• The Journal of Korean society of community based occupational therapy
• /
• v.7 no.1
• /
• pp.17-24
• /
• 2017

Objective : The purpose of this study was to estimate the reliability of cervical range of motion measurement in healthy adults using smart phone application and goniometer that can be easily applicated in clinical setting. Methods : The cervical range of motion was measured as the flexion, extension, right rotation, left rotation, right lateral flexion, and left lateral flexion. To measure the reliability of intra-rater and inter-rater reliability, the same examiner performed two measurements and the other examiner performed once, total measurement were performed three times. The order of tests was randomized and two examiners didn't know the results of measurements. Results : Thirty healthy adults were participated. The result of this study shows that there were are no significant differences in all movements except the right lateral flexion in comparison of average angle of smart phone application and goniometer. The intra-rater reliability of smart phone application and goniometer showed ICC as .841~.958 and the inter-rater reliability showed ICC as .720~.944 for all movements. Conclusion : These results suggest that smart phone application and goniometer have proven to be reliable in measuring the cervical range of motion. Smart phone application can be used as a useful tool in clinical setting due to fast and accurate measurements of cervical range of motion.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.2
• /
• pp.311-317
• /
• 2011

Objective: The present study was intended to identify (1) the intra- and inter-rater reliabilities of a visual sensibility evaluation protocol and (2) the effects of NaCOC color and scouring method on the visual sensibility of NaCOC. Thirty female participants(20s & 30s) were participated in the visual sensibility evaluation of NaCOC. Background: Interests in naturally colored organic cotton(NaCOC) increase rapidly in parallel with the social trend of eco-friendly living and wellbeing. Method: Three color sets (ivory, green, and coyote-brown) of NaCOC specimens including one untreated and four treated specimens($Na_2CO_3$; NaOH; enzyme; boiling water) were examined in the study. The visual sensibility evaluation was conducted by the test-retest method using nine pairs of bipolar visual sensibility adjectives(bright-dark; clear-murky; heavy-light; vivid-subdued; warm-cool; fresh-stale; strong-weak; showy-plain; and luxurious-cheap). Results: As a result of reliability of a visual sensibility evaluation protocol, inter-rater variability(average SD=1.06) of visual sensibility evaluation was more than 1.4 times the intra-rater variability(average SD=0.74). However, both the sensibility evaluation reliabilities did not show any systematic pattern of changes. Lastly, ANOVA and post-hoc analysis showed that preferred scouring methods for a visual sensibility adjective pair significantly vary depending on NaCOC color. Application: Both the reliability of visual sensibility evaluation protocol and the analysis of proper scoring method of NaCOC in the study would be useful information to design the affective textile.

• Clinics in Shoulder and Elbow
• /
• v.25 no.4
• /
• pp.321-327
• /
• 2022

Background: Scapular dyskinesis is considered a risk factor for the shoulder pain that may warrant screening for prevention. Clinicians of all experience screen scapular dyskinesis using the scapular dyskinesis test yes-no classification (Y-N), yet its reliability in asymptomatic individuals is unknown. We aimed to establish Y-N's intra- and inter-reliability between students and expert physical therapists. Methods: We utilized a cross-sectional design using consecutive asymptomatic subjects. Six students and two experts rated 100 subjects using the Y-N. Cohen's kappa (κ) and Krippendorff's alpha (K-α) were calculated to determine intra- and inter-rater reliability. Results: Intra- and inter-rater values for experts were κ=0.92 (95% confidence interval [CI], 0.91-0.93) and 0.85 (95% CI, 0.84-0.87) respectively; students were κ=0.77 (95% CI, 0.75-0.78) and K-α=0.63 (95% CI, 0.58-0.67). Conclusions: The Y-N is reliable in detecting scapular dyskinesis in asymptomatic individuals regardless of experience.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.5
• /
• pp.467-474
• /
• 2017

To investigate the intra-rater absolute reliabilities and validity of the Figure of-Eight Walk test (F8WT) in patients with chronic stroke. A total of 36 subjects with chronic stroke participated in this study. The inter-rater reliability of F8WT was calculated using intra-class correlation coefficients($ICC_{2,1}$). Moreover, we used the standard error measurement (SEM) and the small real difference (SRD) to examine the absolute reliability indices. The validity was demonstrated by a spearman correlation of F8WT with Postural Assessment Scale for Storke(PASS) and Trunk Impairment Scale(TIS). The inter-rater reliability of F8WT was excellent; ICC2,1=0.95(0.91~0.97), acceptable SEM=1.02, and SRD=2.82. F8WT were also found to be significantly associated with PASS(r=-0.82) and TIS(r=-0.85). Therefore, F8WT is a reliable measurement tool and is correlated well with stroke-impairments, such as postural and trunk control. F8WT will be a useful tool in evaluating the walking performance of subjects with chronic stroke.

• Journal of Engineering Education Research
• /
• v.15 no.4
• /
• pp.76-84
• /
• 2012

The purpose of this study is to develop an evaluation criteria for students' portfolios in an annual intramural contest. To accomplish the purpose, evaluation categories and their questions were developed after previous literature, ABEEK's evaluation guidelines, and eight Universities' evaluation forms were analyzed. Furthermore, experts' validity tests were completed by showing that the evaluation criteria form was validated with a mean score of 4.24. Also, the inter-rater reliability was turned out with a high score of .86. The interview results by evaluators of students' portfolios made the final version of evaluation criteria form include five evaluation criteria categories and their allotted score portions: overall organization(40), personal information(15), certificates and awards(5), curriculum(15), and extra-curriculum(15). The importance of overall organization was discussed from the perspectives of teachers as well as students.

• Speech Sciences
• /
• v.10 no.2
• /
• pp.159-168
• /
• 2003

The purpose of this study was to assess the speech rate, fluency and the type of dysfluencies of normal adults in order to provide a basic data of normal speaking. The number of subjects of this study were 30(14 females and 16 males), and their ages ranged 17 to 36. The rate was measured as syllables per minute (SPM). The speech rates in reading ranged 273-426 with a mean of 348 SPM and in speaking ranges 118-409 (mean=265). The average of their fluencies was 99.1% in reading and 96.9% in speaking. The rater reliability of speech rate in the data assessed by video was very high (r=0.98) and the rater reliability of speech fluency was moderately high (r=0.67). The disfluency types were also analysed from 150 disfluency episodes. Syllable repetition and word interjection were the most common disfluent types.

• Journal of Korean Elementary Science Education
• /
• v.18 no.1
• /
• pp.65-73
• /
• 1999

The purpose of this study is tile development of tile observation Assessment criteria that is used to assess manipulative skills in elementary science. The procedures of developing observation Assessment criteria are as follows. First, we investigated the actual condition about science process skills assessment with tile questionnaire. Second, we selected 7 experimental apparatus through the analysis of the science textbooks. The selected experimental apparatus are dropper, alcohol lamp, thermometer, test tube, filtering device, able balance, graduated cylinder Third, the observation Assessment criteria arc developed through tile analysis of the related experimental textbooks, the demonstrations, and the questionnaire, Forth, tile validity is verified by science education specialists and graduate students who major in science education. Fifth, the first jilter-rater agreement is investigated in the result of the field with observation criteria of which the validity was verified. The second inter-rater agreement is investigated through the revision and the addition of the criteria with the low agreement. In result, the jilter-rater agreement ranged from 0.86 to 0.98. One of the major problems in observation assessment is the rater's subjective viewpoint. So, this research shows a more specified scale and criteria for the assessment. This suggests that the observation Assessment criteria developed in tile study satisfies the high reliability and validity requirements. Considering the results, this criteria call be used effectively for assessing manipulative skills of elementary school students.

• Journal of Korean Clinical Nursing Research
• /
• v.21 no.2
• /
• pp.207-214
• /
• 2015

Purpose: This study was aimed to investigate the effect of an education program on inter-rater agreement of Neonatal/Infant Braden Q Scale for clinical nurses working at a neonatal intensive care unit (NICU). Methods: This was single-arm pre and post experimental study. The participants were 12 nurses and 128 hospitalized neonates at a NICU from December, 2012 to March, 2013. Twelve nurses were divided into four different groups; for two groups were assigned nurses with 3 to 5 years of clinical experiences, and for the others with less than 1 year of clinical experience. The interventions were given by one wound ostomy specialist and two NICU nurses with over 5 years of clinical experiences for 1 hour twice. The inter-rater agreement was measured by intraclass-correlation coefficient. Results: Overall inter-rater agreement was improved from .87(95% CI: .80~.92) at the pre-test to .94(.91~.96) at post-test. Each inter-rater agreement except moisture and nutrition was also improved. Conclusion: The developed education program on scoring for Neonatal/Infant Braden Q scale was effective to improve the inter-rater agreement among clinical nurses. We suggest to privide an education for NICU nurse before using the Neonatal/Infant Braden Q scale in clinical settings.

• The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
• /
• v.26 no.2
• /
• pp.10-18
• /
• 2013

Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

• Journal of the Korean Society of Physical Medicine
• /
• v.8 no.1
• /
• pp.137-145
• /
• 2013

PURPOSE: The purpose of this study is to examine assessment of test-retest reliability for 13 items of pediatric balance scales, then the intrarater reliability among the raters. METHODS: Study participants included 6 children with spastic cerebral palsy who could walk. Raters were consist of seventy-four, 2nd year physical therapy major students. The children's ability to achieve physical balance was wideotaped for PBS items. The raters watched the tapes and evlauated each child twice. Test-retest reliability was analyzed using the Spearman correlation, and interrater reliability was analyzed using the Kendall's coefficient of concordance for ranks. RESULTS: The total PBS scores averaged 49.22 and 50.06 for first and second tests. Test-retest reliability of PBS individual items were between low and high. The low itmes were 3 items, and high were 4 itmes. Interrater reliability were low agreement. CONCLUSION: Based on the study, the pediatric balance scale is an effective evaluating tool for measuring functional balance of school age child. However, the agreement of students or beginner's interpretation is necessary in conjunction to this study results. On top of that, it is important to provide detailed explanation and repetitive training, which improves the analysis reliability. Also, each category subscores level for the pediatric balance scale must be examined carefully in conjunction to performing test, only after improving match quality via preceding practice.