• Clinics in Shoulder and Elbow
• /
• v.25 no.4
• /
• pp.321-327
• /
• 2022

Background: Scapular dyskinesis is considered a risk factor for the shoulder pain that may warrant screening for prevention. Clinicians of all experience screen scapular dyskinesis using the scapular dyskinesis test yes-no classification (Y-N), yet its reliability in asymptomatic individuals is unknown. We aimed to establish Y-N's intra- and inter-reliability between students and expert physical therapists. Methods: We utilized a cross-sectional design using consecutive asymptomatic subjects. Six students and two experts rated 100 subjects using the Y-N. Cohen's kappa (κ) and Krippendorff's alpha (K-α) were calculated to determine intra- and inter-rater reliability. Results: Intra- and inter-rater values for experts were κ=0.92 (95% confidence interval [CI], 0.91-0.93) and 0.85 (95% CI, 0.84-0.87) respectively; students were κ=0.77 (95% CI, 0.75-0.78) and K-α=0.63 (95% CI, 0.58-0.67). Conclusions: The Y-N is reliable in detecting scapular dyskinesis in asymptomatic individuals regardless of experience.

• Journal of Korean Academy of Nursing
• /
• v.38 no.3
• /
• pp.474-482
• /
• 2008

Purpose: The purposes of this study were; 1) to test the validity and reliability of the Korean version of Rantz's Observable Indicators of Nursing Home Care Quality Instrument (ONHQ) and 2) to evaluate the quality of Korean nursing homes. Methods: The study employed a three-phase methodological research design. 1) The original instrument of Rantz's. ONHQ was translated into Korean and modified by Korean nursing home experts. 2) A pilot study using the modified instrument was done in 20 nursing homes to examine inter-rater reliability. 3) The validity and reliability were tested.in 98 nursing homes. Results: Seven factors were extracted through factor analysis: 'communication', 'care delivery', 'grooming', 'odor, 'environment-basics', 'environment-access', and 'environment-homelike'. These factors explained 86.07% of the total variance. Cronbach's alpha coefficient of the 30 items was .97 indicating a high internal consistency of the instrument. Inter-rater reliability according to Kappa was .82. The average score of nursing home quality was 112.07 indicating an average range of quality level. Conclusion: The Korean version of the ONHQ was identified as a tool with a high degree of validity and reliability. This tool can be effectively used to assess the quality of nursing homes by professions as well as family members.

• Journal of the Korean Society of Physical Medicine
• /
• v.6 no.4
• /
• pp.475-488
• /
• 2011

Purpose: The aims of the study were to develop and to establish reliability in Korean versions of World Health Organization Disability Assessment Schedule 2.0(KWHODAS 2.0): 12 item-self(12-self) and 12 item-interviewer(12-interviewer) versions. Methods: KWHODAS 2.0: 12-item versions were developed in idiomatic modern Korean with a process involving independent translation, synthesis of the translations, independent back translation, and review by an expert committee to achieve equivalence with the original English. 88 participants were included in the study. 33 of participants filled the 12-self version twice to examine test-retest reliability and 55 of participants were assessed simultaneously by four interviewers using the 12-interviewer version. Intra-rater reliability was evaluated using the intra-class correlation coefficient(ICC) and inter-rater reliability was evaluated using both the ICC and k statistic. Results: Test-retest reliability for the 12-self version was excellent with $ICC_{(2,1)}$ value ranged from 0.94(CI 0.88-0.98) to 0.96(CI 0.90-0.98). Inter-rater reliability for the 12-interviewer version showed excellent agreement with $ICC_{(2,1)}$ from 0.94(CI 0.91-0.96) to 1(CI 1.0-1.0). K value was observed from 0.95 to 1. Conclusion: KWHODAS 2.0: 12-self and 12-interviewer versions were successfully translated and both scales showed excellent reliability. It is now suitable for use in clinical and research applications.

• Physical Therapy Rehabilitation Science
• /
• v.5 no.3
• /
• pp.155-161
• /
• 2016

Objective: This study aimed to investigate the reliability and validity of a personal computer-based muscle viewer (PC-BMW) compared with that of a portable ultrasound (P-US) for measuring upper trapezius (UT) and transversus abdominis (TrA) muscle thickness at rest and during contraction. Design: Observational inter-rater reliability study. Methods: Fifty-five healthy participants (25 men, 30 women) participated in this study. PC-BMW and P-US were randomly measured at the UT and TrA muscles. Two examiners randomly obtained the images of all participants in 3 test sessions lasting 2 days. Intra-class correlation coefficients (ICCs), standard error of measurement, contraction ratio, and correlation were used to estimate reliability and validity. Pearson's correlation coefficients were used to analyze the relationship between muscle thickness measures taken from PC-BMW and P-US. Results: The intra-rater reliability ICCs of UT and TrA muscle thickness for the PC-BMW were >0.995, indicating excellent reliability. Inter-rater reliability ICCs for the PC-BMW ranged from 0.963 to 0.987. The P-US also exhibited high reliability. A high correlation was found between the measurements of the two muscles in PC-BMW and P-US (p<0.01). Conclusions: PC-BMW provides clear and excellent images, is pocket-sized and less expensive than a conventional ultrasound imaging system. PC-BMW can be utilized variously and has the advantage of rehabilitative ultrasound imaging. More research is needed to evaluate the utility of PC-BMW for rehabilitation.

• Journal of The Korean Society of Integrative Medicine
• /
• v.10 no.4
• /
• pp.137-143
• /
• 2022

Purpose : The purpose of this study was to evaluate the reliability analysis of the deep tendon reflex by using electromyography (EMG). Methods : The study was tested on 30 volunteers who are women in their 20s. Using an electronic reflective hammer of EMG, deep tendon reflex was measured on all subjects with the participation of three trained physical therapists as raters. First, the subjects were comfortably seated on a table with their knees bent at 90 °. The three raters tapped the electric hammer at intervals of 10 seconds to avoid habituation until a total of 10 compound muscle action potential records were collected. Intraclass correlation coefficients (ICCs) were calculated to assess the inter-rater reliability of the deep tendon reflex with the use of EMG. The items of analysis included amplitude (mV), latency (ms), duration (ms), and area (mV × ms) of the compound evoked potentials. Results : Based on the average records of 10 compound muscle action potential, excellent reliability (ICC: .912) was achieved in terms of area, and there was good reliability in terms of latency (ICC: .795) and duration (ICC: .800). In the shortest latency of the compound muscle action potential, good reliability was achieved in terms of amplitude (ICC: .865), duration (ICC: .781), and area (ICC: .832). In the amplitude of peak-to-peak of compound muscle action potential, excellent reliability was recorded in terms of amplitude (ICC: .924), and good reliability was recorded in terms of duration (ICC: .801) and area (ICC: .874). Conclusion : The findings in this study indicate that electromyography via an electric hammer is a reliable method of assessing and measuring deep tendon reflexes. Especially, it may be an excellent gauge in the area of average values of the compound muscle action potentials and the amplitude of peak-to-peak of compound muscle action potentials.

• Physical Therapy Rehabilitation Science
• /
• v.8 no.4
• /
• pp.194-201
• /
• 2019

Objective: This study aimed to investigate the reliability and validity of muscle thickness (MT) and pennation angle (PA) measurements of the ankle muscle, including the tibialis anterior (TA) and the medial gastrocnemius (MGCM), using a hands-free fixed probe and to compare it with the conventional linear probe. Design: Observational inter-rater reliability study. Methods: Thirty-three healthy subjects (20 male, 13 female) were included. In all subjects, ultrasound images were acquired from the TA and MGCM using a hands-free fixed probe and a conventional linear probe in random sequence by two examiners at two time-points within a 7-day interval. MT and PA were calculated on the taken images. Intra-class correlation coefficients (ICC), 95% confidence intervals, standard error of measurement and the Pearson's correlation coefficient were used to estimate reliability and validity. And also, Bland-Altman plots were generated for a visual representation of MT and PA at the TA and MGCM. Results: The ICC for all intra-rater reliability was 0.943 to 0.995 and that for all inter-rater reliability was 0.928 to 0.993, indicating excellent reliability. A significantly high correlation was observed between MT and PA at the TA and MGCM with use of the hands-free fixed probe and the conventional linear probe (r>0.938; p<0.001). Conclusions: The hands-free fixed probe provided excellent images for measurement of the MT and PA of the TA and MGCM and is a useful device for making clinical measurements of muscle structure without grasping of the probe.

• The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
• /
• v.26 no.2
• /
• pp.10-18
• /
• 2013

Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

• Journal of Engineering Education Research
• /
• v.15 no.4
• /
• pp.76-84
• /
• 2012

The purpose of this study is to develop an evaluation criteria for students' portfolios in an annual intramural contest. To accomplish the purpose, evaluation categories and their questions were developed after previous literature, ABEEK's evaluation guidelines, and eight Universities' evaluation forms were analyzed. Furthermore, experts' validity tests were completed by showing that the evaluation criteria form was validated with a mean score of 4.24. Also, the inter-rater reliability was turned out with a high score of .86. The interview results by evaluators of students' portfolios made the final version of evaluation criteria form include five evaluation criteria categories and their allotted score portions: overall organization(40), personal information(15), certificates and awards(5), curriculum(15), and extra-curriculum(15). The importance of overall organization was discussed from the perspectives of teachers as well as students.

• The Journal of Korean Physical Therapy
• /
• v.22 no.5
• /
• pp.83-93
• /
• 2010

Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

• The Journal of the Korea Contents Association
• /
• v.20 no.9
• /
• pp.511-519
• /
• 2020

The aim of this study was to translate and validate the revised Nottingham Sensory Assessment(rNSA) in Republic of Korea. A cross-sectional study was conducted to translate the rNSA into Korean using a modified forward/backward translation procedure. Inter-rater and intra-rater reliability, internal consistency, and concurrent validity were investigated to validate the Korean version rNSA. The Korean version rNSA showed excellent inter-rater reliability (r=0.92-1.00) and intra-rater reliability (r=0.93-1.00). Significant correlations were found between sensory assessment results of the Korean version of the rNSA and the Korean Fugl Meyer Assessment Sensory subscales (r=0.96). The Cronbach α value of internal consistency of Korean version rNSA was ranged from 0.73 to 0.90, the value of K-FMA-S was ranged from 0.70 to 0.88. In these results, psychometric properties of the Korean version of the rNSA achieved the standard level and can be feasible in clinical practice to assess sensory function following stroke in Republic of Korea.