• Physical Therapy Korea
• /
• v.4 no.3
• /
• pp.45-60
• /
• 1997

This study was performed to determine the inter-rater reliability of the Chedoke-McMaster Stroke Assessment translated in Korean. This measures the physical impairments and disabilities that impact on the lives of individuals with stroke. The purposes of this measure were 1) to stage motor recovery to classify individuals in terms of clinical characteristics, 2) to predict rehabilitation outcomes, and 3) to measure clinically important change in physical function. Twenty-two subjects from physical therapy unit were assessed by two physical therapists. The ratings were compared by Spearman's rank correlation The correlation between two raters ranged from 0.85 to 0.98. Inter-rater reliability coefficient for total scores ranged from 0.95 to 0.97. This study confirms that the Chedoke-McMaster Stroke Assessment yields reliable results.

• The Journal of Korean Physical Therapy
• /
• v.27 no.5
• /
• pp.311-314
• /
• 2015

Purpose: This study attempted to determine intra-rater reliability and inter-rater reliability for measurement of foot form using the FPI-6 (Foot Posture Index) in patients with hemiplegia caused by stroke. Methods: Twenty two stroke patients were recruited into the research and their foot posture was evaluated using the FPI. Two raters assessed 6 items sequentially in accordance with the FPI-6 manual. This procedure involved asking the subject to take several steps in-place, prior to settling into a comfortable stance position with double limb support. Subjects were instructed to stand still with their arms by their sides and look straight ahead. FPI-6 values ranged from -2 to +2 for each of the six criteria and from -12 to +12 for the total score, indicating a position for each foot either along the supinated (negative score) to pronated (more than +6) continuum of foot posture. Results: The results showed that intra-rater reliability and inter-rater reliability for a total FPI-6 score was high: 0.807-0.888. An almost perfect agreement between the two raters was identified in the foot's morphological classification (Somer's D=0.712; p<0.05). Intra-percentage agreement was high (88.6%). Conclusion: The FPI-6 is a quick, simple, and reliable clinical tool with demonstrated good to excellent intra-rater reliability and good inter-rater reliability when used in assessment of the stroke patient's foot.

• Journal of Korean Clinical Nursing Research
• /
• v.21 no.2
• /
• pp.207-214
• /
• 2015

Purpose: This study was aimed to investigate the effect of an education program on inter-rater agreement of Neonatal/Infant Braden Q Scale for clinical nurses working at a neonatal intensive care unit (NICU). Methods: This was single-arm pre and post experimental study. The participants were 12 nurses and 128 hospitalized neonates at a NICU from December, 2012 to March, 2013. Twelve nurses were divided into four different groups; for two groups were assigned nurses with 3 to 5 years of clinical experiences, and for the others with less than 1 year of clinical experience. The interventions were given by one wound ostomy specialist and two NICU nurses with over 5 years of clinical experiences for 1 hour twice. The inter-rater agreement was measured by intraclass-correlation coefficient. Results: Overall inter-rater agreement was improved from .87(95% CI: .80~.92) at the pre-test to .94(.91~.96) at post-test. Each inter-rater agreement except moisture and nutrition was also improved. Conclusion: The developed education program on scoring for Neonatal/Infant Braden Q scale was effective to improve the inter-rater agreement among clinical nurses. We suggest to privide an education for NICU nurse before using the Neonatal/Infant Braden Q scale in clinical settings.

• The Journal of Korean Physical Therapy
• /
• v.32 no.2
• /
• pp.88-93
• /
• 2020

Purpose: This study examined the inter-rater reliability of cervical proprioception, dynamic balance ability, and ankle dorsiflexion range of motion using STARmat^®, which is a practical clinical tool that can provide practitioners and patients with quantitative and qualitative results. Methods: Thirty healthy young subjects were enrolled in this study, and two well-trained physical therapists participated as a tester. Two testers measured the cervical joint position error at the starting position after neck flexion, extension, side bending, and rotation; three dynamic balance tests, including anterior excursion, anterior reaching with single leg balance, and posterior diagonal excursion; and ankle dorsiflexion range of motion using STARmat^®. The intra-class correlation coefficient (ICC) was used to determine the inter-rater reliability of the tests. Results: The inter-rater reliability for the cervical proprioception ranged from moderate to good (0.66 to 0.83), particularly for flexion (0.82), extension (0.70), right side bending (0.73), left side bending (0.71), right rotation (0.83), and left rotation (0.66). For the dynamic balance, the inter-rater reliability ranged from good to excellent (0.87 to 0.91), particularly for anterior excursion (0.86), posterior diagonal excursion (0.87 to 0.89), and anterior reaching with a single leg balance (0.90 to 0.91). In addition, for the ankle dorsiflexion range of motion, the ICC for the inter-rater reliability ranged from 0.95 to 0.96. Conclusion: STARmat^® is a reliable tool for measuring cervical proprioception, dynamic balance tests, and ankle dorsiflexion range of motion in healthy young adults.

• Physical Therapy Korea
• /
• v.17 no.3
• /
• pp.1-10
• /
• 2010

The purpose of this study was to measure intra-rater and inter-rater reliability and range of motion for measurement of passive shoulder internal rotation range of motion and to compare anterior glide distance of humeral head in three methods. Fifty healthy subjects and fifty patients with shoulder musculoskeletal pain were recruited for this study. The subjects' passive shoulder internal rotation range of motion was measured by visual estimation, manual stabilization, and pressure biofeedback unit methods. In two trials, measurements were performed on each subject by two examiners. Intraclass correlation coefficient (ICC(3,1)) was used to determine the reliability of each measurement. The intra-rater reliability of the three methods was excellent (ICC=.77~.93) in both groups. The inter-rater reliability of the visual estimation method was poor (ICC=.20, .29), the manual scapular stabilization method was poor and fair (ICC=.09, .50), and the pressure biofeedback unit method was excellent (ICC .86, .75) in the experimental and control groups. In the experimental group, the difference of examined range of motion by each examiner was significant in the visual estimation method and manual scapular stabilization method, but there was an insignificant difference between the groups is the pressure biofeedback unit method. This result suggests that the intra-rater and inter-rater reliability of a pressure biofeedback unit was better than the other methods. The difference in distance of the anterior glide of humeral head was insignificant among all the methods. The pressure biofeedback unit method was the most reliable method, so it is proposed to be a new and reliable method to measure internal rotation range of motion.

• Physical Therapy Rehabilitation Science
• /
• v.6 no.1
• /
• pp.7-13
• /
• 2017

Objective: The aim of this study was to investigate the inter-rater and intra-rater reliability of rehabilitative ultrasound imaging (RUSI) for measurement of muscle thickness with changes in angles of the gluteus maximus (GM) at rest and during contraction. Design: Cross-sectional study. Methods: Twenty-two healthy men volunteered for this study. GM muscle images were obtained in the resting position and during prone hip extension with knee flexion at hip abduction angles of $0^{\circ}$ and $30^{\circ}$, respectively. Two examiners randomly measured the thickness of the GM twice in three different positions. The first position was a comfortable prone position. The second position was prone hip extension with knee flexion (PHEKF) to $90^{\circ}$. The third position was achieved by hanging a 1-kg weight on the ankle of the lifted leg during PHEKF with the angle of the lifted leg the same as the second position. Intra-class correlation coefficients (ICCs), standard error measurements, and minimal detectable changes were used to estimate reliability. Results: The intra-rater reliability ICCs (95% confidence interval) of the GM were >0.870, indicating good reliability. Inter-rater reliability ICCs ranged from 0.668 to 0.913. The reliability of measurements of muscle thickness at each position was similar to the reliability of the angle change. Differences in muscle thickness and ratios for each position with $0^{\circ}$ and $30^{\circ}$ of hip abduction were not statistically significant. Conclusions: In the present study, the intra-rater reliability of muscle thickness measurements of the GM was good, and the inter-rater reliability was moderate to good. Reliable RUSI measurements of wide and large muscles, such as the GM muscle at rest and during contraction, are feasible. Further investigation is required to establish the reproducibility of the protocols presented in this study.

• Journal of the Korean Society of Physical Medicine
• /
• v.9 no.2
• /
• pp.201-211
• /
• 2014

PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

• The Journal of Korean Physical Therapy
• /
• v.31 no.1
• /
• pp.35-39
• /
• 2019

Purpose: The purpose of this study was to assess the intra-rater and inter-rater reliability and validity of pelvic tilting angle measurements using a smart phone-based inclinometer (Clino) compared to a palpation meter (PALM) in the standing and sitting position. This study used an interchangeable method with Clino to measure the pelvic tilting angle in the standing and sitting positions. Methods: Twenty healthy subjects were recruited. Measurements of the pelvic tilting angle in the standing and sitting positions were obtained by two examiners using the Clino and PALM. A resting session was conducted 10 minutes later to assess the intra and inter rater reliability. To assess validity of the measurement using Clino, a PALM was used as the gold standard. The intra-class correlation coefficient (ICC) was used to determine the intra and inter rater reliability of Clino and a PALM. To assess the validity, the Pearson correlation coefficients were used for two measurement techniques to measure the pelvic tilting angle in the standing and sitting positions. The statistical significance was set to ${\alpha}=0.05$. Results: Measurements of the pelvic tilt had high inter-rater reliability in the standing (ICC=0.82) and sitting (ICC=0.88) positions using Clino and intra-rater reliability in the standing (ICC=0.87) and sitting (ICC=0.91) positions using Clino. Measurements of the pelvic tilt had high validity by a comparison of PALM and Clino in the standing (r=0.83) and sitting (r=0.89) positions (p<0.05). Conclusion: The use of Clino can be recommended as a tool to replace the PALM and measure the pelvic tilt angle in the standing and sitting positions while maintaining the clinical reliability and validity.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.176-189
• /
• 2002

The purpose of the study is to develop major types of scoring rubrics of portfolio system, and estimate the reliability of the rubrics developed. The portfolio system was developed by Science Education Laboratory, Chongju National University of Education in summer, 2000. The portfolio is based on the Unit 2, The Layer and Fossil, and Unit 4, Heat and Change of Objects at fourth-grade level. Four types of scoring rubrics, holistic-general, holistic-specific, analytical-general, and analytical-specific, were developed. Students' portfolios were scored and inter-rater and intra-rater reliability were calculated. To estimate inter-rater reliability, 3 elementary teachers per each rubric(total 12) scored 12 students' portfolios. Teachers who used analytical-specific rubric scored only six portfolios because it took much more time than other rubrics. To estimate intra-rater reliability, second scoring was administered by two raters per rubric in two and half month. The results show that holistic-general rubric has high inter-rater and moderate intra-rater reliability. Holistic-specific rubric shows moderate inter- and intra-rater reliability. Analytical-general rubric has high inter-rater and moderate intra-rater reliability. Analytical-specific rubric shows high inter- and intra-rater reliability. The raters feel that general rubrics seems to be practical but not clear. Specific rubrics provide more clear guidelines for scoring but require more time and effort to develop the rubrics. Analytical-specific rubric requires more than two times of time to score each portfolio and is proved to be highly reliable but less practical.

• Physical Therapy Korea
• /
• v.17 no.1
• /
• pp.62-68
• /
• 2010

The purposes of this study were to examine inter-rater reliability of the Manual Ability Classification System (MACS) by children's age and to identify the correlation between the MACS and the Gross Motor Function Classification System (GMFCS) in children with cerebral palsy (CP). Twenty-six children with CP older than two years participated. Children with CP were classified according to the MACS and the GMFCS by two physical therapists. Inter-rater reliability was analyzed using the Intraclass Correlation Coefficients (ICCs). The results showed that the reliability of the MACS for children aged 2~3 years was .88 and for children aged above 4 years was .98 (p<.05). Children with quadriplegia had a higher level of MACS than children with spastic hemiplegia and diplegia. A moderate relationship between the MACS and the GMFCS was found in all children (rater 1, r=.631; rater 2, r=.438). The MACS will be used for classification of children with CP according to the manual abilities. Thus, it offers a reliable method for communicating between therapists about the manual ability of children with CP who are older than 2 years.