• 한국전문물리치료학회지
• /
• 제1권1호
• /
• pp.1-9
• /
• 1994

This study was performed to determine the inter-rater reliability of manual tests of elbow, knee flexor, and ankle dorsiflexor muscle spasticity graded on the Modified Ashworth Scale. Two raters each independently graded the spasticity of 32 patients with intracranial lesions after moving the paretic limb passively through the available range of motion. The patients were asked to simultaneously squeeze therapeutic putty with their non-paretic hand for reinforcement. The ratings were compared by the Wilcoxon matched pairs signed-rank test and by the Kendall's coefficient of rank(tau) correlation. There was singificant correlation between two raters for spasticity at the elbow, knee flexor, and ankle dorsiflexor. The correlations of the two raters ranged from .6746 to .9308. The highest correlation was for the elbow with reinforcement and the lowest was for the knee without reinforcement. Poorer correlation was evident in the knee joint. The positive results of this study encourage the continued use of manual tests of muscle spasticity, using the Modified Ashworth Scale.

• Physical Therapy Rehabilitation Science
• /
• 제11권4호
• /
• pp.454-463
• /
• 2022

Objective: The purpose of this study was to compare concurrent validity and test-retest reliability based on Craniovertebral angle of 'Angles video goniometer', a smart phone application for convenient range of motion measurement, and 'Image J', an analysis software with high reliability and validity. This was conducted to find out whether 'Angle video goniometer' can be used clinically. Design: Cross-sectional study Methods: Fifty subjects were imaged laterally, and the angle of the head and spine was measured using Image J and the Angles video goniometer, respectively, in a resting posture and a chin in posture. The level of concurrent validity between the two measurement methods and the level of inter-rater reliability and intra-rater reliability were analyzed. Results: For forty participants, the concurrent validity between Image J and Angles video goniometer showed very high validity with ICC of 0.997(0.995~0.999) and 0.994(0.994~0.998), CVME% 0.71~0.72%, SEM% 0.31~0.34, MDC% 0.86~0.94. The test-retest intra-rater reliability showed very high reliability ICC 0.994(0.991~0.996), CVME% 0.71%, SEM% 0.31~0.43, MDC% 0.86~1.19%. The test-retest inter-rater showed very high reliability ICC 0.995(0.992~0.997), CVME% 0.71%, SEM% 0.43~0.59%, MDC% 1.20~1.62% Conclusions: Angles video goniometer', a smartphone application, is a device with very high reliability and validity for craniovertebral angle measurement in healthy adults, and it is a device that can be easily used in clinical practice.

• 임상간호연구
• /
• 제21권2호
• /
• pp.207-214
• /
• 2015

Purpose: This study was aimed to investigate the effect of an education program on inter-rater agreement of Neonatal/Infant Braden Q Scale for clinical nurses working at a neonatal intensive care unit (NICU). Methods: This was single-arm pre and post experimental study. The participants were 12 nurses and 128 hospitalized neonates at a NICU from December, 2012 to March, 2013. Twelve nurses were divided into four different groups; for two groups were assigned nurses with 3 to 5 years of clinical experiences, and for the others with less than 1 year of clinical experience. The interventions were given by one wound ostomy specialist and two NICU nurses with over 5 years of clinical experiences for 1 hour twice. The inter-rater agreement was measured by intraclass-correlation coefficient. Results: Overall inter-rater agreement was improved from .87(95% CI: .80~.92) at the pre-test to .94(.91~.96) at post-test. Each inter-rater agreement except moisture and nutrition was also improved. Conclusion: The developed education program on scoring for Neonatal/Infant Braden Q scale was effective to improve the inter-rater agreement among clinical nurses. We suggest to privide an education for NICU nurse before using the Neonatal/Infant Braden Q scale in clinical settings.

• The Journal of Korean Physical Therapy
• /
• 제35권6호
• /
• pp.177-184
• /
• 2023

Purpose: The purpose of this study was to compare the concurrent validity and test-retest reliability of 'KPIMT Torticollis Protractor', a smart phone and I-pad application for convenient range of motion measurement, and 'Image J', an analysis software with high reliability and validity, according to head tilt and active cervical rotation angle. This was done to determine the clinical utility of 'KPIMT Torticollis Protractor'. Methods: Head tilt and active cervical spine rotation angles of 40 children with congenital muscular torticollis were measured using Image J and KPIMT Torticollis Protractor, respectively. The level of concurrent validity and inter-rater and intra-rater reliability between the two measurement methods were analyzed. Results: For forty participants, the concurrent validity between Image J and KPIMT Torticollis Protractor showed very high validity with ICC of ICC 0.977 (0.995-0.999), 0.994 (0.994-0.998), CV_ME% 0.71-0.72%, SEM% 0.31-0.34%, MDC% 0.86-0.94%. The test-retest intra-rater reliability showed very high reliability ICC 0.911 (0.911-0.966), CV_ME% 0.71%, SEM% 0.34-0.36%, MDC% 0.81-0.94%. The test-retest inter-rater showed very high reliability ICC 0.936 (0.933-0.957), CV_ME% 0.70%, SEM% 0.34-0.35%, MDC% 0.81-0.83%. Conclusion: The KPIMT Torticollis Protractor, a smart phone and IPD application, is a highly reliable and valid device for angle measurement in children with congenital myotonia and can be easily used in clinical practice.

• 대한통합의학회지
• /
• 제5권1호
• /
• pp.43-53
• /
• 2017

Purpose : To examine the relative absolute reliability and validity of step test (ST) scores in subjects with chronic stroke. Method : A total of 27 stroke patients, participated in the study. A relative reliability index (intraclass correlation coefficient, ICC) was used to examine the level of agreement of inter-rater test-retest reliability for ST score. Absolute reliability indices, including the standard error of measurement(SEM) and the minimal detectable change (MDC), and limits of agreement by Bland and Altman analysis. The validity was demonstrated by spearman correlation of ST score with 10 m Walk Test (10mWT), Fugl-Meyer Assessment-Lower/Extremity (FMA-L/E)-total score, Berg Balance Scale (BBS)-total score. Result : An excellent inter-rater reliability in ST scores was found (paretic, ICC=0.993~0.996; nonparetic, ICC=0.982~0.991). In addition, excellent test-retest reliability was found (paretic, ICC=0.992; nonparetic, ICC=0.967). It all showed acceptable SEM of the ST score as paretic and nonparetic were 0.22 and 0.46 respectively (average score <10 %), and the MDC of the paretic and nonparetic were 0.61 and 1.27 respectively (possible highest score <20 %). indicating that measures had a small and acceptable measurement error. The ST score of paretic and nonparetic were also found to be significantly associated with 10MWT (r=0.77~0.79), FMA-LE scores (r=0.73~0.81) and BBS scores (r=0.72~0.76). Conclusion : The ST showed highly sufficient Inter-rater test-retest agreement and validity and acceptable measurement errors caused by due to chance variation in measurement. It also can be used by clinicians and researchers to assess the balance and mobility performance and monitor functional change in chronic stroke patients.

• 대한한의진단학회지
• /
• 제9권1호
• /
• pp.125-130
• /
• 2005

Background and purpose: We evaluated the reliability of two electrodermal measurement devices on meridian skin areas; Electro Acupuncture according to Dr. Voll (EAV) method and newly developed MIR-1. Methods: Eighteen volunteers were tested repeatedly on the same condition with each device. To explore the intra-rater, inter-rater, and test-retest reliabilities, one rater tested each subject twice in succession, then the other rater tested the subject in a row. Finally, retests on the subjects with each device were performed 1 week later. The reliability was determined by Pearson correlation and intraclass correlation statistics. Results: EAV method showed poor reliability, while MIR-1 showed good reliability. Conclusion: It is suggested that further research on the reliability and useful device in both fields of clinical practice and biomedical research.

• PNF and Movement
• /
• 제19권2호
• /
• pp.279-285
• /
• 2021

Purpose: This study aimed to develop new digital navicular drop test (ND-NDT) equipment and to determine its validity and reliability. Methods: A total of 24 healthy male and female adults, who fully understood the purpose of the study and gave consent to participate in the study, were selected as participants. The NDT and ND-NDT were conducted in the dominant foot of the participants in a random order. For the NDT, the position of the navicular bone was marked with a pen first; then, the height of the navicular bone from the ground was measured in both sitting and standing positions. For the ND-NDT, after the sticker-type reflection markers were attached to the position of the navicular bone, the height of the navicular bone from the ground was measured in both sitting and standing positions. To assess the validity of the diagnostic tests, the same examiner measured the height of the medial longitudinal arch (MLA) three times in both the sitting and standing positions. To assess the inter-rater reliability of the ND-NDT, three examiners, in a random order, attached the sticker-type reflection markers to the position of the navicular bone and then measured the height of the MLA in both positions. Results: In the sitting position, the Pearson correlation coefficient (r) between the two diagnostic tests was very high (r = 0.97) and statistically significant. In the standing position, the Pearson correlation coefficient (r) between the two tests was 0.95, which was also statistically significant. The ICC_2,1 values in the sitting and standing positions were 0.93 and 0.95, respectively, indicating significantly high inter-rater reliability. Conclusion: The ND-NDT equipment showed very high diagnostic validity, as well as excellent inter-rater reliability, indicating the clinical usefulness of the equipment as a diagnostic system for confirming pes planus.

• 한국전문물리치료학회지
• /
• 제9권2호
• /
• pp.133-144
• /
• 2002

The purpose of this study was to establish reliability of the Tone Assessment Scale (TAS) translated into Korean in patients with stroke. The TAS consists of resting posture, response to passive movement, and associated reaction to active effort. Fifteen patients (14 males, 1 female) were examined by two raters. Surface electromyography (EMG) data at elbow flexor muscle and joint excursion were collected from 6 patients. To identify the correlation between muscle activity and angular changes of elbow muscle, Pearson product moment correlation was used. The inter-rater and intra-rater reliability of the TAS ranged from very good to good (K/Kw=.61~1.00 for intra-rater and K/Kw=.73~1.00 for intra-rater comparisons) in the sections of resting posture and associated reaction. However, in the section of response to passive movement, the reliability coefficients ranged from very good to fair (Kw=.29~1.00). In the 11th item, correlation between EMG ratio of elbow flexor and angular changes of elbow joint showed statistically strong positive relationship (r=.94, p<.05). These results indicate that the TAS is selectively reliable in the sections of resting posture and associated reaction.

• Journal of Yeungnam Medical Science
• /
• 제35권1호
• /
• pp.63-69
• /
• 2018

Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

• 중환자간호학회지
• /
• 제5권2호
• /
• pp.61-71
• /
• 2012

Purpose: The aim of this study was to measure the inter-rater reliability of Emergency severity index (ESI) version 4 among triage nurse. Methods: This study was carried out from August 11, 2010 to September 7, 2010 in a regional emergency department. Data collection was done by ten triage nurses who trained ESI v.4. Two research nurses and ten triage nurses scored the ESI version 4 to the patients as references, independently. We calculated the weighted kappa between the triage nurses and research nurses to evaluate the consistency of the ESI v.4. Results: A total of 233 patients were enrolled in this study. Classification of ESI level was as follows - level 1 (0.4%), level 2 (21.0%), level 3 (67.8%), level 4 (9.4%), and level 5 (1.3%). Inter-rater reliability by weighted kappa was 0.79 (95% Confidence Interval= 0.74-0.83) and agreement rate was 87.1%. Under-triage rate by triage nurse was 6.0% and over-triage rate was 6.9%. Conclusion: For this study, inter-rater reliability was measured good level between triage nurses and research nurses in Korean single ED.