• Journal of The Korean Society of Integrative Medicine
• /
• v.5 no.1
• /
• pp.43-53
• /
• 2017

Purpose : To examine the relative absolute reliability and validity of step test (ST) scores in subjects with chronic stroke. Method : A total of 27 stroke patients, participated in the study. A relative reliability index (intraclass correlation coefficient, ICC) was used to examine the level of agreement of inter-rater test-retest reliability for ST score. Absolute reliability indices, including the standard error of measurement(SEM) and the minimal detectable change (MDC), and limits of agreement by Bland and Altman analysis. The validity was demonstrated by spearman correlation of ST score with 10 m Walk Test (10mWT), Fugl-Meyer Assessment-Lower/Extremity (FMA-L/E)-total score, Berg Balance Scale (BBS)-total score. Result : An excellent inter-rater reliability in ST scores was found (paretic, ICC=0.993~0.996; nonparetic, ICC=0.982~0.991). In addition, excellent test-retest reliability was found (paretic, ICC=0.992; nonparetic, ICC=0.967). It all showed acceptable SEM of the ST score as paretic and nonparetic were 0.22 and 0.46 respectively (average score <10 %), and the MDC of the paretic and nonparetic were 0.61 and 1.27 respectively (possible highest score <20 %). indicating that measures had a small and acceptable measurement error. The ST score of paretic and nonparetic were also found to be significantly associated with 10MWT (r=0.77~0.79), FMA-LE scores (r=0.73~0.81) and BBS scores (r=0.72~0.76). Conclusion : The ST showed highly sufficient Inter-rater test-retest agreement and validity and acceptable measurement errors caused by due to chance variation in measurement. It also can be used by clinicians and researchers to assess the balance and mobility performance and monitor functional change in chronic stroke patients.

• Physical Therapy Rehabilitation Science
• /
• v.8 no.4
• /
• pp.194-201
• /
• 2019

Objective: This study aimed to investigate the reliability and validity of muscle thickness (MT) and pennation angle (PA) measurements of the ankle muscle, including the tibialis anterior (TA) and the medial gastrocnemius (MGCM), using a hands-free fixed probe and to compare it with the conventional linear probe. Design: Observational inter-rater reliability study. Methods: Thirty-three healthy subjects (20 male, 13 female) were included. In all subjects, ultrasound images were acquired from the TA and MGCM using a hands-free fixed probe and a conventional linear probe in random sequence by two examiners at two time-points within a 7-day interval. MT and PA were calculated on the taken images. Intra-class correlation coefficients (ICC), 95% confidence intervals, standard error of measurement and the Pearson's correlation coefficient were used to estimate reliability and validity. And also, Bland-Altman plots were generated for a visual representation of MT and PA at the TA and MGCM. Results: The ICC for all intra-rater reliability was 0.943 to 0.995 and that for all inter-rater reliability was 0.928 to 0.993, indicating excellent reliability. A significantly high correlation was observed between MT and PA at the TA and MGCM with use of the hands-free fixed probe and the conventional linear probe (r>0.938; p<0.001). Conclusions: The hands-free fixed probe provided excellent images for measurement of the MT and PA of the TA and MGCM and is a useful device for making clinical measurements of muscle structure without grasping of the probe.

• Physical Therapy Korea
• /
• v.6 no.3
• /
• pp.51-58
• /
• 1999

In general, sitting balance is decreased in subjects with spinal cord injury. The purpose of this study was to evaluate the inter- and intra-rater reliability of the Functional Reach Test (FRT) which is used to measure sitting balance. The subjects of this study were 26 persons with spinal cord injury, and they were divided into three groups according to their injury level. Group I, II and III consisted of the following $C_5{\sim}C_8$ quadriplegics, $T_1{\sim}T_4$, and $T_9{\sim}T_12$ paraplegics, respectively. Subjects sat on a mat table that was set at an 80 degree inclination. During three sessions, the length subjects could reach in the FRT test was measured by three physical therapists, and compared to each other. The results showed that intraclass correlation coefficients (2,1) were above 0.97 and inter-rater difference was not statistically significant. The one-way ANOVA demonstrated that reach differed between groups with lower thoracic lesion and the other test groups. In conclusion, we think modified FRT is useful and reliable method to measure the sitting balance in subjects with spinal cord injury.

• Physical Therapy Korea
• /
• v.1 no.1
• /
• pp.1-9
• /
• 1994

This study was performed to determine the inter-rater reliability of manual tests of elbow, knee flexor, and ankle dorsiflexor muscle spasticity graded on the Modified Ashworth Scale. Two raters each independently graded the spasticity of 32 patients with intracranial lesions after moving the paretic limb passively through the available range of motion. The patients were asked to simultaneously squeeze therapeutic putty with their non-paretic hand for reinforcement. The ratings were compared by the Wilcoxon matched pairs signed-rank test and by the Kendall's coefficient of rank(tau) correlation. There was singificant correlation between two raters for spasticity at the elbow, knee flexor, and ankle dorsiflexor. The correlations of the two raters ranged from .6746 to .9308. The highest correlation was for the elbow with reinforcement and the lowest was for the knee without reinforcement. Poorer correlation was evident in the knee joint. The positive results of this study encourage the continued use of manual tests of muscle spasticity, using the Modified Ashworth Scale.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.8
• /
• pp.4241-4254
• /
• 2019

The efficiency and accuracy of handwriting measurement could be improved by adopting digital image processing. This study developed a computer-based Korean Handwriting Assessment tool. Second graders participated in this study by performing writing tasks of consonants, vowels, words, and sentences. We extracted boundary parameters for each letter using digital image processing and calculated the variables of size, size coefficient of variation (CV), misalignment, inter-letter space, inter-word space, and ratio of inter-letter space to inter-word space. Children were also administered traditional handwriting and visuomotor tests. Digital variables from image processing were correlated with these previous tests. Using these correlations, we established a three-point scoring system that computed test scores for each variable. We analyzed inter-rater reliability between the computer rater and human rater and test-retest reliability between the first and second performances. The validity was examined by analyzing the relationship between the Korean Handwriting Assessment and previous handwriting and visuomotor tests. We suggested the Korean Handwriting Assessment to measure size, size consistency, misalignment, inter-letter space, inter-word space, and space ratio using digital image processing. This Korean Handwriting Assessment tool proved to have reliability and validity. It is expected to be useful for assessing children's handwriting.

• Journal of Yeungnam Medical Science
• /
• v.35 no.1
• /
• pp.63-69
• /
• 2018

Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

• PNF and Movement
• /
• v.19 no.2
• /
• pp.279-285
• /
• 2021

Purpose: This study aimed to develop new digital navicular drop test (ND-NDT) equipment and to determine its validity and reliability. Methods: A total of 24 healthy male and female adults, who fully understood the purpose of the study and gave consent to participate in the study, were selected as participants. The NDT and ND-NDT were conducted in the dominant foot of the participants in a random order. For the NDT, the position of the navicular bone was marked with a pen first; then, the height of the navicular bone from the ground was measured in both sitting and standing positions. For the ND-NDT, after the sticker-type reflection markers were attached to the position of the navicular bone, the height of the navicular bone from the ground was measured in both sitting and standing positions. To assess the validity of the diagnostic tests, the same examiner measured the height of the medial longitudinal arch (MLA) three times in both the sitting and standing positions. To assess the inter-rater reliability of the ND-NDT, three examiners, in a random order, attached the sticker-type reflection markers to the position of the navicular bone and then measured the height of the MLA in both positions. Results: In the sitting position, the Pearson correlation coefficient (r) between the two diagnostic tests was very high (r = 0.97) and statistically significant. In the standing position, the Pearson correlation coefficient (r) between the two tests was 0.95, which was also statistically significant. The ICC_2,1 values in the sitting and standing positions were 0.93 and 0.95, respectively, indicating significantly high inter-rater reliability. Conclusion: The ND-NDT equipment showed very high diagnostic validity, as well as excellent inter-rater reliability, indicating the clinical usefulness of the equipment as a diagnostic system for confirming pes planus.

• The Journal of Korean Association of Computer Education
• /
• v.17 no.2
• /
• pp.39-51
• /
• 2014

In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

• The Journal of the Korea Contents Association
• /
• v.20 no.9
• /
• pp.511-519
• /
• 2020

The aim of this study was to translate and validate the revised Nottingham Sensory Assessment(rNSA) in Republic of Korea. A cross-sectional study was conducted to translate the rNSA into Korean using a modified forward/backward translation procedure. Inter-rater and intra-rater reliability, internal consistency, and concurrent validity were investigated to validate the Korean version rNSA. The Korean version rNSA showed excellent inter-rater reliability (r=0.92-1.00) and intra-rater reliability (r=0.93-1.00). Significant correlations were found between sensory assessment results of the Korean version of the rNSA and the Korean Fugl Meyer Assessment Sensory subscales (r=0.96). The Cronbach α value of internal consistency of Korean version rNSA was ranged from 0.73 to 0.90, the value of K-FMA-S was ranged from 0.70 to 0.88. In these results, psychometric properties of the Korean version of the rNSA achieved the standard level and can be feasible in clinical practice to assess sensory function following stroke in Republic of Korea.

• Journal of Korean Academy of Nursing
• /
• v.38 no.3
• /
• pp.474-482
• /
• 2008

Purpose: The purposes of this study were; 1) to test the validity and reliability of the Korean version of Rantz's Observable Indicators of Nursing Home Care Quality Instrument (ONHQ) and 2) to evaluate the quality of Korean nursing homes. Methods: The study employed a three-phase methodological research design. 1) The original instrument of Rantz's. ONHQ was translated into Korean and modified by Korean nursing home experts. 2) A pilot study using the modified instrument was done in 20 nursing homes to examine inter-rater reliability. 3) The validity and reliability were tested.in 98 nursing homes. Results: Seven factors were extracted through factor analysis: 'communication', 'care delivery', 'grooming', 'odor, 'environment-basics', 'environment-access', and 'environment-homelike'. These factors explained 86.07% of the total variance. Cronbach's alpha coefficient of the 30 items was .97 indicating a high internal consistency of the instrument. Inter-rater reliability according to Kappa was .82. The average score of nursing home quality was 112.07 indicating an average range of quality level. Conclusion: The Korean version of the ONHQ was identified as a tool with a high degree of validity and reliability. This tool can be effectively used to assess the quality of nursing homes by professions as well as family members.