• Journal of the Korea Convergence Society
• /
• v.11 no.11
• /
• pp.443-450
• /
• 2020

The purpose of this study was to examine the inter-rater and intra-rater reliability of the oral mucosa pressure ulcer classification system based on the photographs. The study consisted of two stages; development and evaluation. In the developmental stage, 9 photographs of 82 were selected. In the evaluation stage, a total of 49 participants were invited web-based survey by e-mail. Cohen's weighted kappa and Krippendorff's alpha were used to define the inter-rater reliability. Nine photographs consisted of two, three, three, and one in normal, stage 1, stage 2, and stomatitis, respectively. The inter-rater reliabilities of wound care nurse specialist, intensive care nurse specialist, and dentist groups were 0.75, 0.70, and 0.78, respectively. The intra-rater reliability was 0.73. The inter-rater and intra-rater reliabilities of the oral mucosa pressure ulcer classification system showed substantially good agreement.

• The Journal of Korean Physical Therapy
• /
• v.30 no.1
• /
• pp.29-34
• /
• 2018

Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.

• Clinics in Shoulder and Elbow
• /
• v.25 no.1
• /
• pp.3-4
• /
• 2022

• Physical Therapy Korea
• /
• v.17 no.3
• /
• pp.48-58
• /
• 2010

The aim of this study was performed to determine the inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) translated in Korean. This was a new clinical measurement tool for evaluating the recovery of voluntary movement and basic mobility following stroke. A direct-observation reliability study was conducted on 20 patients who had strokes and were in a rehabilitation setting. Subjects were assessed by two physical therapists. The reliability of the STREAM scores was demonstrated by weighted kappa statistics for inter-rater agreement on scores for individual items ranged from .83 to 1.0, intraclass correlation coefficients for total score was .99, and for subscale scores was ranged from .96 to .99. The internal consistency of the STREAM scores was demonstrated by Cronbach alphas of greater than .99 on the subscales and overall. These high levels of reliability support the use of the STREAM translated in Korean instrument for the measurement of motor recovery following stroke.

• Journal of Korean Elementary Science Education
• /
• v.18 no.1
• /
• pp.65-73
• /
• 1999

The purpose of this study is tile development of tile observation Assessment criteria that is used to assess manipulative skills in elementary science. The procedures of developing observation Assessment criteria are as follows. First, we investigated the actual condition about science process skills assessment with tile questionnaire. Second, we selected 7 experimental apparatus through the analysis of the science textbooks. The selected experimental apparatus are dropper, alcohol lamp, thermometer, test tube, filtering device, able balance, graduated cylinder Third, the observation Assessment criteria arc developed through tile analysis of the related experimental textbooks, the demonstrations, and the questionnaire, Forth, tile validity is verified by science education specialists and graduate students who major in science education. Fifth, the first jilter-rater agreement is investigated in the result of the field with observation criteria of which the validity was verified. The second inter-rater agreement is investigated through the revision and the addition of the criteria with the low agreement. In result, the jilter-rater agreement ranged from 0.86 to 0.98. One of the major problems in observation assessment is the rater's subjective viewpoint. So, this research shows a more specified scale and criteria for the assessment. This suggests that the observation Assessment criteria developed in tile study satisfies the high reliability and validity requirements. Considering the results, this criteria call be used effectively for assessing manipulative skills of elementary school students.

• Korean Journal of Radiology
• /
• v.25 no.4
• /
• pp.325-327
• /
• 2024

• The Journal of Korean Physical Therapy
• /
• v.22 no.5
• /
• pp.83-93
• /
• 2010

Purpose: The purpose of this study was to determine the reliability and validity of the Functional Movement Screen (FMS) for assessing Korean athletes. Methods: A total of 48 patients (37 males and 11 females) participated in this study. Data were acquired after translation of the FMS from English to Korean and cross-cultural adaptation of the this questionnaire. To determine inter-rater reliability, the relationship between the FMS scores obtained by two raters was evaluated using the Kappa coefficient, which was in total agreement with the Intra-Correlation Coefficient (ICC3,1). Concurrent validity was examined by correlating the FMS scores with the Oswestry disability index (ODI) scores and Visual analogue scale (VAS) scores. Results: The raters demonstrated excellent agreement on 7 (above 90%) of the 17 test (72.9 to 97.9%) components. Substantial agreement was seen in 11 of the 17 tests. Two components of the In-line lunge and rotatory stability tests demonstrated moderate agreement. It showed good inter-rater reliability: the Kappa coefficients ranged from 0.42 to 0.97. ICC3,1=0.42~0.99 and 0.93 (total FMS score). Cronbach's alpha for FMS was 0.80. It was not correlated with ODI or VAS. Conclusion: The Korean version of the FMS is a reliable instrument for measuring movement patterns of Korean athletes and for making decisions related to interventions for performance enhancement.

• Journal of The Korean Society of Integrative Medicine
• /
• v.5 no.1
• /
• pp.43-53
• /
• 2017

Purpose : To examine the relative absolute reliability and validity of step test (ST) scores in subjects with chronic stroke. Method : A total of 27 stroke patients, participated in the study. A relative reliability index (intraclass correlation coefficient, ICC) was used to examine the level of agreement of inter-rater test-retest reliability for ST score. Absolute reliability indices, including the standard error of measurement(SEM) and the minimal detectable change (MDC), and limits of agreement by Bland and Altman analysis. The validity was demonstrated by spearman correlation of ST score with 10 m Walk Test (10mWT), Fugl-Meyer Assessment-Lower/Extremity (FMA-L/E)-total score, Berg Balance Scale (BBS)-total score. Result : An excellent inter-rater reliability in ST scores was found (paretic, ICC=0.993~0.996; nonparetic, ICC=0.982~0.991). In addition, excellent test-retest reliability was found (paretic, ICC=0.992; nonparetic, ICC=0.967). It all showed acceptable SEM of the ST score as paretic and nonparetic were 0.22 and 0.46 respectively (average score <10 %), and the MDC of the paretic and nonparetic were 0.61 and 1.27 respectively (possible highest score <20 %). indicating that measures had a small and acceptable measurement error. The ST score of paretic and nonparetic were also found to be significantly associated with 10MWT (r=0.77~0.79), FMA-LE scores (r=0.73~0.81) and BBS scores (r=0.72~0.76). Conclusion : The ST showed highly sufficient Inter-rater test-retest agreement and validity and acceptable measurement errors caused by due to chance variation in measurement. It also can be used by clinicians and researchers to assess the balance and mobility performance and monitor functional change in chronic stroke patients.

• Journal of the Korea Society of Computer and Information
• /
• v.20 no.12
• /
• pp.169-174
• /
• 2015

Permutation p-values are provided for the agreement measures for multivariate interval data among many raters. Three agreement measures, Berry and Mielke's measure, Janson and Olsson's measure, and Um's measure are described and compared. Exact and resampling permutation methods are utilized to compute p-values and empirical quantile limits for three measures. Comparisons of p-values demonstrate that resampling permutation methods provide close approximations to exact p-values, and Berry and Mielke's measure and Um's measure show similar performance in terms of measuring agreement.

• Journal of the Korean Society of Physical Medicine
• /
• v.16 no.1
• /
• pp.1-7
• /
• 2021

PURPOSE: The purpose of this study is to conduct inter-rater and intra-rater reliability tests in patients with low back pain (LBP) using the prone instability test (PIT) and side-lying instability test (SIT). We have analyzed the Korean version Oswestry disability index (K-ODI) correlations and radiograph finding (RF) for validity. METHODS: Individuals (n = 51) (mean age of 40.27 ± 13.28) with LBP for at least over a week were recruited, together with two participating physical therapist examiners. The measurement consisted of PIT, PST, K-ODI, and RF. Sensitivity (Sn), specificity (Sp), positive predictive value, negative predictive value, prevalence index, agreement %, Cohen's kappa, and prevalence-adjusted bias-adjusted kappa (PABAK) were calculated. The PIT and SIT were compared with RF for validity analysis, while PIT, SIT, K-ODI, and RF were calculated for the correlation analysis. RESULTS: The intra-rater reliability test measured for the PIT (kappa = .79, PABAK = .88) and SIT (kappa = .73, PABAK = .84), and inter-rater reliability test measured for the SIT (kappa = .80, PABAK = .88) showed good agreements. The PIT (Sn = .65, Sp = .63) and SIT validities (Sn = .68, Sp = .70) were compared with RF, showing a significant correlation in PIT and RF (r = .69), SIT and RF (r = .73), and PIT and K-ODI (r = .53). CONCLUSION: The SIT is a more comfortable position test than the PIT in patients. Both PIT and SIT have acceptable reliability and validity.