• Journal of Preventive Medicine and Public Health
• /
• v.42 no.1
• /
• pp.49-58
• /
• 2009

Objectives : The purpose of the current study was to evaluate the usefulness of the following four comorbidity indices in gastric cancer patients who underwent surgery: Charlson Comorbidity Index(CCI), Cumulative Illness rating scale(CIRS), Index of Co-existent Disease(ICED), and Kaplan-Feinstein Scale(KFS). Methods : The study subjects were 614 adults who underwent surgery for gastric cancer at K hospital between 2005 and 2007. We examined the test-retest and inter-rater reliability of 4 comorbidity indices for 50 patients. Reliability was evaluated with Spearman rho coefficients for CCI and CIRS, while Kappa values were used for the ICED and KFS indices. Logistic regression was used to determine how these comorbidity indices affected unplanned readmission and death. Multiple regression was used for determining if the comorbidity indices affected length of stay and hospital costs. Results : The test-retest reliability of CCI and CIRS was substantial(Spearman rho=0.746 and 0.775, respectively), while for ICED and KFS was moderate(Kappa=0.476 and 0.504, respectively). The inter-rater reliability of the CCI, CIRS, and ICED was moderate(Spearman rho=0.580 and 0.668, and Kappa=0.433, respectively), but for KFS was fair(Kappa=0.383). According to the results from logistic regression, unplanned readmissions and deaths were not significantly different between the comorbidity index scores. But, according to the results from multiple linear regression, the CIRS group showed a significantly increased length of hospital stay(p<0.01). Additionally, CCI showed a significant association with increased hospital costs (p<0.01). Conclusions : This study suggests that the CCI index may be useful in the estimation of comorbidities associated with hospital costs, while the CIRS index may be useful where estimatation of comorbiditie associated with the length of hospital stay are concerned.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.4
• /
• pp.77-92
• /
• 2019

Objective : This study aims to obtain the validation of Korean version of HOME FAST using the translation-back translation process and to evaluate the reliability. Methods : Total three stages were conducted which includes forward translation to Korean, test for degree of understanding of translated version, back translation to English, and then review and proof reading process. 21 occupational therapists were participated in the evaluation of understanding of Korean-translated HOME FAST, then some of expressions were modified for better understanding. Korean version was went through back-translation to English. Similarity between the original version and re-translated version were evaluated. Total 75 data from community dwelling elderly group were collected to assess internal consistency. Two occupational therapists simultaneously evaluated for the inter-rater reliability. Results : 11 items of Korean-translated scale were responded as having confused meaning by occupational therapists. There was some modification on expression. In the evaluation of similarity between original version and re-translated version, 3 items were selected as dissimilar items in terms of syntax and 6 items were selected in terms of semantic similarity. After the repetitive modification process, items were obtained conceptual equivalence between two different languages. Internal consistency was .62(KR20) (p<.01) and inter-rater reliability was .97(ICC) (p<.01). Conclusion : Korean version of HOME FAST was finalized through translation-retranslation process. The conceptual equivalence was established and Korean version showed highly reliable. In further study, The modification of items reflecting Korean house and life style should be conducted.

• The Journal of Korean Physical Therapy
• /
• v.32 no.6
• /
• pp.341-347
• /
• 2020

Purpose: The purpose of this study is to introduce a tool for evaluating eye movement and analyze the reliability of measurement based on 10 cases of evaluating the oculomotor function of children with spastic cerebral palsy Methods: The participants were selected by 6 medical and welfare institutions in Busan as GMFCS grade 1-3 among spastic diplegia and hemiplegia. Seven examiners evaluated 3 children for the evaluation of inter-rater agreement of Ocular Motor Score (OMS) and evaluated the condition of the ocular motor of 10 children using OMS, a re-examination was performed at six weeks after the initial examination. SPSS ver.25.0 was used to calculate the interclass correlation coefficient and Wilcoxon's signed-rank test, Mann Whitney-U test. Results: The inter-rater agreement of OMS was 0.89. Second mean values were decreased compared first examination in motility/ductions/version, saccades and smooth pursuit, but there was no significant difference. Children under 6 years old had a high mean value of saccades in first examination and the motility/ductions/version, fixation, saccades in second examination, but there was no significant difference. Spastic diplegia children's mean values were higher in head posture, fixation in 8 gaze directions than hemiplegia children in both first and second examination, but there were no significant differences. Conclusion: Ocular motor function in 10 children of spastic children who participated in the study and could see that the scores was differed depending on age, type, grade of cerebral palsy. OMS may be available for this purpose.

• Phonetics and Speech Sciences
• /
• v.10 no.1
• /
• pp.75-81
• /
• 2018

Diplophonia is generally defined as the perception of more than one fundamental frequency component in a voice. Its perceptual aspect has traditionally been used to evaluate diplophonia because the perceptions can be easily evaluated, but there are limitations in the validity of the reliability of the intra- and inter-raters, examination situation, and variation of voice sample. Therefore, the purpose of this study is to confirm the reliability and accuracy of auditory perceptual evaluation by comparing non-invasive indirect assessment methods (sound waveform and EGG analysis), and to identify their usefulness with diplophonia. A total of 28 diplophonic voices and 39 non-periodic voices were assessed. Three raters assessed the diplophonia by performing an auditory perception evaluation and identifying the quasi-periodic perturbations of the acoustic waveform and EGG. Among the three discrimination methods, intra- and inter-rater reliability, sensitivity, specificity, accuracy, positive likelihood ratio, and negative likelihood ratio were examined, and the McNemar test was performed to compare the discriminant agreement. The accuracy of the auditory perceptual evaluation (86.57%) was not significantly different from that of sound waveform acoustic (88.06%), but it was significantly different from that of EGG (83.33%). The reading time (6.02 s) for the auditory perceptual evaluation was significantly different from that for sound waveform analysis (30.15 s) and EGG analysis (16.41 s). In the discrimination of diplophonia, auditory perceptual evaluation has sufficient reliability and accuracy as compared to sound waveform and EGG. Since immediate feedback is possible, auditory perceptual evaluation is more convenient. Therefore, it can continue to be used as a tool to discriminate diplophonia in clinical practice.

• Korean Journal of Child Studies
• /
• v.35 no.5
• /
• pp.37-61
• /
• 2014

The purpose of the present study was to conduct a preliminary study for developing a Korean version of the Fine Motor Scale of the Bayley Scales of Infant and Toddler Development, $3^{rd}$ Edition(Bayley-III). The subjects for this study included 313 Korean infants and toddlers aged from 16 days to 42 months and 15 days. The results of this study were as follows. Firstly, the analysis of the degree of item difficulty indicated that the arrangement of the items corresponded with child development by age. Secondly, the analysis of the inter-item consistency, the test-retest reliability and the inter-rater reliability revealed a high degree of reliability of the scale. Thirdly, the Fine Motor Scale of K-Bayley-III score showed a significant high correlation with the Motor composite score but a significant moderate correlation with the Language composite score, providing evidence of its convergent and discriminant validity. This study demonstrated that the preliminary version of the K-Bayley-III Fine Motor Scales can be applied to assess the development of fine motor skills of Korean infants and toddlers.

• Physical Therapy Korea
• /
• v.20 no.3
• /
• pp.54-61
• /
• 2013

This study was to determine the reliability and validity of manual measurements of patellar height to standard radiographic measurements in 30 knees of 15 subjects. Patellar height was measured using manual and radiographic methods. The manual measurements were performed by two examiners using digital vernier calipers with the subject sitting and the knees in $30^{\circ}$ of flexion. The radiographic measurements were performed in the same position. The reliability of the manual measurements was assessed by means of intraclass correlation coefficients [ICC(3,1)], and the validity was investigated using the Pearson's product-moment correlation coefficient and an independent t-test. The intra- and inter-rater reliabilities of the manual measurement of patellar height were excellent (ICC=.86 and .88 respectively). The validity of patellar height measured manually compared to the radiographic method was good (Pearson's r=.69). In conclusion, the manual method is an objective, qualitative measurement of patella height.

• Korean Journal of Child Studies
• /
• v.37 no.6
• /
• pp.35-56
• /
• 2016

Objective: This study aimed to develop and validate the Childcare Adaptation Scale for Infants and Toddlers (CASIT), which is rated by teachers of Korean children. Methods: The participants consisted of 326 childcare teachers working with infants (ages 0-2 years). Content validity, discriminant validity, convergent validity, concurrent validity, internal consistency, inter-rater reliability, and item discrimination were examined using PASW 18.0 and AMOS 19.0. Results: The results of an exploratory factor analysis identified the 29-item scale and six dimensions of the scale, including group life adaptation, negative behaviors, positive affect, regular routines, activity/interest, and peer interaction. Convergent validity was examined via confirmatory factor analysis, average variation extracted (AVE), and construct reliability, and acceptable evidences of convergent validity was established. The scales were shown to be highly consistent internally and among raters. Also, the mean between the upper group and lower group of each item regarding item discrimination showed a significant difference. Conclusion: It was concluded that the CASIT, which is a quick and convenient tool for teachers to use, is a valid and reliable instrument.

• The Mathematical Education
• /
• v.57 no.3
• /
• pp.215-229
• /
• 2018

Despite the importance of learning to do mathematical proofs, researchers have reported that not only secondary school students but also undergraduate students have difficulties in learning proofs. In this study, we introduced a new toll for learning proofs and explored the reliability and the validity of peer assessment on proofs. In the course of a university in Seoul, students were given weekly proof assignments prior to class. After solving the proofs, each student had to assess other students' proofs. The inter-rater reliabilities of weekly peer assessment was higher than .9 over 90 percent of the observed cases. To examine the validity of peer assessment, we check whether students' assessments were similar to expert assessment. Analysis showed that the equivalence has been quite high throughout the semester and the validity was low in the middle of the semester but rose by the end of the semester. Based on these results, we believe instructors can consider the application of peer assessment on proving tasks as a tool to help students learn.

• Korean Journal of Radiology
• /
• v.25 no.4
• /
• pp.351-362
• /
• 2024

Objective: To measure inter-reader agreement and identify associated factors in interpreting complete response (CR) on magnetic resonance imaging (MRI) following chemoradiotherapy (CRT) for rectal cancer. Materials and Methods: This retrospective study involved 10 readers from seven hospitals with experience of 80-10210 cases, and 149 patients who underwent surgery after CRT for rectal cancer. Using MRI-based tumor regression grading (mrTRG) and methods employed in daily practice, the readers independently assessed mrTRG, CR on T2-weighted images (T2WI) denoted as mrCR_T2W, and CR on all images including diffusion-weighted images (DWI) denoted as mrCR_overall. The readers described their interpretation patterns and how they utilized DWI. Inter-reader agreement was measured using multi-rater kappa, and associated factors were analyzed using multivariable regression. Correlation between sensitivity and specificity of each reader was analyzed using Spearman coefficient. Results: The mrCR_T2W and mrCR_overall rates varied widely among the readers, ranging 18.8%-40.3% and 18.1%-34.9%, respectively. Nine readers used DWI as a supplement sequence, which modified interpretations on T2WI in 2.7% of cases (36/1341 [149 patients × 9 readers]) and mostly (33/36) changed mrCR_T2W to non-mrCR_overall. The kappa values for mrTRG, mrCR_T2W, and mrCR_overall were 0.56 (95% confidence interval: 0.49, 0.62), 0.55 (0.52, 0.57), and 0.54 (0.51, 0.57), respectively. No use of rectal gel, larger initial tumor size, and higher initial cT stage exhibited significant association with a higher interreader agreement for assessing mrCR_overall (P ≤ 0.042). Strong negative correlations were observed between the sensitivity and specificity of individual readers (coefficient, -0.718 to -0.963; P ≤ 0.019). Conclusion: Inter-reader agreement was moderate for assessing CR on post-CRT MRI. Readers' varying standards on MRI interpretation (i.e., threshold effect), along with the use of rectal gel, initial tumor size, and initial cT stage, were significant factors associated with inter-reader agreement.

• Advances in Traditional Medicine
• /
• v.6 no.2
• /
• pp.112-120
• /
• 2006

The purpose of this study was to analyze whether quantitative evaluation of the color of the tongue substance using $L^*a^*b^*$ color coordinates system could minimize the problems arising from the different illuminating conditions or not. In controlled 4 different illuminating conditions (by natural light, flashlight, f-number, shutter speed),12 healthy subjects were photographed of their tongue substance through a digital camera (C-2100uz, Olympus Co.), both on the top surface and on the bottom surface of the tongue substance by two examiners, twice at 3 day intervals. Clinician evaluation was also performed grading the redness of the tongue substance in the form of 5-points scale by 6 clinicians. As a result, there was no significant difference in color differences between the color of the tongue substance and the reference red card in the 4 different illuminating conditions. Intra-rater reliability was satisfied and even though limitedly, inter-rater reliability was satisfied. Color differences were significantly correlated with the results by the clinicians, although they were applicable limitedly to specific illuminating conditions. Our results indicate that the application of the color differences in tongue diagnosis could not only evaluate the color information quantitatively, but also minimize the problems arising from the different illuminating conditions and that there was the significant difference in the visual evaluation of the red color of the tongue substance, both between the clinicians and between the illuminating conditions.