• Journal of Preventive Medicine and Public Health
• /
• v.42 no.1
• /
• pp.49-58
• /
• 2009

Objectives : The purpose of the current study was to evaluate the usefulness of the following four comorbidity indices in gastric cancer patients who underwent surgery: Charlson Comorbidity Index(CCI), Cumulative Illness rating scale(CIRS), Index of Co-existent Disease(ICED), and Kaplan-Feinstein Scale(KFS). Methods : The study subjects were 614 adults who underwent surgery for gastric cancer at K hospital between 2005 and 2007. We examined the test-retest and inter-rater reliability of 4 comorbidity indices for 50 patients. Reliability was evaluated with Spearman rho coefficients for CCI and CIRS, while Kappa values were used for the ICED and KFS indices. Logistic regression was used to determine how these comorbidity indices affected unplanned readmission and death. Multiple regression was used for determining if the comorbidity indices affected length of stay and hospital costs. Results : The test-retest reliability of CCI and CIRS was substantial(Spearman rho=0.746 and 0.775, respectively), while for ICED and KFS was moderate(Kappa=0.476 and 0.504, respectively). The inter-rater reliability of the CCI, CIRS, and ICED was moderate(Spearman rho=0.580 and 0.668, and Kappa=0.433, respectively), but for KFS was fair(Kappa=0.383). According to the results from logistic regression, unplanned readmissions and deaths were not significantly different between the comorbidity index scores. But, according to the results from multiple linear regression, the CIRS group showed a significantly increased length of hospital stay(p<0.01). Additionally, CCI showed a significant association with increased hospital costs (p<0.01). Conclusions : This study suggests that the CCI index may be useful in the estimation of comorbidities associated with hospital costs, while the CIRS index may be useful where estimatation of comorbiditie associated with the length of hospital stay are concerned.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.4
• /
• pp.77-92
• /
• 2019

Objective : This study aims to obtain the validation of Korean version of HOME FAST using the translation-back translation process and to evaluate the reliability. Methods : Total three stages were conducted which includes forward translation to Korean, test for degree of understanding of translated version, back translation to English, and then review and proof reading process. 21 occupational therapists were participated in the evaluation of understanding of Korean-translated HOME FAST, then some of expressions were modified for better understanding. Korean version was went through back-translation to English. Similarity between the original version and re-translated version were evaluated. Total 75 data from community dwelling elderly group were collected to assess internal consistency. Two occupational therapists simultaneously evaluated for the inter-rater reliability. Results : 11 items of Korean-translated scale were responded as having confused meaning by occupational therapists. There was some modification on expression. In the evaluation of similarity between original version and re-translated version, 3 items were selected as dissimilar items in terms of syntax and 6 items were selected in terms of semantic similarity. After the repetitive modification process, items were obtained conceptual equivalence between two different languages. Internal consistency was .62(KR20) (p<.01) and inter-rater reliability was .97(ICC) (p<.01). Conclusion : Korean version of HOME FAST was finalized through translation-retranslation process. The conceptual equivalence was established and Korean version showed highly reliable. In further study, The modification of items reflecting Korean house and life style should be conducted.

• English Language & Literature Teaching
• /
• v.12 no.1
• /
• pp.221-238
• /
• 2006

This study investigates the reliability of plagiarism measurement in the ESL essay writing context. The current study aims to address the answers to the following research questions: 1) How does plagiarism measurement affect test reliability in a psychometric view? and 2) how do raters conceive the plagiarism in their analytic scoring? This study uses the mixed-methodology that crosses quantitative-qualitative techniques. Thirty eight international students took an ESL placement writing test offered by the University of Illinois. Two native expert raters rated students' essays in terms of 5 analytic features (organization, content, language use, source use, plagiarism) and made a holistic score using a scoring benchmark. For research question 1, the current study, using G-theory and Multi-facet Rasch model, found that plagiarism measurement threatened test reliability. For research question 2, two native raters and one non-native rater in their email correspondences responded that plagiarism was not a valid analytic area to be measured in a large-scale writing test. They viewed the plagiarism as a difficult measurement are. In conclusion, this study proposes that a systematic training program for avoiding plagiarism should be given to students. In addition, this study suggested that plagiarism is measured reliably in the small-scale classroom test.

• Physical Therapy Korea
• /
• v.20 no.3
• /
• pp.54-61
• /
• 2013

This study was to determine the reliability and validity of manual measurements of patellar height to standard radiographic measurements in 30 knees of 15 subjects. Patellar height was measured using manual and radiographic methods. The manual measurements were performed by two examiners using digital vernier calipers with the subject sitting and the knees in $30^{\circ}$ of flexion. The radiographic measurements were performed in the same position. The reliability of the manual measurements was assessed by means of intraclass correlation coefficients [ICC(3,1)], and the validity was investigated using the Pearson's product-moment correlation coefficient and an independent t-test. The intra- and inter-rater reliabilities of the manual measurement of patellar height were excellent (ICC=.86 and .88 respectively). The validity of patellar height measured manually compared to the radiographic method was good (Pearson's r=.69). In conclusion, the manual method is an objective, qualitative measurement of patella height.

• Korean Journal of Child Studies
• /
• v.37 no.6
• /
• pp.35-56
• /
• 2016

Objective: This study aimed to develop and validate the Childcare Adaptation Scale for Infants and Toddlers (CASIT), which is rated by teachers of Korean children. Methods: The participants consisted of 326 childcare teachers working with infants (ages 0-2 years). Content validity, discriminant validity, convergent validity, concurrent validity, internal consistency, inter-rater reliability, and item discrimination were examined using PASW 18.0 and AMOS 19.0. Results: The results of an exploratory factor analysis identified the 29-item scale and six dimensions of the scale, including group life adaptation, negative behaviors, positive affect, regular routines, activity/interest, and peer interaction. Convergent validity was examined via confirmatory factor analysis, average variation extracted (AVE), and construct reliability, and acceptable evidences of convergent validity was established. The scales were shown to be highly consistent internally and among raters. Also, the mean between the upper group and lower group of each item regarding item discrimination showed a significant difference. Conclusion: It was concluded that the CASIT, which is a quick and convenient tool for teachers to use, is a valid and reliable instrument.

• The Mathematical Education
• /
• v.57 no.3
• /
• pp.215-229
• /
• 2018

Despite the importance of learning to do mathematical proofs, researchers have reported that not only secondary school students but also undergraduate students have difficulties in learning proofs. In this study, we introduced a new toll for learning proofs and explored the reliability and the validity of peer assessment on proofs. In the course of a university in Seoul, students were given weekly proof assignments prior to class. After solving the proofs, each student had to assess other students' proofs. The inter-rater reliabilities of weekly peer assessment was higher than .9 over 90 percent of the observed cases. To examine the validity of peer assessment, we check whether students' assessments were similar to expert assessment. Analysis showed that the equivalence has been quite high throughout the semester and the validity was low in the middle of the semester but rose by the end of the semester. Based on these results, we believe instructors can consider the application of peer assessment on proving tasks as a tool to help students learn.

• Physical Therapy Korea
• /
• v.16 no.4
• /
• pp.1-7
• /
• 2009

The active-knee-extension (AKE) test has been used to measure hamstring muscle length. The traditional AKE test measures the popliteal angle to the point of resistance with a 90-degree flexion of the hip fixed by straps, while the stabilized AKE test measures the popliteal angle to the point of resistance with a 90-degree flexion of the hip stabilized using a pressure biofeedback unit providing lumbopelvic stabilization. The purpose of this study was to determine test-retest reliability of the traditional AKE test and stabilized AKE test. Twenty healthy adults participated in the study. The popliteal angles were measured with a digital inclinometer during each test. To assess the test-retest reliability between the 2 test sessions, intraclass correlation coefficients (ICCs) were calculated. The intrasubject coefficient of variation ($CV_{intra}$) was also calculated. To compare the traditional and stabilized AKE tests for changes in pressure, paired t-tests were applied. The results of this study were as follows: 1) ICCs(3,1) value for test-retest reliability was .96 in the traditional AKE test, and was .98 in the stabilized AKE test. 2) The maximal $CV_{intra}$ was 33.7% in the traditional AKE test and 15.7% in the stabilized AKE test. 3) Differences of $6.1{\pm}2.1$ mmHg in pressure were measured in the traditional AKE test, and differences of $1.2{\pm}1.0$ mmHg in pressure were measured in the stabilized AKE test. The results show the traditional and stabilized AKE test to be highly reliable, with test-retest reliability. However, the stabilized AKE test represented less variation and more stabilization than the traditional AKE test. Further study is needed to measure the inter-rater reliability of the stabilized AKE test for generalization and clinical application.

• Journal of Digital Contents Society
• /
• v.19 no.7
• /
• pp.1405-1412
• /
• 2018

Korean-PEQ (prosthesis evaluation questionnaire) was developed and verified its validity research but, evaluating its reliability applied to the lower extremity amputees have not been conducted. The aim of this study was to apply the Korean-PEQ for lower extremity amputees to evaluate the reliability. As a result, all of the items responding of Korean-PEQ shown to less than 15% ceiling effect and floor effect. therefore, the results were shown to be appropriate. Korean-PEQ reliability of each region of intra-class coefficient was shown to .719(95% CI .600~.811)~920(95%CI .890~.945) and the inter-region reliability was higher as 0.958. Item internal consistency Cronbach's ${\alpha}$ values are shown as higher .910.

• Physical Therapy Korea
• /
• v.18 no.1
• /
• pp.64-73
• /
• 2011

After stroke, many people have problems with balance during movement. Balance is essential for the optimal functioning of the locomotor system and the performance of many activities of daily living. The Functional Gait Assessment (FGA) is a clinical tool for evaluating balance ability during walking. The test consists of ten tasks, seven tasks of the Dynamic Gait Index and three additional tasks. The purpose of this study was to evaluate the reliability and internal consistency of data obtained with the Korean version of the FGA when used with people after suffering a stroke. One-hundred participants, at least three months poststroke and able to walk at least six meters with or without a walking aid, participated in the study (age range=30~83 years; $mean{\pm}SD=58.8{\pm}10.9$). Two physical therapists and two physical therapy students rated the FGA. Intrarater and interrater reliability of the FGA were assessed using kappa statistic and intraclass correlation coefficients (2,1). The internal consistency of the FGA was assessed using the Cronbach alpha. The Cronbach alpha was good (${\alpha}$=.86~.93). The intrarater (intraclass correlation coefficient=.92~.95) and interrater reliability (intraclass correlation coefficient=.91, .95) of the total scores administered by the therapists and students were good, whereas the reliability for single item scores when administered by the physical therapists was moderate to good (kapa value=.42~.97). This study found that intrarater and interrater reliability for total FGA scores and internal consistency were good. Therefore, the Korean version of the FGA can be used as a reliable tool to assess the functional gait performance of patients after stroke.

• Journal of the Korean Society of Physical Medicine
• /
• v.15 no.2
• /
• pp.83-91
• /
• 2020

PURPOSE: Postural and structural asymmetry due to muscle imbalances around the lower back and pelvis are the causes of back pain. Muscle imbalances in patients with chronic low back pain affect the pelvic tilt and movement, and it is necessary to assess the pelvic movement ability using the appropriate tools to determine the mediating effects of lower back pain. This paper reports the reliability and validity of the Sensbalance Therapy Cushion (STC) for pelvic movement and proprioception. METHODS: In this study, the Wii balance board (WBB) was used as a golden standard for pelvic movement measurements. FABQ, KODI, Myovision, and Pelvic movement were measured in 50 patients with chronic low back pain. The correlation between the lower-back muscle activity and pelvic movement was checked. The pelvic movement parameter was measured twice to determine the intra-rater reliability. RESULTS: The STC showed high test-retest reliability in the pelvic tilt measurements (ICC = .672 - .809). The test-retest reliability of proprioception measurements (ICC = .588 - .859) and reaction time measurements (ICC = .542 - .836) were also high. The relationship between the WBB and STC showed a significant positive correlation with the pelvic tilt test (p < .01). The posterior pelvic tilt and lower-back muscle activity showed a significant negative correlation (p < .01). The pelvic left tilt and lower-back muscle activity showed a significant negative correlation (p < .05). CONCLUSION: The results revealed the high reliability and validity of the STC. Therefore, the STC can be used as an objective measuring device for evaluating pelvic tilt, proprioception, and reaction time in low back pain patients.