• Journal of Korean Physical Therapy Science
• /
• v.4 no.1
• /
• pp.265-289
• /
• 1997

The purpose of this studied was to examine the reliability analysis of the GMFM in children with C.P. The subject of this study were 40 C. P patient who had been hospitalized Department of Sam-Yook Rehabilitation Hospital. Subjects were 28 boys and girls, aged 6 to 8 years. Reliability of each dimension of the GMFM were analyzed using Cronbach coefficients and to examine the intra-rater reliability were using Pearson correlation coefficients. The result of reliability analysis of the GMFM revealed higher reliability values. The reliability of the total dimension score was 95. Test-retest revealed intra-rater correlation coefficients from .71 to .98. The study presents that GMFM is useful in assessment of function of children with C. P by the quantitative description of the function.

• Journal of the Ergonomics Society of Korea
• /
• v.30 no.2
• /
• pp.311-317
• /
• 2011

Objective: The present study was intended to identify (1) the intra- and inter-rater reliabilities of a visual sensibility evaluation protocol and (2) the effects of NaCOC color and scouring method on the visual sensibility of NaCOC. Thirty female participants(20s & 30s) were participated in the visual sensibility evaluation of NaCOC. Background: Interests in naturally colored organic cotton(NaCOC) increase rapidly in parallel with the social trend of eco-friendly living and wellbeing. Method: Three color sets (ivory, green, and coyote-brown) of NaCOC specimens including one untreated and four treated specimens($Na_2CO_3$; NaOH; enzyme; boiling water) were examined in the study. The visual sensibility evaluation was conducted by the test-retest method using nine pairs of bipolar visual sensibility adjectives(bright-dark; clear-murky; heavy-light; vivid-subdued; warm-cool; fresh-stale; strong-weak; showy-plain; and luxurious-cheap). Results: As a result of reliability of a visual sensibility evaluation protocol, inter-rater variability(average SD=1.06) of visual sensibility evaluation was more than 1.4 times the intra-rater variability(average SD=0.74). However, both the sensibility evaluation reliabilities did not show any systematic pattern of changes. Lastly, ANOVA and post-hoc analysis showed that preferred scouring methods for a visual sensibility adjective pair significantly vary depending on NaCOC color. Application: Both the reliability of visual sensibility evaluation protocol and the analysis of proper scoring method of NaCOC in the study would be useful information to design the affective textile.

• Journal of The Korean Association For Science Education
• /
• v.17 no.1
• /
• pp.65-73
• /
• 1997

The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach $\alpha$) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

• Journal of The Korean Society of Integrative Medicine
• /
• v.5 no.1
• /
• pp.43-53
• /
• 2017

Purpose : To examine the relative absolute reliability and validity of step test (ST) scores in subjects with chronic stroke. Method : A total of 27 stroke patients, participated in the study. A relative reliability index (intraclass correlation coefficient, ICC) was used to examine the level of agreement of inter-rater test-retest reliability for ST score. Absolute reliability indices, including the standard error of measurement(SEM) and the minimal detectable change (MDC), and limits of agreement by Bland and Altman analysis. The validity was demonstrated by spearman correlation of ST score with 10 m Walk Test (10mWT), Fugl-Meyer Assessment-Lower/Extremity (FMA-L/E)-total score, Berg Balance Scale (BBS)-total score. Result : An excellent inter-rater reliability in ST scores was found (paretic, ICC=0.993~0.996; nonparetic, ICC=0.982~0.991). In addition, excellent test-retest reliability was found (paretic, ICC=0.992; nonparetic, ICC=0.967). It all showed acceptable SEM of the ST score as paretic and nonparetic were 0.22 and 0.46 respectively (average score <10 %), and the MDC of the paretic and nonparetic were 0.61 and 1.27 respectively (possible highest score <20 %). indicating that measures had a small and acceptable measurement error. The ST score of paretic and nonparetic were also found to be significantly associated with 10MWT (r=0.77~0.79), FMA-LE scores (r=0.73~0.81) and BBS scores (r=0.72~0.76). Conclusion : The ST showed highly sufficient Inter-rater test-retest agreement and validity and acceptable measurement errors caused by due to chance variation in measurement. It also can be used by clinicians and researchers to assess the balance and mobility performance and monitor functional change in chronic stroke patients.

• Journal of Korean Critical Care Nursing
• /
• v.5 no.2
• /
• pp.61-71
• /
• 2012

Purpose: The aim of this study was to measure the inter-rater reliability of Emergency severity index (ESI) version 4 among triage nurse. Methods: This study was carried out from August 11, 2010 to September 7, 2010 in a regional emergency department. Data collection was done by ten triage nurses who trained ESI v.4. Two research nurses and ten triage nurses scored the ESI version 4 to the patients as references, independently. We calculated the weighted kappa between the triage nurses and research nurses to evaluate the consistency of the ESI v.4. Results: A total of 233 patients were enrolled in this study. Classification of ESI level was as follows - level 1 (0.4%), level 2 (21.0%), level 3 (67.8%), level 4 (9.4%), and level 5 (1.3%). Inter-rater reliability by weighted kappa was 0.79 (95% Confidence Interval= 0.74-0.83) and agreement rate was 87.1%. Under-triage rate by triage nurse was 6.0% and over-triage rate was 6.9%. Conclusion: For this study, inter-rater reliability was measured good level between triage nurses and research nurses in Korean single ED.

• Journal of the Korean Society of Physical Medicine
• /
• v.6 no.4
• /
• pp.475-488
• /
• 2011

Purpose: The aims of the study were to develop and to establish reliability in Korean versions of World Health Organization Disability Assessment Schedule 2.0(KWHODAS 2.0): 12 item-self(12-self) and 12 item-interviewer(12-interviewer) versions. Methods: KWHODAS 2.0: 12-item versions were developed in idiomatic modern Korean with a process involving independent translation, synthesis of the translations, independent back translation, and review by an expert committee to achieve equivalence with the original English. 88 participants were included in the study. 33 of participants filled the 12-self version twice to examine test-retest reliability and 55 of participants were assessed simultaneously by four interviewers using the 12-interviewer version. Intra-rater reliability was evaluated using the intra-class correlation coefficient(ICC) and inter-rater reliability was evaluated using both the ICC and k statistic. Results: Test-retest reliability for the 12-self version was excellent with $ICC_{(2,1)}$ value ranged from 0.94(CI 0.88-0.98) to 0.96(CI 0.90-0.98). Inter-rater reliability for the 12-interviewer version showed excellent agreement with $ICC_{(2,1)}$ from 0.94(CI 0.91-0.96) to 1(CI 1.0-1.0). K value was observed from 0.95 to 1. Conclusion: KWHODAS 2.0: 12-self and 12-interviewer versions were successfully translated and both scales showed excellent reliability. It is now suitable for use in clinical and research applications.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.195-199
• /
• 2011

There are many causes for the variation of the result in oral proficiency test such as the examiner, the task, the theme of the interview, and the gender of the participants. Previous literature documents that the rater is an important variable influencing test scores of second language oral proficiency. Although much research in language testing has been conducted concerning rater effect on test scores, there has been little attention paid to the effect of potential rater variables in language testing on their rating process. There are noticeably different contents of the rating scales across different speaking tests developed in different context. Therefore, it would not be appropriate to apply the same rating criteria for various tasks. In conclusion, we need more subject protocol analyses and more thoughtful studies on rating processes. In other words, the oral proficiency test needs a more realistic and valid tool for the assessment of second language proficiency.

• Physical Therapy Rehabilitation Science
• /
• v.5 no.3
• /
• pp.155-161
• /
• 2016

Objective: This study aimed to investigate the reliability and validity of a personal computer-based muscle viewer (PC-BMW) compared with that of a portable ultrasound (P-US) for measuring upper trapezius (UT) and transversus abdominis (TrA) muscle thickness at rest and during contraction. Design: Observational inter-rater reliability study. Methods: Fifty-five healthy participants (25 men, 30 women) participated in this study. PC-BMW and P-US were randomly measured at the UT and TrA muscles. Two examiners randomly obtained the images of all participants in 3 test sessions lasting 2 days. Intra-class correlation coefficients (ICCs), standard error of measurement, contraction ratio, and correlation were used to estimate reliability and validity. Pearson's correlation coefficients were used to analyze the relationship between muscle thickness measures taken from PC-BMW and P-US. Results: The intra-rater reliability ICCs of UT and TrA muscle thickness for the PC-BMW were >0.995, indicating excellent reliability. Inter-rater reliability ICCs for the PC-BMW ranged from 0.963 to 0.987. The P-US also exhibited high reliability. A high correlation was found between the measurements of the two muscles in PC-BMW and P-US (p<0.01). Conclusions: PC-BMW provides clear and excellent images, is pocket-sized and less expensive than a conventional ultrasound imaging system. PC-BMW can be utilized variously and has the advantage of rehabilitative ultrasound imaging. More research is needed to evaluate the utility of PC-BMW for rehabilitation.

• Physical Therapy Rehabilitation Science
• /
• v.8 no.4
• /
• pp.194-201
• /
• 2019

Objective: This study aimed to investigate the reliability and validity of muscle thickness (MT) and pennation angle (PA) measurements of the ankle muscle, including the tibialis anterior (TA) and the medial gastrocnemius (MGCM), using a hands-free fixed probe and to compare it with the conventional linear probe. Design: Observational inter-rater reliability study. Methods: Thirty-three healthy subjects (20 male, 13 female) were included. In all subjects, ultrasound images were acquired from the TA and MGCM using a hands-free fixed probe and a conventional linear probe in random sequence by two examiners at two time-points within a 7-day interval. MT and PA were calculated on the taken images. Intra-class correlation coefficients (ICC), 95% confidence intervals, standard error of measurement and the Pearson's correlation coefficient were used to estimate reliability and validity. And also, Bland-Altman plots were generated for a visual representation of MT and PA at the TA and MGCM. Results: The ICC for all intra-rater reliability was 0.943 to 0.995 and that for all inter-rater reliability was 0.928 to 0.993, indicating excellent reliability. A significantly high correlation was observed between MT and PA at the TA and MGCM with use of the hands-free fixed probe and the conventional linear probe (r>0.938; p<0.001). Conclusions: The hands-free fixed probe provided excellent images for measurement of the MT and PA of the TA and MGCM and is a useful device for making clinical measurements of muscle structure without grasping of the probe.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.14
• /
• pp.5759-5765
• /
• 2014

Electrical impedance tomography (EIT) is a potential supplement for mammogram screening. This study aimed to evaluate and feasibility of EIT as opposed to mammography and to determine pain perception with both imaging methods. Women undergoing screening mammography at the Radiology Department of National University of Malaysia Medical Centre were randomly selected for EIT imaging. All women were requested to give a pain score after each imaging session. Two independent raters were chosen to define the image findings of EIT. A total of 164 women in the age range from 40 to 65-year-old participated and were divided into two groups; normal and abnormal. EIT sensitivity and specificity for rater 1 were 69.4% and 63.3, whereas for rater 2 they were 55.3% and 57.0% respectively. The reliability for each rater ranged between good to very good (p<0.05). Quantitative values of EIT showed there were significant differences in all values between groups (ANCOVA, p<0.05). Interestingly, EIT scored a median pain score of $1.51{\pm}0.75$ whereas mammography scored $4.15{\pm}0.87$ (Mann Whitney U test, p<0.05). From these quantitative values, EIT has the potential as a health discriminating index. Its ability to replace image findings from mammography needs further investigation.