• 한국어교육
• /
• 제29권1호
• /
• pp.85-108
• /
• 2018

This study pointed out the reality that many novice Korean language teachers who lack rater training are scoring the learners' writing skill. The study performed and analyzed a case where pre-service teachers were educated in order to explore the possibility of promoting rater training in a Korean language teacher training course. The pre-service teachers majoring in Korean language education at the graduate school scored TOPIK compositions and were provided feedback by the FACETS program, which were further discussed at the rater meeting. In three scoring processes, the raters scored with conscious of own rating patterns and showed positive change or over correction due to excessive consciousness. Consequentially, ongoing training can improve rating ability, and considering the fact that professional rater training is hard to progress, the method composed of FACETS analysis and rater training revealed positive effects. On the other hand, the rater training including native Korean and non-native(Chinese) speakers together showed no significant difference by mother tongue but by individual difference. This can be interpreted as a positive implication to the rating reliability of non-native speakers possessing advanced Korean language abilities. However, this must be supplemented through extended research.

• 대한한의진단학회지
• /
• 제9권1호
• /
• pp.125-130
• /
• 2005

Background and purpose: We evaluated the reliability of two electrodermal measurement devices on meridian skin areas; Electro Acupuncture according to Dr. Voll (EAV) method and newly developed MIR-1. Methods: Eighteen volunteers were tested repeatedly on the same condition with each device. To explore the intra-rater, inter-rater, and test-retest reliabilities, one rater tested each subject twice in succession, then the other rater tested the subject in a row. Finally, retests on the subjects with each device were performed 1 week later. The reliability was determined by Pearson correlation and intraclass correlation statistics. Results: EAV method showed poor reliability, while MIR-1 showed good reliability. Conclusion: It is suggested that further research on the reliability and useful device in both fields of clinical practice and biomedical research.

• The Journal of Korean Physical Therapy
• /
• 제32권2호
• /
• pp.88-93
• /
• 2020

Purpose: This study examined the inter-rater reliability of cervical proprioception, dynamic balance ability, and ankle dorsiflexion range of motion using STARmat^®, which is a practical clinical tool that can provide practitioners and patients with quantitative and qualitative results. Methods: Thirty healthy young subjects were enrolled in this study, and two well-trained physical therapists participated as a tester. Two testers measured the cervical joint position error at the starting position after neck flexion, extension, side bending, and rotation; three dynamic balance tests, including anterior excursion, anterior reaching with single leg balance, and posterior diagonal excursion; and ankle dorsiflexion range of motion using STARmat^®. The intra-class correlation coefficient (ICC) was used to determine the inter-rater reliability of the tests. Results: The inter-rater reliability for the cervical proprioception ranged from moderate to good (0.66 to 0.83), particularly for flexion (0.82), extension (0.70), right side bending (0.73), left side bending (0.71), right rotation (0.83), and left rotation (0.66). For the dynamic balance, the inter-rater reliability ranged from good to excellent (0.87 to 0.91), particularly for anterior excursion (0.86), posterior diagonal excursion (0.87 to 0.89), and anterior reaching with a single leg balance (0.90 to 0.91). In addition, for the ankle dorsiflexion range of motion, the ICC for the inter-rater reliability ranged from 0.95 to 0.96. Conclusion: STARmat^® is a reliable tool for measuring cervical proprioception, dynamic balance tests, and ankle dorsiflexion range of motion in healthy young adults.

• 대한물리의학회지
• /
• 제9권2호
• /
• pp.201-211
• /
• 2014

PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

• 대한통합의학회지
• /
• 제9권1호
• /
• pp.193-202
• /
• 2021

Purpose : The purpose of this study is to examine inter-and intra-rater reliabilities of myotonometric measurements of tone, elasticity and stiffness for the erector spinae muscles of the young and the elderly populations. Methods : A total of 102 (69 young adults from K university and 33 older adults from the D community center in Daejeon) were enrolled in this study. The two different raters measured each side of the erector spinae muscles at prone position. After each rater performed first measurement for a subject, 30 minutes of rest was given. The same rater then repeated the second myometric measurement on the subject. The collected data on the tone, elasticity, and stiffness of the erector spinae were analyzed using intraclass correlation coefficient (ICC) to determine inter- and intra- rater reliabilities. Results : The inter-and intra-rater reliabilities of the myotonometric measurement of the erector spinae for the total subjects were excellent (ICC > 0.9, p < 0.001). Within each of the elderly group and the young group, inter- and intra-rater reliabilities were also excellent (ICC > 0.8~0.9 / p < 0.001, ICC > 0.75~0.9 / p < 0.001, each). Conclusion : The measurement of muscle tone, elasticity, and stiffness for the erector spinae muscles using the myotonometer had excellent reliability. It was confirmed that a highly reliable myometric measurement on the erector spinae can be obtained regardless of whether it is from young or elderly people. This suggests that the myotonometer can be a useful tool to measure muscular properties of the erector spinae of the young and old as an evaluative instrument.

• 한국전문물리치료학회지
• /
• 제17권3호
• /
• pp.48-58
• /
• 2010

The aim of this study was performed to determine the inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) translated in Korean. This was a new clinical measurement tool for evaluating the recovery of voluntary movement and basic mobility following stroke. A direct-observation reliability study was conducted on 20 patients who had strokes and were in a rehabilitation setting. Subjects were assessed by two physical therapists. The reliability of the STREAM scores was demonstrated by weighted kappa statistics for inter-rater agreement on scores for individual items ranged from .83 to 1.0, intraclass correlation coefficients for total score was .99, and for subscale scores was ranged from .96 to .99. The internal consistency of the STREAM scores was demonstrated by Cronbach alphas of greater than .99 on the subscales and overall. These high levels of reliability support the use of the STREAM translated in Korean instrument for the measurement of motor recovery following stroke.

• 한국과학교육학회지
• /
• 제22권1호
• /
• pp.176-189
• /
• 2002

본 연구의 목적은 초등학교 과학과 포트폴리오를 채점할 수 있는 다양한 채점기준을 개발하고, 개발된 각 채점기준의 신뢰도를 검증해 보고자 하는 것이다. 채점기준을 개발하기 위한 포트폴리오는 4학년 2학기 '단원 2. 지층과 화석', '단원 4. 열과 물체의 변화' 를 중심으로 청주교대 과학교육 연구실에서 2000년 여름에 개발한 체제를 같은 해 가을, 경기도 중도시의 한 초등학교 4학년 한 학급에 적용하여 얻은 것이다. 총괄-일반, 총괄-특수, 분석-일반, 분석-특수의 4가지 채점기준을 개발하고, 각 채점기준에 근거하여 학생들이 작성한 포트폴리오 증거물을 채점하여 각 채점 기준별 채점자간 신뢰도와, 채점자내 신뢰도를 구하였다. 1차 채점에서는 총 12명의 채점자들이 각 채점기준별로 3명씩 그룹을 나누어 그룹당 12권의 포트폴리오 증거물을 채점하였다. 단, 분석-특수 채점기준의 경우 6권의 포트폴리오 증거물만을 채점하였다. 채점자내 신뢰도를 알아보기 위해 실시한 채점시기별 신뢰도에서는 l차 채점에 참가한 채점자 중 각 채점기준별로 2명씩 총 8명이 2차 채점에 참가하여 l차 채점과 동일한 방식으로 채점을 실시하였다. 채점결과를 SPSS 통계 프로그램에 입력하여 상관계수를 구한 결과, 총괄-일반 채점기준은 채점자간 신뢰도가 높고 채점자내 신뢰도가 있는 것으로 나타났고 총괄-특수 채점기준은 채점자간 신뢰도와 채점자내 신뢰도가 있는 것으로 나타났다. 분석-일반 채점기준은 채정자간 신뢰도가 높고 채점자내 신뢰도는 있는 것으로 나타났으며, 분석-특수 채점기준은 채점자간 신뢰도와 채점자내 신뢰도가 모두 높은 것으로 나타났다. 일반적인 채점기준들(총괄-일반, 분석-일반)의 경우, 하나의 채점 기준으로 모든 포트폴리오 목표를 채점할 수 있으므로 매우 경제적이고 실용적이나, 채점자들은 채점시 모호함을 느낀다고 하였다. 반면에, 특수적인 채점기준들(총괄-특수, 분석-특수)의 경우, 채점은 더 명확하게 할 수 있으나, 목표별로 채점기준을 개발해야 하므로 많은 시간과 노력이 필요하게 된다. 채점기준의 실용도 측면에서는 분석-특수 채점기준이 다른 기준보다 2배 이상의 시간이 결려 실용도는 낮은 것으로 나타났다.

• The Journal of Korean Physical Therapy
• /
• 제27권4호
• /
• pp.183-189
• /
• 2015

Purpose: The aim of this study was to examine the test-retest and inter-rater reliability of the pediatric functional muscle testing (PFMT) when applied to children with developmental delay. Methods: Sixteen children with developmental delay (seven females, nine males) participated in this study. For the inter-rater reliability, each was scored on the PMFT by two pediatric physical therapists with more than 8 years of clinical experience on the same day. For assessment of the test-retest reliability, one therapist tested the children again within 10 days. The second measurement was performed by taking a first measurement in video. Intraclass correlation coefficient (ICC) was calculated to determine the test-retest and inter-rater reliability of the PFMT, and Chronbach's alpha was used to measure internal consistency. Results: The results of this study were as follows: 1) The test-retest ICC of the score of the infant action month and the right side of the PFMT was from 0.53 to 1.00 and from 0.63 to 0.99, respectively. 2) The inter-rater ICC of the score of the infant action month and the right side of the PFMT was from 0.66 to 1.00 and from 0.64 to 1.00, respectively. 3) Chronbach's alpha was 0.93. The internal consistency indicated excellent. Conclusion: In conclusion, this study showed that the test-retest and inter-rater reliability of the PFMT was relatively high, except for a few items. Therefore, it can be suggested that the PFMT will be a useful tool for measurement of muscle strength for children with developmental delay if it be some modifications.

• 대한통합의학회지
• /
• 제8권3호
• /
• pp.173-180
• /
• 2020

Purpose : The aim of this study was to assess the intra- and inter-rater reliability and validity of measurements of head, neck, and pelvis posture using a mobile application in subjects with forward head posture. Methods : Forty-eight volunteers (22 men, 26 women) participated in this study. Two raters independently examined whole body picture images in a lateral standing posture with arms crossed using a CA-Smart Posture Reminder (CA-SPR), and a rater took and calculated posture images twice to assess reliability. We measured five parameters: craniovertebral angle 1 (CVA1), anterior shoulder translation (AST), pelvic tilt (PT), knee angle (KA), and ankle angle (AA) in the subject's sagittal plane using CA-SPR. We examined whole spine X-ray images in the same position to assess validity. We measured four variables in the subjects: CVA2, translation distance (AHT), anterior pelvic plane (APP), and sacral slope (SS). The intra- and inter-rater reliability were calculated using the intraclass correlation coefficient (ICC). Convergent validity was calculated using Pearson's correlation coefficient. Results : The intra-rater reliability (ICC=.889 -.989) and inter-rater reliability (ICC=.800 -.980) were excellent for all variables measured using CA-SPR. The variables measured using CA-SPR and X-ray were significantly positively correlated (r=.623, p<.01). However, the correlation of the variables in the pelvis was not statistically significant. Conclusion : This study shows that a mobile application (CA-SPR) is a useful tool for measuring head and neck posture in subjects with forward head posture. However, further study is needed to measure pelvic variables when using a mobile application.

• Physical Therapy Rehabilitation Science
• /
• 제11권4호
• /
• pp.488-492
• /
• 2022

Objective: The purpose of this study is to find out the reliability and validity of the newly updated Balancia 2.5 program using Wii balance board through equipment that can measure center of pressure data with the precision. Design: Cross-sectional study Methods: Twenty-seven healthy adults participated in the study. The subjects were assessed for static balance ability by Accusway, and were assessed for static balance ability on Wii balance board connected to theBalancia 2.5 program.To limit postural fluctuations due to stare, the subjects were asked to look at a 15 cm dot drawn 3 m in front of them for 30 seconds with their eyes open. Static balance ability data such as path length and sway velocity were extracted from all measurement tools.Intra-rater and inter-rater reliability and validity were extracted through intraclass correlation coefficient (ICC) and 95% confidence interval (CI). Results: The intra-rater reliability that the same rater shows consistent results through test-retest was a high level at ICC=0.968 (0.926~0.986), and inter-rater reliability that the requires consistent results even when measured by different raters was a high level at ICC=0.943 (0.870~0.975). The validity was a high level at ICC=0.948 (0.881~0.977), which shows whether the measurement tool is properly measuring what it is intended to measure. Conclusions: The Balancia 2.5 program, newly updated through this study, proved to be a program with high reliability and validity in evaluating static balance ability like the existingBalancia 2.0 program.