• Title/Summary/Keyword: Inter-Rater reliability

Search Result 197, Processing Time 0.028 seconds

Reliability and Responsiveness of the Korean Version of the Trunk Impairment Scale for Stroke Patients

  • Ko, Jooyeon;You, Youngyoul
    • The Journal of Korean Physical Therapy
    • /
    • v.27 no.4
    • /
    • pp.175-182
    • /
    • 2015
  • Purpose: The purposes of this study were to develop the Korean version of the trunk impairment scale (K-TIS) and to examine reliability and responsiveness of the K-TIS in patients with stroke. Methods Subjects of the study were 51 stroke patients (mean age: 57.78 years) recruited from two stroke clinics. For the interrater and test-retest reliability, two raters measured the K-TIS two times using video clips with an interval of 2 weeks. For the responsiveness, intensive physical therapy training was provided to all participants 2 times a day for one month or three months depending on the onset of the stroke and the admission rules of the two clinics. Inter-rater reliability and test-retest reliability of the K-TIS three subscales (static sitting balance, dynamic sitting balance, and coordination) scores and total scores were examined using intra-correlation coefficient ($ICC_{3,1}$) and Pearson's correlation coefficient (r). To examine responsiveness, the minimally important difference (MID) was calculated with effect size. Results: Inter-rater reliability of the K-TIS subscales and total scores were all high (ICC3,1=0.920-0.983 and r=0.924-0.984). For the test-retest reliability, $ICC_{3,1}$=0.805-0.901 and r=0.806-0.903, and the MID for acute and post-acute as well as chronic stroke patients remained in the mean change range. Conclusion: It is suggested that the K-TIS might be used for clinical and research purposes as a standardized tool for stroke patients. In addition, it can also be useful in establishment of treatment goal(s) and planning treatment program(s) for patients with stroke.

Reliability and Validity of Angle of Trunk Rotation Measurement Using Smartphone and 3D Printing Technology in Scoliosis

  • Geum-Dong Shin;Seong-gil Kim;Kyoung Kim
    • The Journal of Korean Physical Therapy
    • /
    • v.34 no.6
    • /
    • pp.283-291
    • /
    • 2022
  • Purpose: The purpose of this study was to compare and analyze the method of measuring the angle of the trunk rotation using a smartphone with 3D smartphone holder compared to a scoliometer, which is a measuring tool used as a method for diagnosing scoliosis in scoliosis patients. Methods: Angle of trunk rotation was measured in 21 subjects diagnosed with scoliosis. scoliometer measurement method, a smartphone measurement method with a 3D smartphone holder, a smartphone blind measurement method with a 3D smartphone holder, a smartphone measurement method without a smartphone holder, a smartphone blind measurement method without a smartphone holder, and a total of five measurement methods were repeated three times for comparison and analysis. Results: The smartphone measurement method with a 3D smartphone holder has excellent intra-rater reliability of angle of trunk rotation (Rater A; ICC3, 2≥0.993, Rater B; ICC3, 2≥0.992). The smartphone blind measurement method with a 3D smartphone holder has excellent inter-rater reliability of angle of trunk rotation (ICC2, 2≥0.968). The scoliometer measurement method had the highest validity (r=0.976) with the smartphone measurement method with a 3D smartphone holder, and the blind measurement method without a smartphone holder had the lowest validity (r=0.886). Conclusion: These findings, the angle of trunk rotation measured by the smartphone measurement method with a 3D smartphone holder in scoliosis patients showed high reliability and validity compared to the scoliometer measurement method.

Usefulness of Smart Phone Application to Measure Cervical Range of Motion (목 관절가동범위 측정을 위한 스마트폰 어플리케이션의 유용성)

  • Chun-Yeop, Lee;Hae-Yoon, Song;Jung-Min, Lee;Moon-Young, Chang
    • The Journal of Korean society of community based occupational therapy
    • /
    • v.7 no.1
    • /
    • pp.17-24
    • /
    • 2017
  • Objective : The purpose of this study was to estimate the reliability of cervical range of motion measurement in healthy adults using smart phone application and goniometer that can be easily applicated in clinical setting. Methods : The cervical range of motion was measured as the flexion, extension, right rotation, left rotation, right lateral flexion, and left lateral flexion. To measure the reliability of intra-rater and inter-rater reliability, the same examiner performed two measurements and the other examiner performed once, total measurement were performed three times. The order of tests was randomized and two examiners didn't know the results of measurements. Results : Thirty healthy adults were participated. The result of this study shows that there were are no significant differences in all movements except the right lateral flexion in comparison of average angle of smart phone application and goniometer. The intra-rater reliability of smart phone application and goniometer showed ICC as .841~.958 and the inter-rater reliability showed ICC as .720~.944 for all movements. Conclusion : These results suggest that smart phone application and goniometer have proven to be reliable in measuring the cervical range of motion. Smart phone application can be used as a useful tool in clinical setting due to fast and accurate measurements of cervical range of motion.

The Reliability and Validity of Korean Pediatric Functional Muscle Testing in Children with Motor Disorder

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.28 no.4
    • /
    • pp.232-242
    • /
    • 2016
  • Purpose: This study was conducted to develop a Korean version of the pediatric functional muscle test (K-PFMT) for children with motor developmental disorders, and to verify its reliability and validity. Methods: The subjects were 40 children, aged below 5 years. Each was scored on the K-PFMT by 14 physical therapists to determine inter-rater reliability and internal consistency. Additionally, 3 of the 14 therapists tested 20 children again one or two weeks later to determine test-retest reliability. The internal consistency was calculated by Cronbach's alpha. The inter-rater and test-retest reliability were calculated using the intraclass correlation coefficient (ICC). One-way ANOVA and the paired t-test were used to compare differences among the three evaluator groups and between the test and retest group. Concurrent validity was evaluated by Pearson's correlation with a total score of GMFM. Results: Chronbach's alpha was over 0.98 for each test item and 0.99 for the total items. There was no significant differences in the score of K-PFMT among the three evaluator groups except for a few items. The test-retest ICC was from 0.89 to 1.00 and from 0.82 to 1.00, respectively. There was no significant difference between the test and retest group, except for a few items. There were high significant correlations between K-PFMT and GMFM. Conclusion: This study showed that a K-PFMT with relatively high reliability and validity was successfully developed. The K-PFMT will be a useful tool for measurement of muscle strength of children with motor developmental disorder.

Reliability and Concurrent Validity of Korean Version of the Trunk Control Measurement Scale (K-TCMS) for Children with Cerebral Palsy

  • Ko, Jooyeon;Jung, Jeewoon
    • The Journal of Korean Physical Therapy
    • /
    • v.29 no.1
    • /
    • pp.16-26
    • /
    • 2017
  • Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.

A Reliability Study of the Test of Playfulness in Attention Deficit Hyperactivity Disorder (ADHD) (주의력결핍 과잉행동장애 아동의 Test of Playfulness 신뢰도 연구)

  • Lee, Na-hael;Kim, Kyeong-Mi
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.14 no.1
    • /
    • pp.1-8
    • /
    • 2016
  • Objective : The purpose of this study was to determine the reliability of Test of Playfulness (ToP) in Attention Deficit Hyperactivity Disorder (ADHD) children. Methods : Twenty ADHD children participated in this study. To determine inter-rater reliability, two raters was evaluated by Test of Playfulness scores and analyzed Kappa coefficient and total agreement and intraclass correlation coefficient (ICC). Results : Total agreement was the range of 75%~95% and the Kappa coefficients was the range of. 45~1.00. Analyzing inter-rater reliability by ICC showed very high reliability: Intrinsic motivation was .96, internal control was .98, suspension of reality was .90, framing was .98, total score was .99. Conclusion : A reliability of Test of Playflness of children with ADHD showed that high. On the basis of this study, it will provide availability for clinical evaluation of children with ADHD, and basic study on the play of children with ADHD.

Reliability and Validity of the Goniometer for Hallux Valgus Angle Measurement (엄지발가락휨각도 측정을 위한 각도계의 신뢰도와 타당도)

  • Choung, Sung-Dae;Kang, Sun-Young;Kim, Moon-Hwan;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.20 no.2
    • /
    • pp.46-51
    • /
    • 2013
  • The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

Development and Psychometric Testing of the Clinical Nursing Competency Scale for Clinical Preceptor Use (CNCS-CP) (임상간호실습 현장지도자용 임상간호역량 평가도구 개발)

  • Kwak, Eunmi;Oh, Heeyoung
    • Journal of Korean Academy of Nursing
    • /
    • v.48 no.4
    • /
    • pp.419-431
    • /
    • 2018
  • Purpose: The purpose of this study was to develop and establish the psychometric properties of a clinical nursing competency evaluation tool to be utilized by clinical preceptors. Methods: The initial items were identified through in-depth literature review and field interviews based on a hybrid model. Content validation of the items was evaluated through three rounds of content validity testing. Participants were 34 clinical preceptors and 443 nursing students participating in clinical practice. Data were analyzed using exploratory and confirmatory factor analysis, convergence and discriminant validity, internal consistency and inter-rater reliability. Results: The final scale consisted of 23 items and four factors, fundamental nursing skills performance, critical thinking skills based on the nursing process, basic nursing knowledge, and professional attitude; these factor explained 69.7% of the total variance. The analysis with multi-trait/multi-item matrix correlation coefficients yielded 100.0% and 95.7 % convergence and discriminant validity, respectively. Cronbach's alpha for the total items was .95. The four subscale model tested by confirmatory factor analysis was satisfactory. Inter-rater reliability ranged from .912 to .967. Conclusion: This scale was found to be a reliable and valid instrument that clinical preceptors can apply for evaluating the clinical nursing competency of nursing students in clinical settings.

Development of Korean Infant Developmental Assessment Scale (한국형 영아발달사정도구의 개발)

  • Han Kyung-Ja;Bang Kyung-Sook
    • Child Health Nursing Research
    • /
    • v.10 no.3
    • /
    • pp.321-331
    • /
    • 2004
  • Purpose: To develop an Infant Developmental Assesment Scale appropriate for Korean infants that includes cultural context. Method: The total sample included 990 infants aged birth to 24months. The developmental tests were conducted at hospital well baby clinic, daycare centers, public health centers and homes located in city, urban and rural areas. Item analysis was done to examine content validity of the scale. Test responses were analyzed by SPSS to examine the inter-rater reliability, and construct validity. Result: Based on the naturalistic observation and analysis of other developmenta l instruments, 260 Korean infant developmental items were created. The mean score of the developmental quotient of 966 infants was 101.63±10.89. Correlation coefficient of inter-rater reliability was .99. In addition, 84.6% of total items showed Kappa .70 and above. The development quotient was significantly different depending upon the residential area and father's occupation, therefore, construct validity using known group technique was supported. Conclusion: The developed instrument can be used to assess the development of handicapped infants, as well as normal infant's general abilities and to study individual differences within the normal range for Korean.

  • PDF