• 제목/요약/키워드: Inter-Rater reliability

검색결과 197건 처리시간 0.029초

Reliability and Responsiveness of the Korean Version of the Trunk Impairment Scale for Stroke Patients

  • Ko, Jooyeon;You, Youngyoul
    • The Journal of Korean Physical Therapy
    • /
    • 제27권4호
    • /
    • pp.175-182
    • /
    • 2015
  • Purpose: The purposes of this study were to develop the Korean version of the trunk impairment scale (K-TIS) and to examine reliability and responsiveness of the K-TIS in patients with stroke. Methods Subjects of the study were 51 stroke patients (mean age: 57.78 years) recruited from two stroke clinics. For the interrater and test-retest reliability, two raters measured the K-TIS two times using video clips with an interval of 2 weeks. For the responsiveness, intensive physical therapy training was provided to all participants 2 times a day for one month or three months depending on the onset of the stroke and the admission rules of the two clinics. Inter-rater reliability and test-retest reliability of the K-TIS three subscales (static sitting balance, dynamic sitting balance, and coordination) scores and total scores were examined using intra-correlation coefficient ($ICC_{3,1}$) and Pearson's correlation coefficient (r). To examine responsiveness, the minimally important difference (MID) was calculated with effect size. Results: Inter-rater reliability of the K-TIS subscales and total scores were all high (ICC3,1=0.920-0.983 and r=0.924-0.984). For the test-retest reliability, $ICC_{3,1}$=0.805-0.901 and r=0.806-0.903, and the MID for acute and post-acute as well as chronic stroke patients remained in the mean change range. Conclusion: It is suggested that the K-TIS might be used for clinical and research purposes as a standardized tool for stroke patients. In addition, it can also be useful in establishment of treatment goal(s) and planning treatment program(s) for patients with stroke.

Reliability and Validity of Angle of Trunk Rotation Measurement Using Smartphone and 3D Printing Technology in Scoliosis

  • Geum-Dong Shin;Seong-gil Kim;Kyoung Kim
    • The Journal of Korean Physical Therapy
    • /
    • 제34권6호
    • /
    • pp.283-291
    • /
    • 2022
  • Purpose: The purpose of this study was to compare and analyze the method of measuring the angle of the trunk rotation using a smartphone with 3D smartphone holder compared to a scoliometer, which is a measuring tool used as a method for diagnosing scoliosis in scoliosis patients. Methods: Angle of trunk rotation was measured in 21 subjects diagnosed with scoliosis. scoliometer measurement method, a smartphone measurement method with a 3D smartphone holder, a smartphone blind measurement method with a 3D smartphone holder, a smartphone measurement method without a smartphone holder, a smartphone blind measurement method without a smartphone holder, and a total of five measurement methods were repeated three times for comparison and analysis. Results: The smartphone measurement method with a 3D smartphone holder has excellent intra-rater reliability of angle of trunk rotation (Rater A; ICC3, 2≥0.993, Rater B; ICC3, 2≥0.992). The smartphone blind measurement method with a 3D smartphone holder has excellent inter-rater reliability of angle of trunk rotation (ICC2, 2≥0.968). The scoliometer measurement method had the highest validity (r=0.976) with the smartphone measurement method with a 3D smartphone holder, and the blind measurement method without a smartphone holder had the lowest validity (r=0.886). Conclusion: These findings, the angle of trunk rotation measured by the smartphone measurement method with a 3D smartphone holder in scoliosis patients showed high reliability and validity compared to the scoliometer measurement method.

목 관절가동범위 측정을 위한 스마트폰 어플리케이션의 유용성 (Usefulness of Smart Phone Application to Measure Cervical Range of Motion)

  • 이춘엽;송해윤;이정민;장문영
    • 대한지역사회작업치료학회지
    • /
    • 제7권1호
    • /
    • pp.17-24
    • /
    • 2017
  • 목적 : 건강한 성인을 대상으로 목의 관절가동범위를 측정하는데 임상에서 간편하게 적용할 수 있는 스마트폰 어플리케이션의 유용성을 확인하고자 한다. 연구방법 : 목의 관절가동범위는 스마트폰 어플리케이션과 각도계로 목의 굽힘, 폄, 오른쪽 돌림, 왼쪽 돌림, 오른쪽 가쪽 굽힘, 왼쪽 가쪽 굽힘의 움직임을 각각 측정하였다. 검사자내 신뢰도와 검사자간 신뢰도를 측정하기 위해 같은 검사자가 두 번, 다른 검사자가 한 번으로 총 세 번 측정을 실시하였다. 검사 순서는 무작위로 하였으며, 두 검사자는 서로 측정한 결과를 알지 못하게 하였다. 결과 : 연구에 참여한 대상자는 남자 9명, 여자 21명이었다. 실험 결과 스마트폰 어플리케이션과 각도계의 평균 각도 비교에서 오른쪽 가쪽 굽힘을 제외한 모든 항목에서 유의한 차이가 없는 것으로 나타났다(p>.05). 스마트폰 어플리케이션과 각도계의 검사자내 신뢰도는 전 움직임에서 ICC값이 .841~.958로, 검사자간 신뢰도는 전 움직임에서 ICC값이 .720~.944로 나타나 모두 높은 수준의 신뢰도를 보였다. 결론 : 스마트폰 어플리케이션과 각도계는 목의 관절가동범위를 측정하는데 신뢰할 수 있는 것으로 나타나, 스마트폰 어플리케이션은 관절가동범위에 신속하고 정확한 측정으로 인해 임상에서 유용한 도구로 활용할 수 있을 것이다.

The Reliability and Validity of Korean Pediatric Functional Muscle Testing in Children with Motor Disorder

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • The Journal of Korean Physical Therapy
    • /
    • 제28권4호
    • /
    • pp.232-242
    • /
    • 2016
  • Purpose: This study was conducted to develop a Korean version of the pediatric functional muscle test (K-PFMT) for children with motor developmental disorders, and to verify its reliability and validity. Methods: The subjects were 40 children, aged below 5 years. Each was scored on the K-PFMT by 14 physical therapists to determine inter-rater reliability and internal consistency. Additionally, 3 of the 14 therapists tested 20 children again one or two weeks later to determine test-retest reliability. The internal consistency was calculated by Cronbach's alpha. The inter-rater and test-retest reliability were calculated using the intraclass correlation coefficient (ICC). One-way ANOVA and the paired t-test were used to compare differences among the three evaluator groups and between the test and retest group. Concurrent validity was evaluated by Pearson's correlation with a total score of GMFM. Results: Chronbach's alpha was over 0.98 for each test item and 0.99 for the total items. There was no significant differences in the score of K-PFMT among the three evaluator groups except for a few items. The test-retest ICC was from 0.89 to 1.00 and from 0.82 to 1.00, respectively. There was no significant difference between the test and retest group, except for a few items. There were high significant correlations between K-PFMT and GMFM. Conclusion: This study showed that a K-PFMT with relatively high reliability and validity was successfully developed. The K-PFMT will be a useful tool for measurement of muscle strength of children with motor developmental disorder.

Reliability and Concurrent Validity of Korean Version of the Trunk Control Measurement Scale (K-TCMS) for Children with Cerebral Palsy

  • Ko, Jooyeon;Jung, Jeewoon
    • The Journal of Korean Physical Therapy
    • /
    • 제29권1호
    • /
    • pp.16-26
    • /
    • 2017
  • Purpose: This study was conducted to develop a Korean version of the trunk control measurement scale (TCMS) and examine the reliability and concurrent validity of the K-TCMS in children with cerebral palsy. Methods: Subjects for the study were 23 children with cerebral palsy (CP)(mean age: 84.70 months) recruited from one CP clinic. For the interrater and test-retest reliabilities, four raters (A, B, C, D) measured the K-TCMS two times using video clips with an interval of two weeks. For the concurrent validity, the Korean version of the gross motor function measure (K-GMFM) was chosen. Inter-rater reliability and test-retest reliability of the three K-TCMS subscale (static sitting balance, dynamic sitting balance and dynamic reaching) scores and the total scores were investigated using the intra-correlation coefficient ($ICC_{3,1}$). Spearman's correlation coefficient (r) was calculated to investigate the concurrent validity. Results: The inter-rater reliability of the K-TCMS subscales and total scores were all high ($ICC_{3,1}=0.968-0.992$). For the test-retest reliability, $ICC_{3,1}=0.827-0.962$. The concurrent validity between the K-TCMS's total and three subscale scores and K-GMFM's total score were r=0.600-0.667. Conclusion: The results suggest that the K-TCMS can be used in clinical and research settings as a standardized tool for CP children. The K-TCMS might be also useful for selecting treatment goals and planning interventions for children with cerebral palsy.

주의력결핍 과잉행동장애 아동의 Test of Playfulness 신뢰도 연구 (A Reliability Study of the Test of Playfulness in Attention Deficit Hyperactivity Disorder (ADHD))

  • 이나핼;김경미
    • 대한감각통합치료학회지
    • /
    • 제14권1호
    • /
    • pp.1-8
    • /
    • 2016
  • 목적 : 본 연구의 목적은 주의력결핍 과잉행동장애 아동을 대상으로 놀이의 질적수준을 평가하는 놀이다움 평정척도(Test of Playfulness: ToP)의 신뢰도를 알아보고자 한다. 연구방법 : 연구대상은 G시에 거주하는 초등학교 2학년~3학년의 주의력결핍 과잉행동장애 아동 20명이다. 놀이다움 평정척도의 신뢰도를 알아보기 위하여 측정자간 일치율과 Kappa계수로 제시하였고, 측정자간 신뢰도 분석은 급간내 상관계수(Intraclass Correlation Coefficient: ICC)를 사용하여 제시하였다. 결과 : 놀이다움 평정척도의 각 항목간 측정자간 일치율은 75~95%이었다. 각 항목의 Kappa계수의 범위는 .45~1.00이었다. 각 요소에 대한 측정자간 신뢰도를 급간내 상관계수로 분석한 결과 내적동기는 .96, 통제지각은 .98, 현실감 부재는 .90, 참조체계는 .98, 총점은 .99로 매우 높은 신뢰도를 보였다. 결론 : 연구결과를 통하여 주의력결핍 과잉행동장애 아동의 놀이다움 평정척도의 측정자간 신뢰도는 높은 것으로 나타났다. 이를 근거로 하여 주의력결핍 과잉행동장애 아동의 임상적인 평가의 유용성을 제공하고, 주의력결핍 과잉행동장애 아동의 놀이연구에 대한 기초자료를 제공하고자 한다.

엄지발가락휨각도 측정을 위한 각도계의 신뢰도와 타당도 (Reliability and Validity of the Goniometer for Hallux Valgus Angle Measurement)

  • 정성대;강선영;김문환;원종혁
    • 한국전문물리치료학회지
    • /
    • 제20권2호
    • /
    • pp.46-51
    • /
    • 2013
  • The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

임상간호실습 현장지도자용 임상간호역량 평가도구 개발 (Development and Psychometric Testing of the Clinical Nursing Competency Scale for Clinical Preceptor Use (CNCS-CP))

  • 곽은미;오희영
    • 대한간호학회지
    • /
    • 제48권4호
    • /
    • pp.419-431
    • /
    • 2018
  • Purpose: The purpose of this study was to develop and establish the psychometric properties of a clinical nursing competency evaluation tool to be utilized by clinical preceptors. Methods: The initial items were identified through in-depth literature review and field interviews based on a hybrid model. Content validation of the items was evaluated through three rounds of content validity testing. Participants were 34 clinical preceptors and 443 nursing students participating in clinical practice. Data were analyzed using exploratory and confirmatory factor analysis, convergence and discriminant validity, internal consistency and inter-rater reliability. Results: The final scale consisted of 23 items and four factors, fundamental nursing skills performance, critical thinking skills based on the nursing process, basic nursing knowledge, and professional attitude; these factor explained 69.7% of the total variance. The analysis with multi-trait/multi-item matrix correlation coefficients yielded 100.0% and 95.7 % convergence and discriminant validity, respectively. Cronbach's alpha for the total items was .95. The four subscale model tested by confirmatory factor analysis was satisfactory. Inter-rater reliability ranged from .912 to .967. Conclusion: This scale was found to be a reliable and valid instrument that clinical preceptors can apply for evaluating the clinical nursing competency of nursing students in clinical settings.

한국형 영아발달사정도구의 개발 (Development of Korean Infant Developmental Assessment Scale)

  • 한경자;방경숙
    • Child Health Nursing Research
    • /
    • 제10권3호
    • /
    • pp.321-331
    • /
    • 2004
  • Purpose: To develop an Infant Developmental Assesment Scale appropriate for Korean infants that includes cultural context. Method: The total sample included 990 infants aged birth to 24months. The developmental tests were conducted at hospital well baby clinic, daycare centers, public health centers and homes located in city, urban and rural areas. Item analysis was done to examine content validity of the scale. Test responses were analyzed by SPSS to examine the inter-rater reliability, and construct validity. Result: Based on the naturalistic observation and analysis of other developmenta l instruments, 260 Korean infant developmental items were created. The mean score of the developmental quotient of 966 infants was 101.63±10.89. Correlation coefficient of inter-rater reliability was .99. In addition, 84.6% of total items showed Kappa .70 and above. The development quotient was significantly different depending upon the residential area and father's occupation, therefore, construct validity using known group technique was supported. Conclusion: The developed instrument can be used to assess the development of handicapped infants, as well as normal infant's general abilities and to study individual differences within the normal range for Korean.

  • PDF