• Title/Summary/Keyword: Interrater reliability

Search Result 76, Processing Time 0.021 seconds

INTERRATER RELIABILITY OF CARIES DIAGNOSIS BY LASER FLUORESCENCE (레이저형광 우식진단법의 검사자간 신뢰도에 관한 연구)

  • Lee, Kwang-Hee
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.28 no.4
    • /
    • pp.668-672
    • /
    • 2001
  • The purpose of study was to measure the interrater reliability of the caries diagnostic instrument, Diagnodent(KaVo, Germany), using a new laser fluorescence technique. Occlusal surfaces and smooth surfaces of one hundred extracted human premolars and molars were examined by four dentists. Pearson correlation coeffcients were 0703 to 0.870 for occlusal surfaces and 0.764 to 0.932 for smooth surfaces (P<0.01, all). Reliability coefficients which were calculated by intraclass correlation coefficients were 0.9450 for occlusal surfaces and 0.9605 for smooth surfaces. Therefore, the interrater reliability of caries diagnosis by Diagnodent is very high, and the rater training would be necessary more for occlusal surfaces than for smooth surfaces.

  • PDF

Intra-Rater and Inter-Rater Reliability of the Myotonometer in the Assessment of Biceps Brachii and Quadriceps (근긴장도검사기(Myotonometer)를 이용한 상완이두근과 대퇴사두근 검사의 신뢰도 연구)

  • Kim, Suhn-Yeop
    • Physical Therapy Korea
    • /
    • v.14 no.2
    • /
    • pp.29-36
    • /
    • 2007
  • Muscle tone (stiffness/hardness) or muscle compliance changes during muscle contraction. The purposes of this study were to assess the intrarater and interrater reliabilities of the Myotonometer$^{(R)}$, electronic device that quantifies muscle tone. Two raters used the Myotonometer to assess the right bicep brachia and quadriceps muscles of 30 voluntary persons without any orthopedic or neurological problems (age range, 18~21 yrs). Muscles were measured in a relaxed state and during brief sustained voluntary maximal isometric contraction. Intrarater correlation coefficients were calculated for each muscle and for each condition (relaxed and contracted). Intrarater reliabilities (intraclass correlation coefficients, ICCs) ranged from .778 to .954, relaxed, biceps brachia), .926 to .963 (contracted, biceps brachia), .935 to .990 (relaxed, quadriceps) and .679 to .952(contracted, quadriceps). Interrater reliabilities ranged from .652 to .790 (relaxed, biceps brachii), .813 to .907 (contracted, biceps brachii), .831 to .950 (relaxed, quadriceps) and .849 to .937 (contracted, quadriceps). Myotonometer measurements had high to very high intrarater and interrater reliability for measurements of the biceps brachia and quadriceps muscles.

  • PDF

Analysis of Intrarater and Interrater Reliability of Trunk Repositioning Error Test using a Portable Digital Inclinometer (디지털경사계를 사용한 체간재위치오류 검사의 신뢰도 분석)

  • Chang, Woo-Nam;Lee, Kyoung-Bo;Yeom, Jun-Woo;Hwang, Byong-Yong
    • The Journal of Korean Physical Therapy
    • /
    • v.25 no.4
    • /
    • pp.210-216
    • /
    • 2013
  • Purpose: A cost effective tool for the clinical measurement of trunk reposition sense is clearly needed. This study was to analyze intrarater and interrater Reliability of trunk repositioning error (TRE) test which assesses trunk position sense using a portable digital inclinometer. Methods: Twenty four normal healthy subjects were recruited. TRE was measured using a portable digital inclinometer. A digital inclinometer (Acumar-ACU360; Lafayetter Instrument) with precision to $1^{\circ}$ was placed on skin over the spinous process from first to second thoracic vertebra (T1-T2) and secured with double-sided tape. TRE test during sitting forward and lateral flexion movement was assessed. When they reached a point approximately 50% of full trunk flexion range, the examiner instructed the subjects to stop and told them. This was the target position that they should try to reproduce exactly. Each subject performed six trials. Results: ICC (2,1) for intrarater reliability (with-day and between-day) of TRE test in sagittal and frontal plane of movement was 0.75 and 0.78 (excellent reliability). Interrater reliability was 0.66 in sagittal and 0.64, frontal plane (fair to good reliability). However, there were poor correlations between an average of TRE test in sagittal and frontal plane. Conclusion: TRE test using a portable digital inclinometer demonstrated good to excellent reliability. The device may be a cost effective clinical measurement for trunk reposition sense measurement.

Reliability of the Functional Gait Assessment in Patients With Stroke (뇌졸중 환자에 대한 기능적 보행평가의 신뢰도)

  • Won, Jong-Im;Yu, Kyung-Hoon
    • Physical Therapy Korea
    • /
    • v.18 no.1
    • /
    • pp.64-73
    • /
    • 2011
  • After stroke, many people have problems with balance during movement. Balance is essential for the optimal functioning of the locomotor system and the performance of many activities of daily living. The Functional Gait Assessment (FGA) is a clinical tool for evaluating balance ability during walking. The test consists of ten tasks, seven tasks of the Dynamic Gait Index and three additional tasks. The purpose of this study was to evaluate the reliability and internal consistency of data obtained with the Korean version of the FGA when used with people after suffering a stroke. One-hundred participants, at least three months poststroke and able to walk at least six meters with or without a walking aid, participated in the study (age range=30~83 years; $mean{\pm}SD=58.8{\pm}10.9$). Two physical therapists and two physical therapy students rated the FGA. Intrarater and interrater reliability of the FGA were assessed using kappa statistic and intraclass correlation coefficients (2,1). The internal consistency of the FGA was assessed using the Cronbach alpha. The Cronbach alpha was good (${\alpha}$=.86~.93). The intrarater (intraclass correlation coefficient=.92~.95) and interrater reliability (intraclass correlation coefficient=.91, .95) of the total scores administered by the therapists and students were good, whereas the reliability for single item scores when administered by the physical therapists was moderate to good (kapa value=.42~.97). This study found that intrarater and interrater reliability for total FGA scores and internal consistency were good. Therefore, the Korean version of the FGA can be used as a reliable tool to assess the functional gait performance of patients after stroke.

A Study of Test-Retest Reliability and Interrater Reliability of the Sensory Processing Scale for Children (SPS-C) (아동감각처리척도(Sensory Processing Scale for Children; SPS-C)의 검사-재검사 신뢰도와 검사자간 신뢰도 연구)

  • Kim, Kyeong-Mi;Kim, Ga-Yeon;Lee, Seung-Jin
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.20 no.2
    • /
    • pp.11-21
    • /
    • 2022
  • Objective : This study examined the test-retest reliability and interrater reliability of the Sensory Processing Scale for Children (SPS-C). Method : Senventy primary caregivers of children with sensory processing difficulties and 3 years old participated in the study. The subjects were recruited through child development centers, welfare centers, and acquaintances located in Seoul, Gyeonggi-do, Busan, and Gyeongsang-do. The test-retest reliability verification targeted 20 main caregivers of children with difficulty in sensory processing. Re-evaluation was performed within 7 to 14 days after the initial evaluation, and Pearson's correlation coefficient was used to confirm the relevance between the two time points, and the Intraclass correlation coefficient was used to confirm the degree of agreement. The interrater reliability verification was conducted with 18 primary caregivers and 18 subsidiary caregivers of children with sensory processing difficulties. Each caregiver evaluated the same child, and the Intraclass correlation coefficient was used to confirm the agreement between the two sets of caregivers. Results : The test-retest reliability was Pearson's correlation coefficient r=.914 and intraclass correlation coefficient ICC=.939, indicating a high level of relevance and agreement. The interrater reliability was an Intraclass correlation coefficient ICC=.727, which showed a moderate level of agreement, but the tactile area (ICC=.455) and proprioceptive area (ICC=.439) were not statistically significant and showed a low degree of agreement. Conclusion : Through this study, it was confirmed that the children's Sensory Processing Scale for Children (SPS-C) is a stable evaluation tool with test-retest reliability and interrater reliability verified, and it will be able to provide help in standardization studies for future clinical use.

The Reliability and Validity of the Korean Version of the Cornell Assessment of Pediatric Delirium (한국어판 Cornell Assessment of Pediatric Delirium 소아 섬망 사정 도구의 검증)

  • Nam, Song Yi;Park, Ki Young;Choi, Su Jung
    • Journal of Korean Clinical Nursing Research
    • /
    • v.26 no.2
    • /
    • pp.254-264
    • /
    • 2020
  • Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

Reliability and Validity of Korean-Version of Information Needs in Cardiac Rehabilitation Scale

  • Choi, Sang Young Heon;Kim, Joong Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.34 no.5
    • /
    • pp.234-241
    • /
    • 2022
  • Purpose: The Cardiac Rehabilitation scale (INCR scale) is a verified measure worldwide. The scale measures the extent to which cardiac rehabilitation meets the various needs of the participating patients and determines how education related to heart disease and rehabilitation satisfies their preferences. The current study applied the INCR scale to verify and develop it for use in Korea by conforming to Korean culture and language. Methods: The Korean version of the INCR scale was created after a six-step process in accordance with the international questionnaire translation law. The Korean version of the INCR scale was assessed in 45 cardiac rehabilitation patients (29 males, 16 females). Internal consistency was verified using Cronbach's alpha. Test-re-test reliability and interrater reliability were verified using the intraclass correlation coefficient (ICC). Content validity was selected to verify the validity. Results: The content validity index of the Korean version of the INCR scale was high, with an average of 0.93. Cronbach's Alpha for Internal consistency also revealed high reliability of 0.89 in all 10 categories. The interclass correlation coefficient of the test-re-test and interrater reliability scores were 0.95 and 0.81, respectively. Conclusion: Our results indicate that the Korean version of the INCR scale would be instrumental in the clinical setting to determine the knowledge, educational needs, and preferences of patients participating in cardiovascular disease and cardiac rehabilitation.

Reliability of Scapular Winging Measurement Using a Scapulometer (익상견갑의 평가를 위한 "Scapulometer"의 신뢰도 연구)

  • Weon, Jong-Hyuek;Choi, Houng-Sik;Kwon, Hyuk-Cheol
    • Physical Therapy Korea
    • /
    • v.17 no.2
    • /
    • pp.10-16
    • /
    • 2010
  • This study was undertaken to develop the scapulometer, a measuring tool for scapular winging, and to determine the reliability of scapulometer. Thirty subjects with scapular winging greater than 2 cm participated in this study. Two examiners measured scapular winging using the scapulometer. Standardized measurement position of each subject was as follows: neutral position of shoulder and wrist, $90^{\circ}$ flexion of elbow, and cuff weight of 5% and 10% of body weight (BW) to neutral wrist. The interrater and intrarater reliability were calculated with an intraclass correlation coefficient (ICC) with 95% confidence interval (CI) and standard error of measurement (SEM) at 5% BW and 10% BW. The level of scapular winging was tested between 5% BW and 10% BW with a paired t-test. The interrater reliability was shown to be high at 5% BW (ICC(2,k)=.955, 95% CI=.900~.979, SEM=.07) and at 10% BW (ICC(2,k)=.968, 95% CI=.930~.985, SEM=.06). The intrarater reliability was shown to be high at 5% BW (ICC(2,k)=.921, 95% CI=.842~.961, SEM=.09) and at 10% BW (ICC(2,k)=.906, 95% CI=.813~.954, SEM=.10). The level of scapular winging was significantly different between 5% BW and 10% BW. Conclusively, it is demonstrated that the scapulometer is an objective and qualitative measurement tool for scapular winging.

Reliability of the Korean Version of the Trunk Impairment Scale in Patients With Stroke

  • Seo, Hyun-Du;Kim, Nam-Joe;Chung, Yi-Jung
    • Physical Therapy Korea
    • /
    • v.15 no.4
    • /
    • pp.87-96
    • /
    • 2008
  • The purpose of this study was to establish the reliability of the Trunk Impairment Scale (TIS) translated into Korea in patients with stroke. It also aims to score the quality of trunk movement and to be a tool for the treatment. The TIS consists of three subscales that static sitting balance, dynamic sitting balance and co-ordination. The TIS score ranges from a minimum of 0 to a maximum of 23. Twenty-five stroke patients (13 males, 12 females) were examined by two physiotherapists. Interrater and test-retest reliability were assessed. Kappa and weighted kappa values for the items of the trunk assessment of the TIS ranged from .67 to 1.00. Intraclass correlation coefficients for interrater and test-retest agreement were .95 and .97. Cronbach alpha coefficients for internal consistency range from .87 to .97. The TIS provide reliable assessments for the trunk and are valid scales for measuring trunk performance in patients with stroke. TIS can be used as a guideline for treatment and the assessment of quality of trunk activity.

  • PDF

The Study on the Rater Reliabilities of Physical Therapy Students Pediatric Balance Scales items (물리치료과 학생들을 대상으로 아동균형척도의 항목별 측정자 신뢰도에 관한 연구)

  • Hwang, Ryoung;Kim, Gi-Won
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.8 no.1
    • /
    • pp.137-145
    • /
    • 2013
  • PURPOSE: The purpose of this study is to examine assessment of test-retest reliability for 13 items of pediatric balance scales, then the intrarater reliability among the raters. METHODS: Study participants included 6 children with spastic cerebral palsy who could walk. Raters were consist of seventy-four, 2nd year physical therapy major students. The children's ability to achieve physical balance was wideotaped for PBS items. The raters watched the tapes and evlauated each child twice. Test-retest reliability was analyzed using the Spearman correlation, and interrater reliability was analyzed using the Kendall's coefficient of concordance for ranks. RESULTS: The total PBS scores averaged 49.22 and 50.06 for first and second tests. Test-retest reliability of PBS individual items were between low and high. The low itmes were 3 items, and high were 4 itmes. Interrater reliability were low agreement. CONCLUSION: Based on the study, the pediatric balance scale is an effective evaluating tool for measuring functional balance of school age child. However, the agreement of students or beginner's interpretation is necessary in conjunction to this study results. On top of that, it is important to provide detailed explanation and repetitive training, which improves the analysis reliability. Also, each category subscores level for the pediatric balance scale must be examined carefully in conjunction to performing test, only after improving match quality via preceding practice.