• Title/Summary/Keyword: inter-rater reliability

Search Result 200, Processing Time 0.024 seconds

The reliability of dual rehabilitative ultrasound imaging measurements for muscle co-activation

  • Hahn, Joohee;Ha, Hyun-Geun;Lee, Hwang-Jae;Lim, Seungyeop;Lee, Wan-hee
    • Physical Therapy Rehabilitation Science
    • /
    • v.6 no.3
    • /
    • pp.152-157
    • /
    • 2017
  • Objective: The aim of this study was to determine the intra-rater and inter-rater reliability of the dual rehabilitative ultrasound imaging (D-RUSI) when simultaneously measuring muscle thickness changes at rest and during co-contraction of the biceps brachii (BB) and triceps brachii (TB). Design: Cross-sectional study. Methods: This study included 36 healthy participants (23 men, 13 women). The participants sat on a chair in a comfortable position with a cushion placed under their elbow to maintain a 90-degree elbow flexion angle. The muscle thickness of the biceps brachii and triceps brachii was measured twice using the D-RUSI by two examiners during resting and co-contraction states. One week later, the same procedure was performed once again. Results: The intra-class correlation coefficients (ICCs) for intra-rater reliability ranged from 0.887 to 0.989 and the confidence interval was within an acceptable range of 0.778 to 0.994. The standard error of measurement (SEM) values ranged from 0.303 to 0.866 and the minimal detectable change (MDC) values ranged from 0.84 to 2.40. The ICCs for inter-rater reliability ranged from 0.758 to 0.925. The SEM values ranged from 0.702 to 1.486 and the MDC values ranged from 1.95 to 4.12. Conclusions: The use of the D-RUSI of the BB muscle had a very good intra-rater reliability and very good inter-rater reliability at the resting state, and a, good inter-rater reliability at the co-activation state. ICC values showed very good intra-reliability and inter-reliability for the TB muscle. the D-RUSI is a useful tool for simultaneously measuring the thickness of two muscles when the BB is an agonist and the TB is an antagonist during co-activation of the upper arm.

Study on Reliability of Interpretation and Reproducibility of a Pulse Analyser (맥진기 판독의 신뢰도 및 파형의 재현성 연구)

  • Park, Seung-Chan;Lee, Ji-Hye;Lee, Hye-Yoon;Cho, Min-Kyoung;Kim, Do-Hyung;Kim, So-Yeon;Choi, Jun-Yong;Han, Chang-Woo;Park, Seong-Ha;Hong, Jin-Woo;Lee, In;Kwon, Jung-Nam
    • The Journal of Internal Korean Medicine
    • /
    • v.34 no.3
    • /
    • pp.231-239
    • /
    • 2013
  • Objectives : This study was performed to evaluate inter-rater and intra-rater reliability of interpretation and reproducibility of a pulse analyser (MAXMAC27-Plus). Methods : 38 of 40 volunteers completed the pulse analysis consecutively. Three Korean medical doctors who had at least 2 years of clinical experience interpreted the pulse waves for 3 aspects of size, depth and shape, then inter-rater reliability and crude agreement was obtained. Reinterpretation was done 2 weeks later and intra-rater reliability and crude agreement was obtained. Intra-rater reliability and crude agreement between 1st and 2nd measurement was calculated. Cohen's weighted kappa for size, Cohen's kappa for depth and shape were used as statistical analysis. Results : Inter-rater reliability of size, depth and shape among 3 raters was 0.598, 0.604, and 0.312, respectively, showing moderate to substantial agreement. Average intra-rater reliability between 1st and 2nd interpretation of size, depth and shape was 0.806, 0.705, and 0.638, respectively, showing substantial to almost perfect agreement. However, intra-rater reliability between consecutive measurements of size, depth and shape was 0.221, 0.121, and 0.194, respectively, which showed only poor to fair agreement. Conclusions : Intra-rater and inter-rater reliability of one pulse wave showed relatively high concordance. Training by a clinical expert may effect better concordance among raters. Test-retest reliability showed poor agreement. Improvement of measurement technique and device performance will be needed.

Reliability of Scapular Downward Rotation Measurement in Subjects With Scapular Downward Rotation Syndrome

  • Choi, Woo-Jeong;Lee, Ji-Hyun;Jeong, Hyo-Jung;Yoon, Tae-Lim;Cynn, Heon-Seock
    • Physical Therapy Korea
    • /
    • v.21 no.3
    • /
    • pp.73-79
    • /
    • 2014
  • The purposes of the current study were to (1) estimate the inter-rater agreement for visual assessment of scapular downward rotation (SDR), (2) develop the scapular downward rotation index (SDRI) as a method to measure SDR objectively and quantitatively, and (3) analyze the intra- and inter-rater reliability of the SDRI. Twenty subjects with scapular downward rotation syndrome (SDRS) were recruited for this study. The visual assessment and the measurement for the SDRI were conducted by two examiners in two sessions each. The SDRI [$(a-b){\div}a{\times}100$] is calculated with the measurement of two linear distances: One is a perpendicular distance from the root of the scapular spine to the thoracic mid-line (a), and the other is a perpendicular distance from the inferior angle of the scapula to the thoracic mid-line (b). Cohen's kappa coefficient was calculated to estimate the inter-rater agreement for visual assessment. Intra-class correlation coefficients (ICCs) with a 95% confidence interval (CI), the standard error of measurement, and minimal detectable differences were calculated to assess intra- and inter-rater reliability of SDR measurement using the SDRI. The results indicated that the kappa coefficient of inter-rater agreement for visual assessment was fair (${\kappa}=.21$). The intra-rater reliability of SDR measurement using the SDRI was excellent for examiner 1 (ICC=.92, 95% CI=.78~.97) and good for examiner 2 (ICC=.82, 95% CI=.55~.93). The inter-rater reliability was moderate (ICC=.73, 95% CI=.32~.89). These findings showed that SDR measurement using the SDRI for subjects with SDRS may be considered reliable and better than the visual assessment.

A Reliability Study of the Scale for Contraversive Pushing in Stroke Patients (뇌졸중 환자의 Scale for Contraversive Pushing의 신뢰도 연구)

  • Kim, Chung-Sun;Chang, Jong-Sung
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.4
    • /
    • pp.31-36
    • /
    • 2009
  • Purpose: Pusher syndrome in stroke patients is the tendency to push strongly toward the paretic side with the non-affected limbs. The purpose of this study was to estimated inter-rater and intra-rater reliability of the Scale for Contraversive Pushing (SCP). Methods: Fourteen patients in the acute phase after stroke onset were diagnosed with pusher syndrome. Two physical therapists randomly assessed the same patients on different occasions on the same day. Almost all patients were assessed on more than one day. The inter-rater and intra-rater reliability of the SCP was estimated by calculation of the intraclass correlation coefficient (ICC). Results: The intra-rater reliability of the SCP ranged from 0.87 to 0.97; the inter-rater reliability of the SCP ranged from 0.71 to 0.99 in sitting and standing positions. These results show good reliability for the calculated variables. Conclusion: The results provide support for the use of the SCP in assessing pusher syndrome based on its reliability in stroke patients. It may use the standardized clinical assessments in clinical implication.

  • PDF

Inter-Rater Reliability of Quantitative Knee Tendon Reflex Test for Healthy Subjects (정상 성인에 대한 정량적 무릎힘줄반사 검사의 측정자간 신뢰도)

  • Kim, Yong-Wook;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.14 no.3
    • /
    • pp.57-63
    • /
    • 2007
  • The purpose of this study was to evaluate inter-rater reliability of the amplitude and first knee extension angles in deep tendon reflex test by using an electrical hammer. Twenty-five healthy adults participated in the study. Compound muscle action potential is elicited by tapping the knee tendon with an electrical hammer in deep tendon reflex tests. The amplitude and knee extension angle were simultaneously measured. The mean value of the amplitude and the knee extension angles through three time trials for each tester, are used for determining the inter-rater and Intra-class Correlation Coefficients (ICCs) reliabilities. According to the results, the ICCs of the amplitude is .280 and that of the knee extension angle is .789. Pearson correlation coefficients of the amplitude of the action potential and the knee extension angles are .685, showing significant statistically moderate correlation. Inter-rater reliability in the amplitude was not significant. More objective and quantitative deep tendon reflex tests should be done to obtain higher reliability in further studies.

  • PDF

Intra- and Inter-rater Reliability of BioRescue (BioRescue의 측정자내와 측정자간 신뢰도)

  • Kim, Jin-hong;Choi, Bo-ram
    • The Journal of the Korea Contents Association
    • /
    • v.18 no.11
    • /
    • pp.348-352
    • /
    • 2018
  • BioRescue ($RMIng{\acute{e}}nierie$, Marseille, France) is able to assess dynamic and static balance when a test subject stands or sits over the platform. Although previous studies have examined the reliability of other balance measurement methods, little research has been conducted on the reliability of equipment such as BioRescue. This study examined the intra-rater and inter-rater reliability of BioRescue during balance assessment. Thirty-four healthy adults participated as subjects and two physical therapists participated as examiners to determine intra- and inter-rater reliability. BioRescue was used to conduct measurements during footprint (area and pressure), Romberg, and limit of stability tests. The footprint area and limit of stability tests yielded intra- and inter-rater reliability ICC values above 0.60 in all directions. However, the footprint pressure and Romberg tests yielded values below 0.60 in all directions. BioRescue showed good inter-rater and intra-rater reliability in measurements during footprint area and limit of stability tests. However, because the values of limits of stability show the difference between experienced and unskilled, skill is required for the accuracy of the equipment.

A Reliability Study of Tape and Photography Measurement Techniques for Scapular Position (줄자 및 사진촬영 측정을 이용한 어깨뼈 벌림 측정에 대한 신뢰도 연구)

  • Kim, Moon-Hwan;Yun, Sung-Joon;Ha, Sung-Min
    • Physical Therapy Korea
    • /
    • v.20 no.3
    • /
    • pp.74-80
    • /
    • 2013
  • The purpose of this study was to determine the reliability of distance measurements from the medial border of the scapula to the spinous process of the thoracic vertebrae when obtained using tape and photography measurements. The study included 20 healthy subjects (10 males, 10 females); for a total of 40 scapula measurements. The distance measurements made using tape or photography methods were conducted with the subject in a standing position. Repeated tape and photography measurements were conducted in two sessions on different days by two examiners to assess the inter-rater and intra-rater reliability of the two methods. The reliability of scapular distance measured using tape and photography methods was tested using intraclass correlation coefficients (ICC(3,1)) and the standard error of measurement (SEM). The inter-rater reliability of the tape measurement method was excellent (ICC=.77) and the intra-rater reliability was fair to good (ICC=.74). The inter-rater and intra-rater reliabilities of the photography measurement method were excellent (ICC=.76 and .76 respectively). Our results suggest that photography measurement is an objective and qualitative measurement tool for scapular distance measurements.

Inter-Rater Reliability of Chedoke-McMaster Stroke Assessment for Stroke Patients (뇌졸중환자 평가를 위한 Chedoke-McMaster Stroke Assessment의 측정자간 신뢰도)

  • Won, Jong-Hyuk;Kim, Yong-Wook
    • Physical Therapy Korea
    • /
    • v.4 no.3
    • /
    • pp.45-60
    • /
    • 1997
  • This study was performed to determine the inter-rater reliability of the Chedoke-McMaster Stroke Assessment translated in Korean. This measures the physical impairments and disabilities that impact on the lives of individuals with stroke. The purposes of this measure were 1) to stage motor recovery to classify individuals in terms of clinical characteristics, 2) to predict rehabilitation outcomes, and 3) to measure clinically important change in physical function. Twenty-two subjects from physical therapy unit were assessed by two physical therapists. The ratings were compared by Spearman's rank correlation The correlation between two raters ranged from 0.85 to 0.98. Inter-rater reliability coefficient for total scores ranged from 0.95 to 0.97. This study confirms that the Chedoke-McMaster Stroke Assessment yields reliable results.

  • PDF

Inter-rater Reliability of Cervical Proprioception, Dynamic Balance and Dorsiflexion Range of Motion Ising STARmat®

  • Park, Ji-Won;Park, Seol
    • The Journal of Korean Physical Therapy
    • /
    • v.32 no.2
    • /
    • pp.88-93
    • /
    • 2020
  • Purpose: This study examined the inter-rater reliability of cervical proprioception, dynamic balance ability, and ankle dorsiflexion range of motion using STARmat®, which is a practical clinical tool that can provide practitioners and patients with quantitative and qualitative results. Methods: Thirty healthy young subjects were enrolled in this study, and two well-trained physical therapists participated as a tester. Two testers measured the cervical joint position error at the starting position after neck flexion, extension, side bending, and rotation; three dynamic balance tests, including anterior excursion, anterior reaching with single leg balance, and posterior diagonal excursion; and ankle dorsiflexion range of motion using STARmat®. The intra-class correlation coefficient (ICC) was used to determine the inter-rater reliability of the tests. Results: The inter-rater reliability for the cervical proprioception ranged from moderate to good (0.66 to 0.83), particularly for flexion (0.82), extension (0.70), right side bending (0.73), left side bending (0.71), right rotation (0.83), and left rotation (0.66). For the dynamic balance, the inter-rater reliability ranged from good to excellent (0.87 to 0.91), particularly for anterior excursion (0.86), posterior diagonal excursion (0.87 to 0.89), and anterior reaching with a single leg balance (0.90 to 0.91). In addition, for the ankle dorsiflexion range of motion, the ICC for the inter-rater reliability ranged from 0.95 to 0.96. Conclusion: STARmat® is a reliable tool for measuring cervical proprioception, dynamic balance tests, and ankle dorsiflexion range of motion in healthy young adults.

Inter-rater·absolute Reliability and Concurrent Validity of Tinetti-gait Scale (Korean version) in Stroke Patients (뇌졸중 환자들의 한국판 Tinetti-보행 척도의 측정자간·절대적 신뢰도와 동시 타당도)

  • An, Seung-Heon;Lee, Dong-Geon;Lee, Yun-Bok;Lee, Gyu-Chang
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.9 no.2
    • /
    • pp.201-211
    • /
    • 2014
  • PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.