• Title/Summary/Keyword: Interrater reliability

Search Result 76, Processing Time 0.035 seconds

The Reliability of Thickness Measurement of the Deep Fiber of the Lumbar Multifidus Using Ultrasonography

  • Jung, Doh-Heon;Kim, Su-Jung;Yi, Chung-Hwi;Cynn, Heon-Seock;Choi, Houng-Sik
    • Physical Therapy Korea
    • /
    • v.17 no.4
    • /
    • pp.49-54
    • /
    • 2010
  • The reliability of the thickness measurement of the lumbar multifidus (LMD using real-time ultrasonography (US) was determined in only the superficial fiber of the lumbar multifidus (SM). However, previous studies have not examined the reliability of the deep fiber of the LM (DM). The purpose of this study was to determine the intrarater and the interrater reliability of the thickness measurements of DM using US. Eleven heathy males participated in the study. The thickness of the DM was measured with an US in the prone position. Reliability was examined using intraclass correlation coefficients (ICC), standard error of the measurement (SEM), and the Bland and Altman plot. ICC(3,1) was used to calculate the interrater reliability of the thickness measurement of DM using the values from both the first and second test sessions. Additionally, ICC(3,1) was used to calculate the intrarater reliability of the measurements over two days using the measurements obtained in test session 1 and lest session 2. The results of this study were as follows: 1) the ICC(3,1) value for interrater reliability was .94 in the first test session, and .93 in the second test session. 2) the ICC(3,1) values for intrarater reliability of the measurements over two days was .90 in both the first examiner and the second examiner. The interrater reliability and interrater reliability of the DM measurements, obtained via the US protocol used in this research was excellent. Therefore, we conclude that the thickness measurement of the DM obtaioned from the US protocol used in this research would be useful for clinician assessment of the thickness of the DM.

Measurement of Intrarater Reliability and Interrater Reliability of a Portable Digital Pressure Algometer (휴대용 디지털 압통기의 측정자내 신뢰도 및 측정자간 신뢰도 측정)

  • Lee, Won-Hwee;Oh, Jae-Seop;Park, Kyue-Nam;Kwon, Oh-Yun;Song, Mi-Hye;Park, Ho-Dong;Lee, Kyoung-Joung
    • Physical Therapy Korea
    • /
    • v.15 no.3
    • /
    • pp.62-69
    • /
    • 2008
  • The purpose of this study was to measure intrarater and interrater reliability of a portable digital pressure algometer. Fifty healthy subjects were recruited for this study. Pressure pain thresholds of splenius capitis, levator scapular, and upper trapezius muscles were measured using by FPK algometer and portable digital pressure algometer. Three trials were done on each subject by two examiners. Intraclass correlation coefficients (ICCs) were used to determine the reliability of each measure. The intrarater reliability of the FPK algometer was good and excellent (ICC .63~.79) and the interrater reliability was poor and good (ICC .15~.57). The intrarater reliability of a portable digital pressure algometer was excellent (ICC .75~.86) and the interrater reliability was poor and good (ICC .35~.61). This result suggests that the intrarater reliability and interrater reliability of a portable digital pressure algometer were better than an FPK algometer.

  • PDF

Intrarater and Interrater Reliability of the Dynamic Gait Index in Persons With Parkinson's Disease

  • Hwang, Su-Jin;Woo, Young-Keun
    • Physical Therapy Korea
    • /
    • v.17 no.4
    • /
    • pp.55-60
    • /
    • 2010
  • Clinical measures that Quantify falling risk factors are needed for the accurate evaluation of patients and to plan an intervention strategy. The purpose of this study was to examine the test-retest and interrater reliability of the dynamic gait index (DGI) for persons with Parkinson's disease (PD). A total of 22 idiopathic PD patients were recruited from rehabilitation hospital, Korea in this study. The DGI was assessed in two sessions that were, three days apart. We also measured Berg balance test (BBT) and geriatric depression scale (GDS) for concurrent validity with DGI. Intrarater and interrater reliability (.96 and .98 respectively) for DGI were high. indicating good agreement. The DGI was showed a good positive correlation with the BBS (r=.852). but not GDS (r=-.462). Intrarater and interrater reliability of DGI were high in people with PD. The DGI could be a reliable measure to evaluate functional postural control during gait activities in the PD population, and the ability of DGI to detect real change is acceptable in research and clinical settings.

The Reliability of Balance, Gait, and Muscle Strength Test for the Elderly with Dementia: A Systematic Review

  • Lee, Han-Suk;Park, Sun-Wook
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.12 no.3
    • /
    • pp.49-58
    • /
    • 2017
  • PURPOSE: To summarize the evaluation tools of balance [Berg Balance Scale (BBS), timed up and Go (TUG), forward reaching test (FRT)], gait [6 m walking Test (6MWT)], and strength [Chair Stand Test (CST)] for patients with dementia. METHODS: The following databases were searched: Pub MED, Cochrane, Sciences Direct, and Web of Sciences. The inclusion criteria were as follows: 1) repeated measurement design, 2) subjects with dementia, 3) use of testing tools such as the BBS, TUG, FRT, 6MWT, and CST, 4) report the reliability. One reviewer performed the quality assessment of diagnostic accuracy study and two evaluators performed data extraction independently. RESULTS: Six articles and one letter were included. The interrater reliability of 6MWT, TUG, and CST, were acceptable (ICC>.90). However, FRT had unacceptable reliability. In test-retest reliability, only BBS has acceptable reliability (ICC>.90). Others had various reliabilities. The risk of interrater reliability bias was low in all studies. However, the risk of bias of intrarater reliability was low in five studies and moderate in two studies. CONCLUSION: The interrater reliability of the 6MWT, TUG, and CST were acceptable. However, in test-retest reliability, only BBS has acceptable reliability. Therefore, we suggest the use of BBS to test the balance of dementia patients. In addition, the study of tool reliability according to the subtype of dementia is needed in the future.

Interrater Reliability in the Content Analysis of Preparatory Information for Mechanically Ventilated Patients (인공호흡기 사용 환자들에게 제공된 예비적 정보에 대한 내용분석의 측정자간 신뢰도)

  • Kim Hwa-Soon
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.5 no.2
    • /
    • pp.269-279
    • /
    • 1998
  • In nursing research that the data is collected through clinical observation, analysis of clinical recording or coding of interpersonal interaction in clinical areas, testing and reporting interrater reliability is very important to assure reliable results. Procedures for interrater reliability in these studies should follow two steps. The first step is to determine unitizing reliability, which is defined as consistency in the identification of same data elements in the record by two or more raters reviewing the same record. Unitizing reliability have been rarely reported in previous studies. Unitizing reliability should be tested before progressing to the next step as precondition. Next step is to determine interpretive reliability. Cohen's kappa is a preferable method of calculating the extent of agreement between observer or judges because it provides beyond-chance agreement. Despite its usefulness, kappa can sometimes present paradoxical conclusions and can be difficult to interpret. These difficulties result from the feature of kappa which is affected in complex ways by the presence of bias between observers and by true prevalence of certain categories. Therefore, percentage agreement should be reported with kappa for adequate interpretation of kappa. The presence of bias should be assessed using the bias index and the effect of prevalence should be assessed using the prevalence index. Researchers have been reported only global reliability reflecting the extent to which coders can consistently use the whole coding system across all categories. Category-by-category reliability also need to be reported to inform the possibility that some categories are harder to use than others.

  • PDF

Interrater Reliability of Upper Extremity Function Assessment on Stroke (뇌졸중 환자에 대한 상지기능 평가도구의 검사자간 신뢰도)

  • Hwang, Seong-Soo;Kim, Pu-Reum;Won, Ji-In;Yoo, Seon-Ju;Yoon, Jun-Byung;Lee, Keun-Woo;Lee, Wang-Jae
    • PNF and Movement
    • /
    • v.10 no.1
    • /
    • pp.1-7
    • /
    • 2012
  • Purpose : To verify the interrater reliability of upper extremity function assessment among three tools(Wolf motor function test, Motor assessment scale, Fugl-meyer assessment scale). Methods : The subjects of this study 40 (20 was physical therapists and 20 was physical therapy students). For the test one patients with chronic hemiparesis after stroke participated in the study. The Wolf Motor Function Test consists of 16 functional tasks. The motor assessment scale consists of 3 functional tasks. The fugl-meyer assessment scale consists of 8 functional tasks. All test sessions were videotaped and scored by 40 subjects. Analysis : The data was analysis by SPSS PC 14.0 with Cronbach alpha Coefficients, intraclass Correlation Coefficients Kendall tau-b value. Results : WMFT was highly scored in Cronbach's value, Cronbach's ${\alpha}=0.819$ that means high interrater reliability among assessment. WMFT was highly scored all items in p-value except one item, that means high p-value between therapists and students. WMFT was highly scored in Intrarater correlation coefficient (ICC) = 0.79, that means high interrater reliability of each examination item. WMFT was low index of coincidence from all items, MAS was low index of coincidence from a tim and FMA was low index of coincidence from 4 items. Conclusion : The interrater reliability of WMFT were compared with MAS, FMA and highly verified. WMFT can be more useful tool among upper extremity function assessment.

Reliability of the EOS Imaging System for Assessment of the Spinal and Pelvic Alignment in the Sagittal Plane

  • Kim, Sang Bum;Heo, Youn Moo;Hwang, Cheol Mog;Kim, Tae Gyun;Hong, Jee Young;Won, You Gun;Ham, Chang Uk;Min, Young Ki;Yi, Jin Woong
    • Clinics in Orthopedic Surgery
    • /
    • v.10 no.4
    • /
    • pp.500-507
    • /
    • 2018
  • Background: The sagittal alignment of the spine and pelvis is not only closely related to the overall posture of the body but also to the evaluation and treatment of spine disease. In the last few years, the EOS imaging system, a new low-dose radiation X-ray device, became available for sagittal alignment assessment. However, there has been little research on the reliability of EOS. The purpose of this study was to evaluate the intrarater and interrater reliability of EOS for the sagittal alignment assessment of the spine and pelvis. Methods: Records of 46 patients were selected from the EOS recording system between November 2016 and April 2017. The exclusion criteria were congenital spinal anomaly and deformity, and previous history of spine and pelvis operation. Sagittal parameters of the spine and pelvis were measured by three examiners three times each using both manual and EOS methods. Means comparison t-test, Pearson bivariate correlation analysis, and reliability analysis by intraclass correlation coefficients (ICCs) for intrarater and interrater reliability were performed using R package "irr." Results: We found excellent intrarater and interrater reliability of EOS measurements. For intrarater reliability, the ICC ranged from 0.898 to 0.982. For interrater reliability, the ICC ranged from 0.794 to 0.837. We used a paired t-test to compare the values measured by manual and EOS methods: there was no statistically significant difference between the two methods. Correlation analysis also showed a statistically significant positive correlation. Conclusions: EOS showed excellent reliability for assessment of the sagittal alignment of the spine and pelvis.

Concurrent Validity, Inter-Tester and Intra-Tester Reliability of Goniometric Measurement of Active Elbow Range of Motion Using 4 Different Types of Measuring Instruments (주관절 가동범위 측정법에 대한 동시타당도와 신뢰도)

  • Current, Marion E.;Yi, Chung-Hwi
    • Physical Therapy Korea
    • /
    • v.2 no.2
    • /
    • pp.46-55
    • /
    • 1995
  • The purpose of this study was to assess the concurrent validity and reliability of goniometric measurement of joint motion. Subjects were 40 healthy university students. Measurements were performed by 4 inexperienced physical therapy students. Four different instruments were used and three readings were taken with each instrument in random order making a total of 12 readings for flexion of the right elbow of each subject. Goniometers used were 1. universal 2. fluid-based goniometer/inclinometer 3. digital LCD goniometer 4. electronic goniometer/torsiometer. The results were as follows: Concurrent validity was highest (r= .94) with the universal and digital LCD tools. Interrater reliability (Pearson Product Moment Correlation) was good for each tool. Interrater reliability calculated by ICC(2,1) was highest (.96) with the tensiometer and lowest (.78) with the digital LCD goniometer. Intrarater reliability calculated by ICC was excellent (${\geq}.90$) for all instruments. These results show that concurrent validity, intrarater and interrater reliability are very good in the used of all four types of goniometers/inclinometer/tensiometer, even with inexperienced raters. These results confirm the almost universal reliance on hand held goniometers for joint measurement by physical therapists as being a reliable practice. Further research should be done clinically with actual patients.

  • PDF

Reliability of the Active Knee Extension Test With a Pressure Biofeedback Unit

  • Kim, Chang-ho;Gwak, Gyeong-tae;Kwon, Oh-yun
    • Physical Therapy Korea
    • /
    • v.24 no.3
    • /
    • pp.40-46
    • /
    • 2017
  • Background: The active knee extension (AKE) test commonly used to assess the flexibility of the hamstring muscles. Many researchers have tested the reliability of the AKE test; however, no published studies have examined the intrarater and interrater reliability of the AKE test using a PBU. Objects: The purpose of this study was to determine the intrarater and interrater reliability of the AKE test performed with a pressure biofeedback unit (PBU) on healthy subjects. Methods: Sixteen healthy male participants volunteered and gave informed consent to participate in this study. Two raters conducted AKE tests independently with a PBU. Each knee was measured twice, and the AKE testing was repeated one week after the first round of testing. Results: The interrater reliability's intraclass correlation coefficients ($ICC_{2,1}$) were .887~.986 for the right knees and .915~.988 for the left knees. In addition, the intrarater (test-retest) reliability ($ICC_{3,1}$) values ranged between .820~.915 and .820~.884 for Raters 1 and 2, respectively. The values for the standard error of mesurement were low for all tests ($.81{\sim}2.97^{\circ}$); the calculated minimum detectable change was $2.24{\sim}8.21^{\circ}$. Conclusion: These findings suggest that the AKE test performed with a PBU had excellent interrater and intrarater reliability for assessing hamstring flexibility in healthy young males.

Development of Korean Version of WHO-CIDI(Composite International Dignostic Interview)-Social Phobia : Its Validity and Reliability (한국어판 WHO-CIDI(Composite International Diagnostic Interview)-사회 공포증의 개발 : 타당도 및 신뢰도 검사)

  • Seo, Joo-Won;Oh, Kang-Seoh;Lee, Si-Hyung
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.8 no.2
    • /
    • pp.191-200
    • /
    • 2000
  • It is our purpose to evaluate the validity & interrater reliability of CIDI-social phobia, Korean Version. Method : CIDI-Social phobia Korean Version was evaluated by 50 Korean social phobia patients who met diagnostic criteria of DSM-IV. The authors calculated diagnostic concordance rate between clinical diagnosis & diagnosis by using the CIDI-social phobia Korean Version for evaluating validity. We also calculated the interrater diagnostic concordance of 20 social phobia patients for evaluating interrater reliability. Results : Validity of the CIDI-social phobia Korean Version was 0.74, & Interrater reliability(kappa) was 0.75. Conclusions : CIDI-Social phobia, Korean version had a good reliability & validity. That was proved a good instrument for diagnosing social phobia for general population and clinical patients

  • PDF