• The Journal of Advanced Prosthodontics
• /
• v.6 no.3
• /
• pp.185-193
• /
• 2014

PURPOSE. The purpose of this study was to evaluate the intra-rater reliability and inter-rater reliability of three different methods using a drawing protractor, a digital protractor after tracing, and a CAD system. MATERIALS AND METHODS. Twenty-four artificial abutments that had been prepared by dental students were used in this study. Three dental students measured the convergence angles by each method three times. Bland-Altman plots were applied to examine the overall reliability by comparing the traditional tracing method with a new method using the CAD system. Intraclass Correlation Coefficients (ICC) evaluated intra-rater reliability and inter-rater reliability. RESULTS. All three methods exhibited high intra-rater and inter-rater reliability (ICC>0.80, P<.05). Measurements with the CAD system showed the highest intra-rater reliability. In addition, it showed improved inter-rater reliability compared with the traditional tracing methods. CONCLUSION. Based on the results of this study, the CAD system may be an easy and reliable tool for measuring the abutment convergence angle.

• The Journal of Korean Physical Therapy
• /
• v.33 no.4
• /
• pp.187-192
• /
• 2021

Purpose: The purpose of the current study was to determine the intra- and inter-rater reliability of muscle thickness measurement of the TA using ultrasonography (US) conducted at different inward pressures of approximately 0.5 kg, 1.0 kg, and no pressure control. Methods: Twenty healthy subjects were recruited for this study. Two different examiners measured the thicknesses of the dominant TA of each subject randomly to assess the intra- and inter-rater reliability. The measurement values were analyzed using the intra-class correlation coefficient (ICC) with a 95% confidence interval, standard error of measurement, minimal detectable change, and coefficient of variance. Results: All intra-rater reliability ICC values showed high reliability above 0.9. Inter-rater reliability ICC values showed high reliability above 0.9 with 0.5 and 1.0 kg of inward pressure. In contrast, Inter-rater reliability ICC values showed poor reliability (0.23) with no pressure control of inward pressure. Conclusion: The findings showed that maintaining consistent inward pressure is essential for reliable results when the muscle thickness of the TA is measured by different examiners in a clinical setting.

• Physical Therapy Korea
• /
• v.21 no.1
• /
• pp.1-12
• /
• 2014

The purpose of this study were to determine the intra-rater and inter-rater reliability of shoulder passive range of motion measurement using the "Clinometer + bubble level", a smartphone application and to compare with the intra-rater and inter-rater reliability of measurement using a goniometer. Twenty six patients with stroke were recruited for this study. Two raters measured the passive range of motion of four types of shoulder movements (forward flexion; FF, abduction; ABD, external rotation at $90^{\circ}$ abduction; ER90 and internal rotation at $90^{\circ}$ abduction; IR90) using a goniometer and a smartphone to determine within-day inter-rater reliability. A retest session was performed thirty minutes later to determine within-day intra-rater reliability. The reliability was assessed using intraclass correlation coefficients (ICC) and the standard error of measurement (SEM). The ICC (2,1) for the inter-rater reliabilities of the goniometer and smartphone were good in FF and ABD [ICC (2,1)=.75~.87] and excellent in ER90 [ICC (2,1)=.90~.95]. The intra-rater reliabilities for the goniometer and smartphone were good or more than good, with an ICC (3,1) value >.75, the exception was IR90 measured by rater 2 on the smartphone. These results suggest that smartphone could be used as an alternative method tool for measurement of passive shoulder range of motion in patients with stroke.

• The Journal of Korean Physical Therapy
• /
• v.22 no.4
• /
• pp.29-33
• /
• 2010

Purpose: The purpose of this study was to assess and compare the reliability of the Modified Tardieu Scale (MTS) with the Modified Ashworth Scale (MAS) in patients with hemiplegia. Methods: Two experienced physical therapists examined twenty six patients (17 male and 9 female) with an age range of 19-83 years (mean=51.9 SD=15.2). They assessed the elbow flexor/extensor muscle spasticity in the affected side. Interand intra-rater reliability of the MAS and the MTS were calculated using kappa statistics. Intraclass correlation coefficient (ICC) was calculated to determine the inter- and intra-rater reliability of the angle of muscle reactions (R2-R1). Results: The intra-rater reliability of the MAS (K=0.39-0.55) and MTS (K=0.33-0.55) was fair to moderate. The inter-rater reliability was significantly higheras measured with MTS (K=0.54-0.66) in comparison with MAS (K=0.52). Intra-rater reliability of R2-R1 was moderate to almost perfect (ICC=0.52-0.86), and inter-rater reliability was substantial (ICC=0.74-0.76). Conclusion: The MTS provides higher inter-rater reliability compared with the MAS in hemiplegia patient analysis, but intra-rater reliability of both scales was not significantly different. Thus further research is needed to examine not only reliability, but also validity of these measurement systems.

• Physical Therapy Korea
• /
• v.22 no.4
• /
• pp.62-70
• /
• 2015

The aims of the current study were to assess reliability of range of motion (ROM) measurement of glenohumeral internal rotation (GIR) with a pressure biofeedback stabilization (PBS) method and to compare the reliability between manual stabilization (MS) and the PBS method. In measurement of pure glenohumeral joint motion, scapular stabilization is necessary. The MS method in GIR ROM measurement was used to restrict scapular motion by pressing the palm of the tester's hand over the subject's clavicle, coracoid process, and humeral head. The PBS method was devised to maintain consistent pressure for scapular stabilization during GIR ROM measurement by using a pressure biofeedback unit. GIR ROM was measured by 2 different stabilization methods in 32 subjects with GIR deficit using a smartphone clinometer application. Repeated measurements were performed in two test sessions by two testers to confirm inter- and intra-rater reliability. After tester A performed measurements in test session 1, tester B's measurements were conducted one hour later on the same day to assess the inter-rater reliability and then tester A performed again measurements in test session 2 for confirming the intra-rater reliability. Intra-class correlation coefficient (ICC) (2,1) was applied to assess the inter-rater reliability and ICC (3,1) was applied to determine the intra-rater reliability of the two methods. In the PBS method, the intra-rater reliability was excellent (ICC=.91) and the inter-rater reliability was good (ICC=.84). The inter-rater and intra-rater reliability of the PBS method was higher than in the MS method. The PBS method could regulate manual scapular stabilization pressure in inter- and intra-rater measuring GIR ROM. Results of the current study recommend that the PBS method can provide reliable measurement data on GIR ROM.

• Journal of the Korean Society of Physical Medicine
• /
• v.5 no.3
• /
• pp.477-485
• /
• 2010

Purpose : The clinical scale to assess spasticity of muscle was wildly used the modified Ashworth scale (MAS). But reliability of the MAS has been controverted for ambiguity among the grades. The purpose of this study was to establish the inter-rater reliability of the modified MAS (MMAS) translated into Korean in stroke patients. Methods : Twenty-five patients (sixteen men and nine women) with hemiplegia (ten right and fifteen left) were measured by two raters who were physical therapist in the rehabilitation hospital. The raters assessed spasticity of shoulder adductor, elbow flexor, wrist flexor, hip adductor, knee extensor, and ankle plantar flexor in the same patients according to ratings criteria of the MAS and the MMAS. Results : For the inter-rater reliability of the MAS, two raters agreed on 57.3% and the Kappa values were moderate ($\kappa$=0.41) between two rater. The inter-rater reliability of the MAS was fair for the wrist flexor and the hip adductor and moderate for the other muscles. The intra-rater reliability was good for the shoulder adductor and the knee extensor and moderate for the other muscles. For the inter-rater reliability of the MMAS, two raters agreed on 84.7% and the Kappa values were good ($\kappa$=0.78) between two rater. The inter-rater reliability of the MMAS was moderate for the hip adductor, and good for the shoulder adductor and the wrist flexor, and very good for the other muscles. The intra-rater reliability was good for the wrist flexor and the hip adductor and very good for the other muscles. Conclusion : This study suggests that the MMAS translated into Korean is reliable test scale for the spasticity with stroke patients in the clinical field.

• Journal of Preventive Medicine and Public Health
• /
• v.48 no.5
• /
• pp.239-248
• /
• 2015

Objectives: The purpose of this study was to assess the inter-rater reliability and intra-rater reliability of medical record review for the detection of hospital adverse events. Methods: We conducted two stages retrospective medical records review of a random sample of 96 patients from one acute-care general hospital. The first stage was an explicit patient record review by two nurses to detect the presence of 41 screening criteria (SC). The second stage was an implicit structured review by two physicians to identify the occurrence of adverse events from the positive cases on the SC. The inter-rater reliability of two nurses and that of two physicians were assessed. The intra-rater reliability was also evaluated by using test-retest method at approximately two weeks later. Results: In 84.2% of the patient medical records, the nurses agreed as to the necessity for the second stage review (kappa, 0.68; 95% confidence interval [CI], 0.54 to 0.83). In 93.0% of the patient medical records screened by nurses, the physicians agreed about the absence or presence of adverse events (kappa, 0.71; 95% CI, 0.44 to 0.97). When assessing intra-rater reliability, the kappa indices of two nurses were 0.54 (95% CI, 0.31 to 0.77) and 0.67 (95% CI, 0.47 to 0.87), whereas those of two physicians were 0.87 (95% CI, 0.62 to 1.00) and 0.37 (95% CI, -0.16 to 0.89). Conclusions: In this study, the medical record review for detecting adverse events showed intermediate to good level of inter-rater and intra-rater reliability. Well organized training program for reviewers and clearly defining SC are required to get more reliable results in the hospital adverse event study.

• The Journal of Korean Physical Therapy
• /
• v.22 no.6
• /
• pp.35-42
• /
• 2010

Purpose: To investigate the rater reliability of a Pediatric Balance Scale (PBS) for children with cerebral palsy, and to investigate possible differences among raters according to their clinical work experience and testing experience. Methods: Study participants included 18 children with spastic cerebral palsy who could walk. They were instructed by pediatric physical therapists, two of whom had ten years of clinical work experience and two who had less than one year of experience. The children's ability to achieve physical balance was videotaped for PBS items. The raters watched the tapes and evaluated each child twice. Rater reliability was analyzed using the intraclass correlation coefficient (ICC). Differences between experienced and novice raters were analyzed using a paired t-test. The statistical significance level was set to 0.05. Results: The total PBS scores averaged 45.78~48.00 and 45.72~47.67 for first and second tests. Intra-rater reliability was very high (ICC=0.89~0.99), and the repeated measurement coincidence was high (p>0.05). Inter-rater reliability was high (ICC=0.83~0.84), but there was a bit of a difference in the coincidence (p<0.05). The experienced raters' reliability and coincidence were higher than those of the novices, and there were differences in reliance and coincidence between experienced and novice raters (p<0.05). Conclusion: Inter-rater and intra-rater reliability is very high. However, rater reliability showed defferences depending on clinical work experience and testing experience. When testing pediatric patients with the PBS, the rater's clinical experience and test experience may affect the test results.

• Journal of the Korean Academy of Clinical Electrophysiology
• /
• v.10 no.1
• /
• pp.29-37
• /
• 2012

Purpose : The purpose of this study was to establish intra-rater, inter-rater, test-retest reliability, and concurrent validity of figure-of-8 walk test in people with stroke. Methods : The subjects of this study were 17 patients who were diagnosed with a stroke. Subjects were tested twice by the same raters, with 1 day between tests. Subjects were assessed by two physical therapists. Test-retest reliability was calculated using intraclass correlation coefficients (ICC). The concurrent validity was demonstrated by spearman correlation of F8WT with 10m walking test (10MWT), timed up and go test (TUG), Berg balance scale (BBS), dynamic gait index (DGI) and four square step test (FSST). Results : Intra-rater, inter-rater, test- retest of F8WT time, showed high reliability. Intra-rater, inter-rater, test-retest of F8WT steps demonstrated high reliability. Intra-rater, inter-rater, test-retest of F8WT total smoothness score showed below moderate reliability. There was a significant positive correlation of F8WT time with 10MWT, TUG, FSST. There was a significant negative correlation of F8WT time with DGI, BBS. There was a significant positive correlation of F8WT steps with 10MWT, TUG, FSST. There was a significant negative correlation of F8WT steps with DGI. There was a significant positive correlation of F8WT test total smoothness score with BBS. Conclusion : The time, and number of steps in F8WT show high inter, intra-rater, test-retest reliability. The F8WT smoothness shows below moderate reliability. The F8WT shows high concurrent validity with other comparable balance, and walking tests. The F8WT is a valid and reliable measure for assessing walking function in patients with a stroke.

• Physical Therapy Korea
• /
• v.26 no.1
• /
• pp.8-18
• /
• 2019

Background: Numerous studies have used smartphone applications to measure the range of motion in different joints. In addition, studies measuring the active range of motion (AROM) of the craniocervical joint have revealed high reliability. However, the subjects in these studies were all healthy subjects. No study has yet been conducted to measure the inter-rater reliability for the AROM of the craniocervical joint in stroke patients. Objects: The purpose of this study was to investigate the inter-rater reliability of the AROM of the craniocervical joint using a smartphone. Methods: The participants included 21 subjects who had strokes (17 males and 4 females). Two raters evaluated six types of craniocervical AROM, including flexion, extension, lateral flexion to the hemiplegic side, lateral flexion to the non-hemiplegic side, rotation to the hemiplegic side, and rotation to the non-hemiplegic side, using a goniometer and a smartphone to investigate inter-rater reliability. The inter-rater reliability was analyzed by intraclass correlation coefficients (ICC). Results: The inter-rater reliability of the smartphone was good for extension, lateral flexion to the hemiplegic side, lateral flexion to the non-hemiplegic side, and rotation to the hemiplegic side [ICC(2,k)=.86~.88] and excellent for flexion [ICC(2,k)=.95]. The inter-rater reliability for rotation to the non-hemiplegic side was moderate [ICC(2,k)=.72]. Conclusion: These results suggest that the smartphone offers high inter-rater reliability for measurements of the craniocervical AROM in patients with stroke.