• The Journal of the Society of Korean Medicine Diagnostics
• /
• v.9 no.1
• /
• pp.125-130
• /
• 2005

Background and purpose: We evaluated the reliability of two electrodermal measurement devices on meridian skin areas; Electro Acupuncture according to Dr. Voll (EAV) method and newly developed MIR-1. Methods: Eighteen volunteers were tested repeatedly on the same condition with each device. To explore the intra-rater, inter-rater, and test-retest reliabilities, one rater tested each subject twice in succession, then the other rater tested the subject in a row. Finally, retests on the subjects with each device were performed 1 week later. The reliability was determined by Pearson correlation and intraclass correlation statistics. Results: EAV method showed poor reliability, while MIR-1 showed good reliability. Conclusion: It is suggested that further research on the reliability and useful device in both fields of clinical practice and biomedical research.

• The Journal of Korean Physical Therapy
• /
• v.25 no.4
• /
• pp.174-179
• /
• 2013

Purpose: Visual gait analysis plays a pivotal role in determining the important gait problem of patients. A few studies have been published and have received little attention regarding visual gait analysis on patients with orthopedic problems. The purposes of this study were to investigate the difference of reliability levels according to experience of clinical physical therapists. Methods: Thirty-five clinical physical therapists, 5 high experienced, 15 experienced, and 15 inexperienced, were recruited and individually evaluated these videotaped gait patterns of the participants, and filled up the structured gait analysis form. The gait of nine participants was videotaped. Reliability levels were calculated by the Intraclass Correlation Coefficients (ICC). Results: The inter-rater reliability of high experienced group (ICC=0.56; 95% CI: 0.50-0.62) was comparable to that of the experienced raters (ICC=0.48; 95% CI: 0.43-0.53) and inexperienced group (ICC=0.42; 95% CI: 0.38-0.46). High experienced group reached a higher inter-rater reliability level. The average intra-rater reliability of the high experienced group was 0.70 (ICCs ranging from 0.54 to 0.82). The experienced group reached an average intra-rater reliability of 0.61 (ICCs ranging from 0.47 to 0.81). The inexperienced group attained average ICC values of 0.53 (ICCs ranging from 0.30 to 0.74). Conclusion: Use of a structured gait analysis form as described in this study was found to be moderately reliable. Clinical experience appears to increase the reliability of visual gait analysis.

• Physical Therapy Korea
• /
• v.17 no.3
• /
• pp.48-58
• /
• 2010

The aim of this study was performed to determine the inter-rater reliability of the Stroke Rehabilitation Assessment of Movement (STREAM) translated in Korean. This was a new clinical measurement tool for evaluating the recovery of voluntary movement and basic mobility following stroke. A direct-observation reliability study was conducted on 20 patients who had strokes and were in a rehabilitation setting. Subjects were assessed by two physical therapists. The reliability of the STREAM scores was demonstrated by weighted kappa statistics for inter-rater agreement on scores for individual items ranged from .83 to 1.0, intraclass correlation coefficients for total score was .99, and for subscale scores was ranged from .96 to .99. The internal consistency of the STREAM scores was demonstrated by Cronbach alphas of greater than .99 on the subscales and overall. These high levels of reliability support the use of the STREAM translated in Korean instrument for the measurement of motor recovery following stroke.

• Physical Therapy Korea
• /
• v.14 no.2
• /
• pp.29-36
• /
• 2007

Muscle tone (stiffness/hardness) or muscle compliance changes during muscle contraction. The purposes of this study were to assess the intrarater and interrater reliabilities of the Myotonometer$^{(R)}$, electronic device that quantifies muscle tone. Two raters used the Myotonometer to assess the right bicep brachia and quadriceps muscles of 30 voluntary persons without any orthopedic or neurological problems (age range, 18~21 yrs). Muscles were measured in a relaxed state and during brief sustained voluntary maximal isometric contraction. Intrarater correlation coefficients were calculated for each muscle and for each condition (relaxed and contracted). Intrarater reliabilities (intraclass correlation coefficients, ICCs) ranged from .778 to .954, relaxed, biceps brachia), .926 to .963 (contracted, biceps brachia), .935 to .990 (relaxed, quadriceps) and .679 to .952(contracted, quadriceps). Interrater reliabilities ranged from .652 to .790 (relaxed, biceps brachii), .813 to .907 (contracted, biceps brachii), .831 to .950 (relaxed, quadriceps) and .849 to .937 (contracted, quadriceps). Myotonometer measurements had high to very high intrarater and interrater reliability for measurements of the biceps brachia and quadriceps muscles.

• Physical Therapy Korea
• /
• v.9 no.2
• /
• pp.133-144
• /
• 2002

The purpose of this study was to establish reliability of the Tone Assessment Scale (TAS) translated into Korean in patients with stroke. The TAS consists of resting posture, response to passive movement, and associated reaction to active effort. Fifteen patients (14 males, 1 female) were examined by two raters. Surface electromyography (EMG) data at elbow flexor muscle and joint excursion were collected from 6 patients. To identify the correlation between muscle activity and angular changes of elbow muscle, Pearson product moment correlation was used. The inter-rater and intra-rater reliability of the TAS ranged from very good to good (K/Kw=.61~1.00 for intra-rater and K/Kw=.73~1.00 for intra-rater comparisons) in the sections of resting posture and associated reaction. However, in the section of response to passive movement, the reliability coefficients ranged from very good to fair (Kw=.29~1.00). In the 11th item, correlation between EMG ratio of elbow flexor and angular changes of elbow joint showed statistically strong positive relationship (r=.94, p<.05). These results indicate that the TAS is selectively reliable in the sections of resting posture and associated reaction.

• Journal of Korean Elementary Science Education
• /
• v.18 no.1
• /
• pp.65-73
• /
• 1999

The purpose of this study is tile development of tile observation Assessment criteria that is used to assess manipulative skills in elementary science. The procedures of developing observation Assessment criteria are as follows. First, we investigated the actual condition about science process skills assessment with tile questionnaire. Second, we selected 7 experimental apparatus through the analysis of the science textbooks. The selected experimental apparatus are dropper, alcohol lamp, thermometer, test tube, filtering device, able balance, graduated cylinder Third, the observation Assessment criteria arc developed through tile analysis of the related experimental textbooks, the demonstrations, and the questionnaire, Forth, tile validity is verified by science education specialists and graduate students who major in science education. Fifth, the first jilter-rater agreement is investigated in the result of the field with observation criteria of which the validity was verified. The second inter-rater agreement is investigated through the revision and the addition of the criteria with the low agreement. In result, the jilter-rater agreement ranged from 0.86 to 0.98. One of the major problems in observation assessment is the rater's subjective viewpoint. So, this research shows a more specified scale and criteria for the assessment. This suggests that the observation Assessment criteria developed in tile study satisfies the high reliability and validity requirements. Considering the results, this criteria call be used effectively for assessing manipulative skills of elementary school students.

• Journal of the Korean Society of Physical Medicine
• /
• v.16 no.1
• /
• pp.1-7
• /
• 2021

PURPOSE: The purpose of this study is to conduct inter-rater and intra-rater reliability tests in patients with low back pain (LBP) using the prone instability test (PIT) and side-lying instability test (SIT). We have analyzed the Korean version Oswestry disability index (K-ODI) correlations and radiograph finding (RF) for validity. METHODS: Individuals (n = 51) (mean age of 40.27 ± 13.28) with LBP for at least over a week were recruited, together with two participating physical therapist examiners. The measurement consisted of PIT, PST, K-ODI, and RF. Sensitivity (Sn), specificity (Sp), positive predictive value, negative predictive value, prevalence index, agreement %, Cohen's kappa, and prevalence-adjusted bias-adjusted kappa (PABAK) were calculated. The PIT and SIT were compared with RF for validity analysis, while PIT, SIT, K-ODI, and RF were calculated for the correlation analysis. RESULTS: The intra-rater reliability test measured for the PIT (kappa = .79, PABAK = .88) and SIT (kappa = .73, PABAK = .84), and inter-rater reliability test measured for the SIT (kappa = .80, PABAK = .88) showed good agreements. The PIT (Sn = .65, Sp = .63) and SIT validities (Sn = .68, Sp = .70) were compared with RF, showing a significant correlation in PIT and RF (r = .69), SIT and RF (r = .73), and PIT and K-ODI (r = .53). CONCLUSION: The SIT is a more comfortable position test than the PIT in patients. Both PIT and SIT have acceptable reliability and validity.

• The Journal of Korean Physical Therapy
• /
• v.22 no.4
• /
• pp.57-64
• /
• 2010

Purpose: This study aimed to determine whether there are differences in subtalar joint range of motion (ROM) when using different measurement methods, and to determine inter- and intra-rater reliability of goniometry as used in clinical setting. Methods: Subjects were thirty-one healthy males and females (sixty-two ankles) living in Korea. Three raters with different clinical experiences measured inversion and eversion range of motion of the subtalar joint two times. Measurements were done with subjects prone (open kinetic chain) and standing (closed kinetic chain). Rater and measurement methods were based on analyzing differences in range of motion. Intra-class correlation coefficients (ICCs) were calculated to determine intra-rater and inter-rater reliability. Results: Mean subtalar jont range of motion for inversion ranged from $9.31^{\circ}$ to $11.94^{\circ}$ for eversion, it ranged from $6.73^{\circ}$ to $9.20^{\circ}$. The differences in ROM between raters and between measurement methods were significant (p<0.01). The ICCs for interrater reliability ranged from $0.02^{\circ}$ to $0.20^{\circ}$ for inversion and from $0.23^{\circ}$ to $0.39^{\circ}$ for eversion. Intrarater reliability ranged from $0.32^{\circ}$ to $0.78^{\circ}$ for inversion and from $0.45^{\circ}$ to $0.73^{\circ}$ for eversion. Conclusion: Subtalar joint inversion and eversion ROM show differences for measurement methods low reliability between different raters, and low to high intra-rater reliability within sessions.

• Physical Therapy Rehabilitation Science
• /
• v.8 no.4
• /
• pp.218-224
• /
• 2019

Objective: This reliability study examined the effects of applying varying induced inward pressures using a transducer placed at 0° neutral ankle position (NEU) and 15° ankle dorsiflexion (DF) on tibialis anterior (TA) muscle thickness using a custom-made device with a force indicator during rehabilitative ultrasound imaging. Design: Cross-sectional study. Methods: Twenty-four healthy subjects were recruited in this study. Two examiners measured the muscle thickness of the TA at 0° NEU and 15° DF in 3 conditions of inward pressures (1.0 N, 2.0 N, and 4.0 N) using a custom-made holder. The muscle thickness was measured three times for each of the conditions arranged in random order. For intra- and inter-rater reliability, the intraclass correlation coefficients (ICCs) with 95% confidence intervals, standard error of measurement, minimal detectable change, and coefficient of variation were analyzed. One-way repeated measures analysis of variance was conducted for investigating changes of TA muscle thickness according to the inward pressures of the transducers. Results: The intra-rater reliability of TA muscle thickness measurement was excellent (ICC_3,1: 0.92-0.96) for all conditions (at both ankle joint angles per varying inward pressure). Likewise, the inter-rater reliability of TA muscle thickness measurement was excellent (ICC_2,1: 0.89-0.97) under same conditions. The mean of TA thickness showed the trend of decreasing significantly with increased inward pressures at all ankle joint angles (p<0.05). Conclusions: Use of this custom-made device with a force indicator is useful to accomplish the high intra- and inter-rater reliability of TA muscle thickness measurement at both ankle joint angles in reducing the measurement error.

• The Journal of Korean Physical Therapy
• /
• v.27 no.4
• /
• pp.183-189
• /
• 2015

Purpose: The aim of this study was to examine the test-retest and inter-rater reliability of the pediatric functional muscle testing (PFMT) when applied to children with developmental delay. Methods: Sixteen children with developmental delay (seven females, nine males) participated in this study. For the inter-rater reliability, each was scored on the PMFT by two pediatric physical therapists with more than 8 years of clinical experience on the same day. For assessment of the test-retest reliability, one therapist tested the children again within 10 days. The second measurement was performed by taking a first measurement in video. Intraclass correlation coefficient (ICC) was calculated to determine the test-retest and inter-rater reliability of the PFMT, and Chronbach's alpha was used to measure internal consistency. Results: The results of this study were as follows: 1) The test-retest ICC of the score of the infant action month and the right side of the PFMT was from 0.53 to 1.00 and from 0.63 to 0.99, respectively. 2) The inter-rater ICC of the score of the infant action month and the right side of the PFMT was from 0.66 to 1.00 and from 0.64 to 1.00, respectively. 3) Chronbach's alpha was 0.93. The internal consistency indicated excellent. Conclusion: In conclusion, this study showed that the test-retest and inter-rater reliability of the PFMT was relatively high, except for a few items. Therefore, it can be suggested that the PFMT will be a useful tool for measurement of muscle strength for children with developmental delay if it be some modifications.