• The Journal of Korean Physical Therapy
• /
• v.22 no.4
• /
• pp.43-48
• /
• 2010

Purpose: This study was designed to determine the test-retest, inter-rater, and intra-rater reliability of the Pediatric Balance Scale (PBS) when applied to children with cerebral palsy (CP). Methods: Subjects were out-patient children with cerebral palsy at four CP clinics in Gyeonggyi-do and Chungcheong nam-do. For test-retest and inter-rater reliability studies, the PBS was used twice on 7 separate days by twenty-four children with CP. To assess intra-rater reliability, 10 CP subjects were selected by random sampling. Four pediatric-trained physical therapists with 2-13 years of clinical experience scored the children’s performance blindly, while replaying videotaped data. Results: There was no significant difference in total scores (ICC 3,1=0.89, 0.93, 0.90, and 0.91) measured by each of the four therapists on two occasions. The Inter-rater reliability assessed the 1st and 2nd time was high (1stICC 3,1=0.91, 2nd ICC 3,1=0.93). The intra-rater reliability measured by each of the four therapists using the 2nd scores was also high (ICC 3,1=0.98, 0.99, 0.97, and 0.98). Conclusion: The PBS is reliable. We believe that it can be used in characterizing children with CP.

• Journal of the Korean Society of Physical Medicine
• /
• v.5 no.3
• /
• pp.477-485
• /
• 2010

Purpose : The clinical scale to assess spasticity of muscle was wildly used the modified Ashworth scale (MAS). But reliability of the MAS has been controverted for ambiguity among the grades. The purpose of this study was to establish the inter-rater reliability of the modified MAS (MMAS) translated into Korean in stroke patients. Methods : Twenty-five patients (sixteen men and nine women) with hemiplegia (ten right and fifteen left) were measured by two raters who were physical therapist in the rehabilitation hospital. The raters assessed spasticity of shoulder adductor, elbow flexor, wrist flexor, hip adductor, knee extensor, and ankle plantar flexor in the same patients according to ratings criteria of the MAS and the MMAS. Results : For the inter-rater reliability of the MAS, two raters agreed on 57.3% and the Kappa values were moderate ($\kappa$=0.41) between two rater. The inter-rater reliability of the MAS was fair for the wrist flexor and the hip adductor and moderate for the other muscles. The intra-rater reliability was good for the shoulder adductor and the knee extensor and moderate for the other muscles. For the inter-rater reliability of the MMAS, two raters agreed on 84.7% and the Kappa values were good ($\kappa$=0.78) between two rater. The inter-rater reliability of the MMAS was moderate for the hip adductor, and good for the shoulder adductor and the wrist flexor, and very good for the other muscles. The intra-rater reliability was good for the wrist flexor and the hip adductor and very good for the other muscles. Conclusion : This study suggests that the MMAS translated into Korean is reliable test scale for the spasticity with stroke patients in the clinical field.

• Journal of the Korean Academy of Clinical Electrophysiology
• /
• v.10 no.1
• /
• pp.29-37
• /
• 2012

Purpose : The purpose of this study was to establish intra-rater, inter-rater, test-retest reliability, and concurrent validity of figure-of-8 walk test in people with stroke. Methods : The subjects of this study were 17 patients who were diagnosed with a stroke. Subjects were tested twice by the same raters, with 1 day between tests. Subjects were assessed by two physical therapists. Test-retest reliability was calculated using intraclass correlation coefficients (ICC). The concurrent validity was demonstrated by spearman correlation of F8WT with 10m walking test (10MWT), timed up and go test (TUG), Berg balance scale (BBS), dynamic gait index (DGI) and four square step test (FSST). Results : Intra-rater, inter-rater, test- retest of F8WT time, showed high reliability. Intra-rater, inter-rater, test-retest of F8WT steps demonstrated high reliability. Intra-rater, inter-rater, test-retest of F8WT total smoothness score showed below moderate reliability. There was a significant positive correlation of F8WT time with 10MWT, TUG, FSST. There was a significant negative correlation of F8WT time with DGI, BBS. There was a significant positive correlation of F8WT steps with 10MWT, TUG, FSST. There was a significant negative correlation of F8WT steps with DGI. There was a significant positive correlation of F8WT test total smoothness score with BBS. Conclusion : The time, and number of steps in F8WT show high inter, intra-rater, test-retest reliability. The F8WT smoothness shows below moderate reliability. The F8WT shows high concurrent validity with other comparable balance, and walking tests. The F8WT is a valid and reliable measure for assessing walking function in patients with a stroke.

• Investigative Magnetic Resonance Imaging
• /
• v.19 no.3
• /
• pp.168-177
• /
• 2015

Purpose: Brain surface intensity model (BSIM)-based cortical thickness analysis does not require complicated 3D segmentation of brain gray/white matters. Instead, this technique uses the local intensity profile to compute cortical thickness. The aim of the present study was to evaluate intra-rater and inter-rater reliability of BSIM-based cortical thickness analysis using images from elderly participants. Materials and Methods: Fifteen healthy elderly participants (ages, 55-84 years) were included in this study. High-resolution 3D T1-spoiled gradient recalled-echo (SPGR) images were obtained using 3T MRI. BSIM-based processing steps included an inhomogeneity correction, intensity normalization, skull stripping, atlas registration, extraction of intensity profiles, and calculation of cortical thickness. Processing steps were automatic, with the exception of semiautomatic skull stripping. Individual cortical thicknesses were compared to a database indicating mean cortical thickness of healthy adults, in order to produce Z-score thinning maps. Intra-class correlation coefficients (ICCs) were calculated in order to evaluate inter-rater and intra-rater reliabilities. Results: ICCs for intra-rater reliability were excellent, ranging from 0.751-0.940 in brain regions except the right occipital, left anterior cingulate, and left and right cerebellum (ICCs = 0.65-0.741). Although ICCs for inter-rater reliability were fair to excellent in most regions, poor inter-rater correlations were observed for the cingulate and occipital regions. Processing time, including manual skull stripping, was $17.07{\pm}3.43min$. Z-score maps for all participants indicated that cortical thicknesses were not significantly different from those in the comparison databases of healthy adults. Conclusion: BSIM-based cortical thickness measurements provide acceptable intra-rater and inter-rater reliability. We therefore suggest BSIM-based cortical thickness analysis as an adjunct clinical tool to detect cortical atrophy.

• Physical Therapy Korea
• /
• v.21 no.1
• /
• pp.1-12
• /
• 2014

The purpose of this study were to determine the intra-rater and inter-rater reliability of shoulder passive range of motion measurement using the "Clinometer + bubble level", a smartphone application and to compare with the intra-rater and inter-rater reliability of measurement using a goniometer. Twenty six patients with stroke were recruited for this study. Two raters measured the passive range of motion of four types of shoulder movements (forward flexion; FF, abduction; ABD, external rotation at $90^{\circ}$ abduction; ER90 and internal rotation at $90^{\circ}$ abduction; IR90) using a goniometer and a smartphone to determine within-day inter-rater reliability. A retest session was performed thirty minutes later to determine within-day intra-rater reliability. The reliability was assessed using intraclass correlation coefficients (ICC) and the standard error of measurement (SEM). The ICC (2,1) for the inter-rater reliabilities of the goniometer and smartphone were good in FF and ABD [ICC (2,1)=.75~.87] and excellent in ER90 [ICC (2,1)=.90~.95]. The intra-rater reliabilities for the goniometer and smartphone were good or more than good, with an ICC (3,1) value >.75, the exception was IR90 measured by rater 2 on the smartphone. These results suggest that smartphone could be used as an alternative method tool for measurement of passive shoulder range of motion in patients with stroke.

• Journal of Korean Clinical Nursing Research
• /
• v.26 no.1
• /
• pp.107-116
• /
• 2020

Purpose: This study was a prospective survey to evaluate the Korean Triage and Acuity Scale (KTAS) inter-rater reliability and to identify discordant areas in the KTAS classification between nurses and paramedics in emergency department (ED). Methods: Inter-rater reliability were evaluated using triage deta from January 11 to May 31, 2019. A convinience sample of a total of 800 patients who visited an emergnecy medical center in Incheon (400 adult and 400 pediatric patients in this study) were selected. The triages of this study a pair of one nurse and one paramedic performed triage at the same time, using the KTAS, Inter-rater reliability for the KTAS was evaluated with the weighted kappa. Results: The inter-rater reliability of the KTAS evaluated by weighted Kappa between nurse-paramedic KTAS score of adult patients was .71, and .66 for pediatric patients. Both were in the level considered as substantial. Among causes of triage discordance, the most frequently identified discordant item in triaging adults was the difference in the measurement of pain intensity (28.0%). For both adult and pediatric patients, multiple chief complaint was identified as the major discordant factor. In triaging pediatric patients the body temperature assessment by subjective judgments was the highest discordant item (50.7%). Conclusion: The study result suggested that the KTAS demonstrated a reasonable level of inter-rater reliability and functioned as a standardized triage tool for emergency medical services. In order to improve the inter-rater reliability and classification competence, it is necessary to revise the current all-integrated KTAS provider course to be differentiated for each job group.

• Physical Therapy Korea
• /
• v.2 no.1
• /
• pp.1-13
• /
• 1995

The purpose of this study was to examine the inter-rater reliability of the Korean translation of the GMFM(Gross Motor Function Measure). Three licensed physical therapists with varying amounts(2 - 6 years) of clinical experience served as raters. Thirty patients with cerebral palsy were subjects for this study. Subjects were 22 boys and 8 girls, aged 1 to 8 years. Reliability of each dimension and each total score of the GMGM were analyzed using ICCs(intraclass correlation coefficients). The reliability of each dimension score ranged from .76 to .98, with the walking, running, and jumping dimension having higher reliability values. The reliability of the total dimension score was .94. We conclude that the GMFM has inter-rater reliability for assessing gross motor function in patients with cerebral palsy.

• The Journal of Korean Physical Therapy
• /
• v.30 no.1
• /
• pp.29-34
• /
• 2018

Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.

• Journal of Preventive Medicine and Public Health
• /
• v.48 no.5
• /
• pp.239-248
• /
• 2015

Objectives: The purpose of this study was to assess the inter-rater reliability and intra-rater reliability of medical record review for the detection of hospital adverse events. Methods: We conducted two stages retrospective medical records review of a random sample of 96 patients from one acute-care general hospital. The first stage was an explicit patient record review by two nurses to detect the presence of 41 screening criteria (SC). The second stage was an implicit structured review by two physicians to identify the occurrence of adverse events from the positive cases on the SC. The inter-rater reliability of two nurses and that of two physicians were assessed. The intra-rater reliability was also evaluated by using test-retest method at approximately two weeks later. Results: In 84.2% of the patient medical records, the nurses agreed as to the necessity for the second stage review (kappa, 0.68; 95% confidence interval [CI], 0.54 to 0.83). In 93.0% of the patient medical records screened by nurses, the physicians agreed about the absence or presence of adverse events (kappa, 0.71; 95% CI, 0.44 to 0.97). When assessing intra-rater reliability, the kappa indices of two nurses were 0.54 (95% CI, 0.31 to 0.77) and 0.67 (95% CI, 0.47 to 0.87), whereas those of two physicians were 0.87 (95% CI, 0.62 to 1.00) and 0.37 (95% CI, -0.16 to 0.89). Conclusions: In this study, the medical record review for detecting adverse events showed intermediate to good level of inter-rater and intra-rater reliability. Well organized training program for reviewers and clearly defining SC are required to get more reliable results in the hospital adverse event study.

• KIEAE Journal
• /
• v.12 no.3
• /
• pp.69-75
• /
• 2012

Developing reliable measures of the environment is important to increase our understanding of the environmental effects on walking among seniors. As a preliminary study for developing an instrument for measuring walkability of seniors' environment, the purpose of this study are to identify important assessment indicators associated with seniors' walking and to test their reliability using inter-rater and intra-rater reliability methods. A set of assessment indicators was identified through literature review, and field studies by trained raters were conducted in three senior centers located in Seongnam area in order to test reliability of the audit tool. The results indicated high percent agreement for most indicators and overall 91.6% and 86.1% of items assessed had good or medium inter-rater and intra-rater reliability, respectively. The reliable assessment indicators would provide reliable data for use in community-based audits of built environment in relation to walking among older adults. The findings showed that the indicators of aesthetics had lower reliability compare to safety, convenience, and access. Rater training with various images would improve rater agreement while reduce rater bias.