• Title/Summary/Keyword: Intraclass Correlation

Search Result 331, Processing Time 0.027 seconds

Inter-rater·absolute Reliability and Concurrent Validity of Tinetti-gait Scale (Korean version) in Stroke Patients (뇌졸중 환자들의 한국판 Tinetti-보행 척도의 측정자간·절대적 신뢰도와 동시 타당도)

  • An, Seung-Heon;Lee, Dong-Geon;Lee, Yun-Bok;Lee, Gyu-Chang
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.9 no.2
    • /
    • pp.201-211
    • /
    • 2014
  • PURPOSE: The purpose of this study was to investigate the inter-rater absolute reliability and the concurrent validity of the Tinetti-gait scale that was translated into Korean for chronic stroke patients. METHODS: Fifty-two patients with post-stroke participated in this study. Inter-rater reliability was analyzed by Intraclass Correlation Coefficient ($ICC_{3,1}$) and Kappa coefficient, and absolute reliability was analyzed by the Standard Error of Measurement (SEM), and the Minimal Detectable Change (MDC). Concurrent validity was analyzed by correlating between the Tinetti-gait scale and physical functions. The physical functions were measured by using the Dynamic Gait Index(DGI), 10m walking test(10WT), One Leg Standing Test of affected/non-affected side(OLST), Sit to Stand test(STS), (Fugl Meyer assessment of Lower Extremity(FM-LE). RESULTS: The inter-rater reliability of the Tinetti-gait scale was high; $ICC_{(3,1)}=.91$ (95% CI=.85~.95) (very reliable), the range of Kappa coefficient were .73~.92 (substantial~good). The inter-rater agreement of the each item in Tinetti-gait scale ranged from .74 to .92 (95 % CI=.59~.95) (reliable~very reliable). The SEM and MDC were .56 and 1.55, respectively. In the results of concurrent validity, there were moderate positive correlation between Tinetti-gait scale and DGI (r=.78), 10WT (r=.74), OLST (r=.65~.73), FM-LE (r=67). And there was moderate negative correlation between Tinetti-gait scale and STS (r=-79) (p<.01). CONCLUSION: The Tinetti-gait scale(Korean version) was a reliable and valid tool to measure gait ability in patients with chronic stroke. Thus, it could be a useful tool for examining a gait ability of post-stroke patients. Further study should be conducted to investigate the usability to predict fall risk of post-stroke patients of the Tinetti-gait scale.

Measurement of Fractional Exhaled Nitric Oxide in Adults: Comparison of Two Different Analyzers (NIOX VERO and NObreath)

  • Kang, Sung-Yoon;Lee, Sang Min;Lee, Sang Pyo
    • Tuberculosis and Respiratory Diseases
    • /
    • v.84 no.3
    • /
    • pp.182-187
    • /
    • 2021
  • Background: Fractional exhaled nitric oxide (FeNO) is a non-invasive marker for eosinophilic airway inflammation and a good predictor of response to corticosteroids. There is a need for a reliable and accurate measurement method, as FeNO measurements have been widely used in clinical practice. Our study aimed to compare two FeNO analyzers and derive a conversion equation for FeNO measurements in adults. Methods: We included 99 participants who had chief complaints of chronic cough and difficulty in breathing. The participants underwent concurrent FeNO measurement using NIOX VERO (Circassia AB) and NObreath (Bedfont). We compared the values of the two devices and analyzed their correlation and agreement. We then formulated an equation to convert FeNO values measured by NObreath into those obtained by NIOX VERO. Results: The mean age of the participants was 51.2±17.1 years, with a female predominance (58.6%). Approximately 60% of the participants had asthma. The FeNO level measured by NIOX VERO (median, 27; interquartile range [IQR], 15-45) was significantly lower than that measured by NObreath (median, 38; IQR, 22-58; p<0.001). There was a strong positive correlation between the two devices (r=0.779, p<0.001). Additionally, Bland-Altman plots and intraclass correlation coefficient demonstrated a good agreement. Using linear regression, we derived the following conversion equation: natural log (Ln) (NObreath)=0.728×Ln (NIOX VERO)+1.244. Conclusion: The FeNO values of NIOX VERO and NObreath were in good agreement and had positive correlations. Our proposed conversion equation could help assess the accuracy of the two analyzers.

Reliability and Validity of an Electronic Inspiratory Loading Device for Assessing Pulmonary Function in Patients with COPD

  • Lee, Seugcheol;You, Seongkwang;Yang, Subin;Park, Daesung
    • Physical Therapy Rehabilitation Science
    • /
    • v.10 no.1
    • /
    • pp.40-47
    • /
    • 2021
  • Objective: The purpose of this study is to prove the reliability and validity of the Power breath K5 and to compare it with pony FX. Power breathe K5 is one type of device can assess automatically Maximum inspiratory pressure (MIP), Peak inspiratory pressure, Peak inspiratory flow (PIF). Design: Cross-sectional study. Methods: Thirty-five COPD patients participated in the test to investigate for the intra relater reliability and concurrent validity. The tests MIP, Vital capacity (VC), PIF were measured by Powerbreathe K5 and Pony Fx. Data was analyzed by intraclass correlation reliability (ICC) value and a standard error of measurement and Bland-Altman plots for reliability and pearson correlation for validity. Results: Intra rater reliability of the Powerbreathe K5 was very high at MIP (ICC=0.977 95%CI 0.956~0.989, SEM=8.665, MDC=0.295), PIF (ICC=0.966 95%CI 0.933~0.93, SEM=8.665, MDC=0.295), VC (ICC=0.949 95CI 0.902~0.974, SEM=0.042, MDC=0.116). The Powerbreath K5 was significant correlation compared with Pony Fx in assessment for MIP (r=0.971, p<0.05) and vital capacity (r=0.534, p<0.05). Conclusion: In this study, We investigated the clinical usefulness of the Powerbreath K5 in evaulating the MIP, VC and PIF with COPD patients with high reliability and validity.

Concurrent Validity and Test-retest Reliability of the Core Stability Test Using Ultrasound Imaging and Electromyography Measurements

  • Yoo, Seungju;Lee, Nam-Gi;Park, Chanhee;You, Joshua (Sung) Hyun
    • Physical Therapy Korea
    • /
    • v.28 no.3
    • /
    • pp.186-193
    • /
    • 2021
  • Background: While the formal test has been used to provide a quantitative measurement of core stability, studies have reported inconsistent results regarding its test-retest and intraobserver reliabilities. Furthermore, the validity of the formal test has never been established. Objects: This study aimed to establish the concurrent validity and test-retest reliability of the formal test. Methods: Twenty-two young adults with and without core instability (23.1 ± 2.0 years) were recruited. Concurrent validity was determined by comparing the muscle thickness changes of the external oblique, internal oblique, and transverse abdominal muscle to changes in core stability pressure during the formal test using ultrasound (US) imaging and pressure biofeedback, respectively. For the test-retest reliability, muscle thickness and pressure changes were repeatedly measured approximately 24 hours apart. Electromyography (EMG) was used to monitor trunk muscle activity during the formal test. Results: The Pearson's correlation analysis showed an excellent correlation between transverse abdominal thickness and pressure biofeedback unit (PBU) pressure as well as internal oblique thickness and PBU pressure, ranging from r = 0.856-0.980, p < 0.05. The test-retest reliability was good, intraclass correlation coefficient (ICC1,2) = 0.876 for the core stability pressure measure and ICC1,2 = 0.939 to 0.989 for the abdominal muscle thickness measure. Conclusion: Our results provide clinical evidence that the formal test is valid and reliable, when concurrently incorporated into EMG and US measurements.

The Reliability and Validity of the Digital Goniometer and Smart Phone to Determine Trunk Active Range of Motion in Stroke Patients

  • Park, Hee-yong;Hwang, Ui-jae;Kwon, Oh-yun
    • Physical Therapy Korea
    • /
    • v.29 no.3
    • /
    • pp.225-234
    • /
    • 2022
  • Background: Trunk movements are an important factor in activities of daily living; however, these movements can be impaired by stroke. It is difficult to quantify and measure the active range of motion (AROM) of the trunk in patients with stroke. Objects: To determine the reliability and validity of measurements using a digital goniometer (DG) and smart phone (SP) applications for trunk rotation and lateral flexion in stroke patients. Methods: This is an observational study, in which twenty participants were clinically diagnosed with stroke. Trunk rotation and lateral flexion AROM were assessed using the DG and SP applications (Compass and Clinometer). Intrarater reliability was determined using intraclass correlation coefficients (ICCs) with 95% confidence intervals. Pearson correlation coefficient was used to determine the validity of the DG and SP in AROM measurement. The level of agreement between the two instruments was shown by Bland-Altman plot and 95% limit of agreement (LoA) was calculated. Results: The intrarater reliability (rotation with DG: 0.96-0.98, SP: 0.98; lateral flexion with DG: 0.97-0.98, SP: 0.96) was excellent. A strong and significant correlation was found between DG and SP (rotation hemiplegic side: r = 0.95; non-hemiplegic side: r = 0.90; lateral flexion hemiplegic side: r = 0.88; non-hemiplegic side: r = 0.78). The level of agreement between the two instruments was rotation (hemiplegic side: 23.02° [LoA 17.41°, -5.61°]; non-hemiplegic side: 31.68° [LoA 23.87°, -7.81°]) and lateral flexion (hemiplegic side: 20.94° [LoA 17.48°, -3.46°]; non-hemiplegic side: 27.12° [LoA 18.44°, -8.68°]). Conclusion: Both DG and SP applications can be used as reliable methods for measuring trunk rotation and lateral flexion in patients with stroke. Although, considering the level of clinical agreement, DG and SP could not be used interchangeably for measurements.

The Reliability and Validity of the Korean Version of the 5C Psychological Antecedents of Vaccination Scale (한국어판 예방접종에 대한 심리적 소인 측정도구의 신뢰도와 타당도 검증)

  • Bae, SuYeon;Kim, HeeJu
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.3
    • /
    • pp.324-339
    • /
    • 2023
  • Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

Verification of the Reliability and Validity of a Virtual Reality Cognitive Evaluation System Based on Motion Recognition Analysis Evaluation

  • Jeonghan Kwon;Subeen Kim;Jongduk Choi
    • Physical Therapy Korea
    • /
    • v.30 no.4
    • /
    • pp.306-313
    • /
    • 2023
  • Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

A Study on the Estimation of Calcaneal Width Using a Correlation of Calcaneal Length and Width (종골 길이와 너비의 상관관계를 이용한 종골 너비 추정에 관한 연구)

  • Chun, Dong-il;Hwang, Shu Chiang;Cho, Jae-ho;Choi, Sung-Woo;Kim, Yong Beom;Won, Sung Hun
    • Journal of Korean Foot and Ankle Society
    • /
    • v.21 no.2
    • /
    • pp.61-65
    • /
    • 2017
  • Purpose: The purpose of this study was to determine the correlation and ratio between the calcaneal length and width for predicting the width of calcaneus. Materials and Methods: A total of 190 feet (190 patients) were included based on computed tomography scans. The length of calcaneus (CL) was measured on the line connecting the center of a circle tangent to the cortical margin in the anterior and posterior parts of the calcaneus in a sagittal plane (W1, W2). The width of the calcaneus was defined as the horizontal line of each part (W1, W2, W3) on the same axial plane. The relationship between the measurement was determined through a correlation analysis. The reliability was assessed based on intraclass correlation coefficients. Results: The CL and widths of calcaneus (W1, W2, W3) had a good positive correlation (r=0.848 [W1/CL], r=0.738 [W2/CL], r=0.769 [W3/CL]; p<0.001). The mean CL and widths ratios were 0.33 (W1/CL), 0.37 (W2/CL), and 0.37 (W3/CL). Using these ratios to estimate the widths by multiplying each ratio by the measured calcaneal length, we found a difference between the estimated calcaneal widths and the actual measured calcaneal widths values was 0.25 mm, 0.43 mm, and 0.16 mm. All measurements showed good-to-excellent inter- and intraobserver reliability. Conclusion: This study analyzed the correlation and ratio between the length and width of the calcaneus. The results will help orthopedic surgeons fixate screws in a stable manner to prevent iatrogenic injuries to the medial neurovascular structures of the calcaneus.

The Effect of Gd-EOB-DPTA on the Stiffness Value of Magnetic Resonance Elastography in Evaluating Hepatic Fibrosis (간 섬유화 평가를 위한 MR elastography의 경직도에 대한 Gd-EOB-DTPA의 영향)

  • Lee, Jeong Eun;Lee, Jeong Min;Lee, Ye Ji;Yoon, Jeong-Hee;Lee, Kyung Bun;Han, Joon Koo;Choi, Byung Ihn
    • Investigative Magnetic Resonance Imaging
    • /
    • v.17 no.3
    • /
    • pp.215-223
    • /
    • 2013
  • Purpose : To evaluate the effect of gadoxetic acid on the measurement of the stiffness value of MR elastography (MRE) used to evaluate hepatic fibrosis (HF). Materials and Methods: MRE was obtained in 32 patients with clinically suspected chronic liver disease, both before and after injection of gadoxetic acid. Two independent reviewers measured the stiffness values of the liver parenchyma on elastograms. The mean liver stiffness values were compared in the pre- and post-contrast MREs using the paired t-test. Intra-rater and inter-rater correlation was assessed using the intraclass correlation coefficient (ICC). The accuracy, sensitivity, and specificity of both pre- and post-contrast MREs was evaluated for the diagnosis of significant HF (${\geq}F2$) using cut off value of 3.1 kPa. Results: There were no significant differences in the stiffness values of the liver parenchyma on pre- and post-contrast MREs (p = 0.15 and 0.38 for each reader, respectively). Regarding intra-rater correlation, excellent agreement was noted on rater 1(ICC = 0.998) and rater 2 (ICC = 0.996). Excellent correlation regarding the measured stiffness values was noted on both pre- and post-contrast MREs (ICC = 0.988 for pre-contrast, ICC = 0.993 for post-contrast). The accuracy, sensitivity, and specificity of the pre- and post-contrast MREs for differentiating significant HF (${\geq}F2$) from ${\geq}F1$ were same as 71%, 60%, and 100%, respectively. Conclusion: As there was no significant difference in the stiffness measurements seen on MREs before and after administration of gadoxetic acids, it is therefore acceptable to perform MRE after contrast injection in order to evaluate HF.

Comparison of Standardized Patient and Faculty Agreement in Evaluating Nursing Students' Assessment and Communication Skills (시뮬레이션기반 실습 시 간호학생의 간호사정 및 의사소통 기술에 대한 표준화 환자와 교수자 간의 평가 일치도)

  • Kim, Young Ju
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.24 no.3
    • /
    • pp.189-199
    • /
    • 2017
  • Purpose: This study was conducted to examine the level of agreement between a standardized patient (SP) and a faculty member in the evaluation of nursing students' assessment and communication skills. Methods: Participants were 51 third year nursing students in a simulation practice of 'nursing care for a patient admitted with chest pain'. Using a 30-item checklist and a 16-item communication tool, a SP and faculty member evaluated the students' assessment and communication skills during the simulation. Results: The average values for percent agreement and kappa statistic for nursing assessment between the two evaluators were 85.3% and .48 respectively. Twenty of thirty items evaluating assessment skill had above moderate agreement (${\geq}.41$) by kappa between the evaluators. Seven of sixteen items evaluating communication and interpersonal skills showed above fair agreement (${\geq}.40$) between the two evaluators, which was measured by intraclass correlation coefficient. Conclusion: The findings show that the evaluation of the SP was consistent with those of the faculty member to a moderate degree. Clear guidelines for evaluating criteria and optimal time and effort for SP training are necessary to increase the reliability of standardized patients as evaluators in simulation-based nursing education.