• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 230, Processing Time 0.026 seconds

Concurrent Validity and Test-retest Reliability of the Core Stability Test Using Ultrasound Imaging and Electromyography Measurements

  • Yoo, Seungju;Lee, Nam-Gi;Park, Chanhee;You, Joshua (Sung) Hyun
    • Physical Therapy Korea
    • /
    • v.28 no.3
    • /
    • pp.186-193
    • /
    • 2021
  • Background: While the formal test has been used to provide a quantitative measurement of core stability, studies have reported inconsistent results regarding its test-retest and intraobserver reliabilities. Furthermore, the validity of the formal test has never been established. Objects: This study aimed to establish the concurrent validity and test-retest reliability of the formal test. Methods: Twenty-two young adults with and without core instability (23.1 ± 2.0 years) were recruited. Concurrent validity was determined by comparing the muscle thickness changes of the external oblique, internal oblique, and transverse abdominal muscle to changes in core stability pressure during the formal test using ultrasound (US) imaging and pressure biofeedback, respectively. For the test-retest reliability, muscle thickness and pressure changes were repeatedly measured approximately 24 hours apart. Electromyography (EMG) was used to monitor trunk muscle activity during the formal test. Results: The Pearson's correlation analysis showed an excellent correlation between transverse abdominal thickness and pressure biofeedback unit (PBU) pressure as well as internal oblique thickness and PBU pressure, ranging from r = 0.856-0.980, p < 0.05. The test-retest reliability was good, intraclass correlation coefficient (ICC1,2) = 0.876 for the core stability pressure measure and ICC1,2 = 0.939 to 0.989 for the abdominal muscle thickness measure. Conclusion: Our results provide clinical evidence that the formal test is valid and reliable, when concurrently incorporated into EMG and US measurements.

The Reliability and Validity of the Digital Goniometer and Smart Phone to Determine Trunk Active Range of Motion in Stroke Patients

  • Park, Hee-yong;Hwang, Ui-jae;Kwon, Oh-yun
    • Physical Therapy Korea
    • /
    • v.29 no.3
    • /
    • pp.225-234
    • /
    • 2022
  • Background: Trunk movements are an important factor in activities of daily living; however, these movements can be impaired by stroke. It is difficult to quantify and measure the active range of motion (AROM) of the trunk in patients with stroke. Objects: To determine the reliability and validity of measurements using a digital goniometer (DG) and smart phone (SP) applications for trunk rotation and lateral flexion in stroke patients. Methods: This is an observational study, in which twenty participants were clinically diagnosed with stroke. Trunk rotation and lateral flexion AROM were assessed using the DG and SP applications (Compass and Clinometer). Intrarater reliability was determined using intraclass correlation coefficients (ICCs) with 95% confidence intervals. Pearson correlation coefficient was used to determine the validity of the DG and SP in AROM measurement. The level of agreement between the two instruments was shown by Bland-Altman plot and 95% limit of agreement (LoA) was calculated. Results: The intrarater reliability (rotation with DG: 0.96-0.98, SP: 0.98; lateral flexion with DG: 0.97-0.98, SP: 0.96) was excellent. A strong and significant correlation was found between DG and SP (rotation hemiplegic side: r = 0.95; non-hemiplegic side: r = 0.90; lateral flexion hemiplegic side: r = 0.88; non-hemiplegic side: r = 0.78). The level of agreement between the two instruments was rotation (hemiplegic side: 23.02° [LoA 17.41°, -5.61°]; non-hemiplegic side: 31.68° [LoA 23.87°, -7.81°]) and lateral flexion (hemiplegic side: 20.94° [LoA 17.48°, -3.46°]; non-hemiplegic side: 27.12° [LoA 18.44°, -8.68°]). Conclusion: Both DG and SP applications can be used as reliable methods for measuring trunk rotation and lateral flexion in patients with stroke. Although, considering the level of clinical agreement, DG and SP could not be used interchangeably for measurements.

The Reliability and Validity of the Korean Version of the 5C Psychological Antecedents of Vaccination Scale (한국어판 예방접종에 대한 심리적 소인 측정도구의 신뢰도와 타당도 검증)

  • Bae, SuYeon;Kim, HeeJu
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.3
    • /
    • pp.324-339
    • /
    • 2023
  • Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

Verification of the Reliability and Validity of a Virtual Reality Cognitive Evaluation System Based on Motion Recognition Analysis Evaluation

  • Jeonghan Kwon;Subeen Kim;Jongduk Choi
    • Physical Therapy Korea
    • /
    • v.30 no.4
    • /
    • pp.306-313
    • /
    • 2023
  • Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

Comparison of Standardized Patient and Faculty Agreement in Evaluating Nursing Students' Assessment and Communication Skills (시뮬레이션기반 실습 시 간호학생의 간호사정 및 의사소통 기술에 대한 표준화 환자와 교수자 간의 평가 일치도)

  • Kim, Young Ju
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.24 no.3
    • /
    • pp.189-199
    • /
    • 2017
  • Purpose: This study was conducted to examine the level of agreement between a standardized patient (SP) and a faculty member in the evaluation of nursing students' assessment and communication skills. Methods: Participants were 51 third year nursing students in a simulation practice of 'nursing care for a patient admitted with chest pain'. Using a 30-item checklist and a 16-item communication tool, a SP and faculty member evaluated the students' assessment and communication skills during the simulation. Results: The average values for percent agreement and kappa statistic for nursing assessment between the two evaluators were 85.3% and .48 respectively. Twenty of thirty items evaluating assessment skill had above moderate agreement (${\geq}.41$) by kappa between the evaluators. Seven of sixteen items evaluating communication and interpersonal skills showed above fair agreement (${\geq}.40$) between the two evaluators, which was measured by intraclass correlation coefficient. Conclusion: The findings show that the evaluation of the SP was consistent with those of the faculty member to a moderate degree. Clear guidelines for evaluating criteria and optimal time and effort for SP training are necessary to increase the reliability of standardized patients as evaluators in simulation-based nursing education.

Psychometric Properties of the Alzheimer's Disease Knowledge Scale-Korean Version (한국어판 알츠하이머병 지식 측정도구의 신뢰도와 타당도)

  • Kim, Eun Joo;Jung, Ji-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.45 no.1
    • /
    • pp.107-117
    • /
    • 2015
  • Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

Accuracy of Bolton analysis measured in laser scanned digital models compared with plaster models (gold standard) and cone-beam computer tomography images

  • Kim, Jooseong;Lagravere, Manuel O.
    • The korean journal of orthodontics
    • /
    • v.46 no.1
    • /
    • pp.13-19
    • /
    • 2016
  • Objective: The aim of this study was to compare the accuracy of Bolton analysis obtained from digital models scanned with the Ortho Insight three-dimensional (3D) laser scanner system to those obtained from cone-beam computed tomography (CBCT) images and traditional plaster models. Methods: CBCT scans and plaster models were obtained from 50 patients. Plaster models were scanned using the Ortho Insight 3D laser scanner; Bolton ratios were calculated with its software. CBCT scans were imported and analyzed using AVIZO software. Plaster models were measured with a digital caliper. Data were analyzed with descriptive statistics and the intraclass correlation coefficient (ICC). Results: Anterior and overall Bolton ratios obtained by the three different modalities exhibited excellent agreement (> 0.970). The mean differences between the scanned digital models and physical models and between the CBCT images and scanned digital models for overall Bolton ratios were $0.41{\pm}0.305%$ and $0.45{\pm}0.456%$, respectively; for anterior Bolton ratios, $0.59{\pm}0.520%$ and $1.01{\pm}0.780%$, respectively. ICC results showed that intraexaminer error reliability was generally excellent (> 0.858 for all three diagnostic modalities), with < 1.45% discrepancy in the Bolton analysis. Conclusions: Laser scanned digital models are highly accurate compared to physical models and CBCT scans for assessing the spatial relationships of dental arches for orthodontic diagnosis.

Clinical application of an intraoral scanner for serial evaluation of orthodontic tooth movement: A preliminary study

  • Yun, Dalsun;Choi, Dong-Soon;Jang, Insan;Cha, Bong-Kuen
    • The korean journal of orthodontics
    • /
    • v.48 no.4
    • /
    • pp.262-267
    • /
    • 2018
  • The aim of this study was to test the clinical application of an intraoral scanner for serial evaluation of orthodontic tooth movement. The maxillary dentitions of eight patients with fixed orthodontic appliances were scanned using an intraoral scanner at the beginning of treatment (T0), and at 1 month (T1), 2 months (T2), 3 months (T3), and 4 months (T4) after T0. The serial digital models were superimposed on the palatal surface as a reference area, and the linear and angular changes of the central incisors, canines, and first molars were evaluated. The intraclass correlation coefficient and method errors showed that this method was clinically acceptable. Various types of orthodontic tooth movements, including minute movements, could be observed every month. The intraoral scanner and digital superimposition technique enabled the serial evaluation of orthodontic tooth movement without taking serial impressions and/or acquiring radiographs.

Reproducibility analysis of surface EMG spike variables during isometric voluntary contraction of the biceps brachii muscle (이두박근의 등척성 자의 수축시 표면근전도 신호에서 검출한 스파이크 변수들의 재현성 분석)

  • Lee, Jin
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.6
    • /
    • pp.1246-1254
    • /
    • 2009
  • The reproducibility of initial value and change over time of surface EMG spike variables(MSA, MSF, MSS, MSD) was investigated in the biceps brachii muscle of 11 healthy subjects. Surface EMG signals were recorded during sustained isometric voluntary contractions for 30 seconds at three contraction levels, 20%, 50%, and 80%MVC, respectively. Each contraction was repeated three times in each of three different days for a total of nine contractions and 99 contractions per %MVC level across the eleven subjects. A total of 297 EMG signals across the different trials, days, subjects, and %MVC levels was saved for the subsequent analysis. The degree of reproducibility was investigated using the intraclass correlation coefficient(ICC) and the standard error of the mean(SEM) based upon the analysis of variance(ANOVA), Results for intercept showed higher reproducibility of the spike variables with about 60%-98% ICC than the variable(ARV, MNF) which had been analyzed before in other researches. And results for slope showed poor reproducibility of the spike variables with about 30%-70% ICC and they were comparable with the variables of other researches.

Multilevel Analysis of Health Care Service Utilization among Medical Aid Beneficiaries in Korea

  • Ahn, Yang Heui;Ham, Ok Kyung;Kim, Soo Hyun;Park, Chang Gi
    • Journal of Korean Academy of Nursing
    • /
    • v.42 no.7
    • /
    • pp.928-935
    • /
    • 2012
  • Purpose: The current study was done to identify individual- and group-level factors associated with health care service utilization among Korean medical aid beneficiaries by applying multilevel modeling. Methods: Secondary data analysis was performed using data on health care service reimbursement and medical aid case management progress from 15,948 beneficiaries, and data from 229 regions were included in the analysis. Results: Results of multilevel analysis showed an estimated intraclass correlation coefficient (ICC) of 18.1%, indicating that the group level accounted for 18.1% of the total variance in health care service utilization, and that beneficiaries within the region are more likely to share common features with regard to health care service utilization. At the individual level, existence of disability and types of medical aid beneficiaries showed a significant association, while, at the group level, social deprivation index, and the number of beneficiaries and case managers within the region showed a significant association with health care service utilization. Conclusion: The significant influence of group level variables in health care service utilization found in this study indicate a need for group level approaches, such as policy change and/or promotion of community awareness.