• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 222, Processing Time 0.03 seconds

Reliability and validity of free software for the analysis of locomotor activity in mice

  • Hong, Yoo Rha;Moon, Eunsoo
    • Journal of Yeungnam Medical Science
    • /
    • v.35 no.1
    • /
    • pp.63-69
    • /
    • 2018
  • Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

The Reliability and Validity of Korean Version of the Wheelchair User's Shoulder Pain Index in Wheelchair Users (휠체어 사용자를 위한 한국어판 WUSPI의 신뢰도와 타당도)

  • Park, Ji-Yeon;Cho, Sang-Hyun
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.8 no.4
    • /
    • pp.573-582
    • /
    • 2013
  • PURPOSE: The purpose of this study was to establish the reliability and validity of the Wheelchair User's Shoulder Pain Index (WUSPI), which was translated into Korean for long-term wheelchair users. This index measured 15 functional activities, including transfer, self-care, wheelchair mobility and general activities. METHODS: To assess test-retest reliability, 23 long-term wheelchair users completed this self-administered index twice within the same day. Reliability was determined by the intraclass correlation coefficient (ICC), and Cronbach's alpha was used to measure internal consistency. To examine concurrent validity, 21 long-term wheelchair users completed the questionnaire, and we examined the correlation between the index score and the shoulder range of motion measurements. RESULT: The results showed that the intraclass correlation for test-retest reliability of the total index score ranging from .88 to .99 was good to excellent. Additionally, Cronbach's alpha was .96. The internal consistency indicated excellent. Concurrent validity showed negative correlations of total index score to range of motion measurements of shoulder flexion (rho=-.58), extension (rho=-.09), abduction (rho=-.59), external rotation (rho=-.07) and internal rotation (rho=-.3), suggesting a relationship of total index score to loss of shoulder range of motion. CONCLUSION: The Korean WUSPI shows not only high reliability and internal consistency, but also concurrent validity with loss of shoulder flexion and abduction.

Reliability and Validity Analysis of the Instrument of Oriental Medical Evaluation for Hwa-Byung (화병 한의 평가도구의 신뢰도, 타당도 평가)

  • Lee, Hun-Soo;Choi, Woo-Chang;Yu, Yun-Seon;Kang, Wee-Chang;Jung, In-Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.25 no.4
    • /
    • pp.351-358
    • /
    • 2014
  • Objectives: This study was performed to evaluate the reliability and validity of the instrument of oriental medical evaluation for Hwa-byung. Methods: 97 participants diagnosed with Hwa-byung divided into 5 pattern identifications by the instrument on pattern identifications for Hwa-byung were tested by the instrument of oriental medical evaluation for Hwa-byung twice a week. Results: The intraclass correlation coefficient of the test-retest analysis of oriental medical evaluation for Hwa-byung had over moderate agreement. The intraclass correlation coefficient of test-retest analysis of evaluation index of symptoms had moderate agreement for the total symptoms, and fair agreement for the physical and mental symptoms. The validity analysis of the instrument represented a positive correlation in the pattern identification of stagnation of liver Gi, malfunction of gallbladder due to phlegm stagnation, and disharmony between heart and kidneys. Conclusions: The results showed that the reliability analysis of the instrument of oriental medical evaluation for Hwa-byung showed over moderate agreement, and validity analysis represented a positive correlation except for the pattern identification of flare-up of liver fire and deficiency of both Gi and blood.

Reliability and validity of the patellofemoral disability index as a measure of functional performance and subjective pain in subjects with patellofemoral pain syndrome

  • Alshaharani, Mastour Saeed;Lohman, Everett Bernell;Bahjri, Khaled;Harp, Travis;Alameri, Mansoor;Daher, Noha S.
    • Physical Therapy Rehabilitation Science
    • /
    • v.7 no.2
    • /
    • pp.61-66
    • /
    • 2018
  • Objective: Patellofemoral pain syndrome (PFPS) is a condition that is characterized by patellar discomfort or pain that is aggravated during certain activities such as ascending/descending stairs. The Patellofemoral Disability Index (PDI) was developed to assess the effect of pain on functional activities in individuals with PFPS. The objectives of the current study were to determine the internal consistency, test-retest reliability, and validity of this index. Design: Cross-sectional study. Methods: Forty-one subjects who had PFPS with a mean age of $28.8{\pm}5.0years$ and a mean body mass index of $25.6{\pm}4.7kg/m^2$ participated in the study. All subjects were concurrently enrolled in a clinical trial for which they were instructed to complete hamstring-resistance exercises for 4 weeks. Over the course of the intervention, they completed both the PDI and the Oswestry Disability Index (ODI) at baseline after two weeks, and after four weeks. Pearson correlation coefficient was used to assess the criterion validity. Cronbach's ${\alpha}$ was used to examine the internal consistency. Intraclass correlation coefficients with 95% confidence interval were computed to examine test-retest reliability. Results: Subjects' responses within both the PDI and the ODI yielded Pearson correlation coefficient values that were positive and highly significant (range, 0.73-0.97; p<0.001). There was a high level of internal consistency (Cronbach's ${\alpha}{\geq}0.8$), with the exception of stair climbing (Cronbach's ${\alpha}=0.65$). Intraclass correlation ranged from 0.87 to 0.92, indicating high levels of test-retest reliability. Conclusions: The PDI is a valid, reliable, and feasible method of assessing pain and functional ability in patients with PFPS.

A Reliability Study of the Test of Playfulness in Attention Deficit Hyperactivity Disorder (ADHD) (주의력결핍 과잉행동장애 아동의 Test of Playfulness 신뢰도 연구)

  • Lee, Na-hael;Kim, Kyeong-Mi
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.14 no.1
    • /
    • pp.1-8
    • /
    • 2016
  • Objective : The purpose of this study was to determine the reliability of Test of Playfulness (ToP) in Attention Deficit Hyperactivity Disorder (ADHD) children. Methods : Twenty ADHD children participated in this study. To determine inter-rater reliability, two raters was evaluated by Test of Playfulness scores and analyzed Kappa coefficient and total agreement and intraclass correlation coefficient (ICC). Results : Total agreement was the range of 75%~95% and the Kappa coefficients was the range of. 45~1.00. Analyzing inter-rater reliability by ICC showed very high reliability: Intrinsic motivation was .96, internal control was .98, suspension of reality was .90, framing was .98, total score was .99. Conclusion : A reliability of Test of Playflness of children with ADHD showed that high. On the basis of this study, it will provide availability for clinical evaluation of children with ADHD, and basic study on the play of children with ADHD.

A Comparison of Sample Size Requirements for Intraclass Correlation Coefficient(ICC) (신뢰도 연구에서 급내상관계수와 관련한 표본수 결정 방법 비교)

  • Han, Soo-Yeon;Nam, Jung-Mo;Myoung, Sung-Min;Song, Ki-Jun
    • The Korean Journal of Applied Statistics
    • /
    • v.23 no.3
    • /
    • pp.497-510
    • /
    • 2010
  • In medical practice and research, the problem of assessing reliability between two or more quantitative measures is quite common. Intraclass correlation coefficient(ICC) is commonly used to scale of reliability. Some methods were developed to calculate the required number of subjects, raters or replicates in one-way or two-way random ANOVA models. This paper, studies and compares the performance of four methods such as Walter et al. (1998), Giraudeau and Mary (2001), Saito et al. (2006) and Bonett (2002). In order to compare the efficiency of methods we compare the number of subjects, replicates and the width of confidence interval of ICC needed for some specific ICC values. In the case of subject size, Giraudeau's method is the best. In case of the number of replicates, Saito's method was superior to others. The width of confidence interval of ICC was narrower for Giraudeau's method than any others.

The Reliability and Validity of Hip Range of Motion Measurement using a Smart phone Operative Patient (엉덩관절 수술 환자에서 스마트폰을 이용한 관절가동범위 측정의 신뢰도 및 타당도 연구)

  • Park, Sun-Wook;Kim, Myoung-Soo;Bae, Hyo-Sun;Cha, Yong-Ho
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.10 no.2
    • /
    • pp.1-7
    • /
    • 2015
  • PURPOSE: The aims of this study were to assess the intra-tester and inter-tester reliability and validity of hip range of motion using a smart phone in hip operative patients. METHODS: Twenty-five patients (eight total hip arthroplasty and seventeen femur neck fracture) participated in this study. The range of motions in active and passive hip flexion, abduction and external rotation were measured with a goniometer and smart phone over two times by two observers. The intra-tester and inter-tester reliability were evaluated using the intraclass correlation coefficient (ICC2,1). The validity was measured by Pearson's correlation coefficient RESULTS: The intra-observer reliability was good in all measured items (ICC>0.78). The inter-observer reliability was high with ICC (>0.90). All correlation coefficients of smart phone and goniometer was greater than 0.85 and showed a significant positive correlation (p<0.01). CONCLUSION: The range of motion measurement with a smart phone showed acceptable reliability. Therefore, it could be convenient and have economical benefits to measure the range of motion of the hip joint using a smart phone.

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT)

  • Sun, Yi;Arning, Martin;Bochmann, Frank;Borger, Jutta;Heitmann, Thomas
    • Safety and Health at Work
    • /
    • v.9 no.2
    • /
    • pp.140-143
    • /
    • 2018
  • Background: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. Methods: The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Results: Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. Conclusion: These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

The accuracy of linear measurements of maxillary and mandibular edentulous sites in conebeam computed tomography images with different fields of view and voxel sizes under simulated clinical conditions

  • Ganguly, Rumpa;Ramesh, Aruna;Pagni, Sarah
    • Imaging Science in Dentistry
    • /
    • v.46 no.2
    • /
    • pp.93-101
    • /
    • 2016
  • Purpose: The objective of this study was to investigate the effect of varying resolutions of cone-beam computed tomography images on the accuracy of linear measurements of edentulous areas in human cadaver heads. Intact cadaver heads were used to simulate a clinical situation. Materials and Methods: Fiduciary markers were placed in the edentulous areas of 4 intact embalmed cadaver heads. The heads were scanned with two different CBCT units using a large field of view ($13cm{\times}16cm$) and small field of view ($5cm{\times}8cm$) at varying voxel sizes (0.3 mm, 0.2 mm, and 0.16 mm). The ground truth was established with digital caliper measurements. The imaging measurements were then compared with caliper measurements to determine accuracy. Results: The Wilcoxon signed rank test revealed no statistically significant difference between the medians of the physical measurements obtained with calipers and the medians of the CBCT measurements. A comparison of accuracy among the different imaging protocols revealed no significant differences as determined by the Friedman test. The intraclass correlation coefficient was 0.961, indicating excellent reproducibility. Inter-observer variability was determined graphically with a Bland-Altman plot and by calculating the intraclass correlation coefficient. The Bland-Altman plot indicated very good reproducibility for smaller measurements but larger discrepancies with larger measurements. Conclusion: The CBCT-based linear measurements in the edentulous sites using different voxel sizes and FOVs are accurate compared with the direct caliper measurements of these sites. Higher resolution CBCT images with smaller voxel size did not result in greater accuracy of the linear measurements.

Development of Korean Version of Acute Concussion Evaluation using Cross-cultural Translation Methodology: Pilot Study (Acute Concussion Evaluation의 한국어 번역 및 문화적 개작: 예비 연구)

  • Kim, Bo-min;Jo, Hee-geun;Koo, Ji-eun;Park, Ji-won;Han, Hyeon-ju;Seo, Ji-hye;Im, Hyeok-bin;Kim, Eun-mi;Jeong, Jun-su;Yoon, Ja-yeong
    • Journal of Korean Medicine Rehabilitation
    • /
    • v.29 no.4
    • /
    • pp.73-79
    • /
    • 2019
  • Objectives The purpose of this study is to provide Korean version of mild traumatic brain injury assessment tool. Methods The original version of acute concussion evaluation (ACE) was translated into Korean, and it was then back-translated into English without any prior knowledge of ACE. Finally, the pre-final version of Korean version of acute concussion evaluation (K-ACE) was derived. 49 Korean patients who had been diagnosed with mild traumatic brain injury participated in the study and completed K-ACE. Overall, 44 data were used to analyze findings. Validity of the study was assessed based on Concurrent validity. Reliability was also evaluated using Cronbach's ${\alpha}$ and the intraclass correlation coefficient. Results The Cronbach's ${\alpha}$ value for each item presented a proper level of internal consistency with results of 0.711 to 0.893 in two evaluations, respectively. The intraclass correlation coefficient of the retest reliability was marked as 0.892 (95% CI 0.840~0.933). Concurrent validity demonstrated positive correlations between K-ACE and Korean version of postconcussional syndrome questionnaire. Conclusions The K-ACE is concluded as a valid and reliable tool for measuring mild traumatic brain injury and post-concussion symptoms. Upon completion of the follow-up study, the K-ACE will be well-utilized by both clinicians and researchers.