• 제목/요약/키워드: Intraclass Correlation Coefficient

검색결과 221건 처리시간 0.03초

Reliability and validity of free software for the analysis of locomotor activity in mice

  • Hong, Yoo Rha;Moon, Eunsoo
    • Journal of Yeungnam Medical Science
    • /
    • 제35권1호
    • /
    • pp.63-69
    • /
    • 2018
  • Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

휠체어 사용자를 위한 한국어판 WUSPI의 신뢰도와 타당도 (The Reliability and Validity of Korean Version of the Wheelchair User's Shoulder Pain Index in Wheelchair Users)

  • 박지연;조상현
    • 대한물리의학회지
    • /
    • 제8권4호
    • /
    • pp.573-582
    • /
    • 2013
  • PURPOSE: The purpose of this study was to establish the reliability and validity of the Wheelchair User's Shoulder Pain Index (WUSPI), which was translated into Korean for long-term wheelchair users. This index measured 15 functional activities, including transfer, self-care, wheelchair mobility and general activities. METHODS: To assess test-retest reliability, 23 long-term wheelchair users completed this self-administered index twice within the same day. Reliability was determined by the intraclass correlation coefficient (ICC), and Cronbach's alpha was used to measure internal consistency. To examine concurrent validity, 21 long-term wheelchair users completed the questionnaire, and we examined the correlation between the index score and the shoulder range of motion measurements. RESULT: The results showed that the intraclass correlation for test-retest reliability of the total index score ranging from .88 to .99 was good to excellent. Additionally, Cronbach's alpha was .96. The internal consistency indicated excellent. Concurrent validity showed negative correlations of total index score to range of motion measurements of shoulder flexion (rho=-.58), extension (rho=-.09), abduction (rho=-.59), external rotation (rho=-.07) and internal rotation (rho=-.3), suggesting a relationship of total index score to loss of shoulder range of motion. CONCLUSION: The Korean WUSPI shows not only high reliability and internal consistency, but also concurrent validity with loss of shoulder flexion and abduction.

화병 한의 평가도구의 신뢰도, 타당도 평가 (Reliability and Validity Analysis of the Instrument of Oriental Medical Evaluation for Hwa-Byung)

  • 이헌수;최우창;유윤선;강위창;정인철
    • 동의신경정신과학회지
    • /
    • 제25권4호
    • /
    • pp.351-358
    • /
    • 2014
  • Objectives: This study was performed to evaluate the reliability and validity of the instrument of oriental medical evaluation for Hwa-byung. Methods: 97 participants diagnosed with Hwa-byung divided into 5 pattern identifications by the instrument on pattern identifications for Hwa-byung were tested by the instrument of oriental medical evaluation for Hwa-byung twice a week. Results: The intraclass correlation coefficient of the test-retest analysis of oriental medical evaluation for Hwa-byung had over moderate agreement. The intraclass correlation coefficient of test-retest analysis of evaluation index of symptoms had moderate agreement for the total symptoms, and fair agreement for the physical and mental symptoms. The validity analysis of the instrument represented a positive correlation in the pattern identification of stagnation of liver Gi, malfunction of gallbladder due to phlegm stagnation, and disharmony between heart and kidneys. Conclusions: The results showed that the reliability analysis of the instrument of oriental medical evaluation for Hwa-byung showed over moderate agreement, and validity analysis represented a positive correlation except for the pattern identification of flare-up of liver fire and deficiency of both Gi and blood.

Reliability and validity of the patellofemoral disability index as a measure of functional performance and subjective pain in subjects with patellofemoral pain syndrome

  • Alshaharani, Mastour Saeed;Lohman, Everett Bernell;Bahjri, Khaled;Harp, Travis;Alameri, Mansoor;Daher, Noha S.
    • Physical Therapy Rehabilitation Science
    • /
    • 제7권2호
    • /
    • pp.61-66
    • /
    • 2018
  • Objective: Patellofemoral pain syndrome (PFPS) is a condition that is characterized by patellar discomfort or pain that is aggravated during certain activities such as ascending/descending stairs. The Patellofemoral Disability Index (PDI) was developed to assess the effect of pain on functional activities in individuals with PFPS. The objectives of the current study were to determine the internal consistency, test-retest reliability, and validity of this index. Design: Cross-sectional study. Methods: Forty-one subjects who had PFPS with a mean age of $28.8{\pm}5.0years$ and a mean body mass index of $25.6{\pm}4.7kg/m^2$ participated in the study. All subjects were concurrently enrolled in a clinical trial for which they were instructed to complete hamstring-resistance exercises for 4 weeks. Over the course of the intervention, they completed both the PDI and the Oswestry Disability Index (ODI) at baseline after two weeks, and after four weeks. Pearson correlation coefficient was used to assess the criterion validity. Cronbach's ${\alpha}$ was used to examine the internal consistency. Intraclass correlation coefficients with 95% confidence interval were computed to examine test-retest reliability. Results: Subjects' responses within both the PDI and the ODI yielded Pearson correlation coefficient values that were positive and highly significant (range, 0.73-0.97; p<0.001). There was a high level of internal consistency (Cronbach's ${\alpha}{\geq}0.8$), with the exception of stair climbing (Cronbach's ${\alpha}=0.65$). Intraclass correlation ranged from 0.87 to 0.92, indicating high levels of test-retest reliability. Conclusions: The PDI is a valid, reliable, and feasible method of assessing pain and functional ability in patients with PFPS.

주의력결핍 과잉행동장애 아동의 Test of Playfulness 신뢰도 연구 (A Reliability Study of the Test of Playfulness in Attention Deficit Hyperactivity Disorder (ADHD))

  • 이나핼;김경미
    • 대한감각통합치료학회지
    • /
    • 제14권1호
    • /
    • pp.1-8
    • /
    • 2016
  • 목적 : 본 연구의 목적은 주의력결핍 과잉행동장애 아동을 대상으로 놀이의 질적수준을 평가하는 놀이다움 평정척도(Test of Playfulness: ToP)의 신뢰도를 알아보고자 한다. 연구방법 : 연구대상은 G시에 거주하는 초등학교 2학년~3학년의 주의력결핍 과잉행동장애 아동 20명이다. 놀이다움 평정척도의 신뢰도를 알아보기 위하여 측정자간 일치율과 Kappa계수로 제시하였고, 측정자간 신뢰도 분석은 급간내 상관계수(Intraclass Correlation Coefficient: ICC)를 사용하여 제시하였다. 결과 : 놀이다움 평정척도의 각 항목간 측정자간 일치율은 75~95%이었다. 각 항목의 Kappa계수의 범위는 .45~1.00이었다. 각 요소에 대한 측정자간 신뢰도를 급간내 상관계수로 분석한 결과 내적동기는 .96, 통제지각은 .98, 현실감 부재는 .90, 참조체계는 .98, 총점은 .99로 매우 높은 신뢰도를 보였다. 결론 : 연구결과를 통하여 주의력결핍 과잉행동장애 아동의 놀이다움 평정척도의 측정자간 신뢰도는 높은 것으로 나타났다. 이를 근거로 하여 주의력결핍 과잉행동장애 아동의 임상적인 평가의 유용성을 제공하고, 주의력결핍 과잉행동장애 아동의 놀이연구에 대한 기초자료를 제공하고자 한다.

신뢰도 연구에서 급내상관계수와 관련한 표본수 결정 방법 비교 (A Comparison of Sample Size Requirements for Intraclass Correlation Coefficient(ICC))

  • 한수연;남정모;명성민;송기준
    • 응용통계연구
    • /
    • 제23권3호
    • /
    • pp.497-510
    • /
    • 2010
  • 신뢰도 연구는 한 명의 평가자가 연구 대상을 반복 측정하거나 여러 명의 평가자가 한 대상을 평가할 때 평가자 내, 평가자 간 일치도를 알아보는 연구로 임상 의학 분야에서 빈번하게 쓰이고 있다. 이 같은 신뢰도 연구에서 적절한 표본수, 평가자수 및 반복수를 결정하는 것은 비용과 시간 측면에서 보다 더 효율적인 연구를 할 수 있게 해주는 중요한 요인이다. 본 연구의 목적은 신뢰도 연구에서 측정치가 정량적일 때 쓰이는 신뢰도 계수인 급내상관계수(ICC)와 관련한 기존의 표본수 산출 방법들을 비교분석하여 적절한 표본수나 반복수를 결정할 때 그 지침을 제공하는데 있다. 기존 논문에서 제시한 Walter 등 (1998), Giraudeau와 Mary (2001), Saito 등 (2006) 그리고 Bonett (2002)의 방법들을 비교하였다. 임의효과 일원배치 모형일 때 같은 조건에서 가장 적은 양의 정보를 필요로 하는 방법을 찾는 목적으로 요인을 변화시켜 가면서 표본수, 반복수, 신뢰구간 폭을 비교한다. 비교해 본 결과, 가장 작은 수의 표본을 필요로 하는 방법은 Giraudeau의 방법, 가장 작은 수의 반복을 필요로 하는 방법은 Saito의 방법으로 나타났다. 가장 많은 수의 표본과 반복을 필요로 한 방법은 Bonett의 방법이었다. 정도는 Giraudeau의 방법이 가장 높았고 Walter, Saito, Bonett 순으로 정도가 떨어졌다.

엉덩관절 수술 환자에서 스마트폰을 이용한 관절가동범위 측정의 신뢰도 및 타당도 연구 (The Reliability and Validity of Hip Range of Motion Measurement using a Smart phone Operative Patient)

  • 박선욱;김명수;배효선;차용호
    • 대한물리의학회지
    • /
    • 제10권2호
    • /
    • pp.1-7
    • /
    • 2015
  • PURPOSE: The aims of this study were to assess the intra-tester and inter-tester reliability and validity of hip range of motion using a smart phone in hip operative patients. METHODS: Twenty-five patients (eight total hip arthroplasty and seventeen femur neck fracture) participated in this study. The range of motions in active and passive hip flexion, abduction and external rotation were measured with a goniometer and smart phone over two times by two observers. The intra-tester and inter-tester reliability were evaluated using the intraclass correlation coefficient (ICC2,1). The validity was measured by Pearson's correlation coefficient RESULTS: The intra-observer reliability was good in all measured items (ICC>0.78). The inter-observer reliability was high with ICC (>0.90). All correlation coefficients of smart phone and goniometer was greater than 0.85 and showed a significant positive correlation (p<0.01). CONCLUSION: The range of motion measurement with a smart phone showed acceptable reliability. Therefore, it could be convenient and have economical benefits to measure the range of motion of the hip joint using a smart phone.

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT)

  • Sun, Yi;Arning, Martin;Bochmann, Frank;Borger, Jutta;Heitmann, Thomas
    • Safety and Health at Work
    • /
    • 제9권2호
    • /
    • pp.140-143
    • /
    • 2018
  • Background: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. Methods: The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Results: Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. Conclusion: These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

The accuracy of linear measurements of maxillary and mandibular edentulous sites in conebeam computed tomography images with different fields of view and voxel sizes under simulated clinical conditions

  • Ganguly, Rumpa;Ramesh, Aruna;Pagni, Sarah
    • Imaging Science in Dentistry
    • /
    • 제46권2호
    • /
    • pp.93-101
    • /
    • 2016
  • Purpose: The objective of this study was to investigate the effect of varying resolutions of cone-beam computed tomography images on the accuracy of linear measurements of edentulous areas in human cadaver heads. Intact cadaver heads were used to simulate a clinical situation. Materials and Methods: Fiduciary markers were placed in the edentulous areas of 4 intact embalmed cadaver heads. The heads were scanned with two different CBCT units using a large field of view ($13cm{\times}16cm$) and small field of view ($5cm{\times}8cm$) at varying voxel sizes (0.3 mm, 0.2 mm, and 0.16 mm). The ground truth was established with digital caliper measurements. The imaging measurements were then compared with caliper measurements to determine accuracy. Results: The Wilcoxon signed rank test revealed no statistically significant difference between the medians of the physical measurements obtained with calipers and the medians of the CBCT measurements. A comparison of accuracy among the different imaging protocols revealed no significant differences as determined by the Friedman test. The intraclass correlation coefficient was 0.961, indicating excellent reproducibility. Inter-observer variability was determined graphically with a Bland-Altman plot and by calculating the intraclass correlation coefficient. The Bland-Altman plot indicated very good reproducibility for smaller measurements but larger discrepancies with larger measurements. Conclusion: The CBCT-based linear measurements in the edentulous sites using different voxel sizes and FOVs are accurate compared with the direct caliper measurements of these sites. Higher resolution CBCT images with smaller voxel size did not result in greater accuracy of the linear measurements.

Acute Concussion Evaluation의 한국어 번역 및 문화적 개작: 예비 연구 (Development of Korean Version of Acute Concussion Evaluation using Cross-cultural Translation Methodology: Pilot Study)

  • 김보민;조희근;구지은;박지원;한현주;서지혜;임혁빈;김은미;정준수;윤자영
    • 한방재활의학과학회지
    • /
    • 제29권4호
    • /
    • pp.73-79
    • /
    • 2019
  • Objectives The purpose of this study is to provide Korean version of mild traumatic brain injury assessment tool. Methods The original version of acute concussion evaluation (ACE) was translated into Korean, and it was then back-translated into English without any prior knowledge of ACE. Finally, the pre-final version of Korean version of acute concussion evaluation (K-ACE) was derived. 49 Korean patients who had been diagnosed with mild traumatic brain injury participated in the study and completed K-ACE. Overall, 44 data were used to analyze findings. Validity of the study was assessed based on Concurrent validity. Reliability was also evaluated using Cronbach's ${\alpha}$ and the intraclass correlation coefficient. Results The Cronbach's ${\alpha}$ value for each item presented a proper level of internal consistency with results of 0.711 to 0.893 in two evaluations, respectively. The intraclass correlation coefficient of the retest reliability was marked as 0.892 (95% CI 0.840~0.933). Concurrent validity demonstrated positive correlations between K-ACE and Korean version of postconcussional syndrome questionnaire. Conclusions The K-ACE is concluded as a valid and reliable tool for measuring mild traumatic brain injury and post-concussion symptoms. Upon completion of the follow-up study, the K-ACE will be well-utilized by both clinicians and researchers.