• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 220, Processing Time 0.06 seconds

A study on design effect models for complex sample survey (설계효과모형 적용에 관한 연구)

  • Park, Inho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.3
    • /
    • pp.523-531
    • /
    • 2014
  • Design effect is often used in designing and planning sample surveys and/or in evaluating the efficiency of complex design features of the surveys. In this study, we applied Gabler et al. (2006)'s design effect model to 2013 Consumer behavior survey for food that was carried out by stratified two-stage sampling. Usability and adequacy of the design model to a real survey data are discussed and evaluated.

Develop and Evaluate the Short Form Biomedical Ethics Tool for Medical Workers In Convergence Era (융합 시대의 의료종사자를 위한 단축형 생명의료윤리 도구 개발 및 평가)

  • Je, Nam-Joo;Park, Mee-Ra
    • Journal of Digital Convergence
    • /
    • v.18 no.1
    • /
    • pp.219-229
    • /
    • 2020
  • The purpose of this study was to develop a short biomedical ethics tool for healthcare workers, compare it with pre-existing tool, and increase reliability. Data were collected from 211 healthcare workers working in G-do. Exploratory factor analysis was carried out using Varimax rotation extraction method in IBM SPSS WIN/21.0. Convergent validity of the tool was verified by regression and correlation analysis with original tool score. Reliability was verified by calculating intraclass correlation coefficient and internal consistency coefficient. The short, reduced 21 questions tool reflected 84% of pre-existing tool's biomedical ethics. Its reliability was higher than the 29 question tool for nursing students, but there were differences in the components of subdomains and reliability coefficient. Additional development of questions through qualitative research and interviews are needed to increase reliability of the subdomains. Measurement of biomedical ethics dilemma with the tool that has validity and reliability is needed, followed by replication studies.

Construction of the Mobility to Participation Assessment Scale for Stroke (MPASS) and Testing Its Validity and Reliability in Persons With Stroke in Thailand

  • Nawarat, Jiraphat;Chaipinyo, Kanda
    • Journal of Preventive Medicine and Public Health
    • /
    • v.55 no.4
    • /
    • pp.334-341
    • /
    • 2022
  • Objectives: This study was conducted to develop the Mobility to Participation Assessment Scale for Stroke (MPASS) and assess its content validity, internal consistency, inter-rater and intra-rater reliability, and convergent validity in people with stroke living in the community. Methods: The MPASS was developed using published data on mobility-related activity and participation timing in elderly individuals, and then reviewed by community physical therapists. Content validity was established by reaching a consensus of experienced physical therapists in a focus group. The MPASS was scored for 32 participants with stroke (mean age 61.75±4.92 years) by 3 individual testers. Reliability was examined using the intraclass correlation coefficient (ICC), internal consistency using the Cronbach alpha coefficient (α), and convergent validity using the Pearson correlation coefficient (r) to compare the MPASS to the Modified Rivermead Mobility Index as a referent test of mobility. Results: The MPASS consists of 8 items, and its scoring system provides information on the ability of people with stroke to reach a movement level enabling them to live in society, including interactions with other people and safe living in the community. The interrater and intra-rater reliability were excellent (ICC, 0.948; 95% confidence interval [CI], 0.893 to 0.982 and ICC, 0.967; 95% CI, 0.933 to 0.989, respectively). Internal consistency was good (α=0.877). The convergent validity was moderate (r=0.646; p<0.001). Conclusions: The newly developed MPASS showed acceptable construct validity and high reliability. The MPASS is suitable for use in people with stroke, especially those who have been discharged and live in the community with the ability to initiate sitting.

Sex differences in repeatability of measurement for hamstring strength during maximal voluntary contractions (최대 수의적 수축 동안 뒤넙다리근 근력 반복성의 남녀 차이)

  • Lim, Woo Taek
    • Journal of Korean Physical Therapy Science
    • /
    • v.27 no.1
    • /
    • pp.9-17
    • /
    • 2020
  • Background: This study aimed to examine the repeatability of hamstring strength during maximal voluntary contractions (MVCs) and to examine the sex difference. Design: Quasi-experiment design. Methods: The study recruited 23 healthy young individuals as participants. Hamstring flexibility was measured before and after MVCs by active knee extension test. Five trials of MVCs were performed, and hip extension forces were measured using a strain gauge during MVCs. Repeatability was confirmed by intraclass correlation coefficient (ICC) and coefficient of variation, and the difference between male and female participants was confirmed by independent samples t-test. Results: The forces measured during MVCs were significantly different between men and women over five trials. We observed the minimum and maximum force production at the first and fifth trial of MVCs in both men and women. Excellent to moderate reliability of the hamstring strength during MVCs was found in men (ICC range, 0.70-0.98) and women (ICC range, 0.66-0.90). There was no significant difference in hamstring flexibility between men and women. Conclusion: In clinical settings, we recommend excluding the first trial of MVCs in both men and women. Additionally, performing at least three trials of MVCs would be useful to improve the reliability of the baseline measures in women.

Reliability and Validity Study on the Korean Version of the Fullerton Advanced Balance Scale (한국어판 플러턴 어드밴스드 균형 척도의 신뢰도와 타당도 연구)

  • Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.23 no.1
    • /
    • pp.31-37
    • /
    • 2016
  • Background: The assessment tool developed in other countries should be translated into Korean language using rigorous methodological approaches in order to be used in Korea. Because these procedures are insufficient for establishing the cross-cultural and linguistic equivalence, the need for statistical methods is raised. The Fullerton Advanced Balance Scale was translated into Korean and the content validity was verified through the back translation method, but the reliability and validity have not yet been proven by statistical methods. Objects: The purpose of this study was to investigate the reliability and validity of the Korean version of the Fullerton Advanced Balance Scale (KFAB) by statistical methods in elderly people. Methods: A total of 97 elderly adults (39 males and 58 females) participated in this study. Internal consistency of the KFAB was measured using Cronbach's alpha and an intraclass correlation coefficient (ICC) was used to assess test-retest reliability between the two measurement sessions. Concurrent validity was measured by comparing the KFAB responses with the Korean version of the Berg Balance Scale (KBBS) using the Spearman correlation coefficient. Construct validity of the KFAB was measured using the exploratory factor analysis to evaluate the unidimensionality of the questionnaire. The significance level was set at ${\alpha}=.05$. Results: The internal consistency of the KFAB was found be adequate with Cronbach's alpha (.96), and test-retest reliability was excellent as evidenced by the high ICC (r=.996). Concurrent validity showed high correlation between the KFAB and KBBS (r=.89, p<.001). Construct validity was evaluated using exploratory factor analysis. The result from Bartlett test of sphericity was statistically significant (p<.001), and the value of Kaiser-Meyer-Olkin measure of sampling adequacy was .93. Exploratory factor analysis revealed the existence of only one dominant factor that explained 76.43% of the variance. Conclusion: The KFAB is a reliable, valid and appropriate tool for measuring the balance functions in elderly people.

Comparison of Vendor-Provided Volumetry Software and NeuroQuant Using 3D T1-Weighted Images in Subjects with Cognitive Impairment: How Large is the Inter-Method Discrepancy?

  • Chung, Jieun;Kim, Hayoung;Moon, Yeonsil;Moon, Won-Jin
    • Investigative Magnetic Resonance Imaging
    • /
    • v.24 no.2
    • /
    • pp.76-84
    • /
    • 2020
  • Background: Determination of inter-method differences between clinically available volumetry methods are essential for the clinical application of brain volumetry in a wider context. Purpose: The purpose of this study was to examine the inter-method reliability and differences between the Siemens morphometry (SM) software and the NeuroQuant (NQ) software. Materials and Methods: MR images of 86 subjects with subjective or objective cognitive impairment were included in this retrospective study. For this study, 3D T1 volume images were obtained in all subjects using a 3T MR scanner (Skyra 3T, Siemens). Volumetric analysis of the 3D T1 volume images was performed using SM and NQ. To analyze the inter-method difference, correlation, and reliability, we used the paired t-test, Bland-Altman plot, Pearson's correlation coefficient, intraclass correlation coefficient (ICC), and effect size (ES) using the MedCalc and SPSS software. Results: SM and NQ showed excellent reliability for cortical gray matter, cerebral white matter, and cerebrospinal fluid; and good reliability for intracranial volume, whole brain volume, both thalami, and both hippocampi. In contrast, poor reliability was observed for both basal ganglia including the caudate nucleus, putamen, and pallidum. Paired comparison revealed that while the mean volume of the right hippocampus was not different between the two software, the mean difference in the left hippocampus volume between the two methods was 0.17 ml (P < 0.001). The other brain regions showed significant differences in terms of measured volumes between the two software. Conclusion: SM and NQ provided good-to-excellent reliability in evaluating most brain structures, except for the basal ganglia in patients with cognitive impairment. Researchers and clinicians should be aware of the potential differences in the measured volumes when using these two different software interchangeably.

Reliability and Convergent Validity of Standing Posture Measurement Using a Mobile Application in Forward Head Posture (전방머리자세 성인을 대상으로 모바일 어플리케이션을 이용한 자세정렬 측정의 신뢰도 및 수렴 타당도 연구)

  • Kang, Hyojeong;Kim, Minkyu;Yang, Hoesong;Lee, Wanhee
    • Journal of The Korean Society of Integrative Medicine
    • /
    • v.8 no.3
    • /
    • pp.173-180
    • /
    • 2020
  • Purpose : The aim of this study was to assess the intra- and inter-rater reliability and validity of measurements of head, neck, and pelvis posture using a mobile application in subjects with forward head posture. Methods : Forty-eight volunteers (22 men, 26 women) participated in this study. Two raters independently examined whole body picture images in a lateral standing posture with arms crossed using a CA-Smart Posture Reminder (CA-SPR), and a rater took and calculated posture images twice to assess reliability. We measured five parameters: craniovertebral angle 1 (CVA1), anterior shoulder translation (AST), pelvic tilt (PT), knee angle (KA), and ankle angle (AA) in the subject's sagittal plane using CA-SPR. We examined whole spine X-ray images in the same position to assess validity. We measured four variables in the subjects: CVA2, translation distance (AHT), anterior pelvic plane (APP), and sacral slope (SS). The intra- and inter-rater reliability were calculated using the intraclass correlation coefficient (ICC). Convergent validity was calculated using Pearson's correlation coefficient. Results : The intra-rater reliability (ICC=.889 -.989) and inter-rater reliability (ICC=.800 -.980) were excellent for all variables measured using CA-SPR. The variables measured using CA-SPR and X-ray were significantly positively correlated (r=.623, p<.01). However, the correlation of the variables in the pelvis was not statistically significant. Conclusion : This study shows that a mobile application (CA-SPR) is a useful tool for measuring head and neck posture in subjects with forward head posture. However, further study is needed to measure pelvic variables when using a mobile application.

Reliability and Validity of the Goniometer for Hallux Valgus Angle Measurement (엄지발가락휨각도 측정을 위한 각도계의 신뢰도와 타당도)

  • Choung, Sung-Dae;Kang, Sun-Young;Kim, Moon-Hwan;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.20 no.2
    • /
    • pp.46-51
    • /
    • 2013
  • The purpose of this study was to investigate the reliability and validity of goniometer measurements of the hallux valgus angle (HVA) compared to radiographic measurements, which are the current standard. Twenty subjects (10 female, 10 male) were recruited for this study (40 feet). The HVA of the subjects was measured using goniometer and radiographic measurement. In three trials, measurements were taken of each subject by two examiners using goniometer and radiographic measurements using radiography in a standing position. The reliability of the measurements was investigated using intraclass correlation coefficients (ICC(3,1)), and the validity was tested using the Pearson product-moment correlation coefficient and an independent t-test. The intra-rater reliability of left and right HVAs were poor (ICC=.409 and .341, respectively). The inter-rater reliability of left and right HVAs were poor and moderate (ICC=.303 and .501, respectively). Left and right HVAs measured using goniometer and radiographic measurements were also poor and moderate (Pearson r=.246 and .544, respectively). These results suggest that goniometer measurements of the HVA are inaccurate and have unacceptable validity compared to radiographic measurements.

Sources of Variability of Multiple Self-reported 24-hour Recalls in Dietary Survey (식이조사방법중 자기 기록식 24시간 회상 반복 조사의 변이원에 관한 연구)

  • 김연희
    • Journal of Nutrition and Health
    • /
    • v.30 no.3
    • /
    • pp.349-359
    • /
    • 1997
  • This study was designed to study sources of variability(subjects, day by day, season, day of week, sequence, number of repeated days, compliance etc.) in multiple 24-hour dietary recall method. Dietary intakes of college women in Seoul were obtained using 24-hour dietary recalls, consecutive 7 days, 4 times for 1 year. The result of this study shows that 1) the reproducibility of multiple 24-hour recalls is low(intraclass correlation coefficient<0.3), 2) the intraindividual variations of all nutrients are more than 80%, 3) the major components of variation are interindividual vriability and intraindividual variability(within person variability and methodologic error). There were small but statistically significant season and compliance effects. 4) the ratio within-person varation to between-person variation for absolute and transformed nutrient intakes except some nutrients such as vitamin A, vitamin C, energy from protein and fat etc, was less than 1.7 the minimum numbers of days needed in 24-hour dietary recalls to estimate usual intake for this group were 1 to 21 days. And the numbers of days needed to get the usual intake of an individual varied among individuals and within individuals for different nutrients, ranged from 1 days for log carbohydrate(% energy) to 470 days for Na. 6) There were greater than 0.7 correlation coefficients between the average nutrient intakes of 12 days and intakes of 28 days. Therefore, it was desirable to take the 24-hour recall more than 12 times, repeating 3 days every season.

  • PDF

Reliability and Validity of a Force-Sensing Resistor for the Measurement of Static Hindlimb Weight Distribution in Beagle Dogs

  • Heo, Su-Young;Jeong, Heejun;Jeong, Jaemin;Jeong, Seong Mok;Lee, HaeBeom
    • Journal of Veterinary Clinics
    • /
    • v.35 no.5
    • /
    • pp.206-210
    • /
    • 2018
  • The purpose of this study was to evaluate the reliability and validity of the Force-Sensing Resistor (FSR) for measurement of static hindlimb weight distribution in beagle dogs and to compare these results to a Digital Weighing Scale (DWS). Nine healthy beagle dogs were recruited for this study. Static weight distribution was evaluated four times at intervals of 5 days with each device and two observers to calculate the intra- and interobserver reliability. The intraclass correlation coefficient (ICC) values of the FSR for intraobserver reliability were moderate to good (0.74). The results for the DWS showed poor to moderate (0.56) ICC values for intraobserver reliability. The ICC values for interobserver reliability were 0.53 and 0.61 for FSR and DWS, respectively, indicating poor to moderate agreement. Our findings suggest that the Force-Sensing Resistor can be used to measure static weight distribution in veterinary medicine. However, caution should be taken when comparing measured values of static weight distribution obtained utilizing both the FSR and DWS due to their low positive correlation (R = 0.41, p < 0.01).