• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 230, Processing Time 0.033 seconds

Reliability and Validity of the Manual Measurement Method for Patellar Height (무릎뼈 높이에 대한 도수측정방법의 신뢰도와 타당도)

  • Kim, Moon-Hwan;Yun, Sung-Joon;Weon, Jong-Hyuck
    • Physical Therapy Korea
    • /
    • v.20 no.3
    • /
    • pp.54-61
    • /
    • 2013
  • This study was to determine the reliability and validity of manual measurements of patellar height to standard radiographic measurements in 30 knees of 15 subjects. Patellar height was measured using manual and radiographic methods. The manual measurements were performed by two examiners using digital vernier calipers with the subject sitting and the knees in $30^{\circ}$ of flexion. The radiographic measurements were performed in the same position. The reliability of the manual measurements was assessed by means of intraclass correlation coefficients [ICC(3,1)], and the validity was investigated using the Pearson's product-moment correlation coefficient and an independent t-test. The intra- and inter-rater reliabilities of the manual measurement of patellar height were excellent (ICC=.86 and .88 respectively). The validity of patellar height measured manually compared to the radiographic method was good (Pearson's r=.69). In conclusion, the manual method is an objective, qualitative measurement of patella height.

Development and Validation of a Dignity in Care Scale of Terminally Ill Patients for Nurses (간호사를 위한 말기 환자 존엄간호 측정도구 개발)

  • Ahn, Yun Sil;Oh, Pok Ja
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.3
    • /
    • pp.340-358
    • /
    • 2023
  • Purpose: This study aimed to develop an instrument to showcase Dignity in Care of Terminally Ill Patients for Nurses and to examine its validity and reliability. Methods: A total of 58 preliminary items on dignity in care of terminally ill patients for nurses were selected using content validity analysis and expert opinions on 97 candidate items derived through a literature review and qualitative focus group interviews. Questionnaires were administered to 502 nurses caring for terminally ill cancer patients at hospice and palliative care institutions. The data were analyzed using item analysis, exploratory and confirmatory factor analysis, convergent and discriminant validity, and Pearson correlation for criterion validity, reliability was tested using Cronbach's alpha. Results: The final instrument consisted of 25 items, with four factors identified through confirmatory factor analysis. Four factors-ethical values and moral attitudes, interaction-based communication, maintaining comfort, professional insight and competence-accounted for 61.8% of the total variance. Cronbach's α for total items was .96, and test-retest reliability of intraclass correlation coefficient was .90. Conclusion: Since its validity and reliability have been verified through various methods, the Dignity in Care Scale of Terminally Ill Patients for Nurses can be used for develop nursing interventions and improve dignity in care of terminally ill patients.

Reliability and Validity of the Alcohol Use Disorders Identification Test - Consumption in Screening for Adults with Alcohol Use Disorders and Risky Drinking In Japan

  • Osaki, Yoneatsu;Ino, Aro;Matsushita, Sachio;Higuchi, Susumu;Kondo, Yoko;Kinjo, Aya
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.16
    • /
    • pp.6571-6574
    • /
    • 2014
  • Background: Alcohol is well established as a risk factor for cancer development in many organ sites. To assess the reliability and validity of the Alcohol Use Disorders Identification Test - Consumption (AUDIT-C) for detecting alcohol use disorders or risky drinking in Japanese adults the present study was conducted. Materials and Methods: A test-retest method was applied with a 2-week interval with 113 health care employees. The k coefficient, Cronbach's coefficient alpha, Spearman's correlation coefficient, and intraclass correlation coefficient (ICC) were determined and the validity of the AUDIT-C was analyzed using the data from a nationwide survey on adult alcohol use conducted in 2008 (n=4,123). Results: The reliability of the AUDIT-C score was high (${\kappa}$ coefficient=0.63, Cronbach's alpha=0.98, correlation coefficient=0.95, and ICC=0.95). According to the likelihood ratio and Youden index, appropriate cutoffs for the AUDIT-C were ${\geq}5points$ in men and ${\geq}4$ points in women. The sensitivity and specificity of these cutoffs for identifying ${\geq}8$ points on the AUDIT were 0.88 and 0.80, respectively, for men (positive likelihood ratio [LR+]=4.5) and 0.96 and 0.87, respectively, for women (LR+=7.7). The sensitivity and specificity of the cutoffs for identifying ${\geq}12$ points on the AUDIT were 0.90 and 0.84, respectively, for men (LR+=5.8) and 0.93 and 0.94, respectively, for women (LR+=15.8). The sensitivity and specificity of the cutoffs for identifying ${\geq}16$ points on the AUDIT were 0.93 and 0.80, respectively, for men (LR+=4.7) and 0.92 and 0.98, respectively, for women (LR+=55.6). With higher scores on the AUDIT, the specificity decreased and false-positives increased. The appropriate cutoffs for identifying risky drinking were the same for both genders. Conclusions: The reliability and validity of the AUDIT-C are high, indicating that it is useful for identifying alcohol use disorders or risky drinking among the general population in Japan, a group at high risk of cancer development.

Intra-Rater and Inter-Rater Reliability of Various Forward Head Posture Measurements

  • Yoo, Won-Gyu;Kim, Min-Hee;Yi, Chung-Hwi
    • Physical Therapy Korea
    • /
    • v.12 no.4
    • /
    • pp.41-47
    • /
    • 2005
  • The purpose of this study was to determine the intra-rater and inter-rater reliability of various forward head posture measurements. Ten healthy adults (age, $20.4{\pm}2.2$ yrs; height, $164.0{\pm}5.5$ cm; weight, $58.7{\pm}7.3$ kg) participated in the study. They were free of injury and neurologic deficits in the upper extremities and neck at the time of testing. The subjects were asked to perform head forward posture by under the guidance of physical therapists. Markers were placed on the C7 spinous process, mastoid process, tragus of the ear, outer canthus, and forehead. Measurement 1 for forward head posture assessment was measured as the angle between the horizontal line through C7 and the line connecting the C7 spinous process with the tragus of the ear. Measurement 2 was measured as the angle between the C7 spinous process, the mastoid process and the outer canthus. Measurement 3 was measured as two kinds of angles the HT (head tilt) angle is between the line from the midpoint of forehead to the tragus line and Y-axis at the tragus point. The NF (neck flexion) angle is between the line from the tragus to the C7 line and the Y-axis at the C7. Intra-rater, inter-rater reliability and coefficient of variation was assessed by comparing the measured values from three kinds of measurements of forward head posture. The intra-rater reliability was indicated by intraclass correlation coefficients [ICC(1,1)] and inter-rater reliability was shown by intraclass correlation coefficients [ICC(3,k)]. The results of study were as follows: ICC(1,1) values for intra-rater reliability of three measurements were in the 'excellent' category. ICC(3,k) values for inter-rater reliability of three measurements were also in the 'excellent' category. The coefficient of variation of method 2 had a lower value than method 1 and method 3. This data means that the measured value of method 2 was less scattered. Further research is needed to determine whether the validity of all measurements is revealed in the 'excellent' category.

  • PDF

Parasellar Extension Grades and Surgical Extent in Endoscopic Endonasal Transsphenoidal Surgery for Pituitary Adenomas : A Single Surgeon's Consecutive Series with the Aspects of Reliability and Clinical Validity

  • Lee, Sang-Hyo;Park, Jae-Sung;Lee, Song;Kim, Sung-Won;Hong, Yong-Kil
    • Journal of Korean Neurosurgical Society
    • /
    • v.59 no.6
    • /
    • pp.577-583
    • /
    • 2016
  • Objective : The inter-rater reliability of the modified Knosp's classification was measured before the analysis. The clinical validity of the parasellar extension grading system was evaluated by investigating the extents of resection and complication rates among the grades in the endoscopic endonasal transsphenoidal surgery (EETS) for pituitary adenomas. Methods : From November 2008 to August 2015, of the 286 patients who underwent EETS by the senior author, 208 were pituitary adenoma cases (146 non-functioning pituitary adenomas, 10 adrenocorticotropic hormone-secreting adenomas, 31 growth hormone-secreting adenomas, 17 prolactin-secreting adenomas, and 4 thyroid-stimulating hormone-secreting adenomas; 23 microadenomas, 174 macroadenomas, and 11 giant adenomas). Two neurosurgeons and a neuroradiologist independently measured the degree of parasellar extension on the preoperative sellar MRI according to the modified Knosp's classification. Inter-rater reliability was statistically assessed by measuring the intraclass correlation coefficient. The extents of resection were evaluated by comparison of the pre- and post-operative MR images; the neurovascular complications were assessed by reviewing the patients' medical records. The extent of resection was measured in each parasellar extension grade; thereafter, their statistical differences were calculated. Results : The intraclass correlation coefficient value of reliability across the three raters amounted to 0.862. The gross total removal (GTR) rates achieved in each grade were 70.0, 69.8, 62.9, 21.4, 37.5, and 4.3% in Grades 0, 1, 2, 3A, 3B, and 4, respectively. A significant difference in the extent of resection was observed only between Grades 2 and 3A. In addition, significantly higher complication rates were observed in the groups above Grade 3A. Conclusion : Although the modified Knosp's classification system appears to be complex, its inter-rater reliability proves to be excellent. Regarding the clinical validity of the parasellar extension grading system, Grades 3A, 3B, and 4 have a negative predictive value for the GTR rate, with higher complication rates.

Validity of Arch Relationship Measurements in Digital Dental Models (디지털 치열 모형에서 악궁 관계 지표 측정의 타당성)

  • Ryu, Jiin;Yang, ByoungEun;Lee, Hyelim
    • Journal of the korean academy of Pediatric Dentistry
    • /
    • v.49 no.1
    • /
    • pp.14-24
    • /
    • 2022
  • The aim of the present study is to evaluate the validity of orthodontic measurements including tooth width, Bolton ratio, overjet and overbite on the digital dental models. Dental models of the subjects aged 12 to 18 were obtained in 3 different forms, which were conventional stone model, digital model created with Freedom HD model scanner, and digital model produced with CS3600 intraoral scanner. After measurements were made on the models, reliability and reproducibility of the measurements were evaluated by using intraclass correlation coefficient, while validity was assessed with paired t-test. As a result, significant reliability and reproducibility were verified, with intraclass correlation coefficient exceeding 0.750 in all groups. Measurements of the model scanned group showed an adequate validity in overall and anterior Bolton ratio, overjet, and overbite. Intraoral scanned models showed an adequate validity in anterior Bolton ratio, and overjet. Measurement on intraoral scanned digital models can be considered as an alternative for young children who have difficulty in taking impression. Furthermore, careful considerations on measurement error should be made in clinical situations.

Reliability of Web and Paper-Based Survey Methods for Mibyeong and Cold-Heat Pattern Questionnaire for Korean Medicine Health Assessment: Pilot Study (한의 건강 측정을 위한 미병과 한열설문의 웹과 종이 기반 조사 방법의 신뢰도: 예비연구)

  • Jeong, Kyoungsik;Kim, Hoseok;Lee, Siwoo;Lim, Sueun;Baek, Younghwa
    • The Journal of the Korea Contents Association
    • /
    • v.22 no.8
    • /
    • pp.671-680
    • /
    • 2022
  • This study evaluated the consistency between the web-based and paper-based mibyeong and cold-heat pattern questionnaire, the Korean medicine-based tool for diagnosing and classifying health status. First, a web-based survey was conducted on 72 ordinary people; subsequently, a paper-based survey was conducted after a certain time interval. The equivalence between the web-based and paper-based surveys was evaluated on the basis of the consistency between scores using the Intraclass Correlation Coefficient (ICC) and Bland-Altman methodology. The mibyeong questionnaire showed high reliability for the web-based and paper-based surveys (ICC=0.95, 95% CI 0.92 - 0.97), and the cold-heat pattern questionnaire showed high reliability for both cold syndrome (ICC=0.98, 95% CI 0.96 - 0.99) and heat syndrome (ICC=0.9, 95% CI 0.83 - 0.93). The difference in average scores between the two survey methods was -0.25 for the mibyeong survey, -0.17 for the cold syndrome, and 0.11 for the heat syndrome, showing a similar pattern. Among the respondents, 84% showed positive satisfaction with the web-based survey, and 80% preferred the web-based survey. Overall, this study confirmed the reliability and feasibility of the web-based survey methods for the mibyeong and cold-heat pattern questionnaire. This could be a useful tool for the follow-up of subjects in long-term cohort studies.

Correlation Between Knee Muscle Strength and Maximal Cycling Speed Measured Using 3D Depth Camera in Virtual Reality Environment

  • Kim, Ye Jin;Jeon, Hye-seon;Park, Joo-hee;Moon, Gyeong-Ah;Wang, Yixin
    • Physical Therapy Korea
    • /
    • v.29 no.4
    • /
    • pp.262-268
    • /
    • 2022
  • Background: Virtual reality (VR) programs based on motion capture camera are the most convenient and cost-effective approaches for remote rehabilitation. Assessment of physical function is critical for providing optimal VR rehabilitation training; however, direct muscle strength measurement using camera-based kinematic data is impracticable. Therefore, it is necessary to develop a method to indirectly estimate the muscle strength of users from the value obtained using a motion capture camera. Objects: The purpose of this study was to determine whether the pedaling speed converted using the VR engine from the captured foot position data in the VR environment can be used as an indirect way to evaluate knee muscle strength, and to investigate the validity and reliability of a camera-based VR program. Methods: Thirty healthy adults were included in this study. Each subject performed a 15-second maximum pedaling test in the VR and built-in speedometer modes. In the VR speedometer mode, a motion capture camera was used to detect the position of the ankle joints and automatically calculate the pedaling speed. An isokinetic dynamometer was used to assess the isometric and isokinetic peak torques of knee flexion and extension. Results: The pedaling speeds in VR and built-in speedometer modes revealed a significantly high positive correlation (r = 0.922). In addition, the intra-rater reliability of the pedaling speed in the VR speedometer mode was good (ICC [intraclass correlation coefficient] = 0.685). The results of the Pearson correlation analysis revealed a significant moderate positive correlation between the pedaling speed of the VR speedometer and the peak torque of knee isokinetic flexion (r = 0.639) and extension (r = 0.598). Conclusion: This study suggests the potential benefits of measuring the maximum pedaling speed using 3D depth camera in a VR environment as an indirect assessment of muscle strength. However, technological improvements must be followed to obtain more accurate estimation of muscle strength from the VR cycling test.

Development and Evaluation of a Badge-type Passive Sampler for the Measurement of Short-term Nitrogen Dioxide in Ambient Air (대기 중 이산화질소의 단기 측정을 위한 뱃지형 passive sampler의 개발 및 평가)

  • Kim Sun Kyu;Yim Bong Been;Jung Eui Suk;Kim Sun Tae
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.22 no.1
    • /
    • pp.117-126
    • /
    • 2006
  • The purpose of this study is to develop a badge-type passive sampler for the measurement of short-term nitrogen dioxide and to evaluate its performance. The principle of the method is a colorimetric reaction of nitrogen dioxide with sulfanilic acid, N-1-naphthylethylendiamine, and phosphoric acid. First, it has been shown that the filter paper should be rinsed with ultrapure water and ultrasound, and then dried in a vacuumed desiccator. The concentration and volume of absorption reagent (triethanolamine) were $20\%$ and 100 ${\mu}L$, respectively. The extraction time was determined as 60 min. Second, duplicate measurements (n= 116) were carried out for evaluating the precision of the passive sampler. The relative error and the correlation coefficient between duplicates are $3.4\pm 3.0\%$ and 0.994, respectively. In addition, the $95\%$ confidence interval of intraclass correlation coefficient and the estimated value are 0.992$\sim$0.996 and 0.994, respectively. Third, a paired t-test was carried out for evaluating the accuracy of the passive sampler (n=40). In the result of the test, the $95\%$ confidence interval of the difference was -1.710 ppb <$\gamma$< 0.788 ppb. Finally, the average concentration of blanks, measurement detection limit, limit of detection, and limit of quantification are $2.4\pm 0.4$ ppb, 104 ppb, 3.8 ppb, and 7.0 ppb, respectively.

A Study on Reliability and Evaluate Deficiency and Excess on Visual Inspection of Eyes (안진(眼診)을 통한 허실(虛實) 평가 및 신뢰도 연구)

  • Seo, Jae-Ho;Choi, Jin-Yong;Oh, Whan-Sup;Park, Young-Bae;Park, Young-Jae
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.18 no.1
    • /
    • pp.1-10
    • /
    • 2014
  • Objectives Visual inspection is the first diagnostic method in Oriental medicine, and visual inspection of eyes is the one among them. This study was written in order to complement further understanding on visual inspection of eyes. Methods 1. Out of 102 photographs submitted to the Society of HyungSang Medicine in 2009, 27 portrait pictures were selected as samples in blind by 2 clinicians. The samples were copied to make 54 sample pictures, and then randomly assigned to 4 clinicians. 2. The 4 clinicians evaluated the 54 samples for excess and deficiency of the eyes. The results were recorded as 5-points-scale, and their average and standard deviation was calculated. 3. Intra and inter class reliability test were measured using SPSS 13. Results For intra- and inter-class correlation coefficient (ICC) values were measured as 0.654~0.967 and 0.756~ 0.783 respectively, with the P-value below 0.05. Out of 27 originally selected samples, 7 pictures were selected as Deficiency Samples (with 3 pictures of male and 4 of females), and 20 as Excess Samples (with 4 of male and 16 of female). Among them, Sample No. 1, 9, 22, and 26 were selected as models of 'Excessive Eyes' for females, no. 4 and 5 as 'Very Excessive Eyes' for male and females, and no. 15 as 'Moderate Eyes' for females. Conclusion This study is the first attempt of quantitative measurement of excess and deficiency using the Visual Inspection of eyes by the visual inspection experts. Still, additional studies are needed regarding the relationship visual inspection methods have with existing standards of diagnosis.