• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 220, Processing Time 0.032 seconds

The Agreement in Cold-Heat and Health Status among Sasang Constitutional Experts in Diagnosis of Sasang Pathological Symptoms (사상의학 병증진단에 있어서 사상의학 전문가의 한열 특성 및 건강상태 평가에 관한 일치도 연구)

  • Jin, Hee-Jeong;Kim, Sang-Hyuk;Dong, Sang-Oak;Jang, Eun-Su;Lee, Si-Woo
    • Journal of Sasang Constitutional Medicine
    • /
    • v.26 no.2
    • /
    • pp.146-155
    • /
    • 2014
  • Objectives In Sasang Constitutional medicine(SCM), it is an important factor to assess the degree of cold/heat and healthy status. We purposed to check the agreement among the experts on the assessment of cold/heat and healthy status. Methods Six SCM experts and 10 healthy volunteers were recruited for this study. The SCM experts had an interviewed with each volunteer in the similar condition like that of the actual clinic. And then the expert evaluated each volunteer's cold/heat and healthy status. Intraclass correlation coefficient(ICC) was used to measure the interrater reliability and interrater agreement among the experts. Results Two volunteers are excluded due to the missing data, therefore eight persons' data (3 males and 5 females) were included in our analysis. The mean of age and BMI are 21.73(${\pm}2.32$) and 29.63(${\pm}4.66$), respectively. In health status, cold status and heat status, the ICC was 0.789, 0.904, 0.925, respectively. Conclusions We found that the assessment of cold/heat and healthy status was continued reliable among SCM experts. The assessment of cold/heat status was more consistent than the assessment of healthy status.

In vitro evaluation of color and translucency reproduction of maxillofacial prostheses using a computerized system

  • Nemli, Secil Karakoca;Gungor, Merve Bankoglu;Bagkur, Meral;Bal, Bilge Turhan;Arici, Yeliz Kasko
    • The Journal of Advanced Prosthodontics
    • /
    • v.10 no.6
    • /
    • pp.422-429
    • /
    • 2018
  • PURPOSE. Accurate color matching of maxillofacial prostheses to skin is important for esthetics. A computerized color matching system specific to human skin has recently been developed. The purpose of this study was to evaluate the accuracy in color and translucency matching of the computerized color matching system across different skin colors. MATERIALS AND METHODS. The silicone was colored to simulate 28 different skin colors (n=5) to serve as "target skin colors". Using a spectrocolorometer (e-skin), color codes were determined for "replicate skin color" fabrication. CIELAB Delta-E between target skin color-replicate skin color pairs and translucency parameter were calculated. CIELAB Delta-E values were compared with one-way ANOVA and Tukey multiple-comparison. The agreement between $L^*$, $a^*$, $b^*$ and translucency parameter of target skin colors and replicate skin color were calculated by a two-way mixed average measures intraclass correlation coefficient. Translucency parameter of target skin color- replicate skin color pairs were compared with Paired t-test (${\alpha}=.05$). RESULTS. The mean CIELAB Delta-E value was 3.83 and significant differences were found among colors. The intraclass correlation coefficient showed excellent reliability for $L^*$, $a^*$, $b^*$ and good reliability for translucency parameter (P<.001). The mean translucency parameter of replicate skin colors was significantly higher than that of translucency parameter. CONCLUSION. The computerized color matching system specific to human skin was found to be reliable in terms of color and translucency between target skin colors and replicate skin color.

Reliability Analysis and Improvement Plan for Evaluation of Program Outcomes among Demand-driven Raters (프로그램 학습성과 평가에 대한 수요지향 평가자 간 신뢰도 분석 및 개선 방안)

  • Lee, Youngho;Shin, Younghak;Kim, Jonghwa
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.3
    • /
    • pp.410-418
    • /
    • 2021
  • In a program that runs an engineering education certification, program outcomes refer to the knowledge, skills, and attitudes a student must have until graduation. In general, capstone design is used as a tool for evaluating program outcomes. This paper applies the intraclass correlation coefficient (ICC) to measure the raters' reliability in assessing program outcomes. Several raters evaluate program outcomes, and the result is used to obtain the raters' ICC. ICC measures the reliability of ratings or measurements for clusters - data that has been collected as groups or sorted into groups. If the ICC is close to 1, it means that the reliability among the raters is high. We evaluated the proposed method's usefulness through case analysis. As a method for assessing an evaluation tool's objectivity, multiple raters measure the same evaluation tool. As a result, we measured the ICC values for all POs, and analyzed the cause for the low measured POs. We applied this method to evaluate program outcomes of the Department of Computer Engineering in the past two years. As a result, we derived guidelines for improvement and program outcomes.

Comparison of Batch Assay and Random Assay Using Automatic Dispenser in Radioimmunoassay (핵의학 체외 검사에서 자동분주기를 이용한 Random Assay 가능성평가)

  • Moon, Seung-Hwan;Lee, Ho-Young;Shin, Sun-Young;Min, Gyeong-Sun;Lee, Hyun-Joo;Jang, Su-Jin;Kang, Ji-Yeon;Lee, Dong-Soo;Chung, June-Key;Lee, Myung-Chul
    • Nuclear Medicine and Molecular Imaging
    • /
    • v.43 no.4
    • /
    • pp.323-329
    • /
    • 2009
  • Purpose: Radioimmunoassay (RIA) was usually performed by the batch assay. To improve the efficiency of RIA without increase of the cost and time, random assay could be a choice. We investigated the possibility of the random assay using automatic dispenser by assessing the agreement between batch assay and random assay. Materials and Methods: The experiments were performed with four items; Triiodothyronine (T3), free thyroxine (fT4), Prostate specific antigen (PSA), Carcinoembryonic antigen (CEA). In each item, the sera of twenty patients, the standard, and the control samples were used. The measurements were done 4 times with 3 hour time intervals by random assay and batch assay. The coefficient of variation (CV) of the standard samples and patients' data in T3, fT4, PSA, and CEA were assessed. ICC (Intraclass correlation coefficient) and coefficient of correlation were measured to assessing the agreement between two methods. Results: The CVs (%) of T3, fT4, PSA, and CEA measured by batch assay were 3.2$\pm$1.7%, 3.9$\pm$2.1%, 7.1$\pm$6.2%, 11.2$\pm$7.2%. The CVs by random assay were 2.1$\pm$1.7%, 4.8$\pm$3.1%, 3.6$\pm$4.8%, and 7.4$\pm$6.2%. The ICC between the batch assay and random assay were 0.9968 (T3), 0.9973 (fT4), 0.9996 (PSA), and 0.9901 (CEA). The coefficient of correlation between the batch assay and random assay were 0.9924(T3), 0.9974 (fT4), 0.9994 (PSA), and 0.9989 (CEA) (p<0.05). Conclusion: The results of random assay showed strong agreement with the batch assay in a day. These results suggest that random assay using automatic dispenser could be used in radioimmunoassay.

Availability of the Pendulum Test Using NK Table for Spasticity Measurement of Low Extremity (하지 강직 평가에 있어 NK테이블을 이용한 진자검사의 유용성)

  • Kim, Yong-Wook;Weon, Jong-Hyuck;Kim, Tae-Ho
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.8 no.2
    • /
    • pp.209-217
    • /
    • 2013
  • PURPOSE: The purpose of this study was to investigate the clinical availability of the pendulum test (through reliability and validity) using a NK table attached electrogoniometer for spasticity measurement in patients with brain lesions. METHODS: Thirty-one stroke and traumatic brain injury subjects participated in the study. Intraclass correlation coefficient (ICC) was used to verify the test-retest reliability of spasticity measures of the pendulum test. Pearson's product correlation coefficient was used to examine the validity of the pendulum test through the amplitude of the deep tendon reflex (DTR) test known for objective and quantitative measure of spasticity. RESULTS: In these results, the test-retest reliability was showed significantly high correlation between pendulum tests (ICCs=.95~.97, p<.01). There were significant negative correlations between the amplitude of the DTR test and all measures of spasticity of the pendulum test(r=-.77~-.85, p<.01). CONCLUSION: Thus, it is possible to use the pendulum test using a NK table as an objective measure of spasticity, rather than other expensive equipment, which is more complicated to use. Further studies are needed to explore the therapeutic effects of spasticity using a newly designed pendulum test equipment in this study.

Development of an Oral Health Assessment Tool for Critically Ill Patients (중환자 구강사정 도구개발)

  • Kim, Jin Hee;Park, Kyungsook
    • Journal of Korean Critical Care Nursing
    • /
    • v.11 no.3
    • /
    • pp.12-22
    • /
    • 2018
  • Purpose : This methodological study develops an oral health assessment tool for critically ill patients. Method : From February 15 to April 30, 2014, this study was conducted to test the validity and reliability of the tool at two general hospitals and three medical and surgical intensive care units (ICUs) in Seoul, Korea. Results : The result of the intraclass correlation coefficient to test the between-observer reliability by analyzing the oral health assessment scores before and after oral nursing care showed that .93 of before oral care and .90 of after oral care. The correlation coefficient values of .68 (p<.001) and .71 (p<.001) before and after providing oral nursing care, respectively, indicated the presence of a statistically significant correlation between the tool and the criterion. Using the paired t-test, the differentiated validity of the tool was tested in patients who had developed pneumonia after entering the ICU. A statistically significant difference in scores was found between the time of entering the ICU and that of developing pneumonia (t=-8.73, p<.001), which provided evidence for the differentiated validity of the tool. Conclusions : Since the validity and reliability of the tool developed in this study were verified, this tool can be used to assess the oral health conditions of critically ill patients.

Feasibility of the Depth Camera-based Physical Health Monitoring System for Elderly Living Alone

  • Sungbae, Jo
    • Physical Therapy Rehabilitation Science
    • /
    • v.13 no.1
    • /
    • pp.106-112
    • /
    • 2024
  • Objective: This study aimed to evaluate the validity of a depth camera-based system for monitoring physical function, assessing its feasibility for accurately monitoring activities of daily living. Design: A cross-sectional study. Methods: Twenty-three participants were enlisted to perform fifteen activities of daily living within a living laboratory designed to simulate a home environment. Activities were monitored using a depth camera system capable of classifying actions into standing, sitting, and lying down, with a conventional video camera employed for activity recording. The duration of each activity, as measured by the system, was compared to direct observations made by a physical therapist which were analyzed using a motion analysis software. The association between these two measurement approaches was assessed through correlation analysis, coefficient of determination, intraclass correlation coefficient (ICC), and Bland-Altman plots. Results: Our findings indicated that standing activities exhibited the highest correlation (r=0.847) between the system measurements and physical therapist observations, followed by sitting (r=0.817) and lying down (r=0.734), which demonstrated lower correlations. However, the ICC and Bland-Altman plots revealed notable variances between the two measurement methods, particularly for activities involving lying down. Conclusions: In this study, the depth camera-based physical monitoring system showed promise feasibility in distinguishing standing, sitting, and lying down activities at home environments. However, the current study also underlined some necessities of enhancements in capturing lying down activities.

Reliability of Portable Spirometry Performed in the Korea National Health and Nutrition Examination Survey Compared to Conventional Spirometry

  • Park, Hye Jung;Rhee, Chin Kook;Yoo, Kwang Ha;Park, Yong Bum
    • Tuberculosis and Respiratory Diseases
    • /
    • v.84 no.4
    • /
    • pp.274-281
    • /
    • 2021
  • Background: The Korea National Health and Nutrition Examination Survey (KNHANES) is a well-designed survey to collect national data, which many researchers have used for their studies. In KNHANES, although portable spirometry was used, its reliability has not been verified. Methods: We prospectively enrolled 58 participants from four Korean institutions. The participants were classified into normal pattern, obstructive pattern, and restrictive pattern groups according to their previous spirometry results. Lung function was estimated by conventional spirometry and portable spirometry, and the results were compared. Results: The intraclass correlation coefficients of forced vital capacity (FVC) (coefficient, 9.993; 95% confidence interval [CI], 0.988-0.996), forced expiratory volume in 1 second (FEV1) (coefficient, 0.997; 95% CI, 0.995-0.998), FEV1/FVC ratio (coefficient, 0.995; 95% CI, 0.992-0.997), and forced expiratory flow at 25-75% (FEF25-75%; coefficient, 0.991; 95% CI, 0.984-0.994) were excellent (all p<0.001). In the subgroup analysis, the results of the three parameters were similar in all groups. In the overall and subgroup analyses, Pearson's correlation of all the parameters was also excellent in the total (coefficient, 0.986-0.994; p<0.001) and subgroup analyses (coefficient, 0.915-0.995; p<0.001). In the paired t-test, FVC, FEV1/FVC, and FEF25-75% estimated by the two instruments were statistically different. However, FEV1 was not significantly different. Conclusion: Lung function estimated by portable spirometry was well-correlated with that estimated by conventional spirometry. Although the values had minimal differences between them, we suggest that the spirometry results from the KNHANES are reliable.

The Evaluation of Reliability and Validity for Mibyeong Questionnaire (증상 정도, 기간, 불편정도 및 회복력 기반 미병 설문지의 신뢰도 및 구성 타당도 평가)

  • Jang, Eunsu;Yoon, Ji-Hyeon;Lee, Youngseop
    • The Journal of the Society of Korean Medicine Diagnostics
    • /
    • v.21 no.1
    • /
    • pp.13-25
    • /
    • 2017
  • Objectives The purpose of this study was to evaluate the reliability and the validity of Mibyeong Questionnaire (MQ). The subjects enrolled in this study was 165 from July 2015 to Jan. 2016. The surveys were conducted twice with 3 month terms. Methods The Cronbach's ${\alpha}$ analysis for internal reliability, Pearson Correlation Coefficient analysis for test-retest reliability, Factor analysis with varimax rotation for construct validity, Kappa analysis for diagnostic reliability were used. The significant p-value was less than 0.05. Results and Conclusions The result showed that the Cronbach's ${\alpha}$ of MQ was .857-.937 and total was .913. The reliabilities between test and retest for the MQ were .666-.832 (0.416-0.673, in case of including recovery question) in intraclass correlation coefficient (ICC). The Kappa of recovery question in each item was ranged 0.23(80.6% in agreement rate) to .46(87.9% in agreement rate). In test-retest the Kappa value of Mibyeong diagnosis referred by median value was .418(71% in agreement rate). This study revealed that MQ is a reliable and valid questionnaire.

Reliability and Validity of Korean-Version of Information Needs in Cardiac Rehabilitation Scale

  • Choi, Sang Young Heon;Kim, Joong Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.34 no.5
    • /
    • pp.234-241
    • /
    • 2022
  • Purpose: The Cardiac Rehabilitation scale (INCR scale) is a verified measure worldwide. The scale measures the extent to which cardiac rehabilitation meets the various needs of the participating patients and determines how education related to heart disease and rehabilitation satisfies their preferences. The current study applied the INCR scale to verify and develop it for use in Korea by conforming to Korean culture and language. Methods: The Korean version of the INCR scale was created after a six-step process in accordance with the international questionnaire translation law. The Korean version of the INCR scale was assessed in 45 cardiac rehabilitation patients (29 males, 16 females). Internal consistency was verified using Cronbach's alpha. Test-re-test reliability and interrater reliability were verified using the intraclass correlation coefficient (ICC). Content validity was selected to verify the validity. Results: The content validity index of the Korean version of the INCR scale was high, with an average of 0.93. Cronbach's Alpha for Internal consistency also revealed high reliability of 0.89 in all 10 categories. The interclass correlation coefficient of the test-re-test and interrater reliability scores were 0.95 and 0.81, respectively. Conclusion: Our results indicate that the Korean version of the INCR scale would be instrumental in the clinical setting to determine the knowledge, educational needs, and preferences of patients participating in cardiovascular disease and cardiac rehabilitation.