• 제목/요약/키워드: Intraclass Correlation Coefficient

검색결과 221건 처리시간 0.032초

사상의학 병증진단에 있어서 사상의학 전문가의 한열 특성 및 건강상태 평가에 관한 일치도 연구 (The Agreement in Cold-Heat and Health Status among Sasang Constitutional Experts in Diagnosis of Sasang Pathological Symptoms)

  • 진희정;김상혁;동상옥;장은수;이시우
    • 사상체질의학회지
    • /
    • 제26권2호
    • /
    • pp.146-155
    • /
    • 2014
  • Objectives In Sasang Constitutional medicine(SCM), it is an important factor to assess the degree of cold/heat and healthy status. We purposed to check the agreement among the experts on the assessment of cold/heat and healthy status. Methods Six SCM experts and 10 healthy volunteers were recruited for this study. The SCM experts had an interviewed with each volunteer in the similar condition like that of the actual clinic. And then the expert evaluated each volunteer's cold/heat and healthy status. Intraclass correlation coefficient(ICC) was used to measure the interrater reliability and interrater agreement among the experts. Results Two volunteers are excluded due to the missing data, therefore eight persons' data (3 males and 5 females) were included in our analysis. The mean of age and BMI are 21.73(${\pm}2.32$) and 29.63(${\pm}4.66$), respectively. In health status, cold status and heat status, the ICC was 0.789, 0.904, 0.925, respectively. Conclusions We found that the assessment of cold/heat and healthy status was continued reliable among SCM experts. The assessment of cold/heat status was more consistent than the assessment of healthy status.

In vitro evaluation of color and translucency reproduction of maxillofacial prostheses using a computerized system

  • Nemli, Secil Karakoca;Gungor, Merve Bankoglu;Bagkur, Meral;Bal, Bilge Turhan;Arici, Yeliz Kasko
    • The Journal of Advanced Prosthodontics
    • /
    • 제10권6호
    • /
    • pp.422-429
    • /
    • 2018
  • PURPOSE. Accurate color matching of maxillofacial prostheses to skin is important for esthetics. A computerized color matching system specific to human skin has recently been developed. The purpose of this study was to evaluate the accuracy in color and translucency matching of the computerized color matching system across different skin colors. MATERIALS AND METHODS. The silicone was colored to simulate 28 different skin colors (n=5) to serve as "target skin colors". Using a spectrocolorometer (e-skin), color codes were determined for "replicate skin color" fabrication. CIELAB Delta-E between target skin color-replicate skin color pairs and translucency parameter were calculated. CIELAB Delta-E values were compared with one-way ANOVA and Tukey multiple-comparison. The agreement between $L^*$, $a^*$, $b^*$ and translucency parameter of target skin colors and replicate skin color were calculated by a two-way mixed average measures intraclass correlation coefficient. Translucency parameter of target skin color- replicate skin color pairs were compared with Paired t-test (${\alpha}=.05$). RESULTS. The mean CIELAB Delta-E value was 3.83 and significant differences were found among colors. The intraclass correlation coefficient showed excellent reliability for $L^*$, $a^*$, $b^*$ and good reliability for translucency parameter (P<.001). The mean translucency parameter of replicate skin colors was significantly higher than that of translucency parameter. CONCLUSION. The computerized color matching system specific to human skin was found to be reliable in terms of color and translucency between target skin colors and replicate skin color.

프로그램 학습성과 평가에 대한 수요지향 평가자 간 신뢰도 분석 및 개선 방안 (Reliability Analysis and Improvement Plan for Evaluation of Program Outcomes among Demand-driven Raters)

  • 이영호;신영학;김종화
    • 한국콘텐츠학회논문지
    • /
    • 제21권3호
    • /
    • pp.410-418
    • /
    • 2021
  • 공학교육인증제를 운용하는 공학교육 프로그램에서 프로그램 학습성과는 학생이 졸업하는 시점까지 갖추어야 할 지식, 기술 그리고 태도를 말한다. 일반적으로, 프로그램 학습성과 성취도를 측정하는 평가도구로 캡스톤디자인을 사용한다. 본 논문에서는 프로그램 학습성과 평가에 참여한 수요지향 평가자들의 평가 결과의 신뢰도를 측정하기 위해 급내 상관계수(ICC)를 계산한다. 즉, 같은 평가도구를 이용하여, 여러 명의 평가자가 학습성과를 평가하게 하고, 그 결과를 이용하여 평가자의 ICC를 구한다. ICC는 단체로 수집되거나 단체로 분류된 데이터에 대한 신뢰도의 등급을 측정하는 데 이용된다. ICC가 1에 가까우면 평가자 간 신뢰도가 높다고 판단할 수 있다. 이러한 방법을 지난 2년간의 4년제 대학 컴퓨터공학과 PO 평가 결과에 적용하여 평가도구의 신뢰성을 측정하고 분석하였다. 그리고 이 결과를 이용하여 평가자 간 ICC 측정값을 이용하면, 객관성이 부족한 평가도구를 찾아 보완할 수 있음을 알 수 있었다. 이러한 결과를 바탕으로, PO 평가체계에 대한 개선방안과 PO 수행 지침을 도출한다.

핵의학 체외 검사에서 자동분주기를 이용한 Random Assay 가능성평가 (Comparison of Batch Assay and Random Assay Using Automatic Dispenser in Radioimmunoassay)

  • 문승환;이호영;신선영;민경선;이현주;장수진;강지연;이동수;정준기;이명철
    • Nuclear Medicine and Molecular Imaging
    • /
    • 제43권4호
    • /
    • pp.323-329
    • /
    • 2009
  • 목적: 방사면역측정법 및 면역방사계수법은 매 실험마다 표준용액을 넣고 표준곡선에 대비하여 결과를 산출하는 batch assay가 일반화되어 있다. 비용과 시간에 대한 효율성을 증가 시키기 위해서는 선행 표준 곡선을 이용하여 검사를 진행하는 random assay의 적용이 요구된다. 방사면역측정법 및 면역방사계수법에서 자동분주기를 이용한 random assay적용 가능성을 평가 하기 위해 본 연구를 수행하였다. 대상 및 방법: Triiodothyronine (T3), free thyroxine (fT4), Prostate specific antigen (PSA), Carcinoembryonic antigen (CEA) 4가지 항목을 대상으로 하였으며 각 검사별 20명의 환자 검체를 이용하였다. 각 검사 항목별로 표준곡선을 얻기 위해 3시간 간격으로 4회 측정한 표준용액의 분당계수값(counter per minute, cpm)을 측정하였다. 이를 Friedman test를 이용하여 비교하여 검사시 마다 얻는 표준 곡선간의 차이를 평가하였다. 각 검사별 저, 중, 고농도의 대조 용액을 이용하여 5회 측정하고 이를 Friedman test를 이용하여 비교하여 측정 내 정밀도를 평가하였다. 각 검사별 저, 중, 고농도의 대조용액을 batch assay와 자동분주기를 이용한 random assay로 3시간 간격으로 각각 4회 측정하였다. 측정값을 바탕으로 평균, 표준 편차, 변이계수를 구하고 Wilcoxon test를 이용하여 비교하여 assay 방법에 따른 차이를 비교하였다. 두 assay간에 일치도(agreement)를 평가하기 위해 두 assay의 측정값 사이에 급내상관계수(Intraclass correlation coefficient, ICC)와 상관계수를 계산하였다. 결과: 모든 검사항목에서 표준 용액의 분당계수값은 측정 간에 통계적으로 유의한 차이가 없었다. T3, fT4, PSA, CEA 검사항목마다 측정한 저, 중, 고농도별 측정 내 변이계수는 T3(3.6%, 2.6%, 0.9%), fT4(4.5%, 1.1%. 1.3%), PSA(3.9%, 3.1%, 1.2%), CEA(5.0%, 4.8%, 7.6%)였다. 검사 항목별 측정방법에 따른 대조 용액을 이용한 표준 곡선의 측정 간 정밀도 평가에서 두 검사 방법간에 유의한 차이가 없었다. 각 검사항목별로 20명의 환자 검체에서 측정한 측정 간 변이계수(inter-assay precision)의 평균과 표준편차 값은 batch assay로 시행했을 때 각각 3.2$\pm$1.7%, 3.9$\pm$2.1%. 7.1$\pm$6.2%, 11.2$\pm$7.2%였고 random assay로 측정하였을 때는 2.7$\pm$1.7%, 4.8$\pm$3.1%, 3.6$\pm$4.8%, 7.4$\pm$6.2였다. Batch assay와 random assay는 서로 높은 일치도를 보였다. 측정한 급내상관계수(Intraclass correlation coefficient)는 T3, fT4, PSA, CEA 각각 0.9968, 0.9973. 0.9996, 0.9901였다. Batch assay로 측정한 값과 자등분주기를 이용한 random assay로 측정한 값 사이에 상관 계수(R$^2$)는 T3, fT4, PSA, CEA 각각 0.9924, 0.9974, 0.9994, 0.9989(p<0.005)로 모두 강한 상관관계를 보였다. 결론: T3, fT4, PSA, CEA 4가지 항목의 방사면역측정 법 (Radioimmunoassay)에서 기존의 batch assay와 자동분주기를 이용한 random assay간에 일치도와 상관성이 높았다. 결론적으로 자동분주기를 이용한 random assay를 방사면역측정법 및 면역방사계수법에 적절히 이용할 수 있을 것으로 생각된다.

하지 강직 평가에 있어 NK테이블을 이용한 진자검사의 유용성 (Availability of the Pendulum Test Using NK Table for Spasticity Measurement of Low Extremity)

  • 김용욱;원종혁;김태호
    • 대한물리의학회지
    • /
    • 제8권2호
    • /
    • pp.209-217
    • /
    • 2013
  • PURPOSE: The purpose of this study was to investigate the clinical availability of the pendulum test (through reliability and validity) using a NK table attached electrogoniometer for spasticity measurement in patients with brain lesions. METHODS: Thirty-one stroke and traumatic brain injury subjects participated in the study. Intraclass correlation coefficient (ICC) was used to verify the test-retest reliability of spasticity measures of the pendulum test. Pearson's product correlation coefficient was used to examine the validity of the pendulum test through the amplitude of the deep tendon reflex (DTR) test known for objective and quantitative measure of spasticity. RESULTS: In these results, the test-retest reliability was showed significantly high correlation between pendulum tests (ICCs=.95~.97, p<.01). There were significant negative correlations between the amplitude of the DTR test and all measures of spasticity of the pendulum test(r=-.77~-.85, p<.01). CONCLUSION: Thus, it is possible to use the pendulum test using a NK table as an objective measure of spasticity, rather than other expensive equipment, which is more complicated to use. Further studies are needed to explore the therapeutic effects of spasticity using a newly designed pendulum test equipment in this study.

중환자 구강사정 도구개발 (Development of an Oral Health Assessment Tool for Critically Ill Patients)

  • 김진희;박경숙
    • 중환자간호학회지
    • /
    • 제11권3호
    • /
    • pp.12-22
    • /
    • 2018
  • Purpose : This methodological study develops an oral health assessment tool for critically ill patients. Method : From February 15 to April 30, 2014, this study was conducted to test the validity and reliability of the tool at two general hospitals and three medical and surgical intensive care units (ICUs) in Seoul, Korea. Results : The result of the intraclass correlation coefficient to test the between-observer reliability by analyzing the oral health assessment scores before and after oral nursing care showed that .93 of before oral care and .90 of after oral care. The correlation coefficient values of .68 (p<.001) and .71 (p<.001) before and after providing oral nursing care, respectively, indicated the presence of a statistically significant correlation between the tool and the criterion. Using the paired t-test, the differentiated validity of the tool was tested in patients who had developed pneumonia after entering the ICU. A statistically significant difference in scores was found between the time of entering the ICU and that of developing pneumonia (t=-8.73, p<.001), which provided evidence for the differentiated validity of the tool. Conclusions : Since the validity and reliability of the tool developed in this study were verified, this tool can be used to assess the oral health conditions of critically ill patients.

Feasibility of the Depth Camera-based Physical Health Monitoring System for Elderly Living Alone

  • Sungbae, Jo
    • Physical Therapy Rehabilitation Science
    • /
    • 제13권1호
    • /
    • pp.106-112
    • /
    • 2024
  • Objective: This study aimed to evaluate the validity of a depth camera-based system for monitoring physical function, assessing its feasibility for accurately monitoring activities of daily living. Design: A cross-sectional study. Methods: Twenty-three participants were enlisted to perform fifteen activities of daily living within a living laboratory designed to simulate a home environment. Activities were monitored using a depth camera system capable of classifying actions into standing, sitting, and lying down, with a conventional video camera employed for activity recording. The duration of each activity, as measured by the system, was compared to direct observations made by a physical therapist which were analyzed using a motion analysis software. The association between these two measurement approaches was assessed through correlation analysis, coefficient of determination, intraclass correlation coefficient (ICC), and Bland-Altman plots. Results: Our findings indicated that standing activities exhibited the highest correlation (r=0.847) between the system measurements and physical therapist observations, followed by sitting (r=0.817) and lying down (r=0.734), which demonstrated lower correlations. However, the ICC and Bland-Altman plots revealed notable variances between the two measurement methods, particularly for activities involving lying down. Conclusions: In this study, the depth camera-based physical monitoring system showed promise feasibility in distinguishing standing, sitting, and lying down activities at home environments. However, the current study also underlined some necessities of enhancements in capturing lying down activities.

Reliability of Portable Spirometry Performed in the Korea National Health and Nutrition Examination Survey Compared to Conventional Spirometry

  • Park, Hye Jung;Rhee, Chin Kook;Yoo, Kwang Ha;Park, Yong Bum
    • Tuberculosis and Respiratory Diseases
    • /
    • 제84권4호
    • /
    • pp.274-281
    • /
    • 2021
  • Background: The Korea National Health and Nutrition Examination Survey (KNHANES) is a well-designed survey to collect national data, which many researchers have used for their studies. In KNHANES, although portable spirometry was used, its reliability has not been verified. Methods: We prospectively enrolled 58 participants from four Korean institutions. The participants were classified into normal pattern, obstructive pattern, and restrictive pattern groups according to their previous spirometry results. Lung function was estimated by conventional spirometry and portable spirometry, and the results were compared. Results: The intraclass correlation coefficients of forced vital capacity (FVC) (coefficient, 9.993; 95% confidence interval [CI], 0.988-0.996), forced expiratory volume in 1 second (FEV1) (coefficient, 0.997; 95% CI, 0.995-0.998), FEV1/FVC ratio (coefficient, 0.995; 95% CI, 0.992-0.997), and forced expiratory flow at 25-75% (FEF25-75%; coefficient, 0.991; 95% CI, 0.984-0.994) were excellent (all p<0.001). In the subgroup analysis, the results of the three parameters were similar in all groups. In the overall and subgroup analyses, Pearson's correlation of all the parameters was also excellent in the total (coefficient, 0.986-0.994; p<0.001) and subgroup analyses (coefficient, 0.915-0.995; p<0.001). In the paired t-test, FVC, FEV1/FVC, and FEF25-75% estimated by the two instruments were statistically different. However, FEV1 was not significantly different. Conclusion: Lung function estimated by portable spirometry was well-correlated with that estimated by conventional spirometry. Although the values had minimal differences between them, we suggest that the spirometry results from the KNHANES are reliable.

증상 정도, 기간, 불편정도 및 회복력 기반 미병 설문지의 신뢰도 및 구성 타당도 평가 (The Evaluation of Reliability and Validity for Mibyeong Questionnaire)

  • 장은수;윤지현;이영섭
    • 대한한의진단학회지
    • /
    • 제21권1호
    • /
    • pp.13-25
    • /
    • 2017
  • Objectives The purpose of this study was to evaluate the reliability and the validity of Mibyeong Questionnaire (MQ). The subjects enrolled in this study was 165 from July 2015 to Jan. 2016. The surveys were conducted twice with 3 month terms. Methods The Cronbach's ${\alpha}$ analysis for internal reliability, Pearson Correlation Coefficient analysis for test-retest reliability, Factor analysis with varimax rotation for construct validity, Kappa analysis for diagnostic reliability were used. The significant p-value was less than 0.05. Results and Conclusions The result showed that the Cronbach's ${\alpha}$ of MQ was .857-.937 and total was .913. The reliabilities between test and retest for the MQ were .666-.832 (0.416-0.673, in case of including recovery question) in intraclass correlation coefficient (ICC). The Kappa of recovery question in each item was ranged 0.23(80.6% in agreement rate) to .46(87.9% in agreement rate). In test-retest the Kappa value of Mibyeong diagnosis referred by median value was .418(71% in agreement rate). This study revealed that MQ is a reliable and valid questionnaire.

Reliability and Validity of Korean-Version of Information Needs in Cardiac Rehabilitation Scale

  • Choi, Sang Young Heon;Kim, Joong Hwi
    • The Journal of Korean Physical Therapy
    • /
    • 제34권5호
    • /
    • pp.234-241
    • /
    • 2022
  • Purpose: The Cardiac Rehabilitation scale (INCR scale) is a verified measure worldwide. The scale measures the extent to which cardiac rehabilitation meets the various needs of the participating patients and determines how education related to heart disease and rehabilitation satisfies their preferences. The current study applied the INCR scale to verify and develop it for use in Korea by conforming to Korean culture and language. Methods: The Korean version of the INCR scale was created after a six-step process in accordance with the international questionnaire translation law. The Korean version of the INCR scale was assessed in 45 cardiac rehabilitation patients (29 males, 16 females). Internal consistency was verified using Cronbach's alpha. Test-re-test reliability and interrater reliability were verified using the intraclass correlation coefficient (ICC). Content validity was selected to verify the validity. Results: The content validity index of the Korean version of the INCR scale was high, with an average of 0.93. Cronbach's Alpha for Internal consistency also revealed high reliability of 0.89 in all 10 categories. The interclass correlation coefficient of the test-re-test and interrater reliability scores were 0.95 and 0.81, respectively. Conclusion: Our results indicate that the Korean version of the INCR scale would be instrumental in the clinical setting to determine the knowledge, educational needs, and preferences of patients participating in cardiovascular disease and cardiac rehabilitation.