• Title/Summary/Keyword: Intraclass Correlation

Search Result 331, Processing Time 0.029 seconds

In vitro evaluation of color and translucency reproduction of maxillofacial prostheses using a computerized system

  • Nemli, Secil Karakoca;Gungor, Merve Bankoglu;Bagkur, Meral;Bal, Bilge Turhan;Arici, Yeliz Kasko
    • The Journal of Advanced Prosthodontics
    • /
    • v.10 no.6
    • /
    • pp.422-429
    • /
    • 2018
  • PURPOSE. Accurate color matching of maxillofacial prostheses to skin is important for esthetics. A computerized color matching system specific to human skin has recently been developed. The purpose of this study was to evaluate the accuracy in color and translucency matching of the computerized color matching system across different skin colors. MATERIALS AND METHODS. The silicone was colored to simulate 28 different skin colors (n=5) to serve as "target skin colors". Using a spectrocolorometer (e-skin), color codes were determined for "replicate skin color" fabrication. CIELAB Delta-E between target skin color-replicate skin color pairs and translucency parameter were calculated. CIELAB Delta-E values were compared with one-way ANOVA and Tukey multiple-comparison. The agreement between $L^*$, $a^*$, $b^*$ and translucency parameter of target skin colors and replicate skin color were calculated by a two-way mixed average measures intraclass correlation coefficient. Translucency parameter of target skin color- replicate skin color pairs were compared with Paired t-test (${\alpha}=.05$). RESULTS. The mean CIELAB Delta-E value was 3.83 and significant differences were found among colors. The intraclass correlation coefficient showed excellent reliability for $L^*$, $a^*$, $b^*$ and good reliability for translucency parameter (P<.001). The mean translucency parameter of replicate skin colors was significantly higher than that of translucency parameter. CONCLUSION. The computerized color matching system specific to human skin was found to be reliable in terms of color and translucency between target skin colors and replicate skin color.

Reliability Analysis and Improvement Plan for Evaluation of Program Outcomes among Demand-driven Raters (프로그램 학습성과 평가에 대한 수요지향 평가자 간 신뢰도 분석 및 개선 방안)

  • Lee, Youngho;Shin, Younghak;Kim, Jonghwa
    • The Journal of the Korea Contents Association
    • /
    • v.21 no.3
    • /
    • pp.410-418
    • /
    • 2021
  • In a program that runs an engineering education certification, program outcomes refer to the knowledge, skills, and attitudes a student must have until graduation. In general, capstone design is used as a tool for evaluating program outcomes. This paper applies the intraclass correlation coefficient (ICC) to measure the raters' reliability in assessing program outcomes. Several raters evaluate program outcomes, and the result is used to obtain the raters' ICC. ICC measures the reliability of ratings or measurements for clusters - data that has been collected as groups or sorted into groups. If the ICC is close to 1, it means that the reliability among the raters is high. We evaluated the proposed method's usefulness through case analysis. As a method for assessing an evaluation tool's objectivity, multiple raters measure the same evaluation tool. As a result, we measured the ICC values for all POs, and analyzed the cause for the low measured POs. We applied this method to evaluate program outcomes of the Department of Computer Engineering in the past two years. As a result, we derived guidelines for improvement and program outcomes.

A comparative study to measure the sagittal condylar inclination using mechanical articulator, virtual articulator and jaw tracking device

  • Liya Ma;Fei Liu;Jiansong Mei;Jiarui Chao;Zhenyu Wang;Jiefei Shen
    • The Journal of Advanced Prosthodontics
    • /
    • v.15 no.1
    • /
    • pp.11-21
    • /
    • 2023
  • PURPOSE. To compare the sagittal condylar inclination (SCI) in dentate individuals measured by the different methods with mechanical articulator (MA), virtual articulator (VA), and a jaw tracking device (JTD) system. MATERIALS AND METHODS. A total of 22 healthy dentate participants were enrolled in this study. For MA workflow, the SCI was obtained by a semi-adjustable articulator with protrusive interocclusal records. The SCI was also set on a VA by aligning intraoral scan (IOS) with cone beam computed tomography (CBCT) and facial scan (FS), respectively. These virtual workflows were conducted in a dental design software, namely VAIOS-CBCT and VAIOS-FS. Meanwhile, a JTD system was also utilized to perform the measurement. Intraclass correlation was used to assess the repeatability within workflows. The bilateral SCI values were compared by Wilcoxon matched-pairs signed rank test for each workflow, and Kruskal-Wallis test and post hoc p-value Bonferroni correction were used to compare the differences among four workflows. The agreement of VAIOS-CBCT, VAIOS-FS, and JTD compared with MA was evaluated by Bland-Altman analysis. RESULTS. Intraclass correlation of the SCI revealed a high degree of repeatability for each workflow. There were no significant differences between the left and right sides (P > .05), except for VAIOS-CBCT (P = .028). Significant differences were not found between MA and VAIOS-FS (P > .05). Bland-Altman plots indicated VAIOS-CBCT, VAIOS-FS, and JTD were considered to substitute MA with high 95% limits of agreement. CONCLUSION. The workflow of VAIOS-FS provided an alternative approach to measure the SCI compared with MA.

The Reliability and Validity of Hip Range of Motion Measurement using a Smart phone Operative Patient (엉덩관절 수술 환자에서 스마트폰을 이용한 관절가동범위 측정의 신뢰도 및 타당도 연구)

  • Park, Sun-Wook;Kim, Myoung-Soo;Bae, Hyo-Sun;Cha, Yong-Ho
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.10 no.2
    • /
    • pp.1-7
    • /
    • 2015
  • PURPOSE: The aims of this study were to assess the intra-tester and inter-tester reliability and validity of hip range of motion using a smart phone in hip operative patients. METHODS: Twenty-five patients (eight total hip arthroplasty and seventeen femur neck fracture) participated in this study. The range of motions in active and passive hip flexion, abduction and external rotation were measured with a goniometer and smart phone over two times by two observers. The intra-tester and inter-tester reliability were evaluated using the intraclass correlation coefficient (ICC2,1). The validity was measured by Pearson's correlation coefficient RESULTS: The intra-observer reliability was good in all measured items (ICC>0.78). The inter-observer reliability was high with ICC (>0.90). All correlation coefficients of smart phone and goniometer was greater than 0.85 and showed a significant positive correlation (p<0.01). CONCLUSION: The range of motion measurement with a smart phone showed acceptable reliability. Therefore, it could be convenient and have economical benefits to measure the range of motion of the hip joint using a smart phone.

Reliability and validity of free software for the analysis of locomotor activity in mice

  • Hong, Yoo Rha;Moon, Eunsoo
    • Journal of Yeungnam Medical Science
    • /
    • v.35 no.1
    • /
    • pp.63-69
    • /
    • 2018
  • Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

Reliability Test for Winged Scapula and Correlation between Winged Scapula and Scapular Stability in Patients with Subacromial Impingement Syndrome (봉우리밑충돌증후군 환자의 날개 어깨뼈 평가에 대한 신뢰도 검사 및 날개 어깨뼈와 어깨뼈 안정성에 대한 상관성 연구)

  • Kim, Young-Hoon;Kim, Tae-Gyu;Kim, Soo-Yong
    • PNF and Movement
    • /
    • v.20 no.3
    • /
    • pp.399-408
    • /
    • 2022
  • Purpose: This study investigated the differences in winged scapula between the symptomatic side and asymptomatic side, the reliability of the winged scapula test, and the correlation between winged scapula and the stability of the scapula in patients with subacromial impingement syndrome. Methods: Twenty-four patients with unilateral subacromial impingement syndrome participated in this study. Winged scapula was compared between the symptomatic and asymptomatic sides using a scapulometer. The reliability of the scapulometer was assessed by calculating the intraclass correlation coefficient (ICC), standard error of measurement (SEM), and minimal clinically important difference (MCID). The correlation between winged scapula and the results of the upper quarter Y-balance test were also obtained. Conclusion: Winged scapula was significantly greater on the symptomatic side compared with the asymptomatic side (p < 0.05). High to excellent ICCs were obtained for the winged scapula test, and SEM and MCID values were obtained for winged scapula (SEM: 0.2-0.3 cm, MCID: 0.6-0.8 cm); however, winged scapula and the results of the upper quarter Y-balance test were not correlated. Conclusion: The scapulometer is useful for measuring winged scapula in patients with subacromial impingement syndrome.

Reliability and Validity of the Korean Version of Patient-Rated Tennis Elbow Evaluation (한국어판 환자 평정 주관절 외측상과염 평가서의 신뢰도와 타당도)

  • Lee, Dong-Rour;Kim, Jong-Soon
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.9 no.1
    • /
    • pp.25-33
    • /
    • 2014
  • PURPOSE: The purpose of this was to translate Patient-Rated Tennis Elbow Evaluation(PRTEE) into Korean and identify the reliability and validity of a Korean version of PRTEE. METHODS: The subjects of this study were 32 patients diagnosed with lateral epicondylitis. The subjects were surveyed using a Korean version of PRTEE three times: at the first visit, one week after, and two weeks after. This questionnaire consisted of 15 questions including 5 questions about pain and 10 questions about functions. Intraclass correlation coefficients were used to measure reliability and Cronbach's alpha coefficients were used to assess internal consistency. In addition, the validity of the survey results was examined by correlating a visual analogue scale with the outcome of holding without pain. RESULTS: Test-retest reliability of Korea version PRTEE was good total ICC= .962 (CI=.922-,982). Cronbach's alpha value for PRTEE was found to be .955 and it was statistically significant (p<.05). The positive correlation between PRTEE and VAS was moderate to high (r=.753, P=.00) and statistically significant. There was also a low significant negative correlation between PRTEE and PFG (r=-.362, P=.042). CONCLUSION: The Korean version of PRTEE had reliability and validity. Therefore, it is a useful measure to evaluate the conditions of patients with lateral epicondylitis.

Availability of the Pendulum Test Using NK Table for Spasticity Measurement of Low Extremity (하지 강직 평가에 있어 NK테이블을 이용한 진자검사의 유용성)

  • Kim, Yong-Wook;Weon, Jong-Hyuck;Kim, Tae-Ho
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.8 no.2
    • /
    • pp.209-217
    • /
    • 2013
  • PURPOSE: The purpose of this study was to investigate the clinical availability of the pendulum test (through reliability and validity) using a NK table attached electrogoniometer for spasticity measurement in patients with brain lesions. METHODS: Thirty-one stroke and traumatic brain injury subjects participated in the study. Intraclass correlation coefficient (ICC) was used to verify the test-retest reliability of spasticity measures of the pendulum test. Pearson's product correlation coefficient was used to examine the validity of the pendulum test through the amplitude of the deep tendon reflex (DTR) test known for objective and quantitative measure of spasticity. RESULTS: In these results, the test-retest reliability was showed significantly high correlation between pendulum tests (ICCs=.95~.97, p<.01). There were significant negative correlations between the amplitude of the DTR test and all measures of spasticity of the pendulum test(r=-.77~-.85, p<.01). CONCLUSION: Thus, it is possible to use the pendulum test using a NK table as an objective measure of spasticity, rather than other expensive equipment, which is more complicated to use. Further studies are needed to explore the therapeutic effects of spasticity using a newly designed pendulum test equipment in this study.

Development of an Oral Health Assessment Tool for Critically Ill Patients (중환자 구강사정 도구개발)

  • Kim, Jin Hee;Park, Kyungsook
    • Journal of Korean Critical Care Nursing
    • /
    • v.11 no.3
    • /
    • pp.12-22
    • /
    • 2018
  • Purpose : This methodological study develops an oral health assessment tool for critically ill patients. Method : From February 15 to April 30, 2014, this study was conducted to test the validity and reliability of the tool at two general hospitals and three medical and surgical intensive care units (ICUs) in Seoul, Korea. Results : The result of the intraclass correlation coefficient to test the between-observer reliability by analyzing the oral health assessment scores before and after oral nursing care showed that .93 of before oral care and .90 of after oral care. The correlation coefficient values of .68 (p<.001) and .71 (p<.001) before and after providing oral nursing care, respectively, indicated the presence of a statistically significant correlation between the tool and the criterion. Using the paired t-test, the differentiated validity of the tool was tested in patients who had developed pneumonia after entering the ICU. A statistically significant difference in scores was found between the time of entering the ICU and that of developing pneumonia (t=-8.73, p<.001), which provided evidence for the differentiated validity of the tool. Conclusions : Since the validity and reliability of the tool developed in this study were verified, this tool can be used to assess the oral health conditions of critically ill patients.

Soft Tissue Measurement Method Using Radiopaque Material on Cone-beam Computed Tomography: An Ex Vivo Validation Study

  • Lee, Hae-Seok;Yun, Jeong-Ho;Lee, Dong-Won
    • Implantology
    • /
    • v.22 no.4
    • /
    • pp.210-218
    • /
    • 2018
  • Purpose: The purpose of this study was to investigate the validity and reproducibility of a method based on cone-beam computed tomography (CBCT) technology for the visualization and measurement of gingival soft-tissue dimensions. Material and Methods: A total of 66 selected points in soft-tissue of the ex vivo head of an adult pig were investigated in this study. For the measurement of radiographic thickness (RT), wet soft-tissue surfaces were lightly covered with barium sulfate powder using a powder spray. CBCT was taken and DICOM files were assessed for soft-tissue thickness measurement at reference points. A periodontal probe and a rubber stop were used for the measurement of trans-gingival probing thickness (TPT). After flap elevation, actual thickness of soft-tissue (actual thickness, AT) was measured. Correlation analysis and intraclass correlation coefficients analysis (ICC) were performed for AT, TPT, and RT. Results: All variables were distributed normally. Strong significant correlations of AT with RT and TPT values were found. The two ICC values between TPT vs. AT and RT vs. AT differed significantly. Conclusion: Our results indicated that correlation of RT was stronger than that of TPT with AT. We concluded that soft tissue measurement with CBCT could be a reliable method, compared to the trans-gingival probing measurement method.