• Imaging Science in Dentistry
• /
• v.30 no.3
• /
• pp.155-158
• /
• 2000

The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

• International Journal of Highway Engineering
• /
• v.20 no.2
• /
• pp.35-44
• /
• 2018

PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

• Journal of Information Processing Systems
• /
• v.8 no.2
• /
• pp.241-262
• /
• 2012

An understanding of quality attributes is relevant for the software organization to deliver high software reliability. An empirical assessment of metrics to predict the quality attributes is essential in order to gain insight about the quality of software in the early phases of software development and to ensure corrective actions. In this paper, we predict a model to estimate fault proneness using Object Oriented CK metrics and QMOOD metrics. We apply one statistical method and six machine learning methods to predict the models. The proposed models are validated using dataset collected from Open Source software. The results are analyzed using Area Under the Curve (AUC) obtained from Receiver Operating Characteristics (ROC) analysis. The results show that the model predicted using the random forest and bagging methods outperformed all the other models. Hence, based on these results it is reasonable to claim that quality models have a significant relevance with Object Oriented metrics and that machine learning methods have a comparable performance with statistical methods.

• Journal of Korean Academy of Nursing
• /
• v.42 no.6
• /
• pp.853-860
• /
• 2012

Purpose: The purposes of this study were to develop a Minimal Insomnia Screening Scale for Korean adults (KMISS) and to evaluate psychometric properties and discriminant ability of the developed scale. Methods: Data from a cross-sectional survey of 959 Korean adults were analyzed to develop the summated insomnia scale, which was evaluated in terms of reliability, validity, and discriminant ability by receiver operating characteristics (ROC) curve analysis. Results: Item-total correlations ranged between .71-.79 and Cronbach's ${\alpha}$ was .87. Adequate validity was also evident. ROC-curve analysis showed area under ROC was .87 (95% CI: .84-.90) and identified the optimal cut-off score as ${\leq}20$ (sensitivity, .83; specificity, .75; positive/negative predictive values, .40/.95). Using this cut-off score, the prevalence of insomnia in the study sample was 26.3% and most frequent among women and the oldest group. Conclusion: Data supports the psychometric properties of KMISS as a possible insomnia screening instrument. KMISS also shows promise as a convenient ultra-short screening measure of insomnia for adults and epidemiological studies in community health care settings.

• Journal of Korean Public Health Nursing
• /
• v.32 no.2
• /
• pp.304-318
• /
• 2018

Purpose: This study examined the characteristic of the Injury Severity Score (ISS) of Korean geriatric patients with a traumatic injury in a nationally representative sample to determine the optimal cutoff of ISS of mortality according to age. Methods: The subjects were 3,018 non-elderly patients and 1,584 elderly patients with an ISS and Korean Triage and Acuity Scale (KTAS) in 2016 from the data of the Health Insurance Review and Assessment Service. The traumatic characteristics of the elderly and non-elderly were compared by stratifying the ISS. Receiver Operating Characteristic (ROC) curve analysis was used to find the optimal cutoff of ISS of mortality according to age. Results: The elderly were more prone to severe trauma than the non-elderly were. The distribution of KTAS grades was lower, even though the severity of ISS was as high as that of the non-elderly. The optimal cutoff score of the ISS for mortality in the ROC curve was lower in elderly over 65 years than in the other age group. Conclusion: The elderly are more prone to severe trauma and death than non-elderly, even though their ISS is low. Therefore, a strategy to prevent elderly from experiencing serious trauma and managing their geriatric trauma actively is needed.

• Journal of Korean Academy of Nursing
• /
• v.41 no.6
• /
• pp.758-767
• /
• 2011

Purpose: This study was done to examine the threshold value of estimated height loss at which the risk of osteoporosis increases and to verify its discriminative ability in the detection of osteoporosis. Methods: It was conducted based on epidemiological descriptive methods on 732 Korean women at a public healthcare center in Seoul between July and November 2010. ANOVA, Pearson correlation, logistic regression analysis and receiver operating characteristics (ROC) curve were used for data analysis. Results: There was an age-related correlation between bone mineral density (lumbar spine: F=37.88, p<.001; femur: F=54.27, p<.001) and estimated height loss (F=27.68, p<.001). Estimated height loss increased significantly with decreasing bone mineral density (lumbar spine: r=-.23, p<.001; femur: r=-.34, p<.001). The odds ratio for the point at which the estimated height loss affects the occurrence of osteoporosis was found to increase at a cut-off value of 2 cm and the area under ROC curve was .71 and .82 in lumbar spine and femur, respectively. Conclusion: The optimal cut-off value of the estimated height loss for detection of osteoporosis was 2 cm. Height loss is therefore a useful indicator for the self-assessment and prognosis of osteoporosis.

• The Korean Journal of Rehabilitation Nursing
• /
• v.17 no.1
• /
• pp.10-17
• /
• 2014

Purpose: The Leeds Sleep Evaluation Questionnaire (LSEQ) translated into Korean was modified to easily apply and reduce respondents' confusion and was evaluated for psychometric properties and discriminant ability. Methods: A total of 960 Korean adults aged 45 years and older participated in this cross-sectional survey. To test reliability, validity and discriminant ability, Cronbach's alpha, correlation analysis, confirmatory factor analysis, simple regression analysis and receiver operating characteristics (ROC) curve analysis were used. Results: Item-total correlations ranged between 62~.85 and Cronbach's alpha was .95. Area under ROC was .86 (95% CI: .83~.90) and the optimal cutoff score was identified as ${\leq}$ 66 (sensitivity, .77; specificity, .84; positive/negative predictive values, .49/.95). Using this cutoff score, the prevalence of insomnia in the study sample was 25.8% and tended to be more common in female and older groups. Conclusion: The data supported the psychometric properties of Korean Modified Leeds Sleep Evaluation Questionnaire (KMLSEQ) as an acceptable sleep measurement. In addition, KMLSEQ is likely to be a useful screening tool for insomnia.

• Journal of Korean Clinical Nursing Research
• /
• v.26 no.2
• /
• pp.254-264
• /
• 2020

Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

• Atmosphere
• /
• v.33 no.5
• /
• pp.519-530
• /
• 2023

Deep convection can make adverse effects on safe and efficient aviation operations by causing various weather hazards such as convectively-induced turbulence, icing, lightning, and downburst. To prevent such damage, it is necessary to accurately predict spatiotemporal distribution of deep convective area near the airport and airspace. This study developed a new index, the Aviation Convective Index (ACI), for deep convection, using the operational global Unified Model of the Korea Meteorological Administration. The ACI was computed from combination of three different variables: 3-hour maximum of Convective Available Potential Energy, averaged Outgoing Longwave Radiation, and accumulative precipitation using the fuzzy logic algorithm. In this algorithm, the individual membership function was newly developed following the cumulative distribution function for each variable in Korean Peninsula. This index was validated and optimized by using the 1-yr period of radar mosaic data. According to the Receiver Operating Characteristics curve (AUC) and True Skill Score (TSS), the yearly optimized ACI (ACI_YrOpt) based on the optimal weighting coefficients for 1-yr period shows a better skill than the no optimized one (ACI_NoOpt) with the uniform weights. In all forecast time from 6-hour to 48-hour, the AUC and TSS value of ACI_YrOpt were higher than those of ACI_NoOpt, showing the improvement of averaged value of AUC and TSS by 1.67% and 4.20%, respectively.

• Communications for Statistical Applications and Methods
• /
• v.30 no.1
• /
• pp.21-35
• /
• 2023

Metabolic syndrome is a serious disease that can eventually lead to various complications, such as stroke and cardiovascular disease. In this study, we aimed to identify the risk factors related to metabolic syndrome for its prevention and recognition and propose a nomogram that visualizes and predicts the probability of the incidence of metabolic syndrome. We conducted an analysis using data from the Korea National Health and Nutrition Survey (KNHANES VII) and identified 10 risk factors affecting metabolic syndrome by using the Rao-Scott chi-squared test, considering the characteristics of the complex sample. A naïve Bayesian classifier was used to build a nomogram for metabolic syndrome. We then predicted the incidence of metabolic syndrome using the nomogram. Finally, we verified the nomogram using a receiver operating characteristic curve and a calibration plot.