• International Journal of Contents
• /
• v.10 no.1
• /
• pp.23-28
• /
• 2014

When developing a classifier using various objective functions, it is important to compare the performances of the classifiers. Although there are statistical analyses of objective functions for classifiers, simulation results can provide us with direct comparison results and in this case, a comparison criterion is considerably critical. A Receiver Operating Characteristics (ROC) graph is a simulation technique for comparing classifiers and selecting a better one based on a performance. In this paper, we adopt the ROC graph to compare classifiers trained by mean-squared error, cross-entropy error, classification figure of merit, and the n-th order extension of cross-entropy error functions. After the training of feed-forward neural networks using the CEDAR database, the ROC graphs are plotted to help us identify which objective function is better.

• Imaging Science in Dentistry
• /
• v.30 no.3
• /
• pp.155-158
• /
• 2000

The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• v.34 no.1
• /
• pp.40-50
• /
• 2023

Objectives: This study examined the validity of the Childhood Autism Rating Scale, Second Edition (CARS-2) compared with the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) in identifying autism spectrum disorder (ASD). Methods: A total of 237 children were tested using both the CARS-2 and ADOS-2. We examined the correlation using Pearson's correlation analysis. In addition, we used a receiver operating characteristic graph to determine the optimal standard version of the CARS-2 (CARS2-ST) cutoff score for ASD diagnosis using the ADOS-2. Results: The concurrent validity of the CARS2-ST was demonstrated by a significant correlation with the ADOS-2 (r=0.864, p<0.001). The optimal CARS2-ST cutoff scores were 30 and 28.5 for identifying autism and autism spectrum, respectively, based on the ADOS-2. Conclusion: We suggest a newly derived CARS2-ST cutoff score of 28.5 for screening ASD and providing early intervention.

• Korean Journal of Radiology
• /
• v.23 no.10
• /
• pp.986-997
• /
• 2022

Objective: Whether metabolic redistribution occurs in patients with white matter hyperintensities (WMHs) on magnetic resonance imaging (MRI) is unknown. This study aimed 1) to propose a measure of the brain metabolic network for an individual patient and preliminarily apply it to identify impaired metabolic networks in patients with WMHs, and 2) to explore the clinical and imaging features of metabolic redistribution in patients with WMHs. Materials and Methods: This study included 50 patients with WMHs and 70 healthy controls (HCs) who underwent ¹⁸F-fluorodeoxyglucose-positron emission tomography/MRI. Various global property parameters according to graph theory and an individual parameter of brain metabolic network called "individual contribution index" were obtained. Parameter values were compared between the WMH and HC groups. The performance of the parameters in discriminating between the two groups was assessed using the area under the receiver operating characteristic curve (AUC). The correlation between the individual contribution index and Fazekas score was assessed, and the interaction between age and individual contribution index was determined. A generalized linear model was fitted with the individual contribution index as the dependent variable and the mean standardized uptake value (SUV_mean) of nodes in the whole-brain network or seven classic functional networks as independent variables to determine their association. Results: The means ± standard deviations of the individual contribution index were (0.697 ± 10.9) × 10^-3 and (0.0967 ± 0.0545) × 10^-3 in the WMH and HC groups, respectively (p < 0.001). The AUC of the individual contribution index was 0.864 (95% confidence interval, 0.785-0.943). A positive correlation was identified between the individual contribution index and the Fazekas scores in patients with WMHs (r = 0.57, p < 0.001). Age and individual contribution index demonstrated a significant interaction effect on the Fazekas score. A significant direct association was observed between the individual contribution index and the SUV_mean of the limbic network (p < 0.001). Conclusion: The individual contribution index may demonstrate the redistribution of the brain metabolic network in patients with WMHs.