• International Journal of Contents
• /
• v.10 no.1
• /
• pp.23-28
• /
• 2014

When developing a classifier using various objective functions, it is important to compare the performances of the classifiers. Although there are statistical analyses of objective functions for classifiers, simulation results can provide us with direct comparison results and in this case, a comparison criterion is considerably critical. A Receiver Operating Characteristics (ROC) graph is a simulation technique for comparing classifiers and selecting a better one based on a performance. In this paper, we adopt the ROC graph to compare classifiers trained by mean-squared error, cross-entropy error, classification figure of merit, and the n-th order extension of cross-entropy error functions. After the training of feed-forward neural networks using the CEDAR database, the ROC graphs are plotted to help us identify which objective function is better.

• Imaging Science in Dentistry
• /
• v.30 no.3
• /
• pp.155-158
• /
• 2000

The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

• Journal of the Korean Academy of Child and Adolescent Psychiatry
• /
• v.34 no.1
• /
• pp.40-50
• /
• 2023

Objectives: This study examined the validity of the Childhood Autism Rating Scale, Second Edition (CARS-2) compared with the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) in identifying autism spectrum disorder (ASD). Methods: A total of 237 children were tested using both the CARS-2 and ADOS-2. We examined the correlation using Pearson's correlation analysis. In addition, we used a receiver operating characteristic graph to determine the optimal standard version of the CARS-2 (CARS2-ST) cutoff score for ASD diagnosis using the ADOS-2. Results: The concurrent validity of the CARS2-ST was demonstrated by a significant correlation with the ADOS-2 (r=0.864, p<0.001). The optimal CARS2-ST cutoff scores were 30 and 28.5 for identifying autism and autism spectrum, respectively, based on the ADOS-2. Conclusion: We suggest a newly derived CARS2-ST cutoff score of 28.5 for screening ASD and providing early intervention.