Browse > Article
http://dx.doi.org/10.17555/jvc.2016.04.33.2.97

Application of Receiver Operating Characteristic (ROC) Curve for Evaluation of Diagnostic Test Performance  

Pak, Son-Il (College of Veterinary Medicine and Institute of Veterinary Science, Kangwon National University)
Oh, Tae-Ho (College of Veterinary Medicine, Kyungpook National University)
Publication Information
Journal of Veterinary Clinics / v.33, no.2, 2016 , pp. 97-101 More about this Journal
Abstract
In the field of clinical medicine, diagnostic accuracy studies refer to the degree of agreement between the index test and the reference standard for the discriminatory ability to identify a target disorder of interest in a patient. The receiver operating characteristic (ROC) curve offers a graphical display the trade-off between sensitivity and specificity at each cutoff for a diagnostic test and is useful in assigning the best cutoff for clinical use. In this end, the ROC curve analysis is a useful tool for estimating and comparing the accuracy of competing diagnostic tests. This paper reviews briefly the measures of diagnostic accuracy such as sensitivity, specificity, and area under the ROC curve (AUC) that is a summary measure for diagnostic accuracy across the spectrum of test results. In addition, the methods of creating an ROC curve in single diagnostic test with five-category discrete scale for disease classification from healthy individuals, meaningful interpretation of the AUC, and the applications of ROC methodology in clinical medicine to determine the optimal cutoff values have been discussed using a hypothetical example as an illustration.
Keywords
receiver operating characteristic curve (ROC); diagnostic test performance; accuracy;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240: 1285-1293.   DOI
2 Wan S, Zhang B. Smooth semiparametric receiver operating characteristic curves for continuous diagnostic tests. Stat Med 2007; 26: 2565-2586.   DOI
3 Yang ZH, Li L, Pan ZS. Development of multiple ELISAs for the detection of antibodies against classical swine fever virus in pig sera. Virol Sin 2012; 27: 48-56.   DOI
4 Zhou XH, Li CM, Yang Z. Improving interval estimation of binomial proportions. Philos Trans A Math Phys Eng Sci 2008; 366: 2405-2418.   DOI
5 Zou KH, Hall WJ, Shapiro DE. Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests. Stat Med 1997; 16: 2143-2156.   DOI
6 Zou KH, O'Malley AJ, Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation 2007; 115: 654-657.   DOI
7 Denis-Robichaud J, Dubuc J, Lefebvre D, DesCteaux L. Accuracy of milk ketone bodies from flow-injection analysis for the diagnosis of hyperketonemia in dairy cows. J Dairy Sci 2014; 97: 3364-3370.   DOI
8 Doi K. Diagnostic imaging over the last 50 years: research and development in medical imaging science and technology. Phys Med Biol 2006; 51: R5-27.   DOI
9 Eng J. Receiver operating characteristic analysis: a primer. Acad Radiol 2005; 12: 909-916.   DOI
10 Enachescu V, Ionita M, Mitrea IL. Comparative study for the detection of antibodies to Neospora caninum in milk and sera in dairy cattle in southern Romania. Acta Parasitol 2014; 59: 5-10.
11 Faraggi D, Reiser B. Estimation of the area under the ROC curve. Stat Med 2002; 21: 3093-3106.   DOI
12 Hajian-Tilaki K. Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian J Intern Med 2013; 4: 627-635.
13 Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L. The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inform 2005; 38: 404-415.   DOI
14 Li J, Jiang B, Fine JP. Multicategory reclassification statistics for assessing improvements in diagnostic accuracy. Biostatistics 2013; 14: 382-394.   DOI
15 Lusted LB. Logical analysis in roentgen diagnosis. Radiology 1960; 74: 178-193.   DOI
16 Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978; 8: 283-298.   DOI
17 Obuchowski NA. ROC analysis. AJR Am J Roentgenol 2005; 184: 364-372.   DOI
18 Swets JA. Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986; 99: 181-198.   DOI
19 Burfeind O, Sannmann I, Voigtsberger R, Heuwieser W. Receiver operating characteristic curve analysis to determine the diagnostic performance of serum haptoglobin concentration for the diagnosis of acute puerperal metritis in dairy cows. Anim Reprod Sci 2014; 149: 145-151.   DOI
20 Collinson P. Of bombers, radiologists, and cardiologists: time to ROC. Heart 1998; 80: 215-217.   DOI
21 Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 1993; 39: 561-577.