Browse > Article
http://dx.doi.org/10.29220/CSAM.2021.28.2.161

TPR-TNR plot for confusion matrix  

Hong, Chong Sun (Department of Statistics, Sungkyunkwan University)
Oh, Tae Gyu (Department of Statistics, Sungkyunkwan University)
Publication Information
Communications for Statistical Applications and Methods / v.28, no.2, 2021 , pp. 161-169 More about this Journal
Abstract
The two-dimensional confusion matrix used in credit assessment, biostatistics, and many other fields consists of true positive, true negative, false positive, and false negative. Their rates, such as the true positive rate (TPR), true negative rate (TNR), false positive rate, and false negative rate, can be applied to measure its accuracy. In this study, we propose the TPR-TNR plot, a graphical method that can geometrically describe and explain these rates based on the confusion matrix. The proposed TPR-TNR plot consists of two right-angled triangles. We obtain that the TPR and TNR describe the acute angles of right-angled triangles in the plot. These acute angles can be used to determine optimal thresholds corresponding to lots of accuracy measures.
Keywords
accuracy; confusion; triangle; threshold;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Hong CS and Yoo HS (2011). Optimal criterion of classification accuracy measures for normal mixture, Communications for Statistical Applications and Methods, 18, 343-355.   DOI
2 Perkins NJ and Schisterman EF (2006). The inconsistency of "optimal" cutpoints obtained using two criteria based on the receiver operating characteristic curve, American Journal of Epidemiology, 163, 670-675.   DOI
3 Provost F and Fawcett T (2001). Robust classification for imprecise environments, Machine Learning, 42, 203-231.   DOI
4 Swets JA (1988). Measuring the accuracy of diagnostic systems, Science, 240, 1285-1293.   DOI
5 Youden WJ (1950). Index for rating diagnostic tests, Cancer, 3, 32-35.   DOI
6 Cho MH and Hong CS (2015). Two optimal threshold criteria for ROC analysis, The Korean Data & Information Science Society, 26, 255-260.   DOI
7 Brasil P (2010). Diagnostic test accuracy evaluation for medical professionals, Package DiagnosisMed in R.
8 Hanley JA and McNeil BJ (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology, 143, 29-36.   DOI
9 Metz CE and Kronman HB (1980). Statistical significance tests for binormal ROC curves, Journal of Mathematical Psychology, 22, 218-243.   DOI
10 Altman DG and Bland JM (1994). Diagnostic tests. 1: Sensitivity and specificity, BMJ: British Medical Journal, 308, 1552.   DOI
11 Centor RM (1991). Signal detectability: the use of ROC curves and their analyses, Medical Decision Making, 11, 102-106.   DOI
12 Connell FA and Koepsell TD (1985). Measures of gain in certainty from a diagnostic test, American Journal of Epidemiology, 121, 744-753.   DOI
13 Green DM and Swets JA (1966). Signal Detection Theory and Psychophysics (Vol. 1), Wiley, New York.
14 Vuk M and Curk T (2006). ROC curve, lift chart and calibration plot, Metodoloski Zvezki, 3, 89-108.
15 Zweig MH and Campbell G (1993). Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine, Clinical Chemistry, 39, 561-577.   DOI
16 Egan JP and Egan JP (1975). Signal Detection Theory and ROC-Analysis, Academic Press, New York.
17 Fawcett T (2004). ROC graphs: Notes and practical considerations for researchers, Machine Learning, 31, 1-38.
18 Fawcett T (2006). An introduction to ROC analysis, Pattern Recognition Letters, 27, 861-874.   DOI
19 Hong CS, Joo JS, and Choi JS (2010). Optimal thresholds from mixture distributions, The Korean Journal of Applied Statistics, 23, 13-28.   DOI
20 Hong CS and Lee SJ (2018). TROC curve and accuracy measures, The Korean Data & Information Science Society, 29, 861-872.   DOI
21 Hsieh F and Turnbull BW (1996). Nonparametric and semiparametric estimation of the receiver operating characteristic curve, The Annals of Statistics, 24, 25-40.
22 Krzanowski WJ and Hand DJ (2009). ROC Curves for Continuous Data, CRC Press, Boston.
23 Moses LE, Shapiro D, and Littenberg B (1993). Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations, Statistics in Medicine, 12, 1293-1316.   DOI
24 Provost F and Fawcett T (1997). Analysis and visualization of classifier performance with nonuniform class and cost distributions. In Proceedings of AAAI-97 Workshop on AI Approaches to Fraud Detection & Risk Management, 57-63.
25 Pepe MS (2003). The Statistical Evaluation of Medical Tests for Classification and Prediction, Oxford University Press, Oxford.
26 Perkins NJ and Schisterman EF (2005). The Youden Index and the optimal cut-point corrected for measurement error, Biometrical Journal: Journal of Mathematical Methods in Biosciences, 47, 428-441.   DOI
27 Pontius Jr RG and Si K (2014). The total operating characteristic to measure diagnostic ability for multiple thresholds, International Journal of Geographical Information Science, 28, 570-583.   DOI
28 Sonego P, Kocsor A, and Pongor S (2008). ROC analysis: applications to the classification of biological sequences and 3D structures, Briefings in Bioinformatics, 9, 198-209.   DOI
29 Stein RM (2005). The relationship between default prediction and lending profits: Integrating ROC analysis and loan pricing, Journal of Banking & Finance, 29, 1213-1236.   DOI
30 Tasche D (2008). Validation of internal rating systems and PD estimates. In The Analytics of Risk Model Validation (PP. 169-196), Academic Press.
31 Hong CS and Choi SY (2020). Positive and negative predictive values by the TOC curve, Communications for Statistical Applications and Methods, 27, 211-224.   DOI
32 Bamber D (1975). The area above the ordinal dominance graph and the area below the receiver operating characteristic graph, Journal of Mathematical Psychology, 12, 387-415.   DOI
33 Engelmann B, Hayden E, and Tasche D (2003). Testing rating accuracy, Risk, 16, 82-86.
34 Fluss R, Faraggi D, and Reiser B (2005). Estimation of the Youden Index and its associated cutoff point, Biometrical Journal: Journal of Mathematical Methods in Biosciences, 47, 458-472.   DOI
35 Liu X (2012). Classification accuracy and cut point selection, Statistics in Medicine, 31, 2676-2686.   DOI
36 Oehr P and Ecke T (2020). Establishment and characterization of an empirical biomarker SS/PV-ROC plot using results of the UBC® rapid test in bladder cancer, Entropy, 22, 729.   DOI