Browse > Article
http://dx.doi.org/10.7465/jkdi.2016.27.2.337

Proposition of polytomous discrimination index and test statistics  

Choi, Jin Soo (Department of Statistics, Sungkyunkwan University)
Hong, Chong Sun (Department of Statistics, Sungkyunkwan University)
Publication Information
Journal of the Korean Data and Information Science Society / v.27, no.2, 2016 , pp. 337-351 More about this Journal
Abstract
There exist many real situations that statistical decision problems are classified into more than two categories. In these cases, the concordance statistics by the pair approach are mostly used. However, the expression of the classification of categories are ambiguous. Recently, the standardized evaluation data and re-expressed concordance statistics are defined and could be explained their meanings. They have still some non-specific problems for standard criteria of the statistics. Since these can be considered between result and truth categories additionally, two alternative concordance statistics might be proposed in this paper. Some advantages are founded that the proposed statistics could be discriminated all possible cases for two randomly selected categories. Moreover since the proposed statistics are represented with indicator functions, these could be transformed non-parametrically, so that these concordances are used for hypothesis testing.
Keywords
AUC; concordance; mann-whitney statistic; polytomous discrimination index; wilcoxon rank sum statistic;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 Choi, J. S. and Hong, C. S. (2016). Standardized polytomous discrimination index using concordance. Journal of the Korean Data & Information Science Society, 27, 33-44.   DOI
2 Fawcett, T. (2003). ROC graphs: Notes and practical considerations for data mining researchers. HP Laboratories, Palo Alto, CA 94304.
3 Hand, D. J. and Till, R. J. (2001). A simple generalisation of the area under the ROC curve for multiple class classification problem. Machine Learning, 45, 171-186.   DOI
4 Hanley, J. A. and McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.   DOI
5 Hong, C. S. and Cho, M. H. (2015a). VUS and HUM represented with Mann-Whitney statistic. Communications for Statistical Applications and Methods, 22, 223-232.   DOI
6 Hong, C. S. and Cho, M. H. (2015b). Test statistics for volume under the ROC surface and hypervolume under the ROC manifold. Communications for Statistical Applications and Methods, 22, 377-387.   DOI
7 Hong, C. S., Joo, J. S. and Choi, J. S. (2010). Optimal thresholds from mixture distributions. Korean Journal of Applied Statistics, 23, 13-28.   DOI
8 Hong, C. S. and Jung, D. G. (2014). Standard criterion of hypervolume under the ROC manifold. Journal of the Korean Data & Information Science Society, 25, 473-483.   DOI
9 Hong, C. S., Jung, E. S. and Jung, D. G. (2013). Standard criterion of VUS for ROC surface. Korean Journal of Applied Statistics, 26, 977-985.   DOI
10 Joseph, M. P. (2005). A PD validation framework for Basel II internal ratings-based systems. Creadit Scoring and Credit Control, IX.
11 Obuchowski, N. A., Goske, M. J. and Applegate, K. E. (2001). Assessing physicians' accuracy in diagnosing paediatric patients with acute abdominal pain: Measuring accuracy for multiple diseases. Statistics In Medicine, 20, 3261-3278.   DOI
12 Obuchowski, N. A. (2005). Estimating and comparing diagnostic tests' accuracy when the gold standard is not binary. Academic radiology, 12, 1198-1204.   DOI
13 Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240, 1285-1293.   DOI
14 Van Calster, B., Van Belle, V., Vergouwe, Y., Timmerman, D., Van Huffel, S. and Steyerberg, E. W. (2012). Extending the c-statistic to nominal polytomous outcomes: The polytomous discrimination index. Statistics In Medicine, 31, 2610-2626.   DOI
15 Yan, L., Dodier, R., Mozer, M. C. and Wolniewicz, R. (2003). Optimizing classifier performance via the Wilcoxon-Mann-Whitney statistics. Proceedings of the 20th International Conference on Machine Learning, Washington D.C., 848-855.
16 Zou, K. H., O'Malley, A. J. and Mauri, L. (2007). Receiver operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation, 115, 654-657.   DOI