Browse > Article
http://dx.doi.org/10.5351/CKSS.2009.16.2.239

Criterion of Test Statistics for Validation in Credit Rating Model  

Park, Yong-Seok (Research Institute of Applied Statistics, Sungkyunkwan Univ.)
Hong, Chong-Sun (Dept. of Statistics, Sungkyunkwan Univ.)
Lim, Han-Seung (RMS 2 Team, Korea Ratings)
Publication Information
Communications for Statistical Applications and Methods / v.16, no.2, 2009 , pp. 239-347 More about this Journal
Abstract
This paper presents Kolmogorov-Smirnov, mean difference, AUROC and AR, four well known statistics that have been widely used for evaluating the discriminatory power of credit rating models. Criteria for these statistics are determined by the value of mean difference under the assumption of normality and equal standard deviation. Alternative criteria are proposed through the simulations according to various sample sizes, type II error rates, and the ratio of bads, also we suggest the meaning of statistic on the basis of discriminatory power. Finally we make a comparative study of the currently used guidelines and simulated results.
Keywords
Accuracy ratio(AR); area under ROC(AUROC); discriminatory power; mean difference; type II error rates;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Egan, J. P. (1975). Signal Detection Theory and ROC Analysis, Series in Cognitition and Perception, Academic Press, New York
2 Engelmann, B., Hayden, E. and Tasche, D. (2003). Measuring the Discriminative Power of Rating Systems, Discussion paper Series 2: Banking and Financial Supervision
3 Faraggi, D. and Reiser, B. (2002). Estimation of the area under the ROC curve, Statistics in Medicine, 21, 3093-3106   DOI   ScienceOn
4 Hanley, J. A. and McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology, 143, 29-36   DOI
5 Joseph, M. P. (2005). A PD validation framework for Basel II internal ratings-based systems, Credit Scoring and Credit Control Ⅳ
6 Sobehart, J. R., Keenan, S. C. and Stein, R. M. (2000). Benchmarking quantitative default risk models: A validation methodology, Moody's Investors Service
7 Swets, J. A. (1988). Measuring the accuracy of diagnostic systems, Science, 240, 1285-1293   DOI
8 Swets, J. A., Dawes, R. M. and Manahan, J. (2000). Better decisions through science, Scientific American, 283, 82-87   DOI   ScienceOn
9 Tasche, D. (2006). Validation of internal rating systems and PD estimates, eprint arXiv:physics/0606071
10 Wilkie, A. D. (2004). Measures for Comparing Scoring Systems, In Readings in Credit Scoring-Recent Developments, Advances, and Aims, Oxford Finance
11 박용석, 홍종선 (2008). 신용평가모형에서 콜모고로프-스미르노프 검정기준의 문제점, <한국통계학회 논문집>, 15, 1013-1026   과학기술학회마을   DOI
12 홍종선, 이창혁, 김지훈 (2008). 범주형 재무자료에 대한 신용평가모형 검증 비교, <한국통계학회 논문집>, 15, 615-631   과학기술학회마을   DOI