Browse > Article
http://dx.doi.org/10.9723/jksiis.2012.17.7.139

Developing an Ensemble Classifier for Bankruptcy Prediction  

Min, Sung-Hwan (한림대학교 경영학부)
Publication Information
Journal of Korea Society of Industrial Information Systems / v.17, no.7, 2012 , pp. 139-148 More about this Journal
Abstract
An ensemble of classifiers is to employ a set of individually trained classifiers and combine their predictions. It has been found that in most cases the ensembles produce more accurate predictions than the base classifiers. Combining outputs from multiple classifiers, known as ensemble learning, is one of the standard and most important techniques for improving classification accuracy in machine learning. An ensemble of classifiers is efficient only if the individual classifiers make decisions as diverse as possible. Bagging is the most popular method of ensemble learning to generate a diverse set of classifiers. Diversity in bagging is obtained by using different training sets. The different training data subsets are randomly drawn with replacement from the entire training dataset. The random subspace method is an ensemble construction technique using different attribute subsets. In the random subspace, the training dataset is also modified as in bagging. However, this modification is performed in the feature space. Bagging and random subspace are quite well known and popular ensemble algorithms. However, few studies have dealt with the integration of bagging and random subspace using SVM Classifiers, though there is a great potential for useful applications in this area. The focus of this paper is to propose methods for improving SVM performance using hybrid ensemble strategy for bankruptcy prediction. This paper applies the proposed ensemble model to the bankruptcy prediction problem using a real data set from Korean companies.
Keywords
Support vector machines; Bankruptcy prediction; Bagging; Random Subspace; Ensemble;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 Beaver, W, "Financial ratios as predictors of failure, empirical research in accounting: Selected studied", Journal of Accounting Research, 1966, pp.71-111.
2 Altman, E. L, "Financial ratios, discriminant analysis and the prediction of corporate bankruptcy", The Journal of Finance, 23(3), 1968, pp.589-609.   DOI   ScienceOn
3 Altman, E. L., Edward, I., Haldeman, R., & Narayanan, P. A, "new model to identify bankruptcy risk of corporations", Journal of Banking and Finance, 1, 1977, pp.29-54.   DOI   ScienceOn
4 Meyer, P. A., & Pifer, H, "Prediction of bank failures", The Journal of Finance, 25, 1970, pp.853-868.   DOI
5 Dimitras, A. I., Zanakis, S. H., & Zopounidis, C, "A survey of business failure with an emphasis on prediction methods and industrial applications", European Journal of Operational Research, 90(3), 1996 , pp.487-513.   DOI   ScienceOn
6 Ohlson, J, "Financial ratios and the probabilistic prediction of bankruptcy", Journal of Accounting Research, 18(1),1980 , pp.109-131.   DOI   ScienceOn
7 Pantalone, C., & Platt, M. B, "Predicting commercial bank failure since deregulation", New England Economic Review, 1987, pp.37-47.
8 Han, I., Chandler, J. S., & Liang, T. P, "The impact of measurement scale and correlation structure on classification performance of inductive learning and statistical methods", Expert System with Applications, 10(2), 1996, pp.209-221.   DOI
9 Shaw, M., & Gentry, J, "Using and expert system with inductive learning to evaluate business loans", Financial Management, 17(3), 1998, pp.45-56.
10 Buta, P, "Mining for financial knowledge with CBR", AI Expert, 9(10), 1994, pp.34-41.
11 Bryant, S. M, "A case-based reasoning approach to bankruptcy prediction modeling", International Journal of Intelligent Systems in Accounting, Finance and Management, 6(3), 1997, pp.195-214.   DOI   ScienceOn
12 Bortiz, J. E., & Kennedy, D. B, "Effectiveness of neural network types for prediction of business failure", Expert Systems with Application, 9(4), 1995, pp.503-512.   DOI
13 Zhang, G., Hu, M. Y., Patuwo, B. E., & Indro, D. C, "Artificial neural networks in bankruptcy prediction: General framework and crossvalidation analysis", European Journal of Operational Research, 116(1), 1999 , pp.16-32.   DOI   ScienceOn
14 Coakley, J. R., & Brown, C. E, "Artificial neural networks in accounting and finance: Modeling issues", International Journal of Intelligent Systems in Accounting, Finance and Management, 9(2), 2000, pp.119-144.   DOI   ScienceOn
15 Fan, A., & Palaniswami, M, "Selecting bankruptcy predictors using a support vector machine approach", Proceeding of the international joint conference on neural network, Vol. 6, 2000, pp. 354-359.
16 Van Gestel, T., Baesens, B., Suykens, J., Espinoza, M. Baestaens, D.-E., Vanthienen, J., et al. "Bankruptcy prediction with least squares support vector machine classifiers, computational intelligence for financial engineering", 2003, proceeding 2003. IEEEE international conference on 2003, pp.1-8.
17 Min, S.,& Lee, J., "Hybrid genetic algorithms and support vector machines for bankruptcy prediction", Expert Systems with Applications, Volume 31, Issue 3, October 2006, pp.652-660.   DOI   ScienceOn
18 신택수, 홍태호, "AdaBoost 알고리즘 기반 SVM을이용한 부실 확률분포 기반의 기업신용평가", 지능정보연구, 17권 3호(2011), pp.25-41.
19 김명종, "유전자 알고리즘을 이용한 분류기 앙상블의 최적 선택", 지능정보연구 제16권 제4호 2010, pp. 99-112.
20 김승혁, 김종우, "Modified Bagging Predictors를 이용한 SOHO 부도 예측", 한국지능정보시스템학회논문지 제13권 제2호, 2007, pp.15-26.
21 Dietterich, T. G, "Machine-learning research: Four current directions", AI Magazine, 18(4), 1997, pp.97-136.
22 Kuncheva L.I, "Combining classifiers: Soft computing solutions", in: S.K. Pal and A. Pal (Eds.) Pattern Recognition: From Classical to Modern Approaches, World Scientific Publishing Co., Singapore, 2001, 427-452
23 Breiman, L, "Bagging predictors", Machine Learning, 24(2), 1996, pp.123-140.
24 Vapnik, V. N, "The nature of statistical learning theory", New York: Springer, 1995.
25 박창석, 김병만, 서병훈, 김준우,이광호,"이동 차량에서의 실시간 자동차 번호판 인식",한국산업정보학회논문지, v.9, no.2, 2004년, pp.32-43   과학기술학회마을
26 원철호, 이상헌, 이태균,"인터랙티브 TV 컨트롤 시스템을 위한 근적외선 영상의 얼굴 인식", 한국산업정보학회논문지, v.15, no.5, 2010년, pp.11-17   과학기술학회마을
27 유혜경, 이진영, 나종화,"매장문화재 예측을 위한 통계적 분류 분석", 한국산업정보학회논문지, v.14, no.3, 2009년, pp.106-113   과학기술학회마을
28 Ho, T. K, "The random subspace method for constructing decision forests", IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8), 1998, pp.832-844.   DOI