Browse > Article
http://dx.doi.org/10.13088/jiis.2013.19.2.055

Impact of Ensemble Member Size on Confidence-based Selection in Bankruptcy Prediction  

Kim, Na-Ra (School of Business, Ewha Womans University)
Shin, Kyung-Shik (School of Business, Ewha Womans University)
Ahn, Hyunchul (School of Management Information Systems, Kookmin University)
Publication Information
Journal of Intelligence and Information Systems / v.19, no.2, 2013 , pp. 55-71 More about this Journal
Abstract
The prediction model is the main factor affecting the performance of a knowledge-based system for bankruptcy prediction. Earlier studies on prediction modeling have focused on the building of a single best model using statistical and artificial intelligence techniques. However, since the mid-1980s, integration of multiple techniques (hybrid techniques) and, by extension, combinations of the outputs of several models (ensemble techniques) have, according to the experimental results, generally outperformed individual models. An ensemble is a technique that constructs a set of multiple models, combines their outputs, and produces one final prediction. The way in which the outputs of ensemble members are combined is one of the important issues affecting prediction accuracy. A variety of combination schemes have been proposed in order to improve prediction performance in ensembles. Each combination scheme has advantages and limitations, and can be influenced by domain and circumstance. Accordingly, decisions on the most appropriate combination scheme in a given domain and contingency are very difficult. This paper proposes a confidence-based selection approach as part of an ensemble bankruptcy-prediction scheme that can measure unified confidence, even if ensemble members produce different types of continuous-valued outputs. The present experimental results show that when varying the number of models to combine, according to the creation type of ensemble members, the proposed combination method offers the best performance in the ensemble having the largest number of models, even when compared with the methods most often employed in bankruptcy prediction.
Keywords
부도예측;앙상블;결합기법;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Finlay, S., "Multiple classifier architectures and their application to credit risk assessment," European Journal of Operational Research, Vol.210(2011), 368-378.   DOI   ScienceOn
2 Hansen, L. K. and P. Salamon, "Neural network ensembles," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.12, No.10(1990), 993-1001.   DOI   ScienceOn
3 Hashem, S., "Optimal linear combinations of neural networks," Neural Networks, Vol.10, No.4 (1997), 599-614.   DOI   ScienceOn
4 Hayashia, Y., and R. Setionob, "Combining neural network predictions for medical diagnosis," Computers in Biology and Medicine, Vol.32 (2002), 237-246.   DOI   ScienceOn
5 Heskes, T., Balancing between bagging and bumping, In : Mozer, M. C., Jordan, M. I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. Cambridge, MIT Press, (1997), 466-472.
6 Ho, T. K., J. J. Hull, and S. N. Srihari, "Decision combination in multiple classifier systems," Pattern Analysis and Machine Intelligence, Vol.16, No.1(1994), 66-75.   DOI   ScienceOn
7 Hong, S. H. and K. S. Shin, "Using GA based Input Selection Method for Artificial Neural Network Modeling Application to Bankruptcy Prediction," Journal of Intelligence and Information Systems, Vol.9, No.1(2003), 227-249.   과학기술학회마을
8 Abdelwahed, T. and E. M. Amir, "New Evolutionary Bankruptcy Forecasting Model based on Genetic Algorithms and Neural Networks," Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence, (2005).
9 Alfaro, E., N. Garcia, M. Gamez, and D. Elizondo, "Bankruptcy forecasting : an empirical comparison of AdaBoost and neural networks," Decision Support Systems, Vol.45(2008), 110-122.   DOI   ScienceOn
10 Altman, E. I., "Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy," The Journal of Finance, Vol.23, No.4(1968), 589-609.   DOI
11 Back, B., T. Laitinen, and K. Sere, "Neural networks and genetic algorithms for bankruptcy predictions," Expert Systems with Applications, Vol.11(1996), 407-413.   DOI   ScienceOn
12 Beaver, W., "Financial Ratios as Predictors of Failure, Journal of Accounting Research, Vol.4(1966), 71-111.   DOI   ScienceOn
13 Breiman, L., "Bagging predictors," Machine Learning, Vol.24, No.2(1996), 497-501.
14 Chan, A. P. F., W. Y. Ng, D. S. Yeung, E. C. C. Tsang, and M. Firth, "Bankruptcy prediction using multiple classifier system with mutual information feature grouping," IEEE international conference on systems, man, and cybernetics, (2006), 845-850.
15 Wahba, G., "Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV," Technical Report, NO.984rr, Department of Statistics, University of Wisconsin, 1998.
16 Verikas, A., A. Lipnickas, K. Malmqvist, M. Bacauskiene, and A. Gelzinis, "Soft combination of neural classifiers : A comparative study," Pattern Recognition Letters, Vol.20 (1999), 429-444.   DOI   ScienceOn
17 Verikas, A., Z. Kalsyte, M. Bacauskiene, and A. Gelzinis, "Hybrid and ensemble-based soft computing techniques in bankruptcy prediction : a survey," Soft Computing, Vol.14 (2010), 995-1010.   DOI
18 Wahba, G., Multivariate function and operator estimation, based on smoothing splines and reproducing kernels, Nonlinear Modeling and Forecasting, SFI Studies in the Sciences of Complexity, Proc. Vol.XII, Eds. M. Casdagli and S. Eubank, Addison-Wesley, 1992.
19 Xu, L., A. Krzyzak, and C. Y. Suen, "Methods for combining multiple classifiers and their applications to handwriting recognition," IEEE Transactions on Systems, Man, and Cybernetics, Vol.22(1992), 418-435.   DOI   ScienceOn
20 Olmeda, I. and E. Fernandez, "Hybrid classifiers for financial multicriteria decision making_the case of bankruptcy prediction," Computational Economics, Vol.10(1997), 317-335.   DOI
21 Pal, S. K. and A. Pal, Pattern Recognition : From Classical to Modern Approaches, World Scientific, 2001.
22 Platt, J. C., Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, In Advances in large margin classifiers, Alexander J. S., P. Bartlett, B, Scholkopf, D. Schuurmans, eds., Cambridge, MIT Press, 1999.
23 Ravi, V., H. Kurniawana, P. Thaia, and P. Kumarb, "Soft computing system for bank performance prediction," Applied Soft Computing, Vol.8 (2008), 305-315.   DOI   ScienceOn
24 Sewell, M., "Ensemble Learning," Research Note, RN/11/02, Dept. of Computer Science, UCL, 2011.
25 Shin, K. S. and K. J. Lee, "Bankruptcy Prediction Modeling Using Multiple Neural Network Models," Lecture Notes in Computer Science, Vol.3214(2004), 668-674.
26 Taniguchi, M. and V. Tresp, "Averaging regularized estimators," Neural Computation, Vol.9(1997), 1163-1178.   DOI   ScienceOn
27 Shmueli, G., N. R. Patel, and P. C. Bruce, Data Mining for Business Intelligence : Concepts, Techniques, and Applications in Microsoft Office Excel With Xlminer, Hardcover, 2nd Edition, Wiley, 2010.
28 Sun, J. and Li, h. "Listed companies' financial distress prediction based on weighted majority voting combination of multiple classifiers," Expert Systems with Applications, Vol.35 (2008), 818-827.   DOI   ScienceOn
29 Tai, Q. Y. and K. S. Shin, "GA-based Normalization Approach in Back-propagation Neural Network for Bankruptcy Prediction Modeling," Journal of Intelligence and Information Systems, Vol.16, No.3(2010), 1-14.
30 Tsai, C. F. and J. W. Wu, "Using Neural Network Ensembles for Bankruptcy Prediction and Credit Scoring," Expert Systems with Applications, Vol.34(2008), 2639-2649.   DOI   ScienceOn
31 Jo, H. K. and I. G. Han, "Integration of Case-Based Forecasting, Neural Network, and Discriminant Analysis for Bankruptcy Prediction," Expert Systems With Applications, Vol.2, No.4(1996), 415-422.
32 Jo, H. K., I. G. Han, and H. Lee, "Bankruptcy prediction using case-based reasoning, neural networks, and discriminant analysis," Expert Systems With Applications, Vol.13(1997), 97-108.   DOI   ScienceOn
33 Kim, M. J. and D. K. Kang, "Ensemble with neural networks for bankruptcy prediction," Expert Systems with Applications, Vol.37(2010), 3373-3379.   DOI   ScienceOn
34 Kuncheva, L. I., Combining pattern classifiers : Methods and algorithms, Hoboken, New Jersey, John Wiley & Sons, 2004.
35 Leshno, M. and Y. Spector, "Neural network prediction analysis : The bankruptcy case," Neurocomputing, Vol.10(1996), 125-147.   DOI   ScienceOn
36 Ruta, D. and B. Gabrys, "An Overview of Classifier Fusion Methods," Computing and Information Systems, Vol.7(2000), 1-10.
37 Lin, F. Y. and S. McClean, "A data mining approach to the prediction of corporate failure," Knowledge-Based Systems, Vol.14(2001), 189-195.   DOI   ScienceOn
38 Mar-Molinero, C. and C. Serrano-Cinca, "Bank failure : a multidimensional scaling approach," The European Journal of Finance, Vol.7 (2001), 165-183.   DOI   ScienceOn
39 Neophytou, E. and C. Mar-Molinero, "Predicting Corporate Failure in the UK : A Multidimensional Scaling Approach," Journal of Business Finance and Accounting, Vol.31 (2004), 667-710.
40 Odom, M. and R. Sharda, "A neural network model for bankruptcy prediction," Proc. Int. Joint Conf. Neural Networks, San Diego, CA, (1990).
41 Ohlson, J., "Financial ratios and the probabilistic prediction of bankruptcy," Journal of Accounting Research, Vol.18, No.1(1980), 109-131.   DOI   ScienceOn
42 IBM SPSS Modeler Help, Modeling Nodes, Neural Networks, embedded in IBM SPSS Modeler, (2012).
43 Chen, W. S. and Y. K. Du, "Using Neural Networks and Data Mining Techniques for the Financial Distress Prediction Model," Expert Systems with Applications, Vol.36(2009), 4075-4086.   DOI   ScienceOn
44 Cho, S. B. and J. H. Kim, "Combining multiple neural networks by fuzzy integral for robust classification," IEEE Transactions on System, Man, and Cybernetics, Vol.25, No.2(1995), 380-384.   DOI   ScienceOn
45 Clemen, R. T., "Combining forecasts : A review and annotated bibliography," International Journal of Forecasting, Vol.5(1989), 559-583.   DOI   ScienceOn
46 Duda, R. O., P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. John Wiley & Sons, NY, 2001.
47 Kim, K. J, "Data Mining using Instance Selection in Artificial Neural Networks for Bankruptcy Prediction," Journal of Intelligence and Information Systems, Vol.10, No.1(2004), 109-123.   과학기술학회마을
48 West, D., S. Dellana, and J. Qian, "Neural network ensemble strategies for financial decision applications," Computers and Operations Research, Vol.32(2005), 2543-2559.   DOI   ScienceOn
49 Atiya, A. F., "Bankruptcy Prediction for Credit Risk Using Neural Networks : A Survey and New Results," IEEE transactions on neural networks, Vol.12, No.4(July, 2001), 929-935.   DOI   ScienceOn
50 Freund, Y. and R. E. Schapire, "A decisiontheoretic generalization of on-line learning and an application to boosting," Unpublished manuscript. Quoted in Quinlan, J.R., "Bagging, boosting, and C4. 5," Proceedings of the National Conference on Artificial Intelligence, (1996).
51 Shin, K. S. and I. G. Han, "Bankruptcy Prediction Modeling Using Multiple Neural Network Models," Proceedings of the Fall Conference on the Korean Operations Research and Management Science Society (KORMS), (1998), 145-148.