Browse > Article
http://dx.doi.org/10.13088/jiis.2020.26.2.105

Machine learning-based corporate default risk prediction model verification and policy recommendation: Focusing on improvement through stacking ensemble model  

Eom, Haneul (Department of Science and Technology Studies, Korea University)
Kim, Jaeseong (Department of Science and Technology Studies, Korea University)
Choi, Sangok (Department of public administration, Korea University)
Publication Information
Journal of Intelligence and Information Systems / v.26, no.2, 2020 , pp. 105-129 More about this Journal
Abstract
This study uses corporate data from 2012 to 2018 when K-IFRS was applied in earnest to predict default risks. The data used in the analysis totaled 10,545 rows, consisting of 160 columns including 38 in the statement of financial position, 26 in the statement of comprehensive income, 11 in the statement of cash flows, and 76 in the index of financial ratios. Unlike most previous prior studies used the default event as the basis for learning about default risk, this study calculated default risk using the market capitalization and stock price volatility of each company based on the Merton model. Through this, it was able to solve the problem of data imbalance due to the scarcity of default events, which had been pointed out as the limitation of the existing methodology, and the problem of reflecting the difference in default risk that exists within ordinary companies. Because learning was conducted only by using corporate information available to unlisted companies, default risks of unlisted companies without stock price information can be appropriately derived. Through this, it can provide stable default risk assessment services to unlisted companies that are difficult to determine proper default risk with traditional credit rating models such as small and medium-sized companies and startups. Although there has been an active study of predicting corporate default risks using machine learning recently, model bias issues exist because most studies are making predictions based on a single model. Stable and reliable valuation methodology is required for the calculation of default risk, given that the entity's default risk information is very widely utilized in the market and the sensitivity to the difference in default risk is high. Also, Strict standards are also required for methods of calculation. The credit rating method stipulated by the Financial Services Commission in the Financial Investment Regulations calls for the preparation of evaluation methods, including verification of the adequacy of evaluation methods, in consideration of past statistical data and experiences on credit ratings and changes in future market conditions. This study allowed the reduction of individual models' bias by utilizing stacking ensemble techniques that synthesize various machine learning models. This allows us to capture complex nonlinear relationships between default risk and various corporate information and maximize the advantages of machine learning-based default risk prediction models that take less time to calculate. To calculate forecasts by sub model to be used as input data for the Stacking Ensemble model, training data were divided into seven pieces, and sub-models were trained in a divided set to produce forecasts. To compare the predictive power of the Stacking Ensemble model, Random Forest, MLP, and CNN models were trained with full training data, then the predictive power of each model was verified on the test set. The analysis showed that the Stacking Ensemble model exceeded the predictive power of the Random Forest model, which had the best performance on a single model. Next, to check for statistically significant differences between the Stacking Ensemble model and the forecasts for each individual model, the Pair between the Stacking Ensemble model and each individual model was constructed. Because the results of the Shapiro-wilk normality test also showed that all Pair did not follow normality, Using the nonparametric method wilcoxon rank sum test, we checked whether the two model forecasts that make up the Pair showed statistically significant differences. The analysis showed that the forecasts of the Staging Ensemble model showed statistically significant differences from those of the MLP model and CNN model. In addition, this study can provide a methodology that allows existing credit rating agencies to apply machine learning-based bankruptcy risk prediction methodologies, given that traditional credit rating models can also be reflected as sub-models to calculate the final default probability. Also, the Stacking Ensemble techniques proposed in this study can help design to meet the requirements of the Financial Investment Business Regulations through the combination of various sub-models. We hope that this research will be used as a resource to increase practical use by overcoming and improving the limitations of existing machine learning-based models.
Keywords
Corporate default risk prediction; Merton model; Random forest; CNN;
Citations & Related Records
Times Cited By KSCI : 10  (Citation Analysis)
연도 인용수 순위
1 Kim, M. J., "Ensemble Learning for Solving Data Imbalance in Bankruptcy Prediction", Journal of Intelligence and Information Systems, Vol.15, No.3(2009), 1-15.
2 Kim, M. J., H. B. Kim and D. K. Kang, "Optimizing SVM Ensembles Using Genetic Algorithms in Bankruptcy Prediction", Journal of information and communication convergence engineering, Vol.8, No.4(2010), 370-376.   DOI
3 Kim, M. J., "Ensemble Learning with Support Vector Machines for Bond Rating", Journal of Intelligence and Information Systems, Vol.18, No.2(2012), 29-45.   DOI
4 Bae, J. K., "An Integrated Approach to Predict Corporate Bankruptcy with Voting Algorithms and Neural Networks", Korean Business Review, Vol.3, No.2(2010), 79-101.
5 Kim, S. J. and H. C. Ahn, "Corporate Bond Rating Model using Random Forest.", Journal of Intelligence and Information Systems, Spring Conference, (2014), 371-376.
6 Wang, H., Q. Xu and L. Zhou, "Large Unbalanced Credit Scoring Using Lasso-Logistic Regression Ensemble", PLoS One, San Francisco, Vol.10, No.2, (2015).
7 Yeh, S.-H., Wang, C.-J. and Tsai, M.-F., "Corporate Default Prediction via Deep Learning," in 24th Wireless and Optical Communication Conference (WOCC, 2014)
8 Min, S. H., "Bankruptcy prediction using an improved bagging ensemble", Journal of Intelligence and Information Systems, Vol.20, No.4, (2014), 121-139.   DOI
9 Min, S. H., "Simultaneous optimization of KNN ensemble model for bankruptcy prediction", Journal of Intelligence and Information Systems, Vol.22, No.1, (2016), 139-157.   DOI
10 Jo, N. O., H. J. Kim and K. S. Shin. "Bankrupcy Type Prediction Using A Hybrid Artificial Neural Networks Model." Journal of Intelligence and Information Systems, Vol.21, No.3, (2015), 79-99.   DOI
11 Addal, S., "Financial forecasting using machine learning", African Institute for Mathematical Science, (2016), 1-32.
12 Yali Amit; Donald Geman (1997). "Shape quantization and recognition with randomized trees". Neural Computation 9 (7): 1545-1588. doi:10.1162/neco.1997.9.7.1545.   DOI
13 Jo, N. O. and K. S. Shin. "Bankrupcy Prediction Modeling Using Qualitative Information Based on Big Data Analytics", Journal of Intelligence and Information Systems, Vol.22, No.2, (2016), 33-56.   DOI
14 Zmijewski, M. E., "Methodological Issues Related to the Estimation of Financial Distress Prediction Models," Journal of Accounting Research, 22, (1984), 59-82.   DOI
15 Altman, E., A. Resti, and A. Sironi, "Default Recovery Rates in Credit Risk Modelling: A Review of the Literature and Empirical Evidence," Economic Notes, 33(2), (2004), 183-203.   DOI
16 Horrigan, J. O., "The Determination of Long-Term Credit Standing with Financial Ratios," Journal of Accounting Research, 4, (1966), 44-62.   DOI
17 Ohlson, J. S., "Financial Ratios and Probabilistic Prediction of Bankruptcy," Journal of Accounting Research, 18(1), (1980), 109-131.   DOI
18 Jeon, Yong., Ki., "Empirical study of the commercial credit rating and predictability of financial statements information", Korea University PhD Thesis, 1986.
19 Yoon, J., M, "Effectiveness Analysis of Credit Card Default Risk with Deep Learning Neural Network", Journal of Money & Finance, Vol. 33, No. 1(2019), 151-181.   DOI
20 Kang, Dae., IL., "Stock Portfolio Composition and Trading Strategy Considering Bankruptcy Risks", National Pension Service Research Report, 2014, 1-158
21 Cha, S., J, "Corporate Default Prediction Model Using Deep Learning Time Series Algorithm, RNN and LSTM", Journal of Intelligence and Information Systems, Vol 24, No. 4(2018), 1-32.   DOI
22 Jo, Ji., Ho., "A Study on Credit Rating System in Korea Bond Market", Asian Review of Financial Research, V11, No.15, 1998, 149-190.
23 Jeong, Wan., Ho., "A Study on Forecasting Corporate Default: Based on Stock Price Information", Asian Review of Financial Research, Vol 15, No.15(2002), 217-249.
24 Kwon, H., C, "A Study on the Work-time Estimation for Block Erections Using Stacking Ensemble Learning", Journal of the Society of Naval Architects of Korea, Vol. 56, No. 6(2019), 488-496.   DOI
25 Choi, Y., S, "Expected Probability of Default Combining Financial Data and Stock Prices", Korea Defivatives Association(2007)
26 Oh, S., K, "Structural Credit Risk Model Incorporating the First Hitting Condition of Random Default Barrier", The Korean Journal of Financial Management, Vol 32, No. 4(2015), 23-51.   DOI
27 Byun, J., K, "The Effectiveness of Merton Model and Pricing of Credit Risk of Corporate Bonds.", journal of Korean Association of Applied Economics, Vol 6, No. 3(2004), 49-85
28 Lee, K. C., "Comparative Study on the Bankruptcy Prediction Power of Statistical Model and Al Models : MDA, Inductive Learning, Neural Network)", Journal of the Korean Operations Research and Management Science Society, Vol.18, No.2, (1993), 57-81.
29 Lee, J. S. and J. H. Han, "Test of Non-Financial Information in Bankruptcy Prediction using Artificial Neural Network - The Case of Small and Medium - Sized Firms - )", Journal of Intelligence and Information Systems, Vol.1, No.1, (1995), 123-134.
30 Kang, Dae., IL., "An Analysis of Default Portfolios using the First Passage Time Stochastic Process", Vol. 28, No.2,149-187