The Journal of the Korea Contents Association (한국콘텐츠학회논문지)

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Fair Performance Evaluation Method for Stock Trend Prediction Models

주가 경향 예측 모델의 공정한 성능 평가 방법

  • 임정수 (한국교통대학교 전자공학과 부교수)
  • Received : 2020.07.22
  • Accepted : 2020.08.25
  • Published : 2020.10.28
Download PDF
⟨ Previous Next ⟩

Abstract

Stock investment is a personal investment technique that has gathered tremendous interest since the reduction in interest rates and tax exemption. However, it is risky especially for those who do not have expert knowledge on stock volatility. Therefore, it is well understood that accurate stock trend prediction can greatly help stock investment, giving birth to a volume of research work in the field. In order to compare different research works and to optimize hyper-parameters for prediction models, it is required to have an evaluation standard that can accurately assess performances of prediction models. However, little research has been done in the area, and conventionally used methods have been employed repeatedly without being rigorously validated. For this reason, we first analyze performance evaluation of stock trend prediction with respect to performance metrics and data composition, and propose a fair evaluation method based on prediction disparity ratio.

주식 투자는 재테크의 하나로 금리 인하와 비과세 제도의 축소에 따라 주목을 받기 시작했다. 그러나 투자에 전문적인 지식이 필요할 뿐 아니라 위험 부담이 크다는 단점이 있다. 따라서 주가 경향의 정확한 예측은 개인투자자에게나 주식 투자 관련 서비스를 제공하는 회사에 중요한 능력이며, 더욱 정확한 예측을 위한 연구가 활발히 진행 중이다. 그러나 예측 연구들의 공정한 비교와 최고의 예측 모델을 얻기 위한 하이퍼-파라미터의 최적화에는 예측 모델의 성능을 정확하게 평가하는 방법이 필요한데, 지금까지 예측 모델의 성능 평가에 대한 연구는 미진한 상태이며, 기존 방법들을 그대로 답습하고 있는 실정이다. 이에 본 논문에서는 주가 예측 모델 성능 평가를 측정기준과 데이터 구성의 관점에서 분석하고, 예측 불균형 비율을 이용한 주가 경향 예측 모델의 공정한 성능 평가 방법을 제안한다.

Keywords

References

  1. H. S. Sim, H. I. Kim, and J. J. Ahn, "Is deep learning for image recognition applicable to stock market prediction?," Complexity, Vol.2019, pp.1-10, 2019.
  2. https://www.index.go.kr/main.do
  3. X. Zhang, Y. Hu, K. Xie, S. Wang, E. Ngai, and M. Liu, "A causal feature selection algorithm for stock prediction modeling," Neurocomputing, Vol.142, pp.48-59, 2014. https://doi.org/10.1016/j.neucom.2014.01.057
  4. https://en.wikipedia.org/wiki/Robo-advisor
  5. http://www.ratestbed.kr/portal/main/main.do
  6. E. Hoseinzade and S. Haratizadeh, "CNNpred: CNN-based stock market prediction using a diverse set of variables," Expert Systems with Applications, Vol.129, pp.273-285, 2019. https://doi.org/10.1016/j.eswa.2019.03.029
  7. W. Chiang, D. ENke, T. Wu, and R. Wang, "An adaptive stock index trading decision support system," Expert Systems with Applications, Vol.59, pp.195-207, 2016. https://doi.org/10.1016/j.eswa.2016.04.025
  8. J. Zhang, S. Cui, Y. Xu, Q. Li, and T. Li, "A novel data-driven stock price trend prediction system," Expert Systems with Applications, Vol.97, pp.60-69, 2018. https://doi.org/10.1016/j.eswa.2017.12.026
  9. Y. Chen and Y. Hao, "Integrating principle component analysis and weighted support vector machine for stock trading signals prediction," Neurocomputing, Vol.321, pp.381-402, 2018. https://doi.org/10.1016/j.neucom.2018.08.077
  10. C. Tsai and Y. Hsiao, "Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches," Decision Support Systems, Vol.50, pp.258-269, 2010. https://doi.org/10.1016/j.dss.2010.08.028
  11. Z. Hu, J. Zhu, and K. Tse, "Stocks market prediction using support vector machine," Int. Conf. on Information Management, Innovation Management and Industrial Engineering, pp.115-118, 2013.
  12. J. Patel, S. Shah, P. Thakkar, and K. Kotecha, "Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques," Expert Systems with Applications, Vol.42, pp.259-268, 2015. https://doi.org/10.1016/j.eswa.2014.07.040
  13. A. N. Kia, S. Haratizadeh, and S. B. Shouraki, "A hybrid supervised semi-supervised graph-based model to predict one-day ahead movement of global stock markets and commodity prices," Expert Systems with Applications, Vol.105, pp.159-173, 2018. https://doi.org/10.1016/j.eswa.2018.03.037
  14. W. Long, Z. Lu, and L. Cui, "Deep learning-based feature engineering for stock price movement prediction," Knowledge-Based Systems, Vol.164, pp.163-173, 2019. https://doi.org/10.1016/j.knosys.2018.10.034
  15. 박강희, 신현정, "Semi-supervised learning을 이용한 주가예측," 한국경영과학회 학술대회 논문집, pp.110-116, 2010.
  16. 안성원, 조성배, "뉴스 텍스트 마이닝과 시계열 분석을 이용한 주가예측," 한국정보과학회 학술발표 논문집, pp.364-369, 2010.
  17. 신동근, 정경용, "웨이블릿 변환과 퍼지 신경망을 이용한 단기 KOSPI 예측," 한국콘텐츠학회논문지, 제11권, 제6호, pp.1-7, 2011. https://doi.org/10.5392/JKCA.2011.11.6.001
  18. 김진화, 홍광헌, 민진영, "지식 누적을 이용한 실시간 주식시장 예측," 지능정보연구, 제17권, 제4호, pp.109-130, 2011. https://doi.org/10.13088/JIIS.2011.17.4.109
  19. 허준영, 양진용, "SVM 기반의 재무 정보를 이용한 주가 예측," 정보과학회 컴퓨팅의 실제 논문지, 제21권, 제3호, pp.167-172, 2015. https://doi.org/10.5626/KTCP.2015.21.3.167
  20. Z. Lei and W. Lin, "Price trend prediction of stock market using outlier data mining algorithm," IEEE Int. Conf. on Big Data and Cloud Computing, pp.93-98, 2015.
  21. G. Dong, K. Fataliyev, and L. Wang, "One-step and multi-step ahead stock prediction using backpropagation neural networks," Int. Conf. on Information, Communication, and Signal Processing, pp.1-5, 2013.
  22. F. Wang, Z. Zhao, X. Li, and H. Zhang, "Stock volatility prediction using multi-kernel learning based extreme learning machine," Int. Joint Conf. on Neural Networks, pp.3078-3085, 2014.
  23. Y. Xu, Z. Li, and L. Luo, "A study on feature selection for the trend prediction of stock trading price," Int. Conf. on Computational and Information Sciences, pp.579-582, 2013.
  24. K. Kim, "Financial time series forecasting using support vector machine," Neurocomputing, Vol.55, pp.307-319, 2003. https://doi.org/10.1016/S0925-2312(03)00372-2
  25. Y. Lin, H. Guo, and J. Hu, "An SVM-based approach for stock market trend prediction," Int. Joint Conf. on Neural Networks, 2013.
  26. A. K. Sirohi, P. K. Mahato, and V. Attar, "Multiple kernel learning for stock price direction prediction," IEEE Int. Conf. on Advances in Engineering & Technology Research. 2014.
  27. D. Kato and T. Nagao, "Stock prediction using multiple time series of stock prices and news articles," IEEE Symposium on Computers & Informatics, pp.11-16, 2012.
  28. Y. Luo, J. Hu, X. Wei, D. Fang, and H. Shao, "Stock trends prediction based on hypergraph modeling clustering algorithm," IEEE Int. Conf. on Progress in Informatics and Computing, pp.27-31, 2014.
  29. K. Kim and I. Han, "Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index," Expert Systems with Applications, Vol.19, pp.125-132, 2000. https://doi.org/10.1016/S0957-4174(00)00027-0
  30. A. Oztekin, R. Kizilaslan, S. Freund, and A. Iseri, "A data analytic approach to forecasting daily stock returns in an emerging market," European Journal of Operational Research, Vol.253, pp.697-710, 2016. https://doi.org/10.1016/j.ejor.2016.02.056
  31. M. Lee, "Using support vector machine with hybrid feature selection method to the stock trend prediction," Expert Systems with Applications, Vol.36, pp.10896-10904, 2009. https://doi.org/10.1016/j.eswa.2009.02.038
  32. L. Ni, Z. Ni, and Y. Gao, "Stock trend prediction based on fractal feature selection and support vector machine," Expert System with Applications, Vol.38, pp.5569-5576, 2011. https://doi.org/10.1016/j.eswa.2010.10.079
  33. D. Kumar, S. S. Meghwani, and M. Thakur, "Proximal support vector machine based hybrid prediction models for trend forecasting in financial markets," Journal of Computational Science, Vol.17, pp.1-13, 2016. https://doi.org/10.1016/j.jocs.2016.07.006