Browse > Article
http://dx.doi.org/10.5392/JKCA.2020.20.10.702

Fair Performance Evaluation Method for Stock Trend Prediction Models  

Lim, Chungsoo (한국교통대학교 전자공학과)
Publication Information
Abstract
Stock investment is a personal investment technique that has gathered tremendous interest since the reduction in interest rates and tax exemption. However, it is risky especially for those who do not have expert knowledge on stock volatility. Therefore, it is well understood that accurate stock trend prediction can greatly help stock investment, giving birth to a volume of research work in the field. In order to compare different research works and to optimize hyper-parameters for prediction models, it is required to have an evaluation standard that can accurately assess performances of prediction models. However, little research has been done in the area, and conventionally used methods have been employed repeatedly without being rigorously validated. For this reason, we first analyze performance evaluation of stock trend prediction with respect to performance metrics and data composition, and propose a fair evaluation method based on prediction disparity ratio.
Keywords
Stock Price Trend Prediction; Performance Evaluation Method for Stock Trend Prediction; Machine Learning;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. S. Sim, H. I. Kim, and J. J. Ahn, "Is deep learning for image recognition applicable to stock market prediction?," Complexity, Vol.2019, pp.1-10, 2019.
2 A. N. Kia, S. Haratizadeh, and S. B. Shouraki, "A hybrid supervised semi-supervised graph-based model to predict one-day ahead movement of global stock markets and commodity prices," Expert Systems with Applications, Vol.105, pp.159-173, 2018.   DOI
3 W. Long, Z. Lu, and L. Cui, "Deep learning-based feature engineering for stock price movement prediction," Knowledge-Based Systems, Vol.164, pp.163-173, 2019.   DOI
4 박강희, 신현정, "Semi-supervised learning을 이용한 주가예측," 한국경영과학회 학술대회 논문집, pp.110-116, 2010.
5 안성원, 조성배, "뉴스 텍스트 마이닝과 시계열 분석을 이용한 주가예측," 한국정보과학회 학술발표 논문집, pp.364-369, 2010.
6 신동근, 정경용, "웨이블릿 변환과 퍼지 신경망을 이용한 단기 KOSPI 예측," 한국콘텐츠학회논문지, 제11권, 제6호, pp.1-7, 2011.   DOI
7 김진화, 홍광헌, 민진영, "지식 누적을 이용한 실시간 주식시장 예측," 지능정보연구, 제17권, 제4호, pp.109-130, 2011.   DOI
8 허준영, 양진용, "SVM 기반의 재무 정보를 이용한 주가 예측," 정보과학회 컴퓨팅의 실제 논문지, 제21권, 제3호, pp.167-172, 2015.   DOI
9 Z. Lei and W. Lin, "Price trend prediction of stock market using outlier data mining algorithm," IEEE Int. Conf. on Big Data and Cloud Computing, pp.93-98, 2015.
10 G. Dong, K. Fataliyev, and L. Wang, "One-step and multi-step ahead stock prediction using backpropagation neural networks," Int. Conf. on Information, Communication, and Signal Processing, pp.1-5, 2013.
11 F. Wang, Z. Zhao, X. Li, and H. Zhang, "Stock volatility prediction using multi-kernel learning based extreme learning machine," Int. Joint Conf. on Neural Networks, pp.3078-3085, 2014.
12 Y. Xu, Z. Li, and L. Luo, "A study on feature selection for the trend prediction of stock trading price," Int. Conf. on Computational and Information Sciences, pp.579-582, 2013.
13 https://en.wikipedia.org/wiki/Robo-advisor
14 http://www.ratestbed.kr/portal/main/main.do
15 E. Hoseinzade and S. Haratizadeh, "CNNpred: CNN-based stock market prediction using a diverse set of variables," Expert Systems with Applications, Vol.129, pp.273-285, 2019.   DOI
16 W. Chiang, D. ENke, T. Wu, and R. Wang, "An adaptive stock index trading decision support system," Expert Systems with Applications, Vol.59, pp.195-207, 2016.   DOI
17 J. Zhang, S. Cui, Y. Xu, Q. Li, and T. Li, "A novel data-driven stock price trend prediction system," Expert Systems with Applications, Vol.97, pp.60-69, 2018.   DOI
18 Y. Chen and Y. Hao, "Integrating principle component analysis and weighted support vector machine for stock trading signals prediction," Neurocomputing, Vol.321, pp.381-402, 2018.   DOI
19 C. Tsai and Y. Hsiao, "Combining multiple feature selection methods for stock prediction: Union, intersection, and multi-intersection approaches," Decision Support Systems, Vol.50, pp.258-269, 2010.   DOI
20 Z. Hu, J. Zhu, and K. Tse, "Stocks market prediction using support vector machine," Int. Conf. on Information Management, Innovation Management and Industrial Engineering, pp.115-118, 2013.
21 J. Patel, S. Shah, P. Thakkar, and K. Kotecha, "Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques," Expert Systems with Applications, Vol.42, pp.259-268, 2015.   DOI
22 K. Kim and I. Han, "Genetic algorithms approach to feature discretization in artificial neural networks for the prediction of stock price index," Expert Systems with Applications, Vol.19, pp.125-132, 2000.   DOI
23 https://www.index.go.kr/main.do
24 X. Zhang, Y. Hu, K. Xie, S. Wang, E. Ngai, and M. Liu, "A causal feature selection algorithm for stock prediction modeling," Neurocomputing, Vol.142, pp.48-59, 2014.   DOI
25 K. Kim, "Financial time series forecasting using support vector machine," Neurocomputing, Vol.55, pp.307-319, 2003.   DOI
26 Y. Lin, H. Guo, and J. Hu, "An SVM-based approach for stock market trend prediction," Int. Joint Conf. on Neural Networks, 2013.
27 A. K. Sirohi, P. K. Mahato, and V. Attar, "Multiple kernel learning for stock price direction prediction," IEEE Int. Conf. on Advances in Engineering & Technology Research. 2014.
28 D. Kato and T. Nagao, "Stock prediction using multiple time series of stock prices and news articles," IEEE Symposium on Computers & Informatics, pp.11-16, 2012.
29 Y. Luo, J. Hu, X. Wei, D. Fang, and H. Shao, "Stock trends prediction based on hypergraph modeling clustering algorithm," IEEE Int. Conf. on Progress in Informatics and Computing, pp.27-31, 2014.
30 A. Oztekin, R. Kizilaslan, S. Freund, and A. Iseri, "A data analytic approach to forecasting daily stock returns in an emerging market," European Journal of Operational Research, Vol.253, pp.697-710, 2016.   DOI
31 M. Lee, "Using support vector machine with hybrid feature selection method to the stock trend prediction," Expert Systems with Applications, Vol.36, pp.10896-10904, 2009.   DOI
32 L. Ni, Z. Ni, and Y. Gao, "Stock trend prediction based on fractal feature selection and support vector machine," Expert System with Applications, Vol.38, pp.5569-5576, 2011.   DOI
33 D. Kumar, S. S. Meghwani, and M. Thakur, "Proximal support vector machine based hybrid prediction models for trend forecasting in financial markets," Journal of Computational Science, Vol.17, pp.1-13, 2016.   DOI