DOI QR코드

DOI QR Code

예측성향을 고려한 비대칭 서포트벡터 회귀의 적용

Application of Asymmetric Support Vector Regression Considering Predictive Propensity

  • 이동주 (공주대학교 산업시스템공학과)
  • Lee, Dongju (Department of Industrial & Systems Engineering, Kongju National University)
  • 투고 : 2022.02.24
  • 심사 : 2022.03.14
  • 발행 : 2022.03.31

초록

Most of the predictions using machine learning are neutral predictions considering the symmetrical situation where the predicted value is not smaller or larger than the actual value. However, in some situations, asymmetric prediction such as over-prediction or under-prediction may be better than neutral prediction, and it can induce better judgment by providing various predictions to decision makers. A method called Asymmetric Twin Support Vector Regression (ATSVR) using TSVR(Twin Support Vector Regression), which has a fast calculation time, was proposed by controlling the asymmetry of the upper and lower widths of the ε-tube and the asymmetry of the penalty with two parameters. In addition, by applying the existing GSVQR and the proposed ATSVR, prediction using the prediction propensities of over-prediction, under-prediction, and neutral prediction was performed. When two parameters were used for both GSVQR and ATSVR, it was possible to predict according to the prediction propensity, and ATSVR was found to be more than twice as fast in terms of calculation time. On the other hand, in terms of accuracy, there was no significant difference between ATSVR and GSVQR, but it was found that GSVQR reflected the prediction propensity better than ATSVR when checking the figures. The accuracy of under-prediction or over-prediction was lower than that of neutral prediction. It seems that using both parameters rather than using one of the two parameters (p_1,p_2) increases the change in the prediction tendency. However, depending on the situation, it may be better to use only one of the two parameters.

키워드

참고문헌

  1. Huang, X., Shi, L., Pelckmans, K., and Suykens, J., Asymmetric є-tube support vector regression, Computational Statistics and Data Analysis, 2014, Vol. 77, pp. 371-382. https://doi.org/10.1016/j.csda.2014.03.016
  2. Peng X., TSVR: An efficient Twin Support Vector Machine for regression, Neural Networks, 2010, Vol. 23, pp. 365-372. https://doi.org/10.1016/j.neunet.2009.07.002
  3. Lee, D.J., Tool Lifecycle Optimization using ν- Asymmetric Support Vector Regression, Journal of the Society of Korea Industrial and Systems Engineering, 2020, Vol. 43, No. 4, pp. 208-216. https://doi.org/10.11627/jkise.2020.43.4.208
  4. Lee, D.J., and Choi, S.J., Generalized Support Vector Quantile Regression, Journal of the Society of Korea Industrial and Systems Engineering, 2020, Vol. 43, No. 4, pp. 107-115. https://doi.org/10.11627/jkise.2020.43.4.107
  5. Singh, M. Chadha, J., Ahuja, P., and Jayadeva, Chandra, S., Reduced Twin Support Vector Regression, Neurocomputing, 2011, Vol. 74, pp. 1474-1477. https://doi.org/10.1016/j.neucom.2010.11.003
  6. Vapnik, V., Statistical Learning Theory, New York, NY: Wiley, 1998.
  7. Wang, S., Huang, X., and Yan, Y., A neural network of smooth hinge functions, IEEE Trans. Neural Netw., 2010, Vol. 21, No. 9, pp. 1381-1395. https://doi.org/10.1109/TNN.2010.2053383
  8. Wang, H. and Xu, Y., Scaling up twin support vector regression with safe screening rule, Information Science, 2018, Vol. 465, pp. 174-190. https://doi.org/10.1016/j.ins.2018.07.008
  9. Wu, D., Jennins, C., Terpenny, J., Gao, R.X., and Kumara, S., A Comparative Study on Machine Learning Algorithms for Smart Manufacturing: Tool Wear Prediction Using Random Forests, Journal of Manu. Sci. and Engineering, 2017, Vol. 139, No. 7, pp. 1-10.
  10. Wu, J., Wang, Y.-G., Tian, Y.-C., Burrage, K., and Cao, T., Support Vector Regression with Asymmetric Loss for Optimal Electric Load Forecasting, Energy, 2021, Vol. 223, 119969. https://doi.org/10.1016/j.energy.2021.119969
  11. Xu, Y., Li, X., Pan, X., and Yang, Z., Asymmetric ν-twin support vector regression, Neural Comput. & Appli., 2018, Vol. 30, pp. 3799-3814. https://doi.org/10.1007/s00521-017-2966-z
  12. Xu, Y. and Wang, L., A weighted twin support vector regression, Knowledge-Based Systems, 2012, Vol. 33, pp. 92-101. https://doi.org/10.1016/j.knosys.2012.03.013