Asia pacific journal of information systems

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지

Customer Level Classification Model Using Ordinal Multiclass Support Vector Machines

  • Kim, Kyoung-Jae (Department of Management Information Systems, Dongguk University) ;
  • Ahn, Hyun-Chul (School of Management Information Systems, Kookmin University)
  • Published : 2010.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Conventional Support Vector Machines (SVMs) have been utilized as classifiers for binary classification problems. However, certain real world problems, including corporate bond rating, cannot be addressed by binary classifiers because these are multi-class problems. For this reason, numerous studies have attempted to transform the original SVM into a multiclass classifier. These studies, however, have only considered nominal classification problems. Thus, these approaches have been limited by the existence of multiclass classification problems where classes are not nominal but ordinal in real world, such as corporate bond rating and multiclass customer classification. In this study, we adopt a novel multiclass SVM which can address ordinal classification problems using ordinal pairwise partitioning (OPP). The proposed model in our study may use fewer classifiers, but it classifies more accurately because it considers the characteristics of the order of the classes. Although it can be applied to all kinds of ordinal multiclass classification problems, most prior studies have applied it to finance area like bond rating. Thus, this study applies it to a real world customer level classification case for implementing customer relationship management. The result shows that the ordinal multiclass SVM model may also be effective for customer level classification.

Keywords

References

  1. Ahn, H.C. and Kim, K-J., "Multiclass SVM model with order information," International Journal of Fuzzy Logic and Intelligent Systems, Vol. 6, No.4, 2006, pp. 331-334. https://doi.org/10.5391/IJFIS.2006.6.4.331
  2. Ahn, H.C., Kim, K-J., and Han, I., "Hybrid genetic algorithms and case-based reasoning systems for customer classification," Expert Systems, Vol. 23, No.3, 2006, pp. 127-144. https://doi.org/10.1111/j.1468-0394.2006.00329.x
  3. Ahn, H.C., Kim, K-J., and Han, I., "A casebased reasoning system with the two-dimensional reduction technique for customer classification," Expert Systems with Applications, Vol. 32, 2007, pp. 1011-1019. https://doi.org/10.1016/j.eswa.2006.02.021
  4. Bounds, D. and Ross, D., "Forecasting customer response with neural networks," Handbook of neural computation, 1997, pp. 1-7.
  5. Chang, C.-C. and Lin, C.-J., "LIBSVM : a library for support vector machines," Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm/, 2001.
  6. Coenen, F., Swinnen, G., Vanhoof, K and Wets, G., "The improvement of response modeling: combining rule-induction and case-based reasoning," Expert Systems with Applications, Vol. 18, 2000, pp. 307-313. https://doi.org/10.1016/S0957-4174(00)00012-9
  7. Friedman, J., "Another approach to polychromous classification," Technical Report, Stanford Univ., 1996.
  8. Hsu, C-W. and Lin, C.-J., "A comparison of methods for multiclass support vector machines," IEEE Transactions on Neural Networks, Vol. 13, No.2, 2002a, pp. 415-425. https://doi.org/10.1109/72.991427
  9. Hsu, C-W. and Lin, C.-J., "A simple decomposition method for support vector machines," Machine Learning, Vol. 46, 2002b, pp. 291-314. https://doi.org/10.1023/A:1012427100071
  10. Hsu, C-W. and Lin, C.-J., "BSVM : a SVM library for the solution of large classification and regression problems," Software available at http://www.csie.ntu.edu.tw/~cj lin/bsvm/,2006.
  11. Kim, D., Lee, H. and Cho, S., "Response modeling with support vector regression," Expert Systems with Applications, Vol. 34, 2008, pp. 1102-1108. https://doi.org/10.1016/j.eswa.2006.12.019
  12. Kim, K, "Financial time series forecasting using support vector machines," Neurocomputing, Vol. 55, No. 1/2, 2003, pp. 307-319. https://doi.org/10.1016/S0925-2312(03)00372-2
  13. Kre$\beta$el, U., "Pairwise classification and support vector machines," In Scholkopf, B., Burges, C. and Smola, A.J.: Advances in Kernel Methods: Support Vector Learning, Chapter 15. MIT Press. Cambridge, MA, 1999, pp. 255-268.
  14. Kwon, Y.S., Han, I. and Lee, K.C., "Ordinal pairwise partitioning (OPP) approach to neural networks training in bond rating," Intelligent Systems in Accounting, Finance and Management, Vol. 6, 1997, pp. 23-40. https://doi.org/10.1002/(SICI)1099-1174(199703)6:1<23::AID-ISAF113>3.0.CO;2-4
  15. Lee, H. and Cho, S., "Focusing on non-respondents: Response modeling with novelty detectors," Expert Systems with Applications, Vol. 33, 2007, pp. 522-530. https://doi.org/10.1016/j.eswa.2006.05.016
  16. Lorena, A.C. and de Carvalho, A.C.P.L.F., "Investigation of strategies for the generatior of multiclass support vector machines," In Nguyen, N.T., Katarzyniak, R.: New Challenges in Applied Intelligence Techniques, Springer-Verlag, Berlin, Germany, 2008, pp. 319-328
  17. Moutinho, L., Curry, B., Davies, F., and Rita, P., Neural Network in Marketing, Routledge, New York, 1994.
  18. Platt, J., "Fast training of support vector machines using sequential minimal optimization," In SchOlkopf, B., Burges, C. and Smola, A (ed.), Advances in Kernel Methods-Support Vector Learning, MIT Press, Cambridge, MA, USA, 1999.
  19. Potharst, R., Kaymak, U., and Pijls W., "Neural networks for target selection in direct marketing," Erasmus University Rotterdam in its series Discussion Paper with number 77, http://ideas.repec.org/s/ dgr/eureri.html, 2001.
  20. Shin, H.J. and Cho, S., "Response modeling with support vector machines," Expert Systems with Applications, Vol. 30, 2006, pp. 746-760. https://doi.org/10.1016/j.eswa.2005.07.037
  21. Statnikov, A, Aliferis, C.F., Tsamardinos, I., Hardin, D., and Levy,S., "A domprehensive evaluation of multicategory classification methods for Mmicroarray gene expression cancer diagnosis," Bioinformatics, Vol. 21, No.5, 2005, pp. 631-543. https://doi.org/10.1093/bioinformatics/bti033
  22. Suh, E.H., Noh, K.C., and Suh, C.K., "Customer list segmentation using the combined response model," Expert Systems with Applications, Vol. 17, No.2, 1999, pp. 89-97. https://doi.org/10.1016/S0957-4174(99)00026-3
  23. Tay, F.E.H. and Cao, L.J., "Application of support vector machines in financial time series forecasting," Omega, Vol. 29, 2001, pp. 309-317. https://doi.org/10.1016/S0305-0483(01)00026-3
  24. Vapnik, V., The Nature of Statistical Learning Theory, New York, NY: Springer-Verlag, 1995.
  25. Viaene, S., Baesens, B., Van Gestel, T., Suykens, J.A.K, Van den Poel, D., Vathienen, J., De Moor, B., and Dedene, G., "Knowledge discovery in a direct marketing case using least squares support vector machines," International Journal of Intelligent Systems, Vol. 16, 2001, pp. 1023-1036. https://doi.org/10.1002/int.1047
  26. Weston, J. and Watkins, C., "Support vector machines for multiclass pattern recognition," Proceedings of the Seventh European Symposium on Artificial Neural Networks, 1999, pp. 219-224.
  27. Wu, Y.-C., Lee, Y.-S. and Yang, J.-C., "Robust and efficient multiclass SVM models for phrase pattern recognition," Pattern Recognition, Vol. 41, No.9, 2008, pp. 2874-2889. https://doi.org/10.1016/j.patcog.2008.02.010