The Transactions of The Korean Institute of Electrical Engineers (전기학회논문지)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지
DOI QR코드

DOI QR Code

Design of SVM-Based Polynomial Neural Networks Classifier Using Particle Swarm Optimization

입자군집 최적화를 이용한 SVM 기반 다항식 뉴럴 네트워크 분류기 설계

  • Roh, Seok-Beom (Dept. of Electrical and Electronic Engineering, University of Suwon) ;
  • Oh, Sung-Kwun (Dept. of Electrical and Electronic Engineering, University of Suwon)
  • Received : 2018.04.06
  • Accepted : 2018.05.01
  • Published : 2018.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, the design methodology as well as network architecture of Support Vector Machine based Polynomial Neural Network, which is a kind of the dynamically generated neural networks, is introduced. The Support Vector Machine based polynomial neural networks is given as a novel network architecture redesigned with the aid of polynomial neural networks and Support Vector Machine. The generic polynomial neural networks, whose nodes are made of polynomials, are dynamically generated in each layer-wise. The individual nodes of the support vector machine based polynomial neural networks is constructed as a support vector machine, and the nodes as well as layers of the support vector machine based polynomial neural networks are dynamically generated as like the generation process of the generic polynomial neural networks. Support vector machine is well known as a sort of robust pattern classifiers. In addition, in order to enhance the structural flexibility as well as the classification performance of the proposed classifier, multi-objective particle swarm optimization is used. In other words, the optimization algorithm leads to sequentially successive generation of each layer of support vector based polynomial neural networks. The bench mark data sets are used to demonstrate the pattern classification performance of the proposed classifiers through the comparison of the generalization ability of the proposed classifier with some already studied classifiers.

Keywords

References

  1. G. B. Hwang, Q. U. Zhu, C. K. Siew, "Extreme Learning Machine: Thoery and Applicaitons", Neurocomputing, vol. 70, pp. 489-501, 2006 https://doi.org/10.1016/j.neucom.2005.12.126
  2. S.-K. Oh and Pedryza, W, "The Design of Self- Organizing Polynomial Neural Networks", Information Science, vol. 141, pp. 237-258, 2002 https://doi.org/10.1016/S0020-0255(02)00175-5
  3. S.-K. Oh and W. Pedrycz, "Identification of Fuzzy Systems by means of an Auto-Tuning Algorithm and Its Application to Nonlinear Systems", Fuzzy sets and Systems, vol. 115, no. 2, pp. 205-230, 2000. https://doi.org/10.1016/S0165-0114(98)00174-2
  4. S.-K. Oh, W. Pedrycz, and D.-W. Kim, "Hybrid Fuzzy Polynomial Neural Networks", Int. J. of Uncertainty, Fuzziness and Knowledge-Based Systems, vol. 10, no. 3, pp. 257-280, June, 2002. https://doi.org/10.1142/S0218488502001478
  5. S.-K. Oh and W. Pedrycz, "The design of self-organizing Polynomial Neural Networks", Information Science, vol. 141, pp. 237-258, 2002. https://doi.org/10.1016/S0020-0255(02)00175-5
  6. S.-K. Oh, W. Pedrycz and B.-J. Park, "Polynomial Neural Networks Architecture: Analysis and Design", Computers and Electrical Engineering, vol. 29, Issue 6, pp. 703-725, 2003. https://doi.org/10.1016/S0045-7906(02)00045-9
  7. C. Cortes and V. N. Vapnik, "Support-vector networks", Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995 https://doi.org/10.1007/BF00994018
  8. T. B. Trafalis and H. Ince, "Support vector machine for regression and applications to financial forecasting", in Proc. IEEE-INNSENNS Int. Joint Conf. Neural Netw., vol. 6, pp. 348-353, 2000
  9. W. S. Noble, "Support vector machine application in computational biology", in Kernel Methods in Computational Biology, B Schokopf, K. Tsuda, and J.-P. Vert, Eds. Cambridge, MA, USA: MIT Press, 2004
  10. K.-S. Goh, E.-Y. Chang, and B.-T. Li, "Using one-class and two-class SVMs for multiclass image annotation", IEEE Trans. Knowl. Data Eng., vol. 17, no. 10, pp. 1333-1346, 2005 https://doi.org/10.1109/TKDE.2005.170
  11. D. Isa, L.-H. Lee, V. P. Kallimani, and R. RajKumar, "Text document preprocessing with the Bayes formula for classification using the support vector machine", IEEE Trans.Knowl. Data Eng., vol. 20, no. 9, pp. 1264-1272, 2008 https://doi.org/10.1109/TKDE.2008.76
  12. M. B. Karstan, "Kernel methods in bioinformatics", in Handbook of Statistical Bioinformatics, Part 3, New York, NY, USA: Springer, pp. 317-334, 2011
  13. R. E. Perez and K. Behdinan, "Particle swarm approach for structural design optimization", Computer & Structures, vol. 85, Issues 19-20, pp. 1579-1588, 2007 https://doi.org/10.1016/j.compstruc.2006.10.013
  14. C. A. Coello Coello, and M. S. Lechuga, "MOPSO: A Proposal for Multiple Objective Particle Swarm Optimization," Proceedings of the 2002 IEEE Congress on Evolutionary Computation, pp. 12-17.
  15. E. Frank, M. A. Hall, and I. H. Witten, The WEKA Workbench. Online Appendix for "Data Mining: Practical Machine Learning Tools and Techniques", Morgan Kaufmann, Fourth Edition, 2016.