DOI QR코드

DOI QR Code

Design of Data-centroid Radial Basis Function Neural Network with Extended Polynomial Type and Its Optimization

데이터 중심 다항식 확장형 RBF 신경회로망의 설계 및 최적화

  • 오성권 (수원대 공대 전기공학과) ;
  • 김영훈 (수원대 전기공학과) ;
  • 박호성 (수원대 산업기술연구소) ;
  • 김정태 (대진대 공대 전기정보시스템공학과)
  • Received : 2010.09.01
  • Accepted : 2010.11.10
  • Published : 2011.03.01

Abstract

In this paper, we introduce a design methodology of data-centroid Radial Basis Function neural networks with extended polynomial function. The two underlying design mechanisms of such networks involve K-means clustering method and Particle Swarm Optimization(PSO). The proposed algorithm is based on K-means clustering method for efficient processing of data and the optimization of model was carried out using PSO. In this paper, as the connection weight of RBF neural networks, we are able to use four types of polynomials such as simplified, linear, quadratic, and modified quadratic. Using K-means clustering, the center values of Gaussian function as activation function are selected. And the PSO-based RBF neural networks results in a structurally optimized structure and comes with a higher level of flexibility than the one encountered in the conventional RBF neural networks. The PSO-based design procedure being applied at each node of RBF neural networks leads to the selection of preferred parameters with specific local characteristics (such as the number of input variables, a specific set of input variables, and the distribution constant value in activation function) available within the RBF neural networks. To evaluate the performance of the proposed data-centroid RBF neural network with extended polynomial function, the model is experimented with using the nonlinear process data(2-Dimensional synthetic data and Mackey-Glass time series process data) and the Machine Learning dataset(NOx emission process data in gas turbine plant, Automobile Miles per Gallon(MPG) data, and Boston housing data). For the characteristic analysis of the given entire dataset with non-linearity as well as the efficient construction and evaluation of the dynamic network model, the partition of the given entire dataset distinguishes between two cases of Division I(training dataset and testing dataset) and Division II(training dataset, validation dataset, and testing dataset). A comparative analysis shows that the proposed RBF neural networks produces model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

Keywords

References

  1. T. Tagaki and M. sugeno, "Fuzzy identification of system and its applications to modeling and control", IEEE Trans. Syst. Cybern., Vol. 15, No. 1, pp. 116-132, 1985.
  2. H. Nomura, I. Hayashi, and N. Wakami, "A self-tuning method of fuzzy reasoning by method of the steepest descent and its application to moving obstacle avoidance", 6th Fuzzy System Symposium, Tokyo, pp. 423-426, 1990.
  3. M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control system", Science, New Series, Vol. 197, pp. 287-289, 1977.
  4. G. Vachtsevanos, V. Ramani, and T. W. Hwang, "Prediction of gas turbine NOx emissions using polynomial neural network", Technical Report, Georgia Institute of Technology, Atlanta, 1995.
  5. J. S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference systems", IEEE Trans. on Systems, Man, and Cybernetics, Vol. 23, pp. 665-685, 1993. https://doi.org/10.1109/21.256541
  6. L. P. Maguire, B. Roche, T. M. McGinnity, and L. J. McDaid, "Predicting a chaotic time series using a fuzzy neural network", Information Sciences, Vol. 112, pp. 125-136, 1998. https://doi.org/10.1016/S0020-0255(98)10026-9
  7. S. K. Oh, W. Pedrycz, and D. W. Kim, "Hybrid fuzzy polynomial neural networks", Int. J. of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 10, No. 3, pp. 257-280, 2002. https://doi.org/10.1142/S0218488502001478
  8. S. K. Oh, W. Pedrycz, and H. S. Park, "Hybrid identification in fuzzy-neural networks", Fuzzy Sets Syst., Vol. 138, No. 2, pp. 399-426, 2003. https://doi.org/10.1016/S0165-0114(02)00441-4
  9. S. K. Oh, W. Pedrycz, and H. S. Park, "Rule-based multy-FNN identification with the aid of evolutionary fuzzy granulation", J. Knowledge-Based Syst., Vol. 17, No. 1, pp. 1-13, 2004. https://doi.org/10.1016/S0950-7051(03)00047-9
  10. W. Pedrycz and K. C. Kwak, "Linguistic models as a framework of user-centric system modeling", IEEE Transactions on SMC-Part A, Vol. 36, No. 4, pp. 727-745, 2006.
  11. http://archive.ics.uci.edu/ml/datasets/
  12. 백진열, "Type-2 퍼지추론 기반의 다항식 RBF 뉴럴 네트워크에 관한 연구", 수원대학교 공과대학 전기공학과 석사학위논문, 2008.