Browse > Article
http://dx.doi.org/10.5370/KIEE.2011.60.3.639

Design of Data-centroid Radial Basis Function Neural Network with Extended Polynomial Type and Its Optimization  

Oh, Sung-Kwun (수원대 공대 전기공학과)
Kim, Young-Hoon (수원대 전기공학과)
Park, Ho-Sung (수원대 산업기술연구소)
Kim, Jeong-Tae (대진대 공대 전기정보시스템공학과)
Publication Information
The Transactions of The Korean Institute of Electrical Engineers / v.60, no.3, 2011 , pp. 639-647 More about this Journal
Abstract
In this paper, we introduce a design methodology of data-centroid Radial Basis Function neural networks with extended polynomial function. The two underlying design mechanisms of such networks involve K-means clustering method and Particle Swarm Optimization(PSO). The proposed algorithm is based on K-means clustering method for efficient processing of data and the optimization of model was carried out using PSO. In this paper, as the connection weight of RBF neural networks, we are able to use four types of polynomials such as simplified, linear, quadratic, and modified quadratic. Using K-means clustering, the center values of Gaussian function as activation function are selected. And the PSO-based RBF neural networks results in a structurally optimized structure and comes with a higher level of flexibility than the one encountered in the conventional RBF neural networks. The PSO-based design procedure being applied at each node of RBF neural networks leads to the selection of preferred parameters with specific local characteristics (such as the number of input variables, a specific set of input variables, and the distribution constant value in activation function) available within the RBF neural networks. To evaluate the performance of the proposed data-centroid RBF neural network with extended polynomial function, the model is experimented with using the nonlinear process data(2-Dimensional synthetic data and Mackey-Glass time series process data) and the Machine Learning dataset(NOx emission process data in gas turbine plant, Automobile Miles per Gallon(MPG) data, and Boston housing data). For the characteristic analysis of the given entire dataset with non-linearity as well as the efficient construction and evaluation of the dynamic network model, the partition of the given entire dataset distinguishes between two cases of Division I(training dataset and testing dataset) and Division II(training dataset, validation dataset, and testing dataset). A comparative analysis shows that the proposed RBF neural networks produces model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.
Keywords
Radial Basis Function(RBF) Neural networks; Data-centroid; Extended polynomial type; K-means clustering; Particle Swarm Optimization(PSO); PSO-based design procedure; Standard least square method; Nonlinear process data;
Citations & Related Records

Times Cited By SCOPUS : 0
연도 인용수 순위
  • Reference
1 S. K. Oh, W. Pedrycz, and H. S. Park, "Hybrid identification in fuzzy-neural networks", Fuzzy Sets Syst., Vol. 138, No. 2, pp. 399-426, 2003.   DOI   ScienceOn
2 S. K. Oh, W. Pedrycz, and H. S. Park, "Rule-based multy-FNN identification with the aid of evolutionary fuzzy granulation", J. Knowledge-Based Syst., Vol. 17, No. 1, pp. 1-13, 2004.   DOI   ScienceOn
3 W. Pedrycz and K. C. Kwak, "Linguistic models as a framework of user-centric system modeling", IEEE Transactions on SMC-Part A, Vol. 36, No. 4, pp. 727-745, 2006.
4 http://archive.ics.uci.edu/ml/datasets/
5 G. Vachtsevanos, V. Ramani, and T. W. Hwang, "Prediction of gas turbine NOx emissions using polynomial neural network", Technical Report, Georgia Institute of Technology, Atlanta, 1995.
6 J. S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference systems", IEEE Trans. on Systems, Man, and Cybernetics, Vol. 23, pp. 665-685, 1993.   DOI   ScienceOn
7 H. Nomura, I. Hayashi, and N. Wakami, "A self-tuning method of fuzzy reasoning by method of the steepest descent and its application to moving obstacle avoidance", 6th Fuzzy System Symposium, Tokyo, pp. 423-426, 1990.
8 L. P. Maguire, B. Roche, T. M. McGinnity, and L. J. McDaid, "Predicting a chaotic time series using a fuzzy neural network", Information Sciences, Vol. 112, pp. 125-136, 1998.   DOI   ScienceOn
9 S. K. Oh, W. Pedrycz, and D. W. Kim, "Hybrid fuzzy polynomial neural networks", Int. J. of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 10, No. 3, pp. 257-280, 2002.   DOI   ScienceOn
10 T. Tagaki and M. sugeno, "Fuzzy identification of system and its applications to modeling and control", IEEE Trans. Syst. Cybern., Vol. 15, No. 1, pp. 116-132, 1985.
11 M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control system", Science, New Series, Vol. 197, pp. 287-289, 1977.
12 백진열, "Type-2 퍼지추론 기반의 다항식 RBF 뉴럴 네트워크에 관한 연구", 수원대학교 공과대학 전기공학과 석사학위논문, 2008.