Browse > Article

The Design of Granular-based Radial Basis Function Neural Network by Context-based Clustering  

Park, Ho-Sung (수원대 산업기술연구소)
Oh, Sung-Kwun (수원대 공대 전기공학과)
Publication Information
The Transactions of The Korean Institute of Electrical Engineers / v.58, no.6, 2009 , pp. 1230-1237 More about this Journal
Abstract
In this paper, we develop a design methodology of Granular-based Radial Basis Function Neural Networks(GRBFNN) by context-based clustering. In contrast with the plethora of existing approaches, here we promote a development strategy in which a topology of the network is predominantly based upon a collection of information granules formed on a basis of available experimental data. The output space is granulated making use of the K-Means clustering while the input space is clustered with the aid of a so-called context-based fuzzy clustering. The number of information granules produced for each context is adjusted so that we satisfy a certain reconstructability criterion that helps us minimize an error between the original data and the ones resulting from their reconstruction involving prototypes of the clusters and the corresponding membership values. In contrast to "standard" Radial Basis Function neural networks, the output neuron of the network exhibits a certain functional nature as its connections are realized as local linear whose location is determined by the values of the context and the prototypes in the input space. The other parameters of these local functions are subject to further parametric optimization. Numeric examples involve some low dimensional synthetic data and selected data coming from the Machine Learning repository.
Keywords
Granular-based RBF NNs; Receptive fields; Fuzzy clustering; Context-based fuzzy clustering; Information granules;
Citations & Related Records

Times Cited By SCOPUS : 0
연도 인용수 순위
  • Reference
1 M. Han and J Xi, 'Efficient clustering of radial basis perceptron neural network for recognition,' Pattern Recognition, Vol. 37, pp. 2059-2067, 2004   DOI   ScienceOn
2 J. Moody and C. J. Darken, .Fast learning in networks of locally tuned processing units,. Neural Computation, Vol. 1, pp. 281 -294, 1989   DOI
3 K. Mali and S. Mitra, 'Symbolic classification, clustering and fuzzy radial basis function network,' Fuzzy Sets and Systems, Vol. 152, pp. 553-564, 2005   DOI   ScienceOn
4 W. Pedrycz, 'Conditional fuzzy c-means,' Pattern Recognition Letters, Vol. 17, pp. 625-631, 1996   DOI   ScienceOn
5 W. Pedrycz, M. G. Chun, and G. Succi, 'N4: computing with neural receptive fields,' Neurocomputing, Vol. 55, pp. 383-401, 2003   DOI   ScienceOn
6 Y. Tan, J. Wang, and J. M. Zurada, 'Nonlinear blind source separation using a radial basis function network,' IEEE Trans. Neural Networks, Vol. 12, No.1, pp. 124-134, 2001   DOI   ScienceOn
7 J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum Press, New York, 1981
8 S. K. Oh, W. Pedrycz, and H. S. Park, 'Genetically optimized fuzzy polynomial neural networks,' IEEE Trans. fuzzy systems, Vol. 14, No.1, pp. 125-144, 2006   DOI   ScienceOn
9 M. Wallace, N. Tsapatsoulis, and S. Kollias, 'Intelligent initialization of resource allocating RBF networks,' Neural Networks, Vol. 18, pp. 117-122, 2005   DOI   ScienceOn
10 S. M. Loone and G. Irwin, 'Improving neural network training solutions using regularization,' Neurocomputing, Vol. 37, pp. 71-90, 2001   DOI   ScienceOn
11 W Pedrycz, 'Conditional fuzzy clustering in the design of radial basis function neural networks,' IEEE Trans. Neural Networks, Vol. 9, No.4, pp. 601-612, 1998   DOI   ScienceOn
12 N. B. Karayiannis, 'Reformulated radial basis neural networks trained by gradient descent,' IEEE Trans. Neural Networks, Vol. 10, No.3, pp. 657-671, 1999   DOI   ScienceOn
13 W. Pedrycz and K. C. Kwak, 'The development of incremental models,' IEEE Trans. Fuzzy Systems, Vol. 15, No.3, pp. 507-518, 2007   DOI   ScienceOn
14 C. C. Lee, P. C. Chung, J. R. Tsai, and C. I. Chang, 'Robust radial basis function neural networks,' IEEE Trans. Syst. Man Cybern. Part B, Vol. 29, No.6, pp. 674-685, 1999   DOI   ScienceOn
15 J. M. Vilaplana, J. L. P. Molina, and J. L. Coronado, 'Hyper RBF model for accurate reaching In redundant robotic systems,' Neurocomputing, Vol. 61, pp. 495-501, 2004   DOI   ScienceOn
16 S. J. Lee and C. L. Hou, .An ART-based construction of RBF networks,. IEEE Trans. Neural Networks, Vol. 13, No.6, pp. 1308-1321, 2002   DOI   ScienceOn
17 H. S. Park, W. Pedrycz, and S. K. Oh, 'Evolutionary design of hybrid self-rganizing fuzzy polynomial neural networks with the aid of information granulation,' Expert Systems with Applications, Vol. 33, pp. 830-846, 2007   DOI   ScienceOn
18 C. Harpham and C. W. Dawson, .The effect of different basis functions on a radial basis function network for time series prediction: a comparative study,. Neurocomputing, Vol. 69, pp. 2161-2170, 2006   DOI   ScienceOn