Browse > Article

Genetically Optimized Hybrid Fuzzy Neural Networks Based on Linear Fuzzy Inference Rules  

Oh Sung-Kwun (Department of Electrical Engineering, The University of Suwon)
Park Byoung-Jun (Department of Electrical Electronic & Information Engineering, Wonkwang University)
Kim Hyun-Ki (Department of Electrical Engineering, The University of Suwon)
Publication Information
International Journal of Control, Automation, and Systems / v.3, no.2, 2005 , pp. 183-194 More about this Journal
Abstract
In this study, we introduce an advanced architecture of genetically optimized Hybrid Fuzzy Neural Networks (gHFNN) and develop a comprehensive design methodology supporting their construction. A series of numeric experiments is included to illustrate the performance of the networks. The construction of gHFNN exploits fundamental technologies of Computational Intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the gHFNNs results from a synergistic usage of the genetic optimization-driven hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). In this tandem, a FNN supports the formation of the premise part of the rule-based structure of the gHFNN. The consequence part of the gHFNN is designed using PNNs. We distinguish between two types of the linear fuzzy inference rule-based FNN structures showing how this taxonomy depends upon the type of a fuzzy partition of input variables. As to the consequence part of the gHFNN, the development of the PNN dwells on two general optimization mechanisms: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the gHFNN, the models are experimented with a representative numerical example. A comparative analysis demonstrates that the proposed gHFNN come with higher accuracy as well as superb predictive capabilities when comparing with other neurofuzzy models.
Keywords
Genetically optimized hybrid fuzzy neural networks; computational intelligence; linear fuzzy inference rule-based fuzzy neural networks; genetically optimized polynomial neural networks; design procedure;
Citations & Related Records

Times Cited By Web Of Science : 6  (Related Records In Web of Science)
Times Cited By SCOPUS : 7
연도 인용수 순위
1 S.-K. Oh and W. Pedrycz, 'Fuzzy identification by means of auto-tuning algorithm and its application to nonlinear systems,' Fuzzy Sets and Systems, vol. 115, no. 2, pp. 205-230, 2000   DOI   ScienceOn
2 B.-J. Park, W. Pedrycz, and S.-K. Oh, 'Identification of fuzzy models with the aid of evolutionary data granulation,' IEE Proceedings -Control Theory and Application, vol. 148, no. 5, pp. 406-418, 2001
3 S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Hybrid identification of fuzzy rule-based models,' International Journal of Intelligent Systems, vol. 17, no. 1, pp. 77-103, 2002   DOI   ScienceOn
4 Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer- Verlag, Berlin Heidelberg, 1996
5 S.-K. Oh and W. Pedrycz, 'The design of selforganizing polynomial neural networks,' Information Sciences, vol. 141, no. 3-4, pp. 237- 258, 2002   DOI   ScienceOn
6 T. Ohtani, H. Ichihashi, T. Miyoshi, and K. Nagasaka, 'Orthogonal and successive projection methods for the learning of neurofuzzy GMDH,' Information Sciences, vol. 110, pp. 5-24, 1998   DOI   ScienceOn
7 G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting, and Control, 2nd edition Holden-Day, SanFransisco, 1976
8 E. Kim, H. Lee, M. Park, and M. Park, 'A simply identified Sugeno-type fuzzy model via double clustering,' Information Sciences, vol. 110, pp. 25-39. 1998   DOI   ScienceOn
9 Y. Lin and G. A. Cunningham III, 'A new approach to fuzzy-neural modeling,' IEEE Trans. on Fuzzy Systems, vol. 3, no. 2, pp. 190-197, 1997   DOI   ScienceOn
10 S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Polynomial neural networks architecture: analysis and design,' Computers and Electrical Engineering, vol. 29, no. 6, pp. 653-725, 2003   DOI   ScienceOn
11 S.-K. Oh, W. Pedrycz, and H.-S. Park, 'Hybrid identification in fuzzy-neural networks,' Fuzzy Sets and Systems, vol. 138, no. 2, pp. 399-426, 2003   DOI   ScienceOn
12 H.-S. Park and S.-K Oh, 'Multi-FNN identification by means of HCM clustering and its optimization using genetic algorithms,' Journal of Fuzzy Logic and Intelligent Systems(in Korean), vol. 10, no. 5, pp. 487-496, 2000
13 T. Yamakawa, 'A new effective learning algorithm for a neo fuzzy neuron model,' Proc. of 5th IFSA World Conference, pp. 1017-1020, 1993
14 L. Magdalena, O. Cordon, F. Gomide, F. Herrera, and F. Hoffmann, 'Ten years of genetic fuzzy systems: current framework and new trends,' Fuzzy Sets and Systems, vol. 141, no. 1, pp. 5-31, 2004   DOI   ScienceOn
15 A. G. Ivahnenko, 'The group method of data handling: a rival of method of stochastic approximation,' Soviet Automatic Control, vol. 13, no. 3, pp. 43-55, 1968
16 T. Ohtani, H. Ichihashi, T. Miyoshi, and K. Nagasaka, 'Structural learning with M-apoptosis in neurofuzzy GMHD,' Proc. of the 7th IEEE Iinternational Conference on Fuzzy Systems, pp. 1265-1270, 1998
17 S.-K. Oh, K.-C. Yoon, and H.-K. Kim, 'The design of optimal fuzzy-neural networks structure by means of GA and an aggregate weighted performance index,' Journal of Control, Automation and Systems Engineering(in Korean), vol. 6, no. 3, pp. 273-283, 2000
18 J. H. Holland, Adaptation in Natural and Artificial Systems, The University of Michigan Press, Ann Arbour, 1975
19 S.-K. Oh, Computational Intelligence by Programming focused on Fuzzy, Neural Networks, and Genetic Algorithms (in Korean), Naeha, 2002
20 H. Ichihashi and K. Nagasaka, 'Differential minimum bias criterion for neuro-fuzzy GMDH,' Proc. of 3rd International Conference on Fuzzy Logic, Neural Nets and Soft Computing IIZUKA'94, pp. 171-172, 1994
21 K. S. Narendra and K. Parthasarathy, 'Gradient methods for the optimization of dynamical systems containing neural networks,' IEEE Trans. on Neural Networks, vol. 2, no. 2, pp. 252-262, March 1991   DOI   ScienceOn
22 S.-K. Oh, C.-S. Park, and B.-J. Park, 'On-line modeling of nonlinear process systems using the adaptive fuzzy-neural networks,' The Transactions of the Korean Institute of Electrical Engineers (in Korean), vol. 48A, no. 10, pp. 1293-1302, 1999
23 B.-J. Park and S.-K. Oh, 'The analysis and design of advanced neurofuzzy polynomial networks,' Journal of the Institute of Electronics Engineers of Korea (in Korean), vol. 39-CI, no. 3, pp. 18-31, 2002
24 B.-J. Park, S.-K. Oh, T.-C. Ahn, and H.-K. Kim, 'Optimization of fuzzy systems by means of GA and weighting factor,' The Transactions of the Korean Institute of Electrical Engineers (in Korean), vol. 48A, no. 6, pp. 789-799, June 1999
25 D. E. Goldberg, Genetic Algorithms in Search, Optimization & Machine Learning, Addison- Wesley, 1989
26 B.-J. Park, S.-K. Oh, and S.-W. Jang, 'The design of adaptive fuzzy polynomial neural networks architectures based on fuzzy neural networks and self-organizing networks,' Journal of Control, Automation and Systems Engineering(in Korean), vol. 8, no. 2, pp.126-135, 2002
27 S.-K. Oh, W. Pedrycz, and B.-J. Park, 'Selforganizing neurofuzzy networks based on evolutionary fuzzy granulation,' IEEE Trans. on Systems, Man and Cybernetics-A, vol. 33, no. 2, pp. 271-277, 2003
28 W. Pedrycz and J. F. Peters, Computational Intelligence and Software Engineering, World Scientific, Singapore, 1998