A Novel Soft Computing Technique for the Shortcoming of the Polynomial Neural Network

  • Kim, Dongwon (Department of Electrical Engineering, Korea University) ;
  • Huh, Sung-Hoe (Department of Electrical Engineering, Korea University) ;
  • Seo, Sam-Jun (Department of Electrical and Electronic Engineering, Anyang University) ;
  • Park, Gwi-Tae (Department of Electrical Engineering, Korea University)
  • Published : 2004.06.01

Abstract

In this paper, we introduce a new soft computing technique that dwells on the ideas of combining fuzzy rules in a fuzzy system with polynomial neural networks (PNN). The PNN is a flexible neural architecture whose structure is developed through the modeling process. Unfortunately, the PNN has a fatal drawback in that it cannot be constructed for nonlinear systems with only a small amount of input variables. To overcome this limitation in the conventional PNN, we employed one of three principal soft computing components such as a fuzzy system. As such, a space of input variables is partitioned into several subspaces by the fuzzy system and these subspaces are utilized as new input variables to the PNN architecture. The proposed soft computing technique is achieved by merging the fuzzy system and the PNN into one unified framework. As a result, we can find a workable synergistic environment and the main characteristics of the two modeling techniques are harmonized. Thus, the proposed method alleviates the problems of PNN while providing superb performance. Identification results of the three-input nonlinear static function and nonlinear system with two inputs will be demonstrated to demonstrate the performance of the proposed approach.

Keywords

References

  1. IEEE Trans. on Syst. Man Cybern. v.SMC-1 no.1 Polynomial theory of complex systems A. G. Ivakhnenko
  2. Theoretical Systems Ecology: Advance and Case Studies Identification of the mathematical model of a complex system by the selforganization method A. G. Ivakhnenko;G. I. Krotov;N. A. Ivakhnenko;E. Halfon(ed.)
  3. Sov. Automat. Contr. v.7 Longterm prediction by GMDH algorithms using the unbiased criterion and the balance-of-variables criterion A. G. Ivakhnenko;N. A. Ivakhnenko
  4. Sov. Automat. Contr. v.8 Longterm prediction by GMDH algorithms using the unbiased criterion and the balance-of-variables criterion, part2 A. G. Ivakhnenko;N. A. Ivakhnenko
  5. Self-Organizing Methods in Modeling, GMDH Type-Algorithms S. J. Farlow
  6. Master's thesis, Dept. Control Instrum., Wonkwang Univ. Evolutionary Design of Self-organizing Polynomial Neural Networks D. W. Kim
  7. Trans. KIEE v.49D no.3 A study on the optimal design of polynomial neural networks structure S. K. Oh;D. W. Kim;B. J. Park
  8. Inf. Sci. v.141 The design of self-organizing polynomial neural networks S. K. Oh;W. Pedrycz https://doi.org/10.1016/S0020-0255(02)00175-5
  9. IEEE Trans. on Fuzzy Syst. v.1 no.1 A fuzzy-logic-based approach to qualitative modeling M. Sugeno;T. Yasukawa https://doi.org/10.1109/TFUZZ.1993.390281
  10. Journal of KIEE v.11 no.2 A study on the self-organizing fuzzy polynomial neural networks D. W. Kim;S. K. Oh;H. K. Kim
  11. IEEE Trans. on Syst. Man. Cybern. v.23 no.3 ANFIS: Adaptive-networks-based fuzzy inference system J. S. Jang https://doi.org/10.1109/21.256541
  12. Neuro-Fuzzy AND Soft Computing: A Computational Approach to Learning and Machine Intelligence J. S. Jang;C. T. Sun;E. Mizutani
  13. Int. J. Approx. Reasoning v.5 no.3 NN-driven fuzzy reasoning H. Takagi;I, Hayashi https://doi.org/10.1016/0888-613X(91)90008-A
  14. Fuzzy Sets Syst. v.28 Structure identification of fuzzy model M. Sugeno;G. T. Kang https://doi.org/10.1016/0165-0114(88)90113-3
  15. Tran. Soc. Instrum. Control Eng. v.22 no.9 Revised GMDH algorithm estimating degree of the complete polynomial T. Kondo
  16. IEEE Trans. on Fuzzy Syst. v.9 no.4 A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks S. Wu;M. J. Er;Y. Gao https://doi.org/10.1109/91.940970
  17. IEEE Trans. on Neural Netw. v.3 no.5 On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm S. I. Horikawa https://doi.org/10.1109/72.159069
  18. IEEE Trans. on Fuzzy Syst. v.5 no.3 A new approach to fuzzy modeling E. T. Kim;M. K. Park;S. H. Ji;M. Park https://doi.org/10.1109/91.618271
  19. Inf. Sci. v.110 A simply identified Sugeno-type fuzzy model via double clustering E. Kim;H. Lee;M. Park;M. Park https://doi.org/10.1016/S0020-0255(97)10083-4
  20. Fuzzy Sets Syst. v.106 About the use of fuzzy clustering techniques for fuzzy model identification A. F. Gomez-Skarmeta;M. Delgado;M. A. Vila https://doi.org/10.1016/S0165-0114(97)00276-5
  21. IEE Proc.-Control Theory Appl. v.142 no.6 Linguistic fuzzy model identification H. S. Hwang;K. B. Woo https://doi.org/10.1049/ip-cta:19952254
  22. IEEE Trans. on Fuzzy Syst. v.3 no.2 A new approach to fuzzy-neural system modeling Y. Lin;G. A. Cunningham III https://doi.org/10.1109/91.388173
  23. Proc. of Fuzz-IEEE Combination of fuzzy rule based model and self-organizing approximator technique:a new approach to nonlinear system modeling D. W. Kim;J. H. Park;G. T. Park
  24. Proc. of IEEE Int. Conf. Syst. Man. Cybern Hybrid architecture of the neural networks and self-organizing approximator technique: a new approach to nonlinear system modeling D. W. Kim;G. T. Park
  25. IEEE Trans. on Fuzzy Syst. v.10 no.5 Fuzzy polynomial neural network: hybrid architectures of fuzzy modeling B. J. Park;W. Pedrycz;S. K. Oh https://doi.org/10.1109/TFUZZ.2002.803495