A New Approach of Self-Organizing Fuzzy Polynomial Neural Networks Based on Information Granulation and Genetic Algorithms

정보 입자화와 유전자 알고리즘에 기반한 자기구성 퍼지 다항식 뉴럴네트워크의 새로운 접근

  • Published : 2006.02.01

Abstract

In this paper, we propose a new architecture of Information Granulation based genetically optimized Self-Organizing Fuzzy Polynomial Neural Networks (IG_gSOFPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially information granulation and genetic algorithms. The proposed IG_gSOFPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional SOFPNNs. The design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial of the consequent part of fuzzy rules, and a collection of the specific subset of input variables) and addresses specific aspects of parametric optimization. In addition, the fuzzy rules used in the networks exploit the notion of information granules defined over system's variables and formed through the process of information granulation. That is, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. This granulation is realized with the aid of the hard c-menas clustering method (HCM). To evaluate the performance of the IG_gSOFPNN, the model is experimented with using two time series data(gas furnace process and NOx process data).

Keywords

References

  1. A. G. Ivakhnenko, 'Polynomial theory of complex systems', IEEE Trans. on Systems, Man and Cybernetics, Vol. SMC-1, pp. 364-378, 1971
  2. A. G. Ivakhnenko and G. A. Ivakhnenko, 'The Review of Problems Solvable by Algorithms of the Group Method of Data Handing (GMDH)', Pattern Recognition and Image Analysis, Vol. 5, No. 4, pp. 527-535, 1995
  3. S. K. Oh and W. Pedrycz, 'The design of Self-organizning Polynomial Neural Networks', Information Science, Vol. 141, pp. 237-258, 2002 https://doi.org/10.1016/S0020-0255(02)00175-5
  4. S. K. Oh, W. Pedrycz and B. J. Park, 'Polynomial Neural Networks Architecture: Analysis and Design', Computers and Electrical Engineering, Vol. 29, Issue 6, pp. 703-725, 2003 https://doi.org/10.1016/S0045-7906(02)00045-9
  5. 박호성, 오성권, 윤양웅, '퍼지 뉴럴 네트워크 구조로의 새로운 모델링 연구', 제어.자동화.시스템 공학회, Vol. 7, No. 8, pp. 664-673, 2001. 8
  6. 박호성, 박건준, 이동윤, 오성권, '경쟁적 퍼지다항식 뉴런에 기초한 고급 자기구성 뉴럴네트워크', 대한전기학회, Vol. 53D, No. 3, pp. 135-144, March, 2004
  7. Holland, J. H., Adaptation In Natural and Artficial Systems, The University of Michigan Press, Ann Arbour. 1975
  8. D. E. Goldberg, Genetic Alogrithm in Search, Optimization & Machine Learning, Addison wesley, 1989
  9. K. De Jong. Are genetic alogrithms function optimizers? In Proc. of PPSN II (Parallel Problem Solving from Nature), pages 3-13, Amsterdam, North Holland, 1992
  10. R. Moore, Interval analysis, Prentice-Hall, Englewood Cliffs, NJ, 1966
  11. R. Moore (Ed.), Reliability in computing, Academic Press, New York, 1988
  12. L. A. Zadeh, in: L.A. Zadeh, R. Yager, et al., (Eds.), Fuzzy Sets and Applications: Selected Papers, Wiley, New York, 1987
  13. J. C. BEZDEK, Pattern Recognition with Fuzzy Objective Function Algorithms, New York, Plenum, 1981
  14. D. E. Box and G. M. Jenkins, Time Series Analysis, Forcasting and Control, California: Holden Day, 1976
  15. W. Pedrycz, 'An identification algorithm in fuzzy relational system', Fuzzy Sets Syst., Vol. 13, pp.153-167, 1984 https://doi.org/10.1016/0165-0114(84)90015-0
  16. J. Leski and E. Czogala, 'A new artifical neural networks based fuzzy inference system with moving consquents in if-then rules and seleted applications', Fuzzy Sets and Systems, Vol. 108, pp. 289-297, 1999 https://doi.org/10.1016/S0165-0114(97)00314-X
  17. W. Pedrycz, G. Vukovich, 'Granular neural networks', Neurocomputing, Vol. 36, pp. 205-224, 2001 https://doi.org/10.1016/S0925-2312(00)00342-8
  18. Y. Lin, G. A. Cunningham III, 'A new approach to fuzzy-neural modeling', IEEE Trans. Fuzzy Systems, Vol. 3, No. 2, pp. 190-197, 1995 https://doi.org/10.1109/91.388173
  19. Yin Wang and Gang Rong, 'A self-organizing neural-network-based fuzzy system', Fuzzy Sets and Systems, vol. 103, pp. 1-11, 1999 https://doi.org/10.1016/S0165-0114(97)00196-6
  20. G. Vachtsevanos, V. Ramani and T. W. Hwang, 'Prediction of Gas Turbine NOx Emissions using Polynomial Neural Network', Technical Report, Georgia Institute of Technology, Atlanta, 1995
  21. S. K. Oh, W. Pedrycz and H. S. Park, 'Hybrid Identification in Fuzzy-Neural Networks', Fuzzy Sets and Systems, Vol. 138, Issue 2, pp. 399-426, 2003 https://doi.org/10.1016/S0165-0114(02)00441-4
  22. 오성권, 프로그래밍에 의한 컴퓨터지능, 내하 출판사, 2002. 9
  23. 오성권, 프로그래밍에 의한 하이브리드 퍼지추론 시스템, 내하 출판사, 2005. 10
  24. 오성권, 하이브리드 퍼지추론시스템 국제 저널 논문집, 내하 출판사, 2005. 10