Browse > Article

Genetically Optimized Self-Organizing Polynomial Neural Networks  

박호성 (원광대학 제어계측공학과)
박병준 (원광대학 전기전자공학부)
장성환 (원광대학 전기전자공학부)
오성권 (원광대학 전기전자공학부)
Publication Information
The Transactions of the Korean Institute of Electrical Engineers D / v.53, no.1, 2004 , pp. 40-49 More about this Journal
Abstract
In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Self-Organizing Polynomial Neural Networks(SOPNN), discuss a comprehensive design methodology and carry out a series of numeric experiments. The conventional SOPNN is based on the extended Group Method of Data Handling(GMDH) method and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons (or nodes) located in each layer through a growth process of the network. Moreover it does not guarantee that the SOPNN generated through learning has the optimal network architecture. But the proposed GA-based SOPNN enable the architecture to be a structurally more optimized network, and to be much more flexible and preferable neural network than the conventional SOPNN. In order to generate the structurally optimized SOPNN, GA-based design procedure at each stage (layer) of SOPNN leads to the selection of preferred nodes (or PNs) with optimal parameters- such as the number of input variables, input variables, and the order of the polynomial-available within SOPNN. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization (predictive) abilities of the model. A detailed design procedure is discussed in detail. To evaluate the performance of the GA-based SOPNN, the model is experimented with using two time series data (gas furnace and NOx emission process data of gas turbine power plant). A comparative analysis shows that the proposed GA-based SOPNN is model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.
Keywords
Self-Organizing Polynomial Neural Networks(SOPNN); Polynomial Neuron(PN); aggregate objective function; Genetic Algorithms(GAs); GMDH(Group Method of Data Handling); design procedure; time series data;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K. De Jong. Are genetic algorithms function optimizer? In Proc. of PPSN II(Parallel Problem Solving from Nature), pages 3-13, Amsterdam, North Holland, 1992
2 Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, Berlin Heidelberg, 1996
3 D. E. Box and G. M. Jenkins, Time Series Analysis, Forcasting and Control, California: Holden Day, 1976
4 G. Vachtsevanos, V. Ramani, and T. W. Hwang, 'Prediction of Gas Turbine NOx Emissions using Polynomial Neural Network', Technical Report, Georgia Institute of Technology, Atlanta, 1995
5 S.-K. Oh and W. Pedrycz, 'Identification of Fuzzy Systems by means of an Auto-Tuning Algorithm and Its Application to Nonlinear Systems', Fuzzy sets and Systems, Vol. 115, No.2, pp, 205-230, 2000   DOI   ScienceOn
6 E. T. Kim, H. J. Lee, M. K. Park and M. Park, 'A simple identified Sugeno-type fuzzy model via double clustering', Information Science 1l0, pp. 25-39, 1998   DOI   ScienceOn
7 A. Sugeno and T. Yasukawa, 'A Fuzzy-Logic -Based Approach to Qualitative Modeling', IEEE Trans. Fuzzy Systems, Vol. 1, No.1, pp. 7-31, 1993   DOI   ScienceOn
8 R. M. Tong, 'The evaluation of fuzzy models derived from experimental data', Fuzzy Sets and Systems, Vol. 13, pp. 1-12, 1980   DOI   ScienceOn
9 W. Pedtycz, 'An identification algorithm in fuzzy relational system', Fuzzy Sets and Systems, Vol. 13, pp.153-167, 1984   DOI   ScienceOn
10 C. W. Xu, and Y. Zailu, 'Fuzzy model identification self-learning for dynamic system', IEEE Trans. on Syst, Man, Cybern., Vol. SMC-17, No.4, pp.683-689, 1987   DOI   ScienceOn
11 오성권, '프로그래밍에 의한 컴퓨터지능(퍼지, 신경회로망 및 유전자알고리즘을 중심으로)', 내하출판사, 2002. 8
12 Y. Lin, G. A. Cunningham Ⅲ, 'A new approach to fuzzy-neural modeling', IEEE Trans. Fuzzy Systems Vol. 3, No.2, pp. 190-197, 1995   DOI   ScienceOn
13 T.-C. Ahn, S.-K. Oh, A thesis of emission pattern model about the atmosphere pollution material of a power plant, Electrical Engineering & Science Research Institute. Korea, 1997(in Korean)
14 A. G. Ivakhnenko, G. A. Ivaknenko and J.A. Muller, 'Self-organization of Neural Networks with Active Neurons', Pattern Recognition and Image Analysis, Vol. 4, No.2, pp. 185-196, 1994
15 S.-K. Oh, W. Pedrycz and H.-S. Park, 'Hybrid Identification in Fuzzy-Neural Networks', Fuzzy Sets & Systems, Vol. 138, pp. 399-426, 2003   DOI   ScienceOn
16 A. G. Ivakhnenko and G. A. Ivaknenko, 'The Review of Problems Solvable by Algorithms of the Group Method of Data Handling(GMDH)', Pattern Recognition and Image Analysis, Vol. 5, No.4, pp. 527-535, 1995
17 S.- K. Oh, W. Pedrycz and H.-S. Park, 'Rule-based Multi-FNN Identification with the Aid of Evolutionary Fuzzy Granulation', Journal of Knowledge-Based Systems, 2003(In press)   DOI   ScienceOn
18 H.-S. Park, B.-J. Park and S.-K. Oh, 'Optimal Design of Self-Organizing Polynomial Neural Networks By Means of Genetic Algorithms', Journal of the Research Institute of Engineering Technology Development, Vol. 22, pp. 111-121, 2002
19 V. Sommer, P. Tobias, D. Kohl, H. Sundgreen, and L. Lundstrom, 'Neural networks and abductive networks for chemical sensor signals: A case comparison', Sensors and Actuators, B. 2S, pp. 217-222, 1995   DOI   ScienceOn
20 S. Kleinsteuber and N. Sepehri, 'A polynomial network modeling approach to a class of large-scale hydraulic systems', Computers Elect. Eng. 22, pp. 151-168, 1996   DOI   ScienceOn
21 오성권, 'C 프로그래밍에 의한 퍼지모델 및 제어시스템,' 내하출판사, 2002. 1
22 A. G. Ivakhnenko and H. R. Madala, Inductive Learning Algorithms for Complex Systems Modeling, CRC Press, London, 1994
23 V. Cherkassky, D. Gehring, and F. Mulier, 'Comparison of adaptive methods for function estimation from samples', IEEE Trans. Neural Networks, vol. 7, pp. 969 984, July 1996   DOI   ScienceOn
24 A. G. Ivakhnenko, 'Polynomial theory of complex systems', IEEE Trans. on Systems, Man and Cybernetics, Vol. SMC-1, pp. 364-378, 1971
25 J. A. Dicherson and B. Kosko, 'Fuzzy function approximation with ellipsoidal rules', IEEE Trans. Syst., Man, Cybern, Part B, vol. 26, pp.542 560, Aug. 1996   DOI
26 D. E. Goldberg, Genetic Algorithm in search, Optimization & Machine Learning, Addison wesley, 1989
27 S.-K. Oh and W. Pedrycz, 'The design of self-orgaruzmg Polynomial Neural Networks', Information Science, Vol. 141, pp. 237-258, 2002   DOI   ScienceOn
28 S.-K. Oh, W. Pedrycz and B.-J. Park, 'Polynomial Neural Networks Architecture: Analysis and Design', Computers and Electrical Engineering, Vol. 29, Issue 6, pp. 703-725, 2003   DOI   ScienceOn
29 Holland, J. H., Adatation In Natural and Artificial Systems. The University of Michigan Press, Ann Arbour. 1975