• Transactions on Control, Automation and Systems Engineering
• /
• v.3 no.1
• /
• pp.43-50
• /
• 2001

In this paper, we propose the design procedure of advance Polynomial Neural Networks(PNN) architecture for optimal model identification of complex and nonlinear system. The proposed PNN architecture is presented as the generic and advanced type. The essence of the design procedure dwells on the Group Method of Data Handling(GMDH). PNN is a flexible neural architecture whose structure is developed through learning. In particular, the number of layers of the PNN is not fixed in advance but is generated in a dynamic way. In this sense, PNN is a self-organizing network. With the aid of three representative numerical examples, compari-sons show that the proposed advanced PNN algorithm can produce the model with higher accuracy than previous other works. And performance index related to approximation and generalization capabilities of model is evaluated and also discussed.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.8 no.6
• /
• pp.58-69
• /
• 1998

This paper introduces a novel neuro-fuzzy system based on the polynomial fuzzy neural network(PFNN) architecture. The PFNN consists of a set of if-then rules with appropriate membership functions whose parameters are optimized via a hybrid genetic algorithm. A polynomial neural network is employed in the defuzzification scheme to improve output performance and to select appropriate rules. A performance criterion for model selection, based on the Group Method of DAta Handling is defined to overcome the overfitting problem in the modeling procedure. The hybrid genetic optimization method, which combines a genetic algorithm and the Simplex method, is developed to increase performance even if the length of a chromosome is reduced. A novel coding scheme is presented to describe fuzzy systems for a dynamic search rang in th GA. For a performance assessment of the PFNN inference system, three well-known problems are used for comparison with other methods. The results of these comparisons show that the PFNN inference system outperforms the other methods while it exhibits exceptional robustness characteristics.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.60 no.3
• /
• pp.639-647
• /
• 2011

In this paper, we introduce a design methodology of data-centroid Radial Basis Function neural networks with extended polynomial function. The two underlying design mechanisms of such networks involve K-means clustering method and Particle Swarm Optimization(PSO). The proposed algorithm is based on K-means clustering method for efficient processing of data and the optimization of model was carried out using PSO. In this paper, as the connection weight of RBF neural networks, we are able to use four types of polynomials such as simplified, linear, quadratic, and modified quadratic. Using K-means clustering, the center values of Gaussian function as activation function are selected. And the PSO-based RBF neural networks results in a structurally optimized structure and comes with a higher level of flexibility than the one encountered in the conventional RBF neural networks. The PSO-based design procedure being applied at each node of RBF neural networks leads to the selection of preferred parameters with specific local characteristics (such as the number of input variables, a specific set of input variables, and the distribution constant value in activation function) available within the RBF neural networks. To evaluate the performance of the proposed data-centroid RBF neural network with extended polynomial function, the model is experimented with using the nonlinear process data(2-Dimensional synthetic data and Mackey-Glass time series process data) and the Machine Learning dataset(NOx emission process data in gas turbine plant, Automobile Miles per Gallon(MPG) data, and Boston housing data). For the characteristic analysis of the given entire dataset with non-linearity as well as the efficient construction and evaluation of the dynamic network model, the partition of the given entire dataset distinguishes between two cases of Division I(training dataset and testing dataset) and Division II(training dataset, validation dataset, and testing dataset). A comparative analysis shows that the proposed RBF neural networks produces model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.11 no.4
• /
• pp.336-339
• /
• 2001

The ozone forecasting systems have many problems because the mechanism of the ozone concentration is highly complex, nonlinear, and nonstationary. Especially, the performance of the prediction results in the high-level ozone concentration are not good. This paper describes the modeling method of the ozone prediction system using neuro-fuzzy approaches and fuzzy clustering methods. The dynamic polynomial neural network (DPNN) based upon a typical algorithm of GMDH (group method of data handling) is a useful method for data analysis, the identification of nonlinear complex systems, and prediction of dynamical systems.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.55 no.6
• /
• pp.264-273
• /
• 2006

In this paper, we propose a new architecture of Self-Organizing Fuzzy Polynomial Neural Networks (SOFPNN) by means of consecutive optimization and also discuss its comprehensive design methodology involving mechanisms of genetic optimization. The network is based on a structurally as well as parametrically optimized fuzzy polynomial neurons (FPNs) conducted with the aid of information granulation and genetic algorithms. In structurally identification of FPN, the design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics and addresses specific aspects of parametric optimization. In addition, the fuzzy rules used in the networks exploit the notion of information granules defined over system's variables and formed through the process of information granulation. That is, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. This granulation is realized with the aid of the hard c-menas clustering method (HCM). For the parametric identification, we obtained the effective model that the axes of MFs are identified by GA to reflect characteristic of given data. Especially, the genetically dynamic search method is introduced in the identification of parameter. It helps lead to rapidly optimal convergence over a limited region or a boundary condition. To evaluate the performance of the proposed model, the model is experimented with using two time series data(gas furnace process, nonlinear system data, and NOx process data).

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.50 no.9
• /
• pp.430-438
• /
• 2001

In this study, we introduce the adaptive Polynomial Neuro-Fuzzy Networks(PNFN) architecture generated from the fusion of fuzzy inference system and PNN algorithm. The PNFN dwells on the ideas of fuzzy rule-based computing and neural networks. Fuzzy inference system is applied in the 1st layer of PNFN and PNN algorithm is employed in the 2nd layer or higher. From these the multilayer structure of the PNFN is constructed. In order words, in the Fuzzy Inference System(FIS) used in the nodes of the 1st layer of PNFN, either the simplified or regression polynomial inference method is utilized. And as the premise part of the rules, both triangular and Gaussian like membership function are studied. In the 2nd layer or higher, PNN based on GMDH and regression polynomial is generated in a dynamic way, unlike in the case of the popular multilayer perceptron structure. That is, the PNN is an analytic technique for identifying nonlinear relationships between system's inputs and outputs and is a flexible network structure constructed through the successive generation of layers from nodes represented in partial descriptions of I/O relatio of data. The experiment part of the study involves representative time series such as Box-Jenkins gas furnace data used across various neurofuzzy systems and a comparative analysis is included as well.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2004.10a
• /
• pp.433-436
• /
• 2004

In this paper, we introduce a new Fuzzy Polynomial Neural Networks (FPNNS)-like structure whose neuron is based on the Fuzzy Set-based Fuzzy Inference System (FS-FIS) and is different from that of FPNNS based on the Fuzzy relation-based Fuzzy Inference System (FR-FIS) and discuss the ability of the new FPNNS-like structure named Fuzzy Set-based Polynomial Neural Networks (FSPNN). The premise parts of their fuzzy rules are not identical, while the consequent parts of the both Networks (such as FPNN and FSPNN) are identical. This difference results from the angle of a viewpoint of partition of input space of system. In other word, from a point of view of FS-FIS, the input variables are mutually independent under input space of system, while from a viewpoint of FR-FIS they are related each other. The proposed design procedure for networks architecture involves the selection of appropriate nodes with specific local characteristics such as the number of input variables, the order of the polynomial that is constant, linear, quadratic, or modified quadratic functions being viewed as the consequent part of fuzzy rules, and a collection of the specific subset of input variables. On the parameter optimization phase, we adopt Information Granulation (IC) based on HCM clustering algorithm and a standard least square method-based learning. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. To evaluate the performance of the genetically optimized FSPNN (gFSPNN), the model is experimented with using the time series dataset of gas furnace process.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.15 no.7
• /
• pp.846-851
• /
• 2005

In this paper, we propose Genetic Algorithms(GAs)-based Optimized Polynomial Neural Networks(PNN). The proposed algorithm is based on Group Method of Data Handling(GMDH) method and its structure is similar to feedforward Neural Networks. But the structure of PNN is not fixed like in conventional neural networks and can be generated in a dynamic manner. As each node of PNN structure, we use several types of high-order polynomial such as linear, quadratic and modified quadratic, and it is connected as various kinds of multi-variable inputs. The conventional PNN depends on the experience of a designer that select the number of input variables, input variable and polynomial type. Therefore it is very difficult to organize optimized network. The proposed algorithm leads to identify and select the number of input variables, input variable and polynomial type by using Genetic Algorithms(GAs). The aggregate performance index with weighting factor is proposed as well. The study is illustrated with tile NOx omission process data of gas turbine power plant for application to nonlinear process. In the sequel the proposed model shows not only superb predictability but also high accuracy in comparison to the existing intelligent models.

• Journal of Power Electronics
• /
• v.16 no.2
• /
• pp.598-609
• /
• 2016

The good control performance of permanent magnet linear synchronous motor (LSM) drive systems is difficult to achieve using linear controllers because of uncertainty effects, such as fictitious forces. A backstepping control system using adaptive modified recurrent Laguerre orthogonal polynomial neural network uncertainty observer (OPNNUO) is proposed to increase the robustness of LSM drive systems. First, a field-oriented mechanism is applied to formulate a dynamic equation for an LSM drive system. Second, a backstepping approach is proposed to control the motion of the LSM drive system. With the proposed backstepping control system, the mover position of the LSM drive achieves good transient control performance and robustness. As the LSM drive system is prone to nonlinear and time-varying uncertainties, an adaptive modified recurrent Laguerre OPNNUO is proposed to estimate lumped uncertainties and thereby enhance the robustness of the LSM drive system. The on-line parameter training methodology of the modified recurrent Laguerre OPNN is based on the Lyapunov stability theorem. Furthermore, two optimal learning rates of the modified recurrent Laguerre OPNN are derived to accelerate parameter convergence. Finally, the effectiveness of the proposed control system is verified by experimental results.

• Proceedings of the KIEE Conference
• /
• 2003.07d
• /
• pp.2519-2521
• /
• 2003

In this paper, we propose Self-Organizing Fuzzy Polynomial Neural Networks(SOFPNN) architecture for optimal model identification and discuss a comprehensive design methodology supporting its development. It is shown that this network exhibits a dynamic structure as the number of its layers as well as the number of nodes in each layer of the SOFPNN are not predetermined (as this is the case in a popular topology of a multilayer perceptron). As the form of the conclusion part of the rules, especially the regression polynomial uses several types of high-order polynomials such as linear, quadratic, and modified quadratic. As the premise part of the rules, both triangular and Gaussian-like membership function are studied and the number of the premise input variables used in the rules depends on that of the inputs of its node in each layer. We introduce two kinds of SOFPNN architectures, that is, the basic and modified one with both the generic and the advanced type. The superiority and effectiveness of the proposed SOFPNN architecture is demonstrated through nonlinear function numerical example.