• Journal of the Institute of Convergence Signal Processing
• /
• v.5 no.1
• /
• pp.32-39
• /
• 2004

Biological neurons generally have chaotic characteristics for permanent or transient period. The effects of chaotic response of biological neuron have not yet been verified by using analytical methods. Even though the transient chaos of neuron could be beneficial to overcoming the local minimum problem, the permanent chaotic response gives adverse effect on optimization problems in general. To solve optimization problems, which are needed in almost all neural network applications such as pattern recognition, identification or prediction, and control, the neuron should have one stable fixed point. In this paper, the dynamic characteristics of the chaotic dynamic neuron and the condition that produces the chaotic response are analyzed, and the convergence conditions are presented.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.4
• /
• pp.396-401
• /
• 2006

It is well-known that a neural network with cyclic connections generates plural limit cycles, thus, being used as a memory system for storing large number of dynamic information. In this paper, a continuous-time cyclic connection neural network was built so that each neuron is connected only to its nearest neurons with binary synaptic weights of ${\pm}1$. The type and the number of limit cycles generated by such network has also been demonstrated through simulation. In particular, the effect of chaos signal for transition between limit cycles has been tested. Furthermore, it is evaluated whether the chaotic noise is more effective than random noise in the process of the dynamical neural networks.

• Journal of the Institute of Convergence Signal Processing
• /
• v.2 no.1
• /
• pp.44-52
• /
• 2001

This paper describes an off-line method for recognizing totally unconstrained handwritten digits using modified chaotic neural networks(MCNN). The chaotic neural networks(CNN) is modified to be a useful network for solving complex pattern problems by enforcing dynamic characteristics and learning process. Since the MCNN has the characteristics of highly nonlinear dynamics in structure and neuron itself, it can be an appropriate network for the robust classification of complex handwritten digits. Digit identification starts with extraction of features from the raw digit images and then recognizes digits using the MCNN based classifier. The performance of the MCNN classifier is evaluated on the numeral database of Concordia University, Montreal, Canada. For the relative comparison of recognition performance, the MCNN classifier is compared with the recurrent neural networks(RNN) classifier. Experimental results show that the classification rate is 98.0%. It indicates that the MCNN classifier outperforms the RNN classifier as well as other classifiers that have been reported on the same database.

• International Journal of Control, Automation, and Systems
• /
• v.6 no.5
• /
• pp.755-766
• /
• 2008

This study presents a recurrent compensatory fuzzy neural network (RCFNN) for dynamic system identification. The proposed RCFNN uses a compensatory fuzzy reasoning method, and has feedback connections added to the rule layer of the RCFNN. The compensatory fuzzy reasoning method can make the fuzzy logic system more effective, and the additional feedback connections can solve temporal problems as well. Moreover, an online learning algorithm is demonstrated to automatically construct the RCFNN. The RCFNN initially contains no rules. The rules are created and adapted as online learning proceeds via simultaneous structure and parameter learning. Structure learning is based on the measure of degree and parameter learning is based on the gradient descent algorithm. The simulation results from identifying dynamic systems demonstrate that the convergence speed of the proposed method exceeds that of conventional methods. Moreover, the number of adjustable parameters of the proposed method is less than the other recurrent methods.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.8 no.1
• /
• pp.31-36
• /
• 2008

This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the enviromuent. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.920-924
• /
• 2005

This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the environment. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

• Journal of information and communication convergence engineering
• /
• v.9 no.4
• /
• pp.369-374
• /
• 2011

Generally the neural network and the Fuzzy compensative algorithms are applied to forecast the time series for power demand with the characteristics of a nonlinear dynamic system, but, relatively, they have a few prediction errors. They also make long term forecasts difficult because of sensitivity to the initial conditions. In this paper, we evaluate the chaotic characteristic of electrical power demand with qualitative and quantitative analysis methods and perform a forecast simulation of electrical power demand in regular sequence, attractor reconstruction and a time series forecast for multi dimension using Lyapunov Exponent (L.E.) quantitatively. We compare simulated results with previous methods and verify that the present method is more practical and effective than the previous methods. We also obtain the hourly predictability of time series for power demand using the L.E. and evaluate its accuracy.

• Journal of Intelligence and Information Systems
• /
• v.5 no.1
• /
• pp.103-123
• /
• 1999

Input filtering as a preprocessing method is so much crucial to get good performance in time series forecasting. There are a few preprocessing methods (i.e. ARMA outputs as time domain filters, and Fourier transform or wavelet transform as time-frequency domain filters) for handling time series. Specially, the time-frequency domain filters describe the fractal structure of financial markets better than the time domain filters due to theoretically additional frequency information. Therefore, we, first of all, try to describe and analyze specially some issues on the effectiveness of different filtering methods from viewpoint of the performance of a neural network based forecasting. And then we discuss about neural network model architecture issues, for example, what type of neural network learning architecture is selected for our time series forecasting, and what input size should be applied to a model. In this study an input selection problem is limited to a size selection of the lagged input variables. To solve this problem, we simulate on analyzing and comparing a few neural networks having different model architecture and also use an embedding dimension measure as chaotic time series analysis or nonlinear dynamic analysis to reduce the dimensionality (i.e. the size of time delayed input variables) of the models. Throughout our study, experiments for integration methods of joint time-frequency analysis and neural network techniques are applied to a case study of daily Korean won / U. S dollar exchange returns and finally we suggest an integration framework for future research from our experimental results.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.53 no.8
• /
• pp.551-560
• /
• 2004

In this paper, we propose a new architecture of Self-Organizing Fuzzy Polynomial Neural Networks (SOFPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially genetic algorithms (GAs). The proposed SOFPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional SOFPNNs. The design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial of the consequent part of fuzzy rules, and a collection of the specific subset of input variables) and addresses specific aspects of parametric optimization. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. To evaluate the performance of the genetically optimized SOFPNN, the model is experimented with using two time series data(gas furnace and chaotic time series), A comparative analysis reveals that the proposed SOFPNN exhibits higher accuracy and superb predictive capability in comparison to some previous models available in the literatures.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.8
• /
• pp.1647-1652
• /
• 2009

Generally the neural network and the fuzzy compensative algorithm are applied to forecast the time series for power demand with a characteristic of non-linear dynamic system, but it has a few prediction errors relatively. It also makes long term forecast difficult for sensitivity on the initial condition. On this paper, we evaluate the chaotic characteristic of electrical power demand with analysis methods of qualitative and quantitative and perform a forecast simulation of electrical power demand in regular sequence, attractor reconstruction, time series forecast for multi dimension using Lyapunov exponent quantitatively. We compare simulated results with the previous method and verify that the purpose one being more practice and effective than it.