• Title/Summary/Keyword: chaotic neural networks

Search Result 66, Processing Time 0.035 seconds

The Coupling Effects of Excitatory and Inhibitory Connections Between Chaotic Neurons Having Gaussian-shaped Refractory Function With Hysteresis

  • Park, Changkyu;Lee, Ju-Jang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.356-361
    • /
    • 1998
  • Neural Networks, modeled succinctly from the real nervous system of a living body, can be categorized into two folds; artificial neural network(ANN) and biological neural network(BNN). While the former has been developed to solve practical problems using function approximation capability, pattern classification) clustering algorithm, etc, the latter has been focused on verifying the information processing capability to which brain research gives an impetus, by mimicking real biological systems. However, BNN suffers Iron severe nonlinearities dealt with. A bridge between two neural networks is chaotic neural network(CNN), which simply delineate the real nor-vous system and comprises almost all the ANN structures by selecting parameters. Main research theme of this area is to develop an explanation tool to clarify the information processing mechanism in biological systems and its extension to engineering applications. The CNN has a Gaussian-shaped refractory function with hysteresis effect and the chaotic responses of it have been observed fur a wide range of parameter space. Through the examination of the coupling effects of excitatory and inhibitory connections, the secrets of information processing and memory structure will appear.

  • PDF

Control of Chaos Dynamics in Jordan Recurrent Neural Networks

  • Jin, Sang-Ho;Kenichi, Abe
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.43.1-43
    • /
    • 2001
  • We propose two control methods of the Lyapunov exponents for Jordan-type recurrent neural networks. Both the two methods are formulated by a gradient-based learning method. The first method is derived strictly from the definition of the Lyapunov exponents that are represented by the state transition of the recurrent networks. The first method can control the complete set of the exponents, called the Lyapunov spectrum, however, it is computationally expensive because of its inherent recursive way to calculate the changes of the network parameters. Also this recursive calculation causes an unstable control when, at least, one of the exponents is positive, such as the largest Lyapunov exponent in the recurrent networks with chaotic dynamics. To improve stability in the chaotic situation, we propose a non recursive formulation by approximating ...

  • PDF

Fuzzy Neural Network Based Generalized Predictive Control of Chaotic Nonlinear Systems (혼돈 비선형 시스템의 퍼지 신경 회로망 기반 일반형 예측 제어)

  • Park, Jong-Tae;Park, Yoon-Ho
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.2
    • /
    • pp.65-75
    • /
    • 2004
  • This paper presents a generalized predictive control method based on a fuzzy neural network(FNN) model, which uses the on-line multi-step prediction, fur the intelligent control of chaotic nonlinear systems whose mathematical models are unknown. In our design method, the parameters of both predictor and controller are tuned by a simple gradient descent scheme, and the weight parameters of FNN are determined adaptively during the operation of the system. In order to design a generalized predictive controller effectively, this paper describes computing procedure for each of the two important parameters. Also, we introduce a projection matrix to determine the control input, which deceases the control performance function very rapidly. Finally, in order to evaluate the performance of our controller, the proposed method is applied to the Doffing and Henon systems, which are two representative continuous-time and discrete-time chaotic nonlinear systems, res reactively.

A Study on Implementation and Interconnection of Chaotic Neuron Circuit (카오스 뉴론회의 구현 및 상호연결에 관한 연구)

  • 이익수;여진경;이경훈;여지환;정호선
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.2
    • /
    • pp.131-139
    • /
    • 1996
  • This paper describes the chaotic neuron model to represent the complicated states of brain and analyzes the dynamical responses of chaotic neuron such as periodic, bifurcation, and chaotic phenomena which are simulated iwth numerical analysis. Next, the chaotic neuron circuit is implemented w ith the analog electronic devices. The transfer function of chaotic neuron is given by summed the linear and nonlinear property. The output function of chaojtic neuron is designed iwth the two cMOS inverters and a feedback resistor. By adjusting the external voltage, the various dynamical properties are demonstrated. In addition, we construt the chaotic neural networks which are composed of the interconnection of chaotic neuroncircuit such as serial, paralle, and layer connection. On the board experiment, we proved the dynamci and chaotic responses which exist in the human brain.

  • PDF

Complexity Control Method of Chaos Dynamics in Recurrent Neural Networks

  • Sakai, Masao;Honma, Noriyasu;Abe, Kenichi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.494-494
    • /
    • 2000
  • This paper demonstrates that the largest Lyapunov exponent $\lambda$ of recurrent neural networks can be controlled by a gradient method. The method minimizes a square error $e_{\lambda}=(\lambda-\lambda^{obj})^2$ where $\lambda^{obj}$ is desired exponent. The $\lambda$ can be given as a function of the network parameters P such as connection weights and thresholds of neurons' activation. Then changes of parameters to minimize the error are given by calculating their gradients $\partial\lambda/\partialP$. In a previous paper, we derived a control method of $\lambda$via a direct calculation of $\partial\lambda/\partialP$ with a gradient collection through time. This method however is computationally expensive for large-scale recurrent networks and the control is unstable for recurrent networks with chaotic dynamics. Our new method proposed in this paper is based on a stochastic relation between the complexity $\lambda$ and parameters P of the networks configuration under a restriction. Then the new method allows us to approximate the gradient collection in a fashion without time evolution. This approximation requires only $O(N^2)$ run time while our previous method needs $O(N^{5}T)$ run time for networks with N neurons and T evolution. Simulation results show that the new method can realize a "stable" control for larege-scale networks with chaotic dynamics.

  • PDF

Evolving Cellular Automata Neural Systems(ECANS 1)

  • Lee, Dong-Wook;Sim, Kwee-Bo
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.158-163
    • /
    • 1998
  • This paper is our first attempt to construct a information processing system such as the living creatures' brain based on artificial life technique. In this paper, we propose a method of constructing neural networks using bio-inspired emergent and evolutionary concept, Ontogeny of living things is realized by cellular automata model and Phylogeny that is living things adaptation ability themselves to given environment, are realized by evolutionary algorithms. Proposing evolving cellular automata neural systems are calledin a word ECANS. A basic component of ECANS is 'cell' which is modeled on chaotic neuron with complex characteristics, In our system, the states of cell are classified into eight by method of connection neighborhood cells. When a problem is given, ECANS adapt itself to the problem by evolutionary method. For fixed cells transition rule, the structure of neural network is adapted by change of initial cell' arrangement. This initial cell is to become a network b developmental process. The effectiveness and the capability of proposed scheme are verified by applying it to pattern classification and robot control problem.

  • PDF

Study of Neuron Operation using Controlled Chaotic Instabilities in Brillouin-Active Fiber Based Neural Networks

  • Kim, Yong-K.;Huh, Do-Geun;Kim, Kwan-Woong;Yu, C.
    • Journal of Electrical Engineering and Technology
    • /
    • v.1 no.4
    • /
    • pp.546-549
    • /
    • 2006
  • In this paper the neuron operation based on Brillouin-active fiber in optical fiber is described. The inherent optical feedback by the backscattered stokes wave in optical fiber leads to instabilities in the form of optical chaos. Controlling of chaos induced transient instability in Brillouin-active fiber is implemented with Kerr nonlinearity having a non-instantaneous response in network systems. The controlling chaotic instabilities can lead to multistable periodic states; create optical logic 'on' or high level '1' or 'off', or low level '0'. It is theoretically possible to apply the multi-stability regimes as an optical memory device for encoding and decoding series and complex data transmission in optical systems.

Evolvable Neural Networks for Time Series Prediction with Adaptive Learning Interval

  • Seo, Sang-Wook;Lee, Dong-Wook;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.8 no.1
    • /
    • pp.31-36
    • /
    • 2008
  • This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the enviromuent. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

Evolvable Neural Networks for Time Series Prediction with Adaptive Learning Interval

  • Lee, Dong-Wook;Kong, Seong-G;Sim, Kwee-Bo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.920-924
    • /
    • 2005
  • This paper presents adaptive learning data of evolvable neural networks (ENNs) for time series prediction of nonlinear dynamic systems. ENNs are a special class of neural networks that adopt the concept of biological evolution as a mechanism of adaptation or learning. ENNs can adapt to an environment as well as changes in the environment. ENNs used in this paper are L-system and DNA coding based ENNs. The ENNs adopt the evolution of simultaneous network architecture and weights using indirect encoding. In general just previous data are used for training the predictor that predicts future data. However the characteristics of data and appropriate size of learning data are usually unknown. Therefore we propose adaptive change of learning data size to predict the future data effectively. In order to verify the effectiveness of our scheme, we apply it to chaotic time series predictions of Mackey-Glass data.

  • PDF

Recognition of Unconstrained Handwritten Numerals using Chaotic Neural Network (카오틱 신경망을 이용한 서체 숫자 인식)

  • 조재홍;성정원
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.1301-1304
    • /
    • 1998
  • Several neural networks have been successfully used to classify complex patterns such as handwritten numerals or words. This paper describes the discrimination of totally unconstrained handwritten numerals using the proposed chaotic neural network (CNN) to improve the recognition rate. The recognition system in the paper consists of the preprocessing stage to extract features using Kirsch mask and the classification stage to recognize numerals using the CNN. In order to evaluate the performance of the proposed network, we performed the recognition with unconstrained handwritten numeral database of Concordia university, Canada. Experimental results show that the CNN based recognizer performs higher recognition rate than other neural network-based methods reported using same database.

  • PDF