• Title/Summary/Keyword: evolutionary neural networks

Search Result 85, Processing Time 0.029 seconds

Evolutionary Algorithm for Recurrent Neural Networks Storing Periodic Pattern Pairs (주기적 패턴 쌍을 저장하는 Recurrent Neural Network를 찾는 진화 알고리즘)

  • Kim, Kwon-Il;Zhang, Byoung-Tak
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.06c
    • /
    • pp.399-402
    • /
    • 2007
  • 뇌 속 뉴런들의 네트워크는 근본적으로 recurrent neural networks(RNNs)의 형태를 지닌다. 이 논문에서는 반복되는 뉴런 반응 패턴들 사이의 관계를 네트워크에 저장함으로써 생물의 기억이 생성된다는 가정하에, 이를 표현할 수 있는 RNN 모델을 제안하였고, evolutionary algorithm을 통해 이러한 여러 쌍의 기억들이 저장된 네트워크가 존재할 수 있음을 보였다.

  • PDF

Using Evolutionary Optimization to Support Artificial Neural Networks for Time-Divided Forecasting: Application to Korea Stock Price Index

  • Oh, Kyong Joo
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.1
    • /
    • pp.153-166
    • /
    • 2003
  • This study presents the time-divided forecasting model to integrate evolutionary optimization algorithm and change point detection based on artificial neural networks (ANN) for the prediction of (Korea) stock price index. The genetic algorithm(GA) is introduced as an evolutionary optimization method in this study. The basic concept of the proposed model is to obtain intervals divided by change points, to identify them as optimal or near-optimal change point groups, and to use them in the forecasting of the stock price index. The proposed model consists of three phases. The first phase detects successive change points. The second phase detects the change-point groups with the GA. Finally, the third phase forecasts the output with ANN using the GA. This study examines the predictability of the proposed model for the prediction of stock price index.

Design of Advanced Self-Organizing Fuzzy Polynomial Neural Networks Based on FPN by Evolutionary Algorithms (진화론적 알고리즘에 의한 퍼지 다항식 뉴론 기반 고급 자기구성 퍼지 다항식 뉴럴 네트워크 구조 설계)

  • Park, Ho-Sung;Oh, Sung-Kwun;Ahn, Tea-Chon
    • Proceedings of the KIEE Conference
    • /
    • 2005.10b
    • /
    • pp.322-324
    • /
    • 2005
  • In this paper, we introduce the advanced Self-Organizing Fuzzy Polynomial Neural Network based on optimized FPN by evolutionary algorithm and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially genetic algorithms (GAs). The proposed model gives rise to a structurally and parametrically optimized network through an optimal parameters design available within Fuzzy Polynomial Neuron(FPN) by means of GA. Through the consecutive process of such structural and parametric optimization, an optimized and flexible the proposed model is generated in a dynamic fashion. The performance of the proposed model is quantified through experimentation that exploits standard data already used in fuzzy modeling. These results reveal superiority of the proposed networks over the existing fuzzy and neural models.

  • PDF

Optimal Environmental and Economic Operation using Evolutionary Computation and Neural Networks (진화연산과 신경망이론을 이용한 전력계통의 최적환경 및 경제운용)

  • Rhee, Sang-Bong;Kim, Kyu-Ho;You, Seok-Ku
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.48 no.12
    • /
    • pp.1498-1506
    • /
    • 1999
  • In this paper, a hybridization of Evolutionary Strategy (ES) and a Two-Phase Neural Network(TPNN) is applied to the optimal environmental and economic operation. As the evolutionary computation, ES is to search for the global optimum based on natural selection and genetics but it shows a defect of reducing the convergence rate in the latter part of search, and often does not search the exact solution. Also, neural network theory as a local search technique can be used to search a more exact solution. But it also has the defect that a solution frequently sticks to the local region. So, new algorithm is presented as hybrid methods by combining merits of two methods. The hybrid algorithm has been tested on Emission Constrained Economic Dispatch (ECED) problem and Weighted Emission Economic Dispatch (WEED) problem for optimal environmental and economic operation. The result indicated that the hybrid approach can outperform the other computational efficiency and accuracy.

  • PDF

A NEW ALGORITHM OF EVOLVING ARTIFICIAL NEURAL NETWORKS VIA GENE EXPRESSION PROGRAMMING

  • Li, Kangshun;Li, Yuanxiang;Mo, Haifang;Chen, Zhangxin
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.9 no.2
    • /
    • pp.83-89
    • /
    • 2005
  • In this paper a new algorithm of learning and evolving artificial neural networks using gene expression programming (GEP) is presented. Compared with other traditional algorithms, this new algorithm has more advantages in self-learning and self-organizing, and can find optimal solutions of artificial neural networks more efficiently and elegantly. Simulation experiments show that the algorithm of evolving weights or thresholds can easily find the perfect architecture of artificial neural networks, and obviously improves previous traditional evolving methods of artificial neural networks because the GEP algorithm imitates the evolution of the natural neural system of biology according to genotype schemes of biology to crossover and mutate the genes or chromosomes to generate the next generation, and the optimal architecture of artificial neural networks with evolved weights or thresholds is finally achieved.

  • PDF

Behavior Control of Autonomous Mobile Robots using ECANS1 (진화하는 셀룰라 오토마타를 이용한 자율이동로봇군의 행동제어)

  • Lee, Dong-Wook;Chung, Young-June;Sim, Kwee-Bo
    • Proceedings of the KIEE Conference
    • /
    • 1998.07g
    • /
    • pp.2183-2185
    • /
    • 1998
  • In this paper, we propose a method of designing neural networks using biological inspired developmental and evolutionary concept. The living things are best information processing system in themselves. One individual is developed from a generative cell. And a species of this individual have adapted itself to the environment by evolution. Ontogeny of organism is embodied in cellular automata and phylogeny of species is realized by evolutionary algorithms. The connection among cells is determined by a rule of cellular automata. In order to obtain the best neural networks in the environment, we evolve the arrangement of initial cells. The cell, that is neuron of neural networks, is modeled on chaotic neuron with firing or rest state like biological neuron. A final output of network is measured by frequency of firing state. The effectiveness of the proposed scheme is verified by applying it to navigation problem of robot.

  • PDF

Evolving Cellular Automata Neural Systems(ECANS 1)

  • Lee, Dong-Wook;Sim, Kwee-Bo
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.158-163
    • /
    • 1998
  • This paper is our first attempt to construct a information processing system such as the living creatures' brain based on artificial life technique. In this paper, we propose a method of constructing neural networks using bio-inspired emergent and evolutionary concept, Ontogeny of living things is realized by cellular automata model and Phylogeny that is living things adaptation ability themselves to given environment, are realized by evolutionary algorithms. Proposing evolving cellular automata neural systems are calledin a word ECANS. A basic component of ECANS is 'cell' which is modeled on chaotic neuron with complex characteristics, In our system, the states of cell are classified into eight by method of connection neighborhood cells. When a problem is given, ECANS adapt itself to the problem by evolutionary method. For fixed cells transition rule, the structure of neural network is adapted by change of initial cell' arrangement. This initial cell is to become a network b developmental process. The effectiveness and the capability of proposed scheme are verified by applying it to pattern classification and robot control problem.

  • PDF

Evolutionary Neural Networks based on DNA coding and L-system (DNA Coding 및 L-system에 기반한 진화신경회로망)

  • 이기열;전호병;이동욱;심귀보
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2000.11a
    • /
    • pp.107-110
    • /
    • 2000
  • In this paper, we propose a method of constructing neural networks using bio-inspired emergent and evolutionary concepts. This method is algorithm that is based on the characteristics of the biological DNA and growth of plants. Here is, we propose a constructing method to make a DNA coding method for production rule of L-system. L-system is based on so-called the parallel rewriting mechanism. The DNA coding method has no limitation in expressing the production rule of L-system. Evolutionary algorithms motivated by Darwinian natural selection are population based searching methods and the high performance of which is highly dependent on the representation of solution space. In order to verify the effectiveness of our scheme, we apply it to one step ahead prediction of Mackey-Glass time series.

  • PDF

Performance Improvement of Ensemble Speciated Neural Networks using Kullback-Leibler Entropy (Kullback-Leibler 엔트로피를 이용한 종분화 신경망 결합의 성능향상)

  • Kim, Kyung-Joong;Cho, Sung-Bae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.51 no.4
    • /
    • pp.152-159
    • /
    • 2002
  • Fitness sharing that shares fitness if calculated distance between individuals is smaller than sharing radius is one of the representative speciation methods and can complement evolutionary algorithm which converges one solution. Recently, there are many researches on designing neural network architecture using evolutionary algorithm but most of them use only the fittest solution in the last generation. In this paper, we elaborate generating diverse neural networks using fitness sharing and combing them to compute outputs then, propose calculating distance between individuals using modified Kullback-Leibler entropy for improvement of fitness sharing performance. In the experiment of Australian credit card assessment, breast cancer, and diabetes in UCI database, proposed method performs better than not only simple average output or Pearson Correlation but also previous published methods.

Visual Servoing of Robot Manipulators using Pruned Recurrent Neural Networks (저차원화된 리커런트 뉴럴 네트워크를 이용한 비주얼 서보잉)

  • 김대준;이동욱;심귀보
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1997.11a
    • /
    • pp.259-262
    • /
    • 1997
  • This paper presents a visual servoing of RV-M2 robot manipulators to track and grasp moving object, using pruned dynamic recurrent neural networks(DRNN). The object is stationary in the robot work space and the robot is tracking and grasping the object by using CCD camera mounted on the end-effector. In order to optimize the structure of DRNN, we decide the node whether delete or add, by mutation probability, first in case of delete node, the node which have minimum sum of input weight is actually deleted, and then in case of add node, the weight is connected according to the number of case which added node can reach the other nodes. Using evolutionary programming(EP) that search the struture and weight of the DRNN, and evolution strategies(ES) which train the weight of neuron, we pruned the net structure of DRNN. We applied the DRNN to the Visual Servoing of a robot manipulators to control position and orientation of end-effector, and the validity and effectiveness of the pro osed control scheme will be verified by computer simulations.

  • PDF