• 제목/요약/키워드: backpropagation algorithm

검색결과 350건 처리시간 0.026초

사운덱스 알고리즘을 적용한 신경망라 뉴로-처지 기법의 호스트 이상 탐지 (Host Anomaly Detection of Neural Networks and Neural-fuzzy Techniques with Soundex Algorithm)

  • 차병래;김형종;박봉구;조혁현
    • 정보보호학회논문지
    • /
    • 제15권2호
    • /
    • pp.13-22
    • /
    • 2005
  • 본 논문에서는 시스템 호출을 이용하여 이상 침입 탐지 시스템의 성능을 향상시키기 위해, 특징 선택과 가변 길이 데이터를 고정 길이 학습 패턴으로 변환 생성하는 문제를 해결하기 위한 사운덱스 알고리즘을 적용한 신경망 학습을 통하여 이상 침입 탐지의 연구를 하고자 한다. 즉, 가변 길이의 순차적인 시스템 호출 데이터를 사운덱스 알고리즘에 의한 고정 길이의 행위 패턴을 생성하여 역전파 알고리즘과 퍼지 멤버쉽 함수에 의해 신경망 학습을 수행하였다. 역전파 신경망과 뉴로-퍼지 기법을 UNM의 Sendmail Data Set을 이용하여 시스템 호출의 이상침입 탐지에 적용하여 시간과 공간 복잡도 그리고 MDL 측면에서 성능을 검증하였다.

Self-Learning Control of Cooperative Motion for Humanoid Robots

  • Hwang, Yoon-Kwon;Choi, Kook-Jin;Hong, Dae-Sun
    • International Journal of Control, Automation, and Systems
    • /
    • 제4권6호
    • /
    • pp.725-735
    • /
    • 2006
  • This paper deals with the problem of self-learning cooperative motion control for the pushing task of a humanoid robot in the sagittal plane. A model with 27 linked rigid bodies is developed to simulate the system dynamics. A simple genetic algorithm(SGA) is used to find the cooperative motion, which is to minimize the total energy consumption for the entire humanoid robot body. And the multi-layer neural network based on backpropagation(BP) is also constructed and applied to generalize parameters, which are obtained from the optimization procedure by SGA, in order to control the system.

펄스열에서 1인 펄스수와 0인 펄스수의 비를 이용하여 확률연산을 하는 신경회로망 (A Neural Network Based on Stochastic Computation using the Ratio of the Number of Ones and Zeros in the Pulse Stream)

  • 민승재;채수익
    • 전자공학회논문지B
    • /
    • 제31B권7호
    • /
    • pp.211-218
    • /
    • 1994
  • Stochastic computation employs random pulse streams to represent numbers. In this paper, we study a new method to implement the number system which uses the ratio of the numbers of ones and zeros in the pulse streams. In this number system. if P is the probability that a pulse is one in a pulse stream then the number X represented by the pulse stream is defined as P/(1-P). We propose circuits to implement the basic operations such as addition multiplication and sigmoid function with this number system and examine the error characteristics of such operations in stochastic computation. We also propose a neuron model and derive a learning algorithm based on backpropagation for the 3-layered feedforward neural networks. We apply this learning algorithm to a digit recognition problem. To analyze the results, we discuss the errors due to the variance of the random pulse streams and the quantization noise of finite length register.

  • PDF

비선형 시스템의 안정화를 위한 자기순환 뉴로-퍼지 제어기의 설계 (Design of Self Recurrent Neuro-Fuzzy Controller for Stabilization of Nonlinear System)

  • 탁한호;이인용;이성현
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2007년도 춘계학술대회 학술발표 논문집 제17권 제1호
    • /
    • pp.390-393
    • /
    • 2007
  • In this paper, applications of self recurrent neuro-fuzzy controller to stabilization of nonlinear system are considered. The architecture of self recurrent neuro-fuzzy controller is fix layer, and the hidden layer is comprised of self recurrent architecture. Also, generalized dynamic error-backpropagation algorithm is used for the learning of the self recurrent neuro-fuzzy controller. To demonstrate the efficiency of the self recurrent neuro-fuzzy control algorithm presented in this study, a self recurrent neuro-fuzzy controller was designed and then a comparative analysis was made with LQR controller through an simulation.

  • PDF

Neural Network and Its Application to Rainfall-Runoff Forecasting

  • Kang, Kwan-Won;Park, Chan-Young;Kim, Ju-Hwan
    • Korean Journal of Hydrosciences
    • /
    • 제4권
    • /
    • pp.1-9
    • /
    • 1993
  • It is a major objective for the management and operation of water resources system to forecast streamflows. The applicability of artificial neural network model to hydrologic system is analyzed and the performance is compared by statistical method with observed. Multi-layered perception was used to model rainfall-runoff process at Pyung Chang River Basin in Korea. The neural network model has the function of learning the process which can be trained with the error backpropagation (EBP) algorithm in two phases; (1) learning phase permits to find the best parameters(weight matrix) between input and output. (2) adaptive phase use the EBP algorithm in order to learn from the provided data. The generalization results have been obtained on forecasting the daily and hourly streamflows by assuming them with the structure of ARMA model. The results show validities in applying to hydrologic forecasting system.

  • PDF

동적 신경망과 Geneo-tic Algorithms를 적용한 비선형 시스템의 제어 (Dynamic Neural Units and Genetic Algorithms With Applications to the Control of Unknown Nonlinear Systems)

  • 조현섭;민진경;노용기;정병조;장성환
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 제37회 하계학술대회 논문집 D
    • /
    • pp.1943-1944
    • /
    • 2006
  • "Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin

  • PDF

다층 신경회로망을 이용한 비선형 시스템의 견실한 제어 (Robust control of Nonlinear System Using Multilayer Neural Network)

  • 조현섭
    • 한국정보전자통신기술학회논문지
    • /
    • 제6권4호
    • /
    • pp.243-248
    • /
    • 2013
  • In this thesis, we have designed the indirect adaptive controller using Dynamic Neural Units(DNU) for unknown nonlinear systems. Proposed indirect adaptive controller using Dynamic Neural Unit based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our method is different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its training.

유전자 알고리즘을 이용한 신경 회로망 성능향상에 관한 연구 (A study on Performance Improvement of Neural Networks Using Genetic algorithms)

  • 임정은;김해진;장병찬;서보혁
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 제37회 하계학술대회 논문집 D
    • /
    • pp.2075-2076
    • /
    • 2006
  • In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Backpropagation(BP). The conventional BP does not guarantee that the BP generated through learning has the optimal network architecture. But the proposed GA-based BP enable the architecture to be a structurally more optimized network, and to be much more flexible and preferable neural network than the conventional BP. The experimental results in BP neural network optimization show that this algorithm can effectively avoid BP network converging to local optimum. It is found by comparison that the improved genetic algorithm can almost avoid the trap of local optimum and effectively improve the convergent speed.

  • PDF

Control of a cart system using genetic algorithm

  • Kim, Sung-Soo;Woo, Kwang-Bang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1994년도 Proceedings of the Korea Automatic Control Conference, 9th (KACC) ; Taejeon, Korea; 17-20 Oct. 1994
    • /
    • pp.385-389
    • /
    • 1994
  • So far many researches have studied to control a cart system with a pole on the top of itself (forwards we call it simply a cart system) which is movable only to the directions to which a cart moves, using neural networks and genetic algorithms. Especially which it wag solved by genetic algorithms, it was possible to control a cart system more robustly than ordinary methods using neural networks but it had problems too, i.e., the control time to be achieved was short and the processing time for it was long. However we could control a cart system using standard genetic algorithm longer than ordinary neural network methods (for example error backpropagation) and could see that robust control was possible. Computer simulation was performed through the personal computer and the results showed the possibility of real time control because the cpu time which was occupied by processes was relatively short.

  • PDF

신경회로망의 학습 알고리듬을 이용하여 돌연변이를 수행하는 새로운 진화 프로그래밍 알고리듬 (A New Evolutionary Programming Algorithm using the Learning Rule of a Neural Network for Mutation of Individuals)

  • 임종화;최두현;황찬식
    • 전자공학회논문지C
    • /
    • 제36C권3호
    • /
    • pp.58-64
    • /
    • 1999
  • 진화 프로그래밍은 두 가지 요소로 특징지을 수 있다. 하나는 선택 방법이고 나머지는 돌연변이 규칙이다. 본 논문에서는 신경회로망의 역전파 학습 알고리듬을 이용하여 돌연변이 연산을 수행하는 새로운 진화 프로그래밍 알고리듬을 제안한다. 신경회로망의 학습 알고리듬에서 현재 오차는 진화 프로그래밍의 개체가 진화해 나가야 할 방향을 지정해 주고, 관성은 개체의 변이에 지금까지의 진화 경향을 더해 주어서 빠르게 전역 최적해를 찾도록 하였다. 표준 테스트 함수를 이용하여 제안된 알고리듬의 성능과 강건함을 확인하였다.

  • PDF