• Title/Summary/Keyword: Back-Propagation Algorithm

Search Result 896, Processing Time 0.033 seconds

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative (수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선)

  • 권희용;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.3
    • /
    • pp.274-280
    • /
    • 1992
  • In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

  • PDF

Short-term Load Forecasting Using Artificial Neural Network (인공신경망을 이용한 단기 부하예측모형)

  • Park, Moon-Hee
    • Journal of Energy Engineering
    • /
    • v.6 no.1
    • /
    • pp.68-76
    • /
    • 1997
  • This paper presents a new neural network training algorithm which reduces the required training time considerably and overcomes many of the shortcomings presented by the conventional back-propagation algorithm. The algorithm uses a modified form of the back-propagation algorithm to minimize the mean squared error between the desired and actual outputs with respect to the inputs to the nonlinearities. Artificial Neural Network (ANN) model using the new algorithm is applied to forecast the short-term electric load. Inputs to the ANN are past loads and the output of the ANN is the hourly load forecast for a given day.

  • PDF

Design of the Pattern Classifier using Fuzzy Neural Network (퍼지 신경 회로망을 이용한 패턴 분류기의 설계)

  • Kim, Moon-Hwan;Lee, Ho-Jae;Joo, Young-Hoon;Park, Jin-Bae
    • Proceedings of the KIEE Conference
    • /
    • 2003.07d
    • /
    • pp.2573-2575
    • /
    • 2003
  • In this paper, we discuss a fuzzy neural network classifier with immune algorithm. The fuzzy neural network classifier is constructed with the fuzzy classifier and the neural network classifier based on fuzzy rules. To maximize performance of classifier, the immune algorithm and the back propagation algorithm are used. For the generalized classification ability, the simulation results from the iris data demonstrate superiority of the proposed classifier in comparison with other classifier.

  • PDF

Back-Propagation Algorithm through Omitting Redundant Learning (중복 학습 방지에 의한 역전파 학습 알고리듬)

  • 백준호;김유신;손경식
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.29B no.9
    • /
    • pp.68-75
    • /
    • 1992
  • In this paper the back-propagation algorithm through omitting redundant learning has been proposed to improve learning speed. The proposed algorithm has been applied to XOR, Parity check and pattern recognition of hand-written numbers. The decrease of the number of patterns to be learned has been confirmed as learning proceeds even in early learning stage. The learning speed in pattern recognition of hand-written numbers is improved more than 2 times in various cases of hidden neuron numbers. It is observed that the improvement of learning speed becomes better as the number of patterns and the number of hidden numbers increase. The recognition rate of the proposed algorithm is nearly the same as that conventional method.

  • PDF

On the Classification of Online Handwritten Digits using the Enhanced Back Propagation of Neural Networks (개선된 역전파 신경회로망을 이용한 온라인 필기체 숫자의 분류에 관한 연구)

  • Hong, Bong-Hwa
    • The Journal of Information Technology
    • /
    • v.9 no.4
    • /
    • pp.65-74
    • /
    • 2006
  • The back propagation of neural networks has the problems of falling into local minimum and delay of the speed by the iterative learning. An algorithm to solve the problem and improve the speed of the learning was already proposed in[8], which updates the learning parameter related with the connection weight. In this paper, we propose the algorithm generating initial weight to improve the efficiency of the algorithm by offering the difference between the input vector and the target signal to the generating function of initial weight. The algorithm proposed here can classify more than 98.75% of the handwritten digits and this rate shows 30% more effective than the other previous methods.

  • PDF

Crack Identification Using Hybrid Neuro-Genetic Technique (인공신경망 기법과 유전자 기법을 혼합한 결함인식 연구)

  • Suh, Myung-Won;Shim, Mun-Bo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.16 no.11
    • /
    • pp.158-165
    • /
    • 1999
  • It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. To identify the location and depth of a crack in a structure, a method is presented in this paper which uses hybrid neuro-genetic technique. Feed-forward multilayer neural networks trained by back-propagation are used to learn the input)the location and dept of a crack)-output(the structural eigenfrequencies) relation of the structural system. With this neural network and genetic algorithm, it is possible to formulate the inverse problem. Neural network training algorithm is the back propagation algorithm with the momentum method to attain stable convergence in the training process and with the adaptive learning rate method to speed up convergence. Finally, genetic algorithm is used to fine the minimum square error.

  • PDF

The speed control of induction motor using neural networks (신경회로망을 이용한 유도전동기 속도제어)

  • 김세찬;원충연
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.45 no.1
    • /
    • pp.42-53
    • /
    • 1996
  • The paper presents a speed control system of vector controlled induct- ion motor using neural networks. The main feature of proposed speed control system is a Neural Network Controller(NNC) which supplies torque current to induction motor and Neural Network Emulator(NNE) which captures the forward dynamics of induction motor. A back propagation training algorithm is employed to train the NNE and NNC. In order to determine the NNC output error, plant(induction motor) output error can be back propagated through the NNE. The NNC and NNE for speed control of vector controlled induction motor is carried out by TMS320C30 DSP and IGBT current regulated PWM inverter. Through computer simulation and experimental results, it is verified that proposed speed control system is robust to the load variation. (author). refs., figs.

  • PDF

A Conflict Detection Method Based on Constraint Satisfaction in Collaborative Design

  • Yang, Kangkang;Wu, Shijing;Zhao, Wenqiang;Zhou, Lu
    • Journal of Computing Science and Engineering
    • /
    • v.9 no.2
    • /
    • pp.98-107
    • /
    • 2015
  • Hierarchical constraints and constraint satisfaction were analyzed in order to solve the problem of conflict detection in collaborative design. The constraints were divided into two sets: one set consisted of known constraints and the other of unknown constraints. The constraints of the two sets were detected with corresponding methods. The set of the known constraints was detected using an interval propagation algorithm, a back propagation (BP) neural network was proposed to detect the set with the unknown constraints. An immune algorithm (IA) was utilized to optimize the weights and the thresholds of the BP neural network, and the steps were designed for the optimization process. The results of the simulation indicated that the BP neural network that was optimized by IA has a better performance in terms of convergent speed and global searching ability than a genetic algorithm. The constraints were described using the eXtensible Markup Language (XML) for computers to be able to automatically recognize and establish the constraint network. The implementation of the conflict detection system was designed based on constraint satisfaction. A wind planetary gear train is taken as an example of collaborative design with a conflict detection system.

Adaptive controls for non-linear plant using neural network (신경회로망을 이용한 비선형 플랜트의 적응제어)

  • 정대원
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.215-218
    • /
    • 1997
  • A dynamic back-propagation neural network is addressed for adaptive neural control system to approximate non-linear control system rather than static networks. It has the capability to represent the approximation of nonlinear system without mathematical analysis and to carry out the on-line learning algorithm for real time application. The simulated results show fast tracking capability and adaptive response by using dynamic back-propagation neurons.

  • PDF

A neural network with local weight learning and its application to inverse kinematic robot solution (부분 학습구조의 신경회로와 로보트 역 기구학 해의 응용)

  • 이인숙;오세영
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10a
    • /
    • pp.36-40
    • /
    • 1990
  • Conventional back propagation learning is generally characterized by slow and rather inaccurate learning which makes it difficult to use in control applications. A new multilayer perception architecture and its learning algorithm is proposed that consists of a Kohonen front layer followed by a back propagation network. The Kohonen layer selects a subset of the hidden layer neurons for local tuning. This architecture has been tested on the inverse kinematic solution of robot manipulator while demonstrating its fast and accurate learning capabilities.

  • PDF