• Title/Summary/Keyword: back propagation algorithm

Search Result 898, Processing Time 0.068 seconds

Improved algorithm for learning speed by using the slope of activation function (활성화함수의 기울기를 이용한 수렴속도 개선 알고리듬)

  • Kim, D.K.;Lee, S.H.;Kim, B.S.;Kwon, H.Y.
    • Proceedings of the KIEE Conference
    • /
    • 1992.07a
    • /
    • pp.480-483
    • /
    • 1992
  • Although the back-propagation(BP) algorithm is widely used for its simple structure and easy learning method, it has a drawback of slow convergence rate. In this paper, we propose an algorithm to improve this problem by manipulating the slope parameter of the activation function. The steepest descent method is used in learning the slope parameter, as in the case of weight. The simulation shows that the learning rates of the proposed algorithm is faster than the conventional BP algorithm.

  • PDF

A neural network with adaptive learning algorithm of curvature smoothing for time-series prediction (시계열 예측을 위한 1, 2차 미분 감소 기능의 적응 학습 알고리즘을 갖는 신경회로망)

  • 정수영;이민호;이수영
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.34C no.6
    • /
    • pp.71-78
    • /
    • 1997
  • In this paper, a new neural network training algorithm will be devised for function approximator with good generalization characteristics and tested with the time series prediction problem using santaFe competition data sets. To enhance the generalization ability a constraint term of hidden neuraon activations is added to the conventional output error, which gives the curvature smoothing characteristics to multi-layer neural networks. A hybrid learning algorithm of the error-back propagation and Hebbian learning algorithm with weight decay constraint will be naturally developed by the steepest decent algorithm minimizing the proposed cost function without much increase of computational requriements.

  • PDF

Long-term Prediction of Speech Signal Using a Neural Network (신경 회로망을 이용한 음성 신호의 장구간 예측)

  • 이기승
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.6
    • /
    • pp.522-530
    • /
    • 2002
  • This paper introduces a neural network (NN) -based nonlinear predictor for the LP (Linear Prediction) residual. To evaluate the effectiveness of the NN-based nonlinear predictor for LP-residual, we first compared the average prediction gain of the linear long-term predictor with that of the NN-based nonlinear long-term predictor. Then, the effects on the quantization noise of the nonlinear prediction residuals were investigated for the NN-based nonlinear predictor A new NN predictor takes into consideration not only prediction error but also quantization effects. To increase robustness against the quantization noise of the nonlinear prediction residual, a constrained back propagation learning algorithm, which satisfies a Kuhn-Tucker inequality condition is proposed. Experimental results indicate that the prediction gain of the proposed NN predictor was not seriously decreased even when the constrained optimization algorithm was employed.

(The Development of Janggi Board Game Using Backpropagation Neural Network and Q Learning Algorithm) (역전파 신경회로망과 Q학습을 이용한 장기보드게임 개발)

  • 황상문;박인규;백덕수;진달복
    • Journal of the Institute of Electronics Engineers of Korea TE
    • /
    • v.39 no.1
    • /
    • pp.83-90
    • /
    • 2002
  • This paper proposed the strategy learning method by means of the fusion of Back-Propagation neural network and Q learning algorithm for two-person, deterministic janggi board game. The learning process is accomplished simply through the playing each other. The system consists of two parts of move generator and search kernel. The one consists of move generator generating the moves on the board, the other consists of back-propagation and Q learning plus $\alpha$$\beta$ search algorithm in an attempt to learn the evaluation function. while temporal difference learns the discrepancy between the adjacent rewards, Q learning acquires the optimal policies even when there is no prior knowledge of effects of its moves on the environment through the learning of the evaluation function for the augmented rewards. Depended on the evaluation function through lots of games through the learning procedure it proved that the percentage won is linearly proportional to the portion of learning in general.

An Analysis of Intrusion Pattern Based on Backpropagation Algorithm (역전파 알고리즘 기반의 침입 패턴 분석)

  • Woo Chong-Woo;Kim Sang-Young
    • Journal of Internet Computing and Services
    • /
    • v.5 no.5
    • /
    • pp.93-103
    • /
    • 2004
  • The main function of the intrusion Detection System (IDS) usee to be more or less passive detection of the intrusion evidences, but recently it is developed with more diverse types and methodologies. Especially, it is required that the IDS should process large system audit data fast enough. Therefore the data mining or neural net algorithm is being focused on, since they could satisfy those situations. In this study, we first surveyed and analyzed the several recent intrusion trends and types. And then we designed and implemented an IDS using back-propagation algorithm of the neural net, which could provide more effective solution. The distinctive feature of our study could be stated as follows. First, we designed the system that allows both the Anomaly dection and the Misuse detection. Second, we carried out the intrusion analysis experiment by using the reliable KDD Cup ‘99 data, which would provide us similar results compared to the real data. Finally, we designed the system based on the object-oriented concept, which could adapt to the other algorithms easily.

  • PDF

Application of Neural Network Self Adaptative Control System for A.C. Servo Motor Speed Control (A.C. 서보모터 속도 제어를 위한 신경망 자율 적응제어 시스템의 적용)

  • Park, Wal-Seo;Lee, Seong-Soo;Kim, Yong-Wook;Yoo, Seok-Ju
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.7
    • /
    • pp.103-108
    • /
    • 2007
  • Neural network is used in many fields of control systems currently. However, It is not easy to obtain input-output pattern when neural network is used for the system of a single feedback controller and it is difficult to get satisfied performance with neural network when load changes rapidly or disturbance is applied. To resolve these problems, this paper proposes a new mode to implement a neural network controller by installing a real object in place of activation function of Neural Network output node. As the Neural Network self adaptive control system is designed in simple structure neural network input-output pattern problem is solved naturally and real tin Loaming becomes possible through general back propagation algorithm. The effect of the proposed Neural Network self adaptive control algorithm was verified in a test of controlling the speed of a A.C. servo motor equipped with a high speed computing capable DSP (TMS320C32) on which the proposed algorithm was loaded.

Position Estimation of Wheeled Mobile Robot in a Corridor Using Neural Network (신경망을 이용한 복도에서의 구륜이동로봇의 위치추정)

  • Choi, Kyung-Jin;Lee, Young-Hyun;Park, Chong-Kug
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.5
    • /
    • pp.577-582
    • /
    • 2004
  • This paper describes position estimation algorithm using neural network for the navigation of the vision-based Wheeled Mobile Robot (WMR) in a corridor with taking ceiling lamps as landmark. From images of a corridor the lamp's line on the ceiling in corridor has a specific slope to the lateral position of the WMR. The vanishing point produced by the lamp's line also has a specific position to the orientation of WMR. The ceiling lamps has a limited size and shape like a circle in image. Simple image processing algorithms are used to extract lamps from the corridor image. Then the lamp's line and vanishing point's position are defined and calculated at known position of WMR in a corridor To estimate the lateral position and orientation of WMR from an image, the relationship between the position of WMR and the features of ceiling lamps have to be defined. Data set between position of WMR and features of lamps are configured. Neural network are composed and teamed with data set. Back propagation algorithm(BPN) is used for learning. And it is applied in navigation of WMR in a corridor.

A Recognition Algorithm for Handwritten Logic Circuit Diagrams Using Neural Network (신경회로망을 이용한 손으로 작성된 논리회로 도면 인식 알고리듬)

  • Kim, Dug-Ryung;Park, Sung-Han
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.27 no.10
    • /
    • pp.68-77
    • /
    • 1990
  • In this paper, a neural patten recognition method for the automatic circuit diagram reading system is proposed. The proposed procedure to recognize a deformed logic symbols is composed of three stages: feature detection, log mapping, and pattern classification. In the feature detection stage, a modified competitive learning algorithm where each pattern has the inhibition weight as well as the activation weight is developed. The global information of hand-written logic symbols is obtained by the feature detection neural network having both the inhibition and activation weights. The obtained global data is then transformed into a log space by the conformal mapping where according to the Schwartz's theory about the human visual signal process-ing, the degree of rotation and the scale change are mapped into the translation change. Logic symbols are finally classified by a three layer perceptron trained by the error back propagation algorithm. The computer simulation demonstrates that the proposed multistage neural network system can recognize well the deformed patterns of hand-written logic circuit diagrams.

  • PDF

Load Frequency Control of Multi-area Power System using Auto-tuning Neuro-Fuzzy Controller (자기조정 뉴로-퍼지제어기를 이용한 다지역 전력시스템의 부하주파수 제어)

  • Jeong, Hyeong-Hwan;Kim, Sang-Hyo;Ju, Seok-Min;Heo, Dong-Ryeol;Lee, Gwon-Sun
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.49 no.3
    • /
    • pp.95-106
    • /
    • 2000
  • The load frequency control of power system is one of important subjects in view of system operation and control. That is even though the rapid load disturbances were applied to the given power system, the stable and reliable power should be supplied to the users, converging unconditionally and rapidly the frequency deviations and the tie-line power flow one on each area into allowable boundary limits. Nonetheless of such needs, if the internal parameter perturbation and the sudden load variation were given, the unstable phenomenal of power system can be often brought out because of the large frequency deviation and the unsuppressible power line one. Therefore, it is desirable to design the robust neuro-fuzzy controller which can stabilize effectively the given power system as soon as possible. In this paper the robust neuro-fuzzy controller was proposed and applied to control of load frequency over multi-area power system. The architecture and algorithm of a designed NFC(Neuro-Fuzzy Controller) were consist of fuzzy controller and neural network for auto tuning of fuzzy controller. The adaptively learned antecedent and consequent parameters of membership functions in fuzzy controller were acquired from the steepest gradient method for error-back propagation algorithm. The performances of the resultant NFC, that is, the steady-state deviations of frequency and tie-line power flow and the related dynamics, were investigated and analyzed in detail by being applied to the load frequency control of multi-area power system, when the perturbations of predetermined internal parameters. Through the simulation results tried variously in this paper for disturbances of internal parameters and external stepwise load stepwise load changes, the superiorities of the proposed NFC in robustness and adaptive rapidity to the conventional controllers were proved.

  • PDF

Optimization of Process Parameters of Incremental Sheet Forming of Al3004 Sheet Using Genetic Algorithm-BP Neural Network (유전 알고리즘-BP신경망을 이용한 Al3004 판재 점진성형 공정변수에 대한 최적화 연구)

  • Yang, Sen;Kim, Young-Suk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.1
    • /
    • pp.560-567
    • /
    • 2020
  • Incremental Sheet Forming (ISF) is a unique sheet-forming technique. The process is a die-less sheet metal manufacturing process for rapid prototyping and small batch production. In the forming process, the critical parameters affecting the formability of sheet materials are the tool diameter, step depth, feed rate, spindle speed, etc. This study examined the effects of these parameters on the formability in the forming of the varying wall angle conical frustum model for a pure Al3004 sheet with 1mm in thickness. Using Minitab software based on Back Propagation Neural Network (BPNN) and Genetic Algorithm (GA), a second order mathematical prediction model was established to predict and optimize the wall angle. The results showed that the maximum forming angle was 87.071° and the best combination of these parameters to give the best performance of the experiment is as follows: tool diameter of 6mm, spindle speed of 180rpm, step depth of 0.4mm, and feed rate of 772mm/min.