• Title/Summary/Keyword: back-propagation learning algorithm

Search Result 386, Processing Time 0.024 seconds

Improving the Error Back-Propagation Algorithm of Multi-Layer Perceptrons with a Modified Error Function (역전파 학습의 오차함수 개선에 의한 다층퍼셉트론의 학습성능 향상)

  • 오상훈;이영직
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.6
    • /
    • pp.922-931
    • /
    • 1995
  • In this paper, we propose a modified error function to improve the EBP(Error Back-Propagation) algorithm of Multi-Layer Perceptrons. Using the modified error function, the output node of MLP generates a strong error signal in the case that the output node is far from the desired value, and generates a weak error signal in the opposite case. This accelerates the learning speed of EBP algorothm in the initial stage and prevents overspecialization for training patterns in the final stage. The effectiveness of our modification is verified through the simulation of handwritten digit recognition.

  • PDF

The Basic Design of High Speed Neural Network Filter for Application of Machine Tools Controller (공작기계 컨트롤러용 고속 신경망 필터의 기초설계)

  • 김진선;신우철;홍준희
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2003.10a
    • /
    • pp.125-130
    • /
    • 2003
  • This Paper describes a Nonlinear adoptive noise canceller using Neural Network for Machine Tools Controller System. Back-Propagation Learning Algorithm based MLP (Multi Layer Perceptron)is used an adaptive filters. In this Paper. it assume that the noise of primary input in the adaptive noise canceller is not the same characteristic as that of the reference input. Experimental results show that the neural network base noise canceller outperforms the linear noise canceller. Especially to make noise cancel close to realtime, Primary Input is divided by Unit and each divided pan is processed for very short time than all the processed data are unified to whole data.

  • PDF

A Study on Emergency Monitoring Robot System by Back-Propagation Algorithm

  • Yoo, Sowol;Kim, Miae;Lee, Kwangok;Bae, Sanghyun
    • Journal of Integrative Natural Science
    • /
    • v.7 no.1
    • /
    • pp.62-66
    • /
    • 2014
  • This study aims to implement the emergency monitoring robot system which predicts the current state of the patients without visiting the medical institutions by measuring the basic health status of the user's blood pressure, heartbeat, and basic health status of body temperature in the disaster emergency situation based on the Smart Grid. By arranging a large number of sensor(blood pressure, heartbeat, body temperature sensor) and measuring the bio signs, so the attached wireless XBee sensor can be stored in DB of robot, and it aims to draw the current state of the patients by analysis of stored bio data. Among 300 data obtained from the sensor, 1st data to 100th data were used for learning, and from 101st data to 300th data were used for assessment. 12 results were different among the total 300 assessment data, so it shows about 96% accuracy.

Implementation of Self-adaptive System using the Algorithm of Neural Network Learning Gain

  • Lee, Seong-Su;Kim, Yong-Wook;Oh, Hun;Park, Wal-Seo
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.3
    • /
    • pp.453-459
    • /
    • 2008
  • The neural network is currently being used throughout numerous control system fields. However, it is not easy to obtain an input-output pattern when the neural network is used for the system of a single feedback controller and it is difficult to obtain satisfactory performance with when the load changes rapidly or disturbance is applied. To resolve these problems, this paper proposes a new mode to implement a neural network controller by installing a real object for control and an algorithm for this, which can replace the existing method of implementing a neural network controller by utilizing activation function at the output node. The real plant object for controlling of this mode implements a simple neural network controller replacing the activation function and provides the error back propagation path to calculate the error at the output node. As the controller is designed using a simple structure neural network, the input-output pattern problem is solved naturally and real-time learning becomes possible through the general error back propagation algorithm. The new algorithm applied neural network controller gives excellent performance for initial and tracking response and shows a robust performance for rapid load change and disturbance, in which the permissible error surpasses the range border. The effect of the proposed control algorithm was verified in a test that controlled the speed of a motor equipped with a high speed computing capable DSP on which the proposed algorithm was loaded.

Learning method of a Neural Network using Genetic Algorithm for 3 Bit Parity Discrimination (패리티 판별을 위한 유전자 알고리즘을 사용한 신경회로망의 학습법)

  • Choi, Jae-Seung;Kim, Chung-Hwa
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.2 s.314
    • /
    • pp.11-18
    • /
    • 2007
  • Back propagation algorithm based on a gradient-decent method has been widely used to the training of a neural network. However, this algorithm have some problems such as dropping the minimum value in a local area according to an initial value and setting the number of units in a hidden layer when training the neural network. Accordingly, to solve the above-mentioned problems, this paper proposes a genetic algorithm using the training method of the neural network. Thus, the improved genetic algorithm using a new crossover and mutation method is proposed to discriminate 3 bit parity. Experiments confirm that the proposed system is effective for training speed after demonstrating for generation gap, the number of units in the hidden layer, and the number of individuals.

A Study on the Learning Method of Documents for Implementation of Automated Documents Classificator (문서 자동 분류기의 구현을 위한 문서 학습 방법에 관한 연구)

  • 선복근;이인정;한광록
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.1001-1004
    • /
    • 1999
  • We study on machine learning method for automatic document categorization using back propagation algorithm. Four categories are classified for the experiment and the system learns with 20 documents per a category by this method. As a result of the machine learning, we can find that a new document is automatically classified with a category according to the predefined ones.

  • PDF

The methods of recognition of consonants(voiced stops) by Neural Network (신경망에 의한 초성자음(ㄱ, ㄷ, ㅂ)의 인식방법)

  • 김석동
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1991.06a
    • /
    • pp.73-77
    • /
    • 1991
  • As the basic analysis to solve the stop consonants in phoneme based speech recognition using Back Propagation learning algorithm, changes in hidden units, training set and iteration. Also we propose an efficient processing method of separation between consonants and vowels.

  • PDF

A neural network with adaptive learning algorithm of curvature smoothing for time-series prediction (시계열 예측을 위한 1, 2차 미분 감소 기능의 적응 학습 알고리즘을 갖는 신경회로망)

  • 정수영;이민호;이수영
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.34C no.6
    • /
    • pp.71-78
    • /
    • 1997
  • In this paper, a new neural network training algorithm will be devised for function approximator with good generalization characteristics and tested with the time series prediction problem using santaFe competition data sets. To enhance the generalization ability a constraint term of hidden neuraon activations is added to the conventional output error, which gives the curvature smoothing characteristics to multi-layer neural networks. A hybrid learning algorithm of the error-back propagation and Hebbian learning algorithm with weight decay constraint will be naturally developed by the steepest decent algorithm minimizing the proposed cost function without much increase of computational requriements.

  • PDF

Design of Adaptive-Neuro Controller of SCARA Robot Using Digital Signal Processor (디지털 시그널 프로세서를 이용한 스카라 로봇의 적응-신경제어기 설계)

  • 한성현
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.6 no.1
    • /
    • pp.7-17
    • /
    • 1997
  • During the past decade, there were many well-established theories for the adaptive control of linear systems, but there exists relatively little general theory for the adaptive control of nonlinear systems. Adaptive control technique is essential for providing a stable and robust performance for application of industrial robot control. Neural network computing methods provide one approach to the development of adaptive and learning behavior in robotic system for manufacturing. Computational neural networks have been demonstrated which exhibit capabilities for supervised learning, matching, and generalization for problems on an experimental scale. Supervised learning could improve the efficiency of training and development of robotic systems. In this paper, a new scheme of adaptive-neuro control system to implement real-time control of robot manipulator using digital signal processors is proposed. Digital signal processors, DSPs, are micro-processors that are developed particularly for fast numerical computations involving sums and products of variables. The proposed neuro control algorithm is one of learning a model based error back-propagation scheme using Lyapunov stability analysis method. The proposed adaptive-neuro control scheme is illustrated to be an efficient control scheme for implementation of real-time control for SCARA robot with four-axes by experiment.

  • PDF

Forecasting of Passenger Numbers, Freight Volumes and Optimal Tonnage of Passenger Ship in Mokpo Port (목포항 여객수 및 적정 선복량 추정에 관한 연구)

  • Jang, Woon-Jae;Keum, Jong-Soo
    • Journal of Navigation and Port Research
    • /
    • v.28 no.6
    • /
    • pp.509-515
    • /
    • 2004
  • The aim of this paper is to forecast passenger numbers and freight volumes in 2005 and it is proposed optimal tonnage of passenger ship. The forecasting of passenger numbers and freight volumes is important problem in order to determine optimal tonnage of passenger ship, port plan and development. In this paper, the forecasting of passenger numbers and freight volumes are performed by the method of neural network using back-propagation learning algorithm. And this paper compares the forecasting performance of neural networks with moving average method and exponential smooth method As the result of analysis. The forecasting of passenger numbers and freight volumes is that the neural networks performed better than moving average method and exponential smoothing method on the basis of MSE(mean square error) and MAE(mean absolute error).