• Title/Summary/Keyword: back-propagation

Search Result 1,469, Processing Time 0.024 seconds

Learning of Differential Neural Networks Based on Kalman-Bucy Filter Theory (칼만-버쉬 필터 이론 기반 미분 신경회로망 학습)

  • Cho, Hyun-Cheol;Kim, Gwan-Hyung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.8
    • /
    • pp.777-782
    • /
    • 2011
  • Neural network technique is widely employed in the fields of signal processing, control systems, pattern recognition, etc. Learning of neural networks is an important procedure to accomplish dynamic system modeling. This paper presents a novel learning approach for differential neural network models based on the Kalman-Bucy filter theory. We construct an augmented state vector including original neural state and parameter vectors and derive a state estimation rule avoiding gradient function terms which involve to the conventional neural learning methods such as a back-propagation approach. We carry out numerical simulation to evaluate the proposed learning approach in nonlinear system modeling. By comparing to the well-known back-propagation approach and Kalman-Bucy filtering, its superiority is additionally proved under stochastic system environments.

Improving the Error Back-Propagation Algorithm of Multi-Layer Perceptrons with a Modified Error Function (역전파 학습의 오차함수 개선에 의한 다층퍼셉트론의 학습성능 향상)

  • 오상훈;이영직
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.6
    • /
    • pp.922-931
    • /
    • 1995
  • In this paper, we propose a modified error function to improve the EBP(Error Back-Propagation) algorithm of Multi-Layer Perceptrons. Using the modified error function, the output node of MLP generates a strong error signal in the case that the output node is far from the desired value, and generates a weak error signal in the opposite case. This accelerates the learning speed of EBP algorothm in the initial stage and prevents overspecialization for training patterns in the final stage. The effectiveness of our modification is verified through the simulation of handwritten digit recognition.

  • PDF

Tomogram Enhancement using Iterative Error Correction Algorithm

  • Ko, Dae-Sik;Park, Jun-Sok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.4E
    • /
    • pp.9-13
    • /
    • 1996
  • We developed an iterative algorithm which could improve the resolution of reconstructed tomograms having random attenuation patterns and analyzed the limitation of this algorithm. The simple back-and forth propagation algorithm has depth resolution about four wavelengths. An iterative algorithm, based on back-and-forth propagation, can be used to improve the resolution of reconstructed tomograms. We analyzed the wavefield for multi-layered specimen and programmed iterative algorithm using Clanguage. Simulation results show that the images get clearer as the number of iterations increases. Also, unambiguous images can be reconstructed using this algorithm even when the layer separation is only two wavelengths. However, this iteration algorithm comes up with an incorrect solution for the number of projections less than five.

  • PDF

Gabor-Features Based Wavelet Decomposition Method for Face Detection (얼굴 검출을 위한 Gabor 특징 기반의 웨이블릿 분해 방법)

  • Lee, Jung-Moon;Choi, Chan-Sok
    • Journal of Industrial Technology
    • /
    • v.28 no.B
    • /
    • pp.143-148
    • /
    • 2008
  • A real-time face detection is to find human faces robustly under the cluttered background free from the effect of occlusion by other objects or various lightening conditions. We propose a face detection system for real-time applications using wavelet decomposition method based on Gabor features. Firstly, skin candidate regions are extracted from the given image by skin color filtering and projection method. Then Gabor-feature based template matching is performed to choose face cadidate from the skin candidate regions. The chosen face candidate region is transformed into 2-level wavelet decomposition images, from which feature vectors are extracted for classification. Based on the extracted feature vectors, the face candidate region is finally classified into either face or nonface class by the Levenberg-Marguardt back-propagation neural network.

  • PDF

Dynamic Control of Track Vehicle Using Fuzzy-Neural Control Method (퍼지-뉴럴 제어기법에 의한 궤도차량의 동적 제어)

  • 한성현;서운학;조길수;윤강섭
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1997.04a
    • /
    • pp.133-139
    • /
    • 1997
  • This paper presents a new approach to the dynamic control technique for track vehicle system using neural network-fuzzy control method. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is propored a learning controller consisting of two neural network-fuzzy based on independent resoning and a connection net with fixed weights to simply the neural network-fuzzy. The performance of the proposed controller is shown by simulation for trajectory tracking of the speed and azimuth of a track vehicle

  • PDF

Comparison of the BOD Forecasting Ability of the ARIMA model and the Artificial Neural Network Model (ARIMA 모형과 인공신경망모형의 BOD예측력 비교)

  • 정효준;이홍근
    • Journal of Environmental Health Sciences
    • /
    • v.28 no.3
    • /
    • pp.19-25
    • /
    • 2002
  • In this paper, the water quality forecast was performed on the BOD of the Chungju Dam using the ARIMA model, which is a nonlinear statistics model, and the artificial neural network model. The monthly data of water quality were collected from 1991 to 2000. The most appropriate ARIMA model for Chungju dam was found to be the multiplicative seasonal ARIMA(1,0,1)(1,0,1)$_{12}$, model. While the artificial neural network model, which is used relatively often in recent days, forecasts new data by the strength of a learned matrix like human neurons. The BOD values were forecasted using the back-propagation algorithm of multi-layer perceptrons in this paper. Artificial neural network model was com- posed of two hidden layers and the node number of each hidden layer was designed fifteen. It was demonstrated that the ARIMA model was more appropriate in terms of changes around the overall average, but the artificial neural net-work model was more appropriate in terms of reflecting the minimum and the maximum values.s.

Sensor Failure Detection and Accommodation Based on Neural Networks (신경회로망을 이용한 센서 고장진단 및 극복)

  • 이균정;이봉기
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.1 no.1
    • /
    • pp.82-91
    • /
    • 1998
  • This paper presents a neural networks based approach for the problem of sensor failure detection and accommodation for ship without physical redundancy in the sensors. The designed model consists of two neural networks. The first neural network is responsible for the failure detection and the second neural network is responsible for the failure identification and accommodation. On the yaw rate sensor of ship, simulation results indicates that the proposed method can be useful as failure detector and sensor estimator.

  • PDF

Container Identifier Recognition System for GATE automation (GATE 자동화를 위한 컨테이너 식별자 인식 시스템)

  • 유영달;하성욱;강대성
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 1998.10a
    • /
    • pp.137-141
    • /
    • 1998
  • Todays the efficient management of container has not been realized in container terminal, because of the excessive quantity of container transported and manual system. For the efficient and automated management of container in terminal, the automated container identifier recognition system in terminal is a significant problem. However, the identifier recognition rate is decreased owing to the difficulty of image preprocessing caused the refraction of container surface, the change of weather and the damaged identifier characters. Therefore, this paper proposes more accurate system for container identifier recognition as suggestion of Line-Scan Proper Region Detect for stronger preprocessing against external noisy element and Moment Back-Propagation Neural Network to recognize identifier.

  • PDF

Comparison of Different Schemes for Speed Sensorless Control of Induction Motor Drives by Neural Network (유도전동기의 속도 센서리스 제어를 위한 신경회로망 알고리즘의 추정 특성 비교)

  • 이경훈;국윤상;김윤호;최원범
    • Proceedings of the KIPE Conference
    • /
    • 1999.07a
    • /
    • pp.526-530
    • /
    • 1999
  • This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

  • PDF

Estimating a Consolidation Behavior of Clay Using Artificial Neural Network (인공신경망을 이용한 압밀거동 예측)

  • Park, Hyung-Gyu;Kang, Myung-Chan;Lee, Song
    • Proceedings of the Korean Geotechical Society Conference
    • /
    • 2000.11a
    • /
    • pp.673-680
    • /
    • 2000
  • Artificial neural networks are efficient computing techniques that are widely used to solve complex problems in many fields. In this study, a back-propagation neural network model for estimating a consolidation behavior of clay from soil parameter, site investigation data and the first settlement curve is proposed. The training and testing of the network were based on a database of 63 settlement curve from two different sites. Five different network models were used to study the ability of the neural network to predict the desired output to increasing degree of accuracy. The study showed that the neural network model predicted a consolidation behavior of clay reasonably well.

  • PDF