• Title/Summary/Keyword: Back Propagation Training Algorithm

Search Result 185, Processing Time 0.033 seconds

The Constrained Least Mean Square Error Method (제한 최소 자승오차법)

  • 나희승;박영진
    • Journal of KSNVE
    • /
    • v.4 no.1
    • /
    • pp.59-69
    • /
    • 1994
  • A new LMS algorithm titled constrained LMS' is proposed for problems with constrained structure. The conventional LMS algorithm can not be used because it destroys the constrained structures of the weights or parameters. Proposed method uses error-back propagation, which is popular in training neural networks, for error minimization. The illustrative examplesare shown to demonstrate the applicability of the proposed algorithm.

  • PDF

Comparison of Different Schemes for Speed Sensorless Control of Induction Motor Drives by Neural Network (유도전동기의 속도 센서리스 제어를 위한 신경회로망 알고리즘의 추정 특성 비교)

  • 이경훈;국윤상;김윤호;최원범
    • Proceedings of the KIPE Conference
    • /
    • 1999.07a
    • /
    • pp.526-530
    • /
    • 1999
  • This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

  • PDF

Implementation of Speed-Sensorless Induction Motor Drives with RLS Algorithm (RLS 알로리즘을 이용한 유도전동기의 속도 센서리스 운전)

  • 김윤호;국윤상
    • Proceedings of the KIPE Conference
    • /
    • 1998.07a
    • /
    • pp.384-387
    • /
    • 1998
  • This paper presents a newly developed speed sensorless drive using RLS(Recursive Least Squares) based on Neural Network Training Algorithm. The proposed algorithm based on the RLS has just the time-varying learning rate, while the well-known back-propagation (or generalized delta rule) algorithm based on gradient descent has a constant learning rate. The number of iterations required by the new algorithm to converge is less than that of the back-propagation algorithm. The RLS based on NN is used to adjust the motor speed so that the neural model output follows the desired trajectory. This mechanism forces the estimated speed to follow precisely the actual motor speed. In this paper, a flux estimation strategy using filter concept is discussed. The theoretical analysis and experimental results to verify the effectiveness of the proposed analysis and the proposed control strategy are described.

  • PDF

Reduction of Environmental Background Noise using Speech and Noise Recognition (음성 및 잡음 인식 알고리즘을 이용한 환경 배경잡음의 제거)

  • Choi, Jae-Seung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.15 no.4
    • /
    • pp.817-822
    • /
    • 2011
  • This paper first proposes the speech recognition algorithm by detection of the speech and noise sections at each frame using a neural network training by back-propagation algorithm, then proposes the spectral subtraction method which removes the noises at each frame according to detection of the speech and noise sections. In this experiment, the performance of the proposed recognition system was evaluated based on the recognition rate using various speeches that are degraded by white noise and car noise. Moreover, experimental results of the noise reduction by the spectral subtraction method demonstrate using the speech and noise sections detecting by the speech recognition algorithm at each frame. Based on measuring signal-to-noise ratio, experiments confirm that the proposed algorithm is effective for the speech by corrupted the noise using signal-to-noise ratio.

Application of Neural Networks For Estimating Evapotranspiration

  • Lee, Nam-Ho
    • Proceedings of the Korean Society for Agricultural Machinery Conference
    • /
    • 1993.10a
    • /
    • pp.1273-1281
    • /
    • 1993
  • Estimation of daily and seasonal evaportranspiration is essential for water resource planning irrigation feasibility study, and real-time irrigation water management . This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration . A neural network was developed to forecast daily evapotranspiration of the rice crop. It is a three-layer network with input, hidden , and output layers. Back-propagation algorithm with delta learning rule was used to train the neural network. Training neural network wasconducted usign daily actural evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity , and pan evaporation . During the training, neural network parameters were calibrated. The trained network was applied to a set of field data not used in the training . The created response of the neural network was in good agreement with desired values. Evaluating the neural networ performance indicates that neural network may be applied to the estimation of evapotranspiration of the rice crop.

  • PDF

Application of Back-propagation Algorithm for the forecasting of Temperature and Humidity (온도 및 습도의 단기 예측에 있어서 역전파 알고리즘의 적용)

  • Jeong, Hyo-Joon;Hwang, Won-Tae;Suh, Kyung-Suk;Kim, Eun-Han;Han, Moon-Hee
    • Journal of Environmental Impact Assessment
    • /
    • v.12 no.4
    • /
    • pp.271-279
    • /
    • 2003
  • Temperature and humidity forecasting have been performed using artificial neural networks model(ANN). We composed ANN with multi-layer perceptron which is 2 input layers, 2 hidden layers and 1 output layer. Back propagation algorithm was used to train the ANN. 6 nodes and 12 nodes in the middle layers were appropriate to the temperature model for training. And 9 nodes and 6 nodes were also appropriate to the humidity model respectively. 90% of the all data was used learning set, and the extra 10% was used to model verification. In the case of temperature, average temperature before 15 minute and humidity at present constituted input layer, and temperature at present constituted out-layer and humidity model was vice versa. The sensitivity analysis revealed that previous value data contributed to forecasting target value than the other variable. Temperature was pseudo-linearly related to the previous 15 minute average value. We confirmed that ANN with multi-layer perceptron could support pollutant dispersion model by computing meterological data at real time.

Self-Adaptive Learning Algorithm for Training Multi-Layered Neural Networks and Its Applications (다층 신경회로망의 자기 적응 학습과 그 응용)

  • Cheung, Wan-Sup;Jho, Moon-Jae;Hammond, Joseph K.
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.1E
    • /
    • pp.25-36
    • /
    • 1994
  • A problem of making a neural network learning self-adaptive to the training set supplied is addressed in this paper. This arises from the aspect in choice of an adequate stepsize for the update of the current weigh vectors according to the training pairs. Related issues in this attempt are raised and fundamentals in neural network learning are introduced. In comparison to the most popular back-propagation scheme, the usefulness and superiority of the proposed weight update algorithm are illustrated by examing the identification of unknown nonlinear systems only from measurements.

  • PDF

A study on nonlinear data-based modeling using fuzzy neural networks (퍼지신경망을 이용한 비선형 데이터 모델링에 관한 연구)

  • Kwon, Oh-Gook;Jang, Wook;Joo, Young-Hoon;Choi, Yoon-Ho;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.120-123
    • /
    • 1997
  • This paper presents models of fuzzy inference systems that can be built from a set of input-output training data pairs through hybrid structure-parameter learning. Fuzzy inference systems has the difficulty of parameter learning. Here we develop a coding format to determine a fuzzy neural network(FNN) model by chromosome in a genetic algorithm(GA) and present systematic approach to identify the parameters and structure of FNN. The proposed FNN can automatically identify the fuzzy rules and tune the membership functions by modifying the connection weights of the networks using the GA and the back-propagation learning algorithm. In order to show effectiveness of it we simulate and compare with conventional methods.

  • PDF

Neural Netwotk Analysis of Acoustic Emission Signals for Drill Wear Monitoring

  • Prasopchaichana, Kritsada;Kwon, Oh-Yang
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.28 no.3
    • /
    • pp.254-262
    • /
    • 2008
  • The objective of the proposed study is to produce a tool-condition monitoring (TCM) strategy that will lead to a more efficient and economical drilling tool usage. Drill-wear monitoring is an important attribute in the automatic cutting processes as it can help preventing damages of the tools and workpieces and optimizing the tool usage. This study presents the architectures of a multi-layer feed-forward neural network with back-propagation training algorithm for the monitoring of drill wear. The input features to the neural networks were extracted from the AE signals using the wavelet transform analysis. Training and testing were performed under a moderate range of cutting conditions in the dry drilling of steel plates. The results indicated that the extracted input features from AE signals to the supervised neural networks were effective for drill wear monitoring and the output of the neural networks could be utilized for the tool life management planning.

The methods of recognition of consonants(voiced stops) by Neural Network (신경망에 의한 초성자음(ㄱ, ㄷ, ㅂ)의 인식방법)

  • 김석동
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1991.06a
    • /
    • pp.73-77
    • /
    • 1991
  • As the basic analysis to solve the stop consonants in phoneme based speech recognition using Back Propagation learning algorithm, changes in hidden units, training set and iteration. Also we propose an efficient processing method of separation between consonants and vowels.

  • PDF