• Title/Summary/Keyword: Elman 신경망

Search Result 23, Processing Time 0.024 seconds

Nonlinear Adaptive Prediction using Locally and Globally Recurrent Neural Networks (지역 및 광역 리커런트 신경망을 이용한 비선형 적응예측)

  • 최한고
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.40 no.1
    • /
    • pp.139-147
    • /
    • 2003
  • Dynamic neural networks have been applied to diverse fields requiring temporal signal processing such as signal prediction. This paper proposes the hybrid network, composed of locally(LRNN) and globally recurrent neural networks(GRNN), to improve dynamics of multilayered recurrent networks(RNN) and then describes nonlinear adaptive prediction using the proposed network as an adaptive filter. The hybrid network consists of IIR-MLP and Elman RNN as LRNN and GRNN, respectively. The proposed network is evaluated in nonlinear signal prediction and compared with Elman RNN and IIR-MLP networks for the relative comparison of prediction performance. Experimental results show that the hybrid network performs better with respect to convergence speed and accuracy, indicating that the proposed network can be a more effective prediction model than conventional multilayered recurrent networks in nonlinear prediction for nonstationary signals.

System Identification Using Hybrid Recurrent Neural Networks (Hybrid 리커런트 신경망을 이용한 시스템 식별)

  • Choi Han-Go;Go Il-Whan;Kim Jong-In
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.6 no.1
    • /
    • pp.45-52
    • /
    • 2005
  • Dynamic neural networks have been applied to diverse fields requiring temporal signal processing. This paper describes system identification using the hybrid neural network, composed of locally(LRNN) and globally recurrent neural networks(GRNN) to improve dynamics of multilayered recurrent networks(RNN). The structure of the hybrid nework combines IIR-MLP as LRNN and Elman RNN as GRNN. The hybrid network is evaluated in linear and nonlinear system identification, and compared with Elman RNN and IIR-MLP networks for the relative comparison of its performance. Simulation results show that the hybrid network performs better with respect to the convergence and accuracy, indicating that it can be a more effective network than conventional multilayered recurrent networks in system identification.

  • PDF

The Improving Method of Characters Recognition Using New Recurrent Neural Network (새로운 순환신경망을 사용한 문자인식성능의 향상 방안)

  • 정낙우;김병기
    • Journal of the Korea Society of Computer and Information
    • /
    • v.1 no.1
    • /
    • pp.129-138
    • /
    • 1996
  • In the result of Industrial development. largeness and highness of techniques. a large amount of Information Is being treated every year. Achive informationization. we must store in computer ,all informations written on paper for a long time and be able to utilize them In right time and place. There Is recurrent neural network as a model rousing the output value In learning neural network for characters recognition. But most of these methods are not so effectively applied to it. This study suggests a new type of recurrent neural network to classifyeffectively the static patterns such as off-line handwritten characters. This study shows that this new type Is better than those of before in recognizing the patterns. such as figures and handwritten characters, by using the new J-E (Jordan-Elman) neural network model in which enlarges and combines Jordan and Elman Model.

  • PDF

Application of recurrent neural network for inflow prediction into multi-purpose dam basin (다목적댐 유입량 예측을 위한 Recurrent Neural Network 모형의 적용 및 평가)

  • Park, Myung Ky;Yoon, Yung Suk;Lee, Hyun Ho;Kim, Ju Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.51 no.12
    • /
    • pp.1217-1227
    • /
    • 2018
  • This paper aims to evaluate the applicability of dam inflow prediction model using recurrent neural network theory. To achieve this goal, the Artificial Neural Network (ANN) model and the Elman Recurrent Neural Network(RNN) model were applied to hydro-meteorological data sets for the Soyanggang dam and the Chungju dam basin during dam operation period. For the model training, inflow, rainfall, temperature, sunshine duration, wind speed were used as input data and daily inflow of dam for 10 days were used for output data. The verification was carried out through dam inflow prediction between July, 2016 and June, 2018. The results showed that there was no significant difference in prediction performance between ANN model and the Elman RNN model in the Soyanggang dam basin but the prediction results of the Elman RNN model are comparatively superior to those of the ANN model in the Chungju dam basin. Consequently, the Elman RNN prediction performance is expected to be similar to or better than the ANN model. The prediction performance of Elman RNN was notable during the low dam inflow period. The performance of the multiple hidden layer structure of Elman RNN looks more effective in prediction than that of a single hidden layer structure.

Peak Impact Force of Ship Bridge Collision Based on Neural Network Model (신경망 모델을 이용한 선박-교각 최대 충돌력 추정 연구)

  • Wang, Jian;Noh, Jackyou
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.28 no.1
    • /
    • pp.175-183
    • /
    • 2022
  • The collision between a ship and bridge across a waterway may result in extremely serious consequences that may endanger the safety of life and property. Therefore, factors affecting ship bridge collision must be investigated, and the impact force should be discussed based on various collision conditions. In this study, a finite element model of ship bridge collision is established, and the peak impact force of a ship bridge collision based on 50 operating conditions combined with three input parameters, i.e., ship loading condition, ship speed, and ship bridge collision angle, is calculated via numerical simulation. Using neural network models trained with the numerical simulation results, the prediction model of the peak impact force of ship bridge collision involving an extremely short calculation time on the order of milliseconds is established. The neural network models used in this study are the basic backpropagation neural network model and Elman neural network model, which can manage temporal information. The accuracy of the neural network models is verified using 10 test samples based on the operating conditions. Results of a verification test show that the Elman neural network model performs better than the backpropagation neural network model, with a mean relative error of 4.566% and relative errors of less than 5% in 8 among 10 test cases. The trained neural network can yield a reliable ship bridge collision force instantaneously only when the required parameters are specified and a nonlinear finite element solution process is not required. The proposed model can be used to predict whether a catastrophic collision will occur during ship navigation, and thus hence the safety of crew operating the ship.

A Study on Speech Recognition using Recurrent Neural Networks (회귀신경망을 이용한 음성인식에 관한 연구)

  • 한학용;김주성;허강인
    • The Journal of the Acoustical Society of Korea
    • /
    • v.18 no.3
    • /
    • pp.62-67
    • /
    • 1999
  • In this paper, we investigates a reliable model of the Predictive Recurrent Neural Network for the speech recognition. Predictive Neural Networks are modeled by syllable units. For the given input syllable, then a model which gives the minimum prediction error is taken as the recognition result. The Predictive Neural Network which has the structure of recurrent network was composed to give the dynamic feature of the speech pattern into the network. We have compared with the recognition ability of the Recurrent Network proposed by Elman and Jordan. ETRI's SAMDORI has been used for the speech DB. In order to find a reliable model of neural networks, the changes of two recognition rates were compared one another in conditions of: (1) changing prediction order and the number of hidden units: and (2) accumulating previous values with self-loop coefficient in its context. The result shows that the optimum prediction order, the number of hidden units, and self-loop coefficient have differently responded according to the structure of neural network used. However, in general, the Jordan's recurrent network shows relatively higher recognition rate than Elman's. The effects of recognition rate on the self-loop coefficient were variable according to the structures of neural network and their values.

  • PDF

A New Thpe of Recurrent Neural Network for the Umprovement of Pattern Recobnition Ability (패턴 인식 성능을 향상시키는 새로운 형태의 순환신경망)

  • Jeong, Nak-U;Kim, Byeong-Gi
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.2
    • /
    • pp.401-408
    • /
    • 1997
  • Human gets almist all of his knoweledge from the recognition and the accumulation of input patterns,image or sound,the he gets theough his eyes and through his ears.Among these means,his chracter recognition,an ability that allows him to recognize characters and understand their meanings through visual information, is now applied to a pattern recognition system using neural network in computer. Recurrent neural network is one of those models that reuse the output value in neural network learning.Recently many studies try to apply this recurrent neural network to the classification of static patterns like off-line handwritten characters. But most of their efforts are not so drrdtive until now.This stusy suggests a new type of recurrent neural network for an deedctive classification of the static patterns such as off-line handwritten chracters.Using the new J-E(Jordan-Elman)neural network model that enlarges and combines Jordan Model and Elman Model,this new type is better than those of before in recobnizing the static patterms such as figures and handwritten-characters.

  • PDF

Estimates of Settlement in Field Ground Using Neural Networks (인공신경망을 이용한 현장지반의 장래 침하량 산정)

  • 김영수;정성관;이상웅;이동현
    • Journal of the Korean Geotechnical Society
    • /
    • v.19 no.5
    • /
    • pp.27-33
    • /
    • 2003
  • This study analyzed an application possibility of neural network to overcome problems of conventional settlement prediction. It is very important to estimate settlement in preloading method used to improve soft ground. At present, Hyperbolic method, Hoshino method and Asaoka method are used mostly in the prediction of settlement. But these methods can not predict settlement at the phase of design. On the other hand, neural networks are capable of predicting settlement through accumulated data in the phase of design and this method can be easily applied in practice. In this study Elman neural network is used to estimate future settlement.

A Study on the Recognition of Korean Numerals Using Recurrent Neural Predictive HMM (회귀신경망 예측 HMM을 이용한 숫자음 인식에 관한 연구)

  • 김수훈;고시영;허강인
    • The Journal of the Acoustical Society of Korea
    • /
    • v.20 no.8
    • /
    • pp.12-18
    • /
    • 2001
  • In this paper, we propose the Recurrent Neural Predictive HMM (RNPHMM). The RNPHMM is the hybrid network of the recurrent neural network and HMM. The predictive recurrent neural network trained to predict the future vector based on several last feature vectors, and defined every state of HMM. This method uses the prediction value from the predictive recurrent neural network, which is dynamically changing due to the effects of the previous feature vectors instead of the stable average vectors. The models of the RNPHMM are Elman network prediction HMM and Jordan network prediction HMM. In the experiment, we compared the recognition abilities of the RNPHMM as we increased the state number, prediction order, and number of hidden nodes for the isolated digits. As a result of the experiments, Elman network prediction HMM and Jordan network prediction HMM have good recognition ability as 98.5% for test data, respectively.

  • PDF

Enhancement of QRS Complex using a Neural Network based ALE (신경망 ALE를 사용한 QRS complex의 증대)

  • 최한고;심은보
    • Journal of Biomedical Engineering Research
    • /
    • v.21 no.5
    • /
    • pp.487-494
    • /
    • 2000
  • 본 논문에서는 배경잡음이 섞여 있는 QRS 파의 증대를 위해 신경망에 근거한 적응라인증대기(ALE) 적용을 다루고 있다. Elman과 Jordan RNN 구조의 합성형태를 갖는 수정된 완전연결 리커런트 신경망이 ALE의 비션형 적응필터로 사용되고 있다. 신경망 노드사이의 연결계수와 이득, 기울기, 지연과 같은 노드 활성함수의 변수들이 기울기 강하 알고리즘을 사용하여 학습이 반복될 때마다 갱신된다. 수정된 신경망은 먼저 미지의 선형과 비선형 시스템 identification을 수행함으로써 평가하였다. 그리고 미약한 QRS를 증대시키기 위해서 적당한 크기의 잡음과 매우 심한 잡음이 포함된 실제의 ECG 신호를 비선형 신경망 적응필처를 사용하는 ALE에 입력하였다. 수정된 신경망은 시스템 identification에 사용하기가 적합함을 확인하였으며, 시뮬레이션 결과에 의하면 신경망 ALE는 잡음 ECG 신호로부터 QRS 파를 증대를 잘 수행하였다.

  • PDF