• 제목/요약/키워드: Recurrent neural networks

검색결과 289건 처리시간 0.032초

변분법을 이용한 재귀신경망의 온라인 학습 (A on-line learning algorithm for recurrent neural networks using variational method)

  • 오원근;서병설
    • 제어로봇시스템학회논문지
    • /
    • 제2권1호
    • /
    • pp.21-25
    • /
    • 1996
  • In this paper we suggest a general purpose RNN training algorithm which is derived on the optimal control concepts and variational methods. First, learning is regared as an optimal control problem, then using the variational methods we obtain optimal weights which are given by a two-point boundary-value problem. Finally, the modified gradient descent algorithm is applied to RNN for on-line training. This algorithm is intended to be used on learning complex dynamic mappings between time varing I/O data. It is useful for nonlinear control, identification, and signal processing application of RNN because its storage requirement is not high and on-line learning is possible. Simulation results for a nonlinear plant identification are illustrated.

  • PDF

실시간 2차원 학습 신경망을 이용한 전기.유압 서보시스템의 추적제어 (Tracking Control of a Electro-hydraulic Servo System Using 2-Dimensional Real-Time Iterative Learning Algorithm)

  • 곽동훈;조규승;정봉호;이진걸
    • 제어로봇시스템학회논문지
    • /
    • 제9권6호
    • /
    • pp.435-441
    • /
    • 2003
  • This paper addresses that an approximation and tracking control of realtime recurrent neural networks(RTRN) using two-dimensional iterative teaming algorithm for an electro-hydraulic servo system. Two dimensional learning rule is driven in the discrete system which consists of nonlinear output fuction and linear input. In order to control the trajectory of position, two RTRN with the same network architecture were used. Simulation results show that two RTRN using 2-D learning algorithm are able to approximate the plant output and desired trajectory to a very high degree of a accuracy respectively and the control algorithm using two identical RTRN was very effective to trajectory tracking of the electro-hydraulic servo system.

A Study on the Lifetime Prediction of Lithium-Ion Batteries Based on the Long Short-Term Memory Model of Recurrent Neural Networks

  • Sang-Bum Kim
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제16권3호
    • /
    • pp.236-241
    • /
    • 2024
  • Due to the recent emphasis on carbon neutrality and environmental regulations, the global electric vehicle (EV) market is experiencing rapid growth. This surge has raised concerns about the recycling and disposal methods for EV batteries. Unlike traditional internal combustion engine vehicles, EVs require unique and safe methods for the recovery and disposal of their batteries. In this process, predicting the lifespan of the battery is essential. Impedance and State of Charge (SOC) analysis are commonly used methods for this purpose. However, predicting the lifespan of batteries with complex chemical characteristics through electrical measurements presents significant challenges. To enhance the accuracy and precision of existing measurement methods, this paper proposes using a Long Short-Term Memory (LSTM) model, a type of deep learning-based recurrent neural network, to diagnose battery performance. The goal is to achieve safe classification through this model. The designed structure was evaluated, yielding results with a Mean Absolute Error (MAE) of 0.8451, a Root Mean Square Error (RMSE) of 1.3448, and an accuracy of 0.984, demonstrating excellent performance.

Using neural networks to model and predict amplitude dependent damping in buildings

  • Li, Q.S.;Liu, D.K.;Fang, J.Q.;Jeary, A.P.;Wong, C.K.
    • Wind and Structures
    • /
    • 제2권1호
    • /
    • pp.25-40
    • /
    • 1999
  • In this paper, artificial neural networks, a new kind of intelligent method, are employed to model and predict amplitude dependent damping in buildings based on our full-scale measurements of buildings. The modelling method and procedure using neural networks to model the damping are studied. Comparative analysis of different neural network models of damping, which includes multi-layer perception network (MLP), recurrent neural network, and general regression neural network (GRNN), is performed and discussed in detail. The performances of the models are evaluated and discussed by tests and predictions including self-test, "one-lag" prediction and "multi-lag" prediction of the damping values at high amplitude levels. The established models of damping are used to predict the damping in the following three ways : (1) the model is established by part of the data measured from one building and is used to predict the another part of damping values which are always difficult to obtain from field measurements : the values at the high amplitude level. (2) The model is established by the damping data measured from one building and is used to predict the variation curve of damping for another building. And (3) the model is established by the data measured from more than one buildings and is used to predict the variation curve of damping for another building. The prediction results are discussed.

순환 신경망을 이용한 미세먼지 AQI 지수 예측 (Prediction of Particulate Matter AQI using Recurrent Neural Networks)

  • 정용진;이종성;오창헌
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2019년도 춘계학술대회
    • /
    • pp.543-545
    • /
    • 2019
  • 미세먼지에 따른 행동 지침을 위해 AQI 지수가 개발되어 사용되고 있다. AQI 지수에 대한 정보는 일반인들도 쉽게 제공 받을 수 있으며, 이에 따라 AQI 지수를 기반으로 다양한 서비스가 제공되고 있다. 서비스가 제공됨에 따라 정확한 AQI 지수의 예측이 필요하다. 본 논문에서는 미세먼지의 AQI 지수를 예측하기 위해 순환 신경망을 이용하여 분류 모델의 설계를 진행한다. 설계된 모델의 평가를 위해 실제 미세먼지와 예측치의 AQI 지수를 비교한다.

  • PDF

진화연산을 이용한 동적 귀환 신경망의 구조 저차원화 (Structure Pruning of Dynamic Recurrent Neural Networks Based on Evolutionary Computations)

  • 김대준;심귀보
    • 한국지능시스템학회논문지
    • /
    • 제7권4호
    • /
    • pp.65-73
    • /
    • 1997
  • 본 논문에서는 진화연산을 이용하여 동적 귀환 신경망의 구조를 저차원화하는 방법을 제안한다. 일반적으로 진화연산을 개체군을 이용한 탐색 방법으로서 신경회로망의 여러 가지 다른 성질을 동시에 최적화할 필요가 있을 때 유용한 방법이다. 본 연구에서는 동적 귀환 신경망의 구조를 조차원화하기 위하여 진화 프로그래밍으로 신경망의 구조를 탐색하고, 진화전략으로 신경망의 연결강도를 학습시킴으로서 전체적인 구조를 저차원화하였다.신경망의 중간층 노드의 추가/삭제는 돌연변이 확률에 의하여 결정한다. 노드를 삭제할 경우에는 입력 연결강도의 총합이 가장 작은 노드를 삭제하고, 노드를 추가할 경우에는 미리 지정한 확률함스에 따라 노드를 추가한다. 그리고 추가된 노드와 다른 노드와의 연결방법은 서로 영향을 미칠 수 있는 모든 연결강도 중에서 확률적으로 선택하여 연결하였다. 마지막으로 제안한 저차원화 동적 귀환 신경망이 완전 연결된 신경망보다 더 좋은 성능을 얻을 수 있음을 예제로서 본 논문에서는 도립진자의 안정화 및 제어와 로봇 매니퓰레이터의 비주얼 서보잉에 적용하여 컴퓨터 시뮬레이션을 통하여 그 유효성을 확인한다.

  • PDF

신경회로망을 이용한 원자력발전소 증기발생기의 지능제어 (Intelligent Control of Nuclear Power Plant Steam Generator Using Neural Networks)

  • 김성수;이재기;최진영
    • 제어로봇시스템학회논문지
    • /
    • 제6권2호
    • /
    • pp.127-137
    • /
    • 2000
  • This paper presents a novel neural based controller which controls the water level of the nuclear power plant steam generator. The controller consists of a model reference feedback linearization controller and a PI controller for stabilizing the feedback linearization controller. The feedback linearization controller consists of a neural network model and an inversing module which uses the neural network model for computing the control input to the steam generator. We chose Piecewise Linearly Trained Network(PLTN) and Recurrent Neural Netwrok(RNN) for an approximator of the plant and used these approximators in calculating the input from the feedback linearization controller. Combining the above two controllers gives a result of better performance than the case which uses only a PI controller Each control result of PLTN and RNN is given.

  • PDF

순환신경망 모델을 활용한 팔당호의 단기 수질 예측 (Short-Term Water Quality Prediction of the Paldang Reservoir Using Recurrent Neural Network Models)

  • 한지우;조용철;이소영;김상훈;강태구
    • 한국물환경학회지
    • /
    • 제39권1호
    • /
    • pp.46-60
    • /
    • 2023
  • Climate change causes fluctuations in water quality in the aquatic environment, which can cause changes in water circulation patterns and severe adverse effects on aquatic ecosystems in the future. Therefore, research is needed to predict and respond to water quality changes caused by climate change in advance. In this study, we tried to predict the dissolved oxygen (DO), chlorophyll-a, and turbidity of the Paldang reservoir for about two weeks using long short-term memory (LSTM) and gated recurrent units (GRU), which are deep learning algorithms based on recurrent neural networks. The model was built based on real-time water quality data and meteorological data. The observation period was set from July to September in the summer of 2021 (Period 1) and from March to May in the spring of 2022 (Period 2). We tried to select an algorithm with optimal predictive power for each water quality parameter. In addition, to improve the predictive power of the model, an important variable extraction technique using random forest was used to select only the important variables as input variables. In both Periods 1 and 2, the predictive power after extracting important variables was further improved. Except for DO in Period 2, GRU was selected as the best model in all water quality parameters. This methodology can be useful for preventive water quality management by identifying the variability of water quality in advance and predicting water quality in a short period.

Higher-Order Conditional Random Field established with CNNs for Video Object Segmentation

  • Hao, Chuanyan;Wang, Yuqi;Jiang, Bo;Liu, Sijiang;Yang, Zhi-Xin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제15권9호
    • /
    • pp.3204-3220
    • /
    • 2021
  • We perform the task of video object segmentation by incorporating a conditional random field (CRF) and convolutional neural networks (CNNs). Most methods employ a CRF to refine a coarse output from fully convolutional networks. Others treat the inference process of the CRF as a recurrent neural network and then combine CNNs and the CRF into an end-to-end model for video object segmentation. In contrast to these methods, we propose a novel higher-order CRF model to solve the problem of video object segmentation. Specifically, we use CNNs to establish a higher-order dependence among pixels, and this dependence can provide critical global information for a segmentation model to enhance the global consistency of segmentation. In general, the optimization of the higher-order energy is extremely difficult. To make the problem tractable, we decompose the higher-order energy into two parts by utilizing auxiliary variables and then solve it by using an iterative process. We conduct quantitative and qualitative analyses on multiple datasets, and the proposed method achieves competitive results.

순환 신경망에서 LSTM 블록을 사용한 영어와 한국어의 시편 생성기 비교 (Psalm Text Generator Comparison Between English and Korean Using LSTM Blocks in a Recurrent Neural Network)

  • 에런 스노버거;이충호
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국정보통신학회 2022년도 추계학술대회
    • /
    • pp.269-271
    • /
    • 2022
  • 최근 몇 년 동안 LSTM 블록이 있는 RNN 네트워크는 순차적 데이터를 처리하는 기계 학습 작업에 광범위하게 사용되어왔다. 이러한 네트워크는 주어진 시퀀스에서 가능성이 다음으로 가장 높은 단어를 기존 신경망보다 더 정확하게 예측할 수 있기 때문에 순차적 언어 처리 작업에서 특히 우수한 것으로 입증되었다. 이 연구는 영어와 한국어로 된 150개의 성경 시편에 대한 세 가지 다른 번역에 대해 RNN/LSTM 신경망을 훈련하였다. 그런 다음 결과 모델에 입력 단어와 길이 번호를 제공하여 훈련 중에 인식한 패턴을 기반으로 원하는 길이의 새 시편을 자동으로 생성하였다. 영어 텍스트와 한국어 텍스트에 대한 네트워크 훈련 결과를 상호 비교하고 개선할 점을 기술한다.

  • PDF