• 제목/요약/키워드: recurrent neural network

검색결과 583건 처리시간 0.024초

단방향 및 양방향 순환 신경망의 성능 평가 (Performance Evaluation of Unidirectional and Bidirectional Recurrent Neural Networks)

  • ;정경희 ;추현승
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2023년도 춘계학술발표대회
    • /
    • pp.652-654
    • /
    • 2023
  • The accurate prediction of User Equipment (UE) paths in wireless networks is crucial for improving handover mechanisms and optimizing network performance, particularly in the context of Beyond 5G and 6G networks. This paper presents a comprehensive evaluation of unidirectional and bidirectional recurrent neural network (RNN) architectures for UE path prediction. The study employs a sequence-to-sequence model designed to forecast user paths in a wireless network environment, comparing the performance of unidirectional and bidirectional RNNs. Through extensive experimentation, the paper highlights the strengths and weaknesses of each RNN architecture in terms of prediction accuracy and computational efficiency. These insights contribute to the development of more effective predictive path-based mobility management strategies, capable of addressing the challenges posed by ultra-dense cell deployments and complex network dynamics.

동적 신경회로망을 이용한 비선형 크레인 시스템의 위치제어 (Position Control of Nonlinear Crane Systems using Dynamic Neural Network)

  • 한승훈;조현철;이권순
    • 전기학회논문지
    • /
    • 제56권5호
    • /
    • pp.966-972
    • /
    • 2007
  • This paper presents position control of nonlinear three-dimensional crane systems using neural network approach. Such crane system generally includes very complicated characteristic dynamics and mechanical framework such that its mathematical model is expressed by strong nonlinearity. This leads difficulty in control design for the systems. We linearize the nonlinear system model to construct PID control applying well-known linear control theory and then neural network is utilized to compensate system perturbation due to linearization. Thus, control input of the crane system is composed of nominal PID and neural output signals respectively. Our method illustrates simple design procedure, but system perturbation and modelling error are overcome through a neural compensator. As well. adaptive neural control is constructed from online learning. Computer simulation demonstrates our control approach is superior to the classic control systems.

Complexity Control Method of Chaos Dynamics in Recurrent Neural Networks

  • Sakai, Masao;Homma, Noriyasu;Abe, Kenichi
    • Transactions on Control, Automation and Systems Engineering
    • /
    • 제4권2호
    • /
    • pp.124-129
    • /
    • 2002
  • This paper demonstrates that the largest Lyapunov exponent λ of recurrent neural networks can be controlled efficiently by a stochastic gradient method. An essential core of the proposed method is a novel stochastic approximate formulation of the Lyapunov exponent λ as a function of the network parameters such as connection weights and thresholds of neural activation functions. By a gradient method, a direct calculation to minimize a square error (λ - λ$\^$obj/)$^2$, where λ$\^$obj/ is a desired exponent value, needs gradients collection through time which are given by a recursive calculation from past to present values. The collection is computationally expensive and causes unstable control of the exponent for networks with chaotic dynamics because of chaotic instability. The stochastic formulation derived in this paper gives us an approximation of the gradients collection in a fashion without the recursive calculation. This approximation can realize not only a faster calculation of the gradient, but also stable control for chaotic dynamics. Due to the non-recursive calculation. without respect to the time evolutions, the running times of this approximation grow only about as N$^2$ compared to as N$\^$5/T that is of the direct calculation method. It is also shown by simulation studies that the approximation is a robust formulation for the network size and that proposed method can control the chaos dynamics in recurrent neural networks efficiently.

확장된 RNN을 활용한 사람재인식 시스템에 관한 연구 (A Study on Person Re-Identification System using Enhanced RNN)

  • 최석규;허문걸
    • 한국인터넷방송통신학회논문지
    • /
    • 제17권2호
    • /
    • pp.15-23
    • /
    • 2017
  • 사람의 빈번한 자세 변화, 그리고 background clutter과 occlusion으로 인해 Person Re-identificatio는 컴퓨터 비전 분야에서 가장 어려운 부분이다. 비겹침 카메라의 이미지는 어떤 사람을 다른 사람과 구별하기 어렵게 한다. 더욱 나은 성능 일치를 달성하기 위해 대부분의 방법은 특징 선택과 거리 메트릭을 개별적으로 사용한다. 그렇게 차별화된 표현과 적절한 거리를 얻을 수 있고, 사람과 중요한 특징의 무시 사이의 유사성을 설명할 수 있다. 이러한 상황은 우리가 이 문제를 다루는 새로운 방법을 고려하도록 한다. 본 논문에서는 Person Re-identification를 위한 3단 계층네트워크를 갖는 향상되고 반복적인 신경 회로망을 제안하였다. 특히 RNN(Revurrent Neural Network) 모델은 반복적인 EM(Expectation Maximum) 알고리즘과 3단 계층 네트워크를 포함하고, 차별적 특징과 지표 거리를 공동으로 학습한다. 반복적인 EM 알고리즘은 RNN 이전에 연속해 있는 CNN(Convoutional Neural Network)의 특징 추출 능력을 충분히 사용할 수 있다. 자율 학습을 통해 EM 프레임 워크는 패치의 레이블을 변경하고 더 큰 데이터 세트를 훈련할 수 있다. 네트워크를 더 잘 훈련시키기 위해 3단 계층 네트워크를 통해 CNN, RNN 및 풀링 계층이 공동으로 특징 추출을 할 수 있다. 실험 결과에 따르면 비전처리 분야에서 다른 연구자의 접근 방식과 비교할 때 이 방법은 경쟁력 있는 정확도를 얻을 수 있다. 이 방법에 대한 다른 요소의 영향은 향후 연구에서 분석되고 평가될 것이다.

C-BLRNN을 이용한 위성채널 등화기 (Satellite communication Equalizer Using Complex Bilinear Recurrent Neural Network)

  • 박동철;정태균
    • 한국통신학회논문지
    • /
    • 제25권3A호
    • /
    • pp.375-382
    • /
    • 2000
  • Equalization of satellite communication using Complex-Bilinear Recurrent Neural Network(C-BLRNN) is proposed in this pater. Since the BLRNN is based on the bilinear polynomial and it has been more effectively used in modeling highly nonlinear systems with time-series characteristics than multi-layer perception type neural networks(MLPNN) , it can be applied to satellite equalizer. the proposed C-BLRNN based equalizer for M-PSK with a channel model is compared with Volterra filter Equalizer, DFE, and conventional Complex MLPNN Equlizer. The results show that the proposed C-BLRNN based equalizer gives very favorable results in both of MSE and BER criteria over other equalizers.

  • PDF

Two-dimensional attention-based multi-input LSTM for time series prediction

  • Kim, Eun Been;Park, Jung Hoon;Lee, Yung-Seop;Lim, Changwon
    • Communications for Statistical Applications and Methods
    • /
    • 제28권1호
    • /
    • pp.39-57
    • /
    • 2021
  • Time series prediction is an area of great interest to many people. Algorithms for time series prediction are widely used in many fields such as stock price, temperature, energy and weather forecast; in addtion, classical models as well as recurrent neural networks (RNNs) have been actively developed. After introducing the attention mechanism to neural network models, many new models with improved performance have been developed; in addition, models using attention twice have also recently been proposed, resulting in further performance improvements. In this paper, we consider time series prediction by introducing attention twice to an RNN model. The proposed model is a method that introduces H-attention and T-attention for output value and time step information to select useful information. We conduct experiments on stock price, temperature and energy data and confirm that the proposed model outperforms existing models.

LRCN을 이용한 리튬 이온 배터리의 건강 상태 추정 (State of Health Estimation for Lithium-Ion Batteries Using Long-term Recurrent Convolutional Network)

  • 홍선리;강모세;정학근;백종복;김종훈
    • 전력전자학회논문지
    • /
    • 제26권3호
    • /
    • pp.183-191
    • /
    • 2021
  • A battery management system (BMS) provides some functions for ensuring safety and reliability that includes algorithms estimating battery states. Given the changes caused by various operating conditions, the state-of-health (SOH), which represents a figure of merit of the battery's ability to store and deliver energy, becomes challenging to estimate. Machine learning methods can be applied to perform accurate SOH estimation. In this study, we propose a Long-Term Recurrent Convolutional Network (LRCN) that combines the Convolutional Neural Network (CNN) and Long Short-term Memory (LSTM) to extract aging characteristics and learn temporal mechanisms. The dataset collected by the battery aging experiments of NASA PCoE is used to train models. The input dataset used part of the charging profile. The accuracy of the proposed model is compared with the CNN and LSTM models using the k-fold cross-validation technique. The proposed model achieves a low RMSE of 2.21%, which shows higher accuracy than others in SOH estimation.

균형적인 신체활동을 위한 맞춤형 AI 운동 추천 서비스 (Customized AI Exercise Recommendation Service for the Balanced Physical Activity)

  • 김창민;이우범
    • 융합신호처리학회논문지
    • /
    • 제23권4호
    • /
    • pp.234-240
    • /
    • 2022
  • 본 논문은 직종별 근무 환경에 따른 상대적 운동량을 고려한 맞춤형 AI 운동 추천 서비스 방법을 제안한다. 가속도 및 자이로 센서를 활용하여 수집된 데이터를 18가지 일상생활의 신체활동으로 분류한 WISDM 데이터베이스를 기반으로 전신, 하체, 상체의 3가지 활동으로 분류한 후 인식된 활동 지표를 통해 적절한 운동을 추천한다. 본 논문에서 신체활동 분류를 위해서 사용하는 1차원 합성곱 신경망(1D CNN; 1 Dimensional Convolutional Neural Network) 모델은 커널 크기가 다른 다수의 1D 컨볼루션(Convolution) 계층을 병렬적으로 연결한 컨볼루션 블록을 사용한다. 컨볼루션 블록은 하나의 입력 데이터에 다층 1D 컨볼루션을 적용함으로써 심층 신경망 모델로 추출할 수 있는 입력 패턴의 세부 지역 특징을 보다 얇은 계층으로도 효과적으로 추출 할 수 있다. 제안한 신경망 모델의 성능 평가를 위해서 기존 순환 신경망(RNN; Recurrent Neural Network) 모델과 비교 실험한 결과 98.4%의 현저한 정확도를 보였다.

A new surrogate method for the neutron kinetics calculation of nuclear reactor core transients

  • Xiaoqi Li;Youqi Zheng;Xianan Du;Bowen Xiao
    • Nuclear Engineering and Technology
    • /
    • 제56권9호
    • /
    • pp.3571-3584
    • /
    • 2024
  • Reactor core transient calculation is very important for the reactor safety analysis, in which the kernel is neutron kinetics calculation by simulating the variation of neutron density or thermal power over time. Compared with the point kinetics method, the time-space neutron kinetics calculation can provide accurate variation of neutron density in both space and time domain. But it consumes a lot of resources. It is necessary to develop a surrogate model that can quickly obtain the temporal and spatial variation information of neutron density or power with acceptable calculation accuracy. This paper uses the time-varying characteristics of power to construct a time function, parameterizes the time-varying characteristics which contains the information about the spatial change of power. Thereby, the amount of targets to predict in the space domain is compressed. A surrogate method using the machine learning is proposed in this paper. In the construction of a neural network, the input is processed by a convolutional layer, followed by a fully connected layer or a deconvolution layer. For the problem of time sequence disturbance, a structure combining convolutional neural network and recurrent neural network is used. It is verified in the tests of a series of 1D, 2D and 3D reactor models. The predicted values obtained using the constructed neural network models in these tests are in good agreement with the reference values, showing the powerful potential of the surrogate models.

메모리 요소를 활용한 신경망 연구 동향 (A Survey on Neural Networks Using Memory Component)

  • 이지환;박진욱;김재형;김재인;노홍찬;박상현
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제7권8호
    • /
    • pp.307-324
    • /
    • 2018
  • 최근 순환 신경 망(Recurrent Neural Networks)은 시간에 대한 의존성을 고려한 구조를 통해 순차 데이터(Sequential data)의 예측 문제 해결에서 각광받고 있다. 하지만 순차 데이터의 시간 스텝이 늘어남에 따라 발생하는 그라디언트 소실(Gradients vanishing)이 문제로 대두되었다. 이를 해결하기 위해 장단기 기억 모델(Long Short-Term Memory)이 제안되었지만, 많은 데이터를 저장하고 장기간 보존하는 데에 한계가 있다. 따라서 순환 신경망과 메모리 요소(Memory component)를 활용한 학습 모델인 메모리-증대 신경망(Memory-Augmented Neural Networks)에 대한 연구가 최근 활발히 진행되고 있다. 본 논문에서는 딥 러닝(Deep Learning) 분야의 화두로 떠오른 메모리-증대 신경망 주요 모델들의 구조와 특징을 열거하고, 이를 활용한 최신 기법들과 향후 연구 방향을 제시한다.