• Title/Summary/Keyword: long term neural network

Search Result 390, Processing Time 0.024 seconds

LSTM Network with Tracking Association for Multi-Object Tracking

  • Farhodov, Xurshedjon;Moon, Kwang-Seok;Lee, Suk-Hwan;Kwon, Ki-Ryong
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.10
    • /
    • pp.1236-1249
    • /
    • 2020
  • In a most recent object tracking research work, applying Convolutional Neural Network and Recurrent Neural Network-based strategies become relevant for resolving the noticeable challenges in it, like, occlusion, motion, object, and camera viewpoint variations, changing several targets, lighting variations. In this paper, the LSTM Network-based Tracking association method has proposed where the technique capable of real-time multi-object tracking by creating one of the useful LSTM networks that associated with tracking, which supports the long term tracking along with solving challenges. The LSTM network is a different neural network defined in Keras as a sequence of layers, where the Sequential classes would be a container for these layers. This purposing network structure builds with the integration of tracking association on Keras neural-network library. The tracking process has been associated with the LSTM Network feature learning output and obtained outstanding real-time detection and tracking performance. In this work, the main focus was learning trackable objects locations, appearance, and motion details, then predicting the feature location of objects on boxes according to their initial position. The performance of the joint object tracking system has shown that the LSTM network is more powerful and capable of working on a real-time multi-object tracking process.

Long-term Prediction of Speech Signal Using a Neural Network (신경 회로망을 이용한 음성 신호의 장구간 예측)

  • 이기승
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.6
    • /
    • pp.522-530
    • /
    • 2002
  • This paper introduces a neural network (NN) -based nonlinear predictor for the LP (Linear Prediction) residual. To evaluate the effectiveness of the NN-based nonlinear predictor for LP-residual, we first compared the average prediction gain of the linear long-term predictor with that of the NN-based nonlinear long-term predictor. Then, the effects on the quantization noise of the nonlinear prediction residuals were investigated for the NN-based nonlinear predictor A new NN predictor takes into consideration not only prediction error but also quantization effects. To increase robustness against the quantization noise of the nonlinear prediction residual, a constrained back propagation learning algorithm, which satisfies a Kuhn-Tucker inequality condition is proposed. Experimental results indicate that the prediction gain of the proposed NN predictor was not seriously decreased even when the constrained optimization algorithm was employed.

LSTM RNN-based Korean Speech Recognition System Using CTC (CTC를 이용한 LSTM RNN 기반 한국어 음성인식 시스템)

  • Lee, Donghyun;Lim, Minkyu;Park, Hosung;Kim, Ji-Hwan
    • Journal of Digital Contents Society
    • /
    • v.18 no.1
    • /
    • pp.93-99
    • /
    • 2017
  • A hybrid approach using Long Short Term Memory (LSTM) Recurrent Neural Network (RNN) has showed great improvement in speech recognition accuracy. For training acoustic model based on hybrid approach, it requires forced alignment of HMM state sequence from Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM). However, high computation time for training GMM-HMM is required. This paper proposes an end-to-end approach for LSTM RNN-based Korean speech recognition to improve learning speed. A Connectionist Temporal Classification (CTC) algorithm is proposed to implement this approach. The proposed method showed almost equal performance in recognition rate, while the learning speed is 1.27 times faster.

Long-term Settlement Prediction of Railway Concrete Track Based on Recurrent Neural Network (RNN) (순환신경망을 활용한 콘크리트궤도의 장기 침하 거동 예측)

  • Kim, Joonyoung;Lee, Su-Hyung;Choi, Yeong-Tae;Woo, Sang Inn
    • Journal of the Korean Geotechnical Society
    • /
    • v.36 no.3
    • /
    • pp.5-14
    • /
    • 2020
  • The railway concrete track has been increasingly adopted for high-speed train such as KTX due to its high running stability, improved ride quality for the passengers, and low maintenance cost. However, excessive settlement of the railway concrete track has been monitored at embankment sections of the ◯◯ High-speed Line, resulting in the concerns on the safety of railway operation. In order to establish an effective maintenance plan for the concrete track railway exceeding the allowable residual settlement, it is essential to reasonably predict their long-term settlement behavior during the public period. In this study, we developed a model for predicting the long-term settlement behavior of concrete track using recurrent neural network (RNN) and examined the applicability of the developed model.

Traffic Flow Prediction with Spatio-Temporal Information Fusion using Graph Neural Networks

  • Huijuan Ding;Giseop Noh
    • International journal of advanced smart convergence
    • /
    • v.12 no.4
    • /
    • pp.88-97
    • /
    • 2023
  • Traffic flow prediction is of great significance in urban planning and traffic management. As the complexity of urban traffic increases, existing prediction methods still face challenges, especially for the fusion of spatiotemporal information and the capture of long-term dependencies. This study aims to use the fusion model of graph neural network to solve the spatio-temporal information fusion problem in traffic flow prediction. We propose a new deep learning model Spatio-Temporal Information Fusion using Graph Neural Networks (STFGNN). We use GCN module, TCN module and LSTM module alternately to carry out spatiotemporal information fusion. GCN and multi-core TCN capture the temporal and spatial dependencies of traffic flow respectively, and LSTM connects multiple fusion modules to carry out spatiotemporal information fusion. In the experimental evaluation of real traffic flow data, STFGNN showed better performance than other models.

Using machine learning to forecast and assess the uncertainty in the response of a typical PWR undergoing a steam generator tube rupture accident

  • Tran Canh Hai Nguyen ;Aya Diab
    • Nuclear Engineering and Technology
    • /
    • v.55 no.9
    • /
    • pp.3423-3440
    • /
    • 2023
  • In this work, a multivariate time-series machine learning meta-model is developed to predict the transient response of a typical nuclear power plant (NPP) undergoing a steam generator tube rupture (SGTR). The model employs Recurrent Neural Networks (RNNs), including the Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and a hybrid CNN-LSTM model. To address the uncertainty inherent in such predictions, a Bayesian Neural Network (BNN) was implemented. The models were trained using a database generated by the Best Estimate Plus Uncertainty (BEPU) methodology; coupling the thermal hydraulics code, RELAP5/SCDAP/MOD3.4 to the statistical tool, DAKOTA, to predict the variation in system response under various operational and phenomenological uncertainties. The RNN models successfully captures the underlying characteristics of the data with reasonable accuracy, and the BNN-LSTM approach offers an additional layer of insight into the level of uncertainty associated with the predictions. The results demonstrate that LSTM outperforms GRU, while the hybrid CNN-LSTM model is computationally the most efficient. This study aims to gain a better understanding of the capabilities and limitations of machine learning models in the context of nuclear safety. By expanding the application of ML models to more severe accident scenarios, where operators are under extreme stress and prone to errors, ML models can provide valuable support and act as expert systems to assist in decision-making while minimizing the chances of human error.

Electroencephalography-based imagined speech recognition using deep long short-term memory network

  • Agarwal, Prabhakar;Kumar, Sandeep
    • ETRI Journal
    • /
    • v.44 no.4
    • /
    • pp.672-685
    • /
    • 2022
  • This article proposes a subject-independent application of brain-computer interfacing (BCI). A 32-channel Electroencephalography (EEG) device is used to measure imagined speech (SI) of four words (sos, stop, medicine, washroom) and one phrase (come-here) across 13 subjects. A deep long short-term memory (LSTM) network has been adopted to recognize the above signals in seven EEG frequency bands individually in nine major regions of the brain. The results show a maximum accuracy of 73.56% and a network prediction time (NPT) of 0.14 s which are superior to other state-of-the-art techniques in the literature. Our analysis reveals that the alpha band can recognize SI better than other EEG frequencies. To reinforce our findings, the above work has been compared by models based on the gated recurrent unit (GRU), convolutional neural network (CNN), and six conventional classifiers. The results show that the LSTM model has 46.86% more average accuracy in the alpha band and 74.54% less average NPT than CNN. The maximum accuracy of GRU was 8.34% less than the LSTM network. Deep networks performed better than traditional classifiers.

Tunnel-lining Back Analysis Based on Artificial Neural Network for Characterizing Seepage and Rock Mass Load (투수 및 이완하중 파악을 위한 터널 라이닝의 인공신경망 역해석)

  • Kong, Jung-Sik;Choi, Joon-Woo;Park, Hyun-Il;Nam, Seok-Woo;Lee, In-Mo
    • Journal of the Korean Geotechnical Society
    • /
    • v.22 no.8
    • /
    • pp.107-118
    • /
    • 2006
  • Among a variety of influencing components, time-variant seepage and long-term underground motion are important to understand the abnormal behavior of tunnels. Excessiveness of these two components could be the direct cause of severe damage on tunnels, however, it is not easy to quantify the effect of these on the behavior of tunnels. These parameters can be estimated by using inverse methods once the appropriate relationship between inputs and results is clarified. Various inverse methods or parameter estimation techniques such as artificial neural network and least square method can be used depending on the characteristics of given problems. Numerical analyses, experiments, or monitoring results are frequently used to prepare a set of inputs and results to establish the back analysis models. In this study, a back analysis method has been developed to estimate geotechnically hard-to-known parameters such as permeability of tunnel filter, underground water table, long-term rock mass load, size of damaged zone associated with seepage and long-term underground motion. The artificial neural network technique is adopted and the numerical models developed in the first part are used to prepare a set of data for learning process. Tunnel behavior, especially the displacements of the lining, has been exclusively investigated for the back analysis.

Temperature distribution prediction in longitudinal ballastless slab track with various neural network methods

  • Hanlin Liu;Wenhao Yuan;Rui Zhou;Yanliang Du;Jingmang Xu;Rong Chen
    • Smart Structures and Systems
    • /
    • v.32 no.2
    • /
    • pp.83-99
    • /
    • 2023
  • The temperature prediction approaches of three important locations in an operational longitudinal slab track-bridge structure by using three typical neural network methods based on the field measuring platform of four meteorological factors and internal temperature. The measurement experiment of four meteorological factors (e.g., ambient temperature, solar radiation, wind speed, and humidity) temperature in the three locations of the longitudinal slab and base plate of three important locations (e.g., mid-span, beam end, and Wide-Narrow Joint) were conducted, and then their characteristics were analyzed, respectively. Furthermore, temperature prediction effects of three locations under five various meteorological conditions are tested by using three neural network methods, respectively, including the Artificial Neural Network (ANN), the Long Short-Term Memory (LSTM), and the Convolutional Neural Network (CNN). More importantly, the predicted effects of solar radiation in four meteorological factors could be identified with three indicators (e.g., Root Means Square Error, Mean Absolute Error, Correlation Coefficient of R2). In addition, the LSTM method shows the best performance, while the CNN method has the best prediction effect by only considering a single meteorological factor.

Stock Prediction Model based on Bidirectional LSTM Recurrent Neural Network (양방향 LSTM 순환신경망 기반 주가예측모델)

  • Joo, Il-Taeck;Choi, Seung-Ho
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.11 no.2
    • /
    • pp.204-208
    • /
    • 2018
  • In this paper, we proposed and evaluated the time series deep learning prediction model for learning fluctuation pattern of stock price. Recurrent neural networks, which can store previous information in the hidden layer, are suitable for the stock price prediction model, which is time series data. In order to maintain the long - term dependency by solving the gradient vanish problem in the recurrent neural network, we use LSTM with small memory inside the recurrent neural network. Furthermore, we proposed the stock price prediction model using bidirectional LSTM recurrent neural network in which the hidden layer is added in the reverse direction of the data flow for solving the limitation of the tendency of learning only based on the immediately preceding pattern of the recurrent neural network. In this experiment, we used the Tensorflow to learn the proposed stock price prediction model with stock price and trading volume input. In order to evaluate the performance of the stock price prediction, the mean square root error between the real stock price and the predicted stock price was obtained. As a result, the stock price prediction model using bidirectional LSTM recurrent neural network has improved prediction accuracy compared with unidirectional LSTM recurrent neural network.