• Title/Summary/Keyword: Recurrent neural networks

Search Result 285, Processing Time 0.025 seconds

Exploring the Prediction of Timely Stocking in Purchasing Process Using Process Mining and Deep Learning (프로세스 마이닝과 딥러닝을 활용한 구매 프로세스의 적기 입고 예측에 관한 연구)

  • Youngsik Kang;Hyunwoo Lee;Byoungsoo Kim
    • Information Systems Review
    • /
    • v.20 no.4
    • /
    • pp.25-41
    • /
    • 2018
  • Applying predictive analytics to enterprise processes is an effective way to reduce operation costs and enhance productivity. Accordingly, the ability to predict business processes and performance indicators are regarded as a core capability. Recently, several works have predicted processes using deep learning in the form of recurrent neural networks (RNN). In particular, the approach of predicting the next step of activity using static or dynamic RNN has excellent results. However, few studies have given attention to applying deep learning in the form of dynamic RNN to predictions of process performance indicators. To fill this knowledge gap, the study developed an approach to using process mining and dynamic RNN. By utilizing actual data from a large domestic company, it has applied the suggested approach in estimating timely stocking in purchasing process, which is an important indicator of the process. The analytic methods and results of this study were presented and some implications and limitations are also discussed.

The Prediction of Cryptocurrency on Using Text Mining and Deep Learning Techniques : Comparison of Korean and USA Market (텍스트 마이닝과 딥러닝을 활용한 암호화폐 가격 예측 : 한국과 미국시장 비교)

  • Won, Jonggwan;Hong, Taeho
    • Knowledge Management Research
    • /
    • v.22 no.2
    • /
    • pp.1-17
    • /
    • 2021
  • In this study, we predicted the bitcoin prices of Bithum and Coinbase, a leading exchange in Korea and USA, using ARIMA and Recurrent Neural Networks(RNNs). And we used news articles from each country to suggest a separated RNN model. The suggested model identifies the datasets based on the changing trend of prices in the training data, and then applies time series prediction technique(RNNs) to create multiple models. Then we used daily news data to create a term-based dictionary for each trend change point. We explored trend change points in the test data using the daily news keyword data of testset and term-based dictionary, and apply a matching model to produce prediction results. With this approach we obtained higher accuracy than the model which predicted price by applying just time series prediction technique. This study presents that the limitations of the time series prediction techniques could be overcome by exploring trend change points using news data and various time series prediction techniques with text mining techniques could be applied to improve the performance of the model in the further research.

Robust Flight Control System Using Neural Networks: Dynamic Surface Design Approach (신경 회로망을 이용한 강인 비행 제어 시스템: 동적 표면 설계 접근)

  • Yoon, Sung-Jin;Choi, Yoon-Ho;Park, Jin-Bae
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.1848-1849
    • /
    • 2006
  • The new robust controller design method is proposed for the flight control systems with model uncertainties. The proposed control system is a combination of the adaptive dynamic surface control (DSC) technique and the self recurrent wavelet neural network (SRWNN). The adaptive DSC technique provides us with the ability to overcome the "explosion of complexity" problem of the backstepping controller. The SRWNNs are used to observe the arbitrary model uncertainties of flight systems and all their weights are trained on-line. From the Lyapunov stability analysis, their adaptation laws are induced and the uniformly ultimately boundedness of all signals in a closed-loop adaptive system is proved. Finally, simulation results for a high performance aircraft (F-16) are utilized to validate the good tracking performance and robustness of the proposed control system.

  • PDF

Robust Flight Control System Using Neural Networks: Dynamic Surface Design Approach (신경 회로망을 이용한 강인 비행 제어 시스템: 동적 표면 설계 접근)

  • Yoo, Sung-Jin;Choi, Yoon-Ho;Park, Jin-Bae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.55 no.12
    • /
    • pp.518-525
    • /
    • 2006
  • This paper presents the adaptive robust control method for the flight control systems with model uncertainties. The proposed control system can be composed simply by a combination of the adaptive dynamic surface control (DSC) technique and the self recurrent wavelet neural network (SRWNN). The adaptive DSC technique provides us with the ability to overcome the 'explosion of complexity' problem of the backstepping controller. The SRWNNs are used to observe the arbitrary model uncertainties of flight systems, and all their weights are trained on-line. From the Lyapunov stability analysis, their adaptation laws are induced and the uniformly ultimately boundedness of all signals in a closed-loop adaptive system is proved. Finally, simulation results for a high performance aircraft (F-16) are utilized to validate the good tracking performance and robustness of the proposed control system.

Artificial neural network algorithm comparison for exchange rate prediction

  • Shin, Noo Ri;Yun, Dai Yeol;Hwang, Chi-gon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.12 no.3
    • /
    • pp.125-130
    • /
    • 2020
  • At the end of 1997, the volatility of the exchange rate intensified as the nation's exchange rate system was converted into a free-floating exchange rate system. As a result, managing the exchange rate is becoming a very important task, and the need for forecasting the exchange rate is growing. The exchange rate prediction model using the existing exchange rate prediction method, statistical technique, cannot find a nonlinear pattern of the time series variable, and it is difficult to analyze the time series with the variability cluster phenomenon. And as the number of variables to be analyzed increases, the number of parameters to be estimated increases, and it is not easy to interpret the meaning of the estimated coefficients. Accordingly, the exchange rate prediction model using artificial neural network, rather than statistical technique, is presented. Using DNN, which is the basis of deep learning among artificial neural networks, and LSTM, a recurrent neural network model, the number of hidden layers, neurons, and activation function changes of each model found the optimal exchange rate prediction model. The study found that although there were model differences, LSTM models performed better than DNN models and performed best when the activation function was Tanh.

CNN-LSTM based Autonomous Driving Technology (CNN-LSTM 기반의 자율주행 기술)

  • Ga-Eun Park;Chi Un Hwang;Lim Se Ryung;Han Seung Jang
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.6
    • /
    • pp.1259-1268
    • /
    • 2023
  • This study proposes a throttle and steering control technology using visual sensors based on deep learning's convolutional and recurrent neural networks. It collects camera image and control value data while driving a training track in clockwise and counterclockwise directions, and generates a model to predict throttle and steering through data sampling and preprocessing for efficient learning. Afterward, the model was validated on a test track in a different environment that was not used for training to find the optimal model and compare it with a CNN (Convolutional Neural Network). As a result, we found that the proposed deep learning model has excellent performance.

Audio Event Detection Based on Attention CRNN (Attention CRNN에 기반한 오디오 이벤트 검출)

  • Kwak, Jin-Yeol;Chung, Yong-Joo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.15 no.3
    • /
    • pp.465-472
    • /
    • 2020
  • Recently, various deep neural networks based methods have been proposed for audio event detection. In this study, we improved the performance of audio event detection by adopting an attention approach to a baseline CRNN. We applied context gating at the input of the baseline CRNN and added an attention layer at the output. We improved the performance of the attention based CRNN by using the audio data of strong labels in frame units as well as the data of weak labels in clip levels. In the audio event detection experiments using the audio data from the Task 4 of the DCASE 2018/2019 Challenge, we could obtain maximally a 66% relative increase in the F-score in the proposed attention based CRNN compared with the baseline CRNN.

Performance Comparison of Machine Learning Based on Neural Networks and Statistical Methods for Prediction of Drifter Movement (뜰개 이동 예측을 위한 신경망 및 통계 기반 기계학습 기법의 성능 비교)

  • Lee, Chan-Jae;Kim, Gyoung-Do;Kim, Yong-Hyuk
    • Journal of the Korea Convergence Society
    • /
    • v.8 no.10
    • /
    • pp.45-52
    • /
    • 2017
  • Drifter is an equipment for observing the characteristics of seawater in the ocean, and it can be used to predict effluent oil diffusion and to observe ocean currents. In this paper, we design models or the prediction of drifter trajectory using machine learning. We propose methods for estimating the trajectory of drifter using support vector regression, radial basis function network, Gaussian process, multilayer perceptron, and recurrent neural network. When the propose mothods were compared with the existing MOHID numerical model, performance was improve on three of the four cases. In particular, LSTM, the best performed method, showed the imporvement by 47.59% Future work will improve the accuracy by weighting using bagging and boosting.

Computing machinery techniques for performance prediction of TBM using rock geomechanical data in sedimentary and volcanic formations

  • Hanan Samadi;Arsalan Mahmoodzadeh;Shtwai Alsubai;Abdullah Alqahtani;Abed Alanazi;Ahmed Babeker Elhag
    • Geomechanics and Engineering
    • /
    • v.37 no.3
    • /
    • pp.223-241
    • /
    • 2024
  • Evaluating the performance of Tunnel Boring Machines (TBMs) stands as a pivotal juncture in the domain of hard rock mechanized tunneling, essential for achieving both a dependable construction timeline and utilization rate. In this investigation, three advanced artificial neural networks namely, gated recurrent unit (GRU), back propagation neural network (BPNN), and simple recurrent neural network (SRNN) were crafted to prognosticate TBM-rate of penetration (ROP). Drawing from a dataset comprising 1125 data points amassed during the construction of the Alborze Service Tunnel, the study commenced. Initially, five geomechanical parameters were scrutinized for their impact on TBM-ROP efficiency. Subsequent statistical analyses narrowed down the effective parameters to three, including uniaxial compressive strength (UCS), peak slope index (PSI), and Brazilian tensile strength (BTS). Among the methodologies employed, GRU emerged as the most robust model, demonstrating exceptional predictive prowess for TBM-ROP with staggering accuracy metrics on the testing subset (R2 = 0.87, NRMSE = 6.76E-04, MAD = 2.85E-05). The proposed models present viable solutions for analogous ground and TBM tunneling scenarios, particularly beneficial in routes predominantly composed of volcanic and sedimentary rock formations. Leveraging forecasted parameters holds the promise of enhancing both machine efficiency and construction safety within TBM tunneling endeavors.

Design of a neural network based adaptive noise canceler for broadband noise rejection (광대역 잡음제거를 위한 신경망 적응잡음제거기 설계)

  • 곽우혁;최한고
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.3 no.2
    • /
    • pp.30-36
    • /
    • 2002
  • This paper describes a nonlinear adaptive noise canceler(ANC) using neural networks(NN) based on filter to make up for the drawback of the conventional ANC with the linear adaptive filter. The proposed ANC was tested its noise rejection performance using broadband time-varying noise signal and compared with the ANC of TDL linear filter. Experimental results show that in cases of nonlinear correlations between the noise of primary input and reference input, the neural network based ANC outperforms the linear ANC with respect to mean square error It is also verified that the recurrent NN adaptive filter is superior to the feedforward NN filter. Thus, we identify that the NN adaptive filter is more effective than the linear adaptive filter for rejection of broadband time-varying noise in the ANC.

  • PDF