• Title/Summary/Keyword: Recurrent neural networks

Search Result 289, Processing Time 0.023 seconds

Real-time Approximation of a Hydraulic Servo System Using a Recurrent Neural Network with 2-D Learning Algorithm (2차원 학습 회귀적 신경망을 이용한 전기.유압 서보시스템의 실시간 추종)

  • 정봉호;곽동훈;이춘태;이진걸
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.20 no.8
    • /
    • pp.94-100
    • /
    • 2003
  • This paper presents the experiments on the approximation of a hydraulic servo system using a real time recurrent neural networks (RTRN) with time varying weights. In order to verify the effectiveness of the RTRN algorithm in hydraulic servo system, we design the experimental hydraulic system and implemented the real time approximation of system output. Experimental results show that approximated output of the RTRN well follows the position trajectory of the electro-hydraulic servo system. And also it is verified that the 2-D RNN can be implemented in sampling time even though high sampling frequency experimentally.

Recurrent Based Modular Neural Network

  • Yon, Jung-Heum;Park, Woo-Kyung;Kim, Yong-Min;Jeon, Hong-Tae
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.694-697
    • /
    • 2003
  • In this paper, we propose modular network to solve difficult and complex problems that are seldom solved with Multi-Layer Neural Network(MLNN). The structure of Modular Neural Network(MNN) in researched by Jacobs and jordan is selected in this paper. Modular network consists of several Expert Networks(EN) and a Gating Network(CN) which is composed of single-layer neural network(SLNN) or multi-layer neural network. We propose modular network structure using Recurrent Neural Network(RNN), since the state of the whole network at a particular time depends on aggregate of previous states as well as on the current input. Finally, we show excellence of the proposed network compared with modular network.

  • PDF

Learning for Environment and Behavior Pattern Using Recurrent Modular Neural Network Based on Estimated Emotion (감정평가에 기반한 환경과 행동패턴 학습을 위한 궤환 모듈라 네트워크)

  • Kim, Seong-Joo;Choi, Woo-Kyung;Kim, Yong-Min;Jeon, Hong-Tae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.1
    • /
    • pp.9-14
    • /
    • 2004
  • Rational sense is affected by emotion. If we add the factor of estimated emotion by environment information into robots, we may get more intelligent and human-friendly robots. However, various sensory information and pattern classification are prescribed for robots to learn emotion so that the networks are suitable for the necessity of robots. Neural network has superior ability to extract character of system but neural network has defect of temporal cross talk and local minimum convergence. To solve the defects, many kinds of modular neural networks have been proposed because they divide a complex problem into simple several subproblems. The modular neural network, introduced by Jacobs and Jordan, shows an excellent ability of recomposition and recombination of complex work. On the other hand, the recurrent network acquires state representations and representations of state make the recurrent neural network suitable for diverse applications such as nonlinear prediction and modeling. In this paper, we applied recurrent network for the expert network in the modular neural network structure to learn data pattern based on emotional assessment. To show the performance of the proposed network, simulation of learning the environment and behavior pattern is proceeded with the real time implementation. The given problem is very complex and has too many cases to learn. The result will show the performance and good ability of the proposed network and will be compared with the result of other method, general modular neural network.

Sound event detection based on multi-channel multi-scale neural networks for home monitoring system used by the hard-of-hearing (청각 장애인용 홈 모니터링 시스템을 위한 다채널 다중 스케일 신경망 기반의 사운드 이벤트 검출)

  • Lee, Gi Yong;Kim, Hyoung-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.39 no.6
    • /
    • pp.600-605
    • /
    • 2020
  • In this paper, we propose a sound event detection method using a multi-channel multi-scale neural networks for sound sensing home monitoring for the hearing impaired. In the proposed system, two channels with high signal quality are selected from several wireless microphone sensors in home. The three features (time difference of arrival, pitch range, and outputs obtained by applying multi-scale convolutional neural network to log mel spectrogram) extracted from the sensor signals are applied to a classifier based on a bidirectional gated recurrent neural network to further improve the performance of sound event detection. The detected sound event result is converted into text along with the sensor position of the selected channel and provided to the hearing impaired. The experimental results show that the sound event detection method of the proposed system is superior to the existing method and can effectively deliver sound information to the hearing impaired.

Nonlinear Backstepping Control of SynRM Drive Systems Using Reformed Recurrent Hermite Polynomial Neural Networks with Adaptive Law and Error Estimated Law

  • Ting, Jung-Chu;Chen, Der-Fa
    • Journal of Power Electronics
    • /
    • v.18 no.5
    • /
    • pp.1380-1397
    • /
    • 2018
  • The synchronous reluctance motor (SynRM) servo-drive system has highly nonlinear uncertainties owing to a convex construction effect. It is difficult for the linear control method to achieve good performance for the SynRM drive system. The nonlinear backstepping control system using upper bound with switching function is proposed to inhibit uncertainty action for controlling the SynRM drive system. However, this method uses a large upper bound with a switching function, which results in a large chattering. In order to reduce this chattering, a nonlinear backstepping control system using an adaptive law is proposed to estimate the lumped uncertainty. Since this method uses an adaptive law, it cannot achiever satisfactory performance. Therefore, a nonlinear backstepping control system using a reformed recurrent Hermite polynomial neural network with an adaptive law and an error estimated law is proposed to estimate the lumped uncertainty and to compensate the estimated error in order to enhance the robustness of the SynRM drive system. Further, the reformed recurrent Hermite polynomial neural network with two learning rates is derived according to an increment type Lyapunov function to speed-up the parameter convergence. Finally, some experimental results and a comparative analysis are presented to verify that the proposed control system has better control performance for controlling SynRM drive systems.

A SE Approach for Machine Learning Prediction of the Response of an NPP Undergoing CEA Ejection Accident

  • Ditsietsi Malale;Aya Diab
    • Journal of the Korean Society of Systems Engineering
    • /
    • v.19 no.2
    • /
    • pp.18-31
    • /
    • 2023
  • Exploring artificial intelligence and machine learning for nuclear safety has witnessed increased interest in recent years. To contribute to this area of research, a machine learning model capable of accurately predicting nuclear power plant response with minimal computational cost is proposed. To develop a robust machine learning model, the Best Estimate Plus Uncertainty (BEPU) approach was used to generate a database to train three models and select the best of the three. The BEPU analysis was performed by coupling Dakota platform with the best estimate thermal hydraulics code RELAP/SCDAPSIM/MOD 3.4. The Code Scaling Applicability and Uncertainty approach was adopted, along with Wilks' theorem to obtain a statistically representative sample that satisfies the USNRC 95/95 rule with 95% probability and 95% confidence level. The generated database was used to train three models based on Recurrent Neural Networks; specifically, Long Short-Term Memory, Gated Recurrent Unit, and a hybrid model with Long Short-Term Memory coupled to Convolutional Neural Network. In this paper, the System Engineering approach was utilized to identify requirements, stakeholders, and functional and physical architecture to develop this project and ensure success in verification and validation activities necessary to ensure the efficient development of ML meta-models capable of predicting of the nuclear power plant response.

Vibration Control a Flexible Single Link Robot Manipulator Using Neural Networks (신경회로망을 이용한 유연성 단일 링크 로봇 매니퓰레이터의 진동제어)

  • 탁한호;이상배
    • Journal of the Korean Institute of Navigation
    • /
    • v.21 no.3
    • /
    • pp.55-66
    • /
    • 1997
  • In this paper, applications of neural networks to vibration control of flexible single link robot manipulator are ocnsidered. The architecture of neural networks is a hidden layer, which is comprised of self-recurrent one. Tow neural networks are utilized in a control system ; one as an identifier is called neuro identifier and the othe ra s a controller is called neuro controller. The neural networks can be used to approximate any continuous function to any desired degree of accuracy and the weights are updated by dynamic error-backpropagation algorithm(DEA). To guarantee concegence and to get faster learning, an approach that uses adaptive learning rates is developed by introducing a Lyapunov function. When a flexible manipulator is ratated by a motor through the fixed end, transverse vibration may occur. The motor torque should be controlle dinsuch as way, that the motor is rotated by a specified angle. while simulataneously stabilizing vibration of the flexible manipulators so that it is arrested as soon as possible at the end of rotation. Accurate vibration control of lightweight manipulator during the large body motions, as well as the flexural vibrations. Therefore, dynamic models for a flexible single link manipulator is derived, and LQR controller and nerual networks controller are composed. The effectiveness of the proposed nerual networks control system is confirmed by experiments.

  • PDF

RECURRENT NEURAL NETWORKS -What Do They Learn and How\ulcorner-

  • Uchikawa, Yoshiki;Takase, Haruhiko;Watanabe, Tatsumi;Gouhara, Kazutoshi
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1993.06a
    • /
    • pp.1005-1008
    • /
    • 1993
  • Supervised learnmg 01 recurrent neural networks (RNNs) is discussed. First, we review the present state of art, featuring their major properties in contrast of those of the multilayer neural networks. Then, we concisely describe one of the most practical learning algorithms, i.e. backpropagation through time. Revising the basic formulation of the learning algorithms, we derive a general formula to solve for the exact solution(s) of the whole connection weights w of RNNs. On this basis we introduce a novel interpretation of the supervised learning. Namely, we define a multidimensional Euclidean space, by assigning the cost function E(w) and every component of w to each coordinate axis. Since E=E(w) turns up as a hyper surface in this space, we refer to the surface as learning surface. We see that topological features of the learning surface are valleys and hills. Finally, after explicating that the numerical procedures of learning are equivalent to descending slopes of the learning surface along the steepest gradient, we show that a minimal value of E(w) is the intersection of curved valleys.

  • PDF

Stock Prediction Model based on Bidirectional LSTM Recurrent Neural Network (양방향 LSTM 순환신경망 기반 주가예측모델)

  • Joo, Il-Taeck;Choi, Seung-Ho
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.11 no.2
    • /
    • pp.204-208
    • /
    • 2018
  • In this paper, we proposed and evaluated the time series deep learning prediction model for learning fluctuation pattern of stock price. Recurrent neural networks, which can store previous information in the hidden layer, are suitable for the stock price prediction model, which is time series data. In order to maintain the long - term dependency by solving the gradient vanish problem in the recurrent neural network, we use LSTM with small memory inside the recurrent neural network. Furthermore, we proposed the stock price prediction model using bidirectional LSTM recurrent neural network in which the hidden layer is added in the reverse direction of the data flow for solving the limitation of the tendency of learning only based on the immediately preceding pattern of the recurrent neural network. In this experiment, we used the Tensorflow to learn the proposed stock price prediction model with stock price and trading volume input. In order to evaluate the performance of the stock price prediction, the mean square root error between the real stock price and the predicted stock price was obtained. As a result, the stock price prediction model using bidirectional LSTM recurrent neural network has improved prediction accuracy compared with unidirectional LSTM recurrent neural network.

Sound Event Detection based on Deep Neural Networks (딥 뉴럴네트워크 기반의 소리 이벤트 검출)

  • Chung, Suk-Hwan;Chung, Yong-Joo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.14 no.2
    • /
    • pp.389-396
    • /
    • 2019
  • In this paper, various architectures of deep neural networks were applied for sound event detection and their performances were compared using a common audio database. The FNN, CNN, RNN and CRNN were implemented using hyper-parameters optimized for the database as well as the architecture of each neural network. Among the implemented deep neural networks, CRNN performed best at all testing conditions and CNN followed CRNN in performance. Although RNN has a merit in tracking the time-correlations in audio signals, it showed poor performance compared with CNN and CRNN.