• Title/Summary/Keyword: Recurrent Neural Networks

Search Result 278, Processing Time 0.02 seconds

Acoustic Event Detection in Multichannel Audio Using Gated Recurrent Neural Networks with High-Resolution Spectral Features

  • Kim, Hyoung-Gook;Kim, Jin Young
    • ETRI Journal
    • /
    • v.39 no.6
    • /
    • pp.832-840
    • /
    • 2017
  • Recently, deep recurrent neural networks have achieved great success in various machine learning tasks, and have also been applied for sound event detection. The detection of temporally overlapping sound events in realistic environments is much more challenging than in monophonic detection problems. In this paper, we present an approach to improve the accuracy of polyphonic sound event detection in multichannel audio based on gated recurrent neural networks in combination with auditory spectral features. In the proposed method, human hearing perception-based spatial and spectral-domain noise-reduced harmonic features are extracted from multichannel audio and used as high-resolution spectral inputs to train gated recurrent neural networks. This provides a fast and stable convergence rate compared to long short-term memory recurrent neural networks. Our evaluation reveals that the proposed method outperforms the conventional approaches.

The development of semi-active suspension controller based on error self recurrent neural networks (오차 자기순환 신경회로망 기반 반능동 현가시스템 제어기 개발)

  • Lee, Chang-Goo;Song, Kwang-Hyun
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.5 no.8
    • /
    • pp.932-940
    • /
    • 1999
  • In this paper, a new neural networks and neural network based sliding mode controller are proposed. The new neural networks are an mor self-recurrent neural networks which use a recursive least squares method for the fast on-line leammg. The error self-recurrent neural networks converge considerably last than the back-prollagation algorithm and have advantage oi bemg less affected by the poor initial weights and learning rate. The controller for suspension system is designed according to sliding mode technique based on new proposed neural networks. In order to adapt shding mode control mnethod, each frame dstance hetween ground and vehcle body is estimated md controller is designed according to estimated neural model. The neural networks based sliding mode controller approves good peiformance throllgh computer sirnulations.

  • PDF

A study on the Fuzzy Recurrent Neural Networks for the image noise elimination filter (영상 잡음 제거 필터를 위한 퍼지 순환 신경망 연구)

  • Byun, Oh-Sung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.16 no.6
    • /
    • pp.61-70
    • /
    • 2011
  • In this paper, it is realized an image filter for a noise elimination using a recurrent neural networks with fuzzy. The proposed fuzzy neural networks structure is to converge weights and the number of iteration for a certain value by using basically recurrent neural networks structure and is simplified computation and complexity of mathematics by applying the hybrid fuzzy membership function operator. In this paper, the proposed method, the recurrent neural networks applying fuzzy which is collected a certain value, has been proved improving average 0.38dB than the conventional method, the generalied recurrent neural networks, by using PSNR. Also, a result image of the proposed method was similar to the original image than a result image of the conventional method by comparing to visual images.

A study on the fuzzified Diagonal Recurrent Neural Networks for the Image Processing (영상처리를 위한 퍼지화된 대각형 Recurrent 신경망에 관한 연구)

  • 변오성;문성룡
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.478-481
    • /
    • 1999
  • In this paper, we could analyze and compare with the generalized Recurrent neural networks and the Recurrent neural networks applying the fuzzy. The total system is digitalized in order to be filtering the image, and the fuzzy is applied to the generalized Recurrent in order to be fast the operation speed. So the fuzzified Recurrent neural networks are completely removed to the included noise in the image, and could converge on a certain value as controlling the weight and iteration frequency corresponding to the desired target value. Also, that values are compared and analysed using MSE and PSNR. When applying to the image which is included to the noise in the generalized Recurrent and the Recurrent applying the fuzzy, the Recurrent applying the fuzzy is shown the superiority at the noise and the fixed convergence part through MSE and PSNR in the computer simulations.

  • PDF

Isolated Digit Recognition Combined with Recurrent Neural Prediction Models and Chaotic Neural Networks (회귀예측 신경모델과 카오스 신경회로망을 결합한 고립 숫자음 인식)

  • Kim, Seok-Hyun;Ryeo, Ji-Hwan
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.8 no.6
    • /
    • pp.129-135
    • /
    • 1998
  • In this paper, the recognition rate of isolated digits has been improved using the multiple neural networks combined with chaotic recurrent neural networks and MLP. Generally, the recognition rate has been increased from 1.2% to 2.5%. The experiments tell that the recognition rate is increased because MLP and CRNN(chaotic recurrent neural network) compensate for each other. Besides this, the chaotic dynamic properties have helped more in speech recognition. The best recognition rate is when the algorithm combined with MLP and chaotic multiple recurrent neural network has been used. However, in the respect of simple algorithm and reliability, the multiple neural networks combined with MLP and chaotic single recurrent neural networks have better properties. Largely, MLP has very good recognition rate in korean digits "il", "oh", while the chaotic recurrent neural network has best recognition in "young", "sam", "chil".

  • PDF

Optimization of Memristor Devices for Reservoir Computing (축적 컴퓨팅을 위한 멤리스터 소자의 최적화)

  • Kyeongwoo Park;HyeonJin Sim;HoBin Oh;Jonghwan Lee
    • Journal of the Semiconductor & Display Technology
    • /
    • v.23 no.1
    • /
    • pp.1-6
    • /
    • 2024
  • Recently, artificial neural networks have been playing a crucial role and advancing across various fields. Artificial neural networks are typically categorized into feedforward neural networks and recurrent neural networks. However, feedforward neural networks are primarily used for processing static spatial patterns such as image recognition and object detection. They are not suitable for handling temporal signals. Recurrent neural networks, on the other hand, face the challenges of complex training procedures and requiring significant computational power. In this paper, we propose memristors suitable for an advanced form of recurrent neural networks called reservoir computing systems, utilizing a mask processor. Using the characteristic equations of Ti/TiOx/TaOy/Pt, Pt/TiOx/Pt, and Ag/ZnO-NW/Pt memristors, we generated current-voltage curves to verify their memristive behavior through the confirmation of hysteresis. Subsequently, we trained and inferred reservoir computing systems using these memristors with the NIST TI-46 database. Among these systems, the accuracy of the reservoir computing system based on Ti/TiOx/TaOy/Pt memristors reached 99%, confirming the Ti/TiOx/TaOy/Pt memristor structure's suitability for inferring speech recognition tasks.

  • PDF

System Identification Using Hybrid Recurrent Neural Networks (Hybrid 리커런트 신경망을 이용한 시스템 식별)

  • Choi Han-Go;Go Il-Whan;Kim Jong-In
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.6 no.1
    • /
    • pp.45-52
    • /
    • 2005
  • Dynamic neural networks have been applied to diverse fields requiring temporal signal processing. This paper describes system identification using the hybrid neural network, composed of locally(LRNN) and globally recurrent neural networks(GRNN) to improve dynamics of multilayered recurrent networks(RNN). The structure of the hybrid nework combines IIR-MLP as LRNN and Elman RNN as GRNN. The hybrid network is evaluated in linear and nonlinear system identification, and compared with Elman RNN and IIR-MLP networks for the relative comparison of its performance. Simulation results show that the hybrid network performs better with respect to the convergence and accuracy, indicating that it can be a more effective network than conventional multilayered recurrent networks in system identification.

  • PDF

Equalization of Time-Varying Channels using a Recurrent Neural Network Trained with Kalman Filters (칼만필터로 훈련되는 순환신경망을 이용한 시변채널 등화)

  • 최종수;권오신
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.9 no.11
    • /
    • pp.917-924
    • /
    • 2003
  • Recurrent neural networks have been successfully applied to communications channel equalization. Major disadvantages of gradient-based learning algorithms commonly employed to train recurrent neural networks are slow convergence rates and long training sequences required for satisfactory performance. In a high-speed communications system, fast convergence speed and short training symbols are essential. We propose decision feedback equalizers using a recurrent neural network trained with Kalman filtering algorithms. The main features of the proposed recurrent neural equalizers, utilizing extended Kalman filter (EKF) and unscented Kalman filter (UKF), are fast convergence rates and good performance using relatively short training symbols. Experimental results for two time-varying channels are presented to evaluate the performance of the proposed approaches over a conventional recurrent neural equalizer.

Nonlinear Adaptive Prediction using Locally and Globally Recurrent Neural Networks (지역 및 광역 리커런트 신경망을 이용한 비선형 적응예측)

  • 최한고
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.40 no.1
    • /
    • pp.139-147
    • /
    • 2003
  • Dynamic neural networks have been applied to diverse fields requiring temporal signal processing such as signal prediction. This paper proposes the hybrid network, composed of locally(LRNN) and globally recurrent neural networks(GRNN), to improve dynamics of multilayered recurrent networks(RNN) and then describes nonlinear adaptive prediction using the proposed network as an adaptive filter. The hybrid network consists of IIR-MLP and Elman RNN as LRNN and GRNN, respectively. The proposed network is evaluated in nonlinear signal prediction and compared with Elman RNN and IIR-MLP networks for the relative comparison of prediction performance. Experimental results show that the hybrid network performs better with respect to convergence speed and accuracy, indicating that the proposed network can be a more effective prediction model than conventional multilayered recurrent networks in nonlinear prediction for nonstationary signals.

Adaptive PID controller based on error self-recurrent neural networks (오차 자기순환 신경회로망에 기초한 적응 PID제어기)

  • Lee, Chang-Goo;Shin, Dong-Young
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.2
    • /
    • pp.209-214
    • /
    • 1998
  • In this paper, we are dealing with the problem of controlling unknown nonlinear dynamical system by using neural networks. A novel error self-recurrent(ESR) neural model is presented to perform black-box identification. Through the various outcome of the experiment, a new neural network is seen to be considerably faster than the BP algorithm and has advantages of being less affected by poor initial weights and learning rate. These characteristics make it flexible to design the controller in real-time based on neural networks model. In addition, we design an adaptive PID controller that Keyser suggested by using ESR neural networks, and present a method on the implementation of adaptive controller based on neural network for practical applications. We obtained good results in the case of robot manipulator experiment.

  • PDF