• Title/Summary/Keyword: back propagation algorithm

Search Result 896, Processing Time 0.032 seconds

Reduction of Environmental Background Noise using Speech and Noise Recognition (음성 및 잡음 인식 알고리즘을 이용한 환경 배경잡음의 제거)

  • Choi, Jae-Seung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.15 no.4
    • /
    • pp.817-822
    • /
    • 2011
  • This paper first proposes the speech recognition algorithm by detection of the speech and noise sections at each frame using a neural network training by back-propagation algorithm, then proposes the spectral subtraction method which removes the noises at each frame according to detection of the speech and noise sections. In this experiment, the performance of the proposed recognition system was evaluated based on the recognition rate using various speeches that are degraded by white noise and car noise. Moreover, experimental results of the noise reduction by the spectral subtraction method demonstrate using the speech and noise sections detecting by the speech recognition algorithm at each frame. Based on measuring signal-to-noise ratio, experiments confirm that the proposed algorithm is effective for the speech by corrupted the noise using signal-to-noise ratio.

Implementation of Self-Adaptative System using Algorithm of Neural Network Learning Gain (신경회로망 학습이득 알고리즘을 이용한 자율적응 시스템 구현)

  • Lee, Sung-Su
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.1868-1870
    • /
    • 2006
  • Neural network is used in many fields of control systems, but input-output patterns of a control system are not easy to be obtained and by using as single feedback neural network controller. And also it is difficult to get a satisfied performance when the changes of rapid load and disturbance are applied. To resolve those problems, this paper proposes a new algorithm which is the neural network controller. The new algorithm uses the neural network instead of activation function to control object at the output node. Therefore, control object is composed of neural network controller unifying activation function, and it supplies the error back propagation path to calculate the error at the output node. As a result, the input-output pattern problem of the controller which is resigned by the simple structure of neural network is solved, and real-time learning can be possible in general back propagation algorithm. Application of the new algorithm of neural network controller gives excellent performance for initial and tracking response and it shows the robust performance for rapid load change and disturbance. The proposed control algorithm is implemented on a high speed DSP, TMS320C32, for the speed of 3-phase induction motor. Enhanced performance is shown in the test of the speed control.

  • PDF

Face Region Detection using a Color Union Model and The Levenberg-Marquadt Algorithm (색상 조합 모델과 LM(Levenberg-Marquadt)알고리즘을 이용한 얼굴 영역 검출)

  • Kim, Jin-Ok
    • The KIPS Transactions:PartB
    • /
    • v.14B no.4
    • /
    • pp.255-262
    • /
    • 2007
  • This paper proposes an enhanced skin color-based detection method to find a region of human face in color images. The proposed detection method combines three color spaces, RGB, $YC_bC_r$, YIQ and builds color union histograms of luminance and chrominance components respectively. Combined color union histograms are then fed in to the back-propagation neural network for training and Levenberg-Marquadt algorithm is applied to the iteration process of training. Proposed method with Levenberg-Marquadt algorithm applied to training process of neural network contributes to solve a local minimum problem of back-propagation neural network, one of common methods of training for face detection, and lead to make lower a detection error rate. Further, proposed color-based detection method using combined color union histograms which give emphasis to chrominance components divided from luminance components inputs more confident values at the neural network and shows higher detection accuracy in comparison to the histogram of single color space. The experiments show that these approaches perform a good capability for face region detection, and these are robust to illumination conditions.

Modified elman neural network structure for nonlinear system identification (비선형 시스템 식별을 위한 수정된 elman 신경회로망 구조)

  • 정경권;권성훈;이인재;이정훈;엄기환
    • Proceedings of the IEEK Conference
    • /
    • 1998.06a
    • /
    • pp.917-920
    • /
    • 1998
  • In this paper, we propose a modified elman neural network structure for nonlinear system identification. The proposed structure is that all of network output feed back into hidden units and output units. Learning algorithm is standard back-propagation algorithm. The simulation showed the effectiveness of using the modified elman neural network structure in the nonlinear system identification.

  • PDF

The Design of Optimal Fuzzy-Neural networks Structure by Means of GA and an Aggregate Weighted Performance Index (유전자 알고리즘과 합성 성능지수에 의한 최적 퍼지-뉴럴 네트워크 구조의 설계)

  • Oh, Sung-Kwun;Yoon, Ki-Chan;Kim, Hyun-Ki
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.6 no.3
    • /
    • pp.273-283
    • /
    • 2000
  • In this paper we suggest an optimal design method of Fuzzy-Neural Networks(FNN) model for complex and nonlinear systems. The FNNs use the simplified inference as fuzzy inference method and Error Back Propagation Algorithm as learning rule. And we use a HCM(Hard C-Means) Clustering Algorithm to find initial parameters of the membership function. The parameters such as parameters of membership functions learning rates and momentum weighted value is proposed to achieve a sound balance between approximation and generalization abilities of the model. According to selection and adjustment of a weighting factor of an aggregate objective function which depends on the number of data and a certain degree of nonlinearity (distribution of I/O data we show that it is available and effective to design and optimal FNN model structure with a mutual balance and dependency between approximation and generalization abilities. This methodology sheds light on the role and impact of different parameters of the model on its performance (especially the mapping and predicting capabilities of the rule based computing). To evaluate the performance of the proposed model we use the time series data for gas furnace the data of sewage treatment process and traffic route choice process.

  • PDF

Searching a global optimum by stochastic perturbation in error back-propagation algorithm (오류 역전파 학습에서 확률적 가중치 교란에 의한 전역적 최적해의 탐색)

  • 김삼근;민창우;김명원
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.79-89
    • /
    • 1998
  • The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

  • PDF

Forecasting Water Levels Of Bocheong River Using Neural Network Model

  • Kim, Ji-tae;Koh, Won-joon;Cho, Won-cheol
    • Water Engineering Research
    • /
    • v.1 no.2
    • /
    • pp.129-136
    • /
    • 2000
  • Predicting water levels is a difficult task because a lot of uncertainties are included. Therefore the neural network which is appropriate to such a problem, is introduced. One day ahead forecasting of river stage in the Bocheong River is carried out by using the neural network model. Historical water levels at Snagye gauging point which is located at the downstream of the Bocheong River and average rainfall of the Bocheong River basin are selected as training data sets. With these data sets, the training process has been done by using back propagation algorithm. Then waters levels in 1997 and 1998 are predicted with the trained algorithm. To improve the accuracy, a filtering method is introduced as predicting scheme. It is shown that predicted results are in a good agreement with observed water levels and that a filtering method can overcome the lack of training patterns.

  • PDF

Design of automatic cruise control system of mobile robot using fuzzy-neural control technique (퍼지-뉴럴 제어기법에 의한 이동형 로봇의 자율주행 제어시스템 설계)

  • 한성현;김종수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.1804-1807
    • /
    • 1997
  • This paper presents a new approach to the design of cruise control system of a mobile robot with two drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy-neural network, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learnign architecture. It is proposed a learning controller consisting of two neural networks-fuzzy based on independent reasoning and a connecton net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by two independent wheels.

  • PDF

Self-Relaxation for Multilayer Perceptron

  • Liou, Cheng-Yuan;Chen, Hwann-Txong
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.06a
    • /
    • pp.113-117
    • /
    • 1998
  • We propose a way to show the inherent learning complexity for the multilayer perceptron. We display the solution space and the error surfaces on the input space of a single neuron with two inputs. The evolution of its weights will follow one of the two error surfaces. We observe that when we use the back-propagation(BP) learning algorithm (1), the wight cam not jump to the lower error surface due to the implicit continuity constraint on the changes of weight. The self-relaxation approach is to explicity find out the best combination of all neurons' two error surfaces. The time complexity of training a multilayer perceptron by self-relaxationis exponential to the number of neurons.

  • PDF

Development of Fuzzy-Neural Control Algorithm for the Motion Control of K1-Track Vehicle (K1-궤도차량의 운동제어를 위한 퍼지-뉴럴제어 알고리즘 개발)

  • 한성현
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1997.10a
    • /
    • pp.70-75
    • /
    • 1997
  • This paper proposes a new approach to the design of fuzzy-neuro control for track vehicle system using fuzzy logic based on neural network. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based of independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is illustrated by simulation for trajectory tracking of track vehicle speed.

  • PDF