• Title/Summary/Keyword: Robust backpropagation

Search Result 22, Processing Time 0.02 seconds

Robust Feature Selection and Shot Change Detection Method Using the Neural Networks (강인한 특징 변수 선별과 신경망을 이용한 장면 전환점 검출 기법)

  • Hong, Seung-Bum;Hong, Gyo-Young
    • Journal of Korea Multimedia Society
    • /
    • v.7 no.7
    • /
    • pp.877-885
    • /
    • 2004
  • In this paper, we propose an enhancement shot change detection method using the neural net and the robust feature selection out of multiple features. The previous shot change detection methods usually used single feature and fixed threshold between consecutive frames. However, contents such as color, shape, background, and texture change simultaneously at shot change points in a video sequence. Therefore, in this paper, we detect the shot changes effectively using robust features, which are supplementary each other, rather than using single feature. In this paper, we use the typical CART (classification and regression tree) of data mining method to select the robust features, and the backpropagation neural net to determine the threshold of the each selected features. And to evaluation the performance of the robust feature selection, we compare the proposed method to the PCA(principal component analysis) method of the typical feature selection. According to the experimental result. it was revealed that the performance of our method had better that than the PCA method.

  • PDF

Pattern Recognition using Robust Feedforward Neural Networks (로버스트 다층전방향 신경망을 이용한 패턴인식)

  • Hwang, Chang-Ha;Kim, Sang-Min
    • Journal of the Korean Data and Information Science Society
    • /
    • v.9 no.2
    • /
    • pp.345-355
    • /
    • 1998
  • The back propagation(BP) algorithm allows multilayer feedforward neural networks to learn input-output mappings from training samples. It iteratively adjusts the network parameters(weights) to minimize the sum of squared approximation errors using a gradient descent technique. However, the mapping acquired through the BP algorithm may be corrupt when errorneous training data are employed. In this paper two types of robust backpropagation algorithms are discussed both from a theoretical point of view and in the case studies of nonlinear regression function estimation and handwritten Korean character recognition. For future research we suggest Bayesian learning approach to neural networks and compare it with two robust backpropagation algorithms.

  • PDF

A Robust Backpropagation Algorithm and It's Application (문자인식을 위한 로버스트 역전파 알고리즘)

  • Oh, Kwang-Sik;Kim, Sang-Min;Lee, Dong-No
    • Journal of the Korean Data and Information Science Society
    • /
    • v.8 no.2
    • /
    • pp.163-171
    • /
    • 1997
  • Function approximation from a set of input-output pairs has numerous applications in scientific and engineering areas. Multilayer feedforward neural networks have been proposed as a good approximator of nonlinear function. The back propagation(BP) algorithm allows multilayer feedforward neural networks to learn input-output mappings from training samples. It iteratively adjusts the network parameters(weights) to minimize the sum of squared approximation errors using a gradient descent technique. However, the mapping acquired through the BP algorithm may be corrupt when errorneous training data we employed. When errorneous traning data are employed, the learned mapping can oscillate badly between data points. In this paper we propose a robust BP learning algorithm that is resistant to the errorneous data and is capable of rejecting gross errors during the approximation process, that is stable under small noise perturbation and robust against gross errors.

  • PDF

A study on the Adaptive Controller with Chaotic Dynamic Neural Networks

  • Kim, Sang-Hee;Ahn, Hee-Wook;Wang, Hua O.
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.7 no.4
    • /
    • pp.236-241
    • /
    • 2007
  • This paper presents an adaptive controller using chaotic dynamic neural networks(CDNN) for nonlinear dynamic system. A new dynamic backpropagation learning method of the proposed chaotic dynamic neural networks is developed for efficient learning, and this learning method includes the convergence for improving the stability of chaotic neural networks. The proposed CDNN is applied to the system identification of chaotic system and the adaptive controller. The simulation results show good performances in the identification of Lorenz equation and the adaptive control of nonlinear system, since the CDNN has the fast learning characteristics and the robust adaptability to nonlinear dynamic system.

A Fast and Robust Approach for Modeling of Nanoscale Compound Semiconductors for High Speed Digital Applications

  • Ahlawat, Anil;Pandey, Manoj;Pandey, Sujata
    • JSTS:Journal of Semiconductor Technology and Science
    • /
    • v.6 no.3
    • /
    • pp.182-188
    • /
    • 2006
  • An artificial neural network model for the microwave characteristics of an InGaAs/InP hemt for 70 nm gate length has been developed. The small-signal microwave parameters have been evaluated to determine the transconductance and drain-conductance. We have further investigated the frequency characteristics of the device. The neural network training have been done using the three layer architecture using Levenberg-Marqaurdt Backpropagation algorithm. The results have been compared with the experimental data, which shows a close agreement and the validity of our proposed model.

A study on the Adaptive Neural Controller with Chaotic Neural Networks (카오틱 신경망을 이용한 적응제어에 관한 연구)

  • Sang Hee Kim;Won Woo Park;Hee Wook Ahn
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.4 no.3
    • /
    • pp.41-48
    • /
    • 2003
  • This paper presents an indirect adaptive neuro controller using modified chaotic neural networks(MCNN) for nonlinear dynamic system. A modified chaotic neural networks model is presented for simplifying the traditional chaotic neural networks and enforcing dynamic characteristics. A new Dynamic Backpropagation learning method is also developed. The proposed MCNN paradigm is applied to the system identification of a MIMO system and the indirect adaptive neuro controller. The simulation results show good performances, since the MCNN has robust adaptability to nonlinear dynamic system.

  • PDF

Robust seismic waveform inversion using backpropagation algorithm (Hybrid L1/L2 를 이용한 주파수 영역 탄성파 파형역산)

  • Chung, Woo-Keen;Ha, Tae-Young;Shin, Chang-Soo
    • 한국지구물리탐사학회:학술대회논문집
    • /
    • 2007.06a
    • /
    • pp.124-129
    • /
    • 2007
  • For seismic imaging and inversion, the inverted image depends on how we define the objective function. ${\ell}^1$-norm is more robust than ${\ell}^2$-norm. However, it is difficult to apply the Newton-type algorithm directly because the partial derivative for ${\ell^1$-norm has a singularity. In our paper, to overcome the difficulties of singularities, Huber function given by hybrid ${\ell}^1/{\ell}^2$-norm is used. We tested the robustness of our new object function with several noisy data set. Numerical results show that the new objective function is more robust to band limited spiky noise than the conventional object function.

  • PDF

The Study of I.M. speed control using MRAC (MRAC방식의 유도전동기 속도제어에 관한 연구)

  • 전희종;김병진;정을기;박경옥;손희남
    • Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
    • /
    • 1995.10a
    • /
    • pp.96-100
    • /
    • 1995
  • In this paper an induction motor control using fuzzy controller and neural network adptive observer is studied. The proposed observer which comprises neural network flux observer which comprises neural network flux observer and neural network torque observer is trained to learn the flux dynamics and torque dynamics and subjected to further on-line training by means of a backpropagation algorithem. Therefore it has been shown that the robust control of induction motor neglects the rotor time constant variations

  • PDF

Adaptive PI Controller Design Based on CTRNN for Permanent Magnet Synchronous Motors (영구자석 동기모터를 위한 CTRNN모델 기반 적응형 PI 제어기 설계)

  • Kim, Il-Hwan
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.65 no.4
    • /
    • pp.635-641
    • /
    • 2016
  • In many industrial applications that use the electric motors robust controllers are needed. The method using a neural network in order to design a robust controller when a disturbance occurs is studied. Backpropagation algorithm, which is used in a conventional neural network controller is used in many areas, but when the number of neurons in the input layer, hidden layer and output layer of the neural network increases the processing speed of the learning process is slow. In this paper an adaptive PI(Proportional and Integral) controller based on CTRNN(Continuous Time Recurrent Neural Network) for permanent magnet synchronous motors is presented. By varying the load and the speed the validity of the proposed method is verified through simulation and experiments.

Parameter Calibration of Storage Function Model and Flood Forecasting (2) Comparative Study on the Flood Forecasting Methods (저류함수모형의 매개변수 보정과 홍수예측 (2) 홍수예측방법의 비교 연구)

  • Kim, Bum Jun;Song, Jae Hyun;Kim, Hung Soo;Hong, Il Pyo
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.1B
    • /
    • pp.39-50
    • /
    • 2006
  • The flood control offices of main rivers have used a storage function model to forecast flood stage in Korea and studies of flood forecasting actively have been done even now. On this account, the storage function model, which is used in flood control office, regression models and artificial neural network model are applied into flood forecasting of study watershed in this paper. The result obtained by each method are analyzed for the comparative study. In case of storage function model, this paper uses the representative parameters of the flood control offices and the optimized parameters. Regression coefficients are obtained by regression analysis and neural network is trained by backpropagation algorithm after selecting four events between 1995 to 2001. As a result of this study, it is shown that the optimized parameters are superior to the representative parameters for flood forecasting. The results obtained by multiple, robust, stepwise regression analysis, one of the regression methods, show very good forecasts. Although the artificial neural network model shows less exact results than the regression model, it can be efficient way to produce a good forecasts.