• Title/Summary/Keyword: Gradient descent

Search Result 341, Processing Time 0.027 seconds

Convergence Behavior of the Least Mean Fourth Algorithm for a Multiple Sinusoidal Input (복수 정현파 입력신호에 대한 최소평균사승 알고리듬의 수렴 특성에 관한 연구)

  • Lee, Kang-Seung;Lee, Jae-Chon;Youn, Dae-Hee
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.1
    • /
    • pp.22-30
    • /
    • 1995
  • In this Paper we study the convergence behavior of the least mean fourth (LMF) algorithm where the error raised to the power of four is minimized for a multiple sinusoidal input and Gaussian measurement noise. Here we newly obtain the convergence equation for the sum of the mean of the squared weight errors, which indicates that the transient behavior can differ depending on the relative sizes of the Gaussian noise and the convergence constant. It should be noted that no similar results can be expected from the previous analysis by Walach and Widrow.

  • PDF

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.7
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

Camera Calibration Using the Fuzzy Model (퍼지 모델을 이용한 카메라 보정에 관한 연구)

  • 박민기
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.11 no.5
    • /
    • pp.413-418
    • /
    • 2001
  • In this paper, we propose a new camera calibration method which is based on a fuzzy model instead of a physical camera model of the conventional method. The camera calibration is to determine the correlation between camera image coordinate and real world coordinate. The camera calibration method using a fuzzy model can not estimate camera physical parameters which can be obtained in the conventional methods. However, the proposed method is very simple and efficient because it can determine the correlation between camera image coordinate and real world coordinate without any restriction, which is the objective of camera calibration. With calibration points acquired out of experiments, 3-D real world coordinate and 2-D image coordinate are estimated using the fuzzy modeling method and the results of the experiments demonstrate the validity of the proposed method.

  • PDF

A Study on the Prediction of the Nonlinear Chaotic Time Series Using a Self-Recurrent Wavelet Neural Network (자기 회귀 웨이블릿 신경 회로망을 이용한 비선형 혼돈 시계열의 예측에 관한 연구)

  • Lee, Hye-Jin;Park, Jin-Bae;Choi, Yoon-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2004.07d
    • /
    • pp.2209-2211
    • /
    • 2004
  • Unlike the wavelet neural network, since a mother wavelet layer of the self-recurrent wavelet neural network (SRWNN) is composed of self-feedback neurons, it has the ability to store past information of the wavelet. Therefore we propose the prediction method for the nonlinear chaotic time series model using a SRWNN. The SRWNN model is learned for the modeling of a function such that the inputs arc known values of the time series and the output is the value in the future. The parameters of the network are tuned to minimize the difference between the nonlinear mapping of the chaotic time series and the output of SRWNN using the gradient-descent method for the adaptive backpropagation algorithm. Through the computer simulations, we demonstrate the feasibility and the effectiveness of our method for the prediction of the logistic map and the Mackey-Glass delay-differential equation as a nonlinear chaotic time series.

  • PDF

Detection of High Impedance Fault Using Adaptive Neuro-Fuzzy Inference System (적응 뉴로 퍼지 추론 시스템을 이용한 고임피던스 고장검출)

  • 유창완
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.9 no.4
    • /
    • pp.426-435
    • /
    • 1999
  • A high impedance fault(HIF) is one of the serious problems facing the electric utility industry today. Because of the high impedance of a downed conductor under some conditions these faults are not easily detected by over-current based protection devices and can cause fires and personal hazard. In this paper a new method for detection of HIF which uses adaptive neuro-fuzzy inference system (ANFIS) is proposed. Since arcing fault current shows different changes during high and low voltage portion of conductor voltage waveform we firstly divided one cycle of fault current into equal spanned four data windows according to the mangnitude of conductor voltage. Fast fourier transform(FFT) is applied to each data window and the frequency spectrum of current waveform are chosen asinputs of ANFIS after input selection method is preprocessed. Using staged fault and normal data ANFIS is trained to discriminate between normal and HIF status by hybrid learning algorithm. This algorithm adapted gradient descent and least square method and shows rapid convergence speed and improved convergence error. The proposed method represent good performance when applied to staged fault data and HIFLL(high impedance like load)such as arc-welder.

  • PDF

Design of Adaptive Fuzzy Sliding Mode Controller for Chattering Reduction (채터링 감소를 위한 적응 퍼지 슬라이딩 모드 제어기의 설계)

  • Seo, Sam-Jun;Kim, Dong-Won;Park, Gwi-Tae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.6
    • /
    • pp.752-758
    • /
    • 2004
  • In this paper, we proposed an adaptivefuzzy sliding control algorithm using gradient descent method to reduce chattering phenomenon which is viewed in variable control system. In design of FLC, fuzzy control rules are obtained from expert's experience and intuition and it is very difficult to obtain them. We proposed an adaptive algorithm which is updated by consequence part parameter of control rules in order to reduce chattering phenomenon and simultaneously to satistfy the sliding mode condition. The proposed algorithm has the characteristics which are viewed in conventional VSC, e.g. insensitivity to a class of disturbance, parameter variations and uncertainties in the sliding mode. To demonstrate its performance, the proposed control algorithm is applied to an inverted pendulum system. The results show that both alleviation of chattering and performance are achieved.

Nonlinear Adaptive Control and Stability Analysis for Improving Transient Response of Photovoltaic Converter Systems (태양광 컨버터 시스템의 과도응답 개선을 위한 비선형 적응제어 및 안정성 해석)

  • Cho, Hyun-Cheol;Yoo, Su-Bok;Lee, Kwon-Soon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.12
    • /
    • pp.1175-1183
    • /
    • 2009
  • In photovoltaic(PV) generator systems, DC-DC converters are significantly considered for control system performance in power quality point of view. This paper presents a novel adaptive control method for DC-DC converters applied in PV generator systems. First, we derive a state-space average model of the converter system and then propose a reset control methodology to enhance transient response performance for time-varying PV systems. For estimating parameters of a reset control, a gradient descent optimization is utilized and an adjustment rule of them are derived respectively. An objective of the optimization is that characteristic equation of an augmented system model which is formed with an converter system model and an reset control is to trace a predefined polynomial given as a reference characteristic model. Next, we accomplish stability analysis by means of a well-known Lyapunov theory for nonlinear converter systems including time-varying voltage excitation from a PV generator. Numerical simulation demonstrates reliability of our control methodology and its superiority by comparison to a traditional control strategy.

Development of the Adaptive PPF Controller for the Vibration Syppression of Smart Structures (지능구조물 제어를 위한 적응형 PPF 제어기의 개발)

  • Lee, Seung-Bum;Heo, Seok;Kwak, Moom Ku
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2001.05a
    • /
    • pp.302-307
    • /
    • 2001
  • This research is concerned with the development of a real-time adaptive PPF controller for the active vibration suppression of smart structure. In general, the tuning of the PPF controller is carried out off-line. In this research, the real-time learning algorithm is developed to find the optimal filter frequency of the PPF controller in real time and the efficacy of the algorithm is proved by implementing it in real time. To this end, the adaptive algorithm is developed by applying the gradient descent method to the predefined performance index, which is similar to the method used popularly in the optimization and neural network controller design. The experiment was carried out to verify the validity of the adaptive PPF controller developed in this research. The experimental results showed that adaptive PPF controller is effective for active vibration control of the structure which is excited by either impact or harmonic disturbance. The filter frequency of the PPF controller can be tuned in a very short period of time thus proving the efficiency of the adaptive PPF controller.

  • PDF

Improving the Training Performance of Multilayer Neural Network by Using Stochastic Approximation and Backpropagation Algorithm (확률적 근사법과 후형질과 알고리즘을 이용한 다층 신경망의 학습성능 개선)

  • 조용현;최흥문
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.4
    • /
    • pp.145-154
    • /
    • 1994
  • This paper proposes an efficient method for improving the training performance of the neural network by using a hybrid of a stochastic approximation and a backpropagation algorithm. The proposed method improves the performance of the training by appliying a global optimization method which is a hybrid of a stochastic approximation and a backpropagation algorithm. The approximate initial point for a stochastic approximation and a backpropagation algorihtm. The approximate initial point for fast global optimization is estimated first by applying the stochastic approximation, and then the backpropagation algorithm, which is the fast gradient descent method, is applied for a high speed global optimization. And further speed-up of training is made possible by adjusting the training parameters of each of the output and the hidden layer adaptively to the standard deviation of the neuron output of each layer. The proposed method has been applied to the parity checking and the pattern classification, and the simulation results show that the performance of the proposed method is superior to that of the backpropagation, the Baba's MROM, and the Sun's method with randomized initial point settings. The results of adaptive adjusting of the training parameters show that the proposed method further improves the convergence speed about 20% in training.

  • PDF

Mean Life Assessment and Prediction of the Failure Probability of Combustion Turbine Generating Unit with Data Analytic Method Based on Aging Failure Data (통계적 분석방법을 이용한 복합화력 발전설비의 평균수명 계산 및 고장확률 예측)

  • Lee, Sung-Hoon;Lee, Seung-Hyuk;Kim, Jin-O
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.54 no.10
    • /
    • pp.480-486
    • /
    • 2005
  • This paper proposes a method to consider an aging failure probability and survival probability of power system components, though only aging failure probability has been considered in existing mean life calculation. The estimates of the mean and its standard deviation is calculated by using Weibull distribution, and each estimated parameters is obtained from Data Analytic Method (Type H Censoring). The parameter estimation using Data Analytic Method is simpler and faster than the traditional calculation method using gradient descent algorithm. This paper shows calculation procedure of the mean life and its standard deviation by the proposed method and illustrates that the estimated results are close enough to real historical data of combustion turbine generating units in Korean systems. Also, this paper shows the calculation procedures of a probabilistic failure prediction through a stochastic data analysis. Consequently, the proposed methods would be likely to permit that the new deregulated environment forces utilities to reduce overall costs while maintaining an are-related reliability index.