• Title/Summary/Keyword: Gradient descent

Search Result 339, Processing Time 0.024 seconds

Design of Radial Basis Function Neural Network Driven to TYPE-2 Fuzzy Inference and Its Optimization (TYPE-2 퍼지 추론 구동형 RBF 신경 회로망 설계 및 최적화)

  • Baek, Jin-Yeol;Kim, Woong-Ki;Oh, Sung-Kwun;Kim, Hyun-Ki
    • Proceedings of the KIEE Conference
    • /
    • 2008.10b
    • /
    • pp.247-248
    • /
    • 2008
  • 본 논문에서는 TYPE-2 퍼지 추론 기반의 RBF 뉴럴 네트워크(TYPE-2 Radial Basis Function Neural Network, T2RBFNN)를 설계하고 PSO(Particle Swarm Optimization) 알고리즘을 이용하여 모델의 파라미터를 동정한다. 제안된 모델의 은닉층은 TYPE-2 가우시안 활성 함수로 구성되며, 출력층은 Interval set 형태의 연결가중치를 갖는다. 여기에서 규칙 전반부 활성함수의 중심 선택은 C-means 클러스터링 알고리즘을 이용하고, 규칙 후반부 Interval set 형태의 연결가중치 결정에는 경사 하강법(Gradient descent method)을 이용한 오류 역전파 알고리즘을 사용하여 학습한다. 또한, 최적의 모델을 설계하기 위한 학습율 및 활성함수의 활성화 영역 결정에는 입자 군집 최적화(PSO; Particle Swarm Optimization) 알고리즘으로 동조한다. 마지막으로, 제안된 모델의 평가를 위하여 모의 데이터 집합(Synthetic dadaset)을 적용하고 근사화 및 일반화 능력에 대하여 토의한다.

  • PDF

Optimal Hyper Analytic Wavelet Transform for Glaucoma Detection in Fundal Retinal Images

  • Raja, C.;Gangatharan, N.
    • Journal of Electrical Engineering and Technology
    • /
    • v.10 no.4
    • /
    • pp.1899-1909
    • /
    • 2015
  • Glaucoma is one of the most common causes of blindness which is caused by increase of fluid pressure in the eye which damages the optic nerve and eventually causing vision loss. An automated technique to diagnose glaucoma disease can reduce the physicians’ effort in screening of Glaucoma in a person through the fundal retinal images. In this paper, optimal hyper analytic wavelet transform for Glaucoma detection technique from fundal retinal images is proposed. The optimal coefficients for transformation process are found out using the hybrid GSO-Cuckoo search algorithm. This technique consists of pre-processing module, optimal transformation module, feature extraction module and classification module. The implementation is carried out with MATLAB and the evaluation metrics employed are accuracy, sensitivity and specificity. Comparative analysis is carried out by comparing the hybrid GSO with the conventional GSO. The results reported in our paper show that the proposed technique has performed well and has achieved good evaluation metric values. Two 10- fold cross validated test runs are performed, yielding an average fitness of 91.13% and 96.2% accuracy with CGD-BPN (Conjugate Gradient Descent- Back Propagation Network) and Support Vector Machines (SVM) respectively. The techniques also gives high sensitivity and specificity values. The attained high evaluation metric values show the efficiency of detecting Glaucoma by the proposed technique.

A Study for the Improvement of the Fault Decision Capability of FRTU using Discrete Wavelet Transform and Neural Network (이산 웨이블릿 변환과 신경회로망을 이용한 FRTU의 고장판단 능력 개선에 관한 연구)

  • Hong, Dae-Seung;Ko, Yoon-Seok;Kang, Tae-Ku;Park, Hak-Yeol;Yim, Hwa-Young
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.56 no.7
    • /
    • pp.1183-1190
    • /
    • 2007
  • This paper proposes the improved fault decision algorithm using DWT(Discrete Wavelet Transform) and ANNs for the FRTU(Feeder Remote Terminal Unit) on the feeder in the power distribution system. Generally, the FRTU has the fault decision scheme detecting the phase fault, the ground fault. Especially FRTU has the function for 2000ms. This function doesn't operate FI(Fault Indicator) for the Inrush current generated in switching time. But it has a defect making it impossible for the FI to be operated from the real fault current in inrush restraint time. In such a case, we can not find the fault zone from FI information. Accordingly, the improved fault recognition algorithm is needed to solve this problem. The DWT analysis gives the frequency and time-scale information. The neural network system as a fault recognition was trained to distinguish the inrush current from the fault status by a gradient descent method. In this paper, fault recognition algorithm is improved by using voltage monitoring system, DWT and neural network. All of the data were measured in actual 22.9kV power distribution system.

A New PAPR Reduction Method in the OFDM System using GD and Radix-2 DIF IFFT (OFDM 시스템에서의 GD방식과 Radix-2 DIF IFFT를 이용한 효과적인 PAPR 감소 방식)

  • Lee, Sun-Ho;Lee, Hae-Kie;Kim, Sung-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.8 no.3
    • /
    • pp.41-46
    • /
    • 2008
  • Many methods have been developed to overcome the PAPR(peak-to-average power ratio) problem. Selective mapping(SLM), partial transmit sequence(PTS), subblock phase weighting(SPW) and gradient descent(GD) are used widely to reduce the PAPR. In this paper, we present an effective PAPR reduction method that decreases the number of calculations through Radix-2 DIF IFFT procedure and GD method that transmits selected data sequence. The data sequence is constructed by choosing elements that satisfy threshold value as one part of the sequence and the rest elements of each sequence are chosen to have the lower papr operating, which yields performance improvement.

Design of PID Controller to Compensate for Gain and Phase Margin Base on Gradient Descent Method (경사 하강법에 근거한 이득여유와 위상여유를 보상하는 PID 제어기 설계)

  • Park, Jae-Hoon;Cho, Joon-Ho;Choi, Jung-Nae;Lee, Won-Hyuk;Hwang, Hyung-Soo
    • Proceedings of the KIEE Conference
    • /
    • 2005.07d
    • /
    • pp.2552-2554
    • /
    • 2005
  • 제어기 설계에서 이득여유와 위상여유는 견실성 및 안정도 판별의 중요한 척도로 사용되며, 그 중 위상여유는 시스템의 성능지수와 관련된다. 이와 같은 이유로 이득여유와 위상여유의 안정도를 고려한 제어기의 설계방법이 연구되어지고 있다. 근래 Weng Khuen Ho와 Chang Chieh Hang이 제안한 설계방법은 복잡한 계산을 필요로 하는 arctan 함수를 1차 선형함수로 근사화 하여 복잡도를 감소시키면서도 원하는 이득여유와 위상여유를 만족시키는 제어기의 파라미터를 찾았다. 하지만 이 방법은 실제의 arctan 함수를 사용하는 것이 아니라 근사화된 수식을 사용함으로써 오차가 수반되어 원하는 설계조건을 만족 하지 못한다. 따라서 본 논문은 이러한 오차를 최소화하기 위해서 최적화 알고리즘을 이용한 이득여유와 위상여유를 보상하는 PID 제어기를 설계하였다.

  • PDF

AN IMAGE SEGMENTATION LEVEL SET METHOD FOR BUILDING DETECTION

  • Konstantinos, Karantzalos;Demetre, Argialas
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.610-614
    • /
    • 2006
  • In this paper the advanced method of geodesic active contours was developed for the task of building detection from aerial and satellite images. Automatic extraction of man-made structures including buildings, building blocks or roads from remote sensing data is useful for land use mapping, scene understanding, robotic navigation, image retrieval, surveillance, emergency management procedures, cadastral etc. A level set method based on a region-driven segmentation model was implemented with which building boundaries were detected, through this curve propagation technique. The essence of this approach is to optimize the position and the geometric form of the curve by measuring information along that curve, and within the regions that compose the image partition. To this end, one can consider uniform intensities inside objects and the background. Thus, given an initial position of the curve, one can determine global, region-driven functions and provide a statistical description of the inside and outside object area. The calculus of variations and a gradient descent method was used to optimize the variational functional by an iterative steady state process. Experimental results demonstrate the potential of the proposed processing scheme.

  • PDF

Stable Path Tracking Control Using a Wavelet Based Fuzzy Neural Network for Mobile Robots

  • Oh, Joon-Seop;Park, Jin-Bae;Choi, Yoon-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.2254-2259
    • /
    • 2005
  • In this paper, we propose a wavelet based fuzzy neural network(WFNN) based direct adaptive control scheme for the solution of the tracking problem of mobile robots. To design a controller, we present a WFNN structure that merges advantages of neural network, fuzzy model and wavelet transform. The basic idea of our WFNN structure is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. In our control system, the control signals are directly obtained to minimize the difference between the reference track and the pose of mobile robot using the gradient descent(GD) method. In addition, an approach that uses adaptive learning rates for the training of WFNN controller is driven via a Lyapunov stability analysis to guarantee the fast convergence, that is, learning rates are adaptively determined to rapidly minimize the state errors of a mobile robot. Finally, to evaluate the performance of the proposed direct adaptive control system using the WFNN controller, we compare the control performance of the WFNN controller with those of the FNN, the WNN and the WFM controllers.

  • PDF

Intelligent IIR Filter based Multiple-Channel ANC Systems (지능형 IIR 필터 기반 다중 채널 ANC 시스템)

  • Cho, Hyun-Cheol;Yeo, Dae-Yeon;Lee, Young-Jin;Lee, Kwon-Soon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.12
    • /
    • pp.1220-1225
    • /
    • 2010
  • This paper proposes a novel active noise control (ANC) approach that uses an IIR filter and neural network techniques to effectively reduce interior noise. We construct a multiple-channel IIR filter module which is a linearly augmented framework with a generic IIR model to generate a primary control signal. A three-layer perceptron neural network is employed for establishing a secondary-path model to represent air channels among noise fields. Since the IIR module and neural network are connected in series, the output of an IIR filter is transferred forward to the neural model to generate a final ANC signal. A gradient descent optimization based learning algorithm is analytically derived for the optimal selection of the ANC parameter vectors. Moreover, re-estimation of partial parameter vectors in the ANC system is proposed for online learning. Lastly, we present the results of a numerical study to test our ANC methodology with realistic interior noise measurement obtained from Korean railway trains.

Convergence Behavior of the Least Mean Fourth Algorithm for a Multiple Sinusoidal Input (복수 정현파 입력신호에 대한 최소평균사승 알고리듬의 수렴 특성에 관한 연구)

  • Lee, Kang-Seung;Lee, Jae-Chon;Youn, Dae-Hee
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.1
    • /
    • pp.22-30
    • /
    • 1995
  • In this Paper we study the convergence behavior of the least mean fourth (LMF) algorithm where the error raised to the power of four is minimized for a multiple sinusoidal input and Gaussian measurement noise. Here we newly obtain the convergence equation for the sum of the mean of the squared weight errors, which indicates that the transient behavior can differ depending on the relative sizes of the Gaussian noise and the convergence constant. It should be noted that no similar results can be expected from the previous analysis by Walach and Widrow.

  • PDF

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.7
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.