• 제목/요약/키워드: Gradient-descent methods

검색결과 73건 처리시간 0.024초

Trust-Region ICA 알고리듬 (A Trust-Region ICA algorithm)

  • Park, Heeyoul;Kim, Sookjeong;Park, Seungjin
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 2004년도 봄 학술발표논문집 Vol.31 No.1 (B)
    • /
    • pp.721-723
    • /
    • 2004
  • A trust-region method is a quite attractive optimization technique. It is, in general, faster than the steepest descent method and is free of a learning rate unlike the gradient-based methods. In addition to its convergence property (between linear and quadratic convergence), ifs stability is always guaranteed, in contrast to the Newton's method. In this paper, we present an efficient implementation of the maximum likelihood independent component analysis (ICA) using the trust-region method, which leads to trust-region-based ICA (TR-ICA) algorithms. The useful behavior of our TR-ICA algorithms is confimed through numerical experimental results.

  • PDF

Dynamic System Identification Using a Recurrent Compensatory Fuzzy Neural Network

  • Lee, Chi-Yung;Lin, Cheng-Jian;Chen, Cheng-Hung;Chang, Chun-Lung
    • International Journal of Control, Automation, and Systems
    • /
    • 제6권5호
    • /
    • pp.755-766
    • /
    • 2008
  • This study presents a recurrent compensatory fuzzy neural network (RCFNN) for dynamic system identification. The proposed RCFNN uses a compensatory fuzzy reasoning method, and has feedback connections added to the rule layer of the RCFNN. The compensatory fuzzy reasoning method can make the fuzzy logic system more effective, and the additional feedback connections can solve temporal problems as well. Moreover, an online learning algorithm is demonstrated to automatically construct the RCFNN. The RCFNN initially contains no rules. The rules are created and adapted as online learning proceeds via simultaneous structure and parameter learning. Structure learning is based on the measure of degree and parameter learning is based on the gradient descent algorithm. The simulation results from identifying dynamic systems demonstrate that the convergence speed of the proposed method exceeds that of conventional methods. Moreover, the number of adjustable parameters of the proposed method is less than the other recurrent methods.

FEA based optimization of semi-submersible floater considering buckling and yield strength

  • Jang, Beom-Seon;Kim, Jae Dong;Park, Tae-Yoon;Jeon, Sang Bae
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • 제11권1호
    • /
    • pp.82-96
    • /
    • 2019
  • A semi-submersible structure has been widely used for offshore drilling and production of oil and gas. The small water plane area makes the structure very sensitive to weight increase in terms of payload and stability. Therefore, it is necessary to lighten the substructure from the early design stage. This study aims at an optimization of hull structure based on a sophisticated yield and buckling strength in accordance with classification rules. An in-house strength assessment system is developed to automate the procedure such as a generation of buckling panels, a collection of required panel information, automatic buckling and yield check and so on. The developed system enables an automatic yield and buckling strength check of all panels composing the hull structure at each iteration of the optimization. Design variables are plate thickness and stiffener section profiles. In order to overcome the difficulty of large number of design variables and the computational burden of FE analysis, various methods are proposed. The steepest descent method is selected as the optimization algorithm for an efficient search. For a reduction of the number of design variables and a direct application to practical design, the stiffener section variable is determined by selecting one from a pre-defined standard library. Plate thickness is also discretized at 0.5t interval. The number of FE analysis is reduced by using equations to analytically estimating the stress changes in gradient calculation and line search steps. As an endeavor to robust optimization, the number of design variables to be simultaneously optimized is divided by grouping the scantling variables by the plane. A sequential optimization is performed group by group. As a verification example, a central column of a semi-submersible structure is optimized and compared with a conventional optimization of all design variables at once.

궤도민감도 분석에 기반하여 복입력 전력시스템 안정화 장치(Dual-Input PSS)의 비선형 파라미터 최적화 기법 (Optimal Tuning of Nonlinear Parameters of a Dual-Input Power System Stabilizer Based on Analysis of Trajectory Sensitivities)

  • 백승묵;박정욱
    • 전기학회논문지
    • /
    • 제57권6호
    • /
    • pp.915-923
    • /
    • 2008
  • This paper focuses on optimal tuning of nonlinear parameters of a dual-input power system stabilizer(dual-input PSS), which can improve the system damping performance immediately following a large disturbance. Until recently, various PSS models have developed to bring stability and reliability to power systems, and some of these models are used in industry applications. However, due to non-smooth nonlinearities from the interaction between linear parameters(gains and time constants of linear controllers) and nonlinear parameters(saturation output limits), the output limit parameters cannot be determined by the conventional tuning methods based on linear analysis. Only ad hoc tuning procedures('trial and error' approach) have been used. Therefore, the steepest descent method is applied to implement the optimal tuning of the nonlinear parameters of the dual-input PSS. The gradient required in this optimization technique can be computed from trajectory sensitivities in hybrid system modeling with the differential-algebraic-impulsive-switched(DAIS) structure. The optimal output limits of the dual-input PSS are evaluated by time-domain simulation in both a single machine infinite bus(SMIB) system and a multi-machine power system in comparison with those of a single-input PSS.

OFDM 시스템에서의 GD방식과 Radix-2 DIF IFFT를 이용한 효과적인 PAPR 감소 방식 (A New PAPR Reduction Method in the OFDM System using GD and Radix-2 DIF IFFT)

  • 이선호;이해기;김성수
    • 한국콘텐츠학회논문지
    • /
    • 제8권3호
    • /
    • pp.41-46
    • /
    • 2008
  • PAPR을 극복하기 위해서 SLM, PTS, SPW와 GD 같은 많은 연구들이 진행되었다. 본 논문에서는 PAPR을 줄이고 늘어난 계산량을 GD방식과 Radix-2 DIF IFFT 과정을 통하여 성능을 향상시키는 방법을 제시한다. 그리고 특정값을 설정하여 일정한 특정값을 만족하는 경우에는 제안된 방식의 일부분만으로 특정값을 만족하는 데이터 시퀀스를 선택하여 전송할 수 있고, 그렇지 못한 경우는 성능 향상을 위해 남은 부분을 수행하여 가장 적은 PAPR을 갖는 데이터 시퀀스를 선택하여 전송하는 방식이다.

AN IMAGE SEGMENTATION LEVEL SET METHOD FOR BUILDING DETECTION

  • Konstantinos, Karantzalos;Demetre, Argialas
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2006년도 Proceedings of ISRS 2006 PORSEC Volume II
    • /
    • pp.610-614
    • /
    • 2006
  • In this paper the advanced method of geodesic active contours was developed for the task of building detection from aerial and satellite images. Automatic extraction of man-made structures including buildings, building blocks or roads from remote sensing data is useful for land use mapping, scene understanding, robotic navigation, image retrieval, surveillance, emergency management procedures, cadastral etc. A level set method based on a region-driven segmentation model was implemented with which building boundaries were detected, through this curve propagation technique. The essence of this approach is to optimize the position and the geometric form of the curve by measuring information along that curve, and within the regions that compose the image partition. To this end, one can consider uniform intensities inside objects and the background. Thus, given an initial position of the curve, one can determine global, region-driven functions and provide a statistical description of the inside and outside object area. The calculus of variations and a gradient descent method was used to optimize the variational functional by an iterative steady state process. Experimental results demonstrate the potential of the proposed processing scheme.

  • PDF

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • 한국컴퓨터정보학회논문지
    • /
    • 제23권7호
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

퍼지 모델을 이용한 카메라 보정에 관한 연구 (Camera Calibration Using the Fuzzy Model)

  • 박민기
    • 한국지능시스템학회논문지
    • /
    • 제11권5호
    • /
    • pp.413-418
    • /
    • 2001
  • 본 논문에서는 기존에 사용한 물리적 카메라 모델 대신 퍼지 모델을 사용한 새로운 카메라 보정 방식을 제안한다. 카메라 보정은 카메라의 영상 좌표계와 실제 환경이 가지는 좌표계와의 관계를 규정하는 것으로, 퍼지 모델을 이용하는 방법은 기존의 방법에서 이용했던 물리적 변수들을 설정할 수는 없지만 카메라 보정의 목적인 카메라 좌표계와 실제 환경 좌표계와의 관계를 별다른 제약없이 규정할 수 있으므로 매우 간단하고 효율적인 카메라 보정 방법이다. 실제 실험을 통해 얻은 실공간상의 하나의 보정면 좌표에 대해 퍼지 모델링 방법을 이용하여 3차원 실 공간 좌표 및 2차원 영상좌표 예측을 통해 제안한 방법의 유효성을 보인다.

  • PDF

통계적 분석방법을 이용한 복합화력 발전설비의 평균수명 계산 및 고장확률 예측 (Mean Life Assessment and Prediction of the Failure Probability of Combustion Turbine Generating Unit with Data Analytic Method Based on Aging Failure Data)

  • 이성훈;이승혁;김진오
    • 대한전기학회논문지:전력기술부문A
    • /
    • 제54권10호
    • /
    • pp.480-486
    • /
    • 2005
  • This paper proposes a method to consider an aging failure probability and survival probability of power system components, though only aging failure probability has been considered in existing mean life calculation. The estimates of the mean and its standard deviation is calculated by using Weibull distribution, and each estimated parameters is obtained from Data Analytic Method (Type H Censoring). The parameter estimation using Data Analytic Method is simpler and faster than the traditional calculation method using gradient descent algorithm. This paper shows calculation procedure of the mean life and its standard deviation by the proposed method and illustrates that the estimated results are close enough to real historical data of combustion turbine generating units in Korean systems. Also, this paper shows the calculation procedures of a probabilistic failure prediction through a stochastic data analysis. Consequently, the proposed methods would be likely to permit that the new deregulated environment forces utilities to reduce overall costs while maintaining an are-related reliability index.

특징 추출과 검출 오차 최소화 알고리듬을 이용한 회전기계의 결함 진단 (Fault Diagnosis for Rotating Machine Using Feature Extraction and Minimum Detection Error Algorithm)

  • 정의필;조상진;이재열
    • 한국소음진동공학회논문집
    • /
    • 제16권1호
    • /
    • pp.27-33
    • /
    • 2006
  • Fault diagnosis and condition monitoring for rotating machines are important for efficiency and accident prevention. The process of fault diagnosis is to extract the feature of signals and to classify each state. Conventionally, fault diagnosis has been developed by combining signal processing techniques for spectral analysis and pattern recognition, however these methods are not able to diagnose correctly for certain rotating machines and some faulty phenomena. In this paper, we add a minimum detection error algorithm to the previous method to reduce detection error rate. Vibration signals of the induction motor are measured and divided into subband signals. Each subband signal is processed to obtain the RMS, standard deviation and the statistic data for constructing the feature extraction vectors. We make a study of the fault diagnosis system that the feature extraction vectors are applied to K-means clustering algorithm and minimum detection error algorithm.