• Title/Summary/Keyword: Secant algorithm

Search Result 28, Processing Time 0.031 seconds

Separations and Feature Extractions for Image Signals Using Independent Component Analysis Based on Neural Networks of Efficient Learning Rule (효율적인 학습규칙의 신경망 기반 독립성분분석을 이용한 영상신호의 분리 및 특징추출)

  • Cho, Yong-Hyun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.2
    • /
    • pp.200-208
    • /
    • 2003
  • This paper proposes a separation and feature extraction of image signals using the independent component analysis(ICA) based on neural networks of efficient learning rule. The proposed learning rule is a hybrid fixed-point(FP) algorithm based on secant method and momentum. Secant method is applied to improve the performance by simplifying the 1st-order derivative computation for optimizing the objective function, which is to minimize the mutual informations of the independent components. The momentum is applied for high-speed convergence by restraining the oscillation in the process of converging to the optimal solution. The proposed algorithm has been applied to the composite images generated by random mixing matrix from the 10 images of $512\times512$-pixel. The simulation results show that the proposed algorithm has better performances of the separation speed and rate than those using the FP algorithm based on Newton and secant method. The proposed algorithm has been also applied to extract the features using a 3 set of 10,000 image patches from the 10 fingerprints of $256\times256$-pixel and the front and the rear paper money of $480\times225$-pixel, respectively, The simulation results show that the proposed algorithm has also better extraction speed than those using the another methods. Especially, the 160 basis vectors(features) of $16\times16$-pixel show the local features which have the characteristics of spatial frequency and oriented edges in the images.

An Efficient Composite Image Separation by Using Independent Component Analysis Based on Neural Networks (신경망 기반 독립성분분석을 이용한 효율적인 복합영상분리)

  • Cho, Yong-Hyun;Park, Yong-Soo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.12 no.3
    • /
    • pp.210-218
    • /
    • 2002
  • This paper proposes an efficient separation method of the composite images by using independent component analysis(ICA) based on neural networks of the approximate learning algorithm. The Proposed learning algorithm is the fixed point(FP) algorithm based on Secant method which can be approximately computed by only the values of function for estimating the root of objective function for optimizing entropy. The secant method is an alternative of the Newton method which is essential to differentiate the function for estimating the root. It can achieve a superior property of the FP algorithm for ICA due to simplify the composite computation of differential process. The proposed algorithm has been applied to the composite signals and image generated by random mixing matrix in the 4 signal of 500-sample and the 10 images of $512{\times}512-pixel$, respectively The simulation results show that the proposed algorithm has better performance of the learning speed and the separation than those using the conventional algorithm based method. It also solved the training performances depending on initial points setting and the nonrealistic learning time for separating the large size image by using the conventional algorithm.

Augmentation of Fractional-Order PI Controller with Nonlinear Error-Modulator for Enhancing Robustness of DC-DC Boost Converters

  • Saleem, Omer;Rizwan, Mohsin;Khizar, Ahmad;Ahmad, Muaaz
    • Journal of Power Electronics
    • /
    • v.19 no.4
    • /
    • pp.835-845
    • /
    • 2019
  • This paper presents a robust-optimal control strategy to improve the output-voltage error-tracking and control capability of a DC-DC boost converter. The proposed strategy employs an optimized Fractional-order Proportional-Integral (FoPI) controller that serves to eliminate oscillations, overshoots, undershoots and steady-state fluctuations. In order to significantly improve the error convergence-rate during a transient response, the FoPI controller is augmented with a pre-stage nonlinear error-modulator. The modulator combines the variations in the error and error-derivative via the signed-distance method. Then it feeds the aggregated-signal to a smooth sigmoidal control surface constituting an optimized hyperbolic secant function. The error-derivative is evaluated by measuring the output-capacitor current in order to compensate the hysteresis effect rendered by the parasitic impedances. The resulting modulated-signal is fed to the FoPI controller. The fixed controller parameters are meta-heuristically selected via a Particle-Swarm-Optimization (PSO) algorithm. The proposed control scheme exhibits rapid transits with improved damping in its response which aids in efficiently rejecting external disturbances such as load-transients and input-fluctuations. The superior robustness and time-optimality of the proposed control strategy is validated via experimental results.

Independent Component Analysis Using Fixed Point Algorithm Based on Newton and Secant Method Including Moment (모멘트와 뉴우턴법 및 할선법에 기초한 고정점 알고리즘의 독립성분분석 기법)

  • 민성재;조용현
    • Proceedings of the Korea Multimedia Society Conference
    • /
    • 2002.05c
    • /
    • pp.320-324
    • /
    • 2002
  • 본 연구에서는 모멘트와 뉴우턴법 및 모멘트와 할선법에 각각 기초한 고정점 알고리즘의 신경망 기반 독립성분분석 기법을 제안하였다. 여기서 뉴우턴법과 할선법은 각각 엔트로피에 기초한 목적함수의 근을 구하는 근사화 방법으로 빠른 경신을 위함이고, 모멘트는 근사화에 의한 역혼합행렬의 경신과정에서 발생하는 발진을 줄여 좀 더 빠른 학습을 위함이다. 제안된 기법을 256×256 픽셀(pixel)의 8개 지문영상으로부터 임의의 혼합행렬에 따라 발생되는 영상들을 각각 대상으로 시뮬레이션 한 결과, 모멘트와 할선법에 기초한 알고리즘이 모멘트와 뉴우턴에 기초한 알고리즘보다 우수한 분리성능과 빠른 학습속도가 있음을 확인하였다.

  • PDF

A Study on Hull Form Design Techniques Based on Graphical User Interface (그래픽 사용자 인터페이스(GUI)를 도입한 선형설계 기법에 관한 연구)

  • H. Shin;K.W. Park
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.30 no.4
    • /
    • pp.17-22
    • /
    • 1993
  • The intersection problem of three-dimensional free form surfaces can be solved by geometrical and numerical methods. Up to now, the subdivision technique, which is classified under the former, has been largely employed to find the cross section of ship hull form. In this paper, an algorithm is presented for intersecting ship hull form in high speed. The high speed calculation algorithm is based on simple numerical methods, such as the secant method, false position method and bisection method. The algorithm is directly applicable to depicting arbitrary ship cross sections, drawing ship lines and constructing the offset table.

  • PDF

Input Variable Selection by Using Fixed-Point ICA and Adaptive Partition Mutual Information Estimation (고정점 알고리즘의 독립성분분석과 적응분할의 상호정보 추정에 의한 입력변수선택)

  • Cho, Yong-Hyun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.5
    • /
    • pp.525-530
    • /
    • 2006
  • This paper presents an efficient input variable selection method using both fixed-point independent component analysis(FP-ICA) and adaptive partition mutual information(AP-MI) estimation. FP-ICA which is based on secant method, is applied to quickly find the independence between input variables. AP-MI estimation is also applied to estimate an accurate dependence information by equally partitioning the samples of input variable for calculating the probability density function(PDF). The proposed method has been applied to 2 problems for selecting the input variables, which are the 7 artificial signals of 500 samples and the 24 environmental pollution signals of 55 samples, respectively The experimental results show that the proposed methods has a fast and accurate selection performance. The proposed method has also respectively better performance than AP-MI estimation without the FP-ICA and regular partition MI estimation.

Visual Servo Navigation of a Mobile Robot Using Nonlinear Least Squares Optimization for Large Residual (비선형 최소 자승법을 이용한 이동 로봇의 비주얼 서보 네비게이션)

  • Kim, Gon-Woo;Nam, Kyung-Tae;Lee, Sang-Moo;Shon, Woong-Hee
    • The Journal of Korea Robotics Society
    • /
    • v.2 no.4
    • /
    • pp.327-333
    • /
    • 2007
  • We propose a navigation algorithm using image-based visual servoing utilizing a fixed camera. We define the mobile robot navigation problem as an unconstrained optimization problem to minimize the image error between the goal position and the position of a mobile robot. The residual function which is the image error between the position of a mobile robot and the goal position is generally large for this navigation problem. So, this navigation problem can be considered as the nonlinear least squares problem for the large residual case. For large residual, we propose a method to find the second-order term using the secant approximation method. The performance was evaluated using the simulation.

  • PDF

Feature Extraction of Images By Using Independent Component Analysis of Fixed-Point Algorithm Based on Secant Method (할선법에 기초한 고정점 학습알고리즘의 독립성분분석을 이용한 영상의 특징추출)

  • 조용현;민성재;김아람;오정은
    • Proceedings of the Korea Multimedia Society Conference
    • /
    • 2002.11b
    • /
    • pp.137-140
    • /
    • 2002
  • 본 연구에서는 할선법에 기초한 고정점 알고리즘의 독립성분분석기법을 이용한 영상의 특징추출을 제안하였다. 여기서 할선법은 엔트로피 최적화를 위한 목적함수의 근을 구하기 위해 단순히 함수 값만을 이용하여 계산을 간략하게 함으로써 역혼합행렬의 경신속도를 빠르게 하기 위함이다. 제안된 기법을 256×256 픽셀(pixel)의 10개 지문영상들로부터 선택된 16×16 픽셀의 20,000개 패치를 대상으로 시뮬레이션 한 결과. 추출된 16×16 픽셀의 160개 독립성분 기저벡터 각각은 지문영상들에 포함된 공간적인 주파수 특성과 방향성을 가지는 경계 특성이 잘 드러나는 국부적인 특징들임을 확인할 수 있었다.

  • PDF

Advanced Method for an Initial Pole Position Estimation of a PMLSM (PMLSM의 개선된 초기 자극위치 추정방법)

  • Lee Jin-Woo
    • Proceedings of the KIPE Conference
    • /
    • 2004.07a
    • /
    • pp.316-320
    • /
    • 2004
  • This paper presents an advanced method for an initial pole position estimation of a PMLSM (Permanent Magnet Linear Synchronous Motor) that has an incremental encoder for servo applications but does not have Hall sensors as a magnetic pole sensor. The proposed algorithm finds either of two zero force positions and then the correct d-axis by appropriately using the secant method as a numerical method. It only requires the tuned current controller and the relative position information and so it can be simply applicable to a rotary PMSM. The experimental results show the validity of the proposed method with respect to accurate pole position estimation under the minimal moving distance during estimation process.

  • PDF

A QUASI-NEWTON METHOD USING DIRECTIONAL DERIVATIVES FOR NONLINEAR EQUATIONS

  • Kim, Sun-Young
    • Communications of the Korean Mathematical Society
    • /
    • v.9 no.2
    • /
    • pp.491-502
    • /
    • 1994
  • Many problems arising in science and engineering require the numerical solution of a system of n nonlinear equations in n unknowns: (1) given F : $R^{n}$ $\rightarrow$ $R^{n}$ , find $x_{*}$ $\epsilon$ $R^{n}$ / such that F($x_{*}$) = 0. Nonlinear problems are generally solved by iteration. Davidson [3] and Broyden [1] introduced the methods which had led to a large amount of research and a class of algorithm. This work has been called by the quasi-Newton methods, secant updates, or modification methods. Newton's method is the classical method for the problem (1) and quasi-Newton methods have been proposed to circumvent computational disadvantages of Newton's method.(omitted)

  • PDF