• Title/Summary/Keyword: Trust region method

Search Result 45, Processing Time 0.046 seconds

The Aerodynamic Shape Optimization with Trust Region Methods (Trust Region 기법을 이용한 공력 형상 최적설계)

  • Lee, Jae-Hun;Jung, Kyung-Jin;Kwon, Jang-Hyuk
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2008.03b
    • /
    • pp.130-133
    • /
    • 2008
  • In this paper the trust region method is studied and applied in aerodynamic shape optimization. The trust region method is a gradient-based optimization method, but it is not as popular as other methods in engineering computations. Its theory will be explained for unconstrained optimization problems and a trust region subproblem will be solved with the dogleg method. After verifying the trust region method with analytical test problems, it is applied to aerodynamic shape design optimization and the performance of airfoil is improved successfully.

  • PDF

A TRUST REGION METHOD FOR SOLVING THE DECENTRALIZED STATIC OUTPUT FEEDBACK DESIGN PROBLEM

  • MOSTAFA EL-SAYED M.E.
    • Journal of applied mathematics & informatics
    • /
    • v.18 no.1_2
    • /
    • pp.1-23
    • /
    • 2005
  • The decentralized static output feedback design problem is considered. A constrained trust region method is developed that solves this optimal control problem when a complete set of state variables is not available. The considered problem is interpreted as a non-linear (non-convex) constrained matrix optimization problem. Then, a decentralized constrained trust region method is developed for this problem class exploiting the diagonal structure of the problem and using inexact computations. Finally, numerical results are given for the proposed method.

A Trust-Region ICA algorithm (Trust-Region ICA 알고리듬)

  • Park, Heeyoul;Kim, Sookjeong;Park, Seungjin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.721-723
    • /
    • 2004
  • A trust-region method is a quite attractive optimization technique. It is, in general, faster than the steepest descent method and is free of a learning rate unlike the gradient-based methods. In addition to its convergence property (between linear and quadratic convergence), ifs stability is always guaranteed, in contrast to the Newton's method. In this paper, we present an efficient implementation of the maximum likelihood independent component analysis (ICA) using the trust-region method, which leads to trust-region-based ICA (TR-ICA) algorithms. The useful behavior of our TR-ICA algorithms is confimed through numerical experimental results.

  • PDF

A LINE SEARCH TRUST REGION ALGORITHM AND ITS APPLICATION TO NONLINEAR PORTFOLIO PROBLEMS

  • Gu, Nengzhu;Zhao, Yan;Gao, Yan
    • Journal of applied mathematics & informatics
    • /
    • v.27 no.1_2
    • /
    • pp.233-243
    • /
    • 2009
  • This paper concerns an algorithm that combines line search and trust region step for nonlinear optimization problems. Unlike traditional trust region methods, we incorporate the Armijo line search technique into trust region method to solve the subproblem. In addition, the subproblem is solved accurately, but instead solved by inaccurate method. If a trial step is not accepted, our algorithm performs the Armijo line search from the failed point to find a suitable steplength. At each iteration, the subproblem is solved only one time. In contrast to interior methods, the optimal solution is derived by iterating from outside of the feasible region. In numerical experiment, we apply the algorithm to nonlinear portfolio optimization problems, primary numerical results are presented.

  • PDF

AN ADAPTIVE APPROACH OF CONIC TRUST-REGION METHOD FOR UNCONSTRAINED OPTIMIZATION PROBLEMS

  • FU JINHUA;SUN WENYU;SAMPAIO RAIMUNDO J. B. DE
    • Journal of applied mathematics & informatics
    • /
    • v.19 no.1_2
    • /
    • pp.165-177
    • /
    • 2005
  • In this paper, an adaptive trust region method based on the conic model for unconstrained optimization problems is proposed and analyzed. We establish the global and super linear convergence results of the method. Numerical tests are reported that confirm the efficiency of the new method.

A HYBRID METHOD FOR NCP WITH $P_0$ FUNCTIONS

  • Zhou, Qian;Ou, Yi-Gui
    • Journal of applied mathematics & informatics
    • /
    • v.29 no.3_4
    • /
    • pp.653-668
    • /
    • 2011
  • This paper presents a new hybrid method for solving nonlinear complementarity problems with $P_0$-functions. It can be regarded as a combination of smoothing trust region method with ODE-based method and line search technique. A feature of the proposed method is that at each iteration, a linear system is only solved once to obtain a trial step, thus avoiding solving a trust region subproblem. Another is that when a trial step is not accepted, the method does not resolve the linear system but generates an iterative point whose step-length is defined by a line search. Under some conditions, the method is proven to be globally and superlinearly convergent. Preliminary numerical results indicate that the proposed method is promising.

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM

  • Lee, Geunseop
    • Journal of the Korean Mathematical Society
    • /
    • v.54 no.2
    • /
    • pp.613-626
    • /
    • 2017
  • For the overdetermined linear system, when both the data matrix and the observed data are contaminated by noise, Total Least Squares method is an appropriate approach. Since an ill-conditioned data matrix with noise causes a large perturbation in the solution, some kind of regularization technique is required to filter out such noise. In this paper, we consider a Dual regularized Total Least Squares problem. Unlike the Tikhonov regularization which constrains the size of the solution, a Dual regularized Total Least Squares problem considers two constraints; one constrains the size of the error in the data matrix, the other constrains the size of the error in the observed data. Our method derives two nonlinear equations to construct the iterative method. However, since the Jacobian matrix of two nonlinear equations is not guaranteed to be nonsingular, we adopt a trust-region based iteration method to obtain the solution.

SOLVING NONLINEAR ASSET LIABILITY MANAGEMENT PROBLEMS WITH A PRIMAL-DUAL INTERIOR POINT NONMONOTONE TRUST REGION METHOD

  • Gu, Nengzhu;Zhao, Yan
    • Journal of applied mathematics & informatics
    • /
    • v.27 no.5_6
    • /
    • pp.981-1000
    • /
    • 2009
  • This paper considers asset liability management problems when their deterministic equivalent formulations are general nonlinear optimization problems. The presented approach uses a nonmonotone trust region strategy for solving a sequence of unconstrained subproblems parameterized by a scalar parameter. The objective function of each unconstrained subproblem is an augmented penalty-barrier function that involves both primal and dual variables. Each subproblem is solved approximately. The algorithm does not restrict a monotonic decrease of the objective function value at each iteration. If a trial step is not accepted, the algorithm performs a non monotone line search to find a new acceptable point instead of resolving the subproblem. We prove that the algorithm globally converges to a point satisfying the second-order necessary optimality conditions.

  • PDF

ON THE CONVERGENCE OF THE UOBYQA METHOD

  • Han, Lixing;Liu, Guanghui
    • Journal of applied mathematics & informatics
    • /
    • v.16 no.1_2
    • /
    • pp.125-142
    • /
    • 2004
  • We analyze the convergence properties of Powell's UOBYQA method. A distinguished feature of the method is its use of two trust region radii. We first study the convergence of the method when the objective function is quadratic. We then prove that it is globally convergent for general objective functions when the second trust region radius p converges to zero. This gives a justification for the use of p as a stopping criterion. Finally, we show that a variant of this method is superlinearly convergent when the objective function is strictly convex at the solution.

NUMERICAL METHDS USING TRUST-REGION APPROACH FOR SOLVING NONLINEAR ILL-POSED PROBLEMS

  • Kim, Sun-Young
    • Communications of the Korean Mathematical Society
    • /
    • v.11 no.4
    • /
    • pp.1147-1157
    • /
    • 1996
  • Nonlinear ill-posed problems arise in many application including parameter estimation and inverse scattering. We introduce a least squares regularization method to solve nonlinear ill-posed problems with constraints robustly and efficiently. The regularization method uses Trust-Region approach to handle the constraints on variables. The Generalized Cross Validation is used to choose the regularization parameter in computational tests. Numerical results are given to exhibit faster convergence of the method over other methods.

  • PDF