• Title/Summary/Keyword: BFGS method

Search Result 49, Processing Time 0.023 seconds

MODIFIED LIMITED MEMORY BFGS METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION

  • Yuan, Gonglin;Wei, Zengxin;Wu, Yanlin
    • Journal of the Korean Mathematical Society
    • /
    • v.47 no.4
    • /
    • pp.767-788
    • /
    • 2010
  • In this paper, we propose two limited memory BFGS algorithms with a nonmonotone line search technique for unconstrained optimization problems. The global convergence of the given methods will be established under suitable conditions. Numerical results show that the presented algorithms are more competitive than the normal BFGS method.

GLOBAL CONVERGENCE PROPERTIES OF TWO MODIFIED BFGS-TYPE METHODS

  • Guo, Qiang;Liu, Jian-Guo
    • Journal of applied mathematics & informatics
    • /
    • v.23 no.1_2
    • /
    • pp.311-319
    • /
    • 2007
  • This article studies a modified BFGS algorithm for solving smooth unconstrained strongly convex minimization problem. The modified BFGS method is based on the new quasi-Newton equation $B_k+1{^s}_k=yk\;where\;y_k^*=yk+A_ks_k\;and\;A_k$ is a matrix. Wei, Li and Qi [WLQ] have proven that the average performance of two of those algorithms is better than that of the classical one. In this paper, we prove the global convergence of these algorithms associated to a general line search rule.

A MODIFIED BFGS BUNDLE ALGORITHM BASED ON APPROXIMATE SUBGRADIENTS

  • Guo, Qiang;Liu, Jian-Guo
    • Journal of applied mathematics & informatics
    • /
    • v.28 no.5_6
    • /
    • pp.1239-1248
    • /
    • 2010
  • In this paper, an implementable BFGS bundle algorithm for solving a nonsmooth convex optimization problem is presented. The typical method minimizes an approximate Moreau-Yosida regularization using a BFGS algorithm with inexact function and the approximate gradient values which are generated by a finite inner bundle algorithm. The approximate subgradient of the objective function is used in the algorithm, which can make the algorithm easier to implement. The convergence property of the algorithm is proved under some additional assumptions.

An Application of ALM-BFGS Algorithm for the Optimum Section Design of Composite Breakwaters (ALM-BFGS 알고리즘을 이용한 혼성방파제의 최적단면설계에 관한 연구)

  • Seo, Kyung Min;Ryu, Yeon Sun;Ryu, Cheong Ro
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.12 no.1
    • /
    • pp.197-205
    • /
    • 1992
  • For the optimal design of composite breakwaters, a computer program PROCOBRA is developed using the combined ALM-BFGS algorithm. A model formulation for the section design optimization problem of composite breakwaters is proposed where a concept of subsectional weighting factors is introduced in the objective function. Usability of the program is verified through a numerical example. From the study, it is found that the ALM-BFGS method is reliable and can be effectively applied for the design optimization of coastal structures. Compared with conventional design process, it is proved that the economical design of composite breakwaters is possible.

  • PDF

GLOBAL CONVERGENCE PROPERTIES OF THE MODIFIED BFGS METHOD ASSOCIATING WITH GENERAL LINE SEARCH MODEL

  • Liu, Jian-Guo;Guo, Qiang
    • Journal of applied mathematics & informatics
    • /
    • v.16 no.1_2
    • /
    • pp.195-205
    • /
    • 2004
  • To the unconstrained programme of non-convex function, this article give a modified BFGS algorithm. The idea of the algorithm is to modify the approximate Hessian matrix for obtaining the descent direction and guaranteeing the efficacious of the quasi-Newton iteration pattern. We prove the global convergence properties of the algorithm associating with the general form of line search, and prove the quadratic convergence rate of the algorithm under some conditions.

A Modified BFGS Method with Substructuring for the Nonlinear Structural Analysis (비선형 구조해석에서 부분구조를 이용한 수정 BFGS법)

  • Yeon-Sun,Ryu;Gil-Su,Yoon
    • Bulletin of the Society of Naval Architects of Korea
    • /
    • v.23 no.3
    • /
    • pp.39-44
    • /
    • 1986
  • The basic BFGS procedure for the nonlinear finite element analysis is reviewed. Through a simple numerical example, promising characteristics of the method evaluated discussed. Based on the discussion of computational performance, a modified BFGS algorithm with substructuring is derived and proposed for the quasi-static analysis of large-scale nonlinear structures.

  • PDF

A TYPE OF MODIFIED BFGS ALGORITHM WITH ANY RANK DEFECTS AND THE LOCAL Q-SUPERLINEAR CONVERGENCE PROPERTIES

  • Ge Ren-Dong;Xia Zun-Quan;Qiang Guo
    • Journal of applied mathematics & informatics
    • /
    • v.22 no.1_2
    • /
    • pp.193-208
    • /
    • 2006
  • A modified BFGS algorithm for solving the unconstrained optimization, whose Hessian matrix at the minimum point of the convex function is of rank defects, is presented in this paper. The main idea of the algorithm is first to add a modified term to the convex function for obtain an equivalent model, then simply the model to get the modified BFGS algorithm. The superlinear convergence property of the algorithm is proved in this paper. To compared with the Tensor algorithms presented by R. B. Schnabel (seing [4],[5]), this method is more efficient for solving singular unconstrained optimization in computing amount and complication.

THE PERFORMANCE OF A MODIFIED ARMIJO LINE SEARCH RULE IN BFGS OPTIMIZATION METHOD

  • Kim, MinSu;Kwon, SunJoo;Oh, SeYoung
    • Journal of the Chungcheong Mathematical Society
    • /
    • v.21 no.1
    • /
    • pp.117-127
    • /
    • 2008
  • The performance of a modified Armijo line search rule related to BFGS gradient type method with the results from other well-known line search rules are compared as well as analyzed. Although the modified Armijo rule does require as much computational cost as the other rules, it shows more efficient in finding local minima of unconstrained optimization problems. The sensitivity of the parameters used in the line search rules is also analyzed. The results obtained by implementing algorithms in Matlab for the test problems in [3] are presented.

  • PDF

GLOBAL CONVERGENCE OF A MODIFIED BFGS-TYPE METHOD FOR UNCONSTRAINED NON-CONVEX MINIMIZATION

  • Guo, Qiang;Liu, Jian-Guo
    • Journal of applied mathematics & informatics
    • /
    • v.24 no.1_2
    • /
    • pp.325-331
    • /
    • 2007
  • To the unconstrained programme of non-convex function, this article give a modified BFGS algorithm associated with the general line search model. The idea of the algorithm is to modify the approximate Hessian matrix for obtaining the descent direction and guaranteeing the efficacious of the new quasi-Newton iteration equation $B_{k+1}s_k=y^*_k,\;where\;y^*_k$ is the sum of $y_k\;and\;A_ks_k,\;and\;A_k$ is some matrix. The global convergence properties of the algorithm associating with the general form of line search is proved.

Optimal Directivity Synthesis of Ultrasonic Transducers Using a Combined Algorithm (조합 알고리즘에 의한 초음파 트랜스듀서의 최적 지향성합성)

  • ;Takao Tsuchiya;Yukio Kagawa
    • The Journal of the Acoustical Society of Korea
    • /
    • v.19 no.1
    • /
    • pp.25-31
    • /
    • 2000
  • In this paper, we proposed an algorithm that used a direct method to set an initial value of Broydon-Fletcher-Goldfarb-Shanno(BFGS) method and, accordingly, conducted an experiment in optimal directivity synthesis of adaptive ultrasonic transducer by point source array. To certify the efficiency of this method, quasi-ideal beam with arbitrary beam width, rotating beam, and multi beam, all with the limited side lobe level -30dB, were chosen to check the problem of directivity synthesis that was formed by point source array in the second dimensional sound field. The numerical calculation results showed that the proposed method performed the directivity synthesis faster than the BFGS method did. In addition, the proposed method showed a good error correction for directivity synthesis, and did not demand the choice of initial value. Finally, it is also shown that the proposed method can be used for the adaptive control that was not possible with the direct method alone.

  • PDF