• Journal of Mechanical Science and Technology
• /
• 제15권7호
• /
• pp.876-888
• /
• 2001

For a large scaled optimization based on response surface methods, an efficient quadratic approximation method is presented in the context of the trust region model management strategy. If the number of design variables is η, the proposed method requires only 2η+1 design points for one approximation, which are a center point and tow additional axial points within a systematically adjusted trust region. These design points are used to uniquely determine the main effect terms such as the linear and quadratic regression coefficients. A quasi-Newton formula then uses these linear and quadratic coefficients to progressively update the two-factor interaction effect terms as the sequential approximate optimization progresses. In order to show the numerical performance of the proposed method, a typical unconstrained optimization problem and two dynamic response optimization problems with multiple objective are solved. Finally, their optimization results compared with those of the central composite designs (CCD) or the over-determined D-optimality criterion show that the proposed method gives more efficient results than others.

• Communications for Statistical Applications and Methods
• /
• 제27권1호
• /
• pp.129-140
• /
• 2020

In this paper, we introduce an efficient algorithm for the non-convex penalized multinomial logistic regression that can be uniformly applied to a class of non-convex penalties. The class includes most non-convex penalties such as the smoothly clipped absolute deviation, minimax concave and bridge penalties. The algorithm is developed based on the concave-convex procedure and modified local quadratic approximation algorithm. However, usual quadratic approximation may slow down computational speed since the dimension of the Hessian matrix depends on the number of categories of the output variable. For this issue, we use a uniform bound of the Hessian matrix in the quadratic approximation. The algorithm is available from the R package ncpen developed by the authors. Numerical studies via simulations and real data sets are provided for illustration.

• Journal of Mechanical Science and Technology
• /
• 제15권9호
• /
• pp.1257-1267
• /
• 2001

For efficient mechanical system optimization, a new two-point approximation method is presented. Unlike the conventional two-point approximation methods such as TPEA, TANA, TANA-1, TANA-2 and TANA-3, this introduces the shifting level into each exponential intervening variable to avoid the lack of definition of the conventional exponential intervening variables due to zero-or negative-valued design variables. Then a new quadratic approximation whose Hessian matrix has only diagonal elements of different values is proposed in terms of these shifted exponential intervening variables. These diagonal elements are determined in a closed form that corrects the typical error in the approximate gradient of the TANA series due to the lack of definition of exponential type intervening variables and their incomplete second-order terms. Also, a correction coefficient is multiplied to the pre-determined quadratic term to match the value of approximate function with that of the previous point. Finally, in order to show the numerical performance of the proposed method, a sequential approximate optimizer is developed and applied to solve six typical design problems. These optimization results are compared with those of TANA-3. These comparisons show that the proposed method gives more efficient and reliable results than TANA-3.

• 한국공작기계학회:학술대회논문집
• /
• 한국공작기계학회 1999년도 추계학술대회 논문집 - 한국공작기계학회
• /
• pp.419-424
• /
• 1999

In this paper, the comparison of the first order approximation schemes such as SLP (sequential linear programming), CONLIN(convex linearization), MMA(method of moving asymptotes) and the second order approximation scheme, SQP(sequential quadratic programming) was accomplished for optimization of and nonlinear structures. It was found that MMA and SQP(sequential quadratic programming) was accomplished for optimization of and nonlinear structures. It was found that MMA and SQP are the most efficient methods for optimization. But the number of function call of SQP is much more than that of MMA. Therefore, when it is considered with the expense of computation, MMA is more efficient than SQP. In order to examine the efficiency of MMA for complex optimization problem, it was applied to the helicopter tail boom considering column buckling and local wall buckling constraints. It is concluded that MMA can be a very efficient approximation scheme from simple problems to complex problems.

• 대한기계학회논문집A
• /
• 제24권12호
• /
• pp.3040-3052
• /
• 2000

For effective construction of second-order response surface models, an efficient quad ratic approximation method is proposed in the context of trust region model management strategy. In the proposed method, although only the linear and quadratic terms are uniquely determined using 2n+1 design points, the two-factor interaction terms are mathematically updated by normalized quasi-Newton formula. In order to show the numerical performance of the proposed approximation method, a sequential approximate optimizer is developed and solves a typical unconstrained optimization problem having 2, 6, 10, 15, 30 and 50 design variables, a gear reducer system design problem and two dynamic response optimization problems with multiple objectives, five objectives for one and two objectives for the other. Finally, their optimization results are compared with those of the CCD or the 50% over-determined D-optimal design combined with the same trust region sequential approximate optimizer. These comparisons show that the proposed method gives more efficient than others.

• 대한기계학회논문집A
• /
• 제26권12호
• /
• pp.2483-2491
• /
• 2002

This study presents an efficient method for robust optimal design. In order to avoid the excessive evaluations of the exact performance functions, two-point diagonal quadratic approximation method is employed for approximating them during optimization process. This approximation method is one of the two point approximation methods. Therefore, the second order sensitivity information of the approximated performance functions are calculated by an analytical method. As a result, this enables one to avoid the expensive evaluations of the exact $2^{nd}$ derivatives of the performance functions unlike the conventional robust optimal design methods based on the gradient information. Finally, in order to show the numerical performance of the proposed method, one mathematical problem and two mechanical design problems are solved and their results are compared with those of the conventional methods.

• 대한기계학회:학술대회논문집
• /
• 대한기계학회 2001년도 춘계학술대회논문집C
• /
• pp.386-391
• /
• 2001

This paper presents a new two-point approximation method based on the exponential intervening variable. To avoid the lack of definition of the conventional exponential intervening variables due to zero- or negative-valued design variables the shifting level into each exponential intervening variable is introduced. Then a new quadratic approximation, whose Hessian matrix has only diagonal elements of different values, is proposed in terms of these intervening variables. These diagonal elements are computed in a closed form, which correct the typical error in the approximate gradient of the TANA series due to the lack of definition of exponential type intervening variables and their incomplete second-order terms. Also, a correction coefficient is multiplied to the pre-determined quadratic term to match the value of approximate function with that of the original function at the previous point. Finally, the authors developed a sequential approximate optimizer, solved several typical design problems used in the literature and compared these optimization results with those of TANA-3. These comparisons show that the proposed method gives more efficient and reliable results than TANA-3.

• 대한기계학회논문집A
• /
• 제25권9호
• /
• pp.1423-1431
• /
• 2001

Based on the exponential intervening variable, a new two-point approximation method is presented. This introduces the shifting level into each exponential intervening variable to avoid the lack of def inition of the conventional exponential intervening variables due to zero-or negative-valued design variables. Then a new quadratic approximation whose Hessian matrix has only diagonal elements of different values is proposed in terms of these intervening variables. These diagonal elements are determined in a closed form that corrects the typical error in the approximate gradient of the TANA series due to the lack of definition of exponential type intervening variables and their incomplete second-order terms. Also, a correction coefficient is multiplied to the pre-determined quadratic term to match the value of approximate function with that of the previous point. Finally, in order to show the numerical performance of the proposed method, a sequential approximate optimizer is developed and applied to solve six typical design problems. These optimization results are compared with those of TANA-3. These comparisons show that the proposed method gives more efficient and reliable results than TANA-3.

• 대한수학회보
• /
• 제42권4호
• /
• pp.837-849
• /
• 2005

In this paper, we obtain a successive quadratic programming algorithm for solving the semidefinite programming (SDP) relaxation of the binary quadratic programming. Combining with a randomized method of Goemans and Williamson, it provides an efficient approximation for the binary quadratic programming. Furthermore, its convergence result is given. At last, We report some numerical examples to compare our method with the interior-point method on Maxcut problem.

• 대한기계학회논문집
• /
• 제19권2호
• /
• pp.433-442
• /
• 1995

For the line search of a multi-variable optimization, an efficient algorithm is presented. The algorithm sequentially employs several polynomial approximations such as 2-point quadratic interpolation, 3-point cubic interpolation/extrapolation and 4-point cubic interpolation/extrapolation. The order of polynomial function is automatically increased for improving the accuracy of approximation. The method of approximation (interpolation or extrapolation) is automatically switched by checking the slope information of the sample points. Also, for selecting the initial step length along the descent vector, a new approach is presented. The performance of the proposed method is examined by solving typical test problems such as mathematical problems, mechanical design problems and dynamic response problems.