• Communications for Statistical Applications and Methods
• /
• 제24권6호
• /
• pp.673-683
• /
• 2017

The least absolute shrinkage and selection operator (LASSO) has been a popular regression estimator with simultaneous variable selection. However, LASSO does not have the oracle property and its robust version is needed in the case of heavy-tailed errors or serious outliers. We propose a robust penalized regression estimator which provide a simultaneous variable selection and estimator. It is based on the rank regression and the non-convex penalty function, the smoothly clipped absolute deviation (SCAD) function which has the oracle property. The proposed method combines the robustness of the rank regression and the oracle property of the SCAD penalty. We develop an efficient algorithm to compute the proposed estimator that includes a SCAD estimate based on the local linear approximation and the tuning parameter of the penalty function. Our estimate can be obtained by the least absolute deviation method. We used an optimal tuning parameter based on the Bayesian information criterion and the cross validation method. Numerical simulation shows that the proposed estimator is robust and effective to analyze contaminated data.

• 한국멀티미디어학회논문지
• /
• 제24권1호
• /
• pp.13-20
• /
• 2021

A Wasserstein GAN(WGAN), optimum in terms of minimizing Wasserstein distance, still suffers from inconsistent convergence or unexpected output due to inherent learning instability. It is widely known some kinds of restriction on the discriminative function should be considered to solve such problems, which implies the importance of Lipschitz continuity. Unfortunately, there are few known methods to satisfactorily maintain the Lipschitz continuity of the discriminative function. In this paper we propose techniques to stably maintain the Lipschitz continuity of the discriminative function by adding effective regularization terms to the objective function, which limit the magnitude of the gradient vectors of the discriminator to one or less. Extensive experiments are conducted to evaluate the performance of the proposed techniques, which shows the single-sided penalty improves convergence compared with the gradient penalty at the early learning process, while the proposed additional penalty increases inception scores by 0.18 after 100,000 number of learning.

• 산업경영시스템학회지
• /
• 제16권27호
• /
• pp.91-104
• /
• 1993

This paper is concerned with flow shop scheduling problems having the common due date. V-shape property is used for algorithms with early and tardy penalty cost. The objective of this paper is developing efficient heuristic scheduling algorithms for minimizing total penalty cost function and determining the optimal common due date. The between job delay and the work in process are considered for developing algorithms as penalty cost. Algorithms is simulated to analyze interrelated factors. A numerical example is given for illustrating the proposed algorithms.

• Journal of applied mathematics & informatics
• /
• 제29권5_6호
• /
• pp.1533-1539
• /
• 2011

In this paper, a class of nonlinear bilevel programs, i.e. the lower level problem is linear programs, is considered. Aiming at this special structure, we append the duality gap of the lower level problem to the upper level objective with a penalty and obtain a penalized problem. Using the penalty method, we give an existence theorem of solution and propose an algorithm. Then, a numerical example is given to illustrate the algorithm.

• 한국통계학회:학술대회논문집
• /
• 한국통계학회 2003년도 춘계 학술발표회 논문집
• /
• pp.151-156
• /
• 2003

Variable selection algorithm for principal component analysis using penalized likelihood method is proposed. We will adopt a probabilistic principal component idea to utilize likelihood function for the problem and use HARD penalty function to force coefficients of any irrelevant variables for each component to zero. Consistency and sparsity of coefficient estimates will be provided with results of small simulated and illustrative real examples.

• Communications for Statistical Applications and Methods
• /
• 제22권2호
• /
• pp.147-157
• /
• 2015

We consider a sparse high-dimensional linear regression model. Penalized methods using LASSO or non-convex penalties have been widely used for variable selection and estimation in high-dimensional regression models. In penalized regression, the selection and prediction performances depend on which penalty function is used. For example, it is known that LASSO has a good prediction performance but tends to select more variables than necessary. In this paper, we propose an additive sparse penalty for variable selection using a combination of LASSO and minimax concave penalties (MCP). The proposed penalty is designed for good properties of both LASSO and MCP.We develop an efficient algorithm to compute the proposed estimator by combining a concave convex procedure and coordinate descent algorithm. Numerical studies show that the proposed method has better selection and prediction performances compared to other penalized methods.

• 대한전기학회논문지:시스템및제어부문D
• /
• 제53권11호
• /
• pp.747-752
• /
• 2004

This paper presents an iterative linear matrix inequality (LMI) approach to the design of a static output feedback (SOF) stabilization controller. A linear penalty function is incorporated into the objective function for the non-convex rank constraint so that minimizing the penalized objective function subject to LMIs amounts to a convex optimization problem. Hence, the overall procedure results in solving a series of semidefinite programs (SDPs). With an increasing sequence of the penalty parameter, the solution of the penalized optimization problem moves towards the feasible region of the original non-convex problem. The proposed algorithm is, therefore, convergent. Extensive numerical experiments are Deformed to illustrate the proposed algorithm.

• 대한전기학회논문지:전력기술부문A
• /
• 제53권12호
• /
• pp.655-660
• /
• 2004

This paper deals with the design of a fixed-structure $H_\infty$ power system stabilizer (PSS) by using an iterative linear matrix inequality (LMI) method. The fixed-structure $H_\infty$ controller is represented in terms of LMIs with a rank condition. To solve the non-convex rank-constrained LMI problem, a linear penalty function is incorporated into the objective function so that minimizing the penalized objective function subject to LMIs amounts to a convex optimization problem. With an increasing sequence of the penalty parameter, the solution of the penalized optimization problem moves towards the feasible region of the original non-convex problem. The proposed algorithm is, therefore, convergent. Numerical experiments show the practical applicability of the proposed algorithm.

• 한국소음진동공학회논문집
• /
• 제15권11호
• /
• pp.1255-1261
• /
• 2005

The dynamic contact model of a beam that contacts to a rigid wall in a reactor core was studied. The gap between the beam and contact wall results in dynamic contact accompanying inequality constraints. The inequality constraints can be relieved to an equality constraint problem by introducing a convex Penalty function. In this work, a beam with contact condition is formulated using quasi-convex penalty function and numerically solved. General coordinate solution is adopted to raise computational efficiency. Also nonlinearity is examined In the beam contacting to a rigid wall.

• Geomechanics and Engineering
• /
• 제15권4호
• /
• pp.947-955
• /
• 2018

In this study, we propose a three-dimensional simplified slope stability analysis using a hybrid-type penalty method (HPM). In this method, a solid element obtained by the HPM is applied to a column that divides the slope into a lattice. Therefore, it can obtain a safety factor in the same way as simplified methods on the slip surface. Furthermore, it can obtain results (displacement and strain) that cannot be obtained by conventional limit equilibrium methods such as the Hovland method. The continuity condition of displacement between adjacent columns and between elements for each depth is considered to incorporate a penalty function and the relative displacement. For a slip surface between the bottom surface and the boundary condition to express the slip of slope, we introduce a penalty function based on the Mohr-Coulomb failure criterion. To compute the state of the slip surface, an r-min method is used in the load incremental method. Using the result of the simple three-dimensional slope stability analysis, we obtain a safety factor that is the same as the conventional method. Furthermore, the movement of the slope was calculated quantitatively and qualitatively because the displacement and strain of each element are obtained.