• 전기전자학회논문지
• /
• 제20권3호
• /
• pp.226-234
• /
• 2016

전기 저항 단층촬영법(ERT)은 대상체 내부 단면의 저항률 분포를 추정하고 이를 영상화하는 기술이다. ERT의 영상복원은 매우 비정치성이 강한 역문제의 일종으로 의미있는 영상을 얻기 위해서는 조정기법이 사용된다. 대표적으로 l2-norm 조정기법, l1-norm 조정기법, Total Variation 조정기법이 사용되며, 조정기법에 따라 ERT의 영상복원 성능이 달라진다. 즉, 상황에 맞는 적절한 조정기법의 사용은 ERT 영상 복원을 개선할 수 있다. 따라서, 본 논문에서는 모의실험을 통하여 상황에 따른 세 가지 조정기법의 영상복원 성능을 비교하였다.

• 한국통신학회논문지
• /
• 제32권11C호
• /
• pp.1073-1078
• /
• 2007

본 논문에서는 다중 정규화 매개 변수를 이용한 혼합 norm 영상 복원 방식을 제안한다. 임의의 분포를 갖는 첨가 노이즈를 효율적으로 제거하기 위해 정규화 완화 $l_2$ 함수와 정규화 완화 $l_4$ 함수를 결합한 새로운 혼합 norm 정규화 완화 함수가 유도된다. 각 완화 함수의 완화도를 제어하기 위해 개별적인 정규화 매개 변수가 정의되고, 정규화 완화 $l_2$ 함수와 정규화 완화 $l_4$ 함수의 상대적 기여도를 제어하기 위한 혼합 norm 정규화 매개 변수가 kurtosis를 이용해 정의된다. 안정적인 해를 얻기 위해 반복기법이 사용되었으며, 이들의 수렴 여부가 분석되었다. 다양한 분포를 갖는 첨가 노이즈가 실험에 사용되었으며, 이를 통해서 제안된 방식의 성능을 평가할 수 있었다.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2003년도 신호처리소사이어티 추계학술대회 논문집
• /
• pp.489-492
• /
• 2003

In this paper, we propose an iterative mixed norm image restoration algorithm using multi regularization parameters. A functional which combines the regularized l$_2$ norm functional and the regularized l$_4$ functional is proposed. The smoothness of each functional is determined by the regularization parameters. Also, a regularization parameter is used to determine the relative importance between the regularized l$_2$ functional and the regularized l$_4$ functional. An iterative algorithm is utilized for obtaining a solution and its convergence is analyzed.

• 한국전자통신학회논문지
• /
• 제17권1호
• /
• pp.41-48
• /
• 2022

본 논문은 통합 베이즈 티코노프 정규화 방법을 총변이 정규화에 대한 해법으로 제시한다. 통합된 방법은 총변이 항을 가중된 티코노프 정규화 항으로 변형하여 정규화 모수를 구하는 공식을 제시한다. 정규화 모수를 구하고 이를 바탕으로 새로운 가중인수를 구하는 것을 복원된 영상이 수렴하기까지 반복한다. 실험결과는 영상 복원 문제에 대하여 제안하는 방법의 효능을 보여준다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제12권7호
• /
• pp.3194-3216
• /
• 2018

Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

• 전기학회논문지
• /
• 제66권12호
• /
• pp.1772-1781
• /
• 2017

In this study, the design methodology for alleviating the overfitting problem of Polynomial Neural Networks(PNN) is realized with the aid of two kinds techniques such as L2 regularization and Sum of Squared Coefficients (SSC). The PNN is widely used as a kind of mathematical modeling methods such as the identification of linear system by input/output data and the regression analysis modeling method for prediction problem. PNN is an algorithm that obtains preferred network structure by generating consecutive layers as well as nodes by using a multivariate polynomial subexpression. It has much fewer nodes and more flexible adaptability than existing neural network algorithms. However, such algorithms lead to overfitting problems due to noise sensitivity as well as excessive trainning while generation of successive network layers. To alleviate such overfitting problem and also effectively design its ensuing deep network structure, two techniques are introduced. That is we use the two techniques of both SSC(Sum of Squared Coefficients) and $L_2$ regularization for consecutive generation of each layer's nodes as well as each layer in order to construct the deep PNN structure. The technique of $L_2$ regularization is used for the minimum coefficient estimation by adding penalty term to cost function. $L_2$ regularization is a kind of representative methods of reducing the influence of noise by flattening the solution space and also lessening coefficient size. The technique for the SSC is implemented for the minimization of Sum of Squared Coefficients of polynomial instead of using the square of errors. In the sequel, the overfitting problem of the deep PNN structure is stabilized by the proposed method. This study leads to the possibility of deep network structure design as well as big data processing and also the superiority of the network performance through experiments is shown.

• 전기전자학회논문지
• /
• 제20권2호
• /
• pp.152-162
• /
• 2016

전기 저항률 단층촬영법(ERT)은 표면 전극으로부터 측정된 전압을 사용하여 물체 내부의 임피던스 분포를 영상화하는 기술이다. ERT 역문제는 비정치성(ill-posedness)이 매우 심하여 영상복원의 수렴성을 확보하기 위해 조정방법이 사용된다. 사용된 조정방법에 따라 영상복원 성능이 달라지므로 상황에 따라 보다 강건한 영상 복원 성능을 얻기 위해, 서로 다른 영상복원 특성을 나타내는 L1-norm 조정방법과 Total Variation (TV) 조정방법의 두 개의 모드가 상호작용하는 상호작용 이중-모드 조정방법을 제안하였다. 제안한 이중-모드 조정방법은 실제 상황에 따라 달라지는 모드 확률을 계산하고 이에 근거하여 적합한 모드를 선택하거나 두 개의 모드를 결합한다. 모의실험을 수행하여 제안된 기법의 영상 복원 성능을 평가한 결과 비교적 양호한 성능을 나타내었다.

• Structural Engineering and Mechanics
• /
• 제75권4호
• /
• pp.477-485
• /
• 2020

Finite element (FE) model based structural damage detection (SDD) methods play vital roles in effectively locating and quantifying structural damages. Among these methods, structural model updating should be conducted before SDD to obtain benchmark models of real structures. However, the characteristics of updating parameters are not reasonably considered in existing studies. Inspired by the l_∞ norm regularization, a novel anti-sparse representation method is proposed for structural model updating in this study. Based on sensitivity analysis, both frequencies and mode shapes are used to define an objective function at first. Then, by adding l_∞ norm penalty, an optimization problem is established for structural model updating. As a result, the optimization problem can be solved by the fast iterative shrinkage thresholding algorithm (FISTA). Moreover, comparative studies with classical regularization strategy, i.e. the l₂ norm regularization method, are conducted as well. To intuitively illustrate the effectiveness of the proposed method, a 2-DOF spring-mass model is taken as an example in numerical simulations. The updating results show that the proposed method has a good robustness to measurement noises. Finally, to further verify the applicability of the proposed method, a six-storey aluminum alloy frame is designed and fabricated in laboratory. The added mass on each storey is taken as updating parameter. The updating results provide a good agreement with the true values, which indicates that the proposed method can effectively update the model parameters with a high accuracy.

• 산업공학
• /
• 제24권2호
• /
• pp.151-155
• /
• 2011

In this study, we propose a signomial classification method with ₀-regularization (₀-)which seeks a sparse signomial function by solving a mixed-integer program to minimize the weighted sum of the ₀-norm of the coefficient vector of the resulting function and the $L_1$-norm of loss caused by the function. $SC_0$ gives an explicit description of the resulting function with a small number of terms in the original input space, which can be used for prediction purposes as well as interpretation purposes. We present a practical implementation of $SC_0$ based on the mixed-integer programming and the column generation procedure previously proposed for the signomial classification method with $SL_1$-regularization. Computational study shows that $SC_0$ gives competitive performance compared to other widely used learning methods for classification.

• Journal of Electrical Engineering and Technology
• /
• 제13권4호
• /
• pp.1724-1731
• /
• 2018

The conventional polynomial neural network (PNN) is a classical flexible neural structure and self-organizing network, however it is not free from the limitation of overfitting problem. In this study, we propose a space search-optimized polynomial neural network (ssPNN) structure to alleviate this problem. Ranking selection is realized by means of ranking selection-based performance index (RS_PI) which is combined with conventional performance index (PI) and coefficients based performance index (CPI) (viz. the sum of squared coefficient). Unlike the conventional PNN, L2-norm regularization method for estimating the polynomial coefficients is also used when designing the ssPNN. Furthermore, space search optimization (SSO) is exploited here to optimize the parameters of ssPNN (viz. the number of input variables, which variables will be selected as input variables, and the type of polynomial). Experimental results show that the proposed ranking selection-based polynomial neural network gives rise to better performance in comparison with the neuron fuzzy models reported in the literatures.