• Communications for Statistical Applications and Methods
• /
• 제29권5호
• /
• pp.591-601
• /
• 2022

In gene set analysis with microarray expression data, a group of genes such as a gene regulatory pathway and a signaling pathway is often tested if there exists either differentially expressed (DE) or differentially co-expressed (DC) genes between two biological conditions. Recently, a statistical test based on covariance estimation have been proposed in order to identify DC genes. In particular, covariance regularization by hard thresholding indeed improved the power of the test when the proportion of DC genes within a biological pathway is relatively small. In this article, we compare covariance thresholding methods using four different regularization penalties such as lasso, hard, smoothly clipped absolute deviation (SCAD), and minimax concave plus (MCP) penalties. In our extensive simulation studies, we found that both SCAD and MCP thresholding methods can outperform the hard thresholding method when the proportion of DC genes is extremely small and the number of genes in a biological pathway is much greater than a sample size. We also applied four thresholding methods to 3 different microarray gene expression data sets related with mutant p53 transcriptional activity, and epithelium and stroma breast cancer to compare genetic pathways identified by each method.

• 한국통신학회논문지
• /
• 제25권9B호
• /
• pp.1588-1595
• /
• 2000

렌즈의 초점이 맞지 않아 흐려지고 잡음으로 훼손된 영상을 복원하는 경우에 일반적으로 정칙화 반복복원방법이 사용된다. 기존의 방법은 영상의 국부적인 특성을 고려하지 않고 영상전체에 일률적으로 정칙화를 행함으로써 윤곽부분에서는 리플잡음을 초래하고 평면부분에서도 잡음증폭을 피할 수 없으며, 또한 시각적으로 효율적이지 못한 면이 있다. 이러한 문제점을 개선하기 위하여, 본 논문에서는 영상을 방향이 없는 평면영역과 4가지 방향을 갖는 윤곽영역으로 나누어, 윤곽방향을 고려한 방향성 정칙화 연산자를 사용하여 평면영역과 윤곽영역의 방향특성에 따라 적응적으로 처리하는 반복복원방법을 제안한다. 제안한 방법은 기존의 방법과 비교하여 평면영역에서의 잡음 평활화가 개선되고 시각적으로 중요한 윤곽부분의 리플잡음을 억제함으로써 윤곽부분 복원에 효율적임을 실험결과를 통해 알 수 있었으며 ISNR 변에서도 우수하였다.

• 한국음향학회지
• /
• 제42권4호
• /
• pp.364-369
• /
• 2023

두 개 수신기에 들어오는 신호 간의 시간 지연 추정 기술은 수중 음향 뿐만 아니라 실내 음향 및 로보틱스에 이르기까지 다양한 분야에서 응용되고 있는 기술이다. 시간 지연 추정 기술에는 수신기 사이 상호 상관으로부터 시간 지연량을 추정하는 방법이 한 기술 부류이고, 수신기 사이의 시간 지연을 파라메트릭 모델링을 하여 그 파라미터를 시스템 인식의 방법으로 추정하는 기술 부류가 있다. 두 부류 중 후자의 경우 시스템의 파라미터 중에서 지연과 직접 관련 있는 파라미터는 전체 중 극히 일부라는 특성이 있다. 이 특성을 이용하여 Lasso 정규화 같은 방법으로 추정 정확도를 높이기도 한다. 그러나 Lasso 정규화의 경우 필요한 정보가 소실되는 경우가 발생한다. 본 논문에서는 이를 보완하기 위해서 Lasso 정규화에 Ridge 정규화를 덧붙인 Elastic Net을 사용한 방법을 제안한다. 제안한 방법을 기존의 일반 상호 상관(Generalized Cross Correlation, GCC) 방법 및 Lasso 정규화를 사용한 방법과 비교하여, 백색 가우시안 신호원 및 유색 신호원에서도 추정 오차가 매우 적음을 보인다.

• Structural Engineering and Mechanics
• /
• 제75권4호
• /
• pp.477-485
• /
• 2020

Finite element (FE) model based structural damage detection (SDD) methods play vital roles in effectively locating and quantifying structural damages. Among these methods, structural model updating should be conducted before SDD to obtain benchmark models of real structures. However, the characteristics of updating parameters are not reasonably considered in existing studies. Inspired by the l_∞ norm regularization, a novel anti-sparse representation method is proposed for structural model updating in this study. Based on sensitivity analysis, both frequencies and mode shapes are used to define an objective function at first. Then, by adding l_∞ norm penalty, an optimization problem is established for structural model updating. As a result, the optimization problem can be solved by the fast iterative shrinkage thresholding algorithm (FISTA). Moreover, comparative studies with classical regularization strategy, i.e. the l₂ norm regularization method, are conducted as well. To intuitively illustrate the effectiveness of the proposed method, a 2-DOF spring-mass model is taken as an example in numerical simulations. The updating results show that the proposed method has a good robustness to measurement noises. Finally, to further verify the applicability of the proposed method, a six-storey aluminum alloy frame is designed and fabricated in laboratory. The added mass on each storey is taken as updating parameter. The updating results provide a good agreement with the true values, which indicates that the proposed method can effectively update the model parameters with a high accuracy.

• 정보처리학회논문지B
• /
• 제16B권1호
• /
• pp.1-6
• /
• 2009

움직임에 의해 흐려지고 잡음으로 훼손된 영상을 복원하는 것은 매우 어렵다. 기존의 방법들은 영상의 국부적인 특성을 고려하지 않고 영상 전체에 일률적으로 복원처리를 행함으로써 윤곽부분에서 리플잡음을 초래하고 평면부분에서도 잡음증폭을 피할 수 없다. 이러한 문제점을 개선하기 위하여, 본 논문에서는 윤곽방향을 고려한 방향성 정칙화 연산자를 사용하여 적응적으로 처리되는 반복 정칙화 방법을 제안한다. 그것과 더불어 적응 정칙화 파라메타와 이완 파라메타를 적용하는 알고리즘도 함께 제안한다. 결론적으로, 이 방법은 기존의 방법과 비교할 때, 평면부분에서 잡음증폭을 억제하고, 시각적으로 중요한 윤곽부분의 리플잡음을 억제함으로써 윤곽부분 복원에 더욱 효율적임을 실험을 통하여 확인할 수 있었으며 또한 ISNR 면에서도 우수하였다는 것을 확인할 수 있다.

• 전기학회논문지
• /
• 제66권12호
• /
• pp.1772-1781
• /
• 2017

In this study, the design methodology for alleviating the overfitting problem of Polynomial Neural Networks(PNN) is realized with the aid of two kinds techniques such as L2 regularization and Sum of Squared Coefficients (SSC). The PNN is widely used as a kind of mathematical modeling methods such as the identification of linear system by input/output data and the regression analysis modeling method for prediction problem. PNN is an algorithm that obtains preferred network structure by generating consecutive layers as well as nodes by using a multivariate polynomial subexpression. It has much fewer nodes and more flexible adaptability than existing neural network algorithms. However, such algorithms lead to overfitting problems due to noise sensitivity as well as excessive trainning while generation of successive network layers. To alleviate such overfitting problem and also effectively design its ensuing deep network structure, two techniques are introduced. That is we use the two techniques of both SSC(Sum of Squared Coefficients) and $L_2$ regularization for consecutive generation of each layer's nodes as well as each layer in order to construct the deep PNN structure. The technique of $L_2$ regularization is used for the minimum coefficient estimation by adding penalty term to cost function. $L_2$ regularization is a kind of representative methods of reducing the influence of noise by flattening the solution space and also lessening coefficient size. The technique for the SSC is implemented for the minimization of Sum of Squared Coefficients of polynomial instead of using the square of errors. In the sequel, the overfitting problem of the deep PNN structure is stabilized by the proposed method. This study leads to the possibility of deep network structure design as well as big data processing and also the superiority of the network performance through experiments is shown.

• 전기전자학회논문지
• /
• 제18권2호
• /
• pp.272-281
• /
• 2014

전기 임피던스 단층촬영법을 이용한 정적 영상 복원에서 대표적으로 사용되고 있는 복원 알고리즘은 modified Newton-Raphson(mNR) 알고리즘으로 수렴 속도 및 추정 정확도 측면에서 비교적 다른 알고리즘들에 비해 좋은 성능을 나타낸다. mNR 알고리즘에서는 측정 전압과 계산 전압과의 차이, 즉 잔류오차를 최소화하도록 목적함수를 설정하고 이를 반복 연산하여 내부의 저항률 분포를 추정한다. 이때 EIT 역문제의 비정치성을 완화시키기 위해 조정방법을 사용하며 조정인자에 따라 서로 다른 영상 복원 성능을 나타낸다. 기존 기법에서는 반복 연산마다 일정한 상수 값의 조정인자를 사용하기 때문에 대상 물체의 내부 상태가 변하거나 측정 잡음 등이 있는 경우 때때로 조정인자에 따라 영상 복원이 수렴되지 않는다. 따라서 본 논문에서는 영상 복원 수렴 및 성능을 개선하기 위하여 잔류오차에 기반하여 반복 연산마다 자동적으로 조정인자를 수정하는 기법을 제안하였다. 시뮬레이션과 실험을 수행하여 제안된 기법의 영상 복원성능을 평가한 결과 비교적 양호한 성능을 나타내었다.

• Computers and Concrete
• /
• 제27권4호
• /
• pp.305-317
• /
• 2021

The bond between the concrete and bar is a main factor affecting the performance of the reinforced concrete (RC) members, and since the steel corrosion reduces the bond strength, studying the bond behavior of concrete and GFRP bars is quite necessary. In this research, a database including 112 concrete beam test specimens reinforced with spliced GFRP bars in the splitting failure mode has been collected and used to estimate the concrete-GFRP bar bond strength. This paper aims to accurately estimate the bond strength of spliced GFRP bars in concrete beams by applying three soft computing models including multivariate adaptive regression spline (MARS), Kriging, and M5 model tree. Since the selection of regularization parameters greatly affects the fitting of MARS, Kriging, and M5 models, the regularization parameters have been so optimized as to maximize the training data convergence coefficient. Three hybrid model coupling soft computing methods and genetic algorithm is proposed to automatically perform the trial and error process for finding appropriate modeling regularization parameters. Results have shown that proposed models have significantly increased the prediction accuracy compared to previous models. The proposed MARS, Kriging, and M5 models have improved the convergence coefficient by about 65, 63 and 49%, respectively, compared to the best previous model.

• Structural Engineering and Mechanics
• /
• 제85권1호
• /
• pp.119-133
• /
• 2023

Impact event is the key factor influencing the operational state of the mechanical equipment. Additionally, nonlinear factors existing in the complex mechanical equipment which are currently attracting more and more attention. Therefore, this paper proposes a novel hybrid-separate identification strategy to solve the force identification problem of the nonlinear structure under impact excitation. The 'hybrid' means that the identification strategy contains both l1-norm (sparse) and l2-norm regularization methods. The 'separate' means that the nonlinear response part only generated by nonlinear force needs to be separated from measured response. First, the state-of-the-art two-step iterative shrinkage/thresholding (TwIST) algorithm and sparse representation with the cubic B-spline function are developed to solve established normalized sparse regularization model to identify the accurate impact force and accurate peak value of the nonlinear force. Then, the identified impact force is substituted into the nonlinear response separation equation to obtain the nonlinear response part. Finally, a reduced transfer equation is established and solved by the classical Tikhonove regularization method to obtain the wave profile (variation trend) of the nonlinear force. Numerical and experimental identification results demonstrate that the novel hybrid-separate strategy can accurately and efficiently obtain the nonlinear force and impact force for the nonlinear structure.

• International Journal of Computer Science & Network Security
• /
• 제21권6호
• /
• pp.77-88
• /
• 2021

Heart Failure represents a critical pathological case that is challenging to predict and discover at an early age, with a notable increase in morbidity and mortality. Machine Learning and Neural Network techniques play a crucial role in predicting heart attacks, diseases and more. These techniques give valuable perspectives for clinicians who may then adjust their diagnosis for each individual patient. This paper evaluated neural network models for heart attacks predictions. Several online learning methods were investigated to automatically and accurately predict heart attacks. The UCI dataset was used in this work to train and evaluate First Order and Second Order Online Learning methods; namely Backpropagation, Delta bar Delta, Levenberg Marquardt and QuickProp learning methods. An optimizer technique was also used to minimize the random noise in the database. A regularization concept was employed to further improve the generalization of the model. Results show that a three layers' NN model with a Backpropagation algorithm and Nadam optimizer achieved a promising accuracy for the heart attach prediction tasks.