• Title/Summary/Keyword: regularization methods

Search Result 147, Processing Time 0.025 seconds

ON THREE SPECTRAL REGULARIZATION METHODS FOR A BACKWARD HEAT CONDUCTION PROBLEM

  • Xiong, Xiang-Tuan;Fu, Chu-Li;Qian, Zhi
    • Journal of the Korean Mathematical Society
    • /
    • v.44 no.6
    • /
    • pp.1281-1290
    • /
    • 2007
  • We introduce three spectral regularization methods for solving a backward heat conduction problem (BHCP). For the three spectral regularization methods, we give the stability error estimates with optimal order under an a-priori and an a-posteriori regularization parameter choice rule. Numerical results show that our theoretical results are effective.

Selection probability of multivariate regularization to identify pleiotropic variants in genetic association studies

  • Kim, Kipoong;Sun, Hokeun
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.5
    • /
    • pp.535-546
    • /
    • 2020
  • In genetic association studies, pleiotropy is a phenomenon where a variant or a genetic region affects multiple traits or diseases. There have been many studies identifying cross-phenotype genetic associations. But, most of statistical approaches for detection of pleiotropy are based on individual tests where a single variant association with multiple traits is tested one at a time. These approaches fail to account for relations among correlated variants. Recently, multivariate regularization methods have been proposed to detect pleiotropy in analysis of high-dimensional genomic data. However, they suffer a problem of tuning parameter selection, which often results in either too many false positives or too small true positives. In this article, we applied selection probability to multivariate regularization methods in order to identify pleiotropic variants associated with multiple phenotypes. Selection probability was applied to individual elastic-net, unified elastic-net and multi-response elastic-net regularization methods. In simulation studies, selection performance of three multivariate regularization methods was evaluated when the total number of phenotypes, the number of phenotypes associated with a variant, and correlations among phenotypes are different. We also applied the regularization methods to a wild bean dataset consisting of 169,028 variants and 17 phenotypes.

Resistivity Image Reconstruction Using Interacting Dual-Mode Regularization (상호작용 이중-모드 조정방법을 이용한 저항률 영상 복원)

  • Kang, Suk-In;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.20 no.2
    • /
    • pp.152-162
    • /
    • 2016
  • Electrical resistivity tomography (ERT) is a technique to reconstruct the internal resistivity distribution using the measured voltages on the surface electrodes. ERT inverse problem suffers from ill-posedness nature, so regularization methods are used to mitigate ill-posedness. The reconstruction performance varies depending on the type of regularization method. In this paper, an interacting dual-mode regularization method is proposed with two different regularization methods, L1-norm regularization and total variation (TV) regularization, to achieve robust reconstruction performance. The interacting dual-mode regularization method selects the suitable regularization method and combines the regularization methods based on computed mode probabilities depending on the actual conditions. The proposed method is tested with numerical simulations and the results demonstrate an improved reconstruction performance.

A Study on Regularization Methods to Evaluate the Sediment Trapping Efficiency of Vegetative Filter Strips (식생여과대 유사 저감 효율 산정을 위한 정규화 방안)

  • Bae, JooHyun;Han, Jeongho;Yang, Jae E;Kim, Jonggun;Lim, Kyoung Jae;Jang, Won Seok
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.61 no.6
    • /
    • pp.9-19
    • /
    • 2019
  • Vegetative Filter Strip (VFS) is the best management practice which has been widely used to mitigate water pollutants from agricultural fields by alleviating runoff and sediment. This study was conducted to improve an equation for estimating sediment trapping efficiency of VFS using several different regularization methods (i.e., ordinary least squares analysis, LASSO, ridge regression analysis and elastic net). The four different regularization methods were employed to develop the sediment trapping efficiency equation of VFS. Each regularization method indicated high accuracy in estimating the sediment trapping efficiency of VFS. Among the four regularization methods, the ridge method showed the most accurate results according to $R^2$, RMSE and MAPE which were 0.94, 7.31% and 14.63%, respectively. The equation developed in this study can be applied in watershed-scale hydrological models in order to estimate the sediment trapping efficiency of VFS in agricultural fields for an effective watershed management in Korea.

Performance Comparison of Regularization Methods in Electrical Resistance Tomography (전기 저항 단층촬영법에서의 조정기법 성능비교)

  • Kang, Suk-In;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.20 no.3
    • /
    • pp.226-234
    • /
    • 2016
  • Electrical resistance tomography (ERT) is an imaging technique where the internal resistivity distribution inside an object is reconstructed. The ERT image reconstruction is a highly nonlinear ill-posed problem, so regularization methods are used to achieve desired image. The reconstruction outcome is dependent on the type of regularization method employed such as l2-norm, l1-norm, and total variation regularization method. That is, use of an appropriate regularization method considering the flow characteristics is necessary to attain good reconstruction performance. Therefore, in this paper, regularization methods are tested through numerical simulations with different flow conditions and the performance is compared.

Automation of Model Selection through Neural Networks Learning (신경 회로망 학습을 통한 모델 선택의 자동화)

  • 류재흥
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2004.10a
    • /
    • pp.313-316
    • /
    • 2004
  • Model selection is the process that sets up the regularization parameter in the support vector machine or regularization network by using the external methods such as general cross validation or L-curve criterion. This paper suggests that the regularization parameter can be obtained simultaneously within the learning process of neural networks without resort to separate selection methods. In this paper, extended kernel method is introduced. The relationship between regularization parameter and the bias term in the extended kernel is established. Experimental results show the effectiveness of the new model selection method.

  • PDF

Two regularization constant selection methods for recursive least squares algorithm with convex regularization and their performance comparison in the sparse acoustic communication channel estimation (볼록 규준화 RLS의 규준화 상수를 정하기 위한 두 가지 방법과 희소성 음향 통신 채널 추정 성능 비교)

  • Lim, Jun-Seok;Hong, Wooyoung
    • The Journal of the Acoustical Society of Korea
    • /
    • v.35 no.5
    • /
    • pp.383-388
    • /
    • 2016
  • We develop two methods to select a constant in the RLS (Recursive Least Squares) with the convex regularization. The RLS with the convex regularization was proposed by Eksioglu and Tanc in order to estimate the sparse acoustic channel. However the algorithm uses the regularization constant which needs the information about the true channel response for the best performance. In this paper, we propose two methods to select the regularization constant which don't need the information about the true channel response. We show that the estimation performance using the proposed methods is comparable with the Eksioglu and Tanc's algorithm.

An Application of the Clustering Threshold Gradient Descent Regularization Method for Selecting Genes in Predicting the Survival Time of Lung Carcinomas

  • Lee, Seung-Yeoun;Kim, Young-Chul
    • Genomics & Informatics
    • /
    • v.5 no.3
    • /
    • pp.95-101
    • /
    • 2007
  • In this paper, we consider the variable selection methods in the Cox model when a large number of gene expression levels are involved with survival time. Deciding which genes are associated with survival time has been a challenging problem because of the large number of genes and relatively small sample size (n<

Application of Matrix Adaptive Regularization Method for Human Thorax Image Reconstruction (인체 흉부 영상 복원을 위한 행렬 적응 조정 방법의 적용)

  • Jeon, Min-Ho;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.19 no.1
    • /
    • pp.33-40
    • /
    • 2015
  • Inverse problem in electrical impedance tomography (EIT) is highly ill-posed therefore prior information is used to mitigate the ill-posedness. Regularization methods are often adopted in solving EIT inverse problem to have satisfactory reconstruction performance. In solving the EIT inverse problem, iterative Gauss-Newton method is generally used due to its accuracy and fast convergence. However, its performance is still suboptimal and mainly depends on the selection of regularization parameter. Although, there are few methods available to determine the regularization parameter such as L-curve method they are sometimes not applicable for all cases. Moreover, regularization parameter is a scalar and it is fixed during iteration process. Therefore, in this paper, a novel method is used to determine the regularization parameter to improve reconstruction performance. Conductivity norm is calculated at each iteration step and it used to obtain the regularization parameter which is a diagonal matrix in this case. The proposed method is applied to human thorax imaging and the reconstruction performance is compared with traditional methods. From numerical results, improved performance of proposed method is seen as compared to conventional methods.

MSET PERFORMANCE OPTIMIZATION THROUGH REGULARIZATION

  • HINES J. WESLEY;USYNIN ALEXANDER
    • Nuclear Engineering and Technology
    • /
    • v.37 no.2
    • /
    • pp.177-184
    • /
    • 2005
  • The Multivariate State Estimation Technique (MSET) is being used in Nuclear Power Plants for sensor and equipment condition monitoring. This paper presents the use of regularization methods for optimizing MSET's predictive performance. The techniques are applied to a simulated data set and a data set obtained from a nuclear power plant currently implementing empirical, on-line, equipment condition monitoring techniques. The results show that regularization greatly enhances the predictive performance. Additionally, the selection of prototype vectors is investigated and a local modeling method is presented that can be applied when computational speed is desired.