• Title/Summary/Keyword: Regularization Parameter

Search Result 93, Processing Time 0.032 seconds

An optimal regularization for structural parameter estimation from modal response

  • Pothisiri, Thanyawat
    • Structural Engineering and Mechanics
    • /
    • v.22 no.4
    • /
    • pp.401-418
    • /
    • 2006
  • Solutions to the problems of structural parameter estimation from modal response using leastsquares minimization of force or displacement residuals are generally sensitive to noise in the response measurements. The sensitivity of the parameter estimates is governed by the physical characteristics of the structure and certain features of the noisy measurements. It has been shown that the regularization method can be used to reduce effects of the measurement noise on the estimation error through adding a regularization function to the parameter estimation objective function. In this paper, we adopt the regularization function as the Euclidean norm of the difference between the values of the currently estimated parameters and the a priori parameter estimates. The effect of the regularization function on the outcome of parameter estimation is determined by a regularization factor. Based on a singular value decomposition of the sensitivity matrix of the structural response, it is shown that the optimal regularization factor is obtained by using the maximum singular value of the sensitivity matrix. This selection exhibits the condition where the effect of the a priori estimates on the solutions to the parameter estimation problem is minimal. The performance of the proposed algorithm is investigated in comparison with certain algorithms selected from the literature by using a numerical example.

Application of Regularization Method to Angle-resolved XPS Data (각분해X-선광전자분광법 데이터 분석을 위한 regularization 방법의 응용)

  • 노철언
    • Journal of the Korean Vacuum Society
    • /
    • v.5 no.2
    • /
    • pp.99-106
    • /
    • 1996
  • Two types of regularization method (singular system and HMP approaches) for generating depth-concentration profiles from angle-resolved XPS data were evaluated. Both approaches showed qualitatively similar results although they employed different numerical algorithms. The application of the regularization method to simulated data demonhstrates its excellent utility for the complex depth profile system . It includes the stable restoration of depth-concentration profiles from the data with considerable random error and the self choice of smoothing parameter that is imperative for the successful application of the regularization method. The self choice of smoothing parameter is based on generalized cross-validation method which lets the data themselves choose the optimal value of the parameter.

  • PDF

Automation of Model Selection through Neural Networks Learning (신경 회로망 학습을 통한 모델 선택의 자동화)

  • 류재흥
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2004.10a
    • /
    • pp.313-316
    • /
    • 2004
  • Model selection is the process that sets up the regularization parameter in the support vector machine or regularization network by using the external methods such as general cross validation or L-curve criterion. This paper suggests that the regularization parameter can be obtained simultaneously within the learning process of neural networks without resort to separate selection methods. In this paper, extended kernel method is introduced. The relationship between regularization parameter and the bias term in the extended kernel is established. Experimental results show the effectiveness of the new model selection method.

  • PDF

A Unified Bayesian Tikhonov Regularization Method for Image Restoration (영상 복원을 위한 통합 베이즈 티코노프 정규화 방법)

  • Yoo, Jae-Hung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.11 no.11
    • /
    • pp.1129-1134
    • /
    • 2016
  • This paper suggests a new method of finding regularization parameter for image restoration problems. If the prior information is not available, separate optimization functions for Tikhonov regularization parameter are suggested in the literature such as generalized cross validation and L-curve criterion. In this paper, unified Bayesian interpretation of Tikhonov regularization is introduced and applied to the image restoration problems. The relationship between Tikhonov regularization parameter and Bayesian hyper-parameters is established. Update formular for the regularization parameter using both maximum a posteriori(: MAP) and evidence frameworks is suggested. Experimental results show the effectiveness of the proposed method.

Application of Matrix Adaptive Regularization Method for Human Thorax Image Reconstruction (인체 흉부 영상 복원을 위한 행렬 적응 조정 방법의 적용)

  • Jeon, Min-Ho;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.19 no.1
    • /
    • pp.33-40
    • /
    • 2015
  • Inverse problem in electrical impedance tomography (EIT) is highly ill-posed therefore prior information is used to mitigate the ill-posedness. Regularization methods are often adopted in solving EIT inverse problem to have satisfactory reconstruction performance. In solving the EIT inverse problem, iterative Gauss-Newton method is generally used due to its accuracy and fast convergence. However, its performance is still suboptimal and mainly depends on the selection of regularization parameter. Although, there are few methods available to determine the regularization parameter such as L-curve method they are sometimes not applicable for all cases. Moreover, regularization parameter is a scalar and it is fixed during iteration process. Therefore, in this paper, a novel method is used to determine the regularization parameter to improve reconstruction performance. Conductivity norm is calculated at each iteration step and it used to obtain the regularization parameter which is a diagonal matrix in this case. The proposed method is applied to human thorax imaging and the reconstruction performance is compared with traditional methods. From numerical results, improved performance of proposed method is seen as compared to conventional methods.

An Unified Bayesian Total Variation Regularization Method and Application to Image Restoration (통합 베이즈 총변이 정규화 방법과 영상복원에 대한 응용)

  • Yoo, Jae-Hung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.1
    • /
    • pp.41-48
    • /
    • 2022
  • This paper presents the unified Bayesian Tikhonov regularization method as a solution to total variation regularization. The integrated method presents a formula for obtaining the regularization parameter by transforming the total variation term into a weighted Tikhonov regularization term. It repeats until the reconstructed image converges to obtain a regularization parameter and a new weighting factor based on it. The experimental results show the effectiveness of the proposed method for the image restoration problem.

Effective Determination of Optimal Regularization Parameter in Rational Polynomial Coefficients Derivation

  • Youn, Junhee;Hong, Changhee;Kim, TaeHoon;Kim, Gihong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.31 no.6_2
    • /
    • pp.577-583
    • /
    • 2013
  • Recently, massive archives of ground information imagery from new sensors have become available. To establish a functional relationship between the image and the ground space, sensor models are required. The rational functional model (RFM), which is used as an alternative to the rigorous sensor model, is an attractive option owing to its generality and simplicity. To determine the rational polynomial coefficients (RPC) in RFM, however, we encounter the problem of obtaining a stable solution. The design matrix for solutions is usually ill-conditioned in the experiments. To solve this unstable solution problem, regularization techniques are generally used. In this paper, we describe the effective determination of the optimal regularization parameter in the regularization technique during RPC derivation. A brief mathematical background of RFM is presented, followed by numerical approaches for effective determination of the optimal regularization parameter using the Euler Method. Experiments are performed assuming that a tilted aerial image is taken with a known rigorous sensor. To show the effectiveness, calculation time and RMSE between L-curve method and proposed method is compared.

Regularization Parameter Selection for Total Variation Model Based on Local Spectral Response

  • Zheng, Yuhui;Ma, Kai;Yu, Qiqiong;Zhang, Jianwei;Wang, Jin
    • Journal of Information Processing Systems
    • /
    • v.13 no.5
    • /
    • pp.1168-1182
    • /
    • 2017
  • In the past decades, various image regularization methods have been introduced. Among them, total variation model has drawn much attention for the reason of its low computational complexity and well-understood mathematical behavior. However, regularization parameter estimation of total variation model is still an open problem. To deal with this problem, a novel adaptive regularization parameter selection scheme is proposed in this paper, by means of using the local spectral response, which has the capability of locally selecting the regularization parameters in a content-aware way and therefore adaptively adjusting the weights between the two terms of the total variation model. Experiment results on simulated and real noisy image show the good performance of our proposed method, in visual improvement and peak signal to noise ratio value.

A Simulation Study on Regularization Method for Generating Non-Destructive Depth Profiles from Angle-Resolved XPS Data

  • Ro, Chul-Un
    • Analytical Science and Technology
    • /
    • v.8 no.4
    • /
    • pp.707-714
    • /
    • 1995
  • Two types of regularization method (singular system and HMP approaches) for generating depth-concentration profiles from angle-resolved XPS data were evaluated. Both approaches showed qualitatively similar results although they employed different numerical algorithms. The application of the regularization method to simulated data demonstrates its excellent utility for the complex depth profile system. It includes the stable restoration of the depth-concentration profiles from the data with considerable random error and the self choice of smoothing parameter that is imperative for the successful application of the regularization method. The self choice of smoothing parameter is based on generalized cross-validation method which lets the data themselves choose the optimal value of the parameter.

  • PDF

Regularized Iterative Image Restoration with Relaxation Parameter (이완변수를 고려한 영상의 정칙화 반복 복원)

  • 홍성용;이태홍
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.19 no.1
    • /
    • pp.91-99
    • /
    • 1994
  • We proposed the regularized iterative restoration method considering relaxation parameter and regularization paramenter in order to restore the noisy motion-blurred images. We used (i-H) as a regularization operator and these two kinds of constraints were applied while conventional regularization iterative restoration method proposed by Jan Biemond et al used the 2-D Laplacian filter and a predetermined regularization parameter value and relaxation parameter to 1. Through the experimental results, we showed better results compared with those by a conventional method and or regularized iterative restoration method just considering only a regularization parameter. These two kinds of constratints have good effects when applied into the regularized iterative restoration method for noisy motion-blurred images.

  • PDF