• Title/Summary/Keyword: Smoothing parameter

Search Result 120, Processing Time 0.032 seconds

Smoothing Parameter Selection Using Multifold Cross-Validation in Smoothing Spline Regressions

  • Hong, Changkon;Kim, Choongrak;Yoon, Misuk
    • Communications for Statistical Applications and Methods
    • /
    • v.5 no.2
    • /
    • pp.277-285
    • /
    • 1998
  • The smoothing parameter $\lambda$ in smoothing spline regression is usually selected by minimizing cross-validation (CV) or generalized cross-validation (GCV). But, simple CV or GCV is poor candidate for estimating prediction error. We defined MGCV (Multifold Generalized Cross-validation) as a criterion for selecting smoothing parameter in smoothing spline regression. This is a version of cross-validation using $leave-\kappa-out$ method. Some numerical results comparing MGCV and GCV are done.

  • PDF

Parameter estimation of mean field annealing technique for optimal boundary smoothing (최적의 Boundary Smoothing을 위한 Mean Field Annealing 기법의 파라미터 추정에 관한 연구)

  • Kwa
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.22 no.1
    • /
    • pp.185-192
    • /
    • 1997
  • We propose a method of paramete estimation using order-of-magnitude analysis for optimal boundary smoothing in Mean Field Annealing(MFA) technique in this paper. We previously proposed two boundary smoothing methods for consistent object representation in the previous paper, one is using a constratined regulaization(CR) method and the other is using a MFA method. The CR method causes unnecessary smoothing effects at corners. On the other hand, the MFA method method smooths our the noise without losing sharpness of corners. The MFA algorithm is influenced by several parameters such as standard deviation of the noise, the relativemagnitude of prior ter, initial temperature and final temperature. We propose a general parameter esimation method for optimal boundary smoothing using order-of-magnitude analysis to be used for consistent object representation in this paper. In addition, we prove the effectiveness of our parameter estimation and also show the temperature parameter sensitivities of the algorithm.

  • PDF

Diagnostics for Estimated Smoothing Parameter by Generalized Maximum Likelihood Function (일반화최대우도함수에 의해 추정된 평활모수에 대한 진단)

  • Jung, Won-Tae;Lee, In-Suk;Jeong, Hae-Jeong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.257-262
    • /
    • 1996
  • When we are estimate the smoothing parameter in spline regression model, we deal the diagnostic of influence observations as posteriori analysis. When we use Generalized Maximum Likelihood Function as the estimation method of smoothing parameter, we propose the diagnostic measure for influencial observations in the obtained estimate, and we introduce the finding method of the proper smoothing parameter estimate.

  • PDF

Detecting Influential Observations on the Smoothing Parameter in Nonparametric Regression

  • Kim, Choong-Rak;Jeon, Jong-Woo
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.2
    • /
    • pp.495-506
    • /
    • 1995
  • We present formula for detecting influential observations on the smoothing parameter in smoothing spline. Further, we express them as functions of basic building blocks such as residuals and leverage, and compare it with the local influence approach by Thomas (1991). An example based on a real data set is given.

  • PDF

Penalized Likelihood Regression with Negative Binomial Data with Unknown Shape Parameter

  • Kim, Young-Ju
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.1
    • /
    • pp.23-32
    • /
    • 2007
  • We consider penalized likelihood regression with data from the negative binomial distribution with unknown shape parameter. Smoothing parameter selection and asymptotically efficient low dimensional approximations are employed for negative binomial data along with shape parameter estimation through several different algorithms.

An Edge-Based Algorithm for Discontinuity Adaptive Image Smoothing (에지기반의 불연속 경계적응 영상 평활화 알고리즘)

  • 강동중;권인소
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.273-273
    • /
    • 2000
  • We present a new scheme to increase the performance of edge-preserving image smoothing from the parameter tuning of a Markov random field (MRF) function. The method is based on automatic control of the image smoothing-strength in MRF model ing in which an introduced parameter function is based on control of enforcing power of a discontinuity-adaptive Markov function and edge magnitude resulted from discontinuities of image intensity. Without any binary decision for the edge magnitude, adaptive control of the enforcing power with the full edge magnitude could improve the performance of discontinuity-preserving image smoothing.

  • PDF

Edge-Preserving Iterative Reconstruction in Transmission Tomography Using Space-Variant Smoothing (투과 단층촬영에서 공간가변 평활화를 사용한 경계보존 반복연산 재구성)

  • Jung, Ji Eun;Ren, Xue;Lee, Soo-Jin
    • Journal of Biomedical Engineering Research
    • /
    • v.38 no.5
    • /
    • pp.219-226
    • /
    • 2017
  • Penalized-likelihood (PL) reconstruction methods for transmission tomography are known to provide improved image quality for reduced dose level by efficiently smoothing out noise while preserving edges. Unfortunately, however, most of the edge-preserving penalty functions used in conventional PL methods contain at least one free parameter which controls the shape of a non-quadratic penalty function to adjust the sensitivity of edge preservation. In this work, to avoid difficulties in finding a proper value of the free parameter involved in a non-quadratic penalty function, we propose a new adaptive method of space-variant smoothing with a simple quadratic penalty function. In this method, the smoothing parameter is adaptively selected for each pixel location at each iteration by using the image roughness measured by a pixel-wise standard deviation image calculated from the previous iteration. The experimental results demonstrate that our new method not only preserves edges, but also suppresses noise well in monotonic regions without requiring additional processes to select free parameters that may otherwise be included in a non-quadratic penalty function.

On Practical Choice of Smoothing Parameter in Nonparametric Classification (베이즈 리스크를 이용한 커널형 분류에서 평활모수의 선택)

  • Kim, Rae-Sang;Kang, Kee-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.2
    • /
    • pp.283-292
    • /
    • 2008
  • Smoothing parameter or bandwidth plays a key role in nonparametric classification based on kernel density estimation. We consider choosing smoothing parameter in nonparametric classification, which optimize the Bayes risk. Hall and Kang (2005) clarified the theoretical properties of smoothing parameter in terms of minimizing Bayes risk and derived the optimal order of it. Bootstrap method was used in their exploring numerical properties. We compare cross-validation and bootstrap method numerically in terms of optimal order of bandwidth. Effects on misclassification rate are also examined. We confirm that bootstrap method is superior to cross-validation in both cases.

Computation and Smoothing Parameter Selection In Penalized Likelihood Regression

  • Kim Young-Ju
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.3
    • /
    • pp.743-758
    • /
    • 2005
  • This paper consider penalized likelihood regression with data from exponential family. The fast computation method applied to Gaussian data(Kim and Gu, 2004) is extended to non Gaussian data through asymptotically efficient low dimensional approximations and corresponding algorithm is proposed. Also smoothing parameter selection is explored for various exponential families, which extends the existing cross validation method of Xiang and Wahba evaluated only with Bernoulli data.

The Family Approach to Nonparametric Estimation of the Regression Function (비모수적 회귀함수 추정에 대한 Family Approach)

  • 정성석
    • Journal of Korean Society for Quality Management
    • /
    • v.25 no.4
    • /
    • pp.106-114
    • /
    • 1997
  • The smoothing parameter or bandwidth is crucial to performance of the kernel based regression estimator. So the choice of a "optimal" smoothing parameter produce a single curve estimate. If a single estimate is replaced by a family of estimates, it become easy that we understand what varies with choice of the smoothing parameter. This paper suggests the threshold of the maximum bandwidth and the number of the family members in the regression context.n context.

  • PDF