• Title/Summary/Keyword: Robust Statistics

Search Result 397, Processing Time 0.023 seconds

Penalized rank regression estimator with the smoothly clipped absolute deviation function

  • Park, Jong-Tae;Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.6
    • /
    • pp.673-683
    • /
    • 2017
  • The least absolute shrinkage and selection operator (LASSO) has been a popular regression estimator with simultaneous variable selection. However, LASSO does not have the oracle property and its robust version is needed in the case of heavy-tailed errors or serious outliers. We propose a robust penalized regression estimator which provide a simultaneous variable selection and estimator. It is based on the rank regression and the non-convex penalty function, the smoothly clipped absolute deviation (SCAD) function which has the oracle property. The proposed method combines the robustness of the rank regression and the oracle property of the SCAD penalty. We develop an efficient algorithm to compute the proposed estimator that includes a SCAD estimate based on the local linear approximation and the tuning parameter of the penalty function. Our estimate can be obtained by the least absolute deviation method. We used an optimal tuning parameter based on the Bayesian information criterion and the cross validation method. Numerical simulation shows that the proposed estimator is robust and effective to analyze contaminated data.

Robust spectrum sensing under noise uncertainty for spectrum sharing

  • Kim, Chang-Joo;Jin, Eun Sook;Cheon, Kyung-yul;Kim, Seon-Hwan
    • ETRI Journal
    • /
    • v.41 no.2
    • /
    • pp.176-183
    • /
    • 2019
  • Spectrum sensing plays an important role in spectrum sharing. Energy detection is generally used because it does not require a priori knowledge of primary user (PU) signals; however, it is sensitive to noise uncertainty. An order statistics (OS) detector provides inherent protection against nonhomogeneous background signals. However, no analysis has been conducted yet to apply OS detection to spectrum sensing in a wireless channel to solve noise uncertainty. In this paper, we propose a robust spectrum sensing scheme based on generalized order statistics (GOS) and analyze the exact false alarm and detection probabilities under noise uncertainty. From the equation of the exact false alarm probability, the threshold value is calculated to maintain a constant false alarm rate. The detection probability is obtained from the calculated threshold under noise uncertainty. As a fusion rule for cooperative spectrum sensing, we adopt an OR rule, that is, a 1-out-of-N rule, and we call the proposed scheme GOS-OR. The analytical results show that the GOS-OR scheme can achieve optimum performance and maintain the desired false alarm rates if the coefficients of the GOS-OR detector can be correctly selected.

Exploring modern machine learning methods to improve causal-effect estimation

  • Kim, Yeji;Choi, Taehwa;Choi, Sangbum
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.2
    • /
    • pp.177-191
    • /
    • 2022
  • This paper addresses the use of machine learning methods for causal estimation of treatment effects from observational data. Even though conducting randomized experimental trials is a gold standard to reveal potential causal relationships, observational study is another rich source for investigation of exposure effects, for example, in the research of comparative effectiveness and safety of treatments, where the causal effect can be identified if covariates contain all confounding variables. In this context, statistical regression models for the expected outcome and the probability of treatment are often imposed, which can be combined in a clever way to yield more efficient and robust causal estimators. Recently, targeted maximum likelihood estimation and causal random forest is proposed and extensively studied for the use of data-adaptive regression in estimation of causal inference parameters. Machine learning methods are a natural choice in these settings to improve the quality of the final estimate of the treatment effect. We explore how we can adapt the design and training of several machine learning algorithms for causal inference and study their finite-sample performance through simulation experiments under various scenarios. Application to the percutaneous coronary intervention (PCI) data shows that these adaptations can improve simple linear regression-based methods.

On a Robust Test for Parallelism of Regression Lines against Ordered Alternatives

  • Song, Moon-Sup;Kim, Jin-Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.565-579
    • /
    • 1997
  • A robust test is proposed for the problem of testing the parallelism of several regression lines against ordered alternatives. The proposed test statistic is based on a linear combination of one-step pairwise GM-estimators. We compare the performance of the proposed test with that of the other tests through a Monte Carlo simulation. The results of the simulation study show that the proposed test has stable levels, good empirical powers in various circumstances, and particularly higher empirical powers under the presence of extreme outliers or leverage points.

  • PDF

Robust Inference for Testing Order-Restricted Inference

  • Kang, Moon-Su
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.5
    • /
    • pp.1097-1102
    • /
    • 2009
  • Classification of subjects with unknown distribution in small sample size setup may involve order-restricted constraints in multivariate parameter setups. Those problems makes optimality of conventional likelihood ratio based statistical inferences not feasible. Fortunately, Roy (1953) introduced union-intersection principle(UIP) which provides an alternative avenue. Redescending M-estimator along with that principle yields a considerably appropriate robust testing procedure. Furthermore, conditionally distribution-free test based upon exact permutation theory is used to generate p-values, even in small sample. Applications of this method are illustrated in simulated data and read data example (Lobenhofer et al., 2002)

Mixture Bayesian Robust Design

  • Seo, Han-Son
    • Journal of Korean Society for Quality Management
    • /
    • v.34 no.1
    • /
    • pp.48-53
    • /
    • 2006
  • Applying Bayesian optimal design principles is not easy when a prior distribution is not certain. We present a optimal design criterion which possibly yield a reasonably good design and also robust with respect to misspecification of the prior distributions. The criterion is applied to the problem of estimating the turning point of a quadratic regression. Exact mathematical results are presented under certain conditions on prior distributions. Computational results are given for some cases not satisfying our conditions.

A Robust Subset Selection Procedure for Location Parameter Based on Hodges-Lehmann Estimators

  • Lee, Kang Sup
    • Journal of Korean Society for Quality Management
    • /
    • v.19 no.1
    • /
    • pp.51-64
    • /
    • 1991
  • This paper deals with a robust subset selection procedure based on Hodges-Lehmann estimators of location parameters. An improved formula for the estimated standard error of Hodges-Lehmann estimators is considered. Also, the degrees of freedom of the studentized Hodges-Lehmann estimators are investigated and it is suggested to use 0.8n instead of n-1. The proposed procedure is compared with the other subset selection procedures and it is shown to have good effciency for heavy-tailed distributions.

  • PDF

Robust Design to the Combined Array with Multiresponse

  • Kwon, Yong-Man
    • Journal of Integrative Natural Science
    • /
    • v.10 no.1
    • /
    • pp.51-57
    • /
    • 2017
  • The Taguchi parameter design in industry is an approach to reducing performance variation of quality characteristic in products and processes. In the Taguchi parameter design, the product array approach using orthogonal arrays is mainly used. It often requires an excessive number of experiments. An alternative approach, which is called the combined array approach, was studied. In these studies, only single response was considered. In this paper we propose how to simultaneously optimize multiresponse for the robust design using the combined array approach.

Robustizing Kalman filters with the M-estimating functions

  • Pak, Ro Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.1
    • /
    • pp.99-107
    • /
    • 2018
  • This article considers a robust Kalman filter from the M-estimation point of view. Pak (Journal of the Korean Statistical Society, 27, 507-514, 1998) proposed a particular M-estimating function which has the data-based shaping constants. The Kalman filter with the proposed M-estimating function is considered. The structure and the estimating algorithm of the Kalman filter accompanying the M-estimating function are mentioned. Kalman filter estimates by the proposed M-estimating function are shown to be well behaved even when data are contaminated.

Image Noise Reduction Filter Based on Robust Regression Model (로버스트 회귀모형에 근거한 영상 잡음 제거 필터)

  • Kim, Yeong-Hwa;Park, Youngho
    • The Korean Journal of Applied Statistics
    • /
    • v.28 no.5
    • /
    • pp.991-1001
    • /
    • 2015
  • Digital images acquired by digital devices are used in many fields. Applying statistical methods to the processing of images will increase speed and efficiency. Methods to remove noise and image quality have been researched as a basic operation of image processing. This paper proposes a novel reduction method that considers the direction and magnitude of the edge to remove image noise effectively using statistical methods. The proposed method estimates the brightness of pixels relative to pixels in the same direction based on a robust regression model. An estimate of pixel brightness is obtained by weighting the magnitude of the edge that improves the performance of the average filter. As a result of the simulation study, the proposed method retains pixels that are well-characterized and confirms that noise reduction performance is improved over conventional methods.