• 제목/요약/키워드: Robust Statistics

검색결과 397건 처리시간 0.019초

Penalized rank regression estimator with the smoothly clipped absolute deviation function

  • Park, Jong-Tae;Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • 제24권6호
    • /
    • pp.673-683
    • /
    • 2017
  • The least absolute shrinkage and selection operator (LASSO) has been a popular regression estimator with simultaneous variable selection. However, LASSO does not have the oracle property and its robust version is needed in the case of heavy-tailed errors or serious outliers. We propose a robust penalized regression estimator which provide a simultaneous variable selection and estimator. It is based on the rank regression and the non-convex penalty function, the smoothly clipped absolute deviation (SCAD) function which has the oracle property. The proposed method combines the robustness of the rank regression and the oracle property of the SCAD penalty. We develop an efficient algorithm to compute the proposed estimator that includes a SCAD estimate based on the local linear approximation and the tuning parameter of the penalty function. Our estimate can be obtained by the least absolute deviation method. We used an optimal tuning parameter based on the Bayesian information criterion and the cross validation method. Numerical simulation shows that the proposed estimator is robust and effective to analyze contaminated data.

Robust spectrum sensing under noise uncertainty for spectrum sharing

  • Kim, Chang-Joo;Jin, Eun Sook;Cheon, Kyung-yul;Kim, Seon-Hwan
    • ETRI Journal
    • /
    • 제41권2호
    • /
    • pp.176-183
    • /
    • 2019
  • Spectrum sensing plays an important role in spectrum sharing. Energy detection is generally used because it does not require a priori knowledge of primary user (PU) signals; however, it is sensitive to noise uncertainty. An order statistics (OS) detector provides inherent protection against nonhomogeneous background signals. However, no analysis has been conducted yet to apply OS detection to spectrum sensing in a wireless channel to solve noise uncertainty. In this paper, we propose a robust spectrum sensing scheme based on generalized order statistics (GOS) and analyze the exact false alarm and detection probabilities under noise uncertainty. From the equation of the exact false alarm probability, the threshold value is calculated to maintain a constant false alarm rate. The detection probability is obtained from the calculated threshold under noise uncertainty. As a fusion rule for cooperative spectrum sensing, we adopt an OR rule, that is, a 1-out-of-N rule, and we call the proposed scheme GOS-OR. The analytical results show that the GOS-OR scheme can achieve optimum performance and maintain the desired false alarm rates if the coefficients of the GOS-OR detector can be correctly selected.

Exploring modern machine learning methods to improve causal-effect estimation

  • Kim, Yeji;Choi, Taehwa;Choi, Sangbum
    • Communications for Statistical Applications and Methods
    • /
    • 제29권2호
    • /
    • pp.177-191
    • /
    • 2022
  • This paper addresses the use of machine learning methods for causal estimation of treatment effects from observational data. Even though conducting randomized experimental trials is a gold standard to reveal potential causal relationships, observational study is another rich source for investigation of exposure effects, for example, in the research of comparative effectiveness and safety of treatments, where the causal effect can be identified if covariates contain all confounding variables. In this context, statistical regression models for the expected outcome and the probability of treatment are often imposed, which can be combined in a clever way to yield more efficient and robust causal estimators. Recently, targeted maximum likelihood estimation and causal random forest is proposed and extensively studied for the use of data-adaptive regression in estimation of causal inference parameters. Machine learning methods are a natural choice in these settings to improve the quality of the final estimate of the treatment effect. We explore how we can adapt the design and training of several machine learning algorithms for causal inference and study their finite-sample performance through simulation experiments under various scenarios. Application to the percutaneous coronary intervention (PCI) data shows that these adaptations can improve simple linear regression-based methods.

On a Robust Test for Parallelism of Regression Lines against Ordered Alternatives

  • Song, Moon-Sup;Kim, Jin-Ho
    • Communications for Statistical Applications and Methods
    • /
    • 제4권2호
    • /
    • pp.565-579
    • /
    • 1997
  • A robust test is proposed for the problem of testing the parallelism of several regression lines against ordered alternatives. The proposed test statistic is based on a linear combination of one-step pairwise GM-estimators. We compare the performance of the proposed test with that of the other tests through a Monte Carlo simulation. The results of the simulation study show that the proposed test has stable levels, good empirical powers in various circumstances, and particularly higher empirical powers under the presence of extreme outliers or leverage points.

  • PDF

Robust Inference for Testing Order-Restricted Inference

  • Kang, Moon-Su
    • 응용통계연구
    • /
    • 제22권5호
    • /
    • pp.1097-1102
    • /
    • 2009
  • Classification of subjects with unknown distribution in small sample size setup may involve order-restricted constraints in multivariate parameter setups. Those problems makes optimality of conventional likelihood ratio based statistical inferences not feasible. Fortunately, Roy (1953) introduced union-intersection principle(UIP) which provides an alternative avenue. Redescending M-estimator along with that principle yields a considerably appropriate robust testing procedure. Furthermore, conditionally distribution-free test based upon exact permutation theory is used to generate p-values, even in small sample. Applications of this method are illustrated in simulated data and read data example (Lobenhofer et al., 2002)

Mixture Bayesian Robust Design

  • Seo, Han-Son
    • 품질경영학회지
    • /
    • 제34권1호
    • /
    • pp.48-53
    • /
    • 2006
  • Applying Bayesian optimal design principles is not easy when a prior distribution is not certain. We present a optimal design criterion which possibly yield a reasonably good design and also robust with respect to misspecification of the prior distributions. The criterion is applied to the problem of estimating the turning point of a quadratic regression. Exact mathematical results are presented under certain conditions on prior distributions. Computational results are given for some cases not satisfying our conditions.

A Robust Subset Selection Procedure for Location Parameter Based on Hodges-Lehmann Estimators

  • Lee, Kang Sup
    • 품질경영학회지
    • /
    • 제19권1호
    • /
    • pp.51-64
    • /
    • 1991
  • This paper deals with a robust subset selection procedure based on Hodges-Lehmann estimators of location parameters. An improved formula for the estimated standard error of Hodges-Lehmann estimators is considered. Also, the degrees of freedom of the studentized Hodges-Lehmann estimators are investigated and it is suggested to use 0.8n instead of n-1. The proposed procedure is compared with the other subset selection procedures and it is shown to have good effciency for heavy-tailed distributions.

  • PDF

Robust Design to the Combined Array with Multiresponse

  • Kwon, Yong-Man
    • 통합자연과학논문집
    • /
    • 제10권1호
    • /
    • pp.51-57
    • /
    • 2017
  • The Taguchi parameter design in industry is an approach to reducing performance variation of quality characteristic in products and processes. In the Taguchi parameter design, the product array approach using orthogonal arrays is mainly used. It often requires an excessive number of experiments. An alternative approach, which is called the combined array approach, was studied. In these studies, only single response was considered. In this paper we propose how to simultaneously optimize multiresponse for the robust design using the combined array approach.

Robustizing Kalman filters with the M-estimating functions

  • Pak, Ro Jin
    • Communications for Statistical Applications and Methods
    • /
    • 제25권1호
    • /
    • pp.99-107
    • /
    • 2018
  • This article considers a robust Kalman filter from the M-estimation point of view. Pak (Journal of the Korean Statistical Society, 27, 507-514, 1998) proposed a particular M-estimating function which has the data-based shaping constants. The Kalman filter with the proposed M-estimating function is considered. The structure and the estimating algorithm of the Kalman filter accompanying the M-estimating function are mentioned. Kalman filter estimates by the proposed M-estimating function are shown to be well behaved even when data are contaminated.

로버스트 회귀모형에 근거한 영상 잡음 제거 필터 (Image Noise Reduction Filter Based on Robust Regression Model)

  • 김영화;박영호
    • 응용통계연구
    • /
    • 제28권5호
    • /
    • pp.991-1001
    • /
    • 2015
  • 영상은 렌즈를 통하여 형성된 이미지로 많은 응용 분야에서 사용된다. 디지털 기기로 획득한 디지털 영상은 수치화된 자료로 통계분석이 가능하며, 신속하고 효율적인 작업이 가능하게 한다. 영상처리 분야에서는 화질의 개선을 위해서 잡음을 제거하는 방법들이 연구되고 있다. 본 논문은 영상 잡음을 효과적으로 제거하는 방법으로 통계적 방법들을 사용하여, 에지의 방향과 크기를 적용한 새로운 잡음 제거 방법을 제안한다. 이 방법은 동일한 방향에 위치한 화소들에 대하여 로버스트 회귀모형을 적용하고 해당 화소의 밝기 값을 추정한다. 추정된 화소의 밝기 값은 에지의 크기가 가중값으로 사용되어 평균필터의 성능을 개선한다. 모의실험의 결과, 제안한 방법은 특징을 포함하는 화소를 잘 유지하며, 잡음 제거 성능도 기존의 방법보다 개선되는 것을 확인하였다.