• Title/Summary/Keyword: Robust estimator

Search Result 276, Processing Time 0.02 seconds

Penalized rank regression estimator with the smoothly clipped absolute deviation function

  • Park, Jong-Tae;Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.6
    • /
    • pp.673-683
    • /
    • 2017
  • The least absolute shrinkage and selection operator (LASSO) has been a popular regression estimator with simultaneous variable selection. However, LASSO does not have the oracle property and its robust version is needed in the case of heavy-tailed errors or serious outliers. We propose a robust penalized regression estimator which provide a simultaneous variable selection and estimator. It is based on the rank regression and the non-convex penalty function, the smoothly clipped absolute deviation (SCAD) function which has the oracle property. The proposed method combines the robustness of the rank regression and the oracle property of the SCAD penalty. We develop an efficient algorithm to compute the proposed estimator that includes a SCAD estimate based on the local linear approximation and the tuning parameter of the penalty function. Our estimate can be obtained by the least absolute deviation method. We used an optimal tuning parameter based on the Bayesian information criterion and the cross validation method. Numerical simulation shows that the proposed estimator is robust and effective to analyze contaminated data.

Weighted Least Absolute Deviation Lasso Estimator

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.6
    • /
    • pp.733-739
    • /
    • 2011
  • The linear absolute shrinkage and selection operator(Lasso) method improves the low prediction accuracy and poor interpretation of the ordinary least squares(OLS) estimate through the use of $L_1$ regularization on the regression coefficients. However, the Lasso is not robust to outliers, because the Lasso method minimizes the sum of squared residual errors. Even though the least absolute deviation(LAD) estimator is an alternative to the OLS estimate, it is sensitive to leverage points. We propose a robust Lasso estimator that is not sensitive to outliers, heavy-tailed errors or leverage points.

ROBUST MEASURES OF LOCATION IN WATER-QUALITY DATA

  • Kim, Kyung-Sub;Kim, Bom-Chul;Kim, Jin-Hong
    • Water Engineering Research
    • /
    • v.3 no.3
    • /
    • pp.195-202
    • /
    • 2002
  • The mean is generally used as a point estimator in water-quality data. Unfortunately, the nonnormal and skewed distributions of data hinder the direct application of the mean, which is inappropriate statistics in this case. The use of robust statistics such as L, M, and R-estimators are recommended and become more efficient. The median (L-estimator), the biweight (M-estimator), and the Hodges-Lehmann method (R-estimator) are briefly introduced and applied in this paper. From the actual data analyses, it is known that the median does not guarantee robustness for a small number of data sets, and robust measures of location or the arithmetic mean without outliers are highly recommended if the distribution has tails or outliers. Care must be taken to measure the location because water quality level within a water body can change depending on the selected point estimator.

  • PDF

Nonlinear Friction Control Using the Robust Friction State Observer and Recurrent Fuzzy Neural Network Estimator (강인한 마찰 상태 관측기와 순환형 퍼지신경망 관측기를 이용한 비선형 마찰제어)

  • Han, Seong-Ik
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.18 no.1
    • /
    • pp.90-102
    • /
    • 2009
  • In this paper, a tracking control problem for a mechanical servo system with nonlinear dynamic friction is treated. The nonlinear friction model contains directly immeasurable friction state and the uncertainty caused by incomplete modeling and variations of its parameter. In order to provide the efficient solution to these control problems, we propose a hybrid control scheme, which consists of a robust friction state observer, a RFNN estimator and an approximation error estimator with sliding mode control. A sliding mode controller and a robust friction state observer is firstly designed to estimate the unknown infernal state of the LuGre friction model. Next, a RFNN estimator is introduced to approximate the unknown lumped friction uncertainty. Finally, an adaptive approximation error estimator is designed to compensate the approximation error of the RFNN estimator. Some simulations and experiments on the mechanical servo system composed of ball-screw and DC servo motor are presented. Results demonstrate the remarkable performance of the proposed control scheme.

A Robust Estimator in Multivariate Regression Using Least Quartile Difference

  • Jung Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.1
    • /
    • pp.39-46
    • /
    • 2005
  • We propose an equivariant and robust estimator in multivariate regression model based on the least quartile difference (LQD) estimator in univariate regression. We call this estimator as the multivariate least quartile difference (MLQD) estimator. The MLQD estimator considers correlations among response variables and it can be shown that the proposed estimator has the appropriate equivariance properties defined in multivariate regressions. The MLQD estimator has high breakdown point as does the univariate LQD estimator. We develop an algorithm for MLQD estimate. Simulations are performed to compare the efficiencies of MLQD estimate with coordinatewise LQD estimate and the multivariate least trimmed squares estimate.

An Equivariant and Robust Estimator in Multivariate Regression Based on Least Trimmed Squares

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.3
    • /
    • pp.1037-1046
    • /
    • 2003
  • We propose an equivariant and robust estimator in multivariate regression model based on the least trimmed squares (LTS) estimator in univariate regression. We call this estimator as multivariate least trimmed squares (MLTS) estimator. The MLTS estimator considers correlations among response variables and it can be shown that the proposed estimator has the appropriate equivariance properties defined in multivariate regression. The MLTS estimator has high breakdown point as does LTS estimator in univariate case. We develop an algorithm for MLTS estimate. Simulation are performed to compare the efficiencies of MLTS estimate with coordinatewise LTS estimate and a numerical example is given to illustrate the effectiveness of MLTS estimate in multivariate regression.

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

DETERMINATION OF OPTIMAL ROBUST ESTIMATION IN SELF CALIBRATING BUNDLE ADJUSTMENT (자체검정 번들조정법에 있어서 최적 ROBUST추정법의 결정)

  • 유환희
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.9 no.1
    • /
    • pp.75-82
    • /
    • 1991
  • The objective of this paper is to investigate the optimal Robust estimation and scale estimator that could be used to treat the gross errors in a self calibrating bundle adjustment. In order to test the variability in performance of the different weighting schemes in accurately detecting gross error, five robust estimation methods and three types of scale estimators were used. And also, two difference control point patterns(high density control, sparse density control) and three types of gross errors(4$\sigma o$, 20$\sigma o$, 50$\sigma o$) were used for comparison analysis. As a result, Anscombe's robust estimation produced the best results in accuracy among the robust estimation methods considered. when considering the scale estimator about control point patterns, It can be seen that Type II scale estimator provided the best accuracy in high density control pattern. On the other hand, In the case of sparse density control pattern, Type III scale estimator showed the best results in accuracy. Therefore it is expected to apply to robustified bundle adjustment using the optimal scale estimator which can be used for eliminating the gross error in precise structure analysis.

  • PDF

Robust Control Chart using Bootstrap Method (붓스트랩 방법을 이용한 로버스트 관리도)

  • 송서일;조영찬;박현규
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.26 no.3
    • /
    • pp.39-49
    • /
    • 2003
  • Statistical process cintrol is intended to assist operators of a stable system in monitoring whether a change has occurred in the process, and it uses several control charts as main tools. In design and use of control chart, it is rational that probability of false alarm is minimized in stable process and probability of detecting shifts is maximized in out-of-control. In this study, we establish bootstrap control limits for robust M-estimator chart by applying the bootstrap method, called resampling, which could not demand assumptions about pre-distribution when the process is skewed and/or the normality assumption is doubt. The results obtained in this study are summarized as follows : bootstrap M-estimator control chart is developed for applying bootstrap method to M-estimator chart, which is more robust to keep ARL when process contain contaminate quality characteristic.

Robust extreme quantile estimation for Pareto-type tails through an exponential regression model

  • Richard Minkah;Tertius de Wet;Abhik Ghosh;Haitham M. Yousof
    • Communications for Statistical Applications and Methods
    • /
    • v.30 no.6
    • /
    • pp.531-550
    • /
    • 2023
  • The estimation of extreme quantiles is one of the main objectives of statistics of extremes (which deals with the estimation of rare events). In this paper, a robust estimator of extreme quantile of a heavy-tailed distribution is considered. The estimator is obtained through the minimum density power divergence criterion on an exponential regression model. The proposed estimator was compared with two estimators of extreme quantiles in the literature in a simulation study. The results show that the proposed estimator is stable to the choice of the number of top order statistics and show lesser bias and mean square error compared to the existing extreme quantile estimators. Practical application of the proposed estimator is illustrated with data from the pedochemical and insurance industries.