Browse > Article
http://dx.doi.org/10.5351/KJAS.2016.29.3.471

A comparison study of various robust regression estimators using simulation  

Jang, Soohee (Department of Statistics & Information, Dongduk Women's University)
Yoon, Jungyeon (Korea Banking Institute)
Chun, Heuiju (Department of Statistics & Information, Dongduk Women's University)
Publication Information
The Korean Journal of Applied Statistics / v.29, no.3, 2016 , pp. 471-485 More about this Journal
Abstract
Least squares (LS) regression is a classic method for regression that is optimal under assumptions of regression and usual observations. However, the presence of unusual data in the LS method leads to seriously distorted estimates. Therefore, various robust estimation methods are proposed to circumvent the limitations of traditional LS regression. Among these, there are M-estimators based on maximum likelihood estimation (MLE), L-estimators based on linear combinations of order statistics and R-estimators based on a linear combinations of the ordered residuals. In this paper, robust regression estimators with high breakdown point and/or with high efficiency are compared under several simulated situations. The paper analyses and compares distributions of estimates as well as relative efficiencies calculated from mean squared errors (MSE) in the simulation study. We conclude that MM-estimators or GR-estimators are a good choice for the real data application.
Keywords
robust regression; breakdown point; M-estimation; L-estimation; R-estimation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Bellio, R. and Ventura, L. (2005). An introduction to robust estimation with R functions, In Proceedings of the 1st International Workshop on Robust Statistics and R, Treviso, Department of Statistics, Ca'Foscari University, Italy.
2 Chang, W. H., Mckean, J. W., Naranjo, J. D., and Sheather, S. J. (1999). High-Breakdown rank regression, Journal of the American Statistical Association, 94, 205-219.   DOI
3 Croux, C., Rousseeuw, P. J., and Hossjer. O. (1994). Generalized S-estimators, Journal of the American Statistical Association, 89, 1271-1281.   DOI
4 Hettmansperger, T. P., McKean, J. W., and Sheather, S. J. (1997). Rank-based analyses of linear models, Handbook of Statistics, G.S. Maddala and C.R. Rao eds., Elsevier, 145-173.
5 Huber, P. J. (1973). Robust regression: asymptotics, conjectures and Monte Carlo, Annals of Statistics, 1, 799-821.   DOI
6 Jaeckel, L. A. (1972). Estimating regression coefficients by minimizing the dispersion of residuals, Annals of Mathematical Statistics, 43, 1449-1458.   DOI
7 Mosteller, F. and Tukey, J. W. (1977). Data Analysis and Regression, A Second Course in Statistics, Addison-Wesley, MA.
8 Naranjo, J. D. and Hettmansperger, T. P. (1994). Bounded-influence rank regression, Journal of the Royal Statistical Society, Series B, 56, 209-220.
9 Rousseeuw, P. J. (1984). Least median of squares regression, Journal of the American Statistical Association, 79, 871-880.   DOI
10 Rousseeuw, P. J. (1985). Multivariate Estimation with High Breakdown Point, 283-297 in Mathematical Statistics and Applications, Vol. B, edited by W. Grossman, G. Pflug, I. Vince, and W. Wetz. Dordrecht: Reidel.
11 Rousseeuw, P. J. and Croux, C. (1993). Alternatives to the median absolute deviation, Journal of the American Statistical Association, 88, 1273-1283.   DOI
12 Rousseeuw, P. J. and Yohai, V. (1984). Robust Regression by Means of S-Estimators, Nonlinear Time Series Analysis, Lecture Notes in Statistics, 26, 256-272.
13 Siegel, A. F. (1982). Robust regression using repeated medians, Biometrika, 69, 242-244.   DOI
14 Stromberg, A. J., Hossjer, O., and Hawkins, D. M. (2000). The least trimmed differences regression estimator and alternatives, Journal of the American Statistical Association, 95, 853-864.   DOI
15 Yohai, V. J. (1987). High breakdown point and high efficiency robust estimates for regression, Annals of Statistics, 15, 642-656.   DOI
16 Yu, C., Yao, W., and Bai, X. (2014). Robust linear regression: a review and comparison, (Working Paper), Department of Statistics, Kansas State University, Manhattan, Kansas, USA 66506-0802.