Browse > Article
http://dx.doi.org/10.5351/CKSS.2011.18.6.733

Weighted Least Absolute Deviation Lasso Estimator  

Jung, Kang-Mo (Department of Informatics & Statistics, Kunsan National University)
Publication Information
Communications for Statistical Applications and Methods / v.18, no.6, 2011 , pp. 733-739 More about this Journal
Abstract
The linear absolute shrinkage and selection operator(Lasso) method improves the low prediction accuracy and poor interpretation of the ordinary least squares(OLS) estimate through the use of $L_1$ regularization on the regression coefficients. However, the Lasso is not robust to outliers, because the Lasso method minimizes the sum of squared residual errors. Even though the least absolute deviation(LAD) estimator is an alternative to the OLS estimate, it is sensitive to leverage points. We propose a robust Lasso estimator that is not sensitive to outliers, heavy-tailed errors or leverage points.
Keywords
Heavy-tailed errors; Lasso; leverage points; outliers; robust estimator; weight least absolute deviation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties, Journal of the American Statistical Association, 96, 1348-1360.   DOI   ScienceOn
2 Giloni, A., Simonoff, J. S. and Sengupta, B. (2006). Robust weighted LAD regression, Computational Statistics and Data Analysis, 50, 3124-3140.   DOI   ScienceOn
3 Hoerl, A. E. and Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems, Technometrics, 12, 55-67.   DOI
4 Pollard, D. (1991). Asymptotics for least absolute deviation regression estimators, Economertric Theory, 7, 186-199.   DOI
5 Rousseeuw, P. J. and van Zomeren, B. C. (1990). Unmasking multivariate outliers and leverage points, Journal of the American Statistical Association, 85, 633-639.   DOI
6 Tibshirani, R. (1996). Regression shrinkage and selection via the lasso, Journal of Royal Statistical Society B, 58, 267-288.
7 Wang, H., Li, G. and Jiang, G. (2007). Robust regression shrinkage and consistent variable selection through the LAD-Lasso, Journal of Business & Economic Statistics, 25, 347-355.   DOI   ScienceOn
8 Zhao, P. and Yu, B. (2006). On model selection consistency of lasso, Journal of Machine Learning Research, 7, 2541-2563.
9 Zou, H. (2006) The adaptive Lasso and its oracle properties, Journal of the American Statistical Association, 101, 1418-1429.   DOI
10 Croux, C., Filzmoser, P., Pison, G. and Rousseeuw, P. J. (2003). Fitting multiplicative models by robust alternating regressions, Statistics and Computing, 13, 23-36.   DOI