Browse > Article
http://dx.doi.org/10.5351/CSAM.2014.21.4.349

Comparison of Lasso Type Estimators for High-Dimensional Data  

Kim, Jaehee (Department of Statistics, Duksung Women's University)
Publication Information
Communications for Statistical Applications and Methods / v.21, no.4, 2014 , pp. 349-361 More about this Journal
Abstract
This paper compares of lasso type estimators in various high-dimensional data situations with sparse parameters. Lasso, adaptive lasso, fused lasso and elastic net as lasso type estimators and ridge estimator are compared via simulation in linear models with correlated and uncorrelated covariates and binary regression models with correlated covariates and discrete covariates. Each method is shown to have advantages with different penalty conditions according to sparsity patterns of regression parameters. We applied the lasso type methods to Arabidopsis microarray gene expression data to find the strongly significant genes to distinguish two groups.
Keywords
Adaptive Lasso; elastic net; fused lasso; high-dimensional data; lasso; ridge;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Benjamin, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing, Journal of Royal Statistical Society B, 57, 289-300.
2 Buhlmann, P. and van de Geer, S. (2011). Statistics for High-Dimensional Data, Springer, New York.
3 Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression, Annals of Statistics, 32, 407-451.   DOI   ScienceOn
4 Efron, B. and Tibshirani, R. (1993). An Introduction to the Bootstrap, Chapman and Hall, London.
5 Friedman, J., Hasti, T. and Tibshirani, R. (2001). The Elements of Statistical Learning, Springer, New York.
6 Hoerl, A. E. and Kennard, R. W. (1970). Ridge regression: Applications to nonorthogonal problems, Technometrics, 12, 69-82.   DOI   ScienceOn
7 Kim, T. H., Hauser, F., Ha, T., Xue, S., Boehmer, M., Nishimura, N., Munemasa, S., Hubbard, K., Peine, N., Lee, B. H., Lee, S., Robert, N., Parker, J. E. and Schroeder, J. I. (2011). Chemical genetics reveals negative regulation of abscisic acid signaling by a plant immune response pathway, Current Biology, 21, 990-997.   DOI   ScienceOn
8 Kyung, M., Gill, J., Ghosh, M. and Casella, G. (2010). Penalized regression, standard errors, and Bayesian lassos, Bayesian Analysis, 5, 369-412.   DOI
9 Tibshirani, R., Saunders, M., Rosset, S., Zhu, J. and Knight, K. (2005). Sparsity and smoothness via the fused lasso, Journal of Royal Statistical Society B, 67, 91-108.   DOI   ScienceOn
10 Park, T. and Casella, G. (2008). The Bayesian lasso, Journal of the American Statistical Association, 103, 681-686.   DOI
11 Tibshirani, R. (1996). Regression shrinkage and selection via the lasso, Journal of Royal Statiatical Society B, 58, 267-288.
12 Zou, H. (2006). The adaptive lasso and its oracle properties, Journal of the American Statistical Association, 101, 1418-1429.   DOI
13 Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net, Journal of Royal Statistical Society B, 67, 301-320.   DOI   ScienceOn
14 Stein, C. (1981). Estimation of the mean of a multivariate normal distribution, The Annals of Statistics, 9, 1135-1151.   DOI   ScienceOn