Browse > Article
http://dx.doi.org/10.5351/CKSS.2007.14.1.215

Variable Selection in Sliced Inverse Regression Using Generalized Eigenvalue Problem with Penalties  

Park, Chong-Sun (Department of Statistics, Sungkyunkwan University)
Publication Information
Communications for Statistical Applications and Methods / v.14, no.1, 2007 , pp. 215-227 More about this Journal
Abstract
Variable selection algorithm for Sliced Inverse Regression using penalty function is proposed. We noted SIR models can be expressed as generalized eigenvalue decompositions and incorporated penalty functions on them. We found from small simulation that the HARD penalty function seems to be the best in preserving original directions compared with other well-known penalty functions. Also it turned out to be effective in forcing coefficient estimates zero for irrelevant predictors in regression analysis. Results from illustrative examples of simulated and real data sets will be provided.
Keywords
Sliced inverse regression; variable selection; penalty functions; simulated annealing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Kirkpatrick, S., Gelatt, C. D. Jr. and Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220, 671-680   DOI   ScienceOn
2 Li, K. C. (2000). High dimensional data analysis via the SIR/PHD approach. unpublished manuscript
3 McCabe, G. P. (1984). Principal variables. Technometrics, 26, 137-144   DOI
4 Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Ser. B, 58, 267-288
5 Vines, S. K. (2000). Simple principal components. Applied Statistics, 49, 441-451
6 Aarts, E. and Korst, J. (1989). Simulated Annealing and Boltzmasui Machines. John Wiley & Sons
7 Breiman, L. (1995). Better subset regression using the nonnegative garrote. Technometrics, 37, 373-384   DOI
8 Cadima, J. and Jolliffe, I. T. (1995). Loadings and correlations in the interpretation of principal components. Journal of Applied Statistics, 22, 203-214   DOI   ScienceOn
9 Fan, J. and Li, R. (2001). Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties. Journal of The American Statistical Association, 96, 1348-1360   DOI   ScienceOn
10 Hausman, R. E. Jr. (1982). Constrained multivariate analysis. Optimisation in Statistics (Zanckis, S. H. and Rustagi, J. S., eds.), 137-151, North-Holland: Amsterdam
11 Jolliffe, I. T. (1972). Discarding variables in a principal component analysis. I: artificial data. Applied Statistics, 21, 160-173   DOI   ScienceOn
12 Jolliffe, I. T. (1973). Discarding variables in a principal component analysis. ii: real data. Applied Statistics, 22, 21-31   DOI   ScienceOn
13 Jolliffe, I. T. (1995). Rotation of principal components: choice of normalization constraints. Journal of Applied Statistics, 22, 29-35   DOI   ScienceOn
14 Jolliffe, I. T., Trendafilov, N. T. and Uddin, M. (2003). A modified principal component technique based on the Lasso. Journal of Computational and Graphical Statistics, 12, 531-547   DOI   ScienceOn
15 Jolliffe, I. T. (1989). Rotation of Ill-defined principal components. Applied Statistics, 38, 139-147   DOI   ScienceOn
16 Li, K. C. (1991). Sliced inverse regression for dimension reduction. Journal of The American Statistical Association, 86, 316-342   DOI