Estimation of Ridge Regression Under the Integrate Mean Square Error Cirterion

  • Yong B. Lim ;
  • Park, Chi H. ;
  • Park, Sung H.
  • Published : 1980.06.01

Abstract

In response surface experiments, a polynomial model is often used to fit the response surface by the method of least squares. However, if the vectors of predictor variables are multicollinear, least squares estimates of the regression parameters have a high probability of being unsatisfactory. Hoerland Kennard have demonstrated that these undesirable effects of multicollinearity can be reduced by using "ridge" estimates in place of the least squares estimates. Ridge regrssion theory in literature has been mainly concerned with selection of k for the first order polynomial regression model and the precision of $\hat{\beta}(k)$, the ridge estimator of regression parameters. The problem considered in this paper is that of selecting k of ridge regression for a given polynomial regression model with an arbitrary order. A criterion is proposed for selection of k in the context of integrated mean square error of fitted responses, and illustrated with an example. Also, a type of admissibility condition is established and proved for the propose criterion.criterion.

Keywords

References

  1. J. Amer. Statist. Assoc. v.70 Directed ridge regression techniques in cases of multicollinearity GUILKEY,D.K.;MUPHY,J.L.
  2. Technometrics v.21 Some considerations in the evaluation of alternate prediction equations GUNST,R.F.;MASON,R.L.
  3. Technometrics v.16 The average estimated variance eriterion for the selection-of-variables problem in general linear models HELMS.R.W.
  4. Technometrics v.18 A class of biased estimator in linear regression HOCKING,R.R.;SPEED,F.M.;LYNN,M.J.
  5. Technometrics v.12 Ridge regression: 2space biased estimator for nonorthogonal problems HOERL,A.E.;KENNARD,R.W.
  6. Theor. Meth. v.4 Ridge regression : some simulations HOERL,A.E.;KENNARD,R.W.;BALDWIN,K.F.
  7. Technometrics v.12 Generalized inverses, ridge regression, biased linear estimation and nonorthogonal estimation MARQUARDT,D.W.
  8. Amer. Statist. v.29 Ridge regression in practice MARQUARDT,D.W.;SNEE,R.D.
  9. J. Amer. Statist. Assoc v.70 A Monte Carlo evaluation of some ridge type estimaters MCDONALD,G.C.;GALARNEAU,D.I.
  10. Response Surface Methodology Myers,R.H.
  11. Biometrics v.33 Selection of polynomial terms for response surface experiments PARK,S.H.
  12. Technometrics v.20 Selecting contrasts among parameter in Scheffe's mixture models: screening components and model rednction PARK,S.H.
  13. Essays in honor of Horold Hotelling Multiple regression. Contributions to Probability and Statistics STEIN.C.M.;I.Olkin(ed.)
  14. Technometrics v.20 A comparison of ridge estimators WICHERN,D.W.;CHURCHILL,G.A.