Browse > Article

Estimation of error variance in nonparametric regression under a finite sample using ridge regression  

Park, Chun-Gun (Kyonggi University, Department of Mathematics)
Publication Information
Journal of the Korean Data and Information Science Society / v.22, no.6, 2011 , pp. 1223-1232 More about this Journal
Abstract
Tong and Wang's estimator (2005) is a new approach to estimate the error variance using least squares method such that a simple linear regression is asymptotically derived from Rice's lag- estimator (1984). Their estimator highly depends on the setting of a regressor and weights in small sample sizes. In this article, we propose a new approach via a local quadratic approximation to set regressors in a small sample case. We estimate the error variance as the intercept using a ridge regression because the regressors have the problem of multicollinearity. From the small simulation study, the performance of our approach with some existing methods is better in small sample cases and comparable in large cases. More research is required on unequally spaced points.
Keywords
Difference-based estimator; least squares; Lipschitz condition; nonparametric regression; ridge regression; Taylor expansion;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Hall, P., Kay, J. W. and Titterinton, D. M. (1990). Asymptotically optimal difference-based estimator of variance in nonparametric regression. Biometrika, 77, 521-528.   DOI   ScienceOn
2 Hoerl, A. E., and Kennard, R. W. (1970a). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12, 55-67.   DOI   ScienceOn
3 Hoerl, A. E., and Kennard, R. W. (1970b). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12, 69-82.   DOI   ScienceOn
4 Park, C. G. (2009). An estimator of the mean of the squared functions for a nonparametric regression. Journal of the Korean Data & Information Science Society, 20, 577-585.
5 Park, C. G. (2011). On statistical properties of some difference-based error variance estimators in nonpara- metric regression with a nite sample. Journal of the Korean Data & Information Science Society, 22, 575-587.
6 Rice, J. A. (1984). Bandwidth choice for nonparametric regression. Annals of statistics, 12, 1215-1220.   DOI   ScienceOn
7 Seifert, B, Gasser, T. and Wolf, A. (1993). Nonparametric estimation of residual variance revisited. Biometrika, 80, 373-383.   DOI   ScienceOn
8 Tong, T. and Wang, Y. (2005). Estimating residual variance in nonparametric regression using least squares. Biometrika, 92, 821-830.   DOI   ScienceOn
9 Gasser, T., Sroka, L. and Jennen-Steinmetz, C. (1986). Residual variance and residual pattern in nonlinear regression. Biometrika, 73, 625-633.   DOI   ScienceOn
10 Dette, H., Munk, A. and Wagner, T. (1998). Estimating the variance in nonparametric regression- What is a reasonable choice? Journal of the Royal Statistical Society B, 60, 751-764.   DOI   ScienceOn