• Title/Summary/Keyword: Regression estimators

Search Result 226, Processing Time 0.017 seconds

Asymptotics Properties of LAD Estimators in Censored Nonlinear Regression Model

  • Park, Seung-Hoe;Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • v.27 no.1
    • /
    • pp.101-112
    • /
    • 1998
  • This paper is concerned with the asymptotic properties of the least absolute deviation estimators for the nonlinear regression model when dependent variables are subject to censoring time, and proposed the simple and practical sufficient conditions for the strong consistency and asymptotic normality of the least absolute deviation estimators in censored regression model. Some desirable asymptotic properties including the asymptotic relative efficiency of proposed model with respect to standard model are given.

  • PDF

A study on robust regression estimators in heteroscedastic error models

  • Son, Nayeong;Kim, Mijeong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.5
    • /
    • pp.1191-1204
    • /
    • 2017
  • Weighted least squares (WLS) estimation is often easily used for the data with heteroscedastic errors because it is intuitive and computationally inexpensive. However, WLS estimator is less robust to a few outliers and sometimes it may be inefficient. In order to overcome robustness problems, Box-Cox transformation, Huber's M estimation, bisquare estimation, and Yohai's MM estimation have been proposed. Also, more efficient estimations than WLS have been suggested such as Bayesian methods (Cepeda and Achcar, 2009) and semiparametric methods (Kim and Ma, 2012) in heteroscedastic error models. Recently, Çelik (2015) proposed the weight methods applicable to the heteroscedasticity patterns including butterfly-distributed residuals and megaphone-shaped residuals. In this paper, we review heteroscedastic regression estimators related to robust or efficient estimation and describe their properties. Also, we analyze cost data of U.S. Electricity Producers in 1955 using the methods discussed in the paper.

A Study on the Several Robust Regression Estimators

  • Kim, Jee-Yun;Roh, Kyung-Mi;Hwang, Jin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.2
    • /
    • pp.307-316
    • /
    • 2004
  • Principal Component Regression(PCR) and Partial Least Squares Regression(PLSR) are the two most popular regression techniques in chemometrics. In the field of chemometrics usually the number of regressor variables greatly exceeds the number of observation. So we have to reduce the number of regressors to avoid the identifiability problem. In this paper we compare PCR and PLSR techniques combined with various robust regression methods including regression depth estimation. We compare the efficiency, goodness-of-fit and robustness of each estimators under several contamination schemes.

  • PDF

Improvement of Boundary Bias in Nonparametric Regression via Twicing Technique

  • Jo, Jae-Keun
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.445-452
    • /
    • 1997
  • In this paper, twicing technique for the improvement of asymptotic boundary bias in nonparametric regression is considered. Asymptotic mean squared errors of the nonparametric regression estimators are derived at the boundary region by twicing the Nadaraya-Waston and local linear smoothing. Asymptotic biases of the resulting estimators are of order$h^2$and$h^4$ respectively.

  • PDF

A Comparison Study of Several Robust Regression Estimators under Various Contaminations (다양한 오염 상황에서의 여러 로버스트 회귀추정량의 비교연구)

  • 김지연;황진수;김진경
    • The Korean Journal of Applied Statistics
    • /
    • v.17 no.3
    • /
    • pp.475-488
    • /
    • 2004
  • Several robust regression estimators are compared under contamination. Symmetric and asymmetric contamination schemes are used to measure the variance and MSE of regression estimators. Under asymmetric contamination depth-based regression estimator, especially projection based regression estimator(rcent) outperforms the rest and under symmetric contamination HBR performs relatively well.

Nonparametric Estimation using Regression Quantiles in a Regression Model

  • Han, Sang-Moon;Jung, Byoung-Cheol
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.5
    • /
    • pp.793-802
    • /
    • 2012
  • One proposal is made to construct a nonparametric estimator of slope parameters in a regression model under symmetric error distributions. This estimator is based on the use of the idea of minimizing approximate variance of a proposed estimator using regression quantiles. This nonparametric estimator and some other L-estimators are studied and compared with well known M-estimators through a simulation study.

On a Robust Subset Selection Procedure for the Slopes of Regression Equations

  • Song, Moon-Sup;Oh, Chang-Hyuck
    • Journal of the Korean Statistical Society
    • /
    • v.10
    • /
    • pp.105-121
    • /
    • 1981
  • The problem of selection of a subset containing the largest of several slope parameters of regression equations is considered. The proposed selection procedure is based on the weighted median estimators for regression parameters and the median of rescaled absolute residuals for scale parameters. Those estimators are compared with the classical least squares estimators by a simulation study. A Monte Carlo comparison is also made between the new procedure based on the weighted median estiamtors and the procedure based on the least squares estimators. The results show that the proposed procedure is quite robust with respect to the heaviness of distribution tails.

  • PDF

Comparison of Lasso Type Estimators for High-Dimensional Data

  • Kim, Jaehee
    • Communications for Statistical Applications and Methods
    • /
    • v.21 no.4
    • /
    • pp.349-361
    • /
    • 2014
  • This paper compares of lasso type estimators in various high-dimensional data situations with sparse parameters. Lasso, adaptive lasso, fused lasso and elastic net as lasso type estimators and ridge estimator are compared via simulation in linear models with correlated and uncorrelated covariates and binary regression models with correlated covariates and discrete covariates. Each method is shown to have advantages with different penalty conditions according to sparsity patterns of regression parameters. We applied the lasso type methods to Arabidopsis microarray gene expression data to find the strongly significant genes to distinguish two groups.

The Strong Consistency of Nonlinear Least Squares Estimators

  • Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • v.18 no.2
    • /
    • pp.85-96
    • /
    • 1989
  • This paper is concerned with the strong consistency of the least squares estimators for the nonlinear regression models. A simple and practical sufficient condition for the strong consistency of the least squares estimators is given. It is also discussed that the extension of the strong consistency to a wide class of regression functions can be established by imposing some condition on the input values. Some examples are given to illustrate the application of main result.

  • PDF

Admissible Hierarchical Bayes Estimators of a Multivariate Normal Mean Shrinking towards a Regression Surface

  • Cho, Byung-Yup;Choi, Kuey-Chung;Chang, In-Hong
    • Communications for Statistical Applications and Methods
    • /
    • v.3 no.2
    • /
    • pp.205-216
    • /
    • 1996
  • Consider the problem of estimating a multivariate normal mean with an unknown covarience matrix under a weighted sum of squared error losses. We first provide hierarchical Bayes estimators which shrink the usual (maximum liklihood, uniformly minimum variance unbiased) estimator towards a regression surface and then prove the admissibility of these estimators using Blyth's (1951) method.

  • PDF