• 제목/요약/키워드: Regression estimators

검색결과 226건 처리시간 0.02초

Asymptotics Properties of LAD Estimators in Censored Nonlinear Regression Model

  • Park, Seung-Hoe;Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • 제27권1호
    • /
    • pp.101-112
    • /
    • 1998
  • This paper is concerned with the asymptotic properties of the least absolute deviation estimators for the nonlinear regression model when dependent variables are subject to censoring time, and proposed the simple and practical sufficient conditions for the strong consistency and asymptotic normality of the least absolute deviation estimators in censored regression model. Some desirable asymptotic properties including the asymptotic relative efficiency of proposed model with respect to standard model are given.

  • PDF

A study on robust regression estimators in heteroscedastic error models

  • Son, Nayeong;Kim, Mijeong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제28권5호
    • /
    • pp.1191-1204
    • /
    • 2017
  • Weighted least squares (WLS) estimation is often easily used for the data with heteroscedastic errors because it is intuitive and computationally inexpensive. However, WLS estimator is less robust to a few outliers and sometimes it may be inefficient. In order to overcome robustness problems, Box-Cox transformation, Huber's M estimation, bisquare estimation, and Yohai's MM estimation have been proposed. Also, more efficient estimations than WLS have been suggested such as Bayesian methods (Cepeda and Achcar, 2009) and semiparametric methods (Kim and Ma, 2012) in heteroscedastic error models. Recently, Çelik (2015) proposed the weight methods applicable to the heteroscedasticity patterns including butterfly-distributed residuals and megaphone-shaped residuals. In this paper, we review heteroscedastic regression estimators related to robust or efficient estimation and describe their properties. Also, we analyze cost data of U.S. Electricity Producers in 1955 using the methods discussed in the paper.

A Study on the Several Robust Regression Estimators

  • Kim, Jee-Yun;Roh, Kyung-Mi;Hwang, Jin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • 제15권2호
    • /
    • pp.307-316
    • /
    • 2004
  • Principal Component Regression(PCR) and Partial Least Squares Regression(PLSR) are the two most popular regression techniques in chemometrics. In the field of chemometrics usually the number of regressor variables greatly exceeds the number of observation. So we have to reduce the number of regressors to avoid the identifiability problem. In this paper we compare PCR and PLSR techniques combined with various robust regression methods including regression depth estimation. We compare the efficiency, goodness-of-fit and robustness of each estimators under several contamination schemes.

  • PDF

Improvement of Boundary Bias in Nonparametric Regression via Twicing Technique

  • Jo, Jae-Keun
    • Communications for Statistical Applications and Methods
    • /
    • 제4권2호
    • /
    • pp.445-452
    • /
    • 1997
  • In this paper, twicing technique for the improvement of asymptotic boundary bias in nonparametric regression is considered. Asymptotic mean squared errors of the nonparametric regression estimators are derived at the boundary region by twicing the Nadaraya-Waston and local linear smoothing. Asymptotic biases of the resulting estimators are of order$h^2$and$h^4$ respectively.

  • PDF

다양한 오염 상황에서의 여러 로버스트 회귀추정량의 비교연구 (A Comparison Study of Several Robust Regression Estimators under Various Contaminations)

  • 김지연;황진수;김진경
    • 응용통계연구
    • /
    • 제17권3호
    • /
    • pp.475-488
    • /
    • 2004
  • 위치추정량에서 로버스트한 추정기법 중의 하나로 알려진 데이터 뎁스(depth)를 회귀추정에 적용한 회귀뎁스(regression depth)는 Rousseeuw and Hubert(1999)에 의하여 제안되었다. 이 이외의 회귀뎁스 추정량으로는 심플리셜(simplicial) 뎁스와 사영(projection) 개념의 뎁스 회귀추정량들이 있다. 본 논문에서는 뎁스 기반 회귀추정량들의 성능에 대한 모의실험을 여러 오염 조건에서 행하여 비교하였으며 기존의 우수한 로버스트성을 지니는 추정량으로 최근에 제안된 HBR추정량(Chang et al., 1999)들과의 비교연구도 하였다. 2차원 공간에서의 실험은 전반적으로 사영뎁스기반 회귀추정량이 좋은 결과를 보여주었다.

Nonparametric Estimation using Regression Quantiles in a Regression Model

  • Han, Sang-Moon;Jung, Byoung-Cheol
    • 응용통계연구
    • /
    • 제25권5호
    • /
    • pp.793-802
    • /
    • 2012
  • One proposal is made to construct a nonparametric estimator of slope parameters in a regression model under symmetric error distributions. This estimator is based on the use of the idea of minimizing approximate variance of a proposed estimator using regression quantiles. This nonparametric estimator and some other L-estimators are studied and compared with well known M-estimators through a simulation study.

On a Robust Subset Selection Procedure for the Slopes of Regression Equations

  • Song, Moon-Sup;Oh, Chang-Hyuck
    • Journal of the Korean Statistical Society
    • /
    • 제10권
    • /
    • pp.105-121
    • /
    • 1981
  • The problem of selection of a subset containing the largest of several slope parameters of regression equations is considered. The proposed selection procedure is based on the weighted median estimators for regression parameters and the median of rescaled absolute residuals for scale parameters. Those estimators are compared with the classical least squares estimators by a simulation study. A Monte Carlo comparison is also made between the new procedure based on the weighted median estiamtors and the procedure based on the least squares estimators. The results show that the proposed procedure is quite robust with respect to the heaviness of distribution tails.

  • PDF

Comparison of Lasso Type Estimators for High-Dimensional Data

  • Kim, Jaehee
    • Communications for Statistical Applications and Methods
    • /
    • 제21권4호
    • /
    • pp.349-361
    • /
    • 2014
  • This paper compares of lasso type estimators in various high-dimensional data situations with sparse parameters. Lasso, adaptive lasso, fused lasso and elastic net as lasso type estimators and ridge estimator are compared via simulation in linear models with correlated and uncorrelated covariates and binary regression models with correlated covariates and discrete covariates. Each method is shown to have advantages with different penalty conditions according to sparsity patterns of regression parameters. We applied the lasso type methods to Arabidopsis microarray gene expression data to find the strongly significant genes to distinguish two groups.

The Strong Consistency of Nonlinear Least Squares Estimators

  • Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • 제18권2호
    • /
    • pp.85-96
    • /
    • 1989
  • This paper is concerned with the strong consistency of the least squares estimators for the nonlinear regression models. A simple and practical sufficient condition for the strong consistency of the least squares estimators is given. It is also discussed that the extension of the strong consistency to a wide class of regression functions can be established by imposing some condition on the input values. Some examples are given to illustrate the application of main result.

  • PDF

Admissible Hierarchical Bayes Estimators of a Multivariate Normal Mean Shrinking towards a Regression Surface

  • Cho, Byung-Yup;Choi, Kuey-Chung;Chang, In-Hong
    • Communications for Statistical Applications and Methods
    • /
    • 제3권2호
    • /
    • pp.205-216
    • /
    • 1996
  • Consider the problem of estimating a multivariate normal mean with an unknown covarience matrix under a weighted sum of squared error losses. We first provide hierarchical Bayes estimators which shrink the usual (maximum liklihood, uniformly minimum variance unbiased) estimator towards a regression surface and then prove the admissibility of these estimators using Blyth's (1951) method.

  • PDF