• Title/Summary/Keyword: linear estimator

Search Result 391, Processing Time 0.024 seconds

Autocovariance based estimation in the linear regression model (선형회귀 모형에서 자기공분산 기반 추정)

  • Park, Cheol-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.5
    • /
    • pp.839-847
    • /
    • 2011
  • In this study, we derive an estimator based on autocovariance for the regression coefficients vector in the multiple linear regression model. This method is suggested by Park (2009), and although this method does not seem to be intuitively attractive, this estimator is unbiased for the regression coefficients vector. When the vectors of exploratory variables satisfy some regularity conditions, under mild conditions which are satisfied when errors are from autoregressive and moving average models, this estimator has asymptotically the same distribution as the least squares estimator and also converges in probability to the regression coefficients vector. Finally we provide a simulation study that the forementioned theoretical results hold for small sample cases.

Generalized Maximum Entropy Estimator for the Linear Regression Model with a Spatial Autoregressive Disturbance (오차항이 SAR(1)을 따르는 공간선형회귀모형에서 일반화 최대엔트로피 추정량에 관한 연구)

  • Cheon, Soo-Young;Lim, Seong-Seop
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.2
    • /
    • pp.265-275
    • /
    • 2009
  • This paper considers a linear regression model with a spatial autoregressive disturbance with ill-posed data and proposes the generalized maximum entropy(GME) estimator of regression coefficients. The performance of this estimator is investigated via Monte Carlo experiments. The results show that the GME estimator provides efficient and robust estimate for the unknown parameter.

The Nonparametric Deconvolution Problem with Gaussian Error Distribution

  • Cho, Wan-Hyun;Park, Jeong-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.2
    • /
    • pp.265-276
    • /
    • 1996
  • The nonparametric deconvolution problems are studied to recover an unknown density when the data are contaminated with Gaussian error. We propose the estimator which is a linear combination of kernel type estimates of derivertives of the observed density function. We show that this estimator is consistent and also consider the properties of estimator at small sample by simulation.

  • PDF

Weighted Least Absolute Deviation Lasso Estimator

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.6
    • /
    • pp.733-739
    • /
    • 2011
  • The linear absolute shrinkage and selection operator(Lasso) method improves the low prediction accuracy and poor interpretation of the ordinary least squares(OLS) estimate through the use of $L_1$ regularization on the regression coefficients. However, the Lasso is not robust to outliers, because the Lasso method minimizes the sum of squared residual errors. Even though the least absolute deviation(LAD) estimator is an alternative to the OLS estimate, it is sensitive to leverage points. We propose a robust Lasso estimator that is not sensitive to outliers, heavy-tailed errors or leverage points.

A Study on Estimating Mean Lifetime After Modifying Censored Observations

  • Kim, Jinh-eum;Kim, Jee-hoon
    • Journal of Korean Society for Quality Management
    • /
    • v.26 no.1
    • /
    • pp.161-171
    • /
    • 1998
  • Kim and Kim (1997) developed a method of estimating the mean lifetime based on the augmented data after imputing censored observations. Assuming the linear relationship between lifetime and covariates, and then introducing the procedure of Buckley and James (1979) to estimate the mean lifetimes of censored observations, they proposed a mean lifetime estimator and its consistency under the regularity conditions. In this article, the Kim and Kim's estimator is compared with the estimator introduced by Gill (1983) through simulations under the various configurations. Also, their estimator is illustrated with two real data sets.

  • PDF

Linear Region Extension of MR Curve in ML Based Monopulse (ML 기반 모노 펄스 MR 커브의 선형 영역의 확장)

  • Kim, Heung-Su;Lim, Jong-Hwan;Yang, Hoon-Gee;Chung, Young-Seek;Kim, Doo-Soo;Lee, Hee-Young;Kim, Seon-Joo
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.23 no.6
    • /
    • pp.748-751
    • /
    • 2012
  • The performance of a monopulse estimator is depend on its monopulse ratio(MR) curve. To improve its performance, a mathematical expression of the MR curve that is associated with an array the parameters is needed. In this paper, we present a novel monopulse estimator that uses the inverse function of a MR curve for the Maximum Likelihood (ML)-based monopulse estimator. It is shown that the proposed method can extend the linear region of the MR curve, which in turn improve the estimation accuracy. Moreover, it's performance is compared with the ML-based method through simulation.

A High Breakdown and Efficient GM-Estimator in Linear Models

  • Song, Moon-Sup;Park, Changsoon;Nam, Ho-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.4
    • /
    • pp.471-487
    • /
    • 1996
  • In this paper we propose an efficient scoring type one-step GM-estimator, which has a bounded influence function and a high break-down point. The main point of the estimator is in the weighting scheme of the GM-estimator. The weight function we used depends on both leverage points and residuals So we construct an estimator which does not downweight good leverage points Unider some regularity conditions, we compute the finite-sample breakdown point and prove asymptotic normality Some simulation results are also presented.

  • PDF

An Efficient Mallows-Type One-Step GM-Estimator in linear Models

  • Song, Moon-Sup;Park, Changsoon;Nam, Ho-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.27 no.3
    • /
    • pp.369-383
    • /
    • 1998
  • This paper deals with a robust regression estimator. We propose an efficient one-step GM-estimator, which has a bounded influence function and a high breakdown point. The main idea of this paper is to use the Mallows-type weights which depend on both the predictor variables and the residuals from a high breakdown initial estimator. The proposed weighting scheme severely downweights the bad leverage points and slightly downweights the good leverage points. Under some regularity conditions, we compute the finite-sample breakdown point and prove the asymptotic normality. Some simulation results and a numerical example are also presented.

  • PDF

ONNEGATIVE MINIMUM BIASED ESTIMATION IN VARIANCE COMPONENT MODELS

  • Lee, Jong-Hoo
    • East Asian mathematical journal
    • /
    • v.5 no.1
    • /
    • pp.95-110
    • /
    • 1989
  • In a general variance component model, nonnegative quadratic estimators of the components of variance are considered which are invariant with respect to mean value translaion and have minimum bias (analogously to estimation theory of mean value parameters). Here the minimum is taken over an appropriate cone of positive semidefinite matrices, after having made a reduction by invariance. Among these estimators, which always exist the one of minimum norm is characterized. This characterization is achieved by systems of necessary and sufficient condition, and by a cone restricted pseudoinverse. In models where the decomposing covariance matrices span a commutative quadratic subspace, a representation of the considered estimator is derived that requires merely to solve an ordinary convex quadratic optimization problem. As an example, we present the two way nested classification random model. An unbiased estimator is derived for the mean squared error of any unbiased or biased estimator that is expressible as a linear combination of independent sums of squares. Further, it is shown that, for the classical balanced variance component models, this estimator is the best invariant unbiased estimator, for the variance of the ANOVA estimator and for the mean squared error of the nonnegative minimum biased estimator. As an example, the balanced two way nested classification model with ramdom effects if considered.

  • PDF

Variance estimation of a double expanded estimator for two-phase sampling

  • Mingue Park
    • Communications for Statistical Applications and Methods
    • /
    • v.30 no.4
    • /
    • pp.403-410
    • /
    • 2023
  • Two-Phase sampling, which was first introduced by Neyman (1938), has various applications in different forms. Variance estimation for two-phase sampling has been an important research topic because conventional variance estimators used in most softwares are not working. In this paper, we considered a variance estimation for two-phase sampling in which stratified two-stage cluster sampling designs are used in both phases. By defining a conditionally unbiased estimator of an approximate variance estimator, which is calculable when all elements in the first phase sample are observed, we propose an explicit form of variance estimator of the double expanded estimator for a two-phase sample. A small simulation study shows the proposed variance estimator has a negligible bias with small variance. The suggested variance estimator is also applicable to other linear estimators of the population total or mean if appropriate residuals are defined.