• Title/Summary/Keyword: Least Squares Estimator

Search Result 159, Processing Time 0.026 seconds

MOMENTS OF VARIOGRAM ESTIMATOR FOR A GENERALIZED SKEW t DISTRIBUTION

  • KIM HYOUNG-MOON
    • Journal of the Korean Statistical Society
    • /
    • v.34 no.2
    • /
    • pp.109-123
    • /
    • 2005
  • Variogram estimation is an important step of spatial statistics since it determines the kriging weights. Matheron's variogram estimator can be written as a quadratic form of the observed data. In this paper, we extend a skew t distribution to a generalized skew t distribution and moments of the variogram estimator for a generalized skew t distribution are derived in closed forms. After calculating the correlation structure of the variogram estimator, variogram fitting by generalized least squares is discussed.

Determination of Minimum Eigenvalue in a Continuous-time Weighted Least Squares Estimator (연속시간 하중최소자승 식별기의 최소고우치 결정)

  • Kim, Sung-Duck
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.9
    • /
    • pp.1021-1030
    • /
    • 1992
  • When using a least squares estimator with exponential forgetting factor to identify continuous-time deterministic system, the problem of determining minimum eigenvalue is described in this paper. It is well known fact that the convergence rate of parameter estimates relies on various factors consisting of the estimator and especially, theirproperties can be directly affected by all eigenvalues in the parameter error differential equation. Fortunately, there exists only one adjusting eigenvalue in the given estimator and then, the parameter convergence rates depend on this minimum eigenvalue. In this note, a new result to determine the minimum eigenvalue is proposed. Under the assumption that the input has as many spectral lines as the number of parameter estimates, it can be proven that the minimum eigenvalue converges to a constant value, which is a function of the forgetting factor and the parameter estimates number.

  • PDF

Finite-Sample, Small-Dispersion Asymptotic Optimality of the Non-Linear Least Squares Estimator

  • So, Beong-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.2
    • /
    • pp.303-312
    • /
    • 1995
  • We consider the following type of general semi-parametric non-linear regression model : $y_i = f_i(\theta) + \epsilon_i, i=1, \cdots, n$ where ${f_i(\cdot)}$ represents the set of non-linear functions of the unknown parameter vector $\theta' = (\theta_1, \cdots, \theta_p)$ and ${\epsilon_i}$ represents the set of measurement errors with unknown distribution. Under suitable finite-sample, small-dispersion asymptotic framework, we derive a general lower bound for the asymptotic mean squared error (AMSE) matrix of the Gauss-consistent estimator of $\theta$. We then prove the fundamental result that the general non-linear least squares estimator (NLSE) is an optimal estimator within the class of all regular Gauss-consistent estimators irrespective of the type of the distribution of the measurement errors.

  • PDF

Pitfalls in the Application of the COTE in a Linear Regression Model with Seasonal Data

  • Seuck Heun Song;YouSung Park
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.353-358
    • /
    • 1997
  • When the disturbances in the linear repression medel are generated by a seasonal autoregressive scheme the Cochrane Orcutt transformation estimator (COTE) is a well known alternative to Generalized Least Squares estimator (GLSE). In this paper it is analyzed in which situation the Ordinary Least Squares estimator (OLSE) is always better than COTE for positive autocorrelation in terms of efficiency which is here defined as the ratio of the total variances.

  • PDF

A Robust Estimation Procedure for the Linear Regression Model

  • Kim, Bu-Yong
    • Journal of the Korean Statistical Society
    • /
    • v.16 no.2
    • /
    • pp.80-91
    • /
    • 1987
  • Minimum $L_i$ norm estimation is a robust procedure ins the sense that it leads to an estimator which has greater statistical eficiency than the least squares estimator in the presence of outliers. And the $L_1$ norm estimator has some desirable statistical properties. In this paper a new computational procedure for $L_1$ norm estimation is proposed which combines the idea of reweighted least squares method and the linear programming approach. A modification of the projective transformation method is employed to solve the linear programming problem instead of the simplex method. It is proved that the proposed algorithm terminates in a finite number of iterations.

  • PDF

Influence Assessment in Robust Regression

  • Sohn, Bang-Yong;Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.1
    • /
    • pp.21-32
    • /
    • 1997
  • Robust regression based on M-estimator reduces and/or bounds the influence of outliers in the y-direction only. Therefore, when several influential observations exist, diagnostics in the robust regression is required in order to detect them. In this paper, we propose influence diagnostics in the robust regression based on M-estimator and its one-step version. Noting that M-estimator can be obtained through iterative weighted least squares regression by using internal weights, we apply the weighted least squares (WLS) regression diagnostics to robust regression.

  • PDF

An Estimation of Parameters in Weibull Distribution Using Least Squares Method under Random Censoring Model (임의 중단모형에서 최소제곱법을 이용한 와이블분포의 모수 추정)

  • Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.263-272
    • /
    • 1996
  • In this parer, under random censorship model, an estimation of scale and shape parameters in Weibull lifetime model is considered. Based on nonparametric estimator of survival function, the least square method is proposed. The proposed estimation method is simple and the performance of the proposed estimator is as efficient as maximum likelihood estimators. An example is presented, using field winding data. Simulation studies are performed to compare the performaces of the proposed estimator and maximum likelihood estimator.

  • PDF

Mixture Filtering Approaches to Blind Equalization Based on Estimation of Time-Varying and Multi-Path Channels

  • Lim, Jaechan
    • Journal of Communications and Networks
    • /
    • v.18 no.1
    • /
    • pp.8-18
    • /
    • 2016
  • In this paper, we propose a number of blind equalization approaches for time-varying andmulti-path channels. The approaches employ cost reference particle filter (CRPF) as the symbol estimator, and additionally employ either least mean squares algorithm, recursive least squares algorithm, or $H{\infty}$ filter (HF) as a channel estimator such that they are jointly employed for the strategy of "Rao-Blackwellization," or equally called "mixture filtering." The novel feature of the proposed approaches is that the blind equalization is performed based on direct channel estimation with unknown noise statistics of the received signals and channel state system while the channel is not directly estimated in the conventional method, and the noise information if known in similar Kalman mixture filtering approach. Simulation results show that the proposed approaches estimate the transmitted symbols and time-varying channel very effectively, and outperform the previously proposed approach which requires the noise information in its application.

Weighted Least Absolute Deviation Lasso Estimator

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.6
    • /
    • pp.733-739
    • /
    • 2011
  • The linear absolute shrinkage and selection operator(Lasso) method improves the low prediction accuracy and poor interpretation of the ordinary least squares(OLS) estimate through the use of $L_1$ regularization on the regression coefficients. However, the Lasso is not robust to outliers, because the Lasso method minimizes the sum of squared residual errors. Even though the least absolute deviation(LAD) estimator is an alternative to the OLS estimate, it is sensitive to leverage points. We propose a robust Lasso estimator that is not sensitive to outliers, heavy-tailed errors or leverage points.

A Robust Estimator in Multivariate Regression Using Least Quartile Difference

  • Jung Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.1
    • /
    • pp.39-46
    • /
    • 2005
  • We propose an equivariant and robust estimator in multivariate regression model based on the least quartile difference (LQD) estimator in univariate regression. We call this estimator as the multivariate least quartile difference (MLQD) estimator. The MLQD estimator considers correlations among response variables and it can be shown that the proposed estimator has the appropriate equivariance properties defined in multivariate regressions. The MLQD estimator has high breakdown point as does the univariate LQD estimator. We develop an algorithm for MLQD estimate. Simulations are performed to compare the efficiencies of MLQD estimate with coordinatewise LQD estimate and the multivariate least trimmed squares estimate.