• Title/Summary/Keyword: Least squares estimator

Search Result 159, Processing Time 0.028 seconds

Classical and Bayesian methods of estimation for power Lindley distribution with application to waiting time data

  • Sharma, Vikas Kumar;Singh, Sanjay Kumar;Singh, Umesh
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.3
    • /
    • pp.193-209
    • /
    • 2017
  • The power Lindley distribution with some of its properties is considered in this article. Maximum likelihood, least squares, maximum product spacings, and Bayes estimators are proposed to estimate all the unknown parameters of the power Lindley distribution. Lindley's approximation and Markov chain Monte Carlo techniques are utilized for Bayesian calculations since posterior distribution cannot be reduced to standard distribution. The performances of the proposed estimators are compared based on simulated samples. The waiting times of research articles to be accepted in statistical journals are fitted to the power Lindley distribution with other competing distributions. Chi-square statistic, Kolmogorov-Smirnov statistic, Akaike information criterion and Bayesian information criterion are used to access goodness-of-fit. It was found that the power Lindley distribution gives a better fit for the data than other distributions.

An Asymptotic Property of Multivariate Autoregressive Model with Multiple Unit Roots

  • Shin, Key-Il
    • Journal of the Korean Statistical Society
    • /
    • v.23 no.1
    • /
    • pp.167-178
    • /
    • 1994
  • To estimate coefficient matrix in autoregressive model, usually ordinary least squares estimator or unconditional maximum likelihood estimator is used. It is unknown that for univariate AR(p) model, unconditional maximum likelihood estimator gives better power property that ordinary least squares estimator in testing for unit root with mean estimated. When autoregressive model contains multiple unit roots and unconditional likelihood function is used to estimate coefficient matrix, the seperation of nonstationary part and stationary part of the eigen-values in the estimated coefficient matrix in the limit is developed. This asymptotic property may give an idea to test for multiple unit roots.

  • PDF

Estimation for the Exponential ARMA Model (지수혼합 시계열 모형의 추정)

  • Won Kyung Kim;In Kyu Kim
    • The Korean Journal of Applied Statistics
    • /
    • v.7 no.2
    • /
    • pp.239-248
    • /
    • 1994
  • The Yule-Walker estimator and the approximate conditional least squares estimator of the parameter of the EARMA(1, 1) model are obtained. These two estimators are compared by simulation study. It is shown that the approximate conditional least squares estimator is better in the sense of the mean square error than the Yul-Walker estimator.

  • PDF

Estimation of error variance in nonparametric regression under a finite sample using ridge regression

  • Park, Chun-Gun
    • Journal of the Korean Data and Information Science Society
    • /
    • v.22 no.6
    • /
    • pp.1223-1232
    • /
    • 2011
  • Tong and Wang's estimator (2005) is a new approach to estimate the error variance using least squares method such that a simple linear regression is asymptotically derived from Rice's lag- estimator (1984). Their estimator highly depends on the setting of a regressor and weights in small sample sizes. In this article, we propose a new approach via a local quadratic approximation to set regressors in a small sample case. We estimate the error variance as the intercept using a ridge regression because the regressors have the problem of multicollinearity. From the small simulation study, the performance of our approach with some existing methods is better in small sample cases and comparable in large cases. More research is required on unequally spaced points.

LEAST ABSOLUTE DEVIATION ESTIMATOR IN FUZZY REGRESSION

  • KIM KYUNG JOONG;KIM DONG HO;CHOI SEUNG HOE
    • Journal of applied mathematics & informatics
    • /
    • v.18 no.1_2
    • /
    • pp.649-656
    • /
    • 2005
  • In this paper we consider a fuzzy least absolute deviation method in order to construct fuzzy linear regression model with fuzzy input and fuzzy output. We also consider two numerical examples to evaluate an effectiveness of the fuzzy least absolute deviation method and the fuzzy least squares method.

Alternative robust estimation methods for parameters of Gumbel distribution: an application to wind speed data with outliers

  • Aydin, Demet
    • Wind and Structures
    • /
    • v.26 no.6
    • /
    • pp.383-395
    • /
    • 2018
  • An accurate determination of wind speed distribution is the basis for an evaluation of the wind energy potential required to design a wind turbine, so it is important to estimate unknown parameters of wind speed distribution. In this paper, Gumbel distribution is used in modelling wind speed data, and alternative robust estimation methods to estimate its parameters are considered. The methodologies used to obtain the estimators of the parameters are least absolute deviation, weighted least absolute deviation, median/MAD and least median of squares. The performances of the estimators are compared with traditional estimation methods (i.e., maximum likelihood and least squares) according to bias, mean square deviation and total mean square deviation criteria using a Monte-Carlo simulation study for the data with and without outliers. The simulation results show that least median of squares and median/MAD estimators are more efficient than others for data with outliers in many cases. However, median/MAD estimator is not consistent for location parameter of Gumbel distribution in all cases. In real data application, it is firstly demonstrated that Gumbel distribution fits the daily mean wind speed data well and is also better one to model the data than Weibull distribution with respect to the root mean square error and coefficient of determination criteria. Next, the wind data modified by outliers is analysed to show the performance of the proposed estimators by using numerical and graphical methods.

Equivalence of GLS and Difference Estimator in the Linear Regression Model under Seasonally Autocorrelated Disturbances

  • Seuck Heun Song;Jong Hyup Lee
    • Communications for Statistical Applications and Methods
    • /
    • v.1 no.1
    • /
    • pp.112-118
    • /
    • 1994
  • The generalized least squares estimator in the linear regression model is equivalent to difference estimator irrespective of the particular form of the regressor matrix when the disturbances are generated by a seasonally autoregressive provess and autocorrelation is closed to unity.

  • PDF

Asymptotic Properties of Least Square Estimator of Disturbance Variance in the Linear Regression Model with MA(q)-Disturbances

  • Jong Hyup Lee;Seuck Heum Song
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.1
    • /
    • pp.111-117
    • /
    • 1997
  • The ordinary least squares estimator $S^2$ for the variance of the disturbances is considered in the linear regression model with sutocorrelated disturbances. It is proved that the OLS-estimator of disturbance variance is asymptotically unbiased and weakly consistent, when the distrubances are generated by an MA(q) process. In particular, the asymptotic unbiasedness and consistency of $S^2$ is satisfied without any restriction on the regressor matrix.

  • PDF

Nonlinear Regression Quantile Estimators

  • Park, Seung-Hoe;Kim, Hae kyung;Park, Kyung-Ok
    • Journal of the Korean Statistical Society
    • /
    • v.30 no.4
    • /
    • pp.551-561
    • /
    • 2001
  • This paper deals with the asymptotic properties for statistical inferences of the parameters in nonlinear regression models. As an optimal criterion for robust estimators of the regression parameters, the regression quantile method is proposed. This paper defines the regression quintile estimators in the nonlinear models and provides simple and practical sufficient conditions for the asymptotic normality of the proposed estimators when the parameter space is compact. The efficiency of the proposed estimator is especially well compared with least squares estimator, least absolute deviation estimator under asymmetric error distribution.

  • PDF

Resistant GPA algorithms based on the M and LMS estimation

  • Hyun, Geehong;Lee, Bo-Hui;Choi, Yong-Seok
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.6
    • /
    • pp.673-685
    • /
    • 2018
  • Procrustes analysis is a useful technique useful to measure, compare shape differences and estimate a mean shape for objects; however it is based on a least squares criterion and is affected by some outliers. Therefore, we propose two generalized Procrustes analysis methods based on M-estimation and least median of squares estimation that are resistant to object outliers. In addition, two algorithms are given for practical implementation. A simulation study and some examples are used to examine and compared the performances of the algorithms with the least square method. Moreover since these resistant GPA methods are available for higher dimensions, we need some methods to visualize the objects and mean shape effectively. Also since we have concentrated on resistant fitting methods without considering shape distributions, we wish to shape analysis not be sensitive to particular model.