• 제목/요약/키워드: Least squares estimator

검색결과 160건 처리시간 0.024초

Classical and Bayesian methods of estimation for power Lindley distribution with application to waiting time data

  • Sharma, Vikas Kumar;Singh, Sanjay Kumar;Singh, Umesh
    • Communications for Statistical Applications and Methods
    • /
    • 제24권3호
    • /
    • pp.193-209
    • /
    • 2017
  • The power Lindley distribution with some of its properties is considered in this article. Maximum likelihood, least squares, maximum product spacings, and Bayes estimators are proposed to estimate all the unknown parameters of the power Lindley distribution. Lindley's approximation and Markov chain Monte Carlo techniques are utilized for Bayesian calculations since posterior distribution cannot be reduced to standard distribution. The performances of the proposed estimators are compared based on simulated samples. The waiting times of research articles to be accepted in statistical journals are fitted to the power Lindley distribution with other competing distributions. Chi-square statistic, Kolmogorov-Smirnov statistic, Akaike information criterion and Bayesian information criterion are used to access goodness-of-fit. It was found that the power Lindley distribution gives a better fit for the data than other distributions.

An Asymptotic Property of Multivariate Autoregressive Model with Multiple Unit Roots

  • Shin, Key-Il
    • Journal of the Korean Statistical Society
    • /
    • 제23권1호
    • /
    • pp.167-178
    • /
    • 1994
  • To estimate coefficient matrix in autoregressive model, usually ordinary least squares estimator or unconditional maximum likelihood estimator is used. It is unknown that for univariate AR(p) model, unconditional maximum likelihood estimator gives better power property that ordinary least squares estimator in testing for unit root with mean estimated. When autoregressive model contains multiple unit roots and unconditional likelihood function is used to estimate coefficient matrix, the seperation of nonstationary part and stationary part of the eigen-values in the estimated coefficient matrix in the limit is developed. This asymptotic property may give an idea to test for multiple unit roots.

  • PDF

지수혼합 시계열 모형의 추정 (Estimation for the Exponential ARMA Model)

  • Won Kyung Kim;In Kyu Kim
    • 응용통계연구
    • /
    • 제7권2호
    • /
    • pp.239-248
    • /
    • 1994
  • 지수혼합 시계열 모형인 EARMA(1,1) 모형이 율-워커 추정법과 조건최소제곱 추정법으로 추정되었다. 율-워커 추정량은 이동평균모수가 포함된 ERAMA(1,1) 모형인 경우 유일하지 못하므로 가역 조건을 만족하는 추정량이 유일한 추정량으로 얻어졌고, 조건최소제곱 추정량은 근사추정량이 얻어졌다. 모의 실험을 통하여 근사조건제곱 추정량은 율-워커 추정량보다 평균제곱오차면에서 훨씬 좋은 추정량으로 나타났다.

  • PDF

Estimation of error variance in nonparametric regression under a finite sample using ridge regression

  • Park, Chun-Gun
    • Journal of the Korean Data and Information Science Society
    • /
    • 제22권6호
    • /
    • pp.1223-1232
    • /
    • 2011
  • Tong and Wang's estimator (2005) is a new approach to estimate the error variance using least squares method such that a simple linear regression is asymptotically derived from Rice's lag- estimator (1984). Their estimator highly depends on the setting of a regressor and weights in small sample sizes. In this article, we propose a new approach via a local quadratic approximation to set regressors in a small sample case. We estimate the error variance as the intercept using a ridge regression because the regressors have the problem of multicollinearity. From the small simulation study, the performance of our approach with some existing methods is better in small sample cases and comparable in large cases. More research is required on unequally spaced points.

LEAST ABSOLUTE DEVIATION ESTIMATOR IN FUZZY REGRESSION

  • KIM KYUNG JOONG;KIM DONG HO;CHOI SEUNG HOE
    • Journal of applied mathematics & informatics
    • /
    • 제18권1_2호
    • /
    • pp.649-656
    • /
    • 2005
  • In this paper we consider a fuzzy least absolute deviation method in order to construct fuzzy linear regression model with fuzzy input and fuzzy output. We also consider two numerical examples to evaluate an effectiveness of the fuzzy least absolute deviation method and the fuzzy least squares method.

Alternative robust estimation methods for parameters of Gumbel distribution: an application to wind speed data with outliers

  • Aydin, Demet
    • Wind and Structures
    • /
    • 제26권6호
    • /
    • pp.383-395
    • /
    • 2018
  • An accurate determination of wind speed distribution is the basis for an evaluation of the wind energy potential required to design a wind turbine, so it is important to estimate unknown parameters of wind speed distribution. In this paper, Gumbel distribution is used in modelling wind speed data, and alternative robust estimation methods to estimate its parameters are considered. The methodologies used to obtain the estimators of the parameters are least absolute deviation, weighted least absolute deviation, median/MAD and least median of squares. The performances of the estimators are compared with traditional estimation methods (i.e., maximum likelihood and least squares) according to bias, mean square deviation and total mean square deviation criteria using a Monte-Carlo simulation study for the data with and without outliers. The simulation results show that least median of squares and median/MAD estimators are more efficient than others for data with outliers in many cases. However, median/MAD estimator is not consistent for location parameter of Gumbel distribution in all cases. In real data application, it is firstly demonstrated that Gumbel distribution fits the daily mean wind speed data well and is also better one to model the data than Weibull distribution with respect to the root mean square error and coefficient of determination criteria. Next, the wind data modified by outliers is analysed to show the performance of the proposed estimators by using numerical and graphical methods.

Equivalence of GLS and Difference Estimator in the Linear Regression Model under Seasonally Autocorrelated Disturbances

  • Seuck Heun Song;Jong Hyup Lee
    • Communications for Statistical Applications and Methods
    • /
    • 제1권1호
    • /
    • pp.112-118
    • /
    • 1994
  • The generalized least squares estimator in the linear regression model is equivalent to difference estimator irrespective of the particular form of the regressor matrix when the disturbances are generated by a seasonally autoregressive provess and autocorrelation is closed to unity.

  • PDF

Asymptotic Properties of Least Square Estimator of Disturbance Variance in the Linear Regression Model with MA(q)-Disturbances

  • Jong Hyup Lee;Seuck Heum Song
    • Communications for Statistical Applications and Methods
    • /
    • 제4권1호
    • /
    • pp.111-117
    • /
    • 1997
  • The ordinary least squares estimator $S^2$ for the variance of the disturbances is considered in the linear regression model with sutocorrelated disturbances. It is proved that the OLS-estimator of disturbance variance is asymptotically unbiased and weakly consistent, when the distrubances are generated by an MA(q) process. In particular, the asymptotic unbiasedness and consistency of $S^2$ is satisfied without any restriction on the regressor matrix.

  • PDF

Nonlinear Regression Quantile Estimators

  • Park, Seung-Hoe;Kim, Hae kyung;Park, Kyung-Ok
    • Journal of the Korean Statistical Society
    • /
    • 제30권4호
    • /
    • pp.551-561
    • /
    • 2001
  • This paper deals with the asymptotic properties for statistical inferences of the parameters in nonlinear regression models. As an optimal criterion for robust estimators of the regression parameters, the regression quantile method is proposed. This paper defines the regression quintile estimators in the nonlinear models and provides simple and practical sufficient conditions for the asymptotic normality of the proposed estimators when the parameter space is compact. The efficiency of the proposed estimator is especially well compared with least squares estimator, least absolute deviation estimator under asymmetric error distribution.

  • PDF

Resistant GPA algorithms based on the M and LMS estimation

  • Hyun, Geehong;Lee, Bo-Hui;Choi, Yong-Seok
    • Communications for Statistical Applications and Methods
    • /
    • 제25권6호
    • /
    • pp.673-685
    • /
    • 2018
  • Procrustes analysis is a useful technique useful to measure, compare shape differences and estimate a mean shape for objects; however it is based on a least squares criterion and is affected by some outliers. Therefore, we propose two generalized Procrustes analysis methods based on M-estimation and least median of squares estimation that are resistant to object outliers. In addition, two algorithms are given for practical implementation. A simulation study and some examples are used to examine and compared the performances of the algorithms with the least square method. Moreover since these resistant GPA methods are available for higher dimensions, we need some methods to visualize the objects and mean shape effectively. Also since we have concentrated on resistant fitting methods without considering shape distributions, we wish to shape analysis not be sensitive to particular model.