• Title/Summary/Keyword: maximum likelihood estimator

Search Result 416, Processing Time 0.029 seconds

An Asymptotic Property of Multivariate Autoregressive Model with Multiple Unit Roots

  • Shin, Key-Il
    • Journal of the Korean Statistical Society
    • /
    • v.23 no.1
    • /
    • pp.167-178
    • /
    • 1994
  • To estimate coefficient matrix in autoregressive model, usually ordinary least squares estimator or unconditional maximum likelihood estimator is used. It is unknown that for univariate AR(p) model, unconditional maximum likelihood estimator gives better power property that ordinary least squares estimator in testing for unit root with mean estimated. When autoregressive model contains multiple unit roots and unconditional likelihood function is used to estimate coefficient matrix, the seperation of nonstationary part and stationary part of the eigen-values in the estimated coefficient matrix in the limit is developed. This asymptotic property may give an idea to test for multiple unit roots.

  • PDF

A Comparison of Estimation Methods for Weibull Distribution and Type I Censoring (와이블 분포와 정시중단 하에서의 MLE와 LSE의 정확도 비교)

  • Kim, Seong-Il;Park, Min-Yong;Park, Jung-Won
    • Journal of Korean Society for Quality Management
    • /
    • v.38 no.4
    • /
    • pp.480-490
    • /
    • 2010
  • In this paper, two estimation methods(least square estimation and maximum likelihood estimation) were compared for Weibull distribution and Type I censoring. Data obtained by Monte Carlo simulation were analyzed using two estimation methods and analysis results were compared by MSE(Mean Squared Error). Comparison results show that maximum likelihood estimator is better for censored data and complete data with more than 30 samples and least square estimator is better for small size complete data(less than and equal to 20 samples).

Comparison of Two Parametric Estimators for the Entropy of the Lognormal Distribution (로그정규분포의 엔트로피에 대한 두 모수적 추정량의 비교)

  • Choi, Byung-Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.5
    • /
    • pp.625-636
    • /
    • 2011
  • This paper proposes two parametric entropy estimators, the minimum variance unbiased estimator and the maximum likelihood estimator, for the lognormal distribution for a comparison of the properties of the two estimators. The variances of both estimators are derived. The influence of the bias of the maximum likelihood estimator on estimation is analytically revealed. The distributions of the proposed estimators obtained by the delta approximation method are also presented. Performance comparisons are made with the two estimators. The following observations are made from the results. The MSE efficacy of the minimum variance unbiased estimator appears consistently high and increases rapidly as the sample size and variance, n and ${\sigma}^2$, become simultaneously small. To conclude, the minimum variance unbiased estimator outperforms the maximum likelihood estimator.

GOODNESS-OF-FIT TEST USING LOCAL MAXIMUM LIKELIHOOD POLYNOMIAL ESTIMATOR FOR SPARSE MULTINOMIAL DATA

  • Baek, Jang-Sun
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.3
    • /
    • pp.313-321
    • /
    • 2004
  • We consider the problem of testing cell probabilities in sparse multinomial data. Aerts et al. (2000) presented T=${{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2$ as a test statistic with the local least square polynomial estimator ${{p}_{i}}^{*}$, and derived its asymptotic distribution. The local least square estimator may produce negative estimates for cell probabilities. The local maximum likelihood polynomial estimator ${{\hat{p}}_{i}}$, however, guarantees positive estimates for cell probabilities and has the same asymptotic performance as the local least square estimator (Baek and Park, 2003). When there are cell probabilities with relatively much different sizes, the same contribution of the difference between the estimator and the hypothetical probability at each cell in their test statistic would not be proper to measure the total goodness-of-fit. We consider a Pearson type of goodness-of-fit test statistic, $T_1={{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2/p_{i}$ instead, and show it follows an asymptotic normal distribution. Also we investigate the asymptotic normality of $T_2={{\Sigma}_{i=1}}^{k}{[{p_i}^{*}-E{(p_{i}}^{*})]^2/p_{i}$ where the minimum expected cell frequency is very small.

Reliability Estimation for a Shared-Load System Based on Freund Model

  • Hong, Yeon-Woong;Lee, Jae-Man;Cha, Young-Joon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.6 no.2
    • /
    • pp.1-7
    • /
    • 1995
  • This paper considers the reliability estimation of a two-component shared-load system based on Freund model. Maximum likelihood estimator, order restricted maximum likelihood estimator and uniformly minimum variance unbiased estimator of the reliability function for the system are obtained. Performance of three estimators for moderate sample sizes is studied by simulation.

  • PDF

A Note on Estimation Under Discrete Time Observations in the Simple Stochastic Epidemic Model

  • Oh, Chang-Hyuck
    • Journal of the Korean Statistical Society
    • /
    • v.22 no.1
    • /
    • pp.133-138
    • /
    • 1993
  • We consider two estimators of the infection rate in the simple stochastic epidemic model. It is shown that the maximum likelihood estimator of teh infection rate under the discrete time observation does not have the moment of any positive order. Some properties of the Choi-Severo estimator, an approximation to the maximum likelihood estimator, are also investigated.

  • PDF

Lifetime Performance Index for Weibull Distribution: Estimation and Applications (와이블 분포를 따를 때 수명성능지수의 추정과 활용)

  • Seo, Sun-Keun
    • Journal of Applied Reliability
    • /
    • v.13 no.3
    • /
    • pp.191-206
    • /
    • 2013
  • Application areas for Lifetime Performance Index(LPI), a kind of process capability index to be frequently used as a means of measuring process performance are illustrated with examples. Statistical properties for maximum likelihood and unbiased estimators of LPI are evaluated and discussed under Weibull distribution with known shape parameter. Furthermore, guidelines for selecting an estimator of LPI are also presented.

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

Convergence of Score process in the Cox Proportional Hazards Model

  • Hwang, Jin-Soo
    • Journal of the Korean Statistical Society
    • /
    • v.26 no.1
    • /
    • pp.117-130
    • /
    • 1997
  • We study the asymptotic behavior of the maximum partial likelihood estimator in the Cox proportional hazards model in the presence of nuisance parameters when the entry of patients is staggered. When entry of patients is simultaneous and there is only one regression parameter in the Cox model, the efficient score process of the partial likelihood is martingale and converges weakly to a time-chnaged Brownian motion. Our problem is to get a similar result in the presence of nuisance parameters when entry of patient is staggered.

  • PDF

Maximum Likelihood Estimation Using Laplace Approximation in Poisson GLMMs

  • Ha, Il-Do
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.6
    • /
    • pp.971-978
    • /
    • 2009
  • Poisson generalized linear mixed models(GLMMs) have been widely used for the analysis of clustered or correlated count data. For the inference marginal likelihood, which is obtained by integrating out random effects is often used. It gives maximum likelihood(ML) estimator, but the integration is usually intractable. In this paper, we propose how to obtain the ML estimator via Laplace approximation based on hierarchical-likelihood (h-likelihood) approach under the Poisson GLMMs. In particular, the h-likelihood avoids the integration itself and gives a statistically efficient procedure for various random-effect models including GLMMs. The proposed method is illustrated using two practical examples and simulation studies.