• Title/Summary/Keyword: Likelihood function

Search Result 604, Processing Time 0.041 seconds

An Asymptotic Property of Multivariate Autoregressive Model with Multiple Unit Roots

  • Shin, Key-Il
    • Journal of the Korean Statistical Society
    • /
    • v.23 no.1
    • /
    • pp.167-178
    • /
    • 1994
  • To estimate coefficient matrix in autoregressive model, usually ordinary least squares estimator or unconditional maximum likelihood estimator is used. It is unknown that for univariate AR(p) model, unconditional maximum likelihood estimator gives better power property that ordinary least squares estimator in testing for unit root with mean estimated. When autoregressive model contains multiple unit roots and unconditional likelihood function is used to estimate coefficient matrix, the seperation of nonstationary part and stationary part of the eigen-values in the estimated coefficient matrix in the limit is developed. This asymptotic property may give an idea to test for multiple unit roots.

  • PDF

An Estimation of Parameters in Weibull Distribution Using Least Squares Method under Random Censoring Model (임의 중단모형에서 최소제곱법을 이용한 와이블분포의 모수 추정)

  • Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.7 no.2
    • /
    • pp.263-272
    • /
    • 1996
  • In this parer, under random censorship model, an estimation of scale and shape parameters in Weibull lifetime model is considered. Based on nonparametric estimator of survival function, the least square method is proposed. The proposed estimation method is simple and the performance of the proposed estimator is as efficient as maximum likelihood estimators. An example is presented, using field winding data. Simulation studies are performed to compare the performaces of the proposed estimator and maximum likelihood estimator.

  • PDF

MLE for Incomplete Contingency Tables with Lagrangian Multiplier

  • Kang, Shin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.17 no.3
    • /
    • pp.919-925
    • /
    • 2006
  • Maximum likelihood estimate(MLE) is obtained from the partial log-likelihood function for the cell probabilities of two way incomplete contingency tables proposed by Chen and Fienberg(1974). The partial log-likelihood function is modified by adding lagrangian multiplier that constraints can be incorporated with. Variances of MLE estimators of population proportions are derived from the matrix of second derivatives of the loglikelihood with respect to cell probabilities. Simulation results, when data are missing at random, reveal that Complete-case(CC) analysis produces biased estimates of joint probabilities under MAR and less efficient than either MLE or MI. MLE and MI provides consistent results under either the MAR situation. MLE provides more efficient estimates of population proportions than either multiple imputation(MI) based on data augmentation or complete case analysis. The standard errors of MLE from the proposed method using lagrangian multiplier are valid and have less variation than the standard errors from MI and CC.

  • PDF

A computational note on maximum likelihood estimation in random effects panel probit model

  • Lee, Seung-Chun
    • Communications for Statistical Applications and Methods
    • /
    • v.26 no.3
    • /
    • pp.315-323
    • /
    • 2019
  • Panel data sets have recently been developed in various areas, and many recent studies have analyzed panel, or longitudinal data sets. Often a dichotomous dependent variable occur in survival analysis, biomedical and epidemiological studies that is analyzed by a generalized linear mixed effects model (GLMM). The most common estimation method for the binary panel data may be the maximum likelihood (ML). Many statistical packages provide ML estimates; however, the estimates are computed from numerically approximated likelihood function. For instance, R packages, pglm (Croissant, 2017) approximate the likelihood function by the Gauss-Hermite quadratures, while Rchoice (Sarrias, Journal of Statistical Software, 74, 1-31, 2016) use a Monte Carlo integration method for the approximation. As a result, it can be observed that different packages give different results because of different numerical computation methods. In this note, we discuss the pros and cons of numerical methods compared with the exact computation method.

Estimation for the Half-Triangle Distribution Based on Progressively Type-II Censored Samples

  • Han, Jun-Tae;Kang, Suk-Bok
    • Journal of the Korean Data and Information Science Society
    • /
    • v.19 no.3
    • /
    • pp.951-957
    • /
    • 2008
  • We derive some approximate maximum likelihood estimators(AMLEs) and maximum likelihood estimator(MLE) of the scale parameter in the half-triangle distribution based on progressively Type-II censored samples. We compare the proposed estimators in the sense of the mean squared error for various censored samples. We also obtain the approximate maximum likelihood estimators of the reliability function using the proposed estimators. We compare the proposed estimators in the sense of the mean squared error.

  • PDF

Fault diagnosis based on likelihood decomposition

  • Uosaki, Katsuji;Kagawa, Tetsuo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1992.10b
    • /
    • pp.272-275
    • /
    • 1992
  • A novel fault diagnosis method based on likelihood decomposition is proposed for linear stochastic systems described by autoregressive (AR) model. Assuming that at some time instant .tau. the fault of one of the following two types is occurs: innovation fault (actuator fault); and observation fault (sensor fault), the log-likelihood function is decomposed into two components based on the observations before and after .tau., respectively, Then, the type of the fault is determined by comparing the log-likelihoods corresponding two types of faults. Numerical examples demonstrate the usefulness of the proposed diagnosis method.

  • PDF

QUASI-LIKELIHOOD REGRESSION FOR VARYING COEFFICIENT MODELS WITH LONGITUDINAL DATA

  • Kim, Choong-Rak;Jeong, Mee-Seon;Kim, Woo-Chul;Park, Byeong-U.
    • Journal of the Korean Statistical Society
    • /
    • v.33 no.4
    • /
    • pp.367-379
    • /
    • 2004
  • This article deals with the nonparametric analysis of longitudinal data when there exist possible correlations among repeated measurements for a given subject. We consider a quasi-likelihood regression model where a transformation of the regression function through a link function is linear in time-varying coefficients. We investigate the local polynomial approach to estimate the time-varying coefficients, and derive the asymptotic distribution of the estimators in this quasi-likelihood context. A real data set is analyzed as an illustrative example.

Wakeby Distribution and the Maximum Likelihood Estimation Algorithm in Which Probability Density Function Is Not Explicitly Expressed

  • Park Jeong-Soo
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.443-451
    • /
    • 2005
  • The studied in this paper is a new algorithm for searching the maximum likelihood estimate(MLE) in which probability density function is not explicitly expressed. Newton-Raphson's root-finding routine and a nonlinear numerical optimization algorithm with constraint (so-called feasible sequential quadratic programming) are used. This algorithm is applied to the Wakeby distribution which is importantly used in hydrology and water resource research for analysis of extreme rainfall. The performance comparison between maximum likelihood estimates and method of L-moment estimates (L-ME) is studied by Monte-carlo simulation. The recommended methods are L-ME for up to 300 observations and MLE for over the sample size, respectively. Methods for speeding up the algorithm and for computing variances of estimates are discussed.

A spatial analysis of Neyman-Scott rectangular pulses model using an approximate likelihood function (근사적 우도함수를 이용한 Neyman-Scott 구형펄스모형의 공간구조 분석)

  • Lee, Jeongjin;Kim, Yongku
    • Journal of the Korean Data and Information Science Society
    • /
    • v.27 no.5
    • /
    • pp.1119-1131
    • /
    • 2016
  • The Neyman-Scott Rectangular Pulses Model (NSRPM) is mainly used to construct hourly rainfall series. This model uses a modest number of parameters to represent the rainfall processes and underlying physical phenomena, such as the arrival of storms or rain cells. In NSRPM, the method of moments has often been used because it is difficult to know the distribution of rainfall intensity. Recently, approximated likelihood function for NSRPM has been introduced. In this paper, we propose a hierarchical model for applying a spatial structure to the NSRPM parameters using the approximated likelihood function. The proposed method is applied to summer hourly precipitation data observed at 59 weather stations (Korea Meteorological Administration) from 1973 to 2011.

Likelihood ratio in estimating gamma distribution parameters

  • Rahman, Mezbahur;Muraduzzaman, S. M.
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.345-354
    • /
    • 2010
  • The Gamma Distribution is widely used in Engineering and Industrial applications. Estimation of parameters is revisited in the two-parameter Gamma distribution. The parameters are estimated by minimizing the likelihood ratios. A comparative study between the method of moments, the maximum likelihood method, the method of product spacings, and minimization of three different likelihood ratios is performed using simulation. For the scale parameter, the maximum likelihood estimate performs better and for the shape parameter, the product spacings estimate performs better. Among the three likelihood ratio statistics considered, the Anderson-Darling statistic has inferior performance compared to the Cramer-von-Misses statistic and the Kolmogorov-Smirnov statistic.