• 제목/요약/키워드: marginal likelihood

검색결과 78건 처리시간 0.021초

On Profile Likelihood for Gamma Frailty Models

  • Ha, Il-Do
    • Journal of the Korean Data and Information Science Society
    • /
    • 제17권3호
    • /
    • pp.999-1007
    • /
    • 2006
  • The semiparametric gamma frailty models have been often used for multivariate survival analysis because they give an explicit marginal likelihood. The commonly used estimation procedure is the profile likelihood method based on marginal likelihood, which provides the same parameter estimates as the EM algorithm. In this paper we show in finite samples the standard profile-likelihood method can lead to an underestimation of parameters, particularly for the frailty parameter. To overcome this problem, we propose an adjusted profile-likelihood method. For the illustration a numerical example and a small-sample simulation study are presented.

  • PDF

Comparison of Hierarchical and Marginal Likelihood Estimators for Binary Outcomes

  • Yun, Sung-Cheol;Lee, Young-Jo;Ha, Il-Do;Kang, Wee-Chang
    • 한국통계학회:학술대회논문집
    • /
    • 한국통계학회 2003년도 춘계 학술발표회 논문집
    • /
    • pp.79-84
    • /
    • 2003
  • Likelihood estimation in random-effect models is often complicated because the marginal likelihood involves an analytically intractable integral. Numerical integration such as Gauss-Hermite quadrature is an option, but is generally not recommended when the dimensionality of the integral is high. An alternative is the use of hierarchical likelihood, which avoids such burdensome numerical integration. These two approaches for fitting binary data are compared and the advantages of using the hierarchical likelihood are discussed. Random-effect models for binary outcomes and for bivariate binary-continuous outcomes are considered.

  • PDF

Efficiency and Robustness of Fully Adaptive Simulated Maximum Likelihood Method

  • Oh, Man-Suk;Kim, Dai-Gyoung
    • Communications for Statistical Applications and Methods
    • /
    • 제16권3호
    • /
    • pp.479-485
    • /
    • 2009
  • When a part of data is unobserved the marginal likelihood of parameters given the observed data often involves analytically intractable high dimensional integral and hence it is hard to find the maximum likelihood estimate of the parameters. Simulated maximum likelihood(SML) method which estimates the marginal likelihood via Monte Carlo importance sampling and optimize the estimated marginal likelihood has been used in many applications. A key issue in SML is to find a good proposal density from which Monte Carlo samples are generated. The optimal proposal density is the conditional density of the unobserved data given the parameters and the observed data, and attempts have been given to find a good approximation to the optimal proposal density. Algorithms which adaptively improve the proposal density have been widely used due to its simplicity and efficiency. In this paper, we describe a fully adaptive algorithm which has been used by some practitioners but has not been well recognized in statistical literature, and evaluate its estimation performance and robustness via a simulation study. The simulation study shows a great improvement in the order of magnitudes in the mean squared error, compared to non-adaptive or partially adaptive SML methods. Also, it is shown that the fully adaptive SML is robust in a sense that it is insensitive to the starting points in the optimization routine.

ML estimation using Poisson HGLM approach in semi-parametric frailty models

  • Ha, Il Do
    • Journal of the Korean Data and Information Science Society
    • /
    • 제27권5호
    • /
    • pp.1389-1397
    • /
    • 2016
  • Semi-parametric frailty model with nonparametric baseline hazards has been widely used for the analyses of clustered survival-time data. The frailty models can be fitted via an auxiliary Poisson hierarchical generalized linear model (HGLM). For the inferences of the frailty model marginal likelihood, which gives MLE, is often used. The marginal likelihood is usually obtained by integrating out random effects, but it often requires an intractable integration. In this paper, we propose to obtain the MLE via Laplace approximation using a Poisson HGLM approach for semi-parametric frailty model. The proposed HGLM approach uses hierarchical-likelihood (h-likelihood), which avoids integration itself. The proposed method is illustrated using a numerical study.

A General Mixed Linear Model with Left-Censored Data

  • Ha, Il-Do
    • Communications for Statistical Applications and Methods
    • /
    • 제15권6호
    • /
    • pp.969-976
    • /
    • 2008
  • Mixed linear models have been widely used in various correlated data including multivariate survival data. In this paper we extend hierarchical-likelihood(h-likelihood) approach for mixed linear models with right censored data to that for left censored data. We also allow a general random-effect structure and propose the estimation procedure. The proposed method is illustrated using a numerical data set and is also compared with marginal likelihood method.

Comparing More than Two Agreement Measures Using Marginal Association

  • Oh, Myong-Sik
    • Communications for Statistical Applications and Methods
    • /
    • 제16권6호
    • /
    • pp.1023-1029
    • /
    • 2009
  • Oh (2009) has proposed a likelihood ratio test for comparing two agreements for dependent observations based on the concept of marginal homogeneity and marginal stochastic ordering. In this paper we consider the comparison of more than two agreement measures. Simple ordering and simple tree ordering among agreement measures are investigated. Some test procedures, including likelihood ratio test, are discussed.

Marginal Likelihoods for Bayesian Poisson Regression Models

  • Kim, Hyun-Joong;Balgobin Nandram;Kim, Seong-Jun;Choi, Il-Su;Ahn, Yun-Kee;Kim, Chul-Eung
    • Communications for Statistical Applications and Methods
    • /
    • 제11권2호
    • /
    • pp.381-397
    • /
    • 2004
  • The marginal likelihood has become an important tool for model selection in Bayesian analysis because it can be used to rank the models. We discuss the marginal likelihood for Poisson regression models that are potentially useful in small area estimation. Computation in these models is intensive and it requires an implementation of Markov chain Monte Carlo (MCMC) methods. Using importance sampling and multivariate density estimation, we demonstrate a computation of the marginal likelihood through an output analysis from an MCMC sampler.

Maximum Likelihood Estimation Using Laplace Approximation in Poisson GLMMs

  • Ha, Il-Do
    • Communications for Statistical Applications and Methods
    • /
    • 제16권6호
    • /
    • pp.971-978
    • /
    • 2009
  • Poisson generalized linear mixed models(GLMMs) have been widely used for the analysis of clustered or correlated count data. For the inference marginal likelihood, which is obtained by integrating out random effects is often used. It gives maximum likelihood(ML) estimator, but the integration is usually intractable. In this paper, we propose how to obtain the ML estimator via Laplace approximation based on hierarchical-likelihood (h-likelihood) approach under the Poisson GLMMs. In particular, the h-likelihood avoids the integration itself and gives a statistically efficient procedure for various random-effect models including GLMMs. The proposed method is illustrated using two practical examples and simulation studies.

Second-Order REML for Random Effects Models

  • 하일도;조건호
    • Journal of the Korean Data and Information Science Society
    • /
    • 제12권1호
    • /
    • pp.19-25
    • /
    • 2001
  • Random effects models which describe the dependence via random effects in various correlated data have recently received considerable attention in the biomedical literature. They include mixed linear models (MLMs), generatized linear mixed models (GLMMS) and hierarchical generalized linear models (HGLMs). For the inference Lee and Nelder (2000) proposed the first-and second-order REML (restricted maximum likelihood) methods based on hierarchical-likelihood of tee and Welder (1996). In this paper, for Poisson-gamma HGLMs the new methods are theoretically compared with marginal likelihood methods and both methods are illustrated by two practical examples.

  • PDF

A correction of SE from penalized partial likelihood in frailty models

  • Ha, Il-Do
    • Journal of the Korean Data and Information Science Society
    • /
    • 제20권5호
    • /
    • pp.895-903
    • /
    • 2009
  • The penalized partial likelihood based on restricted maximum likelihood method has been widely used for the inference of frailty models. However, the standard-error estimate for frailty parameter estimator can be downwardly biased. In this paper we show that such underestimation can be corrected by using hierarchical likelihood. In particular, the hierarchical likelihood gives a statistically efficient procedure for various random-effect models including frailty models. The proposed method is illustrated via a numerical example and simulation study. The simulation results demonstrate that the corrected standard-error estimate largely improves such bias.

  • PDF