• Title/Summary/Keyword: MCMC method

Search Result 103, Processing Time 0.019 seconds

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

Bayesian Estimation of Three-parameter Bathtub Shaped Lifetime Distribution Based on Progressive Type-II Censoring with Binomial Removal

  • Chung, Younshik
    • Journal of the Korean Data Analysis Society
    • /
    • v.20 no.6
    • /
    • pp.2747-2757
    • /
    • 2018
  • We consider the MLE (maximum likelihood estimate) and Bayesian estimates of three-parameter bathtub-shaped lifetime distribution based on the progressive type II censoring with binomial removal. Jung, Chung (2018) proposed the three-parameter bathtub-shaped distribution which is the extension of the two-parameter bathtub-shaped distribution given by Zhang (2004). Jung, Chung (2018) investigated its properties and estimations. The maximum likelihood estimates are computed using Newton-Raphson algorithm. Also, Bayesian estimates are obtained under the balanced loss function using MCMC (Markov chain Monte Carlo) method. In particular, BSEL (balanced squared error loss) function is considered as a special form of balanced loss function given by Zellner (1994). For comparing theirs MLEs with the corresponding Bayes estimates, some simulations are performed. It shows that Bayes estimates is better than MLEs in terms of risks. Finally, concluding remarks are mentioned.

A Bayesian joint model for continuous and zero-inflated count data in developmental toxicity studies

  • Hwang, Beom Seuk
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.2
    • /
    • pp.239-250
    • /
    • 2022
  • In many applications, we frequently encounter correlated multiple outcomes measured on the same subject. Joint modeling of such multiple outcomes can improve efficiency of inference compared to independent modeling. For instance, in developmental toxicity studies, fetal weight and number of malformed pups are measured on the pregnant dams exposed to different levels of a toxic substance, in which the association between such outcomes should be taken into account in the model. The number of malformations may possibly have many zeros, which should be analyzed via zero-inflated count models. Motivated by applications in developmental toxicity studies, we propose a Bayesian joint modeling framework for continuous and count outcomes with excess zeros. In our model, zero-inflated Poisson (ZIP) regression model would be used to describe count data, and a subject-specific random effects would account for the correlation across the two outcomes. We implement a Bayesian approach using MCMC procedure with data augmentation method and adaptive rejection sampling. We apply our proposed model to dose-response analysis in a developmental toxicity study to estimate the benchmark dose in a risk assessment.

MCMC Approach for Parameter Estimation in the Structural Analysis and Prognosis

  • An, Da-Wn;Gang, Jin-Hyuk;Choi, Joo-Ho
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.23 no.6
    • /
    • pp.641-649
    • /
    • 2010
  • Estimation of uncertain parameters is required in many engineering problems which involve probabilistic structural analysis as well as prognosis of existing structures. In this case, Bayesian framework is often employed, which is to represent the uncertainty of parameters in terms of probability distributions conditional on the provided data. The resulting form of distribution, however, is not amenable to the practical application due to its complex nature making the standard probability functions useless. In this study, Markov chain Monte Carlo (MCMC) method is proposed to overcome this difficulty, which is a modern computational technique for the efficient and straightforward estimation of parameters. Three case studies that implement the estimation are presented to illustrate the concept. The first one is an inverse estimation, in which the unknown input parameters are inversely estimated based on a finite number of measured response data. The next one is a metamodel uncertainty problem that arises when the original response function is approximated by a metamodel using a finite set of response values. The last one is a prognostics problem, in which the unknown parameters of the degradation model are estimated based on the monitored data.

Variational Bayesian multinomial probit model with Gaussian process classification on mice protein expression level data (가우시안 과정 분류에 대한 변분 베이지안 다항 프로빗 모형: 쥐 단백질 발현 데이터에의 적용)

  • Donghyun Son;Beom Seuk Hwang
    • The Korean Journal of Applied Statistics
    • /
    • v.36 no.2
    • /
    • pp.115-127
    • /
    • 2023
  • Multinomial probit model is a popular model for multiclass classification and choice model. Markov chain Monte Carlo (MCMC) method is widely used for estimating multinomial probit model, but its computational cost is high. However, it is well known that variational Bayesian approximation is more computationally efficient than MCMC, because it uses subsets of samples. In this study, we describe multinomial probit model with Gaussian process classification and how to employ variational Bayesian approximation on the model. This study also compares the results of variational Bayesian multinomial probit model to the results of naive Bayes, K-nearest neighbors and support vector machine for the UCI mice protein expression level data.

Bayesian Inference for the Zero In ated Negative Binomial Regression Model (제로팽창 음이항 회귀모형에 대한 베이지안 추론)

  • Shim, Jung-Suk;Lee, Dong-Hee;Jun, Byoung-Cheol
    • The Korean Journal of Applied Statistics
    • /
    • v.24 no.5
    • /
    • pp.951-961
    • /
    • 2011
  • In this paper, we propose a Bayesian inference using the Markov Chain Monte Carlo(MCMC) method for the zero inflated negative binomial(ZINB) regression model. The proposed model allows the regression model for zero inflation probability as well as the regression model for the mean of the dependent variable. This extends the work of Jang et al. (2010) to the fully defiend ZINB regression model. In addition, we apply the proposed method to a real data example, and compare the efficiency with the zero inflated Poisson model using the DIC. Since the DIC of the ZINB is smaller than that of the ZIP, the ZINB model shows superior performance over the ZIP model in zero inflated count data with overdispersion.

Semiparametric Bayesian Hierarchical Selection Models with Skewed Elliptical Distribution (왜도 타원형 분포를 이용한 준모수적 계층적 선택 모형)

  • 정윤식;장정훈
    • The Korean Journal of Applied Statistics
    • /
    • v.16 no.1
    • /
    • pp.101-115
    • /
    • 2003
  • Lately there has been much theoretical and applied interest in linear models with non-normal heavy tailed error distributions. Starting Zellner(1976)'s study, many authors have explored the consequences of non-normality and heavy-tailed error distributions. We consider hierarchical models including selection models under a skewed heavy-tailed e..o. distribution proposed originally by Chen, Dey and Shao(1999) and Branco and Dey(2001) with Dirichlet process prior(Ferguson, 1973) in order to use a meta-analysis. A general calss of skewed elliptical distribution is reviewed and developed. Also, we consider the detail computational scheme under skew normal and skew t distribution using MCMC method. Finally, we introduce one example from Johnson(1993)'s real data and apply our proposed methodology.

Application of Bayesian Approach to Parameter Estimation of TANK Model: Comparison of MCMC and GLUE Methods (TANK 모형의 매개변수 추정을 위한 베이지안 접근법의 적용: MCMC 및 GLUE 방법의 비교)

  • Kim, Ryoungeun;Won, Jeongeun;Choi, Jeonghyeon;Lee, Okjeong;Kim, Sangdan
    • Journal of Korean Society on Water Environment
    • /
    • v.36 no.4
    • /
    • pp.300-313
    • /
    • 2020
  • The Bayesian approach can be used to estimate hydrologic model parameters from the prior expert knowledge about the parameter values and the observed data. The purpose of this study was to compare the performance of the two Bayesian methods, the Metropolis-Hastings (MH) algorithm and the Generalized Likelihood Uncertainty Estimation (GLUE) method. These two methods were applied to the TANK model, a hydrological model comprising 13 parameters, to examine the uncertainty of the parameters of the model. The TANK model comprises a combination of multiple reservoir-type virtual vessels with orifice-type outlets and implements a common major hydrological process using the runoff calculations that convert the rainfall to the flow. As a result of the application to the Nam River A watershed, the two Bayesian methods yielded similar flow simulation results even though the parameter estimates obtained by the two methods were of somewhat different values. Both methods ensure the model's prediction accuracy even when the observed flow data available for parameter estimation is limited. However, the prediction accuracy of the model using the MH algorithm yielded slightly better results than that of the GLUE method. The flow duration curve calculated using the limited observed flow data showed that the marginal reliability is secured from the perspective of practical application.

Bayesian Mode1 Selection and Diagnostics for Nonlinear Regression Model (베이지안 비선형회귀모형의 선택과 진단)

  • 나종화;김정숙
    • The Korean Journal of Applied Statistics
    • /
    • v.15 no.1
    • /
    • pp.139-151
    • /
    • 2002
  • This study is concerned with model selection and diagnostics for nonlinear regression model through Bayes factor. In this paper, we use informative prior and simulate observations from the posterior distribution via Markov chain Monte Carlo. We propose the Laplace approximation method and apply the Laplace-Metropolis estimator to solve the computational difficulty of Bayes factor.

Estimation of Volatility of Korea Stock Price Index Using Winbugs (Winbugs를 이용한 우리나라 주가지수의 변동성에 대한 추정)

  • Kim, Hyoung Min;Chang, In Hong;Lee, Seung Woo
    • Journal of Integrative Natural Science
    • /
    • v.4 no.2
    • /
    • pp.121-129
    • /
    • 2011
  • The purpose of this paper is to estimate the fluctuation of an earning rate and risk management using the price index of Korea stocks. After an observation of conception of fluctuation, we can show volatility clustering and fluctuation phenomenon in the Korea stock price index using GARCH model with heteroscedasticity. In addition, the effects of fluctuation on the time-series was evaluated, which showed the heteroscedasticity. MCMC method and Winbugs as Bayesian computation were used for analysis.