• Title/Summary/Keyword: Bayesian MCMC(Markov Chain Monte Carlo)

Search Result 88, Processing Time 0.028 seconds

On the Bayesian Statistical Inference (베이지안 통계 추론)

  • Lee, Ho-Suk
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.06c
    • /
    • pp.263-266
    • /
    • 2007
  • This paper discusses the Bayesian statistical inference. This paper discusses the Bayesian inference, MCMC (Markov Chain Monte Carlo) integration, MCMC method, Metropolis-Hastings algorithm, Gibbs sampling, Maximum likelihood estimation, Expectation Maximization algorithm, missing data processing, and BMA (Bayesian Model Averaging). The Bayesian statistical inference is used to process a large amount of data in the areas of biology, medicine, bioengineering, science and engineering, and general data analysis and processing, and provides the important method to draw the optimal inference result. Lastly, this paper discusses the method of principal component analysis. The PCA method is also used for data analysis and inference.

  • PDF

Bayesian Analysis for a Functional Regression Model with Truncated Errors in Variables

  • Kim, Hea-Jung
    • Journal of the Korean Statistical Society
    • /
    • v.31 no.1
    • /
    • pp.77-91
    • /
    • 2002
  • This paper considers a functional regression model with truncated errors in explanatory variables. We show that the ordinary least squares (OLS) estimators produce bias in regression parameter estimates under misspecified models with ignored errors in the explanatory variable measurements, and then propose methods for analyzing the functional model. Fully parametric frequentist approaches for analyzing the model are intractable and thus Bayesian methods are pursued using a Markov chain Monte Carlo (MCMC) sampling based approach. Necessary theories involved in modeling and computation are provided. Finally, a simulation study is given to illustrate and examine the proposed methods.

Markov Chain Monte Carlo simulation based Bayesian updating of model parameters and their uncertainties

  • Sengupta, Partha;Chakraborty, Subrata
    • Structural Engineering and Mechanics
    • /
    • v.81 no.1
    • /
    • pp.103-115
    • /
    • 2022
  • The prediction error variances for frequencies are usually considered as unknown in the Bayesian system identification process. However, the error variances for mode shapes are taken as known to reduce the dimension of an identification problem. The present study attempts to explore the effectiveness of Bayesian approach of model parameters updating using Markov Chain Monte Carlo (MCMC) technique considering the prediction error variances for both the frequencies and mode shapes. To remove the ergodicity of Markov Chain, the posterior distribution is obtained by Gaussian Random walk over the proposal distribution. The prior distributions of prediction error variances of modal evidences are implemented through inverse gamma distribution to assess the effectiveness of estimation of posterior values of model parameters. The issue of incomplete data that makes the problem ill-conditioned and the associated singularity problem is prudently dealt in by adopting a regularization technique. The proposed approach is demonstrated numerically by considering an eight-storey frame model with both complete and incomplete modal data sets. Further, to study the effectiveness of the proposed approach, a comparative study with regard to accuracy and computational efficacy of the proposed approach is made with the Sequential Monte Carlo approach of model parameter updating.

Uncertainty reduction of seismic fragility of intake tower using Bayesian Inference and Markov Chain Monte Carlo simulation

  • Alam, Jahangir;Kim, Dookie;Choi, Byounghan
    • Structural Engineering and Mechanics
    • /
    • v.63 no.1
    • /
    • pp.47-53
    • /
    • 2017
  • The fundamental goal of this study is to minimize the uncertainty of the median fragility curve and to assess the structural vulnerability under earthquake excitation. Bayesian Inference with Markov Chain Monte Carlo (MCMC) simulation has been presented for efficient collapse response assessment of the independent intake water tower. The intake tower is significantly used as a diversion type of the hydropower station for maintaining power plant, reservoir and spillway tunnel. Therefore, the seismic fragility assessment of the intake tower is a pivotal component for estimating total system risk of the reservoir. In this investigation, an asymmetrical independent slender reinforced concrete structure is considered. The Bayesian Inference method provides the flexibility to integrate the prior information of collapse response data with the numerical analysis results. The preliminary information of risk data can be obtained from various sources like experiments, existing studies, and simplified linear dynamic analysis or nonlinear static analysis. The conventional lognormal model is used for plotting the fragility curve using the data from time history simulation and nonlinear static pushover analysis respectively. The Bayesian Inference approach is applied for integrating the data from both analyses with the help of MCMC simulation. The method achieves meaningful improvement of uncertainty associated with the fragility curve, and provides significant statistical and computational efficiency.

Bayesian Filter-Based Mobile Tracking under Realistic Network Setting (실제 네트워크를 고려한 베이지안 필터 기반 이동단말 위치 추적)

  • Kim, Hyowon;Kim, Sunwoo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.41 no.9
    • /
    • pp.1060-1068
    • /
    • 2016
  • The range-free localization using connectivity information has problems of mobile tracking. This paper proposes two Bayesian filter-based mobile tracking algorithms considering a propagation scenario. Kalman and Markov Chain Monte Carlo (MCMC) particle filters are applied according to linearity of two measurement models. Measurement models of the Kalman and MCMC particle filter-based algorithms respectively are defined as connectivity between mobiles, information fusion of connectivity information and received signal strength (RSS) from neighbors within one-hop. To perform the accurate simulation, we consider a real indoor map of shopping mall and degree of radio irregularity (DOI) model. According to obstacles between mobiles, we assume two types of DOIs. We show the superiority of the proposed algorithm over existing range-free algorithms through MATLAB simulations.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

Analyze the parameter uncertainty of SURR model using Bayesian Markov Chain Monte Carlo method with informal likelihood functions

  • Duyen, Nguyen Thi;Nguyen, Duc Hai;Bae, Deg-Hyo
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.127-127
    • /
    • 2021
  • In order to estimate parameter uncertainty of hydrological models, the consideration of the likelihood functions which provide reliable parameters of model is necessary. In this study, the Bayesian Markov Chain Monte Carlo (MCMC) method with informal likelihood functions is used to analyze the uncertainty of parameters of the SURR model for estimating the hourly streamflow of Gunnam station of Imjin basin, Korea. Three events were used to calibrate and one event was used to validate the posterior distributions of parameters. Moreover, the performance of four informal likelihood functions (Nash-Sutcliffe efficiency, Normalized absolute error, Index of agreement, and Chiew-McMahon efficiency) on uncertainty of parameter is assessed. The indicators used to assess the uncertainty of the streamflow simulation were P-factor (percentage of observed streamflow included in the uncertainty interval) and R-factor (the average width of the uncertainty interval). The results showed that the sensitivities of parameters strongly depend on the likelihood functions and vary for different likelihood functions. The uncertainty bounds illustrated the slight differences from various likelihood functions. This study confirms the importance of the likelihood function selection in the application of Bayesian MCMC to the uncertainty assessment of the SURR model.

  • PDF

Multinomial Group Testing with Small-Sized Pools and Application to California HIV Data: Bayesian and Bootstrap Approaches

  • Kim, Jong-Min;Heo, Tae-Young;An, Hyong-Gin
    • Proceedings of the Korean Association for Survey Research Conference
    • /
    • 2006.06a
    • /
    • pp.131-159
    • /
    • 2006
  • This paper consider multinomial group testing which is concerned with classification each of N given units into one of k disjoint categories. In this paper, we propose exact Bayesian, approximate Bayesian, bootstrap methods for estimating individual category proportions using the multinomial group testing model proposed by Bar-Lev et al (2005). By the comparison of Mcan Squre Error (MSE), it is shown that the exact Bayesian method has a bettor efficiency and consistency than maximum likelihood method. We suggest an approximate Bayesian approach using Markov Chain Monte Carlo (MCMC) for posterior computation. We derive exact credible intervals based on the exact Bayesian estimators and present confidence intervals using the bootstrap and MCMC. These intervals arc shown to often have better coverage properties and similar mean lengths to maximum likelihood method already available. Furthermore the proposed models are illustrated using data from a HIV blooding test study throughout California, 2000.

  • PDF

Bayesian estimation for frequency using resampling methods (재표본 방법론을 활용한 베이지안 주파수 추정)

  • Pak, Ro Jin
    • The Korean Journal of Applied Statistics
    • /
    • v.30 no.6
    • /
    • pp.877-888
    • /
    • 2017
  • Spectral analysis is used to determine the frequency of time series data. We first determine the frequency of the series through the power spectrum or the periodogram and then calculate the period of a cycle that may exist in a time series. Estimating the frequency using a Bayesian technique has been developed and proven to be useful; however, the Bayesian estimator for the frequency cannot be analytically solved through mathematical equations and may be handled numerically or computationally. In this paper, we make an inference on the Bayesian frequency through both resampling a parameter by Markov chain Monte Carlo (MCMC) methods and resampling data by bootstrap methods for a time series. We take the Korean real estate price index as an example for Bayesian frequency estimation. We have found a difference in the periods between the sale price index and the long term rental price index, but the difference is not statistically significant.

Bayesian Model for Cost Estimation of Construction Projects

  • Kim, Sang-Yon
    • Journal of the Korea Institute of Building Construction
    • /
    • v.11 no.1
    • /
    • pp.91-99
    • /
    • 2011
  • Bayesian network is a form of probabilistic graphical model. It incorporates human reasoning to deal with sparse data availability and to determine the probabilities of uncertain cases. In this research, bayesian network is adopted to model the problem of construction project cost. General information, time, cost, and material, the four main factors dominating the characteristic of construction costs, are incorporated into the model. This research presents verify a model that were conducted to illustrate the functionality and application of a decision support system for predicting the costs. The Markov Chain Monte Carlo (MCMC) method is applied to estimate parameter distributions. Furthermore, it is shown that not all the parameters are normally distributed. In addition, cost estimates based on the Gibbs output is performed. It can enhance the decision the decision-making process.