• 제목/요약/키워드: Bayesian MCMC(Markov Chain Monte Carlo)

검색결과 88건 처리시간 0.029초

베이지안 통계 추론 (On the Bayesian Statistical Inference)

  • 이호석
    • 한국정보과학회:학술대회논문집
    • /
    • 한국정보과학회 2007년도 한국컴퓨터종합학술대회논문집 Vol.34 No.1 (C)
    • /
    • pp.263-266
    • /
    • 2007
  • 본 논문은 베이지안 통계 추론에 대하여 논의한다. 논문은 베이지안 추론, Markov Chain과 Monte Carlo 적분, MCMC(Markov Chain Monte Carlo) 기법, Metropolis-Hastings 알고리즘, Gibbs 샘플링, Maximum Likelihood Estimation, EM 알고리즘, 상실된 데이터 보완 기법, BMA(Bayesian Model Averaging) 순서로 논의를 진행한다. 이러한 통계적 기법들은 대용량의 데이터를 처리하는 생물학, 의학, 생명 공학, 과학과 공학, 그리고 일반 데이터 조사와 처리 등에 사용되고 있으며, 최적의 추론 결과를 이끌어 내는데 중요한 방법을 제공하고 있다. 그리고 마지막으로 PC(Principal Component) 분석 기법에 대하여 논의한다. PC 분석 기법도 데이터 분석과 연구에 많이 활용된다.

  • PDF

Bayesian Analysis for a Functional Regression Model with Truncated Errors in Variables

  • Kim, Hea-Jung
    • Journal of the Korean Statistical Society
    • /
    • 제31권1호
    • /
    • pp.77-91
    • /
    • 2002
  • This paper considers a functional regression model with truncated errors in explanatory variables. We show that the ordinary least squares (OLS) estimators produce bias in regression parameter estimates under misspecified models with ignored errors in the explanatory variable measurements, and then propose methods for analyzing the functional model. Fully parametric frequentist approaches for analyzing the model are intractable and thus Bayesian methods are pursued using a Markov chain Monte Carlo (MCMC) sampling based approach. Necessary theories involved in modeling and computation are provided. Finally, a simulation study is given to illustrate and examine the proposed methods.

Markov Chain Monte Carlo simulation based Bayesian updating of model parameters and their uncertainties

  • Sengupta, Partha;Chakraborty, Subrata
    • Structural Engineering and Mechanics
    • /
    • 제81권1호
    • /
    • pp.103-115
    • /
    • 2022
  • The prediction error variances for frequencies are usually considered as unknown in the Bayesian system identification process. However, the error variances for mode shapes are taken as known to reduce the dimension of an identification problem. The present study attempts to explore the effectiveness of Bayesian approach of model parameters updating using Markov Chain Monte Carlo (MCMC) technique considering the prediction error variances for both the frequencies and mode shapes. To remove the ergodicity of Markov Chain, the posterior distribution is obtained by Gaussian Random walk over the proposal distribution. The prior distributions of prediction error variances of modal evidences are implemented through inverse gamma distribution to assess the effectiveness of estimation of posterior values of model parameters. The issue of incomplete data that makes the problem ill-conditioned and the associated singularity problem is prudently dealt in by adopting a regularization technique. The proposed approach is demonstrated numerically by considering an eight-storey frame model with both complete and incomplete modal data sets. Further, to study the effectiveness of the proposed approach, a comparative study with regard to accuracy and computational efficacy of the proposed approach is made with the Sequential Monte Carlo approach of model parameter updating.

Uncertainty reduction of seismic fragility of intake tower using Bayesian Inference and Markov Chain Monte Carlo simulation

  • Alam, Jahangir;Kim, Dookie;Choi, Byounghan
    • Structural Engineering and Mechanics
    • /
    • 제63권1호
    • /
    • pp.47-53
    • /
    • 2017
  • The fundamental goal of this study is to minimize the uncertainty of the median fragility curve and to assess the structural vulnerability under earthquake excitation. Bayesian Inference with Markov Chain Monte Carlo (MCMC) simulation has been presented for efficient collapse response assessment of the independent intake water tower. The intake tower is significantly used as a diversion type of the hydropower station for maintaining power plant, reservoir and spillway tunnel. Therefore, the seismic fragility assessment of the intake tower is a pivotal component for estimating total system risk of the reservoir. In this investigation, an asymmetrical independent slender reinforced concrete structure is considered. The Bayesian Inference method provides the flexibility to integrate the prior information of collapse response data with the numerical analysis results. The preliminary information of risk data can be obtained from various sources like experiments, existing studies, and simplified linear dynamic analysis or nonlinear static analysis. The conventional lognormal model is used for plotting the fragility curve using the data from time history simulation and nonlinear static pushover analysis respectively. The Bayesian Inference approach is applied for integrating the data from both analyses with the help of MCMC simulation. The method achieves meaningful improvement of uncertainty associated with the fragility curve, and provides significant statistical and computational efficiency.

실제 네트워크를 고려한 베이지안 필터 기반 이동단말 위치 추적 (Bayesian Filter-Based Mobile Tracking under Realistic Network Setting)

  • 김효원;김선우
    • 한국통신학회논문지
    • /
    • 제41권9호
    • /
    • pp.1060-1068
    • /
    • 2016
  • 연결정보만을 이용하는 range-free 측위 기법의 성능은 이동성을 갖는 무선 단말 움직임에 취약한 문제점이 있다. 본 논문은 실제 전파 환경을 고려한 실내 네트워크에서 베이지안 필터를 사용하여 실시간으로 움직이는 무선장치를 추적하는 두 가지 알고리즘을 제안하였다. 제안하는 알고리즘은 측정 모델의 선형성에 따라 Kalman filter 와 Markov Chain Monte Carlo (MCMC) particle filter를 적용하였다. Kalman과 MCMC particle filter 기반 알고리즘은 각각 무선단말 간 연결정보를, 이동 단말의 한 홉 간격 내 단말로부터 수신하는 신호의 세기 (RSS: received signal strength)와 연결정보를 혼합한 융합정보를 측정 모델로 사용하였다. 정확한 시뮬레이션을 위해 실내 쇼핑몰 지도를 구현한 네트워크 지형, 그리고 라디오 불규칙도 모델을 적용하였다. 또한, 장애물 존재 여부에 따라 라디오 불규칙도를 분류하였다. 성능평가를 위해 MATLAB 시뮬레이션을 수행하였으며, 기존 range-free 측위 기법보다 향상된 위치정확도를 확인하였다.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • 제15권3호
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

Analyze the parameter uncertainty of SURR model using Bayesian Markov Chain Monte Carlo method with informal likelihood functions

  • Duyen, Nguyen Thi;Nguyen, Duc Hai;Bae, Deg-Hyo
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2021년도 학술발표회
    • /
    • pp.127-127
    • /
    • 2021
  • In order to estimate parameter uncertainty of hydrological models, the consideration of the likelihood functions which provide reliable parameters of model is necessary. In this study, the Bayesian Markov Chain Monte Carlo (MCMC) method with informal likelihood functions is used to analyze the uncertainty of parameters of the SURR model for estimating the hourly streamflow of Gunnam station of Imjin basin, Korea. Three events were used to calibrate and one event was used to validate the posterior distributions of parameters. Moreover, the performance of four informal likelihood functions (Nash-Sutcliffe efficiency, Normalized absolute error, Index of agreement, and Chiew-McMahon efficiency) on uncertainty of parameter is assessed. The indicators used to assess the uncertainty of the streamflow simulation were P-factor (percentage of observed streamflow included in the uncertainty interval) and R-factor (the average width of the uncertainty interval). The results showed that the sensitivities of parameters strongly depend on the likelihood functions and vary for different likelihood functions. The uncertainty bounds illustrated the slight differences from various likelihood functions. This study confirms the importance of the likelihood function selection in the application of Bayesian MCMC to the uncertainty assessment of the SURR model.

  • PDF

Multinomial Group Testing with Small-Sized Pools and Application to California HIV Data: Bayesian and Bootstrap Approaches

  • 김종민;허태영;안형진
    • 한국조사연구학회:학술대회논문집
    • /
    • 한국조사연구학회 2006년도 춘계학술대회 발표논문집
    • /
    • pp.131-159
    • /
    • 2006
  • This paper consider multinomial group testing which is concerned with classification each of N given units into one of k disjoint categories. In this paper, we propose exact Bayesian, approximate Bayesian, bootstrap methods for estimating individual category proportions using the multinomial group testing model proposed by Bar-Lev et al (2005). By the comparison of Mcan Squre Error (MSE), it is shown that the exact Bayesian method has a bettor efficiency and consistency than maximum likelihood method. We suggest an approximate Bayesian approach using Markov Chain Monte Carlo (MCMC) for posterior computation. We derive exact credible intervals based on the exact Bayesian estimators and present confidence intervals using the bootstrap and MCMC. These intervals arc shown to often have better coverage properties and similar mean lengths to maximum likelihood method already available. Furthermore the proposed models are illustrated using data from a HIV blooding test study throughout California, 2000.

  • PDF

재표본 방법론을 활용한 베이지안 주파수 추정 (Bayesian estimation for frequency using resampling methods)

  • 박노진
    • 응용통계연구
    • /
    • 제30권6호
    • /
    • pp.877-888
    • /
    • 2017
  • 시계열 자료의 주기를 파악하기 위해 스펙트럴 분석이 널리 이용되고 있다. 전력 스펙트럼이나 피리오도그램을 통해서 주파수를 추정하고 그로부터 순환 주기를 계산한다. 한편에서는 통계학의 한 축인 베이지안 기법을 활용한 주파수 추정법이 연구되어 사용되고 있다. 그런데 베이지안 주파수 추정량이 수학 공식을 통해 분석적으로 표현이 가능하지 않음으로 인해 신뢰구간 추정 같은 심도 깊은 통계학적 분석이 용이하지 않은 상화에서 컴퓨터를 이용한 수치해석적인 방법으로 신뢰구간을 추정하였다. 본 논문에서는 베이지안 주파수에 대한 보다 심도 있는 분석을 위해 모수를 재표본하는 Markov chain Monte Carlo (MCMC)을 이용한 추정과 데이터를 재표본하는 시계열 재표본을 통한 추정을 시도해 보았다. 예제로서 부동산 매매/전세 가격 지수 데이터을 사용하였고 매매와 전세 가격 지수간에 3.7개월 정도의 주기 차이가 존재하나 통계학적으로는 유의미한 차이라고 할 수 없음을 알았다.

Bayesian Model for Cost Estimation of Construction Projects

  • Kim, Sang-Yon
    • 한국건축시공학회지
    • /
    • 제11권1호
    • /
    • pp.91-99
    • /
    • 2011
  • Bayesian network is a form of probabilistic graphical model. It incorporates human reasoning to deal with sparse data availability and to determine the probabilities of uncertain cases. In this research, bayesian network is adopted to model the problem of construction project cost. General information, time, cost, and material, the four main factors dominating the characteristic of construction costs, are incorporated into the model. This research presents verify a model that were conducted to illustrate the functionality and application of a decision support system for predicting the costs. The Markov Chain Monte Carlo (MCMC) method is applied to estimate parameter distributions. Furthermore, it is shown that not all the parameters are normally distributed. In addition, cost estimates based on the Gibbs output is performed. It can enhance the decision the decision-making process.