• Title/Summary/Keyword: MCMC method

Search Result 103, Processing Time 0.028 seconds

A Study on the efficiency of the MCMC multiple imputation In LDA (선형판별분석에서 MCMC다중대체법의 효율에 관한 연구)

  • Yoo, Hee-Kyung;Kim, Myung-Cheol
    • Journal of the Korea Safety Management & Science
    • /
    • v.11 no.3
    • /
    • pp.189-198
    • /
    • 2009
  • This thesis studies two imputation methods, the MCMC method and the EM algorithm, that take care of the problem. The performance of the two methods for the linear (or quadratic) discriminant analysis are evaluated under various types of incomplete observations. Based on simulated experiments, the effect of the imputation using the EM algorithm and the MCMC method are evaluated and compared in terms of the probability of misclassification and the RMSE. This is done for the various cases of incomplete observations. The cases are differentiated by missing rates, sample sizes, and distances between two classification groups. The studies show that the probability of misclassification and the RMSE of the EM algorithm method is lower than the MCMC method. Therefore the imputation using the EM algorithm is more efficient than the MCMC method. And the probability of misclassification of the method that all vectors of observations with missing values are omitted from analysis is lower than the EM algorithm and the MCMC method when the samples size is small and the rate of missing values is extremely big.

Markov Chain Monte Carlo Simulation to Estimate Material Properties of a Layered Half-space (층상 반무한 지반의 물성치 추정을 위한 마르코프 연쇄 몬테카를로 모사 기법)

  • Jin Ho Lee;Hieu Van Nguyen;Se Hyeok Lee
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.36 no.3
    • /
    • pp.203-211
    • /
    • 2023
  • A Markov chain Monte Carlo (MCMC) simulation is proposed for probabilistic full waveform inversion (FWI) in a layered half-space. Dynamic responses on the half-space surface are estimated using the thin-layer method when a harmonic vertical force is applied. Subsequently, a posterior probability distribution function and the corresponding objective function are formulated to minimize the difference between estimations and observed data as well as that of model parameters from prior information. Based on the gradient of the objective function, a proposal distribution and an acceptance probability for MCMC samples are proposed. The proposed MCMC simulation is applied to several layered half-space examples. It is demonstrated that the proposed MCMC simulation for probabilistic FWI can estimate probabilistic material properties such as the shear-wave velocities of a layered half-space.

At-site Low Flow Frequency Analysis Using Bayesian MCMC: II. Application and Comparative Studies (Bayesian MCMC를 이용한 저수량 점 빈도분석: II. 적용과 비교분석)

  • Kim, Sang-Ug;Lee, Kil-Seong
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.1
    • /
    • pp.49-63
    • /
    • 2008
  • The Bayesian MCMC(Bayesian Markov Chain Monte Carlo) and the MLE(Maximum Likelihood Estimation) methods using a quadratic approximation are applied to perform the at-site low flow frequency analysis at the 4 stage stations (Nakdong, Waegwan, Goryeonggyo, and Jindong). Using the results of two types of the estimation method, the frequency curves including uncertainty are plotted. Eight case studies using the synthetic flow data with a sample size of 100, generated from 2-parmeter Weibull distribution are performed to compare with the results of analysis using the MLE and the Bayesian MCMC. The Bayesian MCMC and the MLE are applied to 36 years of gauged data to validate the efficiency of the developed scheme. These examples illustrate the advantages of the Bayesian MCMC and the limitations of the MLE based on a quadratic approximation. From the point of view of uncertainty analysis, the Bayesian MCMC is more effective than the MLE using a quadratic approximation when the sample size is small. In particular, the Bayesian MCMC is a more attractive method than MLE based on a quadratic approximation because the sample size of low flow at the site of interest is mostly not enough to perform the low flow frequency analysis.

Comparing MCMC algorithms for the horseshoe prior (Horseshoe 사전분포에 대한 MCMC 알고리듬 비교 연구)

  • Miru Ma;Mingi Kang;Kyoungjae Lee
    • The Korean Journal of Applied Statistics
    • /
    • v.37 no.1
    • /
    • pp.103-118
    • /
    • 2024
  • The horseshoe prior is notably one of the most popular priors in sparse regression models, where only a small fraction of coefficients are nonzero. The parameter space of the horseshoe prior is much smaller than that of the spike and slab prior, so it enables us to efficiently explore the parameter space even in high-dimensions. However, on the other hand, the horseshoe prior has a high computational cost for each iteration in the Gibbs sampler. To overcome this issue, various MCMC algorithms for the horseshoe prior have been proposed to reduce the computational burden. Especially, Johndrow et al. (2020) recently proposes an approximate algorithm that can significantly improve the mixing and speed of the MCMC algorithm. In this paper, we compare (1) the traditional MCMC algorithm, (2) the approximate MCMC algorithm proposed by Johndrow et al. (2020) and (3) its variant in terms of computing times, estimation and variable selection performance. For the variable selection, we adopt the sequential clustering-based method suggested by Li and Pati (2017). Practical performances of the MCMC methods are demonstrated via numerical studies.

Bayesian Parameter Estimation for Prognosis of Crack Growth under Variable Amplitude Loading (변동진폭하중 하에서 균열성장예지를 위한 베이지안 모델변수 추정법)

  • Leem, Sang-Hyuck;An, Da-Wn;Choi, Joo-Ho
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.35 no.10
    • /
    • pp.1299-1306
    • /
    • 2011
  • In this study, crack-growth model parameters subjected to variable amplitude loading are estimated in the form of a probability distribution using the method of Bayesian parameter estimation. Huang's model is employed to describe the retardation and acceleration of the crack growth during the loadings. The Markov Chain Monte Carlo (MCMC) method is used to obtain samples of the parameters following the probability distribution. As the conventional MCMC method often fails to converge to the equilibrium distribution because of the increased complexity of the model under variable amplitude loading, an improved MCMC method is introduced to overcome this shortcoming, in which a marginal (PDF) is employed as a proposal density function. The model parameters are estimated on the basis of the data from several test specimens subjected to constant amplitude loading. The prediction is then made under variable amplitude loading for the same specimen, and validated by the ground-truth data using the estimated parameters.

Remaining Useful Life Estimation of Li-ion Battery for Energy Storage System Using Markov Chain Monte Carlo Method (마코프체인 몬테카를로 방법을 이용한 에너지 저장 장치용 배터리의 잔존 수명 추정)

  • Kim, Dongjin;Kim, Seok Goo;Choi, Jooho;Song, Hwa Seob;Park, Sang Hui;Lee, Jaewook
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.40 no.10
    • /
    • pp.895-900
    • /
    • 2016
  • Remaining useful life (RUL) estimation of the Li-ion battery has gained great interest because it is necessary for quality assurance, operation planning, and determination of the exchange period. This paper presents the RUL estimation of an Li-ion battery for an energy storage system using exponential function for the degradation model and Markov Chain Monte Carlo (MCMC) approach for parameter estimation. The MCMC approach is dependent upon information such as model initial parameters and input setting parameters which highly affect the estimation result. To overcome this difficulty, this paper offers a guideline for model initial parameters based on the regression result, and MCMC input parameters derived by comparisons with a thorough search of theoretical results.

Sparse Web Data Analysis Using MCMC Missing Value Imputation and PCA Plot-based SOM (MCMC 결측치 대체와 주성분 산점도 기반의 SOM을 이용한 희소한 웹 데이터 분석)

  • Jun, Sung-Hae;Oh, Kyung-Whan
    • The KIPS Transactions:PartD
    • /
    • v.10D no.2
    • /
    • pp.277-282
    • /
    • 2003
  • The knowledge discovery from web has been studied in many researches. There are some difficulties using web log for training data on efficient information predictive models. In this paper, we studied on the method to eliminate sparseness from web log data and to perform web user clustering. Using missing value imputation by Bayesian inference of MCMC, the sparseness of web data is removed. And web user clustering is performed using self organizing maps based on 3-D plot by principal component. Finally, using KDD Cup data, our experimental results were shown the problem solving process and the performance evaluation.

Pedestrian Detection and Tracking Method for Autonomous Navigation Vehicle using Markov chain Monte Carlo Algorithm (MCMC 방법을 이용한 자율주행 차량의 보행자 탐지 및 추적방법)

  • Hwang, Jung-Won;Kim, Nam-Hoon;Yoon, Jeong-Yeon;Kim, Chang-Hwan
    • The Journal of Korea Robotics Society
    • /
    • v.7 no.2
    • /
    • pp.113-119
    • /
    • 2012
  • In this paper we propose the method that detects moving objects in autonomous navigation vehicle using LRF sensor data. Object detection and tracking methods are widely used in research area like safe-driving, safe-navigation of the autonomous vehicle. The proposed method consists of three steps: data segmentation, mobility classification and object tracking. In order to make the raw LRF sensor data to be useful, Occupancy grid is generated and the raw data is segmented according to its appearance. For classifying whether the object is moving or static, trajectory patterns are analysed. As the last step, Markov chain Monte Carlo (MCMC) method is used for tracking the object. Experimental results indicate that the proposed method can accurately detect moving objects.

On the Bayesian Statistical Inference (베이지안 통계 추론)

  • Lee, Ho-Suk
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2007.06c
    • /
    • pp.263-266
    • /
    • 2007
  • This paper discusses the Bayesian statistical inference. This paper discusses the Bayesian inference, MCMC (Markov Chain Monte Carlo) integration, MCMC method, Metropolis-Hastings algorithm, Gibbs sampling, Maximum likelihood estimation, Expectation Maximization algorithm, missing data processing, and BMA (Bayesian Model Averaging). The Bayesian statistical inference is used to process a large amount of data in the areas of biology, medicine, bioengineering, science and engineering, and general data analysis and processing, and provides the important method to draw the optimal inference result. Lastly, this paper discusses the method of principal component analysis. The PCA method is also used for data analysis and inference.

  • PDF

At-site Low Flow Frequency Analysis Using Bayesian MCMC: I. Theoretical Background and Construction of Prior Distribution (Bayesian MCMC를 이용한 저수량 점 빈도분석: I. 이론적 배경과 사전분포의 구축)

  • Kim, Sang-Ug;Lee, Kil-Seong
    • Journal of Korea Water Resources Association
    • /
    • v.41 no.1
    • /
    • pp.35-47
    • /
    • 2008
  • The low flow analysis is an important part in water resources engineering. Also, the results of low flow frequency analysis can be used for design of reservoir storage, water supply planning and design, waste-load allocation, and maintenance of quantity and quality of water for irrigation and wild life conservation. Especially, for identification of the uncertainty in frequency analysis, the Bayesian approach is applied and compared with conventional methodologies in at-site low flow frequency analysis. In the first manuscript, the theoretical background for the Bayesian MCMC (Bayesian Markov Chain Monte Carlo) method and Metropolis-Hasting algorithm are studied. Two types of the prior distribution, a non-data- based and a data-based prior distributions are developed and compared to perform the Bayesian MCMC method. It can be suggested that the results of a data-based prior distribution is more effective than those of a non-data-based prior distribution. The acceptance rate of the algorithm is computed to assess the effectiveness of the developed algorithm. In the second manuscript, the Bayesian MCMC method using a data-based prior distribution and MLE(Maximum Likelihood Estimation) using a quadratic approximation are performed for the at-site low flow frequency analysis.