• Title/Summary/Keyword: Bayesian Sampling Algorithm

Search Result 62, Processing Time 0.029 seconds

A Bayesian Sampling Algorithm for Evolving Random Hypergraph Models Representing Higher-Order Correlations (고차상관관계를 표현하는 랜덤 하이퍼그래프 모델 진화를 위한 베이지안 샘플링 알고리즘)

  • Lee, Si-Eun;Lee, In-Hee;Zhang, Byoung-Tak
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.3
    • /
    • pp.208-216
    • /
    • 2009
  • A number of estimation of distribution algorithms have been proposed that do not use explicitly crossover and mutation of traditional genetic algorithms, but estimate the distribution of population for more efficient search. But because it is not easy to discover higher-order correlations of variables, lower-order correlations are estimated most cases under various constraints. In this paper, we propose a new estimation of distribution algorithm that represents higher-order correlations of the data and finds global optimum more efficiently. The proposed algorithm represents the higher-order correlations among variables by building random hypergraph model composed of hyperedges consisting of variables which are expected to be correlated, and generates the next population by Bayesian sampling algorithm Experimental results show that the proposed algorithm can find global optimum and outperforms the simple genetic algorithm and BOA(Bayesian Optimization Algorithm) on decomposable functions with deceptive building blocks.

Bayesian Parameter Estimation of the Four-Parameter Gamma Distribution

  • Oh, Mi-Ra;Kim, Kyung-Sook;Cho, Wan-Hyun;Son, Young-Sook
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.1
    • /
    • pp.255-266
    • /
    • 2007
  • A Bayesian estimation of the four-parameter gamma distribution is considered under the noninformative prior. The Bayesian estimators are obtained by the Gibbs sampling. The generation of the shape/power parameter and the power parameter in the Gibbs sampler is implemented using the adaptive rejection sampling algorithm of Gilks and Wild (1992). Also, the location parameter is generated using the adaptive rejection Metropolis sampling algorithm of Gilks, Best and Tan (1995). Finally, the simulation result is presented.

Bayesian Analysis of Randomized Response Models : A Gibbs Sampling Approach

  • Oh, Man-Suk
    • Journal of the Korean Statistical Society
    • /
    • v.23 no.2
    • /
    • pp.463-482
    • /
    • 1994
  • In Bayesian analysis of randomized response models, the likelihood function does not combine tractably with typical priors for the parameters of interest, causing computational difficulties in posterior analysis of the parameters of interest. In this article, the difficulties are solved by introducing appropriate latent variables to the model and using the Gibbs sampling algorithm.

  • PDF

Gibbs Sampling for Double Seasonal Autoregressive Models

  • Amin, Ayman A.;Ismail, Mohamed A.
    • Communications for Statistical Applications and Methods
    • /
    • v.22 no.6
    • /
    • pp.557-573
    • /
    • 2015
  • In this paper we develop a Bayesian inference for a multiplicative double seasonal autoregressive (DSAR) model by implementing a fast, easy and accurate Gibbs sampling algorithm. We apply the Gibbs sampling to approximate empirically the marginal posterior distributions after showing that the conditional posterior distribution of the model parameters and the variance are multivariate normal and inverse gamma, respectively. The proposed Bayesian methodology is illustrated using simulated examples and real-world time series data.

Bayesian Estimation of the Two-Parameter Kappa Distribution

  • Oh, Mi-Ra;Kim, Sun-Worl;Park, Jeong-Soo;Son, Young-Sook
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.2
    • /
    • pp.355-363
    • /
    • 2007
  • In this paper a Bayesian estimation of the two-parameter kappa distribution was discussed under the noninformative prior. The Bayesian estimators are obtained by the Gibbs sampling. The generation of the shape parameter and scale parameter in the Gibbs sampler is implemented using the adaptive rejection Metropolis sampling algorithm of Gilks et al. (1995). A Monte Carlo study showed that the Bayesian estimators proposed outperform other estimators in the sense of mean squared error.

Application of Bayesian Computational Techniques in Estimation of Posterior Distributional Properties of Lognormal Distribution

  • Begum, Mun-Ni;Ali, M. Masoom
    • Journal of the Korean Data and Information Science Society
    • /
    • v.15 no.1
    • /
    • pp.227-237
    • /
    • 2004
  • In this paper we presented a Bayesian inference approach for estimating the location and scale parameters of the lognormal distribution using iterative Gibbs sampling algorithm. We also presented estimation of location parameter by two non iterative methods, importance sampling and weighted bootstrap assuming scale parameter as known. The estimates by non iterative techniques do not depend on the specification of hyper parameters which is optimal from the Bayesian point of view. The estimates obtained by more sophisticated Gibbs sampler vary slightly with the choices of hyper parameters. The objective of this paper is to illustrate these tools in a simpler setup which may be essential in more complicated situations.

  • PDF

A Bayesian Approach for Record Value Statistics Model Using Nonhomogeneous Poisson Process

  • Kiheon Choi;Hee chual Kim
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.1
    • /
    • pp.259-269
    • /
    • 1997
  • Bayesian inference for a record value statistics(RVS) model of nonhomogeneous Poisson process is considered. We seal with Bayesian inference for double exponential, Gamma, Rayleigh, Gumble RVS models using Gibbs sampling and Metropolis algorithm and also explore Bayesian computation and model selection.

  • PDF

A Comparison study of Hybrid Monte Carlo Algorithm

  • 황진수;전성해;이찬범
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2000.11a
    • /
    • pp.135-140
    • /
    • 2000
  • 베이지안 신경망 모형(Bayesian Neural Networks Models)에서 주어진 입력값(input)은 블랙 박스(Black-Box)와 같은 신경망 구조의 각 층(layer)을 거쳐서 출력값(output)으로 계산된다. 새로운 입력 데이터에 대한 예측값은 사후분포(posterior distribution)의 기대값(mean)에 의해 계산된다. 주어진 사전분포(prior distribution)와 학습데이터에 의한 가능도함수(likelihood functions)를 통해 계산되어진 사후분포는 매우 복잡한 구조를 갖게 됨으로서 기대값의 적분계산에 대한 어려움이 발생한다. 이때 확률적 추정에 의한 근사 방법인 몬테칼로 적분을 이용한다. 이러한 방법으로서 Hybrid Monte Carlo 알고리즘은 우수한 결과를 제공하여준다(Neal 1996). 본 논문에서는 Hybrid Monte Carlo 알고리즘과 기존에 많이 사용되고 있는 Gibbs sampling, Metropolis algorithm, 그리고 Slice Sampling등의 몬테칼로 방법들을 비교한다.

  • PDF

Bayesian Prediction of Exponentiated Weibull Distribution based on Progressive Type II Censoring

  • Jung, Jinhyouk;Chung, Younshik
    • Communications for Statistical Applications and Methods
    • /
    • v.20 no.6
    • /
    • pp.427-438
    • /
    • 2013
  • Based on progressive Type II censored sampling which is an important method to obtain failure data in a lifetime study, we suggest a very general form of Bayesian prediction bounds from two parameters exponentiated Weibull distribution using the proper general prior density. For this, Markov chain Monte Carlo approach is considered and we also provide a simulation study.

SHM-based probabilistic representation of wind properties: Bayesian inference and model optimization

  • Ye, X.W.;Yuan, L.;Xi, P.S.;Liu, H.
    • Smart Structures and Systems
    • /
    • v.21 no.5
    • /
    • pp.601-609
    • /
    • 2018
  • The estimated probabilistic model of wind data based on the conventional approach may have high discrepancy compared with the true distribution because of the uncertainty caused by the instrument error and limited monitoring data. A sequential quadratic programming (SQP) algorithm-based finite mixture modeling method has been developed in the companion paper and is conducted to formulate the joint probability density function (PDF) of wind speed and direction using the wind monitoring data of the investigated bridge. The established bivariate model of wind speed and direction only represents the features of available wind monitoring data. To characterize the stochastic properties of the wind parameters with the subsequent wind monitoring data, in this study, Bayesian inference approach considering the uncertainty is proposed to update the wind parameters in the bivariate probabilistic model. The slice sampling algorithm of Markov chain Monte Carlo (MCMC) method is applied to establish the multi-dimensional and complex posterior distribution which is analytically intractable. The numerical simulation examples for univariate and bivariate models are carried out to verify the effectiveness of the proposed method. In addition, the proposed Bayesian inference approach is used to update and optimize the parameters in the bivariate model using the wind monitoring data from the investigated bridge. The results indicate that the proposed Bayesian inference approach is feasible and can be employed to predict the bivariate distribution of wind speed and direction with limited monitoring data.