• 제목/요약/키워드: Bayesian Sampling Algorithm

검색결과 62건 처리시간 0.023초

고차상관관계를 표현하는 랜덤 하이퍼그래프 모델 진화를 위한 베이지안 샘플링 알고리즘 (A Bayesian Sampling Algorithm for Evolving Random Hypergraph Models Representing Higher-Order Correlations)

  • 이시은;이인희;장병탁
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제36권3호
    • /
    • pp.208-216
    • /
    • 2009
  • 유전자알고리즘의 교차나 돌연변이 연산을 직접적으로 사용하지 않고 개체군의 확률분포를 추정하여 보다 효율적인 탐색을 수행하려는 분포추정알고리즘이 여러 방법으로 제안되었다. 그러나 실제로 변수들간의 고차상관관계를 파악하는 일은 쉽지 않은 일이라 대부분의 경우 낮은 차수의 상관관계를 제한된 가정하에 추정하게 된다. 본 논문에서는 데이타의 고차상관관계를 표현할 수 있고 최적 해를 좀 더 효율적으로 찾을 수 있는 새로운 분포추정알고리즘을 제안한다. 제안된 알고리즘에서는 상관관계가 있을 것으로 추정되는 변수들의 집합으로 정의된 하이퍼에지로 구성된 랜덤 하이퍼그래프 모델을 구축하여 변수들 간의 고차상관관계를 표현하고, 베이지안 샘플링 알고리즘(Bayesian Sampling Algorithm)을 통해 다음 세대의 개체를 생성한다. 기만하는 빌딩블럭(deceptive building blocks)을 가진 분해가능(decomposable) 함수에 대하여 실험한 결과 성공적으로 최적해를 구할 수 있었으며 단순 유전자알고리즘과 BOA (Bayesian Optimization Algorithm)와 비교하여 좋은 성능을 얻을 수 있었다.

Bayesian Parameter Estimation of the Four-Parameter Gamma Distribution

  • Oh, Mi-Ra;Kim, Kyung-Sook;Cho, Wan-Hyun;Son, Young-Sook
    • Communications for Statistical Applications and Methods
    • /
    • 제14권1호
    • /
    • pp.255-266
    • /
    • 2007
  • A Bayesian estimation of the four-parameter gamma distribution is considered under the noninformative prior. The Bayesian estimators are obtained by the Gibbs sampling. The generation of the shape/power parameter and the power parameter in the Gibbs sampler is implemented using the adaptive rejection sampling algorithm of Gilks and Wild (1992). Also, the location parameter is generated using the adaptive rejection Metropolis sampling algorithm of Gilks, Best and Tan (1995). Finally, the simulation result is presented.

Bayesian Analysis of Randomized Response Models : A Gibbs Sampling Approach

  • Oh, Man-Suk
    • Journal of the Korean Statistical Society
    • /
    • 제23권2호
    • /
    • pp.463-482
    • /
    • 1994
  • In Bayesian analysis of randomized response models, the likelihood function does not combine tractably with typical priors for the parameters of interest, causing computational difficulties in posterior analysis of the parameters of interest. In this article, the difficulties are solved by introducing appropriate latent variables to the model and using the Gibbs sampling algorithm.

  • PDF

Gibbs Sampling for Double Seasonal Autoregressive Models

  • Amin, Ayman A.;Ismail, Mohamed A.
    • Communications for Statistical Applications and Methods
    • /
    • 제22권6호
    • /
    • pp.557-573
    • /
    • 2015
  • In this paper we develop a Bayesian inference for a multiplicative double seasonal autoregressive (DSAR) model by implementing a fast, easy and accurate Gibbs sampling algorithm. We apply the Gibbs sampling to approximate empirically the marginal posterior distributions after showing that the conditional posterior distribution of the model parameters and the variance are multivariate normal and inverse gamma, respectively. The proposed Bayesian methodology is illustrated using simulated examples and real-world time series data.

Bayesian Estimation of the Two-Parameter Kappa Distribution

  • Oh, Mi-Ra;Kim, Sun-Worl;Park, Jeong-Soo;Son, Young-Sook
    • Communications for Statistical Applications and Methods
    • /
    • 제14권2호
    • /
    • pp.355-363
    • /
    • 2007
  • In this paper a Bayesian estimation of the two-parameter kappa distribution was discussed under the noninformative prior. The Bayesian estimators are obtained by the Gibbs sampling. The generation of the shape parameter and scale parameter in the Gibbs sampler is implemented using the adaptive rejection Metropolis sampling algorithm of Gilks et al. (1995). A Monte Carlo study showed that the Bayesian estimators proposed outperform other estimators in the sense of mean squared error.

Application of Bayesian Computational Techniques in Estimation of Posterior Distributional Properties of Lognormal Distribution

  • Begum, Mun-Ni;Ali, M. Masoom
    • Journal of the Korean Data and Information Science Society
    • /
    • 제15권1호
    • /
    • pp.227-237
    • /
    • 2004
  • In this paper we presented a Bayesian inference approach for estimating the location and scale parameters of the lognormal distribution using iterative Gibbs sampling algorithm. We also presented estimation of location parameter by two non iterative methods, importance sampling and weighted bootstrap assuming scale parameter as known. The estimates by non iterative techniques do not depend on the specification of hyper parameters which is optimal from the Bayesian point of view. The estimates obtained by more sophisticated Gibbs sampler vary slightly with the choices of hyper parameters. The objective of this paper is to illustrate these tools in a simpler setup which may be essential in more complicated situations.

  • PDF

A Bayesian Approach for Record Value Statistics Model Using Nonhomogeneous Poisson Process

  • Kiheon Choi;Hee chual Kim
    • Communications for Statistical Applications and Methods
    • /
    • 제4권1호
    • /
    • pp.259-269
    • /
    • 1997
  • Bayesian inference for a record value statistics(RVS) model of nonhomogeneous Poisson process is considered. We seal with Bayesian inference for double exponential, Gamma, Rayleigh, Gumble RVS models using Gibbs sampling and Metropolis algorithm and also explore Bayesian computation and model selection.

  • PDF

A Comparison study of Hybrid Monte Carlo Algorithm

  • 황진수;전성해;이찬범
    • 한국통계학회:학술대회논문집
    • /
    • 한국통계학회 2000년도 추계학술발표회 논문집
    • /
    • pp.135-140
    • /
    • 2000
  • 베이지안 신경망 모형(Bayesian Neural Networks Models)에서 주어진 입력값(input)은 블랙 박스(Black-Box)와 같은 신경망 구조의 각 층(layer)을 거쳐서 출력값(output)으로 계산된다. 새로운 입력 데이터에 대한 예측값은 사후분포(posterior distribution)의 기대값(mean)에 의해 계산된다. 주어진 사전분포(prior distribution)와 학습데이터에 의한 가능도함수(likelihood functions)를 통해 계산되어진 사후분포는 매우 복잡한 구조를 갖게 됨으로서 기대값의 적분계산에 대한 어려움이 발생한다. 이때 확률적 추정에 의한 근사 방법인 몬테칼로 적분을 이용한다. 이러한 방법으로서 Hybrid Monte Carlo 알고리즘은 우수한 결과를 제공하여준다(Neal 1996). 본 논문에서는 Hybrid Monte Carlo 알고리즘과 기존에 많이 사용되고 있는 Gibbs sampling, Metropolis algorithm, 그리고 Slice Sampling등의 몬테칼로 방법들을 비교한다.

  • PDF

Bayesian Prediction of Exponentiated Weibull Distribution based on Progressive Type II Censoring

  • Jung, Jinhyouk;Chung, Younshik
    • Communications for Statistical Applications and Methods
    • /
    • 제20권6호
    • /
    • pp.427-438
    • /
    • 2013
  • Based on progressive Type II censored sampling which is an important method to obtain failure data in a lifetime study, we suggest a very general form of Bayesian prediction bounds from two parameters exponentiated Weibull distribution using the proper general prior density. For this, Markov chain Monte Carlo approach is considered and we also provide a simulation study.

SHM-based probabilistic representation of wind properties: Bayesian inference and model optimization

  • Ye, X.W.;Yuan, L.;Xi, P.S.;Liu, H.
    • Smart Structures and Systems
    • /
    • 제21권5호
    • /
    • pp.601-609
    • /
    • 2018
  • The estimated probabilistic model of wind data based on the conventional approach may have high discrepancy compared with the true distribution because of the uncertainty caused by the instrument error and limited monitoring data. A sequential quadratic programming (SQP) algorithm-based finite mixture modeling method has been developed in the companion paper and is conducted to formulate the joint probability density function (PDF) of wind speed and direction using the wind monitoring data of the investigated bridge. The established bivariate model of wind speed and direction only represents the features of available wind monitoring data. To characterize the stochastic properties of the wind parameters with the subsequent wind monitoring data, in this study, Bayesian inference approach considering the uncertainty is proposed to update the wind parameters in the bivariate probabilistic model. The slice sampling algorithm of Markov chain Monte Carlo (MCMC) method is applied to establish the multi-dimensional and complex posterior distribution which is analytically intractable. The numerical simulation examples for univariate and bivariate models are carried out to verify the effectiveness of the proposed method. In addition, the proposed Bayesian inference approach is used to update and optimize the parameters in the bivariate model using the wind monitoring data from the investigated bridge. The results indicate that the proposed Bayesian inference approach is feasible and can be employed to predict the bivariate distribution of wind speed and direction with limited monitoring data.