• Title/Summary/Keyword: Markov chain - Monte Carlo

Search Result 272, Processing Time 0.022 seconds

Accelerating Scanline Block Gibbs Sampling Method using GPU (GPU 를 활용한 스캔라인 블록 Gibbs 샘플링 기법의 가속)

  • Zeng, Dongmeng;Kim, Wonsik;Yang, Yong;Park, In Kyu
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2014.06a
    • /
    • pp.77-78
    • /
    • 2014
  • A new MCMC method for optimization is presented in this paper, which is called the scanline block Gibbs sampler. Due to its slow convergence speed, traditional Markov chain Monte Carlo (MCMC) is not widely used. In contrast to the conventional MCMC method, it is more convenient to parallelize the scanline block Gibbs sampler. Since The main part of the scanline block Gibbs sampler is to calculate message between each edge, in order to accelerate the calculation of messages passing in scanline sampler, it is parallelized in GPU. It is proved that the implementation on GPU is faster than on CPU based on the experiments on the OpenGM2 benchmark.

  • PDF

Bayesian Variable Selection in the Proportional Hazard Model with Application to DNA Microarray Data

  • Lee, Kyeon-Eun;Mallick, Bani K.
    • Proceedings of the Korean Society for Bioinformatics Conference
    • /
    • 2005.09a
    • /
    • pp.357-360
    • /
    • 2005
  • In this paper we consider the well-known semiparametric proportional hazards (PH) models for survival analysis. These models are usually used with few covariates and many observations (subjects). But, for a typical setting of gene expression data from DNA microarray, we need to consider the case where the number of covariates p exceeds the number of samples n. For a given vector of response values which are times to event (death or censored times) and p gene expressions (covariates), we address the issue of how to reduce the dimension by selecting the significant genes. This approach enable us to estimate the survival curve when n < < p. In our approach, rather than fixing the number of selected genes, we will assign a prior distribution to this number. The approach creates additional flexibility by allowing the imposition of constraints, such as bounding the dimension via a prior, which in effect works as a penalty. To implement our methodology, we use a Markov Chain Monte Carlo (MCMC) method. We demonstrate the use of the methodology to diffuse large B-cell lymphoma (DLBCL) complementary DNA(cDNA) data.

  • PDF

A Bayesian Inference for Power Law Process with a Single Change Point

  • Kim, Kiwoong;Inkwon Yeo;Sinsup Cho;Kim, Jae-Joo
    • International Journal of Quality Innovation
    • /
    • v.5 no.1
    • /
    • pp.1-9
    • /
    • 2004
  • The nonhomogeneous poisson process (NHPP) is often used to model repairable systems that are subject to a minimal repair strategy, with negligible repair times. In this situation, the system can be characterized by its intensity function. There have been many NHPP models according to intensity functions. However, the intensity function of system in use can be changed because of repair or its aging. We consider the single change point model as the modification of the power law process. The shape parameter of its intensity function is changed before and after the change point. We detect the presence of the change point using Bayesian methodology. Some numerical results are also presented.

Bayesian Hierarchical Model with Skewed Elliptical Distribution

  • Chung Younshik
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2000.11a
    • /
    • pp.5-12
    • /
    • 2000
  • Meta-analysis refers to quantitative methods for combining results from independent studies in order to draw overall conclusions. We consider hierarchical models including selection models under a skewed heavy tailed error distribution and it is shown to be useful in such Bayesian meta-analysis. A general class of skewed elliptical distribution is reviewed and developed. These rich class of models combine the information of independent studies, allowing investigation of variability both between and within studies, and weight function. Here we investigate sensitivity of results to unobserved studies by considering a hierarchical selection model and use Markov chain Monte Carlo methods to develop inference for the parameters of interest.

  • PDF

Multiple Comparison for the One-Way ANOVA with the Power Prior

  • Bae, Re-Na;Kang, Yun-Hee;Hong, Min-Young;Kim, Seong-W.
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.1
    • /
    • pp.13-26
    • /
    • 2008
  • Inference on the present data will be more reliable when the data arising from previous similar studies are available. The data arising from previous studies are referred as historical data. The power prior is defined by the likelihood function based on the historical data to the power $a_0$, where $0\;{\le}\;a_0\;{\le}\;1$. The power prior is a useful informative prior for Bayesian inference such as model selection and model comparison. We utilize the historical data to perform multiple comparison in the one-way ANOVA model. We demonstrate our results with some simulated datasets under a simple order restriction between the treatments.

Classical and Bayesian methods of estimation for power Lindley distribution with application to waiting time data

  • Sharma, Vikas Kumar;Singh, Sanjay Kumar;Singh, Umesh
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.3
    • /
    • pp.193-209
    • /
    • 2017
  • The power Lindley distribution with some of its properties is considered in this article. Maximum likelihood, least squares, maximum product spacings, and Bayes estimators are proposed to estimate all the unknown parameters of the power Lindley distribution. Lindley's approximation and Markov chain Monte Carlo techniques are utilized for Bayesian calculations since posterior distribution cannot be reduced to standard distribution. The performances of the proposed estimators are compared based on simulated samples. The waiting times of research articles to be accepted in statistical journals are fitted to the power Lindley distribution with other competing distributions. Chi-square statistic, Kolmogorov-Smirnov statistic, Akaike information criterion and Bayesian information criterion are used to access goodness-of-fit. It was found that the power Lindley distribution gives a better fit for the data than other distributions.

Bayesian analysis of random partition models with Laplace distribution

  • Kyung, Minjung
    • Communications for Statistical Applications and Methods
    • /
    • v.24 no.5
    • /
    • pp.457-480
    • /
    • 2017
  • We develop a random partition procedure based on a Dirichlet process prior with Laplace distribution. Gibbs sampling of a Laplace mixture of linear mixed regressions with a Dirichlet process is implemented as a random partition model when the number of clusters is unknown. Our approach provides simultaneous partitioning and parameter estimation with the computation of classification probabilities, unlike its counterparts. A full Gibbs-sampling algorithm is developed for an efficient Markov chain Monte Carlo posterior computation. The proposed method is illustrated with simulated data and one real data of the energy efficiency of Tsanas and Xifara (Energy and Buildings, 49, 560-567, 2012).

Derivation of Design Flood Using Multisite Rainfall Simulation Technique and Continuous Rainfall-Runoff Model

  • Kwon, Hyun-Han
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2009.05a
    • /
    • pp.540-544
    • /
    • 2009
  • Hydrologic pattern under climate change has been paid attention to as one of the most important issues in hydrologic science group. Rainfall and runoff is a key element in the Earth's hydrological cycle, and associated with many different aspects such as water supply, flood prevention and river restoration. In this regard, a main objective of this study is to evaluate design flood using simulation techniques which can consider a full spectrum of uncertainty. Here we utilize a weather state based stochastic multivariate model as conditional probability model for simulating the rainfall field. A major premise of this study is that large scale climatic patterns are a major driver of such persistent year to year changes in rainfall probabilities. Uncertainty analysis in estimating design flood is inevitably needed to examine reliability for the estimated results. With regard to this point, this study applies a Bayesian Markov Chain Monte Carlo scheme to the NWS-PC rainfall-runoff model that has been widely used, and a case study is performed in Soyang Dam watershed in Korea. A comprehensive discussion on design flood under climate change is provided.

  • PDF

Bayesian Inference and Model Selection for Software Growth Reliability Models using Gibbs Sampler (몬테칼로 깁스방법을 적용한 소프트웨어 신뢰도 성장모형에 대한 베이지안 추론과 모형선택에 관한 연구)

  • 김희철;이승주
    • Journal of Korean Society for Quality Management
    • /
    • v.27 no.3
    • /
    • pp.125-141
    • /
    • 1999
  • Bayesian inference and model selection method for software reliability growth models are studied. Software reliability growth models are used in testing stages of software development to model the error content and time intervals between software failures. In this paper, we could avoid the multiple integration by the use of Gibbs sampling, which is a kind of Markov Chain Monte Carlo method to compute the posterior distribution. Bayesian inference and model selection method for Jelinski-Moranda and Goel-Okumoto and Schick-Wolverton models in software reliability with Poisson prior information are studied. For model selection, we explored the relative error.

  • PDF

A Bayesian Model-based Clustering with Dissimilarities

  • Oh, Man-Suk;Raftery, Adrian
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.10a
    • /
    • pp.9-14
    • /
    • 2003
  • A Bayesian model-based clustering method is proposed for clustering objects on the basis of dissimilarites. This combines two basic ideas. The first is that tile objects have latent positions in a Euclidean space, and that the observed dissimilarities are measurements of the Euclidean distances with error. The second idea is that the latent positions are generated from a mixture of multivariate normal distributions, each one corresponding to a cluster. We estimate the resulting model in a Bayesian way using Markov chain Monte Carlo. The method carries out multidimensional scaling and model-based clustering simultaneously, and yields good object configurations and good clustering results with reasonable measures of clustering uncertainties. In the examples we studied, the clustering results based on low-dimensional configurations were almost as good as those based on high-dimensional ones. Thus tile method can be used as a tool for dimension reduction when clustering high-dimensional objects, which may be useful especially for visual inspection of clusters. We also propose a Bayesian criterion for choosing the dimension of the object configuration and the number of clusters simultaneously. This is easy to compute and works reasonably well in simulations and real examples.

  • PDF