• Title/Summary/Keyword: Markov Chain Method

Search Result 339, Processing Time 0.022 seconds

Reliability Estimation of a Two Mixture Exponential Model Using Gibbs sampler

  • Kim, Hee-Cheul;Kim, Pyong-Koo
    • Proceedings of the Korean Society for Quality Management Conference
    • /
    • 1998.11a
    • /
    • pp.225-232
    • /
    • 1998
  • A Markov Chain Monte Carlo method with data augmentation is developed to compute the features of the posterior distribution. This data augmentation approach facilitates the specification of the transitional measure in the Markov Chain. Bayesian analysis of the mixture exponential model discusses using the Gibbs sampler. Parameter and reliability estimators are obtained. A numerical study is provided.

  • PDF

FUNCTIONAL CENTRAL LIMIT THEOREMS FOR THE GIBBS SAMPLER

  • Lee, Oe-Sook
    • Communications of the Korean Mathematical Society
    • /
    • v.14 no.3
    • /
    • pp.627-633
    • /
    • 1999
  • Let the given distribution $\pi$ have a log-concave density which is proportional to exp(-V(x)) on $R^d$. We consider a Markov chain induced by the method Gibbs sampling having $\pi$ as its in-variant distribution and prove geometric ergodicity and the functional central limit theorem for the process.

  • PDF

BAYESIAN INFERENCE FOR MTAR MODEL WITH INCOMPLETE DATA

  • Park, Soo-Jung;Oh, Man-Suk;Shin, Dong-Wan
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.05a
    • /
    • pp.183-189
    • /
    • 2003
  • A momentum threshold autoregressive (MTAR) model, a nonlinear autoregressive model, is analyzed in a Bayesian framework. Parameter estimation in the presence of missing data is done by using Markov chain Monte Carlo methods. We also propose simple Bayesian test procedures for asymmetry and unit roots. The proposed method is applied to a set of Korea unemployment rate data and reveals evidence for asymmetry and a unit root.

  • PDF

Hierarchical Bayes Analysis of Smoking and Lung Cancer Data

  • Oh, Man-Suk;Park, Hyun-Jin
    • Communications for Statistical Applications and Methods
    • /
    • v.9 no.1
    • /
    • pp.115-128
    • /
    • 2002
  • Hierarchical models are widely used for inference on correlated parameters as a compromise between underfitting and overfilling problems. In this paper, we take a Bayesian approach to analyzing hierarchical models and suggest a Markov chain Monte Carlo methods to get around computational difficulties in Bayesian analysis of the hierarchical models. We apply the method to a real data on smoking and lung cancer which are collected from cities in China.

Posterior density estimation for structural parameters using improved differential evolution adaptive Metropolis algorithm

  • Zhou, Jin;Mita, Akira;Mei, Liu
    • Smart Structures and Systems
    • /
    • v.15 no.3
    • /
    • pp.735-749
    • /
    • 2015
  • The major difficulty of using Bayesian probabilistic inference for system identification is to obtain the posterior probability density of parameters conditioned by the measured response. The posterior density of structural parameters indicates how plausible each model is when considering the uncertainty of prediction errors. The Markov chain Monte Carlo (MCMC) method is a widespread medium for posterior inference but its convergence is often slow. The differential evolution adaptive Metropolis-Hasting (DREAM) algorithm boasts a population-based mechanism, which nms multiple different Markov chains simultaneously, and a global optimum exploration ability. This paper proposes an improved differential evolution adaptive Metropolis-Hasting algorithm (IDREAM) strategy to estimate the posterior density of structural parameters. The main benefit of IDREAM is its efficient MCMC simulation through its use of the adaptive Metropolis (AM) method with a mutation strategy for ensuring quick convergence and robust solutions. Its effectiveness was demonstrated in simulations on identifying the structural parameters with limited output data and noise polluted measurements.

The Conformity Effect in Online Product Rating: The Pattern Recognition Approach

  • Kim, Hyung Jun;Kim, Songmi;Kim, Wonjoon
    • International Journal of Contents
    • /
    • v.13 no.4
    • /
    • pp.80-87
    • /
    • 2017
  • Since the advent of the Internet, and the development of smart devices, people have begun to spend more time in online platforms; this phenomenon has created a large number of online Words of Mouth (WOM) daily. Under these changes, one of the important aspects to consider is the conformity effect in online WOM; that is, whether an individual's own opinion would be influenced by the majority opinion of other people. This study, therefore, investigates whether there is the conformity effect in online product ratings for Amazon.com using the method called Markov Chain analysis. Markov Chain analysis considers the stochastic process that satisfies the Markov property, and we assume that the generation of online product ratings follows the process. Under the assumption that people are usually independent when they express their opinion in online platforms, we analyze the interdependency among rating sequences, and we find weak evidence that there exists the conformity effect in online product rating. This suggests that people who leave online product ratings consider others' opinions.

Automatic Generation of Music Accompaniment Using Reinforcement Learning (강화 학습을 통한 자동 반주 생성)

  • Kim, Na-Ri;Kwon, Ji-Yong;Yoo, Min-Joon;Lee, In-Kwon
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.739-743
    • /
    • 2008
  • In this paper, we introduce a method for automatically generating accompaniment music, according to user's input melody. The initial accompaniment chord is generated by analyzing user's input melody. Then next chords are generated continuously based on markov chain probability table in which transition probabilities of each chord are defined. The probability table is learned according to reinforcement learning mechanism using sample data of existing music. Also during playing accompaniment, the probability table is learned and refined using reward values obtained in each status to improve the behavior of playing the chord in real-time. The similarity between user's input melody and each chord is calculated using pitch class histogram. Using our method, accompaniment chords harmonized with user's melody can be generated automatically in real-time.

  • PDF

Uncertainty reduction of seismic fragility of intake tower using Bayesian Inference and Markov Chain Monte Carlo simulation

  • Alam, Jahangir;Kim, Dookie;Choi, Byounghan
    • Structural Engineering and Mechanics
    • /
    • v.63 no.1
    • /
    • pp.47-53
    • /
    • 2017
  • The fundamental goal of this study is to minimize the uncertainty of the median fragility curve and to assess the structural vulnerability under earthquake excitation. Bayesian Inference with Markov Chain Monte Carlo (MCMC) simulation has been presented for efficient collapse response assessment of the independent intake water tower. The intake tower is significantly used as a diversion type of the hydropower station for maintaining power plant, reservoir and spillway tunnel. Therefore, the seismic fragility assessment of the intake tower is a pivotal component for estimating total system risk of the reservoir. In this investigation, an asymmetrical independent slender reinforced concrete structure is considered. The Bayesian Inference method provides the flexibility to integrate the prior information of collapse response data with the numerical analysis results. The preliminary information of risk data can be obtained from various sources like experiments, existing studies, and simplified linear dynamic analysis or nonlinear static analysis. The conventional lognormal model is used for plotting the fragility curve using the data from time history simulation and nonlinear static pushover analysis respectively. The Bayesian Inference approach is applied for integrating the data from both analyses with the help of MCMC simulation. The method achieves meaningful improvement of uncertainty associated with the fragility curve, and provides significant statistical and computational efficiency.

Evaluating the Investment in the Malaysian Construction Sector in the Long-run Using the Modified Internal Rate of Return: A Markov Chain Approach

  • SARSOUR, Wajeeh Mustafa;SABRI, Shamsul Rijal Muhammad
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.7 no.8
    • /
    • pp.281-287
    • /
    • 2020
  • In capital budgeting practices, investment project evaluations based on the net present value (NPV) and the internal rate of return (IRR) represent the traditional evaluation techniques. Compared with the traditional methods, the modified internal rate of return (MIRR) gives the opportunity to evaluate an investment in certain projet, while taking the changes in cash flows over time and issuing shares such as dividing shares, bonuses, and dividend for each end of the investment year into account. Therefore, this study aims to evaluate an investment in the Malaysian construction sector utilizing financial data for 39 public listed companies operating in the Malaysian construction sector over the period from Jan 1, 2007, to December 30, 2018, based on the MIRR method. Stochastic was studied in this study to estimate the estimated probability by applying the Markov chain model to the MIRR method where the transition matrix has two possible movements of either Good (G) or Bad (B). it is found that the long-run probability of getting a good investment is higher than the probability of getting a bad investment in the long-run, where were the probabilities of good and bad are 0.5119, 0.4881, respectively. Hence, investment in the Malaysian construction sector is recommended.

Parameter Learning of Dynamic Bayesian Networks using Constrained Least Square Estimation and Steepest Descent Algorithm (제약조건을 갖는 최소자승 추정기법과 최급강하 알고리즘을 이용한 동적 베이시안 네트워크의 파라미터 학습기법)

  • Cho, Hyun-Cheol;Lee, Kwon-Soon;Koo, Kyung-Wan
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.58 no.2
    • /
    • pp.164-171
    • /
    • 2009
  • This paper presents new learning algorithm of dynamic Bayesian networks (DBN) by means of constrained least square (LS) estimation algorithm and gradient descent method. First, we propose constrained LS based parameter estimation for a Markov chain (MC) model given observation data sets. Next, a gradient descent optimization is utilized for online estimation of a hidden Markov model (HMM), which is bi-linearly constructed by adding an observation variable to a MC model. We achieve numerical simulations to prove its reliability and superiority in which a series of non stationary random signal is applied for the DBN models respectively.