• 제목/요약/키워드: Markov-chain Model

검색결과 556건 처리시간 0.027초

Markov Chain Monte Carlo simulation based Bayesian updating of model parameters and their uncertainties

  • Sengupta, Partha;Chakraborty, Subrata
    • Structural Engineering and Mechanics
    • /
    • 제81권1호
    • /
    • pp.103-115
    • /
    • 2022
  • The prediction error variances for frequencies are usually considered as unknown in the Bayesian system identification process. However, the error variances for mode shapes are taken as known to reduce the dimension of an identification problem. The present study attempts to explore the effectiveness of Bayesian approach of model parameters updating using Markov Chain Monte Carlo (MCMC) technique considering the prediction error variances for both the frequencies and mode shapes. To remove the ergodicity of Markov Chain, the posterior distribution is obtained by Gaussian Random walk over the proposal distribution. The prior distributions of prediction error variances of modal evidences are implemented through inverse gamma distribution to assess the effectiveness of estimation of posterior values of model parameters. The issue of incomplete data that makes the problem ill-conditioned and the associated singularity problem is prudently dealt in by adopting a regularization technique. The proposed approach is demonstrated numerically by considering an eight-storey frame model with both complete and incomplete modal data sets. Further, to study the effectiveness of the proposed approach, a comparative study with regard to accuracy and computational efficacy of the proposed approach is made with the Sequential Monte Carlo approach of model parameter updating.

Markov Chain Monte Carol estimation in Two Successive Occasion Sampling with Radomized Response Model

  • Lee, Kay-O
    • Communications for Statistical Applications and Methods
    • /
    • 제7권1호
    • /
    • pp.211-224
    • /
    • 2000
  • The Bayes estimation of the proportion in successive occasions sampling with randomized response model is discussed by means of Acceptance Rejection sampling. Bayesian estimation of transition probabilities in two successive occasions is suggested via Markov Chain Monte Carlo algorithm and its applicability is represented in a numerical example.

  • PDF

Predicting PM2.5 Concentrations Using Artificial Neural Networks and Markov Chain, a Case Study Karaj City

  • Asadollahfardi, Gholamreza;Zangooei, Hossein;Aria, Shiva Homayoun
    • Asian Journal of Atmospheric Environment
    • /
    • 제10권2호
    • /
    • pp.67-79
    • /
    • 2016
  • The forecasting of air pollution is an important and popular topic in environmental engineering. Due to health impacts caused by unacceptable particulate matter (PM) levels, it has become one of the greatest concerns in metropolitan cities like Karaj City in Iran. In this study, the concentration of $PM_{2.5}$ was predicted by applying a multilayer percepteron (MLP) neural network, a radial basis function (RBF) neural network and a Markov chain model. Two months of hourly data including temperature, NO, $NO_2$, $NO_x$, CO, $SO_2$ and $PM_{10}$ were used as inputs to the artificial neural networks. From 1,488 data, 1,300 of data was used to train the models and the rest of the data were applied to test the models. The results of using artificial neural networks indicated that the models performed well in predicting $PM_{2.5}$ concentrations. The application of a Markov chain described the probable occurrences of unhealthy hours. The MLP neural network with two hidden layers including 19 neurons in the first layer and 16 neurons in the second layer provided the best results. The coefficient of determination ($R^2$), Index of Agreement (IA) and Efficiency (E) between the observed and the predicted data using an MLP neural network were 0.92, 0.93 and 0.981, respectively. In the MLP neural network, the MBE was 0.0546 which indicates the adequacy of the model. In the RBF neural network, increasing the number of neurons to 1,488 caused the RMSE to decline from 7.88 to 0.00 and caused $R^2$ to reach 0.93. In the Markov chain model the absolute error was 0.014 which indicated an acceptable accuracy and precision. We concluded the probability of occurrence state duration and transition of $PM_{2.5}$ pollution is predictable using a Markov chain method.

혼합 군에 대한 확률적 란체스터 모형의 정규근사 (Gaussian Approximation of Stochastic Lanchester Model for Heterogeneous Forces)

  • 박동현;김동현;문형일;신하용
    • 대한산업공학회지
    • /
    • 제42권2호
    • /
    • pp.86-95
    • /
    • 2016
  • We propose a new approach to the stochastic version of Lanchester model. Commonly used approach to stochastic Lanchester model is through the Markov-chain method. The Markov-chain approach, however, is not appropriate to high dimensional heterogeneous force case because of large computational cost. In this paper, we propose an approximation method of stochastic Lanchester model. By matching the first and the second moments, the distribution of each unit strength can be approximated with multivariate normal distribution. We evaluate an approximation of discrete Markov-chain model by measuring Kullback-Leibler divergence. We confirmed high accuracy of approximation method, and also the accuracy and low computational cost are maintained under high dimensional heterogeneous force case.

Markov Chain Approach to Forecast in the Binomial Autoregressive Models

  • Kim, Hee-Young;Park, You-Sung
    • Communications for Statistical Applications and Methods
    • /
    • 제17권3호
    • /
    • pp.441-450
    • /
    • 2010
  • In this paper we consider the problem of forecasting binomial time series, modelled by the binomial autoregressive model. This paper considers proposed by McKenzie (1985) and is extended to a higher order by $Wei{\ss}$(2009). Since the binomial autoregressive model is a Markov chain, we can apply the earlier work of Bu and McCabe (2008) for integer valued autoregressive(INAR) model to the binomial autoregressive model. We will discuss how to compute the h-step-ahead forecast of the conditional probabilities of $X_{T+h}$ when T periods are used in fitting. Then we obtain the maximum likelihood estimator of binomial autoregressive model and use it to derive the maximum likelihood estimator of the h-step-ahead forecast of the conditional probabilities of $X_{T+h}$. The methodology is illustrated by applying it to a data set previously analyzed by $Wei{\ss}$(2009).

RAYLEIGH와 ERLANG 추세를 가진 혼합 고장모형에 대한 베이지안 추론에 관한 연구 (Bayesian Inference for Mixture Failure Model of Rayleigh and Erlang Pattern)

  • 김희철;이승주
    • 응용통계연구
    • /
    • 제13권2호
    • /
    • pp.505-514
    • /
    • 2000
  • 마코브체인 몬테칼로방법중에서 깁스 추출방법을 혼합 고장모형에 이용하였다. 베이자안 추론에서 조건부분포를 가지고 사후 분포를 결정하는데 있어서 계산 문제와 이론적인 정당성을 고려하여 감마족인 Rayleigh와 Erlang추세를 가진 혼합모형에 대하여 깁스샘플링 알고리즘을 이용하여 베이지안 계산과 신뢰도 추이를 알아보고 모의실험자료를 이용하여 수치적인 계산을 시행하고 그 결과를 제시하였다.

  • PDF

Analytic Throughput Model for Network Coded TCP in Wireless Mesh Networks

  • Zhang, Sanfeng;Lan, Xiang;Li, Shuang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권9호
    • /
    • pp.3110-3125
    • /
    • 2014
  • Network coding improves TCP's performance in lossy wireless networks. However, the complex congestion window evolution of network coded TCP (TCP-NC) makes the analysis of end-to-end throughput challenging. This paper analyzes the evolutionary process of TCP-NC against lossy links. An analytic model is established by applying a two-dimensional Markov chain. With maximum window size, end-to-end erasure rate and redundancy parameter as input parameters, the analytic model can reflect window evolution and calculate end-to-end throughput of TCP-NC precisely. The key point of our model is that by the novel definition of the states of Markov chain, both the number of related states and the computation complexity are substantially reduced. Our work helps to understand the factors that affect TCP-NC's performance and lay the foundation of its optimization. Extensive simulations on NS2 show that the analytic model features fairly high accuracy.

Bayesian Conjugate Analysis for Transition Probabilities of Non-Homogeneous Markov Chain: A Survey

  • Sung, Minje
    • Communications for Statistical Applications and Methods
    • /
    • 제21권2호
    • /
    • pp.135-145
    • /
    • 2014
  • The present study surveys Bayesian modeling structure for inferences about transition probabilities of Markov chain. The motivation of the study came from the data that shows transitional behaviors of emotionally disturbed children undergoing residential treatment program. Dirichlet distribution was used as prior for the multinomial distribution. The analysis with real data was implemented in WinBUGS programming environment. The performance of the model was compared to that of alternative approaches.

수정 연쇄 말콥체인을 이용한 2차원 공간의 추계론적 예측기법의 개발 (A Development of Generalized Coupled Markov Chain Model for Stochastic Prediction on Two-Dimensional Space)

  • 박은규
    • 한국지하수토양환경학회지:지하수토양환경
    • /
    • 제10권5호
    • /
    • pp.52-60
    • /
    • 2005
  • 본 연구에서는 기존 연쇄 말콥체인(Coupled Markov Chain, CMC) 확률식의 연산 경직성을 개선하기 위하여 일반화 된 2차원 연쇄 말콥체인(Generalized Coupled Markov Chain, GCMC) 확률식이 개발되었다. 또한 개발된 확률식에 근거하여 평면상에서 무작위적으로 분포하는 참조정보를 효율적으로 활용하는 연산 알고리듬이 개발되었다. 개발된 모델은 대안적 지구통계 기법으로의 새로운 기능성을 제시한다. 본 연구를 통해 새롭게 개발된 GCMC 확률식은 기존 CMC 확률식에 비해 보다 유연한 참조 정보 활용 가능성을 가지며 특수한 경우로 기존 CMC 확률식이 유도되었다. 또한 순차적 연산의 인위적 오류 발생 기능성 및 실제 야외 데이터의 낮은 빈도를 고려하여 무작위로 추출된 위치에서 각 범위를 이용한 연산 알고리듬이 제안되었다. 개발된 모델은 가상의 2차원 토양도에 적용되었으며 기존 지구통계 기법인 SIS에 비하여 손색이 없는 새로운 지구통계 기법으로 토양 및 지질을 포함한 다양한 예측에 이용 될 수 있는 가능성을 보였다. 낮은 빈도로 샘플링 된 지시자에 대해서는 기존 지구통계 기법과 마찬가지로 저평가되는 현상을 보였으며 이를 보완하기 위하여 다양한 소스의 데이터 융합 등을 바탕으로 한 계속적인 연구가 요구된다.

Bayesian Markov Chain Monte Carlo 기법을 통한 NWS-PC 강우-유출 모형 매개변수의 최적화 및 불확실성 분석 (Parameter Optimization and Uncertainty Analysis of the NWS-PC Rainfall-Runoff Model Coupled with Bayesian Markov Chain Monte Carlo Inference Scheme)

  • 권현한;문영일;김병식;윤석영
    • 대한토목학회논문집
    • /
    • 제28권4B호
    • /
    • pp.383-392
    • /
    • 2008
  • 수공구조물을 설계하거나 수자원계획을 수립할 때 제한된 수문자료로 인해 수문모형의 매개변수를 추정하는데 어려움이 따르며 추정된 결과에 신뢰성을 부여하기 위해서 필수적으로 불확실성 분석이 필요하다 하겠다. 이러한 관점에서 본 연구에서는 국내외에서 주로 이용되고 있는 NWS-PC 강우-유출 모형을 대상으로 보다 진보된 매개변수 추정과 불확실성 분석이 가능한 Bayesian Markov Chain Monte Carlo 기법과 결합하여 국내 소양강댐 유역 일유입량 모의에 적용하였다. 실측 일유입량 자료를 대상으로 모형의 검정과정을 수행하였으며 NWS-PC 모형의 총 13개의 매개변수에 대한 사후분포를 추정하여 유출수문곡선의 불확실성 구간을 추정하였다. 검정 및 검증 모두에서 Bayesian Markov Chain Monte Carlo 기법이 모형의 적합성 측면에서 기존 방법론과 비교해보면 다소 우수하거나 비슷한 결과를 나타내었다. 실제로 유역에 발생하는 유출은 다양한 요인에 따라 변화될 수 있으며 이러한 점에서 Bayesian 방법은 강우-유출 관계에서 발생하는 이러한 불확실성을 매개변수의 불확실성으로 인지함으로서 우리가 예상치 못한 유출 사상에 대한 형태를 고려할 수 있는 장점이 있다. 따라서 댐 설계와 같은 대규모 수공 구조물 설계 시에 이러한 불확실성이 접목된 강우-유출 분석이 이루어진다면 보다 합리적인 방법으로 홍수 위험도 분석이 가능하며 더욱이 댐 규모 결정에 있어서 신뢰성 있는 의사 결정 수단을 제공할 수 있을 것으로 사료된다.