• Title/Summary/Keyword: markov models

Search Result 490, Processing Time 0.031 seconds

A hidden Markov model for long term drought forecasting in South Korea

  • Chen, Si;Shin, Ji-Yae;Kim, Tae-Woong
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2015.05a
    • /
    • pp.225-225
    • /
    • 2015
  • Drought events usually evolve slowly in time and their impacts generally span a long period of time. This indicates that the sequence of drought is not completely random. The Hidden Markov Model (HMM) is a probabilistic model used to represent dependences between invisible hidden states which finally result in observations. Drought characteristics are dependent on the underlying generating mechanism, which can be well modelled by the HMM. This study employed a HMM with Gaussian emissions to fit the Standardized Precipitation Index (SPI) series and make multi-step prediction to check the drought characteristics in the future. To estimate the parameters of the HMM, we employed a Bayesian model computed via Markov Chain Monte Carlo (MCMC). Since the true number of hidden states is unknown, we fit the model with varying number of hidden states and used reversible jump to allow for transdimensional moves between models with different numbers of states. We applied the HMM to several stations SPI data in South Korea. The monthly SPI data from January 1973 to December 2012 was divided into two parts, the first 30-year SPI data (January 1973 to December 2002) was used for model calibration and the last 10-year SPI data (January 2003 to December 2012) for model validation. All the SPI data was preprocessed through the wavelet denoising and applied as the visible output in the HMM. Different lead time (T= 1, 3, 6, 12 months) forecasting performances were compared with conventional forecasting techniques (e.g., ANN and ARMA). Based on statistical evaluation performance, the HMM exhibited significant preferable results compared to conventional models with much larger forecasting skill score (about 0.3-0.6) and lower Root Mean Square Error (RMSE) values (about 0.5-0.9).

  • PDF

Parameter Learning of Dynamic Bayesian Networks using Constrained Least Square Estimation and Steepest Descent Algorithm (제약조건을 갖는 최소자승 추정기법과 최급강하 알고리즘을 이용한 동적 베이시안 네트워크의 파라미터 학습기법)

  • Cho, Hyun-Cheol;Lee, Kwon-Soon;Koo, Kyung-Wan
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.58 no.2
    • /
    • pp.164-171
    • /
    • 2009
  • This paper presents new learning algorithm of dynamic Bayesian networks (DBN) by means of constrained least square (LS) estimation algorithm and gradient descent method. First, we propose constrained LS based parameter estimation for a Markov chain (MC) model given observation data sets. Next, a gradient descent optimization is utilized for online estimation of a hidden Markov model (HMM), which is bi-linearly constructed by adding an observation variable to a MC model. We achieve numerical simulations to prove its reliability and superiority in which a series of non stationary random signal is applied for the DBN models respectively.

A Novel Algorithm for Fault Type Fast Diagnosis in Overhead Transmission Lines Using Hidden Markov Models

  • Jannati, M.;Jazebi, S.;Vahidi, B.;Hosseinian, S.H.
    • Journal of Electrical Engineering and Technology
    • /
    • v.6 no.6
    • /
    • pp.742-749
    • /
    • 2011
  • Power transmission lines are one of the most important components of electric power system. Failures in the operation of power transmission lines can result in serious power system problems. Hence, fault diagnosis (transient or permanent) in power transmission lines is very important to ensure the reliable operation of the power system. A hidden Markov model (HMM), a powerful pattern recognizer, classifies events in a probabilistic manner based on fault signal waveform and characteristics. This paper presents application of HMM to classify faults in overhead power transmission lines. The algorithm uses voltage samples of one-fourth cycle from the inception of the fault. The simulation performed in EMTPWorks and MATLAB environments validates the fast response of the classifier, which provides fast and accurate protection scheme for power transmission lines.

Two-Dimensional Hidden Markov Mesh Chain Algorithms for Image Dcoding (이차원 영상해석을 위한 은닉 마프코프 메쉬 체인 알고리즘)

  • Sin, Bong-Gi
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.6
    • /
    • pp.1852-1860
    • /
    • 2000
  • Distinct from the Markov random field or pseudo 2D HMM models for image analysis, this paper proposes a new model of 2D hidden Markov mesh chain(HMMM) model which subsumes the definitions of and the assumptions underlying the conventional HMM. The proposed model is a new theoretical realization of 2D HMM with the causality of top-down and left-right progression and the complete lattice constraint. These two conditions enable an efficient mesh decoding for model estimation and a recursive maximum likelihood estimation of model parameters. Those algorithms are developed in theoretical perspective and, in particular, the training algorithm, it is proved, attains the optimal set of parameters.

  • PDF

Bayesian Inference for Mixture Failure Model of Rayleigh and Erlang Pattern (RAYLEIGH와 ERLANG 추세를 가진 혼합 고장모형에 대한 베이지안 추론에 관한 연구)

  • 김희철;이승주
    • The Korean Journal of Applied Statistics
    • /
    • v.13 no.2
    • /
    • pp.505-514
    • /
    • 2000
  • A Markov Chain Monte Carlo method with data augmentation is developed to compute the features of the posterior distribution. For each observed failure epoch, we introduced mixture failure model of Rayleigh and Erlang(2) pattern. This data augmentation approach facilitates specification of the transitional measure in the Markov Chain. Gibbs steps are proposed to perform the Bayesian inference of such models. For model determination, we explored sum of relative error criterion that selects the best model. A numerical example with simulated data set is given.

  • PDF

Use of Markov Chain Monte Carlo in Estimating the Economy Model

  • Lee, Seung Moon
    • Journal of Integrative Natural Science
    • /
    • v.1 no.2
    • /
    • pp.127-132
    • /
    • 2008
  • This project follows the heterogeneous agent market segmented model of Landon-Lane and Occhino (2007) with using Korean data, M1 and GDP deflator from 1882:I to 2007:II. This paper estimates parameters with Monte Carlo Markov Chain. The fraction of traders, ${\lambda}$, in Korea is 15.64%. The quarterly preferences discount factor's, ${\beta}$, posterior mean is 0.9922. The posterior mean of the inverse of the elasticity of the labor supply to the real wage, ${\varphi}$, is 0.0316. The elasticity of the labor supply to the real wage has a very large value. By Hansen (1985) and Christiano and Eichenbaum (1992) and Cooley and Hansen (1989), models having large elasticity of the aggregate labor supply better match macroeconomic data.

  • PDF

Parameters Estimation of Generalized Linear Failure Rate Semi-Markov Reliability Models

  • El-Gohary, A.;Al-Khedhair, A.
    • International Journal of Reliability and Applications
    • /
    • v.11 no.1
    • /
    • pp.1-16
    • /
    • 2010
  • In this paper we will discuss the stochastic analysis of a three state semi-Markov reliability model. Maximum likelihood procedure will be used to obtain the estimators of the parameters included in this reliability model. Based on the assumption that the lifetime and repair time of the system units are generalized linear failure rate random variables, the reliability function of this system is obtained. Also, the distribution of the first passage time of this system will be derived. Some important special cases are discussed.

  • PDF

Detection of Atrial Fibrillation Using Markov Regime Switching Models of Heart Rate Intervals (심박간격의 마코프 국면전환 모형화를 통한 심방세동 탐지)

  • Jung, Yonghan;Kim, Heeyoung
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.4
    • /
    • pp.290-295
    • /
    • 2016
  • This paper proposes a new method for the automatic detection of atrial fibrillation (AF), using Markov regime switching GARCH (1, 1) model. The proposed method is based on the observation that variability patterns of heart rate intervals during AF significantly differ from regular patterns. The proposed method captures the different patterns of heart rate intervals between two regimes : normal and AF states. We test the proposed method using Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) atrial fibrillation database, and demonstrate the effectiveness of the proposed method.

Markov Chain Approach to Forecast in the Binomial Autoregressive Models

  • Kim, Hee-Young;Park, You-Sung
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.3
    • /
    • pp.441-450
    • /
    • 2010
  • In this paper we consider the problem of forecasting binomial time series, modelled by the binomial autoregressive model. This paper considers proposed by McKenzie (1985) and is extended to a higher order by $Wei{\ss}$(2009). Since the binomial autoregressive model is a Markov chain, we can apply the earlier work of Bu and McCabe (2008) for integer valued autoregressive(INAR) model to the binomial autoregressive model. We will discuss how to compute the h-step-ahead forecast of the conditional probabilities of $X_{T+h}$ when T periods are used in fitting. Then we obtain the maximum likelihood estimator of binomial autoregressive model and use it to derive the maximum likelihood estimator of the h-step-ahead forecast of the conditional probabilities of $X_{T+h}$. The methodology is illustrated by applying it to a data set previously analyzed by $Wei{\ss}$(2009).

Contextual Modeling and Generation of Texture Observed in Single and Multi-channel Images

  • Jung, Myung-Hee
    • Korean Journal of Remote Sensing
    • /
    • v.17 no.4
    • /
    • pp.335-344
    • /
    • 2001
  • Texture is extensively studied in a variety of image processing applications such as image segmentation and classification because it is an important property to perceive regions and surfaces. This paper focused on the analysis and synthesis of textured single and multiband images using Markov Random Field model considering the existent spatial correlation. Especially, for multiband images, the cross-channel correlation existing between bands as well as the spatial correlation within band should be considered in the model. Although a local interaction is assumed between the specified neighboring pixels in MRF models, during the maximization process, short-term correlations among neighboring pixels develop into long-term correlations. This result in exhibiting phase transition. In this research, the role of temperature to obtain the most probable state during the sampling procedure in discrete Markov Random Fields and the stopping rule were also studied.