• Title/Summary/Keyword: jump markov process

Search Result 7, Processing Time 0.03 seconds

Optimal control of stochastic continuous discrete systems applied to FMS

  • Boukas, E.K.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1989.10a
    • /
    • pp.733-743
    • /
    • 1989
  • This paper deals with the control of system with controlled jump Markov disturbances. A such formulation was used by Boukas to model the planning production and maintenance of a FMS with failure machines. The optimal control problem of systems with controlled jump Markov process is addressed. This problem describes the planning production and preventive maintenance of production systems. The optimality conditions in both cases finite and infinite horizon, are derived. A numerical example is presented to validate the proposed results.

  • PDF

A MULTIVARIATE JUMP DIFFUSION PROCESS FOR COUNTERPARTY RISK IN CDS RATES

  • Ramli, Siti Norafidah Mohd;Jang, Jiwook
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.19 no.1
    • /
    • pp.23-45
    • /
    • 2015
  • We consider counterparty risk in CDS rates. To do so, we use a multivariate jump diffusion process for obligors' default intensity, where jumps (i.e. magnitude of contribution of primary events to default intensities) occur simultaneously and their sizes are dependent. For these simultaneous jumps and their sizes, a homogeneous Poisson process. We apply copula-dependent default intensities of multivariate Cox process to derive the joint Laplace transform that provides us with joint survival/default probability and other relevant joint probabilities. For that purpose, the piecewise deterministic Markov process (PDMP) theory developed in [7] and the martingale methodology in [6] are used. We compute survival/default probability using three copulas, which are Farlie-Gumbel-Morgenstern (FGM), Gaussian and Student-t copulas, with exponential marginal distributions. We then apply the results to calculate CDS rates assuming deterministic rate of interest and recovery rate. We also conduct sensitivity analysis for the CDS rates by changing the relevant parameters and provide their figures.

System Replacement Policy for A Partially Observable Markov Decision Process Model

  • Kim, Chang-Eun
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.16 no.2
    • /
    • pp.1-9
    • /
    • 1990
  • The control of deterioration processes for which only incomplete state information is available is examined in this study. When the deterioration is governed by a Markov process, such processes are known as Partially Observable Markov Decision Processes (POMDP) which eliminate the assumption that the state or level of deterioration of the system is known exactly. This research investigates a two state partially observable Markov chain in which only deterioration can occur and for which the only actions possible are to replace or to leave alone. The goal of this research is to develop a new jump algorithm which has the potential for solving system problems dealing with continuous state space Markov chains.

  • PDF

Efficient Bayesian Inference on Asymmetric Jump-Diffusion Models (비대칭적 점프확산 모형의 효율적인 베이지안 추론)

  • Park, Taeyoung;Lee, Youngeun
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.6
    • /
    • pp.959-973
    • /
    • 2014
  • Asset pricing models that account for asymmetric volatility in asset prices have been recently proposed. This article presents an efficient Bayesian method to analyze asset-pricing models. The method is developed by devising a partially collapsed Gibbs sampler that capitalizes on the functional incompatibility of conditional distributions without complicating the updates of model components. The proposed method is illustrated using simulated data and applied to daily S&P 500 data observed from September 1980 to August 2014.

Robust Fuzzy Observer-Based Output-Feedback Controller for Networked Control Systems (네트워크 제어 시스템의 강인 퍼지 관측기 기반 출력궤환 제어기)

  • Jee, Sung-Chul;Lee, Ho-Jae;Joo, Young-Hoon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.4
    • /
    • pp.464-469
    • /
    • 2009
  • This paper discusses a robust observer-based output-feedback stabilization of an uncertain Takagi-Sugeno (T-S) fuzzy system in a network. In the networked control system, the input delay occurs inevitably and it is expressed by the Markovian stochastic process. To design robust sampled-data observer-based output-feedback controller, we discretize the T-S fuzzy system and represent as a jump system. Stochastic robust stabilization condition is formulated in terms of linear matrix inequalities.