• 제목/요약/키워드: strong Markov property

검색결과 3건 처리시간 0.021초

Sensitivity of Conditions for Lumping Finite Markov Chains

  • Suh, Moon-Taek
    • 한국국방경영분석학회지
    • /
    • 제11권1호
    • /
    • pp.111-129
    • /
    • 1985
  • Markov chains with large transition probability matrices occur in many applications such as manpowr models. Under certain conditions the state space of a stationary discrete parameter finite Markov chain may be partitioned into subsets, each of which may be treated as a single state of a smaller chain that retains the Markov property. Such a chain is said to be 'lumpable' and the resulting lumped chain is a special case of more general functions of Markov chains. There are several reasons why one might wish to lump. First, there may be analytical benefits, including relative simplicity of the reduced model and development of a new model which inherits known or assumed strong properties of the original model (the Markov property). Second, there may be statistical benefits, such as increased robustness of the smaller chain as well as improved estimates of transition probabilities. Finally, the identification of lumps may provide new insights about the process under investigation.

  • PDF

A SHARP BOUND FOR ITO PROCESSES

  • Choi, Chang-Sun
    • 대한수학회지
    • /
    • 제35권3호
    • /
    • pp.713-725
    • /
    • 1998
  • Let X and Y be Ito processes with dX$_{s}$ = $\phi$$_{s}$dB$_{s}$$\psi$$_{s}$ds and dY$_{s}$ = (equation omitted)dB$_{s}$ + ξ$_{s}$ds. Burkholder obtained a sharp bound on the distribution of the maximal function of Y under the assumption that │Y$_{0}$$\leq$│X$_{0}$│,│ζ│$\leq$$\phi$│, │ξ│$\leq$$\psi$│ and that X is a nonnegative local submartingale. In this paper we consider a wider class of Ito processes, replace the assumption │ξ│$\leq$$\psi$│ by a more general one │ξ│$\leq$$\alpha$$\psi$│ , where a $\geq$ 0 is a constant, and get a weak-type inequality between X and the maximal function of Y. This inequality, being sharp for all a $\geq$ 0, extends the work by Burkholder.der.urkholder.der.

  • PDF

FIRST PASSAGE PROBLEM FOR WIENER PATHS CROSSING DIFFERENTIABLE CURVES

  • Jang, Yu-Seon;Kim, Sung-Lai;Kim, Sung-Kyun
    • Journal of applied mathematics & informatics
    • /
    • 제19권1_2호
    • /
    • pp.475-484
    • /
    • 2005
  • Let W(t) be a Wiener path, let $\xi\;:\;[0,\;{\infty})\;\to\;\mathbb{R}$ be a continuous and increasing function satisfying $\xi$(0) > 0, let $$T_{/xi}=inf\{t{\geq}0\;:\;W(t){\geq}\xi(t)\}$$ be the first-passage time of W over $\xi$, and let F denote the distribution function of $T_{\xi}$. Then the first passage problem has a unique continuous solution as following $$F(t)=u(t)+{\sum_{n=1}^\infty}\int_0^t\;H_n(t,s)u(s)ds$$, where $$u(t)=2\Psi(\xi(t)/\sqrt{t})\;and\;H_1(t,s)=d\Phi\;(\{\xi(t)-\xi(s)\}/\sqrt{t-s})/ds\;for\;0\;{\leq}\;s.