• Title/Summary/Keyword: discrete-time stochastic process

Search Result 31, Processing Time 0.024 seconds

Stability Analysis of Kalman Filter by Orthonormalized Compressed Measurement

  • Hyung Keun Lee;Jang Gyu Lee
    • KIEE International Transaction on Systems and Control
    • /
    • v.2D no.2
    • /
    • pp.97-107
    • /
    • 2002
  • In this paper, we propose the concept of orthonormalized compressed measurement for the stability analysis of discrete linear time-varying Kalman filters. Unlike previous studies that deal with the homogeneous portion of Kalman filters, the proposed Lyapunov method directly deals with the stochastically-driven system. The orthonorrmalized compressed measurement provides information on the a priori state estimate of the Kalman filter at the k-th step that is propagated from the a posteriori state estimate at the previous block of time. Since the complex multiple-step propagations of a candidate Lyapunov function with process and measurement noises can be simplified to a one-step Lyapunov propagation by the orthonormalized compressed measurement, a stochastic radius of attraction can be derived that would be impractically difficult to obtain by the conventional multiple-step Lyapunov method.

  • PDF

ALTERNATIVE NUMERICAL APPROACHES TO THE JUMP-DIFFUSION OPTION VALUATION

  • CHOI BYUNG WOOK;KI HO SAM;LEE MI YOUNG
    • Journal of applied mathematics & informatics
    • /
    • v.17 no.1_2_3
    • /
    • pp.519-536
    • /
    • 2005
  • The purpose of this paper is to propose several approximating methods to obtain the American option prices under jump-diffusion processes. The first method is to extend an approximating method to the optimal exercise boundary by a multipiece exponential function suggested by Ju [17]. The second approach is to modify the analytical methods of MacMillan [20] and Zhang [25] in a discrete time space. The third approach is to apply the simulation technique of Ibanez and Zapareto [14] to the problem of American option pricing when the jumps are allowed. Finally, we compare the numerical performance of each suggesting method with those of the previous numerical approaches.

Localization and a Distributed Local Optimal Solution Algorithm for a Class of Multi-Agent Markov Decision Processes

  • Chang, Hyeong-Soo
    • International Journal of Control, Automation, and Systems
    • /
    • v.1 no.3
    • /
    • pp.358-367
    • /
    • 2003
  • We consider discrete-time factorial Markov Decision Processes (MDPs) in multiple decision-makers environment for infinite horizon average reward criterion with a general joint reward structure but a factorial joint state transition structure. We introduce the "localization" concept that a global MDP is localized for each agent such that each agent needs to consider a local MDP defined only with its own state and action spaces. Based on that, we present a gradient-ascent like iterative distributed algorithm that converges to a local optimal solution of the global MDP. The solution is an autonomous joint policy in that each agent's decision is based on only its local state.cal state.

Performance Analysis of a Congestion cControl Mechanism Based on Active-WRED Under Multi-classes Traffic (멀티클래스 서비스 환경에서 Active-WRED 기반의 혼잡 제어 메커니즘 및 성능 분석)

  • Kim, Hyun-Jong;Kim, Jong-Chan;Choi, Seong-Gon
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.45 no.5
    • /
    • pp.125-133
    • /
    • 2008
  • In this paper, we propose active queue management mechanism (Active-WRED) to guarantee quality of the high priority service class in multi-class traffic service environment. In congestion situation, this mechanism increases drop probability of low priority traffic and reduces the drop probability of the high priority traffic, therefore it can improve the quality of the high priority service. In order to analyze the performance of our mechanism we introduce the stochastic analysis of a discrete-time queueing systems for the performance evaluation of the Active Queue Management (AQM) based congestion control mechanism called Weighted Random Early Detection (WRED) using a two-state Markov-Modulated Bernoulli arrival process (MMBP-2) as the traffic source. A two-dimensional discrete-time Harkov chain is introduced to model the Active-WRED mechanism for two traffic classes (Guaranteed Service and Best Effort Service) where each dimension corresponds to a traffic class with its own parameters.

Design of Intelligent Controller with Time Delay for Internet-Based Remote Control (인터넷 기반 원격제어를 위한 임의의 시간지연을 갖는 지능형 제어기의 설계)

  • Joo, Young-Hoon;Kim, Jung-Chan;Lee, Oh-Jae;Park, Jin-Bae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.13 no.3
    • /
    • pp.293-299
    • /
    • 2003
  • This paper discusses a design of intelligent controller with time delay for Internet-based remote control. The finite Markovian process is adopted to model the input delay of the overall control system. It is assumed that the zero and hold devices are used for control input. The Takagi-Sugeno (T-S) fuzzy system with uncertain input delay is utilized to represent nonlinear plant. The continuous-time T-S fuzzy system with the Markovian input delay is discretized for easy handling delay, accordingly, the discretized T-S fuzzy system is represented by a discrete-time T-S fuzzy system with jumping parameters. The robust stochastic stabilizibility of the jump T-S fuzzy system is derived and formulated in terms of linear matrix inequalities (LMIs). An experimental results is provided to visualize the feasibility of the proposed method.

A Nuclide Transport Model in the Fractured Rock Medium Using a Continuous Time Markov Process (연속시간 마코프 프로세스를 이용한 균열암반매질에서의 핵종이동 모델)

  • Lee, Y.M.;Kang, C.H.;Hahn, P.S.;Park, H.H.;Lee, K.J.
    • Nuclear Engineering and Technology
    • /
    • v.25 no.4
    • /
    • pp.529-538
    • /
    • 1993
  • A stochastic way using continuous time Markov process is presented to model the one-dimensional nuclide transport in fractured rock matrix as an extended study for previous work [1]. A nuclide migration model by the continuous time Markov process for single planar fractured rock matrix, which is considered as a transient system where a process by which the nuclide is diffused into the rock matrix from the fracture may be no more time homogeneous, is compared with a conventional deterministic analytical solution. The primary desired quantities from a stochastic model are the expected values and variance of the state variables as a function of time. The time-dependent probability distributions of nuclides are presented for each discretized compartment of the medium given intensities of transition. Since this model is discrete in medium space, parameters which affect nuclide transport could be easily incorporated for such heterogeneous media as the fractured rock matrix and the layered porous media. Even though the model developed in this study was shown to be sensitive to the number of discretized compartment showing numerical dispersion as the number of compartments are decreased, with small compensating of dispersion coefficient, the model agrees well to analytical solution.

  • PDF

Survivability Evaluation Model in Wireless Sensor Network using Software Rejuvenation

  • Parvin, Sazia;Thein, Thandar;Kim, Dong-Seong;Park, Jong-Sou
    • Convergence Security Journal
    • /
    • v.8 no.1
    • /
    • pp.91-100
    • /
    • 2008
  • The previous works in sensor networks security have focused on the aspect of confidentiality, authentication and integrity based on cryptographic primitives. There has been no prior work to assess the survivability in systematic way. Accordingly, this paper presents a survivability model of wireless sensor networks using software rejuvenation for dual adaptive cluster head. The survivability model has state transition to reflect status of real wireless sensor networks. In this paper, we only focus on a survivability model which is capable of describing cluster head compromise in the networks and able to switch over the redundant cluster head in order to increase the survivability of that cluster. Second, this paper presents how to enhance the survivability of sensor networks using software rejuvenation methodology for dual cluster head in wireless sensor network. We model and analyze each cluster as a stochastic process based on Semi Markov Process (SMP) and Discrete Time Markov Chain (DTMC). The proof of example scenarios and numerical analysis shows the feasibility of our approach.

  • PDF

A Study on Stochastic Wave Propagation Model to Generate Various Uninterrupted Traffic Flows (다양한 연속 교통류 구현을 위한 확률파장전파모형의 개발)

  • Chang, Hyun-Ho;Baek, Seung-Kirl;Park, Jae-Beom
    • Journal of Korean Society of Transportation
    • /
    • v.22 no.4 s.75
    • /
    • pp.147-158
    • /
    • 2004
  • A class of SWP(Stochastic Wane Propagation) models microscopically mimics individual vehicles' stochastic behavior and traffic jam propagation with simplified car-following models based on CA(Cellular Automata) theory and macroscopically captures dynamic traffic flow relationships based on statistical physics. SWP model, a program-oriented model using both discrete time-space and integer data structure, can simulate a huge road network with high-speed computing time. However, the model has shortcomings to both the capturing of low speed within a jam microscopically and that of the density and back propagation speed of traffic congestion macroscopically because of the generation of spontaneous jam through unrealistic collision avoidance. In this paper, two additional rules are integrated into the NaSch model. The one is SMR(Stopping Maneuver Rule) to mimic vehicles' stopping process more realistically in the tail of traffic jams. the other is LAR(Low Acceleration Rule) for the explanation of low speed characteristics within traffic jams. Therefore, the CA car-following model with the two rules prevents the lockup condition within a heavily traffic density capturing both the stopping maneuver behavior in the tail of traffic jam and the low acceleration behavior within jam microscopically, and generates more various macroscopic traffic flow mechanism than NaSch model's with the explanation of propagation speed and density of traffic jam.

Analysis on the Power Spectral Density of Ultra Wideband(UWB) Communication System (초광대역 통신 시스템의 전력 스펙트럼 밀도 분석)

  • Lee, Jung-Suk;Kim, Jong-Han;Kim, Yoo-Chang;Kim, Jung-Sun;Kim, Won-Hoo
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.38 no.10
    • /
    • pp.34-40
    • /
    • 2001
  • Ultra Wide Band (UWB) system uses wide band signal, which power spectral density is over all band, It likes as a noise floor, so UWB system can be used without interfering with other communication system. For the first time, we adopted Rayleigh mono pulse antipodal signal which had symmetric characteristic and zero mean. With the power spectral density using stochastic process, we knew that the antipodal signaling scheme removed discrete spectrum and concluded that this had much better spectral suppression, probability of error and data rate than PPM (Pulse Positioning Modulation).

  • PDF

Development of Two-lane Highway Vehicle Model Based on Discrete Time and Space (이산적 시공간 기반 2차로 도로 차량모형 개발)

  • Yoon, Byoung Jo
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.31 no.6D
    • /
    • pp.785-791
    • /
    • 2011
  • Two-lane and two-way traffic flow shows various dynamic relationships according to the behaviors of low-speed vehicle and overtaking. And it is essential to develop a vehicle model which simultaneously explains the behaviors of low-speed vehicle and overtaking using opposite lane in order to microscopically analyze various two-lane and two-way traffic flows by traffic flow simulation. In Korea, some studies for car-following and lane-changing models for freeway or signalized road have been reported, but few researches for the development of vehicle model for two-lane and two-way highway have been done. Hence, a microscopic two-lane and two-way vehicle model was, in this study, developed with the consideration of overtaking process and is based on CA (Cellular Automata) which is one of discrete time-space models. The developed model is parallel combined with an adjusted CA car-following model and an overtaking model. The results of experimental simulation showed that the car-following model explained the various macroscopic relationships of traffic flow and overtaking model reasonably generated the various behaviors of macroscopic traffic flows under the conditions of both opposite traffic flow and stochastic parameter to consider overtaking. The vehicle model presented in this study is expected to be used for the simulation of more various two-lane, two-way traffic flows.