• Title/Summary/Keyword: stochastic Riccati equation

Search Result 12, Processing Time 0.031 seconds

Solvability of Stochastic Discrete Algebraic Riccati Equation

  • Oh, Kyu-Kwon;Okuyama, Yoshifumi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.33.4-33
    • /
    • 2001
  • This paper considers a stochastic discrete algebraic Riccati equation, which is a generalized version of the well-known standard discrete algebraic Riccati equation, and has additional linear terms. Under controllability, observability and the assumption that the additional terms are not too large, the existence of a positive definite solution is guaranteed. It is shown that it arises in optimal control of a linear discrete-time system with multiplicative White noise and quadratic cost. A numerical example is given.

  • PDF

INDEFINITE STOCHASTIC LQ CONTROL WITH CROSS TERM VIA SEMIDEFINITE PROGRAMMING

  • Luo, Chengxin;Feng, Enmin
    • Journal of applied mathematics & informatics
    • /
    • v.13 no.1_2
    • /
    • pp.85-97
    • /
    • 2003
  • An indefinite stochastic linear-quadratic(LQ) optimal control problem with cross term over an infinite time horizon is studied, allowing the weighting matrices to be indefinite. A systematic approach to the problem based on semidefinite programming (SDP) and .elated duality analysis is developed. Several implication relations among the SDP complementary duality, the existence of the solution to the generalized Riccati equation and the optimality of LQ problem are discussed. Based on these relations, a numerical procedure that provides a thorough treatment of the LQ problem via primal-dual SDP is given: it identifies a stabilizing optimal feedback control or determines the problem has no optimal solution. An example is provided to illustrate the results obtained.

New method for LQG control of singularly perturbed discrete stochastic systems

  • Lim, Myo-Taeg;Kwon, Sung-Ha
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1995.10a
    • /
    • pp.432-435
    • /
    • 1995
  • In this paper a new approach to obtain the solution of the linear-quadratic Gaussian control problem for singularly perturbed discrete-time stochastic systems is proposed. The alogorithm proposed is based on exploring the previous results that the exact solution of the global discrete algebraic Riccati equations is found in terms of the reduced-order pure-slow and pure-fast nonsymmetric continuous-time algebraic Riccati equations and, in addition, the optimal global Kalman filter is decomposed into pure-slow and pure-fast local optimal filters both driven by the system measurements and the system optimal control input. It is shown that the optimal linear-quadratic Gaussian control problem for singularly perturbed linear discrete systems takes the complete decomposition and parallelism between pure-slow and pure-fast filters and controllers.

  • PDF

INDEFINITE STOCHASTIC OPTIMAL LQR CONTROL WITH CROSS TERM UNDER IQ CONSTRAINTS

  • Luo, Cheng-Xin;Feng, En-Min
    • Journal of applied mathematics & informatics
    • /
    • v.15 no.1_2
    • /
    • pp.185-200
    • /
    • 2004
  • A stochastic optimal LQR control problem under some integral quadratic (IQ) constraints is studied, with cross terms in both the cost and the constraint functionals, allowing all the control weighting matrices being indefinite. Sufficient conditions for the well-posedness of this problem are given. When these conditions are satisfied, the optimal control is explicitly derived via dual theory.

A NUMERICAL SCHEME TO SOLVE NONLINEAR BSDES WITH LIPSCHITZ AND NON-LIPSCHITZ COEFFICIENTS

  • FARD OMID S.;KAMYAD ALl V.
    • Journal of applied mathematics & informatics
    • /
    • v.18 no.1_2
    • /
    • pp.73-93
    • /
    • 2005
  • In this paper, we attempt to present a new numerical approach to solve non-linear backward stochastic differential equations. First, we present some definitions and theorems to obtain the conditions, from which we can approximate the non-linear term of the backward stochastic differential equation (BSDE) and we get a continuous piecewise linear BSDE correspond with the original BSDE. We use the relationship between backward stochastic differential equations and stochastic controls by interpreting BSDEs as some stochastic optimal control problems, to solve the approximated BSDE and we prove that the approximated solution converges to the exact solution of the original non-linear BSDE in two different cases.

Indirect Kalman Filter based Sensor Fusion for Error Compensation of Low-Cost Inertial Sensors and Its Application to Attitude and Position Determination of Small Flying robot (저가 관성센서의 오차보상을 위한 간접형 칼만필터 기반 센서융합과 소형 비행로봇의 자세 및 위치결정)

  • Park, Mun-Soo;Hong, Suk-Kyo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.7
    • /
    • pp.637-648
    • /
    • 2007
  • This paper presents a sensor fusion method based on indirect Kalman filter(IKF) for error compensation of low-cost inertial sensors and its application to the determination of attitude and position of small flying robots. First, the analysis of the measurement error characteristics to zero input is performed, focusing on the bias due to the temperature variation, to derive a simple nonlinear bias model of low-cost inertial sensors. Moreover, from the experimental results that the coefficients of this bias model possess non-deterministic (stochastic) uncertainties, the bias of low-cost inertial sensors is characterized as consisting of both deterministic and stochastic bias terms. Then, IKF is derived to improve long term stability dominated by the stochastic bias error, fusing low-cost inertial sensor measurements compensated by the deterministic bias model with non-inertial sensor measurement. In addition, in case of using intermittent non-inertial sensor measurements due to the unreliable data link, the upper and lower bounds of the state estimation error covariance matrix of discrete-time IKF are analyzed by solving stochastic algebraic Riccati equation and it is shown that they are dependant on the throughput of the data link and sampling period. To evaluate the performance of proposed method, experimental results of IKF for the attitude determination of a small flying robot are presented in comparison with that of extended Kaman filter which compensates only deterministic bias error model.

Controller Design of the Nonlinear Stochastic System using Block Pulse Function (블럭펄스 함수를 이용한 확률시스템의 제어기 설계)

  • Lim, Yun-Sic;Lee, Jae-Chun;Lee, Myung-Kyu;Ahn, Doo-Soo
    • Proceedings of the KIEE Conference
    • /
    • 1997.07b
    • /
    • pp.584-586
    • /
    • 1997
  • The orthogonal polynomials have been widely employed to solve control problems, but the LQG(linear quadratic gaussian) problem remains unsolved. In this paper, we obtained the solutions of Riccati equation and covariance matrix Riccati equation by two point boundary problem and matrix fraction method using BPF(Block Pulse Function), respectively. This solutions are solved the problem of the LQG controller design.

  • PDF

Design of Kalman Filter of Nonlinear Stochastic System via BPF (블럭펄스함수를 이용한 비선형확률시스템의 칼만필터 설계)

  • Ahn, D.S.;Lim, Y.S.;Song, I.M.;Lee, M.K.
    • Proceedings of the KIEE Conference
    • /
    • 1996.07b
    • /
    • pp.1089-1091
    • /
    • 1996
  • This paper presents a design method of Kalman Filter on continuous nonlinear stochastic system via BPF(Block Pulse Function). When we design Kalman Filter on nonlinear stochastic system, we must linearize this systems. In this paper, we uses the adaptive approach scheme and BPF for linearizing of nonlinear system and solving the Riccati differential equation which is usually guite difficult. This method proposed in this paper is simple and have computational advantages. Furthermore this method is very applicable to analysis and design of Kalman Filter on nonlinear stochastic systems.

  • PDF

Application of GTH-like algorithm to Markov modulated Brownian motion with jumps

  • Hong, Sung-Chul;Ahn, Soohan
    • Communications for Statistical Applications and Methods
    • /
    • v.28 no.5
    • /
    • pp.477-491
    • /
    • 2021
  • The Markov modulated Brownian motion is a substantial generalization of the classical Brownian Motion. On the other hand, the Markovian arrival process (MAP) is a point process whose family is dense for any stochastic point process and is used to approximate complex stochastic counting processes. In this paper, we consider a superposition of the Markov modulated Brownian motion (MMBM) and the Markovian arrival process of jumps which are distributed as the bilateral ph-type distribution, the class of which is also dense in the space of distribution functions defined on the whole real line. In the model, we assume that the inter-arrival times of the MAP depend on the underlying Markov process of the MMBM. One of the subjects of this paper is introducing how to obtain the first passage probabilities of the superposed process using a stochastic doubling algorithm designed for getting the minimal solution of a nonsymmetric algebraic Riccatti equation. The other is to provide eigenvalue and eigenvector results on the superposed process to make it possible to apply the GTH-like algorithm, which improves the accuracy of the doubling algorithm.