• 제어로봇시스템학회:학술대회논문집
• /
• 1998.10a
• /
• pp.440-444
• /
• 1998

In this paper, we consider numerical solution of a H-J-B (Hamilton-Jacobi-Bellman) equation of elliptic type arising from the stochastic control problem. For the numerical solution of the equation, we take an approach involving contraction mapping and finite difference approximation. We choose the It(equation omitted) type stochastic differential equation as the dynamic system concerned. The numerical method of solution is validated computationally by using the constructed test case. Map of optimal controls is obtained through the numerical solution process of the equation. We also show how the method applies by taking a simple example of nonlinear spacecraft control.

• The Transactions of the Korean Institute of Electrical Engineers
• /
• v.34 no.5
• /
• pp.173-178
• /
• 1985

The control of a linear system with random coefficients is discussed here. The cost function is of a quadratic form and the random coefficients are assumed to be completely observable by the controller. Stochastic Process involved in the problem by the controller. Stochastic Process involved in the problem formulation is presented to be the unique strong solution to the corresponding stochastic differential equations. Condition for the optimal control is represented through the existence of solution to a Cauchy problem for the given nonlinear partial differential equation. The optimal control is shown to be a linear function of the states and a nonlinear function of random parameters.

• Journal of applied mathematics & informatics
• /
• v.18 no.1_2
• /
• pp.145-158
• /
• 2005

We formulate a stochastic control problem on proportional reinsurance that includes impulse and regular control strategies. For the first time we combine impulse control with regular control, and derive the expected total discount pay-out (return function) from present to bankruptcy. By relying on both stochastic calculus and the classical theory of impulse and regular controls, we state a set of sufficient conditions for its solution in terms of optimal return function. Moreover, we also derive its explicit form and corresponding impulse and regular control strategies.

• 제어로봇시스템학회:학술대회논문집
• /
• 1995.10a
• /
• pp.432-435
• /
• 1995

In this paper a new approach to obtain the solution of the linear-quadratic Gaussian control problem for singularly perturbed discrete-time stochastic systems is proposed. The alogorithm proposed is based on exploring the previous results that the exact solution of the global discrete algebraic Riccati equations is found in terms of the reduced-order pure-slow and pure-fast nonsymmetric continuous-time algebraic Riccati equations and, in addition, the optimal global Kalman filter is decomposed into pure-slow and pure-fast local optimal filters both driven by the system measurements and the system optimal control input. It is shown that the optimal linear-quadratic Gaussian control problem for singularly perturbed linear discrete systems takes the complete decomposition and parallelism between pure-slow and pure-fast filters and controllers.

• Journal of applied mathematics & informatics
• /
• v.13 no.1_2
• /
• pp.85-97
• /
• 2003

An indefinite stochastic linear-quadratic(LQ) optimal control problem with cross term over an infinite time horizon is studied, allowing the weighting matrices to be indefinite. A systematic approach to the problem based on semidefinite programming (SDP) and .elated duality analysis is developed. Several implication relations among the SDP complementary duality, the existence of the solution to the generalized Riccati equation and the optimality of LQ problem are discussed. Based on these relations, a numerical procedure that provides a thorough treatment of the LQ problem via primal-dual SDP is given: it identifies a stabilizing optimal feedback control or determines the problem has no optimal solution. An example is provided to illustrate the results obtained.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.19 no.4
• /
• pp.387-407
• /
• 2015

This paper analyzes the $h{\times}p$ version of the finite element method for optimal control problems constrained by elliptic partial differential equations with random inputs. The main result is that the $h{\times}p$ error bound for the control problems subject to stochastic partial differential equations leads to an exponential rate of convergence with respect to p as for the corresponding direct problems. Numerical examples are used to confirm the theoretical results.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.4
• /
• pp.319-326
• /
• 2015

Recently in the fields o f stochastic optimal control ( SOC) and reinforcemnet l earning (RL), there have been a great deal of research efforts for the problem of finding data-based sub-optimal control policies. The conventional theory for finding optimal controllers via the value-function-based dynamic programming was established for solving the stochastic optimal control problems with solid theoretical background. However, they can be successfully applied only to extremely simple cases. Hence, the data-based modern approach, which tries to find sub-optimal solutions utilizing relevant data such as the state-transition and reward signals instead of rigorous mathematical analyses, is particularly attractive to practical applications. In this paper, we consider a couple of methods combining the modern SOC strategies and approximate inference together with machine-learning-based data treatment methods. Also, we apply the resultant methods to a variety of application domains including financial engineering, and observe their performance.

• Journal of Electrical Engineering and Technology
• /
• v.9 no.1
• /
• pp.80-89
• /
• 2014

A stochastic optimal power flow (S-OPF) model considering uncertainties of load and wind power is developed based on chance constrained programming (CCP). The difficulties in solving the model are the nonlinearity and probabilistic constraints. In this paper, a limit relaxation approach and an iterative learning control (ILC) method are implemented to solve the S-OPF model indirectly. The limit relaxation approach narrows the solution space by introducing regulatory factors, according to the relationship between the constraint equations and the optimization variables. The regulatory factors are designed by ILC method to ensure the optimality of final solution under a predefined confidence level. The optimization algorithm for S-OPF is completed based on the combination of limit relaxation and ILC and tested on the IEEE 14-bus system.

• 전기의세계
• /
• v.30 no.11
• /
• pp.728-733
• /
• 1981

Most of real world systems are highly non-linear. But due to difficulties in analyzing and dealing with it, only the linear system theory is well estabilished. Bilinear system where state and control are linear but not linear jointly is introduced. Here shows that optimal state estimation of stochastic bilinear system requirs infinite dimensional filter, thus onesub-optimal estimator for this system is suggested.

• Journal of applied mathematics & informatics
• /
• v.18 no.1_2
• /
• pp.73-93
• /
• 2005

In this paper, we attempt to present a new numerical approach to solve non-linear backward stochastic differential equations. First, we present some definitions and theorems to obtain the conditions, from which we can approximate the non-linear term of the backward stochastic differential equation (BSDE) and we get a continuous piecewise linear BSDE correspond with the original BSDE. We use the relationship between backward stochastic differential equations and stochastic controls by interpreting BSDEs as some stochastic optimal control problems, to solve the approximated BSDE and we prove that the approximated solution converges to the exact solution of the original non-linear BSDE in two different cases.