• 제어로봇시스템학회:학술대회논문집
• /
• 1994.10a
• /
• pp.156-161
• /
• 1994

In this paper, we consider an optimal control problem of a nonlinear stochastic system. Dynamic programming approach is employed for the formulation of a stochastic optimal control problem. As an optimality condition, dynamic programming equation so called the Bellman equation is obtained, which seldom yields an analytical solution, even very difficult to solve numerically. We obtain the numerical solution of the Bellman equation using an algorithm based on the finite difference approximation and the contraction mapping method. Optimal controls are constructed through the solution process of the Bellman equation. We also construct a test case in order to investigate the actual performance of the algorithm.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2001.05a
• /
• pp.892-896
• /
• 2001

Investigation is performed on the stability of nonlinear system under turbulent fluid motion modelled as white noise random process, which is a preliminary result in the course of research on the characteristic and nonlinear control of the stochastic system. Adopted physical model is beam-type structure with tip-mass and main base mass. The governing equation is derived via F-P-K approach in stochastic sense. By means of Gaussian Closure method infinite dynamic moment equations due to system nonlinearity is closed to finite one. At the best of authors' knowledge, it is the first trial to design nonlinear controller by using of sliding mode technique in stochastic domain and control performance and effect in stochastic domain is studied.

• The Transactions of the Korean Institute of Electrical Engineers
• /
• v.34 no.5
• /
• pp.173-178
• /
• 1985

The control of a linear system with random coefficients is discussed here. The cost function is of a quadratic form and the random coefficients are assumed to be completely observable by the controller. Stochastic Process involved in the problem by the controller. Stochastic Process involved in the problem formulation is presented to be the unique strong solution to the corresponding stochastic differential equations. Condition for the optimal control is represented through the existence of solution to a Cauchy problem for the given nonlinear partial differential equation. The optimal control is shown to be a linear function of the states and a nonlinear function of random parameters.

• Bulletin of the Korean Mathematical Society
• /
• v.55 no.2
• /
• pp.479-497
• /
• 2018

This paper deals with an optimal control on semilinear stochastic functional differential equations with Poisson jumps in a Hilbert space. The existence of an optimal control is derived by the solution of proposed system which satisfies weakly sequentially compactness. Also the stochastic maximum principle for the optimal control is established by using spike variation technique of optimal control with a convex control domain in Hilbert space. Finally, an application of retarded type stochastic Burgers equation is given to illustrate the theory.

• 제어로봇시스템학회:학술대회논문집
• /
• 1998.10a
• /
• pp.440-444
• /
• 1998

In this paper, we consider numerical solution of a H-J-B (Hamilton-Jacobi-Bellman) equation of elliptic type arising from the stochastic control problem. For the numerical solution of the equation, we take an approach involving contraction mapping and finite difference approximation. We choose the It(equation omitted) type stochastic differential equation as the dynamic system concerned. The numerical method of solution is validated computationally by using the constructed test case. Map of optimal controls is obtained through the numerical solution process of the equation. We also show how the method applies by taking a simple example of nonlinear spacecraft control.

• Structural Engineering and Mechanics
• /
• v.32 no.1
• /
• pp.21-36
• /
• 2009

An importance sampling method is presented for computing the first passage probability of elasto-plastic structures under stochastic excitations. The importance sampling distribution corresponds to shifting the mean of the excitation to an 'adapted' stochastic process whose future is determined based on information only up to the present. A stochastic control approach is adopted for designing the adapted process. The optimal control law is determined by a control potential, which satisfies the Bellman's equation, a nonlinear partial differential equation on the response state-space. Numerical results for a single-degree-of freedom elasto-plastic structure shows that the proposed method leads to significant improvement in variance reduction over importance sampling using design points reported recently.

• Journal of applied mathematics & informatics
• /
• v.18 no.1_2
• /
• pp.73-93
• /
• 2005

In this paper, we attempt to present a new numerical approach to solve non-linear backward stochastic differential equations. First, we present some definitions and theorems to obtain the conditions, from which we can approximate the non-linear term of the backward stochastic differential equation (BSDE) and we get a continuous piecewise linear BSDE correspond with the original BSDE. We use the relationship between backward stochastic differential equations and stochastic controls by interpreting BSDEs as some stochastic optimal control problems, to solve the approximated BSDE and we prove that the approximated solution converges to the exact solution of the original non-linear BSDE in two different cases.

• Smart Structures and Systems
• /
• v.19 no.1
• /
• pp.21-31
• /
• 2017

To control the stochastic vibration of a vibration-sensitive instrument supported on a beam, the beam is designed as a sandwich structure with magneto-rheological visco-elastomer (MRVE) core. The MRVE has dynamic properties such as stiffness and damping adjustable by applied magnetic fields. To achieve better vibration control effectiveness, the optimal bounded parametric control for the MRVE sandwich beam with supported mass under stochastic and deterministic support motion excitations is proposed, and the stochastic and shock vibration suppression capability of the optimally controlled beam with multi-mode coupling is studied. The dynamic behavior of MRVE core is described by the visco-elastic Kelvin-Voigt model with a controllable parameter dependent on applied magnetic fields, and the parameter is considered as an active bounded control. The partial differential equations for horizontal and vertical coupling motions of the sandwich beam are obtained and converted into the multi-mode coupling vibration equations with the bounded nonlinear parametric control according to the Galerkin method. The vibration equations and corresponding performance index construct the optimal bounded parametric control problem. Then the dynamical programming equation for the control problem is derived based on the dynamical programming principle. The optimal bounded parametric control law is obtained by solving the programming equation with the bounded control constraint. The controlled vibration responses of the MRVE sandwich beam under stochastic and shock excitations are obtained by substituting the optimal bounded control into the vibration equations and solving them. The further remarkable vibration suppression capability of the optimal bounded control compared with the passive control and the influence of the control parameters on the stochastic vibration suppression effectiveness are illustrated with numerical results. The proposed optimal bounded parametric control strategy is applicable to smart visco-elastic composite structures under deterministic and stochastic excitations for improving vibration control effectiveness.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.3
• /
• pp.277-288
• /
• 2014

This article reviews various state estimation methods for nonlinear systems, particularly with a perspective of a process control engineer. Nonlinear state estimation methods can be classified into the following two categories: stochastic approaches and deterministic approaches. The current review compares the Bayesian approach, which is mainly a stochastic approach, and the MHE (Moving Horizon Estimation) approach, which is mainly a deterministic approach. Though both methods are reviewed, emphasis is given to the latter as it is particularly well-suited to highly nonlinear systems with slow sampling rates, which are common in chemical process applications. Recent developments in underlying theories and supporting numerical algorithms for MHE are reviewed. Thanks to these developments, applications to large-scale and complex chemical processes are beginning to show up but they are still limited at this point owing to the high numerical complexity of the method.

• Journal of the Chungcheong Mathematical Society
• /
• v.34 no.4
• /
• pp.355-368
• /
• 2021

In this paper, we investigate necessary and sufficient conditions for the approximate controllability for semilinear stochastic functional differential equations with delays in Hilbert spaces without the strict range condition on the controller even though the equations contain unbounded principal operators, delay terms and local Lipschitz continuity of the nonlinear term.