• Title/Summary/Keyword: stochastic optimal control

Search Result 129, Processing Time 0.03 seconds

A semi-active stochastic optimal control strategy for nonlinear structural systems with MR dampers

  • Ying, Z.G.;Ni, Y.Q.;Ko, J.M.
    • Smart Structures and Systems
    • /
    • v.5 no.1
    • /
    • pp.69-79
    • /
    • 2009
  • A non-clipped semi-active stochastic optimal control strategy for nonlinear structural systems with MR dampers is developed based on the stochastic averaging method and stochastic dynamical programming principle. A nonlinear stochastic control structure is first modeled as a semi-actively controlled, stochastically excited and dissipated Hamiltonian system. The control force of an MR damper is separated into passive and semi-active parts. The passive control force components, coupled in structural mode space, are incorporated in the drift coefficients by directly using the stochastic averaging method. Then the stochastic dynamical programming principle is applied to establish a dynamical programming equation, from which the semi-active optimal control law is determined and implementable by MR dampers without clipping in terms of the Bingham model. Under the condition on the control performance function given in section 3, the expressions of nonlinear and linear non-clipped semi-active optimal control force components are obtained as well as the non-clipped semi-active LQG control force, and thus the value function and semi-active nonlinear optimal control force are actually existent according to the developed strategy. An example of the controlled stochastic hysteretic column is given to illustrate the application and effectiveness of the developed semi-active optimal control strategy.

Stochastic optimal control of coupled structures

  • Ying, Z.G.;Ni, Y.Q.;Ko, J.M.
    • Structural Engineering and Mechanics
    • /
    • v.15 no.6
    • /
    • pp.669-683
    • /
    • 2003
  • The stochastic optimal nonlinear control of coupled adjacent building structures is studied based on the stochastic dynamical programming principle and the stochastic averaging method. The coupled structures with control devices under random seismic excitation are first condensed to form a reduced-order structural model for the control analysis. The stochastic averaging method is applied to the reduced model to yield stochastic differential equations for structural modal energies as controlled diffusion processes. Then a dynamical programming equation for the energy processes is established based on the stochastic dynamical programming principle, and solved to determine the optimal nonlinear control law. The seismic response mitigation of the coupled structures is achieved through the structural energy control and the dimension of the optimal control problem is reduced. The seismic excitation spectrum is taken into account according to the stochastic dynamical programming principle. Finally, the nonlinear controlled structural response is predicted by using the stochastic averaging method and compared with the uncontrolled structural response to evaluate the control efficacy. Numerical results are given to demonstrate the response mitigation capabilities of the proposed stochastic optimal control method for coupled adjacent building structures.

Nonlinear stochastic optimal control strategy of hysteretic structures

  • Li, Jie;Peng, Yong-Bo;Chen, Jian-Bing
    • Structural Engineering and Mechanics
    • /
    • v.38 no.1
    • /
    • pp.39-63
    • /
    • 2011
  • Referring to the formulation of physical stochastic optimal control of structures and the scheme of optimal polynomial control, a nonlinear stochastic optimal control strategy is developed for a class of structural systems with hysteretic behaviors in the present paper. This control strategy provides an amenable approach to the classical stochastic optimal control strategies, bypasses the dilemma involved in It$\hat{o}$-type stochastic differential equations and is applicable to the dynamical systems driven by practical non-stationary and non-white random excitations, such as earthquake ground motions, strong winds and sea waves. The newly developed generalized optimal control policy is integrated in the nonlinear stochastic optimal control scheme so as to logically distribute the controllers and design their parameters associated with control gains. For illustrative purposes, the stochastic optimal controls of two base-excited multi-degree-of-freedom structural systems with hysteretic behavior in Clough bilinear model and Bouc-Wen differential model, respectively, are investigated. Numerical results reveal that a linear control with the 1st-order controller suffices even for the hysteretic structural systems when a control criterion in exceedance probability performance function for designing the weighting matrices is employed. This is practically meaningful due to the nonlinear controllers which may be associated with dynamical instabilities being saved. It is also noted that using the generalized optimal control policy, the maximum control effectiveness with the few number of control devices can be achieved, allowing for a desirable structural performance. It is remarked, meanwhile, that the response process and energy-dissipation behavior of the hysteretic structures are controlled to a certain extent.

OPTIMAL CONTROL ON SEMILINEAR RETARDED STOCHASTIC FUNCTIONAL DIFFERENTIAL EQUATIONS DRIVEN BY POISSON JUMPS IN HILBERT SPACE

  • Nagarajan, Durga;Palanisamy, Muthukumar
    • Bulletin of the Korean Mathematical Society
    • /
    • v.55 no.2
    • /
    • pp.479-497
    • /
    • 2018
  • This paper deals with an optimal control on semilinear stochastic functional differential equations with Poisson jumps in a Hilbert space. The existence of an optimal control is derived by the solution of proposed system which satisfies weakly sequentially compactness. Also the stochastic maximum principle for the optimal control is established by using spike variation technique of optimal control with a convex control domain in Hilbert space. Finally, an application of retarded type stochastic Burgers equation is given to illustrate the theory.

Stochastic vibration suppression analysis of an optimal bounded controlled sandwich beam with MR visco-elastomer core

  • Ying, Z.G.;Ni, Y.Q.;Duan, Y.F.
    • Smart Structures and Systems
    • /
    • v.19 no.1
    • /
    • pp.21-31
    • /
    • 2017
  • To control the stochastic vibration of a vibration-sensitive instrument supported on a beam, the beam is designed as a sandwich structure with magneto-rheological visco-elastomer (MRVE) core. The MRVE has dynamic properties such as stiffness and damping adjustable by applied magnetic fields. To achieve better vibration control effectiveness, the optimal bounded parametric control for the MRVE sandwich beam with supported mass under stochastic and deterministic support motion excitations is proposed, and the stochastic and shock vibration suppression capability of the optimally controlled beam with multi-mode coupling is studied. The dynamic behavior of MRVE core is described by the visco-elastic Kelvin-Voigt model with a controllable parameter dependent on applied magnetic fields, and the parameter is considered as an active bounded control. The partial differential equations for horizontal and vertical coupling motions of the sandwich beam are obtained and converted into the multi-mode coupling vibration equations with the bounded nonlinear parametric control according to the Galerkin method. The vibration equations and corresponding performance index construct the optimal bounded parametric control problem. Then the dynamical programming equation for the control problem is derived based on the dynamical programming principle. The optimal bounded parametric control law is obtained by solving the programming equation with the bounded control constraint. The controlled vibration responses of the MRVE sandwich beam under stochastic and shock excitations are obtained by substituting the optimal bounded control into the vibration equations and solving them. The further remarkable vibration suppression capability of the optimal bounded control compared with the passive control and the influence of the control parameters on the stochastic vibration suppression effectiveness are illustrated with numerical results. The proposed optimal bounded parametric control strategy is applicable to smart visco-elastic composite structures under deterministic and stochastic excitations for improving vibration control effectiveness.

Stochastic optimal control analysis of a piezoelectric shell subjected to stochastic boundary perturbations

  • Ying, Z.G.;Feng, J.;Zhu, W.Q.;Ni, Y.Q.
    • Smart Structures and Systems
    • /
    • v.9 no.3
    • /
    • pp.231-251
    • /
    • 2012
  • The stochastic optimal control for a piezoelectric spherically symmetric shell subjected to stochastic boundary perturbations is constructed, analyzed and evaluated. The stochastic optimal control problem on the boundary stress output reduction of the piezoelectric shell subjected to stochastic boundary displacement perturbations is presented. The electric potential integral as a function of displacement is obtained to convert the differential equations for the piezoelectric shell with electrical and mechanical coupling into the equation only for displacement. The displacement transformation is constructed to convert the stochastic boundary conditions into homogeneous ones, and the transformed displacement is expanded in space to convert further the partial differential equation for displacement into ordinary differential equations by using the Galerkin method. Then the stochastic optimal control problem of the piezoelectric shell in partial differential equations is transformed into that of the multi-degree-of-freedom system. The optimal control law for electric potential is determined according to the stochastic dynamical programming principle. The frequency-response function matrix, power spectral density matrix and correlation function matrix of the controlled system response are derived based on the theory of random vibration. The expressions of mean-square stress, displacement and electric potential of the controlled piezoelectric shell are finally obtained to evaluate the control effectiveness. Numerical results are given to illustrate the high relative reduction in the root-mean-square boundary stress of the piezoelectric shell subjected to stochastic boundary displacement perturbations by the optimal electric potential control.

Semi-active bounded optimal control of uncertain nonlinear coupling vehicle system with rotatable inclined supports and MR damper under random road excitation

  • Ying, Z.G.;Yan, G.F.;Ni, Y.Q.
    • Coupled systems mechanics
    • /
    • v.7 no.6
    • /
    • pp.707-729
    • /
    • 2018
  • The semi-active optimal vibration control of nonlinear torsion-bar suspension vehicle systems under random road excitations is an important research subject, and the boundedness of MR dampers and the uncertainty of vehicle systems are necessary to consider. In this paper, the differential equations of motion of the coupling torsion-bar suspension vehicle system with MR damper under random road excitation are derived and then transformed into strongly nonlinear stochastic coupling vibration equations. The dynamical programming equation is derived based on the stochastic dynamical programming principle firstly for the nonlinear stochastic system. The semi-active bounded parametric optimal control law is determined by the programming equation and MR damper dynamics. Then for the uncertain nonlinear stochastic system, the minimax dynamical programming equation is derived based on the minimax stochastic dynamical programming principle. The worst-case disturbances and corresponding semi-active bounded parametric optimal control are obtained from the programming equation under the bounded disturbance constraints and MR damper dynamics. The control strategy for the nonlinear stochastic vibration of the uncertain torsion-bar suspension vehicle system is developed. The good effectiveness of the proposed control is illustrated with numerical results. The control performances for the vehicle system with different bounds of MR damper under different vehicle speeds and random road excitations are discussed.

INDEFINITE STOCHASTIC OPTIMAL LQR CONTROL WITH CROSS TERM UNDER IQ CONSTRAINTS

  • Luo, Cheng-Xin;Feng, En-Min
    • Journal of applied mathematics & informatics
    • /
    • v.15 no.1_2
    • /
    • pp.185-200
    • /
    • 2004
  • A stochastic optimal LQR control problem under some integral quadratic (IQ) constraints is studied, with cross terms in both the cost and the constraint functionals, allowing all the control weighting matrices being indefinite. Sufficient conditions for the well-posedness of this problem are given. When these conditions are satisfied, the optimal control is explicitly derived via dual theory.

Optimal Control of Stochastic Bilinear Systems (확률적 이선형시스템의 최적제)

  • Hwang, Chun-Sik
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.31 no.7
    • /
    • pp.18-24
    • /
    • 1982
  • We derived an optimal control of the Stochastic Bilinear Systems. For that we, firstly, formulated stochastic bilinear system and estimated its state when the system state is not directly observable. Optimal control problem of this system is reviewed on the line of three optimization techniques. An optimal control is derived using Hamilton-Jacobi-Bellman equation via dynamic programming method. It consists of combination of linear and quadratic form in the state. This negative feedback control, also, makes the system stable as far as value function is chosen to be a Lyapunov function. Several other properties of this control are discussed.

  • PDF

Design of Stochastic Observer for The Optimal Control of A Flexible Manipulator (유연성 매니퓨레이터의 최적제어를 위한 STOCHASTIC관측기의 설계)

  • 남호범;박종국
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.38 no.9
    • /
    • pp.753-760
    • /
    • 1989
  • A method is suggested to design a stochastic observer which can be used as a state estimator for the optimal control of a one link flexible manipulator. This stochastic observer is derived from unifying the two concepts of reduced-state deterministic observer theory and optimal Kalman filtering theory. In estimating state variables for the optimal control, instead of using the two different state estimators for the deterministic system with noise free measurements and stochastic system with noise measurements, only one stochastic observer is designed which is to be used in both systems commonly. Through the simulation, it has been shown that the flexible system with the stochastic observer is similar in characteristics to the flexible system assuming that all states can be measured.

  • PDF