• Title/Summary/Keyword: Stochastic programming

Search Result 155, Processing Time 0.023 seconds

STABILITY OF EQUIVALENT PROGRAMMING PROBLEMS OF THE MULTIPLE OBJECTIVE LINEAR STOCHASTIC PROGRAMMING PROBLEMS

  • Cho, Gyeong-Mi
    • Journal of the Korean Mathematical Society
    • /
    • v.35 no.2
    • /
    • pp.259-268
    • /
    • 1998
  • In this paper the stochastic multiple objective programming problems where the right-hand-side of the constraints is stochastic are considered. We define the equivalent scalar-valued problem and study the stability of the equivalent scalar-valued problem with respect to the weight parameters and probability mesures under reasonable assumptions.

  • PDF

Semi-active bounded optimal control of uncertain nonlinear coupling vehicle system with rotatable inclined supports and MR damper under random road excitation

  • Ying, Z.G.;Yan, G.F.;Ni, Y.Q.
    • Coupled systems mechanics
    • /
    • v.7 no.6
    • /
    • pp.707-729
    • /
    • 2018
  • The semi-active optimal vibration control of nonlinear torsion-bar suspension vehicle systems under random road excitations is an important research subject, and the boundedness of MR dampers and the uncertainty of vehicle systems are necessary to consider. In this paper, the differential equations of motion of the coupling torsion-bar suspension vehicle system with MR damper under random road excitation are derived and then transformed into strongly nonlinear stochastic coupling vibration equations. The dynamical programming equation is derived based on the stochastic dynamical programming principle firstly for the nonlinear stochastic system. The semi-active bounded parametric optimal control law is determined by the programming equation and MR damper dynamics. Then for the uncertain nonlinear stochastic system, the minimax dynamical programming equation is derived based on the minimax stochastic dynamical programming principle. The worst-case disturbances and corresponding semi-active bounded parametric optimal control are obtained from the programming equation under the bounded disturbance constraints and MR damper dynamics. The control strategy for the nonlinear stochastic vibration of the uncertain torsion-bar suspension vehicle system is developed. The good effectiveness of the proposed control is illustrated with numerical results. The control performances for the vehicle system with different bounds of MR damper under different vehicle speeds and random road excitations are discussed.

Stochastic optimal control of coupled structures

  • Ying, Z.G.;Ni, Y.Q.;Ko, J.M.
    • Structural Engineering and Mechanics
    • /
    • v.15 no.6
    • /
    • pp.669-683
    • /
    • 2003
  • The stochastic optimal nonlinear control of coupled adjacent building structures is studied based on the stochastic dynamical programming principle and the stochastic averaging method. The coupled structures with control devices under random seismic excitation are first condensed to form a reduced-order structural model for the control analysis. The stochastic averaging method is applied to the reduced model to yield stochastic differential equations for structural modal energies as controlled diffusion processes. Then a dynamical programming equation for the energy processes is established based on the stochastic dynamical programming principle, and solved to determine the optimal nonlinear control law. The seismic response mitigation of the coupled structures is achieved through the structural energy control and the dimension of the optimal control problem is reduced. The seismic excitation spectrum is taken into account according to the stochastic dynamical programming principle. Finally, the nonlinear controlled structural response is predicted by using the stochastic averaging method and compared with the uncontrolled structural response to evaluate the control efficacy. Numerical results are given to demonstrate the response mitigation capabilities of the proposed stochastic optimal control method for coupled adjacent building structures.

A semi-active stochastic optimal control strategy for nonlinear structural systems with MR dampers

  • Ying, Z.G.;Ni, Y.Q.;Ko, J.M.
    • Smart Structures and Systems
    • /
    • v.5 no.1
    • /
    • pp.69-79
    • /
    • 2009
  • A non-clipped semi-active stochastic optimal control strategy for nonlinear structural systems with MR dampers is developed based on the stochastic averaging method and stochastic dynamical programming principle. A nonlinear stochastic control structure is first modeled as a semi-actively controlled, stochastically excited and dissipated Hamiltonian system. The control force of an MR damper is separated into passive and semi-active parts. The passive control force components, coupled in structural mode space, are incorporated in the drift coefficients by directly using the stochastic averaging method. Then the stochastic dynamical programming principle is applied to establish a dynamical programming equation, from which the semi-active optimal control law is determined and implementable by MR dampers without clipping in terms of the Bingham model. Under the condition on the control performance function given in section 3, the expressions of nonlinear and linear non-clipped semi-active optimal control force components are obtained as well as the non-clipped semi-active LQG control force, and thus the value function and semi-active nonlinear optimal control force are actually existent according to the developed strategy. An example of the controlled stochastic hysteretic column is given to illustrate the application and effectiveness of the developed semi-active optimal control strategy.

L-SHAPED ALGORITHM FOR TWO STAGE PROBLEMS OF STOCHASTIC CONVEX PROGRAMMING

  • Tang, Hengyong;Zhao, Yufang
    • Journal of applied mathematics & informatics
    • /
    • v.13 no.1_2
    • /
    • pp.261-275
    • /
    • 2003
  • In this paper we study two stage problems of stochastic convex programming. Solving the problems is very hard. A L-shaped method for it is given. The implement of the algorithm is simple, so less computation work is needed. The result of computation shows that the algorithm is effective.

Stochastic Programming for the Optimization of Transportation-Inventory Strategy

  • Deyi, Mou;Xiaoqian, Zhang
    • Industrial Engineering and Management Systems
    • /
    • v.16 no.1
    • /
    • pp.44-51
    • /
    • 2017
  • In today's competitive environment, supply chain management is a major concern for a company. Two of the key issues in supply chain management are transportation and inventory management. To achieve significant savings, companies should integrate these two issues instead of treating them separately. In this paper we develop a framework for modeling stochastic programming in a supply chain that is subject to demand uncertainty. With reasonable assumptions, two stochastic programming models are presented, respectively, including a single-period and a multi-period situations. Our assumptions allow us to capture the stochastic nature of the problem and translate it into a deterministic model. And then, based on the genetic algorithm and stochastic simulation, a solution method is developed to solve the model. Finally, the computational results are provided to demonstrate the effectiveness of our model and algorithm.

Basin-Wide Multi-Reservoir Operation Using Reinforcement Learning (강화학습법을 이용한 유역통합 저수지군 운영)

  • Lee, Jin-Hee;Shim, Myung-Pil
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2006.05a
    • /
    • pp.354-359
    • /
    • 2006
  • The analysis of large-scale water resources systems is often complicated by the presence of multiple reservoirs and diversions, the uncertainty of unregulated inflows and demands, and conflicting objectives. Reinforcement learning is presented herein as a new approach to solving the challenging problem of stochastic optimization of multi-reservoir systems. The Q-Learning method, one of the reinforcement learning algorithms, is used for generating integrated monthly operation rules for the Keum River basin in Korea. The Q-Learning model is evaluated by comparing with implicit stochastic dynamic programming and sampling stochastic dynamic programming approaches. Evaluation of the stochastic basin-wide operational models considered several options relating to the choice of hydrologic state and discount factors as well as various stochastic dynamic programming models. The performance of Q-Learning model outperforms the other models in handling of uncertainty of inflows.

  • PDF

Control of an stochastic nonlinear system by the method of dynamic programming

  • Choi, Wan-Sik
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1994.10a
    • /
    • pp.156-161
    • /
    • 1994
  • In this paper, we consider an optimal control problem of a nonlinear stochastic system. Dynamic programming approach is employed for the formulation of a stochastic optimal control problem. As an optimality condition, dynamic programming equation so called the Bellman equation is obtained, which seldom yields an analytical solution, even very difficult to solve numerically. We obtain the numerical solution of the Bellman equation using an algorithm based on the finite difference approximation and the contraction mapping method. Optimal controls are constructed through the solution process of the Bellman equation. We also construct a test case in order to investigate the actual performance of the algorithm.

  • PDF

Stochastic Weapon Target Assignment Problem under Uncertainty in Targeting Accuracy (명중률의 불확실성을 고려한 추계학적 무장-표적 할당 문제)

  • Lee, Jinho;Shin, Myoungin
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.41 no.3
    • /
    • pp.23-36
    • /
    • 2016
  • We consider a model that minimizes the total cost incurred by assigning available weapons to existing targets in order to reduce enemy threats, which is called the weapon target assignment problem (WTAP). This study addresses the stochastic versions of WTAP, in which data, such as the probability of destroying a target, are given randomly (i.e., data are identified with certain probability distributions). For each type of random data or parameter, we provide a stochastic optimization model on the basis of the expected value or scenario enumeration. In particular, when the probabilities of destroying targets depending on weapons are stochastic, we present a stochastic programming formulation with a simple recourse. We show that the stochastic model can be transformed into a deterministic equivalent mixed integer programming model under a certain discrete probability distribution of randomness. We solve the stochastic model to obtain an optimal solution via the mixed integer programming model and compare this solution with that of the deterministic model.

A Two-stage Stochastic Programming Model for Optimal Reactive Power Dispatch with High Penetration Level of Wind Generation

  • Cui, Wei;Yan, Wei;Lee, Wei-Jen;Zhao, Xia;Ren, Zhouyang;Wang, Cong
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.1
    • /
    • pp.53-63
    • /
    • 2017
  • The increasing of wind power penetration level presents challenges in classical optimal reactive power dispatch (ORPD) which is usually formulated as a deterministic optimization problem. This paper proposes a two-stage stochastic programming model for ORPD by considering the uncertainties of wind speed and load in a specified time interval. To avoid the excessive operation, the schedule of compensators will be determined in the first-stage while accounting for the costs of adjusting the compensators (CACs). Under uncertainty effects, on-load tap changer (OLTC) and generator in the second-stage will compensate the mismatch caused by the first-stage decision. The objective of the proposed model is to minimize the sum of CACs and the expected energy loss. The stochastic behavior is formulated by three-point estimate method (TPEM) to convert the stochastic programming into equivalent deterministic problem. A hybrid Genetic Algorithm-Interior Point Method is utilized to solve this large-scale mixed-integer nonlinear stochastic problem. Two case studies on IEEE 14-bus and IEEE 118-bus system are provided to illustrate the effectiveness of the proposed method.