• Journal of the Korean Mathematical Society
• /
• v.35 no.2
• /
• pp.259-268
• /
• 1998

In this paper the stochastic multiple objective programming problems where the right-hand-side of the constraints is stochastic are considered. We define the equivalent scalar-valued problem and study the stability of the equivalent scalar-valued problem with respect to the weight parameters and probability mesures under reasonable assumptions.

• Coupled systems mechanics
• /
• v.7 no.6
• /
• pp.707-729
• /
• 2018

The semi-active optimal vibration control of nonlinear torsion-bar suspension vehicle systems under random road excitations is an important research subject, and the boundedness of MR dampers and the uncertainty of vehicle systems are necessary to consider. In this paper, the differential equations of motion of the coupling torsion-bar suspension vehicle system with MR damper under random road excitation are derived and then transformed into strongly nonlinear stochastic coupling vibration equations. The dynamical programming equation is derived based on the stochastic dynamical programming principle firstly for the nonlinear stochastic system. The semi-active bounded parametric optimal control law is determined by the programming equation and MR damper dynamics. Then for the uncertain nonlinear stochastic system, the minimax dynamical programming equation is derived based on the minimax stochastic dynamical programming principle. The worst-case disturbances and corresponding semi-active bounded parametric optimal control are obtained from the programming equation under the bounded disturbance constraints and MR damper dynamics. The control strategy for the nonlinear stochastic vibration of the uncertain torsion-bar suspension vehicle system is developed. The good effectiveness of the proposed control is illustrated with numerical results. The control performances for the vehicle system with different bounds of MR damper under different vehicle speeds and random road excitations are discussed.

• Structural Engineering and Mechanics
• /
• v.15 no.6
• /
• pp.669-683
• /
• 2003

The stochastic optimal nonlinear control of coupled adjacent building structures is studied based on the stochastic dynamical programming principle and the stochastic averaging method. The coupled structures with control devices under random seismic excitation are first condensed to form a reduced-order structural model for the control analysis. The stochastic averaging method is applied to the reduced model to yield stochastic differential equations for structural modal energies as controlled diffusion processes. Then a dynamical programming equation for the energy processes is established based on the stochastic dynamical programming principle, and solved to determine the optimal nonlinear control law. The seismic response mitigation of the coupled structures is achieved through the structural energy control and the dimension of the optimal control problem is reduced. The seismic excitation spectrum is taken into account according to the stochastic dynamical programming principle. Finally, the nonlinear controlled structural response is predicted by using the stochastic averaging method and compared with the uncontrolled structural response to evaluate the control efficacy. Numerical results are given to demonstrate the response mitigation capabilities of the proposed stochastic optimal control method for coupled adjacent building structures.

• Smart Structures and Systems
• /
• v.5 no.1
• /
• pp.69-79
• /
• 2009

A non-clipped semi-active stochastic optimal control strategy for nonlinear structural systems with MR dampers is developed based on the stochastic averaging method and stochastic dynamical programming principle. A nonlinear stochastic control structure is first modeled as a semi-actively controlled, stochastically excited and dissipated Hamiltonian system. The control force of an MR damper is separated into passive and semi-active parts. The passive control force components, coupled in structural mode space, are incorporated in the drift coefficients by directly using the stochastic averaging method. Then the stochastic dynamical programming principle is applied to establish a dynamical programming equation, from which the semi-active optimal control law is determined and implementable by MR dampers without clipping in terms of the Bingham model. Under the condition on the control performance function given in section 3, the expressions of nonlinear and linear non-clipped semi-active optimal control force components are obtained as well as the non-clipped semi-active LQG control force, and thus the value function and semi-active nonlinear optimal control force are actually existent according to the developed strategy. An example of the controlled stochastic hysteretic column is given to illustrate the application and effectiveness of the developed semi-active optimal control strategy.

• Journal of applied mathematics & informatics
• /
• v.13 no.1_2
• /
• pp.261-275
• /
• 2003

In this paper we study two stage problems of stochastic convex programming. Solving the problems is very hard. A L-shaped method for it is given. The implement of the algorithm is simple, so less computation work is needed. The result of computation shows that the algorithm is effective.

• Industrial Engineering and Management Systems
• /
• v.16 no.1
• /
• pp.44-51
• /
• 2017

In today's competitive environment, supply chain management is a major concern for a company. Two of the key issues in supply chain management are transportation and inventory management. To achieve significant savings, companies should integrate these two issues instead of treating them separately. In this paper we develop a framework for modeling stochastic programming in a supply chain that is subject to demand uncertainty. With reasonable assumptions, two stochastic programming models are presented, respectively, including a single-period and a multi-period situations. Our assumptions allow us to capture the stochastic nature of the problem and translate it into a deterministic model. And then, based on the genetic algorithm and stochastic simulation, a solution method is developed to solve the model. Finally, the computational results are provided to demonstrate the effectiveness of our model and algorithm.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2006.05a
• /
• pp.354-359
• /
• 2006

The analysis of large-scale water resources systems is often complicated by the presence of multiple reservoirs and diversions, the uncertainty of unregulated inflows and demands, and conflicting objectives. Reinforcement learning is presented herein as a new approach to solving the challenging problem of stochastic optimization of multi-reservoir systems. The Q-Learning method, one of the reinforcement learning algorithms, is used for generating integrated monthly operation rules for the Keum River basin in Korea. The Q-Learning model is evaluated by comparing with implicit stochastic dynamic programming and sampling stochastic dynamic programming approaches. Evaluation of the stochastic basin-wide operational models considered several options relating to the choice of hydrologic state and discount factors as well as various stochastic dynamic programming models. The performance of Q-Learning model outperforms the other models in handling of uncertainty of inflows.

• 제어로봇시스템학회:학술대회논문집
• /
• 1994.10a
• /
• pp.156-161
• /
• 1994

In this paper, we consider an optimal control problem of a nonlinear stochastic system. Dynamic programming approach is employed for the formulation of a stochastic optimal control problem. As an optimality condition, dynamic programming equation so called the Bellman equation is obtained, which seldom yields an analytical solution, even very difficult to solve numerically. We obtain the numerical solution of the Bellman equation using an algorithm based on the finite difference approximation and the contraction mapping method. Optimal controls are constructed through the solution process of the Bellman equation. We also construct a test case in order to investigate the actual performance of the algorithm.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.41 no.3
• /
• pp.23-36
• /
• 2016

We consider a model that minimizes the total cost incurred by assigning available weapons to existing targets in order to reduce enemy threats, which is called the weapon target assignment problem (WTAP). This study addresses the stochastic versions of WTAP, in which data, such as the probability of destroying a target, are given randomly (i.e., data are identified with certain probability distributions). For each type of random data or parameter, we provide a stochastic optimization model on the basis of the expected value or scenario enumeration. In particular, when the probabilities of destroying targets depending on weapons are stochastic, we present a stochastic programming formulation with a simple recourse. We show that the stochastic model can be transformed into a deterministic equivalent mixed integer programming model under a certain discrete probability distribution of randomness. We solve the stochastic model to obtain an optimal solution via the mixed integer programming model and compare this solution with that of the deterministic model.

• Journal of Electrical Engineering and Technology
• /
• v.12 no.1
• /
• pp.53-63
• /
• 2017

The increasing of wind power penetration level presents challenges in classical optimal reactive power dispatch (ORPD) which is usually formulated as a deterministic optimization problem. This paper proposes a two-stage stochastic programming model for ORPD by considering the uncertainties of wind speed and load in a specified time interval. To avoid the excessive operation, the schedule of compensators will be determined in the first-stage while accounting for the costs of adjusting the compensators (CACs). Under uncertainty effects, on-load tap changer (OLTC) and generator in the second-stage will compensate the mismatch caused by the first-stage decision. The objective of the proposed model is to minimize the sum of CACs and the expected energy loss. The stochastic behavior is formulated by three-point estimate method (TPEM) to convert the stochastic programming into equivalent deterministic problem. A hybrid Genetic Algorithm-Interior Point Method is utilized to solve this large-scale mixed-integer nonlinear stochastic problem. Two case studies on IEEE 14-bus and IEEE 118-bus system are provided to illustrate the effectiveness of the proposed method.