• Title/Summary/Keyword: stochastic optimal control

Search Result 130, Processing Time 0.027 seconds

Nanoscale Dynamics, Stochastic Modeling, and Multivariable Control of a Planar Magnetic Levitator

  • Kim, Won-Jong
    • International Journal of Control, Automation, and Systems
    • /
    • v.1 no.1
    • /
    • pp.1-10
    • /
    • 2003
  • This paper presents a high-precision magnetically levitated (maglev) stage to meet demanding motion specifications in the next-generation precision manufacturing and nanotechnology. Characterization of dynamic behaviors of such a motion stage is a crucial task. In this paper, we address the issues related to the stochastic modeling of the stage including transfer function identification, and noise/disturbance analysis and prediction. Provided are test results on precision dynamics, such as fine settling, effect of optical table oscillation, and position ripple. To deal with the dynamic coupling in the platen, we designed and implemented a multivariable linear quadratic regulator, and performed time-optimal control. We demonstrated how the performance of the current maglev stage can be improved with these analyses and experimental results. The maglev stage operates with positioning noise of 5 nm rms in $\chi$ and y, acceleration capabilities in excess of 2g(20 $m/s^2$), and closed-loop crossover frequency of 100 Hz.

OPTIMAL PORTFOLIO STRATEGIES WITH A LIABILITY AND RANDOM RISK: THE CASE OF DIFFERENT LENDING AND BORROWING RATES

  • Yang, Zhao-Jun;Huang, Li-Hong
    • Journal of applied mathematics & informatics
    • /
    • v.15 no.1_2
    • /
    • pp.109-126
    • /
    • 2004
  • This paper deals with two problems of optimal portfolio strategies in continuous time. The first one studies the optimal behavior of a firm who is forced to withdraw funds continuously at a fixed rate per unit time. The second one considers a firm that is faced with an uncontrollable stochastic cash flow, or random risk process. We assume the firm's income can be obtained only from the investment in two assets: a risky asset (e.g., stock) and a riskless asset (e.g., bond). Therefore, the firm's wealth follows a stochastic process. When the wealth is lower than certain legal level, the firm goes bankrupt. Thus how to invest is the fundamental problem of the firm in order to avoid bankruptcy. Under the case of different lending and borrowing rates, we obtain the optimal portfolio strategies for some reasonable objective functions that are the piecewise linear functions of the firm's current wealth and present some interesting proofs for the conclusions. The optimal policies are easy to be operated for any relevant investor.

Solvability of Stochastic Discrete Algebraic Riccati Equation

  • Oh, Kyu-Kwon;Okuyama, Yoshifumi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.33.4-33
    • /
    • 2001
  • This paper considers a stochastic discrete algebraic Riccati equation, which is a generalized version of the well-known standard discrete algebraic Riccati equation, and has additional linear terms. Under controllability, observability and the assumption that the additional terms are not too large, the existence of a positive definite solution is guaranteed. It is shown that it arises in optimal control of a linear discrete-time system with multiplicative White noise and quadratic cost. A numerical example is given.

  • PDF

Joint Batch Production and Inventory Rationing Control in a Two-Station Serial Production System (두 단계 일렬 생산 시스템에서 뱃치 생산과 재고 배급 전략의 통합 구현)

  • Kim, Eun-Gab
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.38 no.2
    • /
    • pp.89-97
    • /
    • 2012
  • This paper considers a manufacturer with a two-station make-to-stock and make-to-order serial production system. The MTS facility produces a single type of component and provides components for the MTO facility that produces customized products. In addition to the internal demand from the MTO facility, the MTS facility faces demands from the spot market with the option of to accept or reject each incoming demand. This paper addresses a joint component inventory rationing and batch production control which maximizes the manufacturer's profit. Using the Markov decision process model, we investigate the structural properties of the optimal inventory rationing and batch production policy, and present two types of heuristics. We implement a numerical experiment to compare the performance of the optimal and heuristic policies and a simulation study to examine the impact of the stochastic process variability on the inventory rationing and batch production control.

Stochastic Optimization Method Using Gradient Based on Control Variates (통제변수 기반 Gradient를 이용한 확률적 최적화 기법)

  • Kwon, Chi-Myung;Kim, Seong-Yeon
    • Journal of the Korea Society for Simulation
    • /
    • v.18 no.2
    • /
    • pp.49-55
    • /
    • 2009
  • In this paper, we investigate an optimal allocation of constant service resources in stochastic system to optimize the expected performance of interest. For this purpose, we use the control variates to estimate the gradients of expected performance with respect to given resource parameters, and apply these estimated gradients in stochastic optimization algorithm to find the optimal allocation of resources. The proposed gradient estimation method is advantageous in that it uses simulation results of a single design point without increasing the number of design points in simulation experiments and does not need to describe the logical relationship among realized performance of interest and perturbations in input parameters. We consider the applications of this research to various models and extension of input parameter space as the future research.

Q Learning MDP Approach to Mitigate Jamming Attack Using Stochastic Game Theory Modelling With WQLA in Cognitive Radio Networks

  • Vimal, S.;Robinson, Y. Harold;Kaliappan, M.;Pasupathi, Subbulakshmi;Suresh, A.
    • Journal of Platform Technology
    • /
    • v.9 no.1
    • /
    • pp.3-14
    • /
    • 2021
  • Cognitive Radio network (CR) is a promising paradigm that helps the unlicensed user (Secondary User) to analyse the spectrum and coordinate the spectrum access to support the creation of common control channel (CCC). The cooperation of secondary users and broadcasting between them is done through transmitting messages in CCC. In case, if the control channels may get jammed and it may directly degrade the network's performance and under such scenario jammers will devastate the control channels. Hopping sequences may be one of the predominant approaches and it may be used to fight against this problem to confront jammer. The jamming attack can be alleviated using one of the game modelling approach and in this proposed scheme stochastic games has been analysed with more single users to provide the flexible control channels against intrusive attacks by mentioning the states of each player, strategies ,actions and players reward. The proposed work uses a modern player action and better strategic view on game theoretic modelling is stochastic game theory has been taken in to consideration and applied to prevent the jamming attack in CR network. The selection of decision is based on Q learning approach to mitigate the jamming nodes using the optimal MDP decision process

ESTIMATION OF NON-INTEGRAL AND INTEGRAL QUADRATIC FUNCTIONS IN LINEAR STOCHASTIC DIFFERENTIAL SYSTEMS

  • Song, IL Young;Shin, Vladimir;Choi, Won
    • Korean Journal of Mathematics
    • /
    • v.25 no.1
    • /
    • pp.45-60
    • /
    • 2017
  • This paper focuses on estimation of an non-integral quadratic function (NIQF) and integral quadratic function (IQF) of a random signal in dynamic system described by a linear stochastic differential equation. The quadratic form of an unobservable signal indicates useful information of a signal for control. The optimal (in mean square sense) and suboptimal estimates of NIQF and IQF represent a function of the Kalman estimate and its error covariance. The proposed estimation algorithms have a closed-form estimation procedure. The obtained estimates are studied in detail, including derivation of the exact formulas and differential equations for mean square errors. The results we demonstrate on practical example of a power of signal, and comparison analysis between optimal and suboptimal estimators is presented.

The study of stochastic inventory model with setup cost and backorder rate (Setup cost와 Backorder rate를 고려한 확률적 재고모형에 관한 연구)

  • 유승우;서창현;김경섭
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2003.06a
    • /
    • pp.129-134
    • /
    • 2003
  • In this paper, we determine optimal reduction in the lead time and setup cost for some stochastic inventory models. And we propose more general model that allow the backorder rate as a control variable. We first assume that the lead time demand follows a normal distribution. And we assume that the backorder rate is dependent on the length of lead time through the amount of shortages. The stochastic models analyzed in this paper are the classical continuous and periodic review policy models with a mixture of backorders and lost sales. For each of these models, we provide a sufficient conditions for the uniqueness of the optimal operating policy. We also develop algorithms for solving these models and provide illustrative numerical examples.

  • PDF

Serviceability-oriented analytical design of isolated liquid damper for the wind-induced vibration control of high-rise buildings

  • Zhipeng Zhao;Xiuyan Hu;Cong Liao;Na Hong;Yuanchen Tang
    • Smart Structures and Systems
    • /
    • v.33 no.1
    • /
    • pp.27-39
    • /
    • 2024
  • The effectiveness of conventional tuned liquid dampers (TLDs) in controlling the wind-induced response of tall flexible structures has been indicated. However, the impaired control effect in the detuning condition or a considerably high mass cost of liquid may be incurred in ensuring the high-level serviceability. To provide an efficient TLD-based solution for wind-induced vibration control, this study proposes a serviceability-oriented optimal design method for isolated TLDs (ILDs) and derives analytical design formulae. The ILD is implemented by mounting the TLD on the linear isolators. Stochastic response analysis is performed for the ILD-equipped structure subjected to stochastic wind and white noise, and the results are considered to derive the closed-form responses. Correspondingly, an extensive parametric analysis is conducted to clarify a serviceability-oriented optimal design framework by incorporating the comfort demand. The obtained results show that the high-level serviceability demand can be satisfied by the ILD based on the proposed optimal design framework. Analytical design formulae can be preliminarily adopted to ensure the target serviceability demand while enhancing the structural displacement performance to increase the safety level. Compared with conventional TLD systems, the ILD exhibits higher effectiveness and a larger frequency bandwidth for wind-induced vibration control at a small mass ratio.

Optimal control of stochastic continuous discrete systems applied to FMS

  • Boukas, E.K.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1989.10a
    • /
    • pp.733-743
    • /
    • 1989
  • This paper deals with the control of system with controlled jump Markov disturbances. A such formulation was used by Boukas to model the planning production and maintenance of a FMS with failure machines. The optimal control problem of systems with controlled jump Markov process is addressed. This problem describes the planning production and preventive maintenance of production systems. The optimality conditions in both cases finite and infinite horizon, are derived. A numerical example is presented to validate the proposed results.

  • PDF