• 제목/요약/키워드: Stochastic Optimal Control

검색결과 130건 처리시간 0.024초

Performance analyses of RHLQG/FIRF controller

  • Yoo, Kyung-Sang;Kwon, Oh-Kyu
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1993년도 한국자동제어학술회의논문집(국제학술편); Seoul National University, Seoul; 20-22 Oct. 1993
    • /
    • pp.88-94
    • /
    • 1993
  • In this paper we analyze the RHLQG/FIRF optimal.contol law presented in [4,5] in order to stabilizes a stochastic linear time varying systems with modeling uncertainty. It is shown by the frequency domain analysis that the RHC is robuster than the LQ control law. Explicit LTR procedures are given to improve the robust performance of RHLQC/FIRF cotrol law. Using the mismatching function technique [8], we propose an LTR method which makes the RHLQG/FIRF controller recover the feedback properties of the R.HC law. Also we compare the LTR performance of the RHLQC/FIRF via simulation with conventional LTR methods.

  • PDF

라이노 로보트 매니퓰레이터의 동특성 미 실시간 최적추적제어에 관한 연구 (A Study on Dynamics Analysis and Real Time Optimal Tracking Control& Rhino Robotic Manipulator)

  • 한성현;이만형
    • 한국정밀공학회지
    • /
    • 제6권1호
    • /
    • pp.52-74
    • /
    • 1989
  • In general, the state of system can be effected by external noise and observed only through a noisy channel. Therefore we use the estimation technigue for the information of state of the system effected by noise. There are many filters such as kalman-Buchy filter, kalman filter, Extended Kalman filter algorithm, cononlinear, extended Kalman filter algorithm to the estimation of parameters is very useful and has a long history. Also a considerable number of applications of this method has been reported. In this paper, the robot control system is treated in stochastic optimal control because of the robots doing a complicated and accurate task in inapproate environment. We have conclusion that error covariance is converged and the stability of filtering is obtained.

  • PDF

시간논리구조에서 이산사건시스템의 최적화 및 추론 (Optimization and reasoning for Discrete Event System in a Temporal Logic Frameworks)

  • 황형수;정용만
    • 한국지능시스템학회논문지
    • /
    • 제7권2호
    • /
    • pp.25-33
    • /
    • 1997
  • A DEDS is a system whose states change in response to the occurence of events from a predefined event set. In this paper, we consider the optimal control and reasoning problem for Discrete Event Systems(DES) in the Temporal Logic Framework(TEL) which have been recnetly defined. The TLE is enhanced with objective functions(event cost indices) and a measurement space is alos deined. A sequence of event which drive the system form a give initial state to a given final state is generated by minimizing a cost functioin index. Our research goal is the reasoning of optimal trajectory and the design of the optimal controller for DESs. This procedure could be guided by the heuristic search methods. For the heuristic search, we suggested the Stochastic Ruler algorithm, instead of the A algorithm with difficulties as following ; the uniqueness of solutions, the computational complexity and how to select a heuristic function. This SR algorithm is used for solving the optimal problem. An example is shown to illustrate our results.

  • PDF

이산형 칼만 필터를 이용한 서보 시스템의 상태 추정자 설계 (A State Estimator for servo system using discrete Kalman Filter)

  • 신두진;염형선;허욱열;이제희
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1998년도 추계학술대회 논문집 학회본부 B
    • /
    • pp.420-422
    • /
    • 1998
  • In this paper, we propose a position-speed control of servo system with a state estimator. And also we utilized two mass modelling in order to deals with real system accurately. The overall control system consists of two parts: the position-speed controller and state estimator. The Kalman filter applied as state - feedback controller is an optimal state estimator applied to a dynamic system that involves random perturbations and gives a linear,unbiased and minimun error variance recursive algorithm to estimate the unknown state optimally. Therefore we consider the error problem about the servo system modelling, the measurement noise at low-speed ranges a stochastic system, and implement a optimal state observer. Performance of the proposed state estimator are demonstrated by computer simulations.

  • PDF

The mathematical backups in the option pricing theory

  • 김주홍
    • 한국전산응용수학회:학술대회논문집
    • /
    • 한국전산응용수학회 2003년도 KSCAM 학술발표회 프로그램 및 초록집
    • /
    • pp.10-10
    • /
    • 2003
  • Option pricing theory developed by Black and Sholes depends on an arbitrage opportunity argument. An investor can exactly replicate the returns to any option on that stock by continuously adjusting a portfolio consisting of a stock and a riskless bond. The value of the option equal the value of the replicating portfolio. However, transactions costs invalidate the Black-Sholes arbitrage argument for option pricing, since continuous revision implies infinite trading, Discrete revision using Black-Sholes deltas generates errors which are correlated with the market, and do not approach zero with more frequent revision when transactions costs are included. Stochastic calculus serves as a fundamental tool in the mathematical finance. We closely look at the utility maximization theory which is one of the main option valuation methods. We also see that how the stochastic optimal control problems and their solution methods are applied to the theory.

  • PDF

Step-Size Control for Width Adaptation in Radial Basis Function Networks for Nonlinear Channel Equalization

  • Kim, Nam-Yong
    • Journal of Communications and Networks
    • /
    • 제12권6호
    • /
    • pp.600-604
    • /
    • 2010
  • A method of width adaptation in the radial basis function network (RBFN) using stochastic gradient (SG) algorithm is introduced. Using Taylor's expansion of error signal and differentiating the error with respect to the step-size, the optimal time-varying step-size of the width in RBFN is derived. The proposed approach to adjusting widths in RBFN achieves superior learning speed and the steady-state mean square error (MSE) performance in nonlinear channel environment. The proposed method has shown enhanced steady-state MSE performance by more than 3 dB in both nonlinear channel environments. The results confirm that controlling over step-size of the width in RBFN by the proposed algorithm can be an effective approach to enhancement of convergence speed and the steady-state value of MSE.

추계적 페트리 네트를 이용한 대기시스템의 제어모형 (Control Models for Queueing Systems Using Stochastic Petri Nets)

  • 이광식;이효성
    • 산업공학
    • /
    • 제8권2호
    • /
    • pp.161-169
    • /
    • 1995
  • In this paper, a threshold policy is considered for the Markovian queueing system with server vacations. The threshold policy considered in this paper has the following form: "when the number of customers present in the system increases to N, the server is turned on and serves customers until the system becomes empty". In this paper, we show how the finite capacity or finite population queueing system under a threshold policy can be modeled by the stochastic Petri net. The performance evaluation of the model is carried out using the software called "SPNP". Some examples are also presented in which it is shown that how the optimal threshold policies can be obtained under a linear cost structure.

  • PDF

Modern Probabilistic Machine Learning and Control Methods for Portfolio Optimization

  • Park, Jooyoung;Lim, Jungdong;Lee, Wonbu;Ji, Seunghyun;Sung, Keehoon;Park, Kyungwook
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제14권2호
    • /
    • pp.73-83
    • /
    • 2014
  • Many recent theoretical developments in the field of machine learning and control have rapidly expanded its relevance to a wide variety of applications. In particular, a variety of portfolio optimization problems have recently been considered as a promising application domain for machine learning and control methods. In highly uncertain and stochastic environments, portfolio optimization can be formulated as optimal decision-making problems, and for these types of problems, approaches based on probabilistic machine learning and control methods are particularly pertinent. In this paper, we consider probabilistic machine learning and control based solutions to a couple of portfolio optimization problems. Simulation results show that these solutions work well when applied to real financial market data.

불확실한 수요와 리드타임을 갖는 공급사슬에서 (s,S) 재고정책에 관한 연구 (A study on Inventory Policy (s, S) in the Supply Chain Management with Uncertain Demand and Lead Time)

  • 한재현;정석재
    • 대한안전경영과학회지
    • /
    • 제15권1호
    • /
    • pp.217-229
    • /
    • 2013
  • As customers' demands for diversified small-quantity products have been increased, there have been great efforts for a firm to respond to customers' demands flexibly and minimize the cost of inventory at the same time. To achieve that goal, in SCM perspective, many firms have tried to control the inventory efficiently. We present an mathematical model to determine the near optimal (s, S) policy of the supply chain, composed of multi suppliers, a warehouse and multi retailers. (s, S) policy is to order the quantity up to target inventory level when inventory level falls below the reorder point. But it is difficult to analyze inventory level because it is varied with stochastic demand of customers. To reflect stochastic demand of customers in our model, we do the analyses in the following order. First, the analysis of inventory in retailers is done at the mathematical model that we present. Then, the analysis of demand pattern in a warehouse is performed as the inventory of a warehouse is much effected by retailers' order. After that, the analysis of inventory in a warehouse is followed. Finally, the integrated mathematical model is presented. It is not easy to get the solution of the mathematical model, because it includes many stochastic factors. Thus, we get the solutions after the stochastic demand is approximated, then they are verified by the simulations.

A NONRANDOM VARIATIONAL APPROACH TO STOCHASTIC LINEAR QUADRATIC GAUSSIAN OPTIMIZATION INVOLVING FRACTIONAL NOISES (FLQG)

  • JUMARIE GUY
    • Journal of applied mathematics & informatics
    • /
    • 제19권1_2호
    • /
    • pp.19-32
    • /
    • 2005
  • It is shown that the problem of minimizing (maximizing) a quadratic cost functional (quadratic gain functional) given the dynamics dx = (fx + gu)dt + hdb(t, a) where b(t, a) is a fractional Brownian motion of order a, 0 < 2a < 1, can be solved completely (and meaningfully!) by using the dynamical equations of the moments of x(t). The key is to use fractional Taylor's series to obtain a relation between differential and differential of fractional order.