• Title/Summary/Keyword: stochastic optimal control

Search Result 130, Processing Time 0.031 seconds

Receding horizon predictive controls and generalized predictive controls with their equivalance and stability

  • Kwon, Wook-Hyun;Lee, Young-Il
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1992.10b
    • /
    • pp.49-55
    • /
    • 1992
  • In this paper, we developed a Receding Horizon Predictive Control for Stochastic state space models(RHPCS). RHPCS was designed to minimize a quadratic cost function. RHPCS consists of Receding Horizon Tracking Control(RHTC) and a state observer. It was shown that RHPCS is equivalent to Generalized Predictive Control(GPC) when the underlying state space model is equivalent to the I/O model used in the design of GPC. The equivalence between GPC and RHPCS was shown through. the comparison of the transfer functions of the two controllers. RHPCS provides a time-invarient optimal control law for systems for which GPC can not be used. The stability properties of RHPCS was derived. From the GPC's equivalence to RHPCS, the stability properties of GPC were shown to be the same as those for RHTC.

  • PDF

Average performance of risk-sensitive controlled orbiting satellite and three-degree-of-freedom structure

  • Won, Chang-Hee
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1995.10a
    • /
    • pp.444-447
    • /
    • 1995
  • The satellite in a circular orbit about a planet with disturbances and a three-degree-of-freedom (3DOF) structure under seismic excitations are modeled by the linear stochastic differential equations. Then the risk-sensitive optimal control method is applied to those equations. The mean and the variance of the cost function varies with respect to the risk-sensitivity parameter, .gamma.$_{RS}$ . For a particular risk-sensitivity parameter value, risk-sensitive control reduces to LQG control. Furthermore, the derivation of the mean square value of the state and control action are given for a finite-horizon full-state-feedback risk-sensitive control system. The risk-sensitive controller outperforms a classical LQG controller in the mean square sense of the state and the control action.

  • PDF

Analysis and Design of Jumping Robot System Using the Model Transformation Method

  • Suh Jin-Ho;Yamakita Masaki
    • Journal of Electrical Engineering and Technology
    • /
    • v.1 no.2
    • /
    • pp.200-210
    • /
    • 2006
  • This paper proposes the motion generation method in which the movement of the 3-links leg subsystem in constrained to slider-link and a singular posture can be easily avoided. This method is the realization of jumping control moving in a vertical direction, which mimics a cat's behavior. To consider the movement from the point of the constraint mechanical system, a robotics system for realizing the motion will change its configuration according to the position. The effectiveness of the proposed scheme is illustrated by simulation and experimental results.

Optimal Design of Linear Quadratic Regulator Restrict Maximum Responses of Building Structures Subject to Stochastic Excitation (확률적 가진입력을 받는 건축구조물의 최대응답 제한을 위한 선형이차안정기의 최적설계)

  • 박지훈;황재승;민경원
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.5 no.6
    • /
    • pp.37-46
    • /
    • 2001
  • In this research, a controller design method based on optimization is proposed that can satisfy constraints on maximum responses of building structures subject to around excitation modeled by partially stochastic process. The class of controllers to be optimized is restricted to LQR. Weighting matrix on controlled outputs is used as design variable. Objective function, constraint functions and their gradients are computed by the parameterization of control gain with Riccati matrix. Full state feedback controllers designed by proposed optimization method satisfy various design objectives and their necessary maximum control forces are computed for the production of actuator. LQG controllers composed of Kalman filter and LQR designed by proposed method perform well with little deterioration. So it is possible to design output feedback controllers satisfying constraints on various maximum responses of structures.

  • PDF

Life-cycle-cost optimization for the wind load design of tall buildings equipped with TMDs

  • Venanzi, Ilaria;Ierimonti, Laura;Caracoglia, Luca
    • Wind and Structures
    • /
    • v.30 no.4
    • /
    • pp.379-392
    • /
    • 2020
  • The paper presents a Life-Cycle Cost-based optimization framework for wind-excited tall buildings equipped with Tuned Mass Dampers (TMDs). The objective is to minimize the Life-Cycle Cost that comprises initial costs of the structure, the control system and costs related to repair, maintenance and downtime over the building's lifetime. The integrated optimization of structural sections and mass ratio of the TMDs is carried out, leading to a set of Pareto optimal solutions. The main advantage of the proposed methodology is that, differently from the traditional optimal design approach, it allows to perform the unified design of both the structure and the control system in a Life Cycle Cost Analysis framework. The procedure quantifies wind-induced losses, related to structural and nonstructural damage, considering the stochastic nature of the loads (wind velocity and direction), the specificity of the structural modeling (e.g., non-shear-type vibration modes and torsional effects) and the presence of the TMDs. Both serviceability and ultimate limit states related to the structure and the TMDs' damage are adopted for the computation of repair costs. The application to a case study tall building allows to demonstrate the efficiency of the procedure for the integrated design of the structure and the control system.

Cost Evaluation of multirate LQD Control

  • 이진우;오준호
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1997.04a
    • /
    • pp.174-178
    • /
    • 1997
  • In this paper,we consider a LQG problem subject to the stochastic multirate system. By restating the problem as a periodic LQG problem, it is pointed out that the lack of measurements and control inputs in some time instants makes the problem singular. A method of transforming the problem into a nonsingular one enables us to obtain the solution,however which gives a resulting value of the LQG cost and the setimation error dynamic different with those of the original system. As a consequence, we present a optimal value of the original cost and the estimation error covariance of the original system,which are expressed by periodic Lyapunov equation respectively. The evaluation resulte can be exploited in comparing the control system performances and specifying the sampling rates.

A Supervised Learning Framework for Physics-based Controllers Using Stochastic Model Predictive Control (확률적 모델예측제어를 이용한 물리기반 제어기 지도 학습 프레임워크)

  • Han, Daseong
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.1
    • /
    • pp.9-17
    • /
    • 2021
  • In this paper, we present a simple and fast supervised learning framework based on model predictive control so as to learn motion controllers for a physic-based character to track given example motions. The proposed framework is composed of two components: training data generation and offline learning. Given an example motion, the former component stochastically controls the character motion with an optimal controller while repeatedly updating the controller for tracking the example motion through model predictive control over a time window from the current state of the character to a near future state. The repeated update of the optimal controller and the stochastic control make it possible to effectively explore various states that the character may have while mimicking the example motion and collect useful training data for supervised learning. Once all the training data is generated, the latter component normalizes the data to remove the disparity for magnitude and units inherent in the data and trains an artificial neural network with a simple architecture for a controller. The experimental results for walking and running motions demonstrate how effectively and fast the proposed framework produces physics-based motion controllers.

Development of Han River Multi-Reservoir Operation Rules by Linear Tracking (선형추적에 의한 한강수계 복합 저수지 계통의 이수 조작기준 작성)

  • Yu, Ju-Hwan
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.6
    • /
    • pp.733-744
    • /
    • 2000
  • Due to the randomness of reservoir inflow and supply demand it is not easy to establish an optimal reservoir operation rule. However, the operation rule can be derived by the implicit stochastic optimization approach using synthetic inflow data with some demand satisfied. In this study the optimal reservoir operation which was reasonably formulated as Linear Tracking model for maximizing the hydro-energy of seven reservoirs system in the Han river was performed by use of the optimal control theory. Here the operation model made to satisfy the 2001st year demand in the capital area inputted the synthetic inflow data generated by multi-site Markov model. Based on the regressions and statistic analyses of the optimal operation results, monthly reservoir operation rules were developed with the seasonal probabilities of the reservoir stages. The comparatively larger dams which would have more controllability such as Hwacheon, Soyanggang, and Chungju had better regressions between the storages and outflows. The effectiveness of the rules was verified by the simulation during actually operating period.period.

  • PDF

Application of Sliding Mode fuzzy Control with Disturbance Prediction (외란 예측기가 포함된 슬라이딩 모드 퍼지 제어기의 응용)

  • 김상범;윤정방;구자인
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2000.04b
    • /
    • pp.365-370
    • /
    • 2000
  • A sliding mode fuzzy control (SMFC) algorithm is applied to design a controller for a benchmark problem on a wind- excited building. The structure is a 76-story concrete office tower with a height of 306 meters, hence the wind resistance characteristics are very important for the serviceability as well as the safety. A control system with an active tuned mass damper is assumed to be installed on the top floor. Since the structural acceleration is measured only at ,limited number of locations without measurement of the wind force, the structure of the conventional continuous sliding mode control may have the feed-back loop only. So, an adaptive least mean squares (LMS) filter is employed in the SMFC algorithm to generate a fictitious feed-forward loop. The adaptive LMS filter is designed based on the information of the stochastic characteristics of the wind velocity along the structure. A numerical study is carried out. and the performance of the present SMFC with the ,adaptive LMS filter is investigated in comparison with those of' other control, of algorithms such as linear quadratic Gaussian control, frequency domain optimal control, quadratic stability control, continuous sliding mode control, and H/sub ∞///sub μ/, control, which were reported by other researchers. The effectiveness of the adaptive LMS filter is also examined. The results indicate that the present algorithm is very efficient .

  • PDF

A Study on Motion Planning Generation of Jumping Robot Control Using Model Transformation Method (모델 변환법을 이용한 점핑 로봇 제어의 운동경로 생성에 관한 연구)

  • 서진호;산북창의;이권순
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.21 no.4
    • /
    • pp.120-131
    • /
    • 2004
  • In this paper, we propose the method of a motion planning generation in which the movement of the 3-link leg subsystem is constrained to a slider-link and a singular posture can be easily avoided. The proposed method is the jumping control moving in vertical direction which mimics a cat's behavior. That is, it is jumping toward wall and kicking it to get a higher-place. Considering the movement from the point of constraint mechanical system, the robotic system which realizes the motion changes its configuration according to the position and it has several phases such as; ⅰ) an one-leg phase, ⅱ) in an air-phase. In other words, the system is under nonholonomic constraint due to the reservation of its momentum. Especially, in an air-phase, we will use a control method using state transformation and linearization in order to control the landing posture. Also, an iterative learning control algorithm is applied in order to improve the robustness of the control. The simulation results for jumping control will illustrate the effectiveness of the proposed control method.