• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.031 seconds

Actuator Fault Detection and Adaptive Fault-Tolerant Control Algorithms Using Performance Index and Human-Like Learning for Longitudinal Autonomous Driving (종방향 자율주행을 위한 성능 지수 및 인간 모사 학습을 이용하는 구동기 고장 탐지 및 적응형 고장 허용 제어 알고리즘)

  • Oh, Sechan;Lee, Jongmin;Oh, Kwangseok;Yi, Kyongsu
    • Journal of Auto-vehicle Safety Association
    • /
    • v.13 no.4
    • /
    • pp.129-143
    • /
    • 2021
  • This paper proposes actuator fault detection and adaptive fault-tolerant control algorithms using performance index and human-like learning for longitudinal autonomous vehicles. Conventional longitudinal controller for autonomous driving consists of supervisory, upper level and lower level controllers. In this paper, feedback control law and PID control algorithm have been used for upper level and lower level controllers, respectively. For actuator fault-tolerant control, adaptive rule has been designed using the gradient descent method with estimated coefficients. In order to adjust the control parameter used for determination of adaptation gain, human-like learning algorithm has been designed based on perceptron learning method using control errors and control parameter. It is designed that the learning algorithm determines current control parameter by saving it in memory and updating based on the cost function-based gradient descent method. Based on the updated control parameter, the longitudinal acceleration has been computed adaptively using feedback law for actuator fault-tolerant control. The finite window-based performance index has been designed for detection and evaluation of actuator performance degradation using control error.

Tracking Control of a Electro-hydraulic Servo System Using 2-Dimensional Real-Time Iterative Learning Algorithm (실시간 2차원 학습 신경망을 이용한 전기.유압 서보시스템의 추적제어)

  • 곽동훈;조규승;정봉호;이진걸
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.9 no.6
    • /
    • pp.435-441
    • /
    • 2003
  • This paper addresses that an approximation and tracking control of realtime recurrent neural networks(RTRN) using two-dimensional iterative teaming algorithm for an electro-hydraulic servo system. Two dimensional learning rule is driven in the discrete system which consists of nonlinear output fuction and linear input. In order to control the trajectory of position, two RTRN with the same network architecture were used. Simulation results show that two RTRN using 2-D learning algorithm are able to approximate the plant output and desired trajectory to a very high degree of a accuracy respectively and the control algorithm using two identical RTRN was very effective to trajectory tracking of the electro-hydraulic servo system.

A discrete iterative learning control method with application to electric servo motor control

  • Park, Hee-J.;Cho, Hyung-S.;Oh, Sang-R.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10b
    • /
    • pp.1387-1392
    • /
    • 1990
  • In this paper, an iterative learning control algorithm for unknown linear discrete systems is proposed by employing a parameter estimator together with an inverse system model. Regardless of initial error and inherent parameter uncertainty, a good tracking control performance is obtained using the proposed learning control algorithm characterized by recursive operations. A sufficient condition for convergency is provided to show the effectiveness of the proposed algorithm. To investigate the performance of the algorithm a series of simulations and experiments were performed for the tracking control of a servo motor.

  • PDF

Fuzzy Control of Dynamic systems Using LIBL(Linguistic Instruction Based Learning) (LIBL을 이용한 다이나믹 시스템의 퍼지제어)

  • 조중선;박계각;정경욱;박래석
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1995.10b
    • /
    • pp.139-144
    • /
    • 1995
  • LIBL(Linguistic Instruction Based Leaning) is an effective learning algorithm for fuzzy controller which interpretes and uses natural language of human The possibiliy of the LIBL algorithm to the fuzzy control of dynamic systems is investigated in this paper. Rise time, percent overshoot, and steady stste are proposed as suitable meaning elements for dynamic systems. A supervisor is able to give "higer-level linguistic instruction" to the learning algorithm through these three meaning elements Simulation results for a DC servo motor show the validity of the proposed algorithm.

  • PDF

Control of an Electro-hydraulic Servosystem Using Neural Network with 2-Dimensional Iterative Learning Rule (2차원 반복 학습 신경망을 이용한 전기.유압 서보시스템의 제어)

  • Kwak D.H.;Lee J.K.
    • Transactions of The Korea Fluid Power Systems Society
    • /
    • v.1 no.1
    • /
    • pp.1-9
    • /
    • 2004
  • This paper addresses an approximation and tracking control of recurrent neural networks(RNN) using two-dimensional iterative learning algorithm for an electro-hydraulic servo system. And two dimensional learning rule is driven in the discrete system which consists of nonlinear output function and linear input. In order to control the trajectory of position, two RNN's with the same network architecture were used. Simulation results show that two RNN's using 2-D learning algorithm are able to approximate the plant output and desired trajectory to a very high degree of a accuracy respectively and the control algorithm using two same RNN was very effective to control trajectory tracking of electro-hydraulic servo system.

  • PDF

Reinforcement learning-based control with application to the once-through steam generator system

  • Cheng Li;Ren Yu;Wenmin Yu;Tianshu Wang
    • Nuclear Engineering and Technology
    • /
    • v.55 no.10
    • /
    • pp.3515-3524
    • /
    • 2023
  • A reinforcement learning framework is proposed for the control problem of outlet steam pressure of the once-through steam generator(OTSG) in this paper. The double-layer controller using Proximal Policy Optimization(PPO) algorithm is applied in the control structure of the OTSG. The PPO algorithm can train the neural networks continuously according to the process of interaction with the environment and then the trained controller can realize better control for the OTSG. Meanwhile, reinforcement learning has the characteristic of difficult application in real-world objects, this paper proposes an innovative pretraining method to solve this problem. The difficulty in the application of reinforcement learning lies in training. The optimal strategy of each step is summed up through trial and error, and the training cost is very high. In this paper, the LSTM model is adopted as the training environment for pretraining, which saves training time and improves efficiency. The experimental results show that this method can realize the self-adjustment of control parameters under various working conditions, and the control effect has the advantages of small overshoot, fast stabilization speed, and strong adaptive ability.

An iterative learning approach to error compensation of position sensors for servo motors

  • Han, Seok-Hee;Ha, In-Joong;Ha, Tae-Kyoon;Huh, Heon;Ko, Myoung-Sam
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1993.10b
    • /
    • pp.534-540
    • /
    • 1993
  • In this paper, we present an iterative learning method of compensating for position sensor error. The previously known compensation algrithms need a special perfect position sensor or a priori information about error sources, while ours does not. To our best knowledge, any iterative learning approach has not been taken for sensor error compensation. Furthermore, our iterative learning algorithm does not have the drawbacks of the existing iterative learning control theories. To be more specific, our algorithm learns a uncertain function inself rather than its special time-trajectory and does not request the derivatives of measurement signals. Moreover, it does not require the learning system to start with the same initial condition for all iterations. To illuminate the generality and practical use of our algorithm, we give the rigorous proof for its convergence and some experimental results.

  • PDF

Learning Control Algorithm Applying to Large Scale System (대규모 시스템에서의 학습제어 알고리즘)

  • Hwang, D.H.;Bien, Z.;Oh, S.R.
    • Proceedings of the KIEE Conference
    • /
    • 1989.07a
    • /
    • pp.112-115
    • /
    • 1989
  • This paper proposes a learning control algorithm for trajectory tracking of large scale system. The controller using only localized informations is composed of stabilizing controller and iterative learning controller. Stabilization and convergence of each subsystem is assured under some conditions which are inequalities of inter-connection terms and learning controller gain.

  • PDF

A Development of Learning Control Method for the Accurate Control of Industrial Robot (산업용 로봇트의 정밀제어를 위한 학습제어 방법의 개발)

  • 원광호;허경무
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.346-346
    • /
    • 2000
  • We proposed a method of second-order iterative learning control with feedback, which shows an enhancement of convergence speed and robustness to the disturbances in our previous study. In this paper, we show that the proposed second-order iterative learning control algorithm with feedback is more effective and has better convergence performance than the algorithm without feedback in the case of the existence of initial condition errors. And the convergence woof of the proposed algorithm in the case of the existence of initial condition error is given in detail, and the effectiveness of the Proposed algorithm is shown by simulation results.

  • PDF

ON THE STRUCTURE AND LEARNING OF NEURAL-NETWORK-BASED FUZZY LOGIC CONTROL SYSTEMS

  • C.T. Lin;Lee, C.S. George
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1993.06a
    • /
    • pp.993-996
    • /
    • 1993
  • This paper addresses the structure and its associated learning algorithms of a feedforward multi-layered connectionist network, which has distributed learning abilities, for realizing the basic elements and functions of a traditional fuzzy logic controller. The proposed neural-network-based fuzzy logic control system (NN-FLCS) can be contrasted with the traditional fuzzy logic control system in their network structure and learning ability. An on-line supervised structure/parameter learning algorithm dynamic learning algorithm can find proper fuzzy logic rules, membership functions, and the size of output fuzzy partitions simultaneously. Next, a Reinforcement Neural-Network-Based Fuzzy Logic Control System (RNN-FLCS) is proposed which consists of two closely integrated Neural-Network-Based Fuzzy Logic Controllers (NN-FLCS) for solving various reinforcement learning problems in fuzzy logic systems. One NN-FLC functions as a fuzzy predictor and the other as a fuzzy controller. As ociated with the proposed RNN-FLCS is the reinforcement structure/parameter learning algorithm which dynamically determines the proper network size, connections, and parameters of the RNN-FLCS through an external reinforcement signal. Furthermore, learning can proceed even in the period without any external reinforcement feedback.

  • PDF