• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.034 seconds

Design of an Active Adaptive Dual Controller for Non-Minimum Phase Systems (비최소 위상시스템에 대한 능동적응 이중 제어기의 설계)

  • 김도성;안태천;이명호
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.35 no.9
    • /
    • pp.380-387
    • /
    • 1986
  • We have developed a dual control algorithm by means of innovations approach and established the stability of dual by introducing the pole-placement method suggested by Berger on the non-dual control. The dual controller realizing this algorithm decreases control loss sharply when compared with that of a non-dual controller, and shows the characteristics of suppressing the output deviation in transient state effectively. The total control energy and the accumulated square misdistance of this dual controller are shown to be 1-10% and 0.1-10% of those of CE control, respectively. Consequently this controller solves the non-minimum phase problem encountered when discretizing the system equation, and can be used to overcome the uncertainty of system effectively by adjusting the learning rate of the controller.

  • PDF

Neural Network Learning Algorithm for Variable Structure System (가변구조 시스템을 위한 신경회로망 학습 알고리즘)

  • Cho, Jeong-Ho;Lee, Dong-Wook;Kim, Young-T.
    • Proceedings of the KIEE Conference
    • /
    • 1996.11a
    • /
    • pp.401-403
    • /
    • 1996
  • In this paper, a new control strategy is presented that combines sliding mode control theory with a neural network. Sliding mode control theory requires the complete knowledge of the dynamics of the controlled system. However, in practice, one often bas only a small number of state measurements. This could be a serious limitation on the practical usefulness of sliding mode control theory. A multilayer neural network is employed to solve this kind of problem. The neural network serves as a compensator without a prior knowledge about the system. The proposed control algorithm is applied to a class of uncertain nonlinear system. The robustness against parameter uncertainty, nonlinearity and external disturbances, and the effectiveness is verified by the simulation results.

  • PDF

Automatic Berthing Finite-time Control Considering Transmission Load Reduction

  • Liu Yang;Im Nam-kyun
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2022.11a
    • /
    • pp.168-169
    • /
    • 2022
  • In this study, we investigates the auto-berthing problem for the underactuated surface vessel in the presence of constraints of dynamic uncertainties, finite time, transmission load, and environmental disturbance. A novel control scheme is proposed by fusing the finite time control technology and the event-triggered input algorithm. In the algorithm, differential homeomorphism coordinate the transformation is used to solve the problem of underactuation. Then, we apply the finite time technology and event triggered to save the time of the berthing vessel and relieve transmission burden between the controller and the vessel respectively. Moreover, a radial basis function network is used to approximate unknown nonlinear functions, and minimum learning parameters are introduced to lessen the computational complexity. A sufficient effort has been made to verify the stability of the closed-loop system based on the Lyapunov stability theory. Finally, simulation results display the effectiveness of the proposed scheme.

  • PDF

Development of Optimal Design Technique of RC Beam using Multi-Agent Reinforcement Learning (다중 에이전트 강화학습을 이용한 RC보 최적설계 기술개발)

  • Kang, Joo-Won;Kim, Hyun-Su
    • Journal of Korean Association for Spatial Structures
    • /
    • v.23 no.2
    • /
    • pp.29-36
    • /
    • 2023
  • Reinforcement learning (RL) is widely applied to various engineering fields. Especially, RL has shown successful performance for control problems, such as vehicles, robotics, and active structural control system. However, little research on application of RL to optimal structural design has conducted to date. In this study, the possibility of application of RL to structural design of reinforced concrete (RC) beam was investigated. The example of RC beam structural design problem introduced in previous study was used for comparative study. Deep q-network (DQN) is a famous RL algorithm presenting good performance in the discrete action space and thus it was used in this study. The action of DQN agent is required to represent design variables of RC beam. However, the number of design variables of RC beam is too many to represent by the action of conventional DQN. To solve this problem, multi-agent DQN was used in this study. For more effective reinforcement learning process, DDQN (Double Q-Learning) that is an advanced version of a conventional DQN was employed. The multi-agent of DDQN was trained for optimal structural design of RC beam to satisfy American Concrete Institute (318) without any hand-labeled dataset. Five agents of DDQN provides actions for beam with, beam depth, main rebar size, number of main rebar, and shear stirrup size, respectively. Five agents of DDQN were trained for 10,000 episodes and the performance of the multi-agent of DDQN was evaluated with 100 test design cases. This study shows that the multi-agent DDQN algorithm can provide successfully structural design results of RC beam.

Searching a global optimum by stochastic perturbation in error back-propagation algorithm (오류 역전파 학습에서 확률적 가중치 교란에 의한 전역적 최적해의 탐색)

  • 김삼근;민창우;김명원
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.79-89
    • /
    • 1998
  • The Error Back-Propagation(EBP) algorithm is widely applied to train a multi-layer perceptron, which is a neural network model frequently used to solve complex problems such as pattern recognition, adaptive control, and global optimization. However, the EBP is basically a gradient descent method, which may get stuck in a local minimum, leading to failure in finding the globally optimal solution. Moreover, a multi-layer perceptron suffers from locking a systematic determination of the network structure appropriate for a given problem. It is usually the case to determine the number of hidden nodes by trial and error. In this paper, we propose a new algorithm to efficiently train a multi-layer perceptron. OUr algorithm uses stochastic perturbation in the weight space to effectively escape from local minima in multi-layer perceptron learning. Stochastic perturbation probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the probabilistically re-initializes weights associated with hidden nodes to escape a local minimum if the EGP learning gets stuck to it. Addition of new hidden nodes also can be viewed asa special case of stochastic perturbation. Using stochastic perturbation we can solve the local minima problem and the network structure design in a unified way. The results of our experiments with several benchmark test problems including theparity problem, the two-spirals problem, andthe credit-screening data show that our algorithm is very efficient.

  • PDF

Development of AI-Based Condition Monitoring System for Failure Diagnosis of Excavator's Travel Device (굴착기 주행디바이스의 고장 진단을 위한 AI기반 상태 모니터링 시스템 개발)

  • Baek, Hee Seung;Shin, Jong Ho;Kim, Seong Joon
    • Journal of Drive and Control
    • /
    • v.18 no.1
    • /
    • pp.24-30
    • /
    • 2021
  • There is an increasing interest in condition-based maintenance for the prevention of economic loss due to failure. Moreover, immense research is being carried out in related technologies in the field of construction machinery. In particular, data-based failure diagnosis methods that employ AI (machine & deep learning) algorithms are in the spotlight. In this study, we have focused on the failure diagnosis and mode classification of reduction gear of excavator's travel device by using the AI algorithm. In addition, a remote monitoring system has been developed that can monitor the status of the reduction gear by using the developed diagnosis algorithm. The failure diagnosis algorithm was performed in the process of data acquisition of normal and abnormal under various operating conditions, data processing and analysis by the wavelet transformation, and learning. The developed algorithm was verified based on three-evaluation conditions. Finally, we have built a system that can check the status of the reduction gear of travel devices on the web using the Edge platform, which is embedded with the failure diagnosis algorithm and cloud.

Identification of suspension systems using error self recurrent neural network and development of sliding mode controller (오차 자기 순환 신경회로망을 이용한 현가시스템 인식과 슬라이딩 모드 제어기 개발)

  • 송광현;이창구;김성중
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.625-628
    • /
    • 1997
  • In this paper the new neural network and sliding mode suspension controller is proposed. That neural network is error self-recurrent neural network. For fast on-line learning, this paper use recursive least squares method. A new neural networks converges considerably faster than the backpropagation algorithm and has advantages of being less affected by the poor initial weights and learning rate. The controller for suspension systems is designed according to sliding mode technique based on new proposed neural network.

  • PDF

신경망을 이용한 차동조향 이동로봇의 추적제어

  • 계중읍;김무진;이영진;이만형
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.17 no.3
    • /
    • pp.90-101
    • /
    • 2000
  • In this paper, we propose a controller for differentially steered wheeled mobile robots. The controller uses input-output linearization algorithm and artificial neural network to stabilize the dynamic model and compensate uncertainties. The proposed neural network part has 6 inputs, 1 hidden layer, 2 torque outputs and features fast online learning and good performance on structure error learning basis. Simulation results show that the proposed controller perform precisely tracking of reference path and is robust to uncertainties.

  • PDF

A Hybrid Modeling Architecture; Self-organizing Neuro-fuzzy Networks

  • Park, Byoungjun;Sungkwun Oh
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.102.1-102
    • /
    • 2002
  • In this paper, we propose Self-organizing neurofuzzy networks(SONFN) and discuss their comprehensive design methodology. The proposed SONFN is generated from the mutually combined structure of both neurofuzzy networks (NFN) and polynomial neural networks(PNN) for model identification of complex and nonlinear systems. NFN contributes to the formation of the premise part of the SONFN. The consequence part of the SONFN is designed using PNN. The parameters of the membership functions, learning rates and momentum coefficients are adjusted with the use of genetic optimization. We discuss two kinds of SONFN architectures and propose a comprehensive learning algorithm. It is shown that this network...

  • PDF

The Design of Self-Organizing Map Using Pseudo Gaussian Function Network

  • Kim, Byung-Man;Cho, Hyung-Suck
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.42.6-42
    • /
    • 2002
  • Kohonen's self organizing feature map (SOFM) converts arbitrary dimensional patterns into one or two dimensional arrays of nodes. Among the many competitive learning algorithms, SOFM proposed by Kohonen is considered to be powerful in the sense that it not only clusters the input pattern adaptively but also organize the output node topologically. SOFM is usually used for a preprocessor or cluster. It can perform dimensional reduction of input patterns and obtain a topology-preserving map that preserves neighborhood relations of the input patterns. The traditional SOFM algorithm[1] is a competitive learning neural network that maps inputs to discrete points that are called nodes on a lattice...

  • PDF