• Title/Summary/Keyword: Learning control

Search Result 3,736, Processing Time 0.037 seconds

A Study on the Improvement of Convergence for a Discrete-time Learning Controller by Approximated Inverse Model (근사 역모델에 의한 이산시간 학습제어기의 수렴성 개선에 관한 연구)

  • Moon, Myung-Soo;Yang, Hai-Won
    • Proceedings of the KIEE Conference
    • /
    • 1989.07a
    • /
    • pp.101-105
    • /
    • 1989
  • The iterative learning controller makes the system output follow the desired output over a finite time interval through iterating trials. In this paper, first we discuss that the design problem of learning controller is originally the design problem of the inverse model. Then we show that the tracking error which is the difference between the desired output and the system output is reduced monotonically by properly modeled inverse system if the magnitude of the learning operator being introduced is bounded within the unit circle in complex domain. Also it would be shown that the conventional learning control method is a kind of extremely simplified inverse model learning control method of the objective controlled system. Hence this control method can be considered as a generalization of the conventional learning control method. The more a designer model the objective controlled system precisely, the better the performance of the approximated inverse model learning controller would be. Finally we compare the performance of the conventional learning control method with that of the approximated inverse model learning control method by computer simulation.

  • PDF

Barycentric Approximator for Reinforcement Learning Control

  • Whang Cho
    • International Journal of Precision Engineering and Manufacturing
    • /
    • v.3 no.1
    • /
    • pp.33-42
    • /
    • 2002
  • Recently, various experiments to apply reinforcement learning method to the self-learning intelligent control of continuous dynamic system have been reported in the machine learning related research community. The reports have produced mixed results of some successes and some failures, and show that the success of reinforcement learning method in application to the intelligent control of continuous control systems depends on the ability to combine proper function approximation method with temporal difference methods such as Q-learning and value iteration. One of the difficulties in using function approximation method in connection with temporal difference method is the absence of guarantee for the convergence of the algorithm. This paper provides a proof of convergence of a particular function approximation method based on \"barycentric interpolator\" which is known to be computationally more efficient than multilinear interpolation .

Multi-Channel Speech Enhancement Algorithm Using DOA-based Learning Rate Control (DOA 기반 학습률 조절을 이용한 다채널 음성개선 알고리즘)

  • Kim, Su-Hwan;Lee, Young-Jae;Kim, Young-Il;Jeong, Sang-Bae
    • Phonetics and Speech Sciences
    • /
    • v.3 no.3
    • /
    • pp.91-98
    • /
    • 2011
  • In this paper, a multi-channel speech enhancement method using the linearly constrained minimum variance (LCMV) algorithm and a variable learning rate control is proposed. To control the learning rate for adaptive filters of the LCMV algorithm, the direction of arrival (DOA) is measured for each short-time input signal and the likelihood function of the target speech presence is estimated to control the filter learning rate. Using the likelihood measure, the learning rate is increased during the pure noise interval and decreased during the target speech interval. To optimize the parameter of the mapping function between the likelihood value and the corresponding learning rate, an exhaustive search is performed using the Bark's scale distortion (BSD) as the performance index. Experimental results show that the proposed algorithm outperforms the conventional LCMV with fixed learning rate in the BSD by around 1.5 dB.

  • PDF

Adaptive Learning Control fo rUnknown Monlinear Systems by Combining Neuro Control and Iterative Learning Control (뉴로제어 및 반복학습제어 기법을 결합한 미지 비선형시스템의 적응학습제어)

  • 최진영;박현주
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.8 no.3
    • /
    • pp.9-15
    • /
    • 1998
  • This paper presents an adaptive learning control method for unknown nonlinear systems by combining neuro control and iterative learning control techniques. In the present control system, an iterative learning controller (ILC) is used for a process of short term memory involved in a temporary adaptive and learning manipulation and a short term storage of a specific temporary action. The learning gain of the iterative learning law is estimated by using a neural network for an unknown system except relative degrees. The control informations obtained by ILC are transferred to a long term memory-based feedforward neuro controller (FNC) and accumulated in it in addition to the previously stored infonnations. This scheme is applied to a two link robot manipulator through simulations.

  • PDF

The Relationships between Mother's Psychological Control and Self-Directed Learning Ability in Elementary School Students: Focusing on the Mediating Effects of Self-Determined Motivation (초등학교 고학년 아동이 지각한 어머니의 심리적 통제와 자기주도적 학습과의 관계: 자기결정성동기의 매개효과 검증)

  • Lee, Heesun;Kwon, Yongae
    • Journal of the Korean Home Economics Association
    • /
    • v.50 no.8
    • /
    • pp.125-135
    • /
    • 2012
  • The purpose of this study is to examine the mediating effects of self-determined motivation between mother's psychological control and self-directed learning ability in children. The participants were 457 sixth-grade elementary students in the Gyung-gi province. They completed questionnaires that included the Self-Directed Learning Readiness Scale, K-SPQ-A, Psychological Control Scale. Descriptive statistics and Pearson's product correlation coefficients were obtained using SPSS (version 18.0), and tests of the mediation were performed using SEM with AMOS (version 18.0). The major findings of this study were as follows that significant correlations among maternal psychological control, self-determined motivation and self-directed learning exist. Also a mother's psychological control was negatively related to a child's self-directed learning. The relationship between maternal psychological control and a child's self directed learning was fully mediated by self determined motivation. These results suggested that high maternal psychological control was negatively affected that development of self-determined motivation and self-directed learning.

Development of Semi-Active Control Algorithm Using Deep Q-Network (Deep Q-Network를 이용한 준능동 제어알고리즘 개발)

  • Kim, Hyun-Su;Kang, Joo-Won
    • Journal of Korean Association for Spatial Structures
    • /
    • v.21 no.1
    • /
    • pp.79-86
    • /
    • 2021
  • Control performance of a smart tuned mass damper (TMD) mainly depends on control algorithms. A lot of control strategies have been proposed for semi-active control devices. Recently, machine learning begins to be applied to development of vibration control algorithm. In this study, a reinforcement learning among machine learning techniques was employed to develop a semi-active control algorithm for a smart TMD. The smart TMD was composed of magnetorheological damper in this study. For this purpose, an 11-story building structure with a smart TMD was selected to construct a reinforcement learning environment. A time history analysis of the example structure subject to earthquake excitation was conducted in the reinforcement learning procedure. Deep Q-network (DQN) among various reinforcement learning algorithms was used to make a learning agent. The command voltage sent to the MR damper is determined by the action produced by the DQN. Parametric studies on hyper-parameters of DQN were performed by numerical simulations. After appropriate training iteration of the DQN model with proper hyper-parameters, the DQN model for control of seismic responses of the example structure with smart TMD was developed. The developed DQN model can effectively control smart TMD to reduce seismic responses of the example structure.

Friction Compensation of X-Y robot Using a Learning Control Technique (학습제어기법을 이용한 X-Y Table의 마찰보상)

  • Sohn, Kyoung-Oh;Kuc, Tae-Yong
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.6 no.3
    • /
    • pp.248-255
    • /
    • 2000
  • Whereas the linear PID controller is widely used for control of industrial servo systems a high precision positioning system is not easy to control only with the PID controller due to uncertain nonlinear dynamics such as friction backlash etc. As a viable means to overcome the difficulty a learning control scheme is proposed in this paper that is simple and straightforward to implement. The proposed learning controller takes full advantage of current feedback capability of the inner-loop of the control system in that electrical motor dynamics as the well as mechanical part of X-Y positioning system is included in the learning control scheme, The experimental results are given to demonstrate its feasibility and effectiveness in terms of convergence precision of tracking and robustness in comparison with the conventional control method.

  • PDF

Control of Crane System Using Fuzzy Learning Method (퍼지학습법을 이용한 크레인 제어)

  • Noh, Sang-Hyun;Lim, Yoon-Kyu
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.2 no.1
    • /
    • pp.61-67
    • /
    • 1999
  • An active control for the swing of crane systems is very important for increasing the productivity. This article introduces the control for the position and the swing of a crane using the fuzzy learning method. Because the crane is a multi-variable system, learning is done to control both position and swing of the crane. Also the fuzzy control rules are separately acquired with the loading and unloading situation of the crane for more accurate control. And We designed controller by fuzzy learning method, and then compare fuzzy learning method with LQR. The result of simulations shows that the crane is controlled better than LQR for a very large swing angle of 1 radian within nearly one cycle.

  • PDF

Output Tracking of Uncertain Fractional-order Systems via Robust Iterative Learning Sliding Mode Control

  • Razmjou, Ehsan-Ghotb;Sani, Seyed Kamal-Hosseini;Jalil-Sadati, Seyed
    • Journal of Electrical Engineering and Technology
    • /
    • v.13 no.4
    • /
    • pp.1705-1714
    • /
    • 2018
  • This paper develops a novel controller called iterative learning sliding mode (ILSM) to control linear and nonlinear fractional-order systems. This control applies a combination structures of continuous and discontinuous controller, conducts the system output to the desired output and achieve better control performance. This controller is designed in the way to be robust against the external disturbance. It also estimates unknown parameters of fractional-order systems. The proposed controller unlike the conventional iterative learning control for fractional systems does not need to apply direct control input to output of the system. It is shown that the controller perform well in partial and complete observable conditions. Simulation results demonstrate very good performance of the iterative learning sliding mode controller for achieving the desired control objective by increasing the number of iterations in the control loop.

Robust tuning of quadratic criterion-based iterative learning control for linear batch system

  • Kim, Won-Cheol;Lee, Kwang-Soon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10a
    • /
    • pp.303-306
    • /
    • 1996
  • We propose a robust tuning method of the quadratic criterion based iterative learning control(Q-ILC) algorithm for discrete-time linear batch system. First, we establish the frequency domain representation for batch systems. Next, a robust convergence condition is derived in the frequency domain. Based on this condition, we propose to optimize the weighting matrices such that the upper bound of the robustness measure is minimized. Through numerical simulation, it is shown that the designed learning filter restores robustness under significant model uncertainty.

  • PDF