• Title/Summary/Keyword: Learning Trajectory

Search Result 254, Processing Time 0.032 seconds

A Study on Position Control of 2-Mass Resonant System Using Iterative Learning Control (반복 학습 제어를 이용한 2관성 공진계의 위치 제어에 관한 연구)

  • Lee, Hak-Sung;Moon, Seung-Bin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.6
    • /
    • pp.693-698
    • /
    • 2004
  • In this paper, an iterative learning control method is applied to suppress a vibration of a 2-mass system which has a flexible coupling between a load and a motor. More specifically, conditions for the load speed without vibration are derived based on the steady-state condition. And the desired motor position trajectory is synthesized based on the relation between the load and motor speed. Finally, a PD-type iterative learning control law is applied for the desired motor position trajectory. Since the learning law applied for the desired trajectory guarantees the perfect tracking performance, the resulting load speed shows no vibration even when there exist model uncertainties. A modification to the learning law is also Presented to suppress undesired effects of an initial position error, The simulation results show the effectiveness of the proposed learning method.

Simplification and Scaling of Iterative Learning Control Command (반복학습제어 명령의 간단화와 스케일링)

  • Chae, Hui-Chang;Lee, Sang-Hoon;Park, Myung-Kwan;Suh, Il-Hong
    • Proceedings of the KIEE Conference
    • /
    • 2003.07d
    • /
    • pp.2390-2392
    • /
    • 2003
  • ILC(Iterative Learning Control: 이하 ILC)는 현재 기계, 전기, 화학 등 많은 분야에 널리 적용되고 있다. ILC는 특히 반복적인 trajectory tracking Control 문제에 아주 효과적인 방법 중의 하나이다. 하지만 ILC는 메모리 기반의 scheme로서 trajectory tracking을 위해서는 많은 메모리를 요구하게 된다. 한편, 자세한 관찰에 의하면 인간의 팔, 다리 등의 관절의 움직임은 아주 정확하지가 않다. 이러한 사실로 미루어 인간이 정화한 모션을 취하는데 드는 비용을 줄이고자 모션 명령을 간단히 한다는 가정을 추론 해 낼 수 있다. 이러한 가정에 기초하여 우리는 ILC 명령을 간단히 하기 위해서 약간의 trajectory tracking의 정확성을 회생하는 메커니즘을 제안한다. 간단해진 ILC 명령은 적은 메모리 공간에 저장될 것이다. 또한, 로봇의 trajectory tracking을 위한 기존의 방법들은 아주 복잡할 뿐만 아니라 하나의 task의 수행만이 가능할 뿐 어떤 일반화의 방법도 제시하지 못하고 있다. 그래서 본 논문에서는 ILC 명령의 scaling에 대한 메커니즘을 제공하여 하나의 trajectory에 대해서 비슷한 모양이지만 다른 크기와 속도를 가지는 trajectory를 구현 할 수 있도록 하였다.

  • PDF

Tracking Control of a Electro-hydraulic Servo System Using 2-Dimensional Real-Time Iterative Learning Algorithm (실시간 2차원 학습 신경망을 이용한 전기.유압 서보시스템의 추적제어)

  • 곽동훈;조규승;정봉호;이진걸
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.9 no.6
    • /
    • pp.435-441
    • /
    • 2003
  • This paper addresses that an approximation and tracking control of realtime recurrent neural networks(RTRN) using two-dimensional iterative teaming algorithm for an electro-hydraulic servo system. Two dimensional learning rule is driven in the discrete system which consists of nonlinear output fuction and linear input. In order to control the trajectory of position, two RTRN with the same network architecture were used. Simulation results show that two RTRN using 2-D learning algorithm are able to approximate the plant output and desired trajectory to a very high degree of a accuracy respectively and the control algorithm using two identical RTRN was very effective to trajectory tracking of the electro-hydraulic servo system.

Industrial robot programming method utilizing the human learning capability (인간 학습을 이용한 산업용 로보트의 효율적 프로그래밍 방안)

  • 김성수;이종태
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 1996.04a
    • /
    • pp.244-248
    • /
    • 1996
  • Nowadays, most shop floors using industrial robots have many problems such as constructing robot workcell, generating robot arm moving trajectory, etc.. In the case of programming robot-arms for a specific task, shop operator commonly use the teach pendant to record the target position and determine the moving trajectory. However, such a teaching process may result in an inefficient trajectory in the sense of moving distance and joint angle fluctuation. Moreover, shop operators who have little knowledge about robot programming process need a lot of learning time and cost. The purpose of this paper is to propose a user friendly robot programming method to program robot-arms easily and efficiently for shop operator so that the programming time is reduced and a short and stable trajectory is obtained.

  • PDF

Improvement of trajectory tracking control performance by using ILC

  • Le, Dang-Khanh;Nam, Taek-Kun
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.38 no.10
    • /
    • pp.1281-1286
    • /
    • 2014
  • This paper presents an iterative learning control (ILC) approach for tracking problems with specified data points that are desired points at certain time instants. To design ILC systems for such problems, unlike traditional ILC approaches, an algorithm which updates not only the control signal but also the reference trajectory at each trial will be developed. The relationship between the reference trajectory and ILC control in tracking problems where there are specified data points through which the system should pass is investigated as the rate of convergence. In traditional ILC, the desired data is stored in a tracking profile file. Due to the huge size of the data file containing the target points, it is important to reduce the computational cost. Finally, simulation results of the presented technique are mentioned and compared to other related works to confirm the effectiveness of proposed scheme.

Punching Motion Generation using Reinforcement Learning and Trajectory Search Method (경로 탐색 기법과 강화학습을 사용한 주먹 지르기동작 생성 기법)

  • Park, Hyun-Jun;Choi, WeDong;Jang, Seung-Ho;Hong, Jeong-Mo
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.8
    • /
    • pp.969-981
    • /
    • 2018
  • Recent advances in machine learning approaches such as deep neural network and reinforcement learning offer significant performance improvements in generating detailed and varied motions in physically simulated virtual environments. The optimization methods are highly attractive because it allows for less understanding of underlying physics or mechanisms even for high-dimensional subtle control problems. In this paper, we propose an efficient learning method for stochastic policy represented as deep neural networks so that agent can generate various energetic motions adaptively to the changes of tasks and states without losing interactivity and robustness. This strategy could be realized by our novel trajectory search method motivated by the trust region policy optimization method. Our value-based trajectory smoothing technique finds stably learnable trajectories without consulting neural network responses directly. This policy is set as a trust region of the artificial neural network, so that it can learn the desired motion quickly.

A Study on the Development of Robust control Algorithm for Stable Robot Locomotion (안정된 로봇걸음걸이를 위한 견실한 제어알고리즘 개발에 관한 연구)

  • Hwang, Won-Jun;Yoon, Dae-Sik;Koo, Young-Mok
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.18 no.4
    • /
    • pp.259-266
    • /
    • 2015
  • This study presents new scheme for various walking pattern of biped robot under the limitted enviroments. We show that the neural network is significantly more attractive intelligent controller design than previous traditional forms of control systems. A multilayer backpropagation neural network identification is simulated to obtain a learning control solution of biped robot. Once the neural network has learned, the other neural network control is designed for various trajectory tracking control with same learning-base. The main advantage of our scheme is that we do not require any knowledge about the system dynamic and nonlinear characteristic, and can therefore treat the robot as a black box. It is also shown that the neural network is a powerful control theory for various trajectory tracking control of biped robot with same learning-vase. That is, we do net change the control parameter for various trajectory tracking control. Simulation and experimental result show that the neural network is practically feasible and realizable for iterative learning control of biped robot.

Local Path Generation Method for Unmanned Autonomous Vehicles Using Reinforcement Learning (강화학습을 이용한 무인 자율주행 차량의 지역경로 생성 기법)

  • Kim, Moon Jong;Choi, Ki Chang;Oh, Byong Hwa;Yang, Ji Hoon
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.9
    • /
    • pp.369-374
    • /
    • 2014
  • Path generation methods are required for safe and efficient driving in unmanned autonomous vehicles. There are two kinds of paths: global and local. A global path consists of all the way points including the source and the destination. A local path is the trajectory that a vehicle needs to follow from a way point to the next in the global path. In this paper, we propose a novel method for local path generation through machine learning, with an effective curve function used for initializing the trajectory. First, reinforcement learning is applied to a set of candidate paths to produce the best trajectory with maximal reward. Then the optimal steering angle with respect to the trajectory is determined by training an artificial neural network. Our method outperformed existing approaches and successfully found quality paths in various experimental settings, including the cases with obstacles.

Analysis of Market Trajectory Data using k-NN

  • Park, So-Hyun;Ihm, Sun-Young;Park, Young-Ho
    • Journal of Multimedia Information System
    • /
    • v.5 no.3
    • /
    • pp.195-200
    • /
    • 2018
  • Recently, as the sensor and big data analysis technology have been developed, there have been a lot of researches that analyze the purchase-related data such as the trajectory information and the stay time. Such purchase-related data is usefully used for the purchase pattern prediction and the purchase time prediction. Because it is difficult to find periodic patterns in large-scale human data, it is necessary to look at actual data sets, find various feature patterns, and then apply a machine learning algorithm appropriate to the pattern and purpose. Although existing papers have been used to analyze data using various machine learning methods, there is a lack of statistical analysis such as finding feature patterns before applying the machine learning algorithm. Therefore, we analyze the purchasing data of Songjeong Maeil Market, which is a data gathering place, and finds some characteristic patterns through statistical data analysis. Based on the results of 1, we derive meaningful conclusions by applying the machine learning algorithm and present future research directions. Through the data analysis, it was confirmed that the number of visits was different according to the regional characteristics around Songjeong Maeil Market, and the distribution of time spent by consumers could be grasped.

A study on the optimal tracking problems with predefined data by using iterative learning control

  • Le, Dang-Khanh;Le, Dang-Phuong;Nam, Taek-Kun
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.38 no.10
    • /
    • pp.1303-1309
    • /
    • 2014
  • In this paper, we present an iterative learning control (ILC) framework for tracking problems with predefined data points that are desired points at certain time instants. To design ILC systems for such problems, a new ILC scheme is proposed to produce output curves that pass close to the desired points. Unlike traditional ILC approaches, an algorithm will be developed in which the control signals are generated by solving an optimal ILC problem with respect to the desired sampling points. In another word, it is a direct approach for the multiple points tracking ILC control problem where we do not need to divide the tracking problem into two steps separately as trajectory planning and ILC controller.The strength of the proposed formulation is the methodology to obtain a control signal through learning law only considering the given data points and dynamic system, instead of following the direction of tracking a prior identified trajectory. The key advantage of the proposed approach is to significantly reduce the computational cost. Finally, simulation results will be introduced to confirm the effectiveness of proposed scheme.