• 제목/요약/키워드: Learning Control Algorithm

검색결과 948건 처리시간 0.033초

RLS기반 Natural Actor-Critic 알고리즘을 이용한 트레이딩 전략 (Trading Strategy Using RLS-Based Natural Actor-Critic algorithm)

  • 강대성;김종호;박주영;박경욱
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2005년도 추계학술대회 학술발표 논문집 제15권 제2호
    • /
    • pp.238-241
    • /
    • 2005
  • 최근 컴퓨터를 이용하여 효과적인 트레이드를 하려는 투자자들이 늘고 있다. 본 논문에서는 많은 인공지능 방법론 중에서 강화학습(reinforcement learning)을 이용하여 효과적으로 트레이딩하는 방법에 대해서 다루려한다. 특히 강화학습 중에서 natural policy gradient를 이용하여 actor의 파라미터를 업데이트하고, value function을 효과적으로 추정하기 위해 RLS(recursive least-squares) 기법으로 critic 부분을 업데이트하는 RLS 기반 natural actor-critic 알고리즘을 이용하여 트레이딩을 수행하는 전략에 대한 가능성을 살펴 보기로 한다.

  • PDF

PSD 및 역전파 알고리즘를 이용한 AMI 로봇의 제어 시스템 설계 (Design of AMI Robot Control System Using PSD and Back Propagation Algorithm)

  • 이재욱;서운학;김휘동;이희섭;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2002년도 춘계학술대회 논문집
    • /
    • pp.393-398
    • /
    • 2002
  • Neural networks are used in the framework of sensorbased tracking control of robot manipulators. They learn by practice movements the relationship between PSD (an analog Position Sensitive Detector) sensor readings for target positions and the joint commands to reach them. Using this configuration, the system can track or follow a moving or stationary object in real time. forthermore, an efficient neural network architecture has been developed for real time learning. This network uses multiple sets of simple backpropagation networks one of which is selected according to which division (corresponding to a cluster of the self-organizing feature map) in data space the current input data belongs to. This lends itself to a very training and processing implementation required for real time control.

  • PDF

오차 자기순환 신경회로망 기반 반능동 현가시스템 제어기 개발 (The development of semi-active suspension controller based on error self recurrent neural networks)

  • 이창구;송광현
    • 제어로봇시스템학회논문지
    • /
    • 제5권8호
    • /
    • pp.932-940
    • /
    • 1999
  • In this paper, a new neural networks and neural network based sliding mode controller are proposed. The new neural networks are an mor self-recurrent neural networks which use a recursive least squares method for the fast on-line leammg. The error self-recurrent neural networks converge considerably last than the back-prollagation algorithm and have advantage oi bemg less affected by the poor initial weights and learning rate. The controller for suspension system is designed according to sliding mode technique based on new proposed neural networks. In order to adapt shding mode control mnethod, each frame dstance hetween ground and vehcle body is estimated md controller is designed according to estimated neural model. The neural networks based sliding mode controller approves good peiformance throllgh computer sirnulations.

  • PDF

신경회로망 알고리즘을 이용한 유도전동기 속도제어어 관한 연구 (Study on Induction Motor Speed Control using Neural Network algorithm)

  • 이훈구;오봉환;이승환;전기영
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2003년도 학술대회 논문집 전문대학교육위원
    • /
    • pp.49-51
    • /
    • 2003
  • This paper presents a speed control system of induction motor using neural network. The speed control of induction motor was designed to NNC(Neural Network Controller) and NNE(Neural Network Estimator) used backpropagation, the NNE was constituted to be get an error value of output of an induction motor and conspire an input/output. NNC is controled to be made the error of reference speed and actual speed decrease, and in order to determine the weighting of NNC can be back propagated through the NNE, and it is adapted to the outside circumstances and system characters with learning ability.

  • PDF

A Study on the Development of Robust Fault Diagnostic System Based on Neuro-Fuzzy Scheme

  • Kim, Sung-Ho;Lee, S-Sang-Yoon
    • Transactions on Control, Automation and Systems Engineering
    • /
    • 제1권1호
    • /
    • pp.54-61
    • /
    • 1999
  • FCM(Fuzzy Cognitive Map) is proposed for representing causal reasoning. Its structure allows systematic causal reasoning through a forward inference. By using the FCM, authors have proposed FCM-based fault diagnostic algorithm. However, it can offer multiple interpretations for a single fault. In process engineering, as experience accumulated, some form of quantitative process knowledge is available. If this information can be integrated into the FCM-based fault diagnosis, the diagnostic resolution can be further improved. The purpose of this paper is to propose an enhanced FCM-based fault diagnostic scheme. Firstly, the membership function of fuzzy set theory is used to integrate quantitative knowledge into the FCM-based diagnostic scheme. Secondly, modified TAM recall procedure is proposed. Considering that the integration of quantitative knowledge into FCM-based diagnosis requires a great deal of engineering efforts, thirdly, an automated procedure for fusing the quantitative knowledge into FCM-based diagnosis is proposed by utilizing self-learning feature of neural network. Finally, the proposed diagnostic scheme has been tested by simulation on the two-tank system.

  • PDF

PSD 및 역전파 알고리즘를 이용한 AM1 로봇의 제어 시스템 설계 (Design of AM1 Robot Control System Using PSD and Back Propagation Algorithm)

  • 이재욱;서운학;이종붕;이희섭;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2001년도 춘계학술대회 논문집(한국공작기계학회)
    • /
    • pp.239-243
    • /
    • 2001
  • Neural networks are used in the framework of sensorbased tracking control of robot manipulators. They learn by practice movements the relationship between PSD (an analog Position Sensitive Detector) sensor readings for target positions and the joint commands to reach them. Using this configuration, the system can track or follow a moving or stationary object in real time. Furthermore, an efficient neural network architecture has been developed for real time learning. This network uses multiple sets of simple backpropagation networks one of which is selected according to which division (corresponding to a cluster of the self-organizing feature map) in data space the current input data belongs to. This lends itself to a very training and processing implementation required for real time control.

  • PDF

이동로봇의 자율주행을 위한 실시간 퍼지신경망 제어 (Real-Time Fuzzy Neural Network Control for Real-Time Autonomous Cruise of Mobile Robot)

  • 정동연;김종수;한성현
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2003년도 춘계학술대회 논문집
    • /
    • pp.312-318
    • /
    • 2003
  • We propose a new technique for the cruise control system design of a mobile robot with three drive wheel. The proposed control scheme uses a Gaussian function as a unit function in the fuzzy neural network and back propagation algorithm to train the fuzzy neural network controller in the framework of the specialized teaming architecture. It is proposed a learning controller consisting of too neural network-fuzzy based on independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is shown by performing the computer simulation for trajectory tracking of the speed and azimuth of a mobile robot driven by three independent wheels.

  • PDF

신경 회로망을 이용한 최적 가변구조 제어기의 설계에 관한 연구 (A Study on the Design of Optimal Variable Structure Controller using Multilayer Neural Inverse Identifier)

  • 이민호;최병재;이수영;박철훈;김병국
    • 전자공학회논문지B
    • /
    • 제32B권12호
    • /
    • pp.1670-1679
    • /
    • 1995
  • In this paper, an optimal variable structure controller with a multilayer neural inverse identifier is proposed. A multilayer neural network with error back propagation learning algorithm is used for construction the neural inverse identifier which is an observer of the external disturbances and the parameter variations of the system. The variable structure controller with the multilayer neural inverse identifier not only needs a small part of a priori knowledge of the bounds of external disturbances and parameter variations but also alleviates the chattering magnitude of the control input. Also, an optimal sliding line is designed by the optimal linear regulator technique and an integrator is introduced for solving the reaching phase problem. Computer simulation results show that the proposed approach gives the effective control results by reducing the chattering magnitude of control input.

  • PDF

역전파 알고리즘 및 PSD를 이용한 로봇의 결실제어 (Robust control of industrial robot using back propagation algorithm and PSD)

  • 이재욱
    • 한국공작기계학회:학술대회논문집
    • /
    • 한국공작기계학회 2000년도 춘계학술대회논문집 - 한국공작기계학회
    • /
    • pp.171-175
    • /
    • 2000
  • Neural networks are in the framework of sensorbased tracking control of robot manipulators. They learn by practice movements the relationship between PSD (an analog Position Sensitive Detector) sensor readings for target positions and the joint commands to reach them. Using this configuration, the system can track or follow a moving or stationary object in real time. Furthermore, an efficient neural network architecture has been developed for real time learning. This network uses multiple sets of simple backpropagation networks one of which is selected according to which division (corresponding to a cluster of the self-organizing feature map) in data space the current input data belongs to. This lends itself to a very training and processing implementation required for real time control.

  • PDF

뉴로-퍼지 제어기를 이용한 유압서보시스뎀의 추적제어 (A Tracking Control of the Hydraulic Servo System Using the Neuro-Fuzzy Controller)

  • 박근석;임준영;강이석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2000년도 제15차 학술회의논문집
    • /
    • pp.228-228
    • /
    • 2000
  • To deal with non-linearities and time-varying characteristics of hydraulic systems, in this paper, the neuro-fuzzy controller has been introduced. This controller does not require an accurate mathematical model for the nonlinear factor. In order to solve general fuzzy inference problems, the input membership function and fuzzy reasoning rules are used for determining the controller Parameters. These parameters are determined by using the learning algorithm. The control performance of the neuro-fuzzy controller is obtained through a series of experiments for the various types of input while applying disturbances to the cylinder. .and performance of this controller was compared with that of PID, PD controller. As a experimental result, it can be proven that the position tracking performance of the neuro-fuzzy is better than that of PID and PD controller.

  • PDF