• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.031 seconds

Control of Intelligent Characters using Reinforcement Learning (강화학습을 이용한 지능형 게임캐릭터의 제어)

  • Shin, Yong-Woo
    • Journal of Internet Computing and Services
    • /
    • v.8 no.5
    • /
    • pp.91-97
    • /
    • 2007
  • Game program had been classed by 3D or on-line game etc, and engine and game programming simply, But, game programmer's kind more classified new, Artifical Intelligence game programmer's role is important. This paper makes game character study and moved by intelligence using reinforcement learning algorithm. Fought with character enemy using developed game, Confirmed whether embodied game character is facile by intelligence, As result of an experiment, we know, studied character defends excellently than randomly moved character.

  • PDF

Nonlinear System Control for DNP (동적 신경망에 의한 비선형 시스템 제어)

  • Roh, Yong-Gi;Ryu, In-Ho;Cho, Hyeon-Seob;Oh, Seong-Kwon;Jang, Seong-Whan
    • Proceedings of the KIEE Conference
    • /
    • 1999.07b
    • /
    • pp.890-893
    • /
    • 1999
  • The intent of this paper is to describe a neural network structure called dynamic neural processor(DNP), and examine how it can be used in developing a learning scheme for computing robot inverse kinematic transformations. The architecture and learning algorithm of the proposed dynamic neural network structure, the DNP, are described. Computer simulations are demonstrate the effectiveness of the Proposed learning using the DNP.

  • PDF

The study on the Algorithm for Desing of Fuzzy Logic Controller Using Neural Network (신경회로망을 이용한 퍼지제어기 설계 알고리즘에 관한 연구)

  • 채명기;이상배
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1996.10a
    • /
    • pp.243-248
    • /
    • 1996
  • In this paper, a general neural-network-based connectionist model, called Fuzzy Neural Network(FNN), is proposed for the realization of a fuzzy logic control system. The proposed FNN is a feedforward multi-layered network which integrates the basic elements and functions of a traditional fuzzy logic controller into a connectionist structure which has distributed learning abilities. Such FNN can be constructed from training examples by learning rule, and the connectionist structure can be trained to develop fuzzy logic rules and find optimal input/output membership functions. Computer simulation examples will be presented to illustrate the performance and applicability of the proposed FNN, and their associated learning algorithms.

  • PDF

Reinforcement Learning-based Duty Cycle Interval Control in Wireless Sensor Networks

  • Akter, Shathee;Yoon, Seokhoon
    • International journal of advanced smart convergence
    • /
    • v.7 no.4
    • /
    • pp.19-26
    • /
    • 2018
  • One of the distinct features of Wireless Sensor Networks (WSNs) is duty cycling mechanism, which is used to conserve energy and extend the network lifetime. Large duty cycle interval introduces lower energy consumption, meanwhile longer end-to-end (E2E) delay. In this paper, we introduce an energy consumption minimization problem for duty-cycled WSNs. We have applied Q-learning algorithm to obtain the maximum duty cycle interval which supports various delay requirements and given Delay Success ratio (DSR) i.e. the required probability of packets arriving at the sink before given delay bound. Our approach only requires sink to compute Q-leaning which makes it practical to implement. Nodes in the different group have the different duty cycle interval in our proposed method and nodes don't need to know the information of the neighboring node. Performance metrics show that our proposed scheme outperforms existing algorithms in terms of energy efficiency while assuring the required delay bound and DSR.

A Study on a Stochastic Nonlinear System Control Using Neural Networks (신경회로망을 사용한 비선형 확률시스템 제어에 관한 연구)

  • Seok, Jin-Wuk;Choi, Kyung-Sam;Cho, Seong-Won;Lee, Jong-Soo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.6 no.3
    • /
    • pp.263-272
    • /
    • 2000
  • In this paper we give some geometric condition for a stochastic nonlinear system and we propose a control method for a stochastic nonlinear system using neural networks. Since a competitive learning neural networks has been developed based on the stochastcic approximation method it is regarded as a stochastic recursive filter algorithm. In addition we provide a filtering and control condition for a stochastic nonlinear system called the perfect filtering condition in a viewpoint of stochastic geometry. The stochastic nonlinear system satisfying the perfect filtering condition is decoupled with a deterministic part and purely semi martingale part. Hence the above system can be controlled by conventional control laws and various intelligent control laws. Computer simulation shows that the stochastic nonlinear system satisfying the perfect filtering condition is controllable and the proposed neural controller is more efficient than the conventional LQG controller and the canonical LQ-Neural controller.

  • PDF

CFWC Scheme for Width Control using CCD Measurement System and Fuzzy PID Controller in Hot Strip Mills (CCD 폭 측정 시스템 및 퍼지 PID를 이용한 CFWC 제어기 설계)

  • Park, Cheol Jae
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.11
    • /
    • pp.991-997
    • /
    • 2013
  • In this paper, we propose a CFWC (CCD and fuzzy PID based width control) scheme to obtain the desired delivery width margin of a vertical rolling mill in hot strip process. A WMS(width measurement system) is composed of two line scan cameras, an edge detection algorithm, a glitch filter, and so on. A dynamic model of the mill is derived from a gauge meter equation in order to design the fuzzy PID controller. The controller is a self-learning structure to select the PID gains from the error and error rate of the width margin. The effectiveness of the proposed CFWC is verified from simulation results under a width disturbance of the entry in the mill. Using a field test, we show that the performance of the width control is improved by the proposed control scheme.

A Study on Track Record and Trajectory Control of Articulated Robot Based on Monitoring Simulator for Smart Factory

  • Kim, Hee-Jin;Dong, Guen-Han;Kim, Dong-Ho;Jang, Gi-Won;Han, Sung-Hyun
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.23 no.2_1
    • /
    • pp.149-161
    • /
    • 2020
  • We describe a new approach to implement of trajectory control and track record of articulated manipulator based on monitoring simulator for smart factory. The learning control algorithm was applied in implementation real-time control to provide enhanced motion control performance for robotic manipulators. The proposed control scheme is simple in structure, fast in computation, and suitable for real-time control. Moreover, this scheme does not require any accurate dynamic modeling, or values of manipulator parameters and payload. Performance of the proposed controller is illustrated by simulation and experimental results for robot manipulator consisting of six joints at the joint space and Cartesian space.by monitoring simulator.

Design and implementation of a high precision

  • Ahn, Hyun-Sik;Oh, Sang-Rok;Choy, Ick;Kim, Kwang-Bea;Ko, Myoung-Sam
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10b
    • /
    • pp.1415-1419
    • /
    • 1990
  • A novel type of a play-back servo system with high precision is designed using an iterative learning control method by employing the model algorithmic control concept together with an inverse model. A sufficient condition is also provided for the convergency. It is shown by simulation that the proposed control algorithm yields a good performance even in the presence of a periodic load disturbance and proved by experiments using microprocessor-based play-back servo system.

  • PDF

A Study on the Prediction of the Nonlinear Chaotic Time Series Using Genetic Algorithm based Fuzzy Neural Network (유전 알고리즘을 이용한 퍼지신경망의 시계열 예측에 관한 연구)

  • Park, In-Kyu
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.11 no.4
    • /
    • pp.91-97
    • /
    • 2011
  • In this paper we present an approach to the structure identification based on genetic algorithm and to the parameter identification by hybrid learning method in neuro-fuzzy-genetic hybrid system in order to predicate the Mackey-Glass Chaotic time series. In this scheme the basic idea consists of two steps. One is the construction of a fuzzy rule base for the partitioned input space via genetic algorithm, the other is the corresponding parameters of the fuzzy control rules adapted by the backpropagation algorithm. In an attempt to test the performance the proposed system, three patterns, x(t-3), x(t-6) and x(t-9), was prepared according to time interval. It was through lots of simulation proved that the initial small error of learning owed to the good structural identification via genetic algorithm. The performance was showed in Table 2.

Dynamic Neural Units and Genetic Algorithms With Applications to the Control of Unknown Nonlinear Systems (동적 신경망과 Geneo-tic Algorithms를 적용한 비선형 시스템의 제어)

  • Cho, Hyun-Seob;Min, Jin-Kyoung;Roh, Yong-Gi;Jung, Byung-Jo;Jang, Sung-Whan
    • Proceedings of the KIEE Conference
    • /
    • 2006.07d
    • /
    • pp.1943-1944
    • /
    • 2006
  • "Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin

  • PDF