• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.031 seconds

Evolutionary designing neural networks structures using genetic algorithm

  • Itou, Minoru;Sugisaka, Masanori
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.43.2-43
    • /
    • 2001
  • In this paper, we consider the problems of the evolutionary designed neural networks structures by genetic algorithm. Neural networks has been applied to various application fields since back-propagation algorithm was proposed, e.g. function approximation, pattern or character recognition and so on. However, one of difficulties to use the neural networks. It is how to design the structure of the neural network. Researchers and users design networks structures and training parameters such as learning rate and momentum rate and so on, by trial and error based on their experiences. In the case of designing large scales neural networks, it is very hard work for manually design by try and error. For this difficulty, various structural learning algorithms have been proposed. Especially, the technique of using genetic algorithm for networks structures design has been ...

  • PDF

Study of the Operation of Actuated signal control Based on Vehicle Queue Length estimated by Deep Learning (딥러닝으로 추정한 차량대기길이 기반의 감응신호 연구)

  • Lee, Yong-Ju;Sim, Min-Gyeong;Kim, Yong-Man;Lee, Sang-Su;Lee, Cheol-Gi
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.17 no.4
    • /
    • pp.54-62
    • /
    • 2018
  • As a part of realization of artificial intelligence signal(AI Signal), this study proposed an actuated signal algorithm based on vehicle queue length that estimates in real time by deep learning. In order to implement the algorithm, we built an API(COM Interface) to control the micro traffic simulator Vissim in the tensorflow that implements the deep learning model. In Vissim, when the link travel time and the traffic volume collected by signal cycle are transferred to the tensorflow, the vehicle queue length is estimated by the deep learning model. The signal time is calculated based on the vehicle queue length, and the simulation is performed by adjusting the signaling inside Vissim. The algorithm developed in this study is analyzed that the vehicle delay is reduced by about 5% compared to the current TOD mode. It is applied to only one intersection in the network and its effect is limited. Future study is proposed to expand the space such as corridor control or network control using this algorithm.

Parallel Model Feature Extraction to Improve Performance of a BCI System (BCI 시스템의 성능 개선을 위한 병렬 모델 특징 추출)

  • Chum, Pharino;Park, Seung-Min;Sim, Kwee-Bo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.11
    • /
    • pp.1022-1028
    • /
    • 2013
  • It is well knowns that based on the CSP (Common Spatial Pattern) algorithm, the linear projection of an EEG (Electroencephalography) signal can be made to spaces that optimize the discriminant between two patterns. Sharing disadvantages from linear time invariant systems, CSP suffers from the non-stationary nature of EEGs causing the performance of the classification in a BCI (Brain-Computer Interface) system to drop significantly when comparing the training data and test data. The author has suggested a simple idea based on the parallel model of CSP filters to improve the performance of BCI systems. The model was tested with a simple CSP algorithm (without any elaborate regularizing methods) and a perceptron learning algorithm as a classifier to determine the improvement of the system. The simulation showed that the parallel model could improve classification performance by over 10% compared to conventional CSP methods.

Intelligent Control Algorithm for the Adjustment Process During Electronics Production (전자제품생산의 조정고정을 위한 지능형 제어알고리즘)

  • 장석호;구영모;고택범;우광방
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.4
    • /
    • pp.448-457
    • /
    • 1998
  • A neural network based control algorithm with fuzzy compensation is proposed for the automated adjustment in the production of electronic end-products. The process of adjustment is to tune the variable devices in order to examine the specified performances of the products ready prior to packing. Camcorder is considered as a target product. The required test and adjustment system is developed. The adjustment system consists of a NNC(neural network controller), a sub-NNC, and an auxiliary algorithm utilizing the fuzzy logic. The neural network is trained by means of errors between the outputs of the real system and the network, as well as on the errors between the changing rate of the outputs. Control algorithm is derived to speed up the learning dynamics and to avoid the local minima at higher energy level, and is able to converge to the global minimum at lower energy level. Many unexpected problems in the application of the real system are resolved by the auxiliary algorithms. As the adjustments of multiple items are related to each other, but the significant effect of performance by any specific item is not observed. The experimental result shows that the proposed method performs very effectively and are advantageous in simple architecture, extracting easily the training data without expertise, adapting to the unstable system that the input-output properties of each products are slightly different, with a wide application to other similar adjustment processes.

  • PDF

An Intelligent PID Controller based on Dynamic Bayesian Networks for Traffic Control of TCP (TCP의 트래픽 제어를 위한 동적 베이시안 네트워크 기반 지능형 PID 제어기)

  • Cho, Hyun-Choel;Lee, Young-Jin;Lee, Jin-Woo;Lee, Kwon-Soon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.4
    • /
    • pp.286-295
    • /
    • 2007
  • This paper presents an intelligent PID control for stochastic systems with nonstationary nature. We optimally determine parameters of a PID controller through learning algorithm and propose an online PID control to compensate system errors possibly occurred in realtime implementations. A dynamic Bayesian network (DBN) model for system errors is additionally explored for making decision about whether an online control is carried out or not in practice. We apply our control approach to traffic control of Transmission Control Protocol (TCP) networks and demonstrate its superior performance comparing to a fixed PID from computer simulations.

A Design and Implementation of Computer-based Test System (컴퓨터기반 시험 시스템 설계 및 구축)

  • Cho Sung-Ho
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.1
    • /
    • pp.1-8
    • /
    • 2005
  • E-learning is the application of e-business technology and services to teaching and learning. It use of new multimedia technologies and Internet to improved the qualify of learning by facilitating access to remote resources and services. In this paper, we show a computer-based test system, which is carefully designed and implemented. The system consists of a contents delivery mechanism, computer-adaptive test algorithm, and review engine. In this papepr, we describe what are points to be considered when design and implementing a computer-based test system. In addition, this paper shows how to control the bias value for computer-adaptive algorithm using real data.

  • PDF

Automatic Error Correction of Position Sensors for Servo Motors via Iterative Learning (반복학습기법을 이용한 서코모터용 위치센서오차의 자동 보정)

  • Han, Seok-Hee;Ha, Tae-Kyoon;Huh, Heon;Ha, In-Joong;Ko, Myoung-Sam
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.9
    • /
    • pp.57-66
    • /
    • 1994
  • In this paper, we present an iterative learning method of compensating for position sensor error. The previously known compensation algorithms need a special perfect position sensor or a priori information about error sources, while ours does not. to our best knowledge, any iterative learning approach has not been taken for sensor error compensation. Furthermore, our iterativelearning algorithm does not have the drawbacks of the existing interativelearning control theories. To be more specivic, our algorithm learns an uncertain function itself rather than its special time-trajectory and does not reuquest the derivatives of measurement signals. Moreover, it does not require the learning system to start with the same initial condition for all iterations. To illuminate the generality and practical use of our algorithm, we give the rigorous proof for its convergence and some experimental results.

  • PDF

A Knowledge Base Construction for Control Application (제어응용을 위한 지식베이스의 구축)

  • 김도성;이명호
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.39 no.7
    • /
    • pp.720-728
    • /
    • 1990
  • A learning control method is proposed in this paper, using a knowledge base which contains control rules, data, and patterns of the past experience of a plant. The knowledge for plant control is retrieved from measurement data during operation and continually modified after control performance evaluation. A control method is proposed using tinually modified after control performance evaluation. A control method is proposed using fuzzy model of the plant and a recursive statistic decision method of fuzzy subset for control rule generation. Also, the resulting knowledge-based control algorithm has been applied to aprocess and its performance improvement and proper generation of appropriate control rules have been verified.

  • PDF

A Routing Algorithm based on Deep Reinforcement Learning in SDN (SDN에서 심층강화학습 기반 라우팅 알고리즘)

  • Lee, Sung-Keun
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.6
    • /
    • pp.1153-1160
    • /
    • 2021
  • This paper proposes a routing algorithm that determines the optimal path using deep reinforcement learning in software-defined networks. The deep reinforcement learning model for learning is based on DQN, the inputs are the current network state, source, and destination nodes, and the output returns a list of routes from source to destination. The routing task is defined as a discrete control problem, and the quality of service parameters for routing consider delay, bandwidth, and loss rate. The routing agent classifies the appropriate service class according to the user's quality of service profile, and converts the service class that can be provided for each link from the current network state collected from the SDN. Based on this converted information, it learns to select a route that satisfies the required service level from the source to the destination. The simulation results indicated that if the proposed algorithm proceeds with a certain episode, the correct path is selected and the learning is successfully performed.

Unknown Nonlinear Systems Control Using Genetic Algorithms (Geneo-tic Algorithms를 이용한 비선형 시스템 제어)

  • Cho, Hyun-Seob
    • Proceedings of the KAIS Fall Conference
    • /
    • 2009.05a
    • /
    • pp.443-445
    • /
    • 2009
  • Dynamic Neural Unit"(DNU) based upon the topology of a reverberating circuit in a neuronal pool of the central nervous system. In this thesis, we present a genetic DNU-control scheme for unknown nonlinear systems. Our methodis different from those using supervised learning algorithms, such as the backpropagation (BP) algorithm, that needs training information in each step. The contributions of this thesis are the new approach to constructing neural network architecture and its trainin.

  • PDF