• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.042 seconds

Reinforcement Learning-Based Adaptive Traffic Signal Control considering Vehicles and Pedestrians in Intersection (차량과 보행자를 고려한 강화학습 기반 적응형 교차로 신호제어 연구)

  • Jong-Min Kim;Sun-Yong Kim
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.19 no.1
    • /
    • pp.143-148
    • /
    • 2024
  • Traffic congestion has caused issues in various forms such as the environment and economy. Recently, an intelligent transport system (ITS) using artificial intelligence (AI) has been focused so as to alleviate the traffic congestion problem. In this paper, we propose a reinforcement learning-based traffic signal control algorithm that can smooth the flow of traffic while reducing discomfort levels of drivers and pedestrians. By applying the proposed algorithm, it was confirmed that the discomfort levels of drivers and pedestrians can be significantly reduced compared to the existing fixed signal control system, and that the performance gap increases as the number of roads at the intersection increases.

Neuro-Fuzzy control of converging vehicles for automated transportation systems (뉴로퍼지를 이용한 자율운송시스템의 차량합류제어)

  • Ryu, Se-Hui;Park, Jang-Hyeon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.5 no.8
    • /
    • pp.907-913
    • /
    • 1999
  • For an automated transportation system like PRT(Personal Rapid Transit) system or IVHS, an efficient vehicle-merging algorithm is required for smooth operation of the network. For management of merging, collision avoidance between vehicles, ride comfort, and the effect on traffic should be considered. This paper proposes an unmanned vehicle-merging algorithm that consists of two procedures. First, a longitudinal control algorithm is designed to keep a safe headway between vehicles in a single lane. Secondly, 'vacant slot and ghost vehicle' concept is introduced and a decision algorithm is designed to determine the sequence of vehicles entering a converging section considering energy consumption, ride comfort, and total traffic flow. The sequencing algorithm is based on fuzzy rules and the membership functions are determined first by an intuitive method and then trained by a learning method using a neural network. The vehicle-merging algorithm is shown to be effective through simulations based on a PRT model.

  • PDF

A Robust Nonlinear Control Using the Neural Network Model on System Uncertainty (시스템의 불확실성에 대한 신경망 모델을 통한 강인한 비선형 제어)

  • 이수영;정명진
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.43 no.5
    • /
    • pp.838-847
    • /
    • 1994
  • Although there is an analytical proof of modeling capability of the neural network, the convergency error in nonlinearity modeling is inevitable, since the steepest descent based practical larning algorithms do not guarantee the convergency of modeling error. Therefore, it is difficult to apply the neural network to control system in critical environments under an on-line learning scheme. Although the convergency of modeling error of a neural network is not guatranteed in the practical learning algorithms, the convergency, or boundedness of tracking error of the control system can be achieved if a proper feedback control law is combined with the neural network model to solve the problem of modeling error. In this paper, the neural network is introduced for compensating a system uncertainty to control a nonlinear dynamic system. And for suppressing inevitable modeling error of the neural network, an iterative neural network learning control algorithm is proposed as a virtual on-line realization of the Adaptive Variable Structure Controller. The efficiency of the proposed control scheme is verified from computer simulation on dynamics control of a 2 link robot manipulator.

  • PDF

Development of Fuzzy-Neural Control Algorithm for the Motion Control of K1-Track Vehicle (K1-궤도차량의 운동제어를 위한 퍼지-뉴럴제어 알고리즘 개발)

  • 한성현
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1997.10a
    • /
    • pp.70-75
    • /
    • 1997
  • This paper proposes a new approach to the design of fuzzy-neuro control for track vehicle system using fuzzy logic based on neural network. The proposed control scheme uses a Gaussian function as a unit function in the neural network-fuzzy, and back propagation algorithm to train the fuzzy-neural network controller in the framework of the specialized learning architecture. It is proposed a learning controller consisting of two neural network-fuzzy based of independent reasoning and a connection net with fixed weights to simply the neural networks-fuzzy. The performance of the proposed controller is illustrated by simulation for trajectory tracking of track vehicle speed.

  • PDF

Optimum chemicals dosing control for water treatment (상수처리 수질제어를 위한 약품주입 자동연산)

  • 하대원;고택범;황희수;우광방
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1993.10a
    • /
    • pp.772-777
    • /
    • 1993
  • This paper presents a neuro-fuzzy modelling method that determines chemicals dosing model based on historical operation data for effective water quality control in water treatment system and calculates automatically the amount of optimum chemicals dosing against the changes of raw water qualities and flow rate. The structure identification in the modelling by means of neuro-fuzzy reasing is performed by Genetic Algorithm(GA) and Complex Method in which the numbers of hidden layer and its hidden nodes, learning rate and connection pattern between input layer and output layer are identified. The learning network is implemented utilizing Back Propagation(BP) algorithm. The effectiveness of the proposed modelling scheme and the feasibility of the acquired neuro-fuzzy network is evaluated through computer simulation for chemicals dosing control in water treatment system.

  • PDF

Adaptive control for robot manipulator through repeated learning (반복 학습을 통한 로보트 매니퓰레이터의 적응 제어)

  • Lee, Cheol;An, Duk-Hwan;Lee, sang-Hyo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10a
    • /
    • pp.269-274
    • /
    • 1990
  • Usually, robot manipulators in production lines are operated with reperting work trajectories. This paper presents the repeated adaptive learning algorithm for robot manipulates for the case of a trajectory. This algorithm uses the nonlinear dynamic model including the repeated friction compensating term, The advantage of the scheme is that It allows friction compensation which may be otherwise difficult for differently constructed models. A secondary advantage of the sheme is that it can also adapt to torque calculation in order to reduce the computational load of the control computer. To show the efficiency of the proposed controller, a computer simulation is performed for the planar robot manipulator with a 2 degree of freedom.

  • PDF

The Adaptive Congestion Control Using Neural Network in ATM network (ATM 망에서 뉴럴 네트워크를 이용한 적응 폭주제어)

  • Lee, Yong-Il;Kim, Yung-Kwon
    • Journal of IKEEE
    • /
    • v.2 no.1 s.2
    • /
    • pp.134-138
    • /
    • 1998
  • Because of the statistical fluctuations and the high 'time-variability' nature of the traffic, managing the resources of the network require highly dynamic techniques with minimal Intervention and reaction times, and adaptive and learning capabilities. The neural networks normalizes the ATM cell arrival rate and queue length and has the adaptive learning algorithm, and experimentally investigated the method to prevent the congestion generated in ATM networks.

  • PDF

Power Quality Disturbances Identification Method Based on Novel Hybrid Kernel Function

  • Zhao, Liquan;Gai, Meijiao
    • Journal of Information Processing Systems
    • /
    • v.15 no.2
    • /
    • pp.422-432
    • /
    • 2019
  • A hybrid kernel function of support vector machine is proposed to improve the classification performance of power quality disturbances. The kernel function mathematical model of support vector machine directly affects the classification performance. Different types of kernel functions have different generalization ability and learning ability. The single kernel function cannot have better ability both in learning and generalization. To overcome this problem, we propose a hybrid kernel function that is composed of two single kernel functions to improve both the ability in generation and learning. In simulations, we respectively used the single and multiple power quality disturbances to test classification performance of support vector machine algorithm with the proposed hybrid kernel function. Compared with other support vector machine algorithms, the improved support vector machine algorithm has better performance for the classification of power quality signals with single and multiple disturbances.

The dynamics of self-organizing feature map with constant learning rate and binary reinforcement function (시불변 학습계수와 이진 강화 함수를 가진 자기 조직화 형상지도 신경회로망의 동적특성)

  • Seok, Jin-Uk;Jo, Seong-Won
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.2 no.2
    • /
    • pp.108-114
    • /
    • 1996
  • We present proofs of the stability and convergence of Self-organizing feature map (SOFM) neural network with time-invarient learning rate and binary reinforcement function. One of the major problems in Self-organizing feature map neural network concerns with learning rate-"Kalman Filter" gain in stochsatic control field which is monotone decreasing function and converges to 0 for satisfying minimum variance property. In this paper, we show that the stability and convergence of Self-organizing feature map neural network with time-invariant learning rate. The analysis of the proposed algorithm shows that the stability and convergence is guranteed with exponentially stable and weak convergence properties as well.s as well.

  • PDF

A Fast off-line Learning Control Approach to Rejection of Periodic Disturbances (주기적인 외란 제거에 있어서 빠른 오프라인 학습 제어 접근 방식)

  • Ha, In-Joong;Jang, Jung-Kook;Park, Jin-Won;Kwon, Jung-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 2007.04a
    • /
    • pp.107-109
    • /
    • 2007
  • The recently-developed off-line learning control approaches for the rejection of periodic disturbances utilize the specific property that the learning system tends to oscillate in steady state. Unfortunately, the prior works have not clarified how closely the learning system should approach the steady state to achieve the rejection of periodic disturbances to satisfactory level. In this paper, we address this issue extensively for the class of linear systems. We also attempt to remove the effect of other aperiodic disturbances on the rejection of the periodic disturbances effectively. In fact, the proposed learning control algorithm can provide very fast convergence performance in the presence of aperiodic disturbance. The effectiveness and practicality of our work is demonstrated through mathematical, performance analysis as well as various simulation results.

  • PDF