• 제목/요약/키워드: multi-agent control

검색결과 191건 처리시간 0.037초

Compact AUV platform system designed for the experiment of underwater multi-agent development

  • Watanabe, Keisuke
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2005년도 ICCAS
    • /
    • pp.2036-2041
    • /
    • 2005
  • The underwater multi-agent technology has many potential for the various activities related to ocean development/conservation in the near future. For example, in such fields as water pollution investigation, aquaculture control, or coral reef research, we feel a growing need for a system that realizes underwater continuous monitoring in the wide rang e. In this case, the target monitoring area will be sliced planar hierarchically toward the depth as monitoring layers, and many AUVs arranged on each layer track the given trajectory and gather various environmental information continuously, with communicating each other in the layer or with other layers. To realize those systems we need to develop AUV multi-agent technologies. So we are now building basic systems for basin experiment for the development of AUV multi-agent behavior. We must experience many situations and problems to be solved for the development of its elemental technologies by using real systems as well as our computer simulations. In this paper we introduce our concept of the experiment in the near future and the hardware/software design of our two types of handy AUVs and ultrasound ranging/communication system for that experiment. One AUV is designed using a 17inches-diameter glass sphere with DOS/V and RT-Linux based subsystems, which is intended to use not only in the basin but also in the calm real sea. The other AUV is designed for the basin experiment using a 7inches-diameter acrylic sphere with low-cost embedded system with SH-2 based subsystems. The basin experiment to verify the basic AUV facilities and ultrasound ranging for position detection was carried out.

  • PDF

Avoidance Behavior of Small Mobile Robots based on the Successive Q-Learning

  • Kim, Min-Soo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2001년도 ICCAS
    • /
    • pp.164.1-164
    • /
    • 2001
  • Q-learning is a recent reinforcement learning algorithm that does not need a modeling of environment and it is a suitable approach to learn behaviors for autonomous agents. But when it is applied to multi-agent learning with many I/O states, it is usually too complex and slow. To overcome this problem in the multi-agent learning system, we propose the successive Q-learning algorithm. Successive Q-learning algorithm divides state-action pairs, which agents can have, into several Q-functions, so it can reduce complexity and calculation amounts. This algorithm is suitable for multi-agent learning in a dynamically changing environment. The proposed successive Q-learning algorithm is applied to the prey-predator problem with the one-prey and two-predators, and its effectiveness is verified from the efficient avoidance ability of the prey agent.

  • PDF

Observer-based Distributed Consensus Algorithm for Multi-agent Systems with Output Saturations

  • Lim, Young-Hun;Lee, Gwang-Seok
    • Journal of information and communication convergence engineering
    • /
    • 제17권3호
    • /
    • pp.167-173
    • /
    • 2019
  • This study investigates the problem of leader-following consensus for multi-agent systems with output saturations. This study assumes that the agents are described as a neutrally stable system, and the leader agent generates the bounded trajectory within the saturation level. Then, the objective of the leader-following consensus is to track the trajectory of the leader by exchanging information with neighbors. To solve this problem, we propose an observer-based distributed consensus algorithm. Then, we provide a consensus analysis by applying the Lyapunov stability theorem and LaSalle's invariance principle. The result shows that the agents achieve the leader-following consensus in a global sense. Moreover, we can achieve the consensus by choosing any positive control gain. Finally, we perform a numerical simulation to demonstrate the validity of the proposed algorithm.

Application of Multi-agent Reinforcement Learning to CELSS Material Circulation Control

  • Hirosaki, Tomofumi;Yamauchi, Nao;Yoshida, Hiroaki;Ishikawa, Yoshio;Miyajima, Hiroyuki
    • 한국지능정보시스템학회:학술대회논문집
    • /
    • 한국지능정보시스템학회 2001년도 The Pacific Aisan Confrence On Intelligent Systems 2001
    • /
    • pp.145-150
    • /
    • 2001
  • A Controlled Ecological Life Support System(CELSS) is essential for man to live a long time in a closed space such as a lunar base or a mars base. Such a system may be an extremely complex system that has a lot of facilities and circulates multiple substances,. Therefore, it is very difficult task to control the whole CELSS. Thus by regarding facilities constituting the CELSS as agents and regarding the status and action as information, the whole CELSS can be treated as multi-agent system(MAS). If a CELSS can be regarded as MAS the CELSS can have three advantages with the MAS. First the MAS need not have a central computer. Second the expendability of the CELSS increases. Third, its fault tolerance rises. However it is difficult to describe the cooperation protocol among agents for MAS. Therefore in this study we propose to apply reinforcement learning (RL), because RL enables and agent to acquire a control rule automatically. To prove that MAS and RL are effective methods. we have created the system in Java, which easily gives a distributed environment that is the characteristics feature of an agent. In this paper, we report the simulation results for material circulation control of the CELSS by the MAS and RL.

  • PDF

Multi-agent System based on Blackboard System for Soccer Robot Implementation

  • Sanornoi, Nitiwat;Phurahong, Boonchana;Sooraksa, Pitikhate
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.2023-2028
    • /
    • 2004
  • This paper reveals the utilization of the multi-gent system that based on the Blackboard system basis as the controller of Soccer Robot. This system is a portion of developing the Soccer Robot team for Robocup 2004 Competition. In this development, the intelligent control system was initiated by the combination of parallel and distributed blackboard structures with the principle design that generated from human body structures, which consists of the combination of two main systems, the organs system and the brain system. The system is designed using the control system theory based on Blackboard basis. Modification of the initial structures to corroborate the Soccer Robot and the structure's constituents are clarified accordingly. To demonstrate the idea, ITE-old team is given as a case study.

  • PDF

불확실성을 포함한 다 개체 시스템의 상태 일치를 위한 이산 시간 출력 궤환 협조 제어 알고리즘 (Discrete-Time State Feedback Algorithm for State Consensus of Uncertain Homogeneous Multi-Agent Systems)

  • 윤문채;김정수;백주훈
    • 제어로봇시스템학회논문지
    • /
    • 제19권5호
    • /
    • pp.390-397
    • /
    • 2013
  • This paper presents a consensus algorithm for uMAS (uncertain Multi-Agent Systems). Unlike previous results in which only nominal models for agents are considered, it is assumed that the uncertain agent model belongs to a known polytope set. In the middle of deriving the proposed algorithm, a convex set is found which includes all uncertainties in the problem using convexity of the polytope set. This set plays an important role in designing the consensus algorithm for uMAS. Based on the set, a consensus condition for uMAS is proposed and the corresponding consensus design problem is solved using LMI (Linear Matrix Inequality). Simulation result shows that the proposed consensus algorithm successfully leads to consensus of the state of uMAS.

Intelligent Hybrid Modular Architecture for Multi Agent System

  • Lee, Dong-Hun;Baek, Seung-Min;Kuc, Tae-Yong;Chung, Chae-Wook
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.896-902
    • /
    • 2004
  • The purpose of the study of multi-robot system is to realize multi-robot system easy for the control of robot system in case robot is adapted in the complicated environment of task structure. The purpose of the study of multi-robot system is to realize multi-robot system easy for the control of robot system in case robot is adapted in the complicated environment of task structure. To make real time control possible by making effective use of recognized information in this dynamic environment, suitable distribution of tasks should be made in consideration of function and role of each performing robots. In this paper, IHMA (Intelligent Hybrid Modular Architecture) of Intelligent combined control architecture which utilizes the merits of deliberative and reactive controllers will be suggested and its efficiency will be evaluated through the adaptation of control architecture to representative multi-robot system.

  • PDF

다개체 협력 시스템을 위한 비젼 기반 축구 로봇 시스템의 개발 (Development of vision-based soccer robots for multi-agent cooperative systems)

  • 심현식;정명진;최인환;김종환
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1997년도 한국자동제어학술회의논문집; 한국전력공사 서울연수원; 17-18 Oct. 1997
    • /
    • pp.608-611
    • /
    • 1997
  • The soccer robot system consists of multi agents, with highly coordinated operation and movements so as to fulfill specific objectives, even under adverse situation. The coordination of the multi-agents is associated with a lot of supplementary work in advance. The associated issues are the position correction, prevention of communication congestion, local information sensing in addition to the need for imitating the human-like decision making. A control structure for soccer robot is designed and several behaviors and actions for a soccer robot are proposed. Variable zone defense as a basic strategy and several special strategies for fouls are applied to SOTY2 team.

  • PDF

시스템의 성능 향상을 위해 마할라노비스 거리와 자유도를 이용하여 변형시킨 쿠커-스메일 모델 (Transformed Augmented Cucker-Smale Model with Mahalanobis Distance and Statistical Degrees of Freedom for Improving Efficiency of Flocking Flight System)

  • 정재휘
    • 한국항공우주학회지
    • /
    • 제48권8호
    • /
    • pp.573-580
    • /
    • 2020
  • 다중개체를 제어하기 위해서 해결해야 되는 문제들 중 하나는 위치제어다. 위치와 속도를 제어하기 위한 모델로 augmented Cucker-Smale 모델이 존재했다. 하지만 기존 모델은 모든 개체에 동일한 시스템을 적용함에 따라서 개별개체의 특성을 살리지 못했다는 특징이 있다. 본 논문에서는 그 점을 보안하고 적절한 형태로 변형하기 위해서 초기 위치와 분포를 이용한 마할라노비스 거리를 계수와 통계학적 자유도를 적용해서, 모델의 수렴시간과 소모에너지를 동시에 줄이고자 한다. 모델의 성능 검증을 위해서 몬테카를로 시뮬레이션을 통해서 전체적인 경향성을 판단했고, 추가적으로 개별 개체의 움직임을 분석하여서 마할라노비스 거리 계수가 적절한 역할을 수행하고 있는지 확인했다.

Development of a Mobile Robot for Handicapped People

  • Shin, Ig-Awa;Kim, Hyoung-Seop;Ishikawa, Seiji
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2001년도 ICCAS
    • /
    • pp.25.2-25
    • /
    • 2001
  • This paper describes a mobile robot intended for being employed in a multi-agent system. We have already proposed a multi-agent system which realizes patient-aid by helping a lying patient take a distant object on the table. In this paper, a mobile robot agent is developed and is included in the system. An effective man-machine communication strategy is proposed by use of a vision agent settled on the ceiling. If a human (assumed to be a patient) wishes to take an object distant on the floor, he points to the object. The vision agent detects the direction of his arm by image processing and guesses which object he intends to take. The vision agent asks him if it is what he wants and, if yes, the mobile robot runs to take and bring it to him. The system is overviewed with the explanation of a mobile robot. Some experimental results are shown with discussion.

  • PDF