• Title/Summary/Keyword: Cooperative Multi-agents

Search Result 32, Processing Time 0.025 seconds

Self-Organization for Multi-Agent Groups

  • Kim, Dong-Hun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.3
    • /
    • pp.333-342
    • /
    • 2004
  • This paper presents a framework for the self-organization of swarm systems based on coupled nonlinear oscillators (CNOs). In this scheme, multiple agents in a swarm self-organize to flock and arrange themselves as a group using CNOs, which are able to keep a certain distance by the attractive and repulsive forces among different agents. A theoretical approach of flocking behavior by CNOs and a design guideline of CNO parameters are proposed. Finally, the formation scenario for cooperative multi-agent groups is investigated to demonstrate group behaviors such as aggregation, migration, homing and so on. The task for each group in this scenario is to perform a series of processes such as gathering into a whole group or splitting into two groups, and then to return to the base while avoiding collision with agents in different groups and maintaining the formation of each group.

A Swarm System Design Based on Coupled Nonlinear Oscillators for Cooperative Behavior

  • Kim, Dong-Hun
    • International Journal of Control, Automation, and Systems
    • /
    • v.1 no.3
    • /
    • pp.301-307
    • /
    • 2003
  • A control system design based on coupled nonlinear oscillators (CNOs) for a self- organized swarm system is presented. In this scheme, agents self-organize to flock and arrange group formations through attractive and repulsive forces among themselves using CNOs. Virtual agents are also used to create richer group formation patterns. The objective of the swarm control in this paper is to follow a moving target with a final group formation in the shortest possible time despite some obstacles. The simulation results have shown that the proposed scheme can effectively construct a self-organized multi-agent swarm system capable of group formation and group immigration despite the emergence of obstacles.

Research of Foresight Knowledge by CMAC based Q-learning in Inhomogeneous Multi-Agent System

  • Hoshino, Yukinobu;Sakakura, Akira;Kamei, Katsuari
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.280-283
    • /
    • 2003
  • A purpose of our research is an acquisition of cooperative behaviors in inhomogeneous multi-agent system. In this research, we used the fire panic problem as an experiment environment. In Fire panic problem a fire exists in the environment, and follows in each steps of agent's behavior, and this fire spreads within the constant law. The purpose of the agent is to reach the goal established without touching the fire, which exists in the environment. The fire heat up by a few steps, which exists in the environment. The fire has unsureness to the agent. The agent has to avoid a fire, which is spreading in environment. The acquisition of the behavior to reach it to the goal is required. In this paper, we observe how agents escape from the fire cooperating with other agents. For this problem, we propose a unique CMAC based Q-learning system for inhomogeneous multi-agent system.

  • PDF

An Automatic Cooperative coordination Model for the Multiagent System using Reinforcement Learning (강화학습을 이용한 멀티 에이전트 시스템의 자동 협력 조정 모델)

  • 정보윤;윤소정;오경환
    • Korean Journal of Cognitive Science
    • /
    • v.10 no.1
    • /
    • pp.1-11
    • /
    • 1999
  • Agent-based systems technology has generated lots of excitement in these years because of its promise as a new paradigm for conceptualizing. designing. and l implementing software systems Especially, there has been many researches for multi agent system because of the characteristics that it fits to the distributed and open Internet environments. In a multiagent system. agents must cooperate with each other through a Coordination procedure. when the conflicts between agents arise. where those are caused b by the point that each action acts for a purpose separately without coordination. But P previous researches for coordination methods in multi agent system have a deficiency that they can not solve correctly the cooperation problem between agents which have different goals in dynamic environment. In this paper. we solve the cooperation problem of multiagent that has multiple goals in a dynamic environment. with an automatic cooperative coordination model using I reinforcement learning. We will show the two pursuit problems that we extend a traditional problem in multi agent systems area for modeling the restriction in the multiple goals in a dynamic environment. and we have verified the validity of the proposed model with an experiment.

  • PDF

Self-organization of Swarm Systems by Association

  • Kim, Dong-Hun
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.2
    • /
    • pp.253-262
    • /
    • 2008
  • This paper presents a framework for decentralized control of self-organizing swarm systems based on the artificial potential functions (APFs). The framework explores the benefits by associating agents based on position information to realize complex swarming behaviors. A key development is the introduction of a set of association rules by APFs that effectively deal with a host of swarming issues such as flexible and agile formation. In this scheme, multiple agents in a swarm self-organize to flock and achieve formation control through attractive and repulsive forces among themselves using APFs. In particular, this paper presents an association rule for swarming that requires less movement for each agent and compact formation among agents. Extensive simulations are presented to illustrate the viability of the proposed framework.

Evolutionary Design of a Fuzzy Logic Controller for Multi-Agent Systems

  • Jeong, Il-Kwon;Lee, Ju-Jang
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1998.10a
    • /
    • pp.507-512
    • /
    • 1998
  • It is an interesting area in the field of artificial intelligence to and an analytic model of cooperative structure for multi-agent system accomplishing a given task. Usually it is difficult to design controllers for multi-agent systems without a comprehensive knowledge about the system. One of the way to overcome this limitation is to implement an evolutionary approach to design the controllers. This paper introduces the use of a genetic algorithm to discover a fuzzy logic controller with rules that govern emergent co-operative behavior: A modified genetic algorithm was applied to automating the discovery of a fuzzy logic controller jot multi-agents playing a pursuit game. Simulation results indicate that, given the complexity of the problem, an evolutionary approach to and the fuzzy logic controller seems to be promising.

  • PDF

Generating Cooperative Behavior by Multi-Agent Profit Sharing on the Soccer Game

  • Miyazaki, Kazuteru;Terada, Takashi;Kobayashi, Hiroaki
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.166-169
    • /
    • 2003
  • Reinforcement learning if a kind of machine learning. It aims to adapt an agent to a given environment with a clue to a reward and a penalty. Q-learning [8] that is a representative reinforcement learning system treats a reward and a penalty at the same time. There is a problem how to decide an appropriate reward and penalty values. We know the Penalty Avoiding Rational Policy Making algorithm (PARP) [4] and the Penalty Avoiding Profit Sharing (PAPS) [2] as reinforcement learning systems to treat a reward and a penalty independently. though PAPS is a descendant algorithm of PARP, both PARP and PAPS tend to learn a local optimal policy. To overcome it, ion this paper, we propose the Multi Best method (MB) that is PAPS with the multi-start method[5]. MB selects the best policy in several policies that are learned by PAPS agents. By applying PS, PAPS and MB to a soccer game environment based on the SoccerBots[9], we show that MB is the best solution for the soccer game environment.

  • PDF

Evoluationary Design of a Fuzzy Logic Controller For Multi-Agent Robotic Systems

  • Jeong, ll-Kwon1;Lee, Ju-Jang
    • Transactions on Control, Automation and Systems Engineering
    • /
    • v.1 no.2
    • /
    • pp.147-152
    • /
    • 1999
  • It is an interesting area in the field of artifical intelligence to find an analytic model of cooperative structure for multiagent system accomplishing a given task. Usually it is difficult to design controllers for multi-agent systems without a comprehensive knowledge about the system. One of the way to overcome this limitation is to implement an evolutionary approach to design the controllers. This paper introduces the use of a genetic algorithm to discover a fuzzy logic controller with rules that govern emergent agents solving a pursuit problem in a continuous world. Simulation results indicate that, given the complexity of the problem, an evolutionary approach to find the fuzzy logic controller seems to be promising.

  • PDF

A Self-Organizing Scheme for Swarm Systems

  • Kim, Dong-Hun;Kim, Hong-Pil
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2475-2480
    • /
    • 2003
  • A control system design based on coupled nonlinear oscillators (CNOs) for a self-organized swarm system is presented. In this scheme, agents self-organize to flock and arrange group formations through attractive and repulsive forces among themselves using CNOs. Virtual agents are also used to create richer group formation patterns. The objective of the swarm control in this paper is to follow a moving target with a final group formation in the shortest possible time despite some obstacles. The simulation results have shown that the proposed scheme can effectively construct a self-organized multi-agent swarm system capable of group formation and group immigration despite the emergence of obstacles.

  • PDF

The Effects of Cooperativeness and Information Redundancy on Team Performance : A Simulation Study (협동성과 정보 여분의 팀 성과에 대한 효과 : 시뮬레이션 연구)

  • Kang, Min-Cheol
    • Asia pacific journal of information systems
    • /
    • v.12 no.2
    • /
    • pp.197-216
    • /
    • 2002
  • Cooperativeness within an organization can be conceptualized as the degree of members' willingness to work with others. The simulation study investigates the relationships of cooperativeness with team performance at different levels of information redundancy by using a multi-agents model called Team-Soar. The model consists of a group of four individual Al agents situated in a network, which models a naval command and control team consisting of four members. The study used a $9{\times}3$ design in which agent cooperativeness was manipulated at nine levels by gradually replacing selfish team members with increasing numbers of neutral and cooperative members, while information redundancy was controlled at three different levels(i.e., low, medium, and high). Results of the Team-Soar simulation show that cooperation has positive impacts on team performance. Further, the results reveal that the impact of agent cooperativeness on team performance depends on the amount of information needed to be processed during the decision making process.