• Title/Summary/Keyword: multi-agent control

Search Result 194, Processing Time 0.032 seconds

The Integrated Control Model for the Freeway Corridors based on Multi-Agent Approach I : Simulation System & Modeling for Optimization (멀티 에이전트를 이용한 도로정체에 따른 교통흐름 예측 및 통합제어 I : 시뮬레이션 시스템 개발 및 최적화를 위한 모델링)

  • Cho, Ki-Yong;Bae, Chul-Ho;Kim, Hyun-Jun;Chu, Yul;Suh, Myung-Won
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.15 no.1
    • /
    • pp.8-15
    • /
    • 2007
  • Freeway corridors consist of urban freeways and parallel arterials that drivers can use alternatively. Ramp metering in freeways and signal control in arterials are contemporary traffic control methods that have been developed and applied in order to improve traffic conditions of freeway corridors. However, most of the existing studies have focused on either optimal ramp metering in freeways, or progression signal strategies between arterial intersections. There have been no traffic control systems in Korea that integrates the freeway ramp metering and arterial signal control. The effective control strategies for freeway operations may cause negative effects on arterial traffic. On the other hand, traffic congestion and bottleneck phenomenon of arterials due to the increasing peak-hour travel demand and ineffective signal operation may generate an accessibility problem to freeway ramps. Thus, the main function of the freeway which is the through-traffic process has not been successful. The purpose of this study is to develop an integrated control model that connects freeway ramp metering systems and signal control systems in arterial intersections. And Optimization of integrated control model which consists of ramp metering and signal control is another purpose. The design of experiment, neural network, and simulated annealing are used for optimization.

A Study on Multi Agent-Based Workflow Modeling System (다중 에이전트 기반 워크플로우 모델링 시스템에 관한 연구)

  • 김학성;김광훈;백수기
    • Journal of Internet Computing and Services
    • /
    • v.3 no.4
    • /
    • pp.19-26
    • /
    • 2002
  • Workflow Management Systems(WFMSs) is a software system that supports that specification and execution of business processes. In this paper, we proposed Multi Agent Based Workflow Modeling System which was implemented by Java application. The proposed workflow modeling system is divided into four agents; Session, Organization, Relevant Data. Invoked Application. We adapted ICN(Information Control Net) to check workflow model syntax, And the proposed modeling system provide the function to import/export WPDL which was defined in WfMC.

  • PDF

Multi-agent Coordination Strategy Using Reinforcement Learning (강화 학습을 이용한 다중 에이전트 조정 전략)

  • Kim, Su-Hyun;Kim, Byung-Cheon;Yoon, Byung-Joo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2000.10a
    • /
    • pp.285-288
    • /
    • 2000
  • 본 논문에서는 다중 에이전트(multi-agent) 환경에서 에이전트들의 행동을 효율적으로 조정 (coordination)하기 위해 강화 학습(reinforcement learning)을 이용하였다. 제안된 방법은 각 에이전트가 목표(goal)와의 거리 관계(distance relationship)와 인접 에이전트들과의 공간 관계(spatial relationship)를 이용하였다. 그러므로 각 에이전트는 다른 에이전트와 충돌(collision) 현상이 발생하지 않으면서, 최적의 다음 상태를 선택할 수 있다. 또한, 상태 공간으로부터 입력되는 강화 값이 0과 1 사이의 값을 갖기 때문에 각 에이전트가 선택한 (상태, 행동) 쌍이 얼마나 좋은가를 나타낼 수 있다. 제안된 방법을 먹이 포획 문제(prey pursuit problem)에 적용한 결과 지역 제어(local control)나. 분산 제어(distributed control) 전략을 이용한 방법보다 여러 에이전트들의 행동을 효율적으로 조정할 수 있었으며, 매우 빠르게 먹이를 포획할 수 있음을 알 수 있었다.

  • PDF

Self-Organization for Multi-Agent Groups

  • Kim, Dong-Hun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.3
    • /
    • pp.333-342
    • /
    • 2004
  • This paper presents a framework for the self-organization of swarm systems based on coupled nonlinear oscillators (CNOs). In this scheme, multiple agents in a swarm self-organize to flock and arrange themselves as a group using CNOs, which are able to keep a certain distance by the attractive and repulsive forces among different agents. A theoretical approach of flocking behavior by CNOs and a design guideline of CNO parameters are proposed. Finally, the formation scenario for cooperative multi-agent groups is investigated to demonstrate group behaviors such as aggregation, migration, homing and so on. The task for each group in this scenario is to perform a series of processes such as gathering into a whole group or splitting into two groups, and then to return to the base while avoiding collision with agents in different groups and maintaining the formation of each group.

A Coordination Agent Model based on Extracting Similar Information (유사 정보 추출에 기반한 조성 에이전트 모델)

  • 양소진;이현수;오경환
    • Korean Journal of Cognitive Science
    • /
    • v.12 no.1_2
    • /
    • pp.55-63
    • /
    • 2001
  • Speaking generally, agent-based technology is a kind of technology to handle the flood of information resulted from the popularization of the internet. Agent system is a multi-distributed system which consists of both homogeneous and heterogeneous agents. Generally there is a coordination agent in between which is in charge of control and m message flow among the application agents. The purpose of this thesis is to propose a coordination method among agents, some of which provide informations and some of which request them. In multi-agent system, the Information Providing Agent(IPA) registers its capabilities to Coordination Agent(CA) and the Information Requesting Agent(lRA) requests CA what it needs. To coordinate them with satisfactory results the coordination agent ought to have an ability to return a relatively proper data to the requester which is supposed to be similar even though it is not so exact as was intended. For this, this thesis proposes a scheme for an coordination agent to find an IPA which provides an information which correlates most closely with that of IRA.

  • PDF

A Navigation System for Mobile Robot

  • Zhang, Yuanliang;Chong, Kil-To
    • Proceedings of the IEEK Conference
    • /
    • 2009.05a
    • /
    • pp.118-120
    • /
    • 2009
  • In this paper, we present the Q-learning method for adaptive traffic signal control on the basis of multi-agent technology. The structure is composed of sixphase agents and one intersection agent. Wireless communication network provides the possibility of the cooperation of agents. As one kind of reinforcement learning, Q-learning is adopted as the algorithm of the control mechanism, which can acquire optical control strategies from delayed reward; furthermore, we adopt dynamic learning method instead of static method, which is more practical. Simulation result indicates that it is more effective than traditional signal system.

  • PDF

A Videoconference System based on Agent Knowledge for Flexible QoS Control (유연한 QoS제어를 위한 에이전트 지식 기반 화상회의 시스템)

  • Lee Sung-Doke
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.11
    • /
    • pp.1047-1058
    • /
    • 2005
  • In this paper we propose an agent architecture to improve the flexibility of videoconference systems with strategic-INTER knowledge. The proposed architecture achieves more flexibility by selecting dynamically the strategy of QoS (Quality of Service). To select the strategies, the systems have to take into the consideration of the properties of problems occurred on QoS and the status of problem solving process. This architecture is introduced as a part of knowledge base of agent dealing with cooperation between software modules of videoconference systems. We have implemented the architecture and our prototype system shows its capability of flexible problem solving against the QoS degradation, along with other possible problems within the time limitation. We confirmed that the proposed architecture can improve its flexibility of a videoconference system compared to conventional systems.

Multi-Agent Based Cooperative Information System using Knowledge Level (지식레벨을 이용한 다중 에이전트 협동 정보시스템)

  • 강성희;박승수
    • Korean Journal of Cognitive Science
    • /
    • v.11 no.1
    • /
    • pp.67-80
    • /
    • 2000
  • Distributed cooperative information system is the one that has various knowledge sources as well as problem solving capabilities to get information in a distributed and heterogeneous data environment. In a distributed cooperative information system. a control mechanism to facilitate the available information is very important. and usually the role of the control mechanism determines the behavior of the total system In this research. we proposed a model of the distributed cooperative information system which is based on the multi-agent paradigm. We also implemented a test system to show l its feasibility. The proposed system makes the knowledge sources into agents and a special agent called 'facilitator' controls the cooperation between the knowledge agents The facilitator uses the knowledge granularity level to determine the sequence of the activation of the agents. In other words. the knowledge source with simple but fast processing mechanism activates first while more sophisticated but slow knowledge sources are activated late. In an environment in which we have several knowledge sources for the same topic. the proposed system will simulate the focusing mechanism of human cognitive process.

  • PDF

Puzzle Heuristics: Efficient Lifelong Multi-Agent Pathfinding Algorithm for Large-scale Challenging Environments (퍼즐 휴리스틱스: 대규모 환경을 위한 효율적인 다중 에이전트 경로 탐색 알고리즘)

  • Wonjong Lee;Joonyeol Sim;Changjoo Nam
    • The Journal of Korea Robotics Society
    • /
    • v.19 no.3
    • /
    • pp.281-286
    • /
    • 2024
  • This paper describes the solution method of Team AIRLAB used to participate in the League of Robot Runners Competition which tackles the problem of Lifelong Multi-agent Pathfinding (MAPF). In lifelong MAPF, multiple agents are tasked to navigate to their respective goal locations where new goals are consecutively revealed once they reach initial goals. The agents need to avoid collisions and deadlock situations while they navigate to perform tasks. Our method consists of (i) Puzzle Heuristics, (ii) MAPF-LNS2, and (iii) RHCR. The Puzzle Heuristics is our own algorithm that generates a compact heuristic table contributing to reduce memory consumption and computation time. MAPF-LNS2 and RHCR are state-of-the-art algorithms for MAPF. By combining these three algorithms, our method can improve the efficiency of paths for all agents significantly.

Integrating Ant Colony Clustering Method to a Multi-Robot System Using Mobile Agents

  • Kambayashi, Yasushi;Ugajin, Masataka;Sato, Osamu;Tsujimura, Yasuhiro;Yamachi, Hidemi;Takimoto, Munehiro;Yamamoto, Hisashi
    • Industrial Engineering and Management Systems
    • /
    • v.8 no.3
    • /
    • pp.181-193
    • /
    • 2009
  • This paper presents a framework for controlling mobile multiple robots connected by communication networks. This framework provides novel methods to control coordinated systems using mobile agents. The combination of the mobile agent and mobile multiple robots opens a new horizon of efficient use of mobile robot resources. Instead of physical movement of multiple robots, mobile software agents can migrate from one robot to another so that they can minimize energy consumption in aggregation. The imaginary application is making "carts," such as found in large airports, intelligent. Travelers pick up carts at designated points but leave them arbitrary places. It is a considerable task to re-collect them. It is, therefore, desirable that intelligent carts (intelligent robots) draw themselves together automatically. Simple implementation may be making each cart has a designated assembly point, and when they are free, automatically return to those points. It is easy to implement, but some carts have to travel very long way back to their own assembly point, even though it is located close to some other assembly points. It consumes too much unnecessary energy so that the carts have to have expensive batteries. In order to ameliorate the situation, we employ mobile software agents to locate robots scattered in a field, e.g. an airport, and make them autonomously determine their moving behaviors by using a clustering algorithm based on the Ant Colony Optimization (ACO). ACO is the swarm intelligence-based methods, and a multi-agent system that exploit artificial stigmergy for the solution of combinatorial optimization problems. Preliminary experiments have provided a favorable result. In this paper, we focus on the implementation of the controlling mechanism of the multi-robots using the mobile agents.