• 제목/요약/키워드: distributed robot system ^ cooperative behavior

검색결과 15건 처리시간 0.032초

Online Evolution for Cooperative Behavior in Group Robot Systems

  • Lee, Dong-Wook;Seo, Sang-Wook;Sim, Kwee-Bo
    • International Journal of Control, Automation, and Systems
    • /
    • 제6권2호
    • /
    • pp.282-287
    • /
    • 2008
  • In distributed mobile robot systems, autonomous robots accomplish complicated tasks through intelligent cooperation with each other. This paper presents behavior learning and online distributed evolution for cooperative behavior of a group of autonomous robots. Learning and evolution capabilities are essential for a group of autonomous robots to adapt to unstructured environments. Behavior learning finds an optimal state-action mapping of a robot for a given operating condition. In behavior learning, a Q-learning algorithm is modified to handle delayed rewards in the distributed robot systems. A group of robots implements cooperative behaviors through communication with other robots. Individual robots improve the state-action mapping through online evolution with the crossover operator based on the Q-values and their update frequencies. A cooperative material search problem demonstrated the effectiveness of the proposed behavior learning and online distributed evolution method for implementing cooperative behavior of a group of autonomous mobile robots.

유전 프로그래밍에 의한 자율이동로봇군의 협조행동 및 제어 (Cooperative behavior and control of autonomous mobile robots using genetic programming)

  • 이동욱;심귀보
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
    • /
    • pp.1177-1180
    • /
    • 1996
  • In this paper, we propose an algorithm that realizes cooperative behavior by construction of autonomous mobile robot system. Each robot is able to sense other robots and obstacles, and it has the rule of behavior to achieve the goal of the system. In this paper, to improve performance of the whole system, we use Genetic Programming based on Natural Selection. Genetic Programming's chromosome is a program of tree structure and it's major operators are crossover and mutation. We verify the effectiveness of the proposed scheme from the several examples.

  • PDF

Cooperative Strategies and Swarm Behavior in Distributed Autonomous Robotic Systems based on Artificial Immune System

  • Sim, Kwee-bo;Lee, Dong-wook
    • 한국지능시스템학회논문지
    • /
    • 제11권7호
    • /
    • pp.591-597
    • /
    • 2001
  • In this paper, we propose a method of cooperative control (T-cell modeling) and selection of group behavior strategy (B-cell modeling) based on immune system in distributed autonomous robotic system (DARS). Immune system is living body's self-protection and self-maintenance system. These features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For applying immune system to DARS, a robot is regarded as a B-cell, each environmental condition as an antigen, a behavior strategy as an antibody and control parameter as a T-cell respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is stimulated and suppressed by other robot using communication. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control school is based on clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy. By T-cell modeling, adaptation ability of robot is enhanced in dynamic environments.

  • PDF

Cooperative Behavior of Distributed Autonomous Robotic Systems Based on Schema Co-Evolutionary Algorithm

  • Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제2권3호
    • /
    • pp.185-190
    • /
    • 2002
  • In distributed autonomous robotic systems (DARS), each robot must behave by itself according to its states ad environments, and if necessary, must cooperate with other robots in order to carry out their given tasks. Its most significant merit is that they determine their behavior independently, and cooperate with other robots in order to perform the given tasks. Especially, in DARS, it is essential for each robot to have evolution ability in order to increase the performance of system. In this paper, a schema co-evolutionary algorithm is proposed for the evolution of collective autonomous mobile robots. Each robot exchanges the information, chromosome used in this algorithm, through communication with other robots. Each robot diffuses its chromosome to two or more robots, receives other robot's chromosome and creates new species. Therefore if one robot receives another robot's chromosome, the robot creates new chromosome. We verify the effectiveness of the proposed algorithm by applying it to cooperative search problem.

인공 면역계 기반 자율분산로봇 시스템의 협조 전략과 군행동 (Cooperative Strategies and Swarm Behavior in Distributed Autonomous Robotic Systems Based on Artificial Immune System)

  • 심귀보;이동욱;선상준
    • 제어로봇시스템학회논문지
    • /
    • 제6권12호
    • /
    • pp.1079-1085
    • /
    • 2000
  • In this paper, we propose a method of cooperative control (T-cell modeling) and selection of group behavior strategy (B-cell modeling) based on immune system in distributed autonomous robotic system (DARS). An immune system is the living bodys self-protection and self-maintenance system. these features can be applied to decision making of the optimal swarm behavior in a dynamically changing environment. For applying immune system to DARS, a robot is regarded as a B-cell, each environmental condition as an antigen, a behavior strategy as an antibody, and control parameter as a T-cell, respectively. When the environmental condition (antigen) changes, a robot selects an appropriate behavior strategy (antibody). And its behavior strategy is stimulated and suppressed by other robots using communication (immune network). Finally, much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and immune network hypothesis, and it is used for decision making of the optimal swarm strategy. Adaptation ability of the robot is enhanced by adding T-cell model as a control parameter in dynamic environments.

  • PDF

자율이동로봇군의 협조전략과 군행동의 실현을 위한 면역시스템의 모델링 (An Immune System Modeling for Realization of Cooperative Strategies and Group Behavior in Collective Autonomous Mobile Robots)

  • 이동욱;심귀보
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 춘계학술대회 학술발표 논문집
    • /
    • pp.127-130
    • /
    • 1998
  • In this paper, we propose a method of cooperative control(T-cell modeling) and selection of group behavior strategy(B-cell modeling) based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For the purpose of applying immune system to DARS, a robot is regarded as a B cell, each environmental condition as an antigen, a behavior strategy as an antibody and control parameter as a T-call respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is stimulated and suppressed by other robot using communication. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based of clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy. By T-cell modeling, adaptation ability of robot is enhanced in dynamic environments.

  • PDF

인공면역네트워크에 의한 자율이동로봇군의 동적 행동 제어 (Dynamic behavior control of a collective autonomous mobile robots using artificial immune networks)

  • 이동욱;심귀보
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1997년도 한국자동제어학술회의논문집; 한국전력공사 서울연수원; 17-18 Oct. 1997
    • /
    • pp.124-127
    • /
    • 1997
  • In this paper, we propose a method of cooperative control based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For the purpose of applying immune system to DARS, a robot is regarded as a B lymphocyte(B cell), each environmental condition as an antigen, and a behavior strategy as an antibody respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is simulated and suppressed by other robot using communication. Finally much simulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy.

  • PDF

동적인 환경에서 강인한 멀티로봇 제어 알고리즘 연구 (Study for Control Algorithm of Robust Multi-Robot in Dynamic Environment)

  • 홍성우;안두성
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 2001년도 춘계학술대회 논문집
    • /
    • pp.249-254
    • /
    • 2001
  • Abstract In this paper, we propose a method of cooperative control based on artifical intelligent system in distributed autonomous robotic system. In general, multi-agent behavior algorithm is simple and effective for small number of robots. And multi-robot behavior control is a simple reactive navigation strategy by combining repulsion from obstacles with attraction to a goal. However when the number of robot goes on increasing, this becomes difficult to be realized because multi-robot behavior algorithm provide on multiple constraints and goals in mobile robot navigation problems. As the solution of above problem, we propose an architecture of fuzzy system for each multi-robot speed control and fuzzy-neural network for obstacle avoidance. Here, we propose an architecture of fuzzy system for each multi-robot speed control and fuzzy-neural network for their direction to avoid obstacle. Our focus is on system of cooperative autonomous robots in environment with obstacle. For simulation, we divide experiment into two method. One method is motor schema-based formation control in previous and the other method is proposed by this paper. Simulation results are given in an obstacle environment and in an dynamic environment.

  • PDF

인공면역계 기반의 자율이동로봇군의 협조행동전략 결정 (Artificial immune network-based cooperative beharior strategies in collective autonomous mobile rotos)

  • 이동욱;심귀보
    • 전자공학회논문지S
    • /
    • 제35S권3호
    • /
    • pp.102-109
    • /
    • 1998
  • In this paper, we propose a method of cooperative control based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment.For the purpose of applying immune system to DARS, a robot is regarded as a B lymphocyte(B cell), each environmental condition as an antigen, and a behavior strategy as an antibody respectively. The executing process of proposed method is as follows. When the environmental codintion changes, a robot select an appropriate beharior stategy. And its behavior stategy is stimulated and suppressed by other robot using communiation. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and idotopic network hypothesis. And it is used for decision making of optimal swarm stragegy.

  • PDF

군집 로봇의 협조 행동을 위한 로봇 개체의 행동학습과 진화 (Behavior Learning and Evolution of Individual Robot for Cooperative Behavior of Swarm Robot System)

  • 심귀보;이동욱
    • 한국지능시스템학회논문지
    • /
    • 제16권2호
    • /
    • pp.131-137
    • /
    • 2006
  • 군집 로봇시스템에서 개개의 로봇은 스스로 주위의 환경과 자신의 상태를 스스로 판단하여 행동하고, 필요에 따라서는 다른 로봇과 협조를 통하여 어떤 주어진 일을 수행할 수 있어야 한다. 따라서 개개의 로봇은 동적으로 변화하는 환경에 잘 적응할 수 있는 학습과 진화능력을 갖는 것이 필수적이다. 이를 위하여 본 논문에서는 지연된 보상능력이 있는 강화학습과 분산유전알고리즘을 이용한 새로운 자율이동로봇의 행동학습 및 진화방법을 제안한다. 지연 보상능력이 있는 강화학습은 로봇이 취한 행동에 대하여 즉각적인 보상을 가할 수 없는 경우에도 학습이 가능한 방법이다. 또한 개개의 로봇이 통신을 통하여 염색체를 교환하는 분산유전알고리즘은 각기 다른 환경에서 학습한 우수한 염색체로부터 자신의 능력을 향상시킨다. 특히 본 논문에서는 진화의 성능을 향상시키기 위하여 강화학습의 특성을 이용한 선택 교배방법을 채택하였다. 제안된 방법은 협조탐색 문제에 적용하여 컴퓨터 시뮬레이션을 통하여 그 유효성을 검증한다.