• International Journal of Control, Automation, and Systems
• /
• v.6 no.2
• /
• pp.282-287
• /
• 2008

In distributed mobile robot systems, autonomous robots accomplish complicated tasks through intelligent cooperation with each other. This paper presents behavior learning and online distributed evolution for cooperative behavior of a group of autonomous robots. Learning and evolution capabilities are essential for a group of autonomous robots to adapt to unstructured environments. Behavior learning finds an optimal state-action mapping of a robot for a given operating condition. In behavior learning, a Q-learning algorithm is modified to handle delayed rewards in the distributed robot systems. A group of robots implements cooperative behaviors through communication with other robots. Individual robots improve the state-action mapping through online evolution with the crossover operator based on the Q-values and their update frequencies. A cooperative material search problem demonstrated the effectiveness of the proposed behavior learning and online distributed evolution method for implementing cooperative behavior of a group of autonomous mobile robots.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10b
• /
• pp.1177-1180
• /
• 1996

In this paper, we propose an algorithm that realizes cooperative behavior by construction of autonomous mobile robot system. Each robot is able to sense other robots and obstacles, and it has the rule of behavior to achieve the goal of the system. In this paper, to improve performance of the whole system, we use Genetic Programming based on Natural Selection. Genetic Programming's chromosome is a program of tree structure and it's major operators are crossover and mutation. We verify the effectiveness of the proposed scheme from the several examples.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.11 no.7
• /
• pp.591-597
• /
• 2001

In this paper, we propose a method of cooperative control (T-cell modeling) and selection of group behavior strategy (B-cell modeling) based on immune system in distributed autonomous robotic system (DARS). Immune system is living body's self-protection and self-maintenance system. These features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For applying immune system to DARS, a robot is regarded as a B-cell, each environmental condition as an antigen, a behavior strategy as an antibody and control parameter as a T-cell respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is stimulated and suppressed by other robot using communication. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control school is based on clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy. By T-cell modeling, adaptation ability of robot is enhanced in dynamic environments.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.2 no.3
• /
• pp.185-190
• /
• 2002

In distributed autonomous robotic systems (DARS), each robot must behave by itself according to its states ad environments, and if necessary, must cooperate with other robots in order to carry out their given tasks. Its most significant merit is that they determine their behavior independently, and cooperate with other robots in order to perform the given tasks. Especially, in DARS, it is essential for each robot to have evolution ability in order to increase the performance of system. In this paper, a schema co-evolutionary algorithm is proposed for the evolution of collective autonomous mobile robots. Each robot exchanges the information, chromosome used in this algorithm, through communication with other robots. Each robot diffuses its chromosome to two or more robots, receives other robot's chromosome and creates new species. Therefore if one robot receives another robot's chromosome, the robot creates new chromosome. We verify the effectiveness of the proposed algorithm by applying it to cooperative search problem.

• Journal of Institute of Control, Robotics and Systems
• /
• v.6 no.12
• /
• pp.1079-1085
• /
• 2000

In this paper, we propose a method of cooperative control (T-cell modeling) and selection of group behavior strategy (B-cell modeling) based on immune system in distributed autonomous robotic system (DARS). An immune system is the living bodys self-protection and self-maintenance system. these features can be applied to decision making of the optimal swarm behavior in a dynamically changing environment. For applying immune system to DARS, a robot is regarded as a B-cell, each environmental condition as an antigen, a behavior strategy as an antibody, and control parameter as a T-cell, respectively. When the environmental condition (antigen) changes, a robot selects an appropriate behavior strategy (antibody). And its behavior strategy is stimulated and suppressed by other robots using communication (immune network). Finally, much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and immune network hypothesis, and it is used for decision making of the optimal swarm strategy. Adaptation ability of the robot is enhanced by adding T-cell model as a control parameter in dynamic environments.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1998.03a
• /
• pp.127-130
• /
• 1998

In this paper, we propose a method of cooperative control(T-cell modeling) and selection of group behavior strategy(B-cell modeling) based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For the purpose of applying immune system to DARS, a robot is regarded as a B cell, each environmental condition as an antigen, a behavior strategy as an antibody and control parameter as a T-call respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is stimulated and suppressed by other robot using communication. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based of clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy. By T-cell modeling, adaptation ability of robot is enhanced in dynamic environments.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.124-127
• /
• 1997

In this paper, we propose a method of cooperative control based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment. For the purpose of applying immune system to DARS, a robot is regarded as a B lymphocyte(B cell), each environmental condition as an antigen, and a behavior strategy as an antibody respectively. The executing process of proposed method is as follows. When the environmental condition changes, a robot selects an appropriate behavior strategy. And its behavior strategy is simulated and suppressed by other robot using communication. Finally much simulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and idiotopic network hypothesis. And it is used for decision making of optimal swarm strategy.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2001.04a
• /
• pp.249-254
• /
• 2001

Abstract In this paper, we propose a method of cooperative control based on artifical intelligent system in distributed autonomous robotic system. In general, multi-agent behavior algorithm is simple and effective for small number of robots. And multi-robot behavior control is a simple reactive navigation strategy by combining repulsion from obstacles with attraction to a goal. However when the number of robot goes on increasing, this becomes difficult to be realized because multi-robot behavior algorithm provide on multiple constraints and goals in mobile robot navigation problems. As the solution of above problem, we propose an architecture of fuzzy system for each multi-robot speed control and fuzzy-neural network for obstacle avoidance. Here, we propose an architecture of fuzzy system for each multi-robot speed control and fuzzy-neural network for their direction to avoid obstacle. Our focus is on system of cooperative autonomous robots in environment with obstacle. For simulation, we divide experiment into two method. One method is motor schema-based formation control in previous and the other method is proposed by this paper. Simulation results are given in an obstacle environment and in an dynamic environment.

• Journal of the Korean Institute of Telematics and Electronics S
• /
• v.35S no.3
• /
• pp.102-109
• /
• 1998

In this paper, we propose a method of cooperative control based on immune system in distributed autonomous robotic system(DARS). Immune system is living body's self-protection and self-maintenance system. Thus these features can be applied to decision making of optimal swarm behavior in dynamically changing environment.For the purpose of applying immune system to DARS, a robot is regarded as a B lymphocyte(B cell), each environmental condition as an antigen, and a behavior strategy as an antibody respectively. The executing process of proposed method is as follows. When the environmental codintion changes, a robot select an appropriate beharior stategy. And its behavior stategy is stimulated and suppressed by other robot using communiation. Finally much stimulated strategy is adopted as a swarm behavior strategy. This control scheme is based on clonal selection and idotopic network hypothesis. And it is used for decision making of optimal swarm stragegy.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.2
• /
• pp.131-137
• /
• 2006

In swarm robot systems, each robot must behaves by itself according to the its states and environments, and if necessary, must cooperates with other robots in order to carry out a given task. Therefore it is essential that each robot has both learning and evolution ability to adapt the dynamic environments. In this paper, the new learning and evolution method based on reinforcement learning having delayed reward ability and distributed genetic algorithms is proposed for behavior learning and evolution of collective autonomous mobile robots. Reinforcement learning having delayed reward is still useful even though when there is no immediate reward. And by distributed genetic algorithm exchanging the chromosome acquired under different environments by communication each robot can improve its behavior ability. Specially, in order to improve the performance of evolution, selective crossover using the characteristic of reinforcement learning is adopted in this paper. we verify the effectiveness of the proposed method by applying it to cooperative search problem.