• Title/Summary/Keyword: swarm robots system

Search Result 41, Processing Time 0.031 seconds

Object Tracking Algorithm of Swarm Robot System for using Polygon Based Q-Learning and Cascade SVM (다각형 기반의 Q-Learning과 Cascade SVM을 이용한 군집로봇의 목표물 추적 알고리즘)

  • Seo, Sang-Wook;Yang, Hyung-Chang;Sim, Kwee-Bo
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.3 no.2
    • /
    • pp.119-125
    • /
    • 2008
  • This paper presents the polygon-based Q-leaning and Cascade Support Vector Machine algorithm for object search with multiple robots. We organized an experimental environment with ten mobile robots, twenty five obstacles, and an object, and then we sent the robots to a hallway, where some obstacles were lying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process to determine the next action of the robots, and hexagon-based Q-learning and dodecagon-based Q-learning and Cascade SVM to enhance the fusion model with DBAM and ABAM process.

  • PDF

Object tracking algorithm of Swarm Robot System for using Polygon based Q-learning and parallel SVM

  • Seo, Snag-Wook;Yang, Hyun-Chang;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.8 no.3
    • /
    • pp.220-224
    • /
    • 2008
  • This paper presents the polygon-based Q-leaning and Parallel SVM algorithm for object search with multiple robots. We organized an experimental environment with one hundred mobile robots, two hundred obstacles, and ten objects. Then we sent the robots to a hallway, where some obstacles were lying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process to determine the next action of the robots, and hexagon-based Q-learning, and dodecagon-based Q-learning and parallel SVM algorithm to enhance the fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process. In this paper, the result show that dodecagon-based Q-learning and parallel SVM algorithm is better than the other algorithm to tracking for object.

Training of Fuzzy-Neural Network for Voice-Controlled Robot Systems by a Particle Swarm Optimization

  • Watanabe, Keigo;Chatterjee, Amitava;Pulasinghe, Koliya;Jin, Sang-Ho;Izumi, Kiyotaka;Kiguchi, Kazuo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1115-1120
    • /
    • 2003
  • The present paper shows the possible development of particle swarm optimization (PSO) based fuzzy-neural networks (FNN) which can be employed as an important building block in real life robot systems, controlled by voice-based commands. The PSO is employed to train the FNNs which can accurately output the crisp control signals for the robot systems, based on fuzzy linguistic spoken language commands, issued by an user. The FNN is also trained to capture the user spoken directive in the context of the present performance of the robot system. Hidden Markov Model (HMM) based automatic speech recognizers are developed, as part of the entire system, so that the system can identify important user directives from the running utterances. The system is successfully employed in a real life situation for motion control of a redundant manipulator.

  • PDF

A Fuzzy-Neural Network Based Human-Machine Interface for Voice Controlled Robots Trained by a Particle Swarm Optimization

  • Watanabe, Keigo;Chatterjee, Amitava;Pulasinghe, Koliya;Izumi, Kiyotaka;Kiguchi, Kazuo
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.411-414
    • /
    • 2003
  • Particle swarm optimization (PSO) is employed to train fuzzy-neural networks (FNN), which can be employed as an important building block in real life robot systems, controlled by voice-based commands. The FNN is also trained to capture the user spoken directive in the context of the present performance of the robot system. The system has been successfully employed in a real life situation for navigation of a mobile robot.

  • PDF

Behavior Learning and Evolution of Individual Robot for Cooperative Behavior of Swarm Robot System (군집 로봇의 협조 행동을 위한 로봇 개체의 행동학습과 진화)

  • Sim, Kwee-Bo;Lee, Dong-Wook
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.2
    • /
    • pp.131-137
    • /
    • 2006
  • In swarm robot systems, each robot must behaves by itself according to the its states and environments, and if necessary, must cooperates with other robots in order to carry out a given task. Therefore it is essential that each robot has both learning and evolution ability to adapt the dynamic environments. In this paper, the new learning and evolution method based on reinforcement learning having delayed reward ability and distributed genetic algorithms is proposed for behavior learning and evolution of collective autonomous mobile robots. Reinforcement learning having delayed reward is still useful even though when there is no immediate reward. And by distributed genetic algorithm exchanging the chromosome acquired under different environments by communication each robot can improve its behavior ability. Specially, in order to improve the performance of evolution, selective crossover using the characteristic of reinforcement learning is adopted in this paper. we verify the effectiveness of the proposed method by applying it to cooperative search problem.

Reinforcement Learning Based Evolution and Learning Algorithm for Cooperative Behavior of Swarm Robot System (군집 로봇의 협조 행동을 위한 강화 학습 기반의 진화 및 학습 알고리즘)

  • Seo, Sang-Wook;Kim, Ho-Duck;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.17 no.5
    • /
    • pp.591-597
    • /
    • 2007
  • In swarm robot systems, each robot must behaves by itself according to the its states and environments, and if necessary, must cooperates with other robots in order to carry out a given task. Therefore it is essential that each robot has both learning and evolution ability to adapt the dynamic environments. In this paper, the new polygon based Q-learning algorithm and distributed genetic algorithms are proposed for behavior learning and evolution of collective autonomous mobile robots. And by distributed genetic algorithm exchanging the chromosome acquired under different environments by communication each robot can improve its behavior ability Specially, in order to improve the performance of evolution, selective crossover using the characteristic of reinforcement learning is adopted in this paper. we verify the effectiveness of the proposed method by applying it to cooperative search problem.

Object tracking algorithm of Swarm Robot System for using SVM and Dodecagon based Q-learning (12각형 기반의 Q-learning과 SVM을 이용한 군집로봇의 목표물 추적 알고리즘)

  • Seo, Sang-Wook;Yang, Hyun-Chang;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.18 no.3
    • /
    • pp.291-296
    • /
    • 2008
  • This paper presents the dodecagon-based Q-leaning and SVM algorithm for object search with multiple robots. We organized an experimental environment with several mobile robots, obstacles, and an object. Then we sent the robots to a hallway, where some obstacles were tying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making(DBAM) and Area-based action making(ABAM) process to determine the next action of the robots, and hexagon-based Q-learning and dodecagon-based Q-learning and SVM to enhance the fusion model with Distance-based action making(DBAM) and Area-based action making(ABAM) process.

Extension of Self-organization for Swarm Systems to Three Dimensions (스웜시스템을 위한 자기조직화의 3D 확장)

  • Kim, Jae-Hyun;Kim, Dong-Hun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.4
    • /
    • pp.489-496
    • /
    • 2010
  • In this paper, a self-organization framework for swarm systems in three dimensions is presented. The framework uses artificial potential functions(APFs) to direct the robots toward the goal as well as to keep them in a swarm system. This research extends conventional APFs used for self-organizations in two dimension environment to three dimensions. In three dimension environment, the ground potential for the boundary surfaces that commonly appear in three dimension environments is proposed. Accordingly, the comparison between the paths without and with the ground potentials shows the necessity and effect of ground potentials. Extensive simulations are given to show the effectiveness of the extended potentials and various properties in three dimension environments.

Manipulation of Micro-Structure by Self-Powered Bacteria (박테리아의 추진을 이용한 마이크로 구조의 조작)

  • Kim, Min-Jun;Byun, Do-Young;Kumar, Vijay;Breuer, Kenneth S.
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.1433-1436
    • /
    • 2008
  • Flagellate bacteria such as Escherichia coli or Serratia marcescens possess a remarkable motility system based on a reversible rotary motor. We have employed S. marcescens as microactuators in low Reynolds number fluidic environments to move a larger engineering element around. Microstructures fabricated using conventional microfabrication techniques are blotted on the swarm plate, which leaves a bacterial monolayer on the surface of the microstructure. We have investigated microstructures powered by bacteria to determine how cell orientation on the microstructure surface relates to the swarming patterns as well as how the orientation is affected by the blotting process. This study will help to refine directional control of bacterial transporters by exploiting bacterial sensory mechanisms.

  • PDF

Statistical Analysis of Receding Horizon Particle Swarm Optimization for Multi-Robot Formation Control (다개체 로봇 편대 제어를 위한 이동 구간 입자 군집 최적화 알고리즘의 통계적 성능 분석)

  • Lee, Seung-Mok
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.24 no.5
    • /
    • pp.115-120
    • /
    • 2019
  • In this paper, we present the results of the performance statistical analysis of the multi-robot formation control based on receding horizon particle swarm optimization (RHPSO). The formation control problem of multi-robot system can be defined as a constrained nonlinear optimization problem when considering collision avoidance between robots. In general, the constrained nonlinear optimization problem has a problem that it takes a long time to find the optimal solution. The RHPSO algorithm was proposed to quickly find a suboptimal solution to the optimization problem of multi-robot formation control. The computational complexity of the RHPSO increases as the number of candidate solutions and generations increases. Therefore, it is important to find a suboptimal solution that can be used for real-time control with minimal candidate solutions and generations. In this paper, we compared the formation error according to the number of candidate solutions and the number of generations. Through numerical simulations under various conditions, the results are analyzed statistically and the minimum number of candidate solutions and the minimum number of generations of the RHPSO algorithm are derived within the allowable control error.