DOI QR코드

DOI QR Code

Object tracking algorithm of Swarm Robot System for using Polygon based Q-learning and parallel SVM

  • Seo, Snag-Wook (School of Electrical and Electronic Engineering, Chung-Ang University) ;
  • Yang, Hyun-Chang (School of Electrical and Electronic Engineering, Chung-Ang University) ;
  • Sim, Kwee-Bo (School of Electrical and Electronic Engineering, Chung-Ang University)
  • Published : 2008.09.01

Abstract

This paper presents the polygon-based Q-leaning and Parallel SVM algorithm for object search with multiple robots. We organized an experimental environment with one hundred mobile robots, two hundred obstacles, and ten objects. Then we sent the robots to a hallway, where some obstacles were lying about, to search for a hidden object. In experiment, we used four different control methods: a random search, a fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process to determine the next action of the robots, and hexagon-based Q-learning, and dodecagon-based Q-learning and parallel SVM algorithm to enhance the fusion model with Distance-based action making (DBAM) and Area-based action making (ABAM) process. In this paper, the result show that dodecagon-based Q-learning and parallel SVM algorithm is better than the other algorithm to tracking for object.

Keywords

References

  1. Parker, L, 'Adaptive Action Selection for Cooperative Agent Teams,' Proc. Of 2nd Int. Conference on Simulation of Adaptive Behavior, pp.442-450, 1992
  2. Ogasawara. G, Omata. T, Sato. T, 'Multiple Movers Using Distributed, Decision-Theoretic Control,' Proc. of Japan-USA Symposium on Flexible Automation, pp. 623-630, 1992
  3. Ballard. D, 'An Introduction to Natural Computation,' The MIT Press Cambridge, 1997
  4. Jang. J, Sun. C, Mizutani. E, 'Neuro-Fuzzy and Soft Computing,' Prentice-Hall New Jersey, 1997
  5. W. Ashley and T. Balch, 'Value-based observation with robot teams using probabilistic techniques,' Proceeding of International conference on Advanced Robotics, 2003
  6. J. B. Park, B. H. Lee, and M. S. Kim, 'Remote control of a mobile robot using distance-based reflective force,' Proceeding of IEEE International Conference on Robotics and Automation, vol. 3, pp. 3415-3420, 2003
  7. D. Patterson and J. Hennessy, 'Computer Organization and Design,' Morgan-Kaufmann $3^rd$ edition, 2005
  8. T. Mitchell, 'Machine Learning,' McGraw-Hill, Singapore, 1997
  9. Ogren. P, Leonard. N. E, 'Obstacle Avoidance in Formation,' Proc. Of IEEE International Conference on Robotics and Automation, pp. 2492-2497, 2003
  10. C. Clausen and H. Wechsler, 'Quad Q-learning,' IEEE Transaction on Neural Network, Vol. 11, pp. 279-294, 2000 https://doi.org/10.1109/72.839000
  11. S. Russel and P. Norbig, Artificial Intelligence: A Modern Approach. 2nd edition Prentice-Hall: New Jersey, 2003
  12. Jian-Pei Zhang, Zhong-Wei Li and Jing Yang, 'A Parallel SVM Training Algorithm on Large-Scale Classification Problems,' Proceedings of the Fourth International Conference on Machine Learning and Cybernetics, Vol. 3, pp. 1637-1641, 2005

Cited by

  1. Industrial Big Data Analysis in Smart Factory: Current Status and Research Strategies vol.5, pp.2169-3536, 2017, https://doi.org/10.1109/ACCESS.2017.2741105