Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Multi-robot Formation based on Object Tracking Method using Fisheye Images

어안 영상을 이용한 물체 추적 기반의 한 멀티로봇의 대형 제어

  • Choi, Yun Won (Automotive IT Platform Research Team, ETRI) ;
  • Kim, Jong Uk (Automotive IT Platform Research Team, ETRI) ;
  • Choi, Jeong Won (Department of Automatic Electrical Engineering, Yeungnam College of Science & Technology) ;
  • Lee, Suk Gyu (Department of Electrical Engineering, Yeungnam University)
  • Received : 2012.11.29
  • Accepted : 2013.04.24
  • Published : 2013.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a novel formation algorithm of identical robots based on object tracking method using omni-directional images obtained through fisheye lenses which are mounted on the robots. Conventional formation methods of multi-robots often use stereo vision system or vision system with reflector instead of general purpose camera which has small angle of view to enlarge view angle of camera. In addition, to make up the lack of image information on the environment, robots share the information on their positions through communication. The proposed system estimates the region of robots using SURF in fisheye images that have $360^{\circ}$ of image information without merging images. The whole system controls formation of robots based on moving directions and velocities of robots which can be obtained by applying Lucas-Kanade Optical Flow Estimation for the estimated region of robots. We confirmed the reliability of the proposed formation control strategy for multi-robots through both simulation and experiment.

Keywords

References

  1. S. R. Moon, B. S. Park, Y. H. Choi, and J. B. Park, "Leaderfollowing approach based adaptive formation controlfor mobile robots with unknown parameters," Transaction of KIEE, vol. 60, no. 8, pp. 1592-1598, Aug. 2011.
  2. G. H. Eoh, J. D. Jeon, J. S. Choi, and B. H. Lee, "Multi-robot cooperative formation for overweight object transportation," System Integration (SII), 2011 IEEE/SICE International Symposium on, pp. 726-731, Dec. 2011.
  3. Y. Touahmi, N. Burlutskiy, K. W. Lee, and B. H. Lee, "Congestion avoidance for multiple micro-robots using the behaviour of fish schools," International Journal of Advanced Robotic Systems, vol. 9, Mar. 2012.
  4. L. Chaimowicz, B. Grocholsky, J. F. Keller, V. Kumar, C. and J. Taylor, "Experiments in multirobot air-ground coordination," Robotics and Automation, Proceedings of the 2004 IEEE International Conference on Robotics & Automation, vol. 4, pp. 4053-4058, Apr. 2004.
  5. Y. Yagi, "Multibody motion estimation and segmentation from multiple central panoramic views," Robotics and Automation, ICRA '03. IEEE International Conference on, vol. 1, pp. 571-576, Sep. 2003.
  6. Y. Yagi, "Omni-directional sensing and its applications," IEICE Trans, INF. & SYST., vol. E82-D, no. 3, pp. 568-579, Mar. 1999.
  7. T. E. Boult, R. Micheals, X. Gao, P. Lewis, C. Power, W. Yin, and A. S. Erkan, "Frame-rate omnidirectional surveillance and tracking of camouflaged and occluded and targets," Second IEEE Workshop on, pp. 48-55, Jun. 1999.
  8. V. N. Peri and S. K. Nayar,"Generation of perspective and panoramic video from omnidirectional video," Proc. of DARPA Image Understanding Workshop, New Orleans, May 1997.
  9. K. Miyamoto, "Fish eye lens," Journal of Optical Society of America, vol. 54, pp. 1060-1061, Aug. 1964. https://doi.org/10.1364/JOSA.54.001060
  10. A. Basu, et al., "Alternative models for fish-eye lenses," Pattern Recognition Letters, vol. 16, pp. 433-441, 1995. https://doi.org/10.1016/0167-8655(94)00115-J
  11. H. Bay, E. Andreas, T. Tuytelaars, and L. V. Gool, "Speeded-up robust features," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, Jun. 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  12. J. Chang, "Digital image translational and rotational motion stabilization using optical flow technique," IEEE Transactions on Consumer Electronics, vol. 48, no. 1, pp. 108-115, Feb. 2002. https://doi.org/10.1109/TCE.2002.1010098
  13. S. M. Kim, J. H. Lee, S. G. Roh, and S. Y. Park, "The study of pre-processing algorithm for improving efficiency of optical flow method on ultrasound image," Journal of IEEK, vol. 47, no. 5, pp. 24-32, Sep. 2010.
  14. W. Y. Jeong and K. M. Lee, "CV-SLAM: a new ceiling visionbased SLAM technique," Intelligent Robots and Systems (IROS 2005), IEEE/RSJ International Conference on, pp. 3195-3200, 2005.
  15. T. K. Yang, W. Y. Choi, and J. M. Lee, "Localization of multiple robots in a wide area," Journal of Institute of Control, Robotics and Systems (in Korean), vol. 16, no. 3, pp. 293-299, Mar. 2010. https://doi.org/10.5302/J.ICROS.2010.16.3.293
  16. A. Bakowski and G. A. Jones, "Video surveillance tracking using color region adjacency graphs," Image Processing and its Applications, Conference Publication, no. 465, pp. 794-798, 1999.
  17. H. Tao, H. S. Sawhney, and R. Kumar, "Object tracking with bayesian estimation of dynamic layer representations," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 75-89, Jan. 2002. https://doi.org/10.1109/34.982885
  18. J. H. Shin, D. H. Nam, G. J. Kwon, and S. K. Jung, "Non-metric fish-eye lens distortion correction using ellipsoid model," HCI Conference Publication, pp. 83-89, Jan. 2005.
  19. G. H. Kim, D. Y. Lee, and K. N. Lee, "Formation of mobile robots with inaccurate sensor information," Transactions on Control Automation and Systems Engineering, vol. 3, no. 4, pp. 203-209, Dec. 2001.
  20. T. D. Nguyen, J. H. Kim, S. H. Kim, H. J. Yang, G. S. Lee, J. Y. Chang, and N. W. Eum, "A novel interaction method for mobile devices using low complexity global motion estimation," ETRI Journal, vol. 34, no. 5, pp. 734-742. Oct. 2012. https://doi.org/10.4218/etrij.12.0112.0070
  21. S. Y. Lee, "Use of optical flow information with three cameras for robot navigation", Journal of Institute of Control, Robotics and Systems (in Korean), vol. 18, no. 2, pp. 110-117, Feb. 2012. https://doi.org/10.5302/J.ICROS.2012.18.2.110
  22. H. I. Kim and G. S. Kim, "Development of a Robot's Visual System for Measuring Distance and Width of Object Algorism", Journal of Institute of Control, Robotics and Systems (in Korean), vol. 17, no. 2, pp. 88-92, Feb. 2011. https://doi.org/10.5302/J.ICROS.2011.17.2.088