The Journal of Korea Robotics Society (로봇학회논문지)

Korea Robotics Society (한국로봇학회)
권호 표지
DOI QR코드

DOI QR Code

Development of a Cost-Effective Tele-Robot System Delivering Speaker's Affirmative and Negative Intentions

화자의 긍정·부정 의도를 전달하는 실용적 텔레프레즌스 로봇 시스템의 개발

  • Jin, Yong-Kyu (Dept. of Information and Communications Engineering, Hansung University) ;
  • You, Su-Jeong (Korea Institute of Industrial Technology) ;
  • Cho, Hye-Kyung (Dept. of Information and Communications Engineering, Hansung University)
  • Received : 2015.04.09
  • Accepted : 2015.04.30
  • Published : 2015.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

A telerobot offers a more engaging and enjoyable interaction with people at a distance by communicating via audio, video, expressive gestures, body pose and proxemics. To provide its potential benefits at a reasonable cost, this paper presents a telepresence robot system for video communication which can deliver speaker's head motion through its display stanchion. Head gestures such as nodding and head-shaking can give crucial information during conversation. We also can assume a speaker's eye-gaze, which is known as one of the key non-verbal signals for interaction, from his/her head pose. In order to develop an efficient head tracking method, a 3D cylinder-like head model is employed and the Harris corner detector is combined with the Lucas-Kanade optical flow that is known to be suitable for extracting 3D motion information of the model. Especially, a skin color-based face detection algorithm is proposed to achieve robust performance upon variant directions while maintaining reasonable computational cost. The performance of the proposed head tracking algorithm is verified through the experiments using BU's standard data sets. A design of robot platform is also described as well as the design of supporting systems such as video transmission and robot control interfaces.

Keywords

References

  1. M. Minsky, Telepresence, Omni, pp.45-51, 1980.
  2. S. Coradeschi and et aI., "Towards a methodology for longitudinal evaluation of social robotic telepresence for elderly," HRI 2011 Workshop on Social Robotic Telepresence.
  3. K.M. Tsui, A. Norton, and et aI., "Designing telepresence robot Systems for use by people with special needs," Proceedings of the International Symposiurn on Quality of Life Teclmologies 2011.
  4. J. H. Lee and S. K., Kang "Trends of tele-presence technology standards," Journal of The Korean Institute of Communication Sciences, vol. 29, no. 12, pp.25-30, 2012.
  5. E. Paulos and J. Canny, "Social tele-embodiment: Understanding presence," Autonomous Robots, vol. 11, no. 1, pp. 87-95, 2001. https://doi.org/10.1023/A:1011264330469
  6. E. Murphy-Chutorian and M.T. Mohan, "Head pose estimation in computer vision: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp.607-626, 2009. https://doi.org/10.1109/TPAMI.2008.106
  7. M.L. Cascia, S. Stan, and A. Vassilis, "Fast, reliable head tracking under varying illumination: An Approach based on registration of texture-mapped 3D models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 4, pp.322-336, 2000. https://doi.org/10.1109/34.845375
  8. C. Basu I.A. Essa, and A.P. Pentland, "Motion regularization for model-based head tracking," in Proc. of International Conference on Pattern Recognition, 1996.
  9. C. Harris and M. Stephens, "A combined comer and edge detector," in Proc. of 4th Alvey Vision Conference, pp.141-151, 1988.
  10. B.D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. of Imaging Understanding Workshop, pp.121-130, 1981.
  11. D.F. DeMenthon and L.S. Davis, "Model-based object pose in 25 lines of code," International Journal of Computer Vision, vol. 15, pp.335-343, 1995.
  12. http://opencv.org/
  13. http://opengl.org/
  14. P. Viola and M. Jones, "Robust real-time face detection," International Journal of Computer Vision, vol. 57, no. 2, pp.137-154, 2004 https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  15. Anna Kim et aI., "A Method for Improving Accuracy of Object Recognition and Pose Estimation by Using Kinect sensor," Journal of Korea Robotics Society, vol. 10, no. 1, pp.16-23, 2015. https://doi.org/10.7746/jkros.2015.10.1.016
  16. Kim Juchang et aI., "Primitive Body Model Encoding and Selective/Asynchronous Input-Parallel State Machine for Body Gesture Recognition," Journal of Korea Robotics Society, vol. 8, no. 1, pp.1-7, 2013. https://doi.org/10.7746/jkros.2013.8.1.001