Browse > Article

Tele-presence System using Homography-based Camera Tracking Method  

Kim, Tae-Hyub (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University)
Choi, Yoon-Seok (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University)
Nam, Bo-Dam (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University)
Hong, Hyun-Ki (Dept. of Imaging Science and Arts, GSAIM, Chung-Ang University)
Publication Information
Abstract
Tele-presence and tele-operation techniques are used to build up an immersive scene and control environment for the distant user. This paper presents a novel tele-presence system using the camera tracking based on planar homography. In the first step, the user wears the HMD(head mounted display) with the camera and his/her head motion is estimated. From the panoramic image by the omni-directional camera mounted on the mobile robot, a viewing image by the user is generated and displayed through HMD. The homography of 3D plane with markers is used to obtain the head motion of the user. For the performance evaluation, the camera tracking results by ARToolkit and the homography based method are compared with the really measured positions of the camera.
Keywords
Tele-presence; mobile robot; HMD; omni-directional camera; homography;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented reality: a class of displays on the reality-virtuality continuum," in Proc. of Telemanipulator and Telepresence Technologies, Vol. 2351, pp. 282-292, 1994.
2 G. Mantovani, G. Riva "Real presence : how different ontologies generate different criteria for presence, telepresence, and virtual presence," MIT press., 1999.
3 S. Dasgupta and A. Banerjee, "An augmented-reality-based real-time panoramic vision system for autonomous navigation," IEEE Trans. on Systems, Man, and Cybernetics, Vol. 36, No. 1, pp. 154-161, 2006.   DOI
4 M. Fiala, "Pano-presence for teleoperation," in Proc. of Intelligent Robots and Systems, pp. 3798-3802, 2005.
5 H. Kato and M. Billinghurst, "Marker tracking and HMD calibration for a video-based augmented reality conferencing system," in Proc. of IWAR, pp. 85-94, 1999.
6 D. Abawi and J. Bienwald, "Accuracy in optical tracking with fiducial markers : an accuracy function for ARToolKit," in Proc. ISMAR, pp. 260-261, 2004.
7 A. Takagi, S. Yamazaki, Y. Saito, and N. Taniguchi, "Development of a stereo video see-through HMD for AR systems," in Proc. of ISAR, pp. 68-77, 2000.
8 H. Nagahara, Y. Yagi, and M. Yachida, "Wide field of view head mounted display for tele-presence with an omnidirectional image sensor," in Proc. of Omnidirectional Vision and Camera Networks, pp. 16, 2003.
9 K. Yamazawa, T. Ishikawa, T. Sato, S. Ikeda, Y. Nakamura, K. Fujikawa, H. Sunahara, and N. Yokoya, "Web-based telepresence system using omni-directional video streams," Lecture Notes on Computer Science, Vol. 3333, pp. 45-52, 2004.
10 H. Lee, D. Kim, M. Park, and G. Park, "Augmented reality based vision system for network based mobile robot," Lecture Notes on Computer Science, Vol. 5068, pp. 123-130, 2008.
11 http://www.hitl.washington.edu/artoolkit/
12 F. Dornaika and C. Garcia, "Robust camera calibration using 2D to 3D feature correspondences," Optical Science Engineering and Instrumentation, Videometrics V, Vol. 3174, 1999.
13 R. Hartley and A. Zisserman, Multiple view geometry, Cambridge University Press, 2004.