Browse > Article
http://dx.doi.org/10.5909/JEB.2011.16.4.614

Real-Time Camera Tracking for Markerless Augmented Reality  

Oh, Ju-Hyun (Technical Research Institute, KBS)
Sohn, Kwang-Hoon (School of Electrical and Electronic Engineering, Yonsei University)
Publication Information
Journal of Broadcast Engineering / v.16, no.4, 2011 , pp. 614-623 More about this Journal
Abstract
We propose a real-time tracking algorithm for an augmented reality (AR) system for TV broadcasting. The tracking is initialized by detecting the object with the SURF algorithm. A multi-scale approach is used for the stable real-time camera tracking. Normalized cross correlation (NCC) is used to find the patch correspondences, to cope with the unknown and changing lighting condition. Since a zooming camera is used, the focal length should be estimated online. Experimental results show that the focal length of the camera is properly estimated with the proposed online calibration procedure.
Keywords
Machine vision; real time systems; tracking; TV cameras;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 D. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol.60, pp.91-110, 2004.   DOI
2 J. Yu, J. Kim, H. Kim, I. Choi, and I. Jeong, "Real-time camera tracking for augmented reality," Int. Conf. on Advanced Communication Technology (ICACT), Feb. 2009.
3 H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol.110, pp.346-359, Jun. 2008.   DOI   ScienceOn
4 J. Oh and K. Sohn, "Semiautomatic zoom lens calibration based on the camera's rotation," SPIE Journal of Electronic Imaging, 20(2), Apr-Jun. 2011.
5 W. Liu, Y. Wang, J. Chen, and J. Guo, "An efficient zoom tracking method for pan-tilit-zoom camera," IEEE Int. Conf. on Computer Science and Information Technology (ICCSIT), pp.536-540, Jul. 2010.   DOI
6 Z. Y. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, pp.1330-1334, Nov. 2000.   DOI   ScienceOn
7 R. Hartley and A. Zisserman, Multiple view geometry in computer vision, Cambridge University Press, 2003.
8 M. Lourakis, "A brief description of the Levenberg-Marquardt algorithm implemented by levmar," matrix, 3(2), 2005.
9 M. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Communications of the ACM, vol.24, pp.381-395, 1981.   DOI   ScienceOn
10 Q. Wang, W. W. Zhang, X. O. Tang, and H. Y. Shum, "Real-time Bayesian 3-D pose tracking," IEEE Transactions on Circuits and Systems for Video Technology, vol.16, pp.1533-1541, Dec. 2006.   DOI   ScienceOn
11 A. I. Comport, E. Marchand, M. Pressigout, and F. Chaumette, "Real-time markerless tracking for augmented reality: The virtual visual servoing framework," IEEE Transactions on Visualization and Computer Graphics, vol.12, pp.615-628, 2006.   DOI   ScienceOn
12 M. Pressigout and E. Marchand, "Real-time hybrid tracking using edge and texture information," International Journal of Robotics Research, vol.26, pp.689-713, Jul. 2007.   DOI
13 "Total Immersion: Augmented reality software solutions with D'Fusion," http://www.t-immersion.com/, 2010.
14 V. Lepetit and P. Fua, "Keypoint recognition using randomized trees," IEEE Transactions on Patteren Analysis and Machine Intelligence, 28(9), pp.1465-1479, 2006.   DOI   ScienceOn
15 D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, "Real-Time Detection and Tracking for Augmented Reality on Mobile Phones," IEEE Transactions on Visualization and Computer Graphics, vol.16, pp.355-368, May-Jun. 2010.   DOI   ScienceOn
16 M. Ozuysal, P. Fua, and V. Lepetit, "Fast keypoint recognition in ten lines of code," in IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8, 2007.   DOI
17 Z. Chen and X. Li, "Markerless tracking based on natural feature for autmented reality," Int. Conf. on Educational and Information Technology (ICEIT), Sep. 2010.
18 D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, "Pose tracking from natural features on mobile phones," Int. Symposium on Mixed and Augmented Reality, pp.125-134, 2008.
19 박성 춘, 남승진, 오주현, 박창섭, "색상패턴 추적을 이용한 실시간 증강영상 시스템," 방송공학회논문지 제7권 제1호, pp.2-9, 2002년 3월.   과학기술학회마을
20 V. Lepetit and P. Fua, Monocular Model-based 3D Tracking of Rigid Objects, Now Publishers Inc, 2005.
21 T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.24, pp.932-946, Jul. 2002.   DOI   ScienceOn
22 G. Simon, A. Fitzgibbon, and A. Zisserman, "Markerless tracking using planar structures in the scene," Int. Symposium on Augmented Reality (ISAR), pp.120-128, Oct. 2000.
23 L. Vacchetti, V. Lepetit, and P. Fua, "Stable Real-Time 3D Tracking Using Online and Offline Information," IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(10), pp.1385-1391, 2004.   DOI   ScienceOn