Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2006.13B.5.499

Reliable Camera Pose Estimation from a Single Frame with Applications for Virtual Object Insertion  

Park, Jong-Seung (인천대학교 컴퓨터공학과)
Lee, Bum-Jong (인천대학교 컴퓨터공학과)
Abstract
This Paper describes a fast and stable camera pose estimation method for real-time augmented reality systems. From the feature tracking results of a marker on a single frame, we estimate the camera rotation matrix and the translation vector. For the camera pose estimation, we use the shape factorization method based on the scaled orthographic Projection model. In the scaled orthographic factorization method, all feature points of an object are assumed roughly at the same distance from the camera, which means the selected reference point and the object shape affect the accuracy of the estimation. This paper proposes a flexible and stable selection method for the reference point. Based on the proposed method, we implemented a video augmentation system that inserts virtual 3D objects into the input video frames. Experimental results showed that the proposed camera pose estimation method is fast and robust relative to the previous methods and it is applicable to various augmented reality applications.
Keywords
Camera Pose From Orthography; Camera Tracking; Virtual Object Insertion;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. Poleman and T. Kanade, 'A paraperspective factori zation method for shape and motion recovery,' IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.206-218, 1997   DOI   ScienceOn
2 D. Dementhon and L. Davis, 'Model-based object pose in 25 lines of code,' International Journal of Computer Vision, pp.123-141, 1995   DOI
3 Z. Zhang, 'A flexible new technique for camera calibration,' IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.1330-1334, 2000   DOI   ScienceOn
4 C. Tomasi and T. Kanade, 'Shape and motion from image streams under orthography: A factorization approach,' International Journal of Computer Vision, pp.137-154, 1992   DOI
5 D. Oberkampf, D. Dementhon, and L. Davis, 'Iterative pose estimation using coplanar feature points,' Comput. Vis. Image Underst., pp.495-511, 1996   DOI   ScienceOn
6 X. Zhang, S. Fronz, and N. Navab, 'Visual Marker Detection and Decoding in AR Systems: A Comparative Study,' International Symposium on Mixed and Augmented Reality, p.97, 2002   DOI
7 M. Pressigout and E. Marchand, 'Real Time Planar Structure Tracking for Visual Servoing: a Contour and Texture Approach,' IEEE Intelligent Robots and System, pp.251-256, August, 2005   DOI
8 R. Carceroni and C. Brown, 'Numerical methods for model based pose recovery,' Technical Report 659, The University of Rochester, New York, 1997
9 H. Park and J.-I. Park, 'Invisible Marker Tracking for AR,' Third IEEE and ACM International Symposium on Mixed and Augmented Reality, pp.272-273, 2004   DOI
10 A. Ali and S. Afghani, 'Support Vectors a Way to Adapt for Lane Marker Tracking: A Step towards Intelligent Transportation Systems,' Proceeding of IEEE and International Conference on Emerging Technologies, pp. 151 -156, September, 2005   DOI
11 Y.-K. Jung, K.-W. Lee, and Y.-S. Ho, 'Feature-Based Object Tracking with an Active Camera,' Proceedings of the Third IEEE Pacific Rim Conference on Multimedia, pp. 1137-1144, 2002
12 K. Kutulakos and J. Vallino, 'Calibration-free augmented reality,' IEEE Transactions on Visualization and Computer Graphic, pp.346- 359, October, 2000   DOI   ScienceOn
13 G. Simon, A. Fitzgibbon, and A. Zisserman, 'Markerless tracking using planar structures in the scene,' Proceeding of IEEE and ACM International Symposium on Augmented Reality, pp.120-128, 2000   DOI
14 S. Yamamoto and S. Hirai, 'Robust and Video-frame Rate Tracking of Planar Motion by Matched Filtering on FPGA,' Proceeding of IEEE and International Conference on Robotics & Automation, pp.4707-4712, April, 2004   DOI
15 J. Heikkila, 'Accurate camera calibration and feature based 3-D reconstruction from monocular image sequences,' Ph.D. dissertation, University of Oulu, Finland, 1997
16 M. Lourakis and A. Argyros, 'Vision-Based Camera Motion Recovery for Augmented Reality,' Computer Graphics International, pp.569-576, 2004   DOI
17 S. Gibson, J. Cook, T. Howard, R. Hubbold, and D. Oram, 'Accurate camera calibration for off-line, video-based augmented reality,' Proceedings of International Symposium on Mixed and Augmented Reality, pp.37 -46, 2002   DOI
18 M. Lourakis and A. Argyros, 'Camera Matchmoving in Unprepared, Unknown Environments,' Computer Vision and Pattern Recognition, p.1190, 2005   DOI