Browse > Article

Projective Reconstruction Method for 3D modeling from Un-calibrated Image Sequence  

Hong Hyun-Ki (Dept. of Image Eng., Graduate School of Advanced Imaging Science Multimedia & Film, chung-Ang Univ.)
Jung Yoon-Yong (Dept. of Image Eng., Graduate School of Advanced Imaging Science Multimedia & Film, chung-Ang Univ.)
Hwang Yong-Ho (Dept. of Image Eng., Graduate School of Advanced Imaging Science Multimedia & Film, chung-Ang Univ.)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.42, no.2, 2005 , pp. 113-120 More about this Journal
Abstract
3D reconstruction of a scene structure from un-calibrated image sequences has been long one of the central problems in computer vision. For 3D reconstruction in Euclidean space, projective reconstruction, which is classified into the merging method and the factorization, is needed as a preceding step. By calculating all camera projection matrices and structures at the same time, the factorization method suffers less from dia and error accumulation than the merging. However, the factorization is hard to analyze precisely long sequences because it is based on the assumption that all correspondences must remain in all views from the first frame to the last. This paper presents a new projective reconstruction method for recovery of 3D structure over long sequences. We break a full sequence into sub-sequences based on a quantitative measure considering the number of matching points between frames, the homography error, and the distribution of matching points on the frame. All of the projective reconstructions of sub-sequences are registered into the same coordinate frame for a complete description of the scene. no experimental results showed that the proposed method can recover more precise 3D structure than the merging method.
Keywords
3D Reconstruction; Camera Calibration; Image Sequence; Projective Reconstruction; Factorization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. S. Intille and A. F. Bobick, 'Disparity-space images and large occlusion stereo,' 2nd European Conference on Computer Vision, pp. 179-186, Stockholm Sweden, 1994
2 Z. Zhang, 'Computing rectifying homographies for stereo vision,' In proc. of IEEE CVPR, pp. 125-131, Fort Collins Colorado, June 1999   DOI
3 C. J. Tasi and A. K. Katsaggelos, ' Dense Disparity Estimation with a Divide-and-Conquer Disparity Space Image Technique,' IEEE, Trans. Multimedia, Vol.1, No.1, pp.18-29, March, 1999   DOI
4 B. Triggs, 'Autocalibration and the absolute quadric,' In proc of IEEE CVPR, pp. 609-614, 1997   DOI
5 R. Hartley, 'In Defence of the 8-Point algorithm,' In proc. IEEE ICCV, pp. 1064-1070, 1995   DOI
6 A. Heyden, R. Berthilsson, and G. Sparr, 'An iterative factorization method for projective structure and motion from image sequences,' Image and Vision Computing, pp. 981-991, 1999   DOI   ScienceOn
7 S. Gibson, R. J. Hubbold, J. Cook, and T. Howard, 'Interactive reconstruction of virtual environments from video sequences,' Computer Graphics, vol. 27, pp. 293-301, 2003   DOI   ScienceOn
8 T. Sato, M. Kanbara, N. Yokoya, and H. Takemura, 'Dense 3-D reconstruction of outdoor scene by hundreds-baseline stereo using a hand-held video camera,' In proc. of IEEE Workshop on Stereo and Multi-baseline vision, 2001   DOI
9 Debevec, P., C. Taylor and J. Malik, 'Modeling and Rendering Architecture from Photographs,' SIGGRAPH96, pp. 11-20, 1996   DOI
10 Takeo Kanade, Masatoshi Okutomi, 'A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment,' IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 16, no. 9, Sept, 1994   DOI   ScienceOn
11 A. Chiuso, P. Favaro, H. Jin, and S. Soatto, 'Motion and structure causally integrated over time,' IEEE Trans. on Pattern Matching and Machine Intelligence, vol. 24, no .4, pp. 523-535, April 2002   DOI   ScienceOn
12 P. Sturm and B. Triggs, 'A factorization based algorithm for multi-image projective structure and motion,' In proc of 4th European Conference on Computer Vision Cambridge, England, pp. 707-720, April 1996
13 R. Hartley and A. Zisserman, Mutiple View Geometry in Computer Vision, Cambrige Univ. Press. 2000
14 K. Cornelis, M. Pollefeys, M. Vergauwen, and L. V. Gool, 'Augmented reality from uncalibrated video sequences,' In proc SMILE 2000, Lecture Notes in Computer Science, vol. 2018, pp. 144-160, 2001
15 A. W. Fitzgibbon and A. Zisserman, 'Automatic camera recovery for closed or open image sequences,' In proc of 6th European Conference on Computer Vision, pp. 311-326, June 1998   DOI
16 S. Gibson, J. Cook, T. Howard, R. Hubbold, and D. Oram, 'Accurate camera calibration for off-line, video-based augmented reality,' In proc. IEEE and ACM ISMAR, Darmstadt, Germany, Sep.2002   DOI