Browse > Article
http://dx.doi.org/10.5909/JEB.2012.17.2.411

Precise Rectification of Misaligned Stereo Images for 3D Image Generation  

Kim, Jae-In (Department of Geoinformatic Engineering, Inha University)
Kim, Tae-Jung (Department of Geoinformatic Engineering, Inha University)
Publication Information
Journal of Broadcast Engineering / v.17, no.2, 2012 , pp. 411-421 More about this Journal
Abstract
The stagnant growth in 3D market due to 3D movie contents shortage is encouraging development of techniques for production cost reduction. Elimination of vertical disparity generated during image acquisition requires heaviest time and effort in the whole stereoscopic film-making process. This matter is directly related to competitiveness in the market and is being dealt with as a very important task. The removal of vertical disparity, i.e. image rectification has been treated for a long time in the photogrammetry field. While computer vision methods are focused on fast processing and automation, photogrammetry methods on accuracy and precision. However, photogrammetric approaches have not been tried for the 3D film-making. In this paper, proposed is a photogrammetry-based rectification algorithm that enable to eliminate the vertical disparity precisely by reconstruction of geometric relationship at the time of shooting. Evaluation of proposed algorithm was carried out by comparing the performance with two existing computer vision algorithms. The epipolar constraint satisfaction, epipolar line accuracy and vertical disparity of result images were tested. As a result, the proposed algorithm showed excellent performance than the other algorithms in term of accuracy and precision, and also revealed robustness about position error of tie-points.
Keywords
Sterevision; 3D Movie; Rectification; Epipolar geometry; Photogrammetry;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vistion, vol.60, no.2, pp.91-110, Nov. 2004.   DOI
2 P. R. Wolf and B. A. Dewitt, Elements of photogrammetry with application in GIS, 3rd Ed., New York: McGraw-Hill, 2000.
3 OpenCV library, http://sourceforge.net/projects/opencvlibrary.
4 T. M. Lambooij, W. A. Ijsselsteijn and I. Heynderickx, "Visual discomfort in stereoscopic displays: A review," in Proc. SPIE, vol. 6490, pp. 64900I, Jan. 2007.
5 Y.-S. Kang and Y.-S. Ho, "An efficient image rectification method for parallel multi-camera arrangement," IEEE Trans. Consumer Electronics, vol. 57, no. 3, pp. 1041-1048, Aug. 2011.   DOI   ScienceOn
6 Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.11, pp.1330-1334, Nov. 2000.   DOI   ScienceOn
7 R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd Ed., New York: Cambridge, 2003.
8 H. C. Longuet-Higgins, "A Computer Algorithm for Reconstructing a Scene from Two Projections", Nature, vol. 293, pp. 133-135, 1981.   DOI
9 R. I. Hartley, "In defence of the eight-point algorithm," Proc. of IEEE International Conference on Computer Vision, pp.1064-1070, Jun. 1995.
10 T. Kim and I. Dowman, 2006. "Comparison of two physical sensor models for satellite images: position-rotation model and orbit-attitude model," The Photogrammetric Record, Vol. 21, No. 114, pp. 110-123, June 2006.   DOI   ScienceOn
11 H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "SURF: Speeded up robust features," Computer Vision and Image Understanding, vol.110, no.3, pp.346-359, Sep. 2008   DOI   ScienceOn
12 T. Kim, H. Kim and S. Rhee, "Investigation of Physical Sensor Models for Modelling SPOT 3 Orbits," The Photogrammetric Record, Vol. 22, No. 119, pp. 257-273, Sep. 2007.   DOI   ScienceOn
13 T. Kim and J. Jeong, 2011. "DEM matching for bias compensation of rigorous pushbroom sensor models," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 66, no. 5, pp. 692-699, Spe. 2011.   DOI   ScienceOn
14 T. Kim, "A study on the epipolarity of linear pushbroom images," Photogrammetric Engineering and Remote Sensing, Vol. 66, No. 8, pp.961-966, Aug. 2000.