Browse > Article
http://dx.doi.org/10.5909/JBE.2007.12.2.128

Multi-view Video Coding using View Interpolation  

Lee, Cheon (School of Information and Mechatronics Gwangju Institute of Science and Technology (GIST))
Oh, Kwan-Jung (School of Information and Mechatronics Gwangju Institute of Science and Technology (GIST))
Ho, Yo-Sung (School of Information and Mechatronics Gwangju Institute of Science and Technology (GIST))
Publication Information
Journal of Broadcast Engineering / v.12, no.2, 2007 , pp. 128-136 More about this Journal
Abstract
Since the multi-view video is a set of video sequences captured by multiple array cameras for the same three-dimensional scene, it can provide multiple viewpoint images using geometrical manipulation and intermediate view generation. Although multi-view video allows us to experience more realistic feeling with a wide range of images, the amount of data to be processed increases in proportion to the number of cameras. Therefore, we need to develop efficient coding methods. One of the possible approaches to multi-view video coding is to generate an intermediate image using view interpolation method and to use the interpolated image as an additional reference frame. The previous view interpolation method for multi-view video coding employs fixed size block matching over the pre-determined disparity search range. However, if the disparity search range is not proper, disparity error may occur. In this paper, we propose an efficient view interpolation method using initial disparity estimation, variable block-based estimation, and pixel-level estimation using adjusted search ranges. In addition, we propose a multi-view video coding method based on H.264/AVC to exploit the intermediate image. Intermediate images have been improved about $1{\sim}4dB$ using the proposed method compared to the previous view interpolation method, and the coding efficiency have been improved about 0.5 dB compared to the reference model.
Keywords
multi-view video coding; view interpolation; disparity estimation; view synthesis;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. Smolic, K. Mueleer, T. Rein, P. Eisert, and T. Wiegand, 'Free Viewpoint Video Extraction, Representation, Coding, and Rendering,' Proceeding of IEEE International Conference on Image Processing. Vol. 5. pp. 3287-3290, 2004
2 ISO/IEC JTC1/SC29/WG11, 'Application and Requirements for 3DAV,' N4982, 2002
3 M. Levoy, and P. Hanrahan, 'Light Field Rendering,' Proceedings of SIGGRAPH, pp. 31-42, 1996
4 L. McMillan, 'An Image-based Approach to Three-dimensional Computer Graphics,' Technical report, PH.D. Dissertation, UNC Computer Science, TR97-013, 1999
5 M. Droese, T. Fujii, and M. Tanimoto, 'Ray-Space Interpolation based on Filtering in Disparity Domain,' Proc. 3D Conference, pp. 213-216, 2004
6 ISO/IEC JTC1/SC29/WG11, 'Description of Core Experiments in MVC,' N8017, 2006
7 A. Yuille, and T. Poggio, 'A Generalized Ordering Constraint for Stereo Correspondence,' MIT A.I. Laboratory Memo 777, 1984
8 D. Scharstein, and R. Szeliski, 'A Taxomony an Evaluation of Dense Two-frame Stereo Correspondence Algorithms,' IJCV, vol. 47, pp. 7-42, 2002   DOI
9 J. Shade, S. Gortler, L. He and R. Szeliski, 'Layered Depth Images,' Proceedings of SIGGRAPH, pp. 231-242, 1998
10 E. Chen and L. Williams, 'View Interpolation for Image Synthesis,' Proceedings of SIGGRAPH, pp. 279-288, 1993
11 A. Smolic and P. Kauff, 'Interactive 3D Video Representation and Coding Technologies,' Proc. of the IEEE, vol. 93, pp.99-110, 2005