Browse > Article

Depth Estimation and Intermediate View Synthesis for Three-dimensional Video Generation  

Lee, Sang-Beom (광주과학기술원 정보통신공학과)
Lee, Cheon (광주과학기술원 정보통신공학과)
Ho, Yo-Sung (광주과학기술원 정보통신공학과)
Publication Information
The Journal of Korean Institute of Communications and Information Sciences / v.34, no.10B, 2009 , pp. 1070-1075 More about this Journal
Abstract
In this paper, we propose new depth estimation and intermediate view synthesis algorithms for three-dimensional video generation. In order to improve temporal consistency of the depth map sequence, we add a temporal weighting function to the conventional matching function when we compute the matching cost for estimating the depth information. In addition, we propose a boundary noise removal method in the view synthesis operation. after finding boundary noise areas using the depth map, we replace them with corresponding texture information from the other reference image. Experimental results showed that the proposed algorithm improved temporal consistency of the depth sequence and reduced flickering artifacts in the virtual view. It also improved visual quality of the synthesized virtual views by removing the boundary noise.
Keywords
Multi-View Video; Depth Map; View Synthesis; Temporal Consistency; Boundary Noise;
Citations & Related Records
연도 인용수 순위
  • Reference
1 ISO/IEC JTC1/SC29/WG11, 'Vision on 3D Video,' N10357, Feb. 2009
2 S.-B. Lee, C. Lee, and Y.-S. Ho, 'Temporal Consistency Enhancement of Background for Depth Estimation,' in Proc. of 3D Systems and Applications, pp. S08-01.1~4, April, 2009
3 D. Sharstein and R. Szeliski, 'A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms,' Proc. of IEEE Workshop on Stereo and Multi-Baseline Vision, pp. 131-140, Dec. 2001
4 C.L. Zitnick, S.B. Kang, M. Uyttendaele, S. Winder, R. Szeliski, 'High-quality Video View Interpolation Using a Layered Representation,' in Proc. of SIGGRAPH'04, pp. 600-608, Aug. 2004
5 ISO/IEC JTC1/SC29/WG11 'Reference Softwares for Depth stimation and View Synthesis,' M15377, April 2008
6 ISO/IEC JTC1/SC29/WG11 'HHI Test Material for 3D Video,' M15413, April 2008
7 A. Smolic, K. Muller, P. Merkle, C. Fehn, P. Kauff, P. Eisert, and T. Wiegand, '3D Video and Free Viewpoint Video - Technologies, Applications and MPEG Standards,' IEEE International Conference on Multimedia and Expo, pp. 2161-2164, July 2006
8 C. Fehn, 'Depth-image-based Rendering (DIBR), Compression and Transmission for a New Approach on 3DTV,' Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems, vol. 5291, pp. 93-104, 2004
9 ISO/IEC JTC1/SC29/WG11 'Call for Contributions on 3D Video Test Material,' N9595, Jan. 2008
10 ISO/IEC JTC1/SC29/WG11 'Multiview Video Test Sequence and Camera Parameters,' M15419, April 2008
11 ISO/IEC JTC1/SC29/WG11 '1D Parallel Test Sequences for MPEG-FTV,' M15378, April 2008
12 W. R. Mark, L. McMillan, G. Bishop, 'Post-Rendering 3D Warping,' in Proc. of Symposium on Interactive 3D Graphics, pp. 7-16, April 1997
13 ISO/IEC JTC1/SC29/WG11 'Contribution for 3D Video Test Material of Outdoor Scene,' M15371, April 2008