Browse > Article
http://dx.doi.org/10.5909/JBE.2010.15.1.003

A High-Quality Occlusion Filling Method Using Image Inpainting  

Kim, Yong-Jin (Dept. of Electrical and Computer Engineering, Hanyang University)
Lee, Sang-Hwa (Dept. of Electrical Eng. and Computer Science, Seoul National University)
Park, Jong-Il (Dept. of Electrical and Computer Engineering, Hanyang University)
Publication Information
Journal of Broadcast Engineering / v.15, no.1, 2010 , pp. 3-13 More about this Journal
Abstract
In this paper, we propose a method for filling out the occlusions in generating multi-view images from one source image and its ground-truth depth image. The method is based on image inpainting and layered interpolation. The source image is first divided into several layers using depth information. The occlusions are interpolated separately in every layered image using the image inpainting algorithm. Finally, the interpolated layered images are combined to obtain different viewpoint images. Interpolating occlusions with depth-correlated texture information that is contained to each layer makes it possible to obtain more detailed and accurate results than previous methods. The effectiveness of the proposed method is shown through experimental results.
Keywords
Image inpainting; View synthesis; Occlusion;
Citations & Related Records
연도 인용수 순위
  • Reference
1 L. Zhang, W.J. Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Trans. on Broadcasting, vol.51, no.2, pp. 191-199, 2005   DOI   ScienceOn
2 A. Saxena, S. H. Chung, and A. Y. Ng, "3-D Depth Reconstruction from a Single Still Image," International Journal of Computer Vision (IJCV), 2007.
3 A. Criminisi, P. Perez and K. Toyama, "Region Filling and Object Removal by Exemplar-based Image Inpainting," IEEE Trans. Image Processing, vol.13, no.9, pp. 1200-1212, 2004.   DOI   ScienceOn
4 C. Fehn and P. Kauff, "Interactive Virtual View Video (IVVV): The Bridge between 3D-TV and Immersive TV," Proc. of SPIE Three-Dimensional TV, Video and Display, pp. 14-25, 2002.
5 S. Avidan and A. Shashua, "Novel View Synthesis by Cascading Trilinear Tensors," IEEE Trans. Visualization and Computer Graphics, vol.4 no.4, pp.293-306, 1998.   DOI   ScienceOn
6 M. Bleyer, M. Gelautz, and C. Rother, C. Rhemann, "A stereo approach that handles the matting problem via image warping," Computer Vision and Pattern Recognition, 2009.
7 K.-J. Oh, S. Yea, and Y.-S. Ho, "Hole-filling method using depth based in-painting for view synthesis in free viewpoint television (FTV) and 3D video," Proc. of Picture Coding Symposium (PCS), 2009.
8 http://vision.middlebury.edu/stereo
9 ITU-R Recommendation BT.500-10, "Methodology for the Subjective Assessment of the Quality of Television Pictures," 2002.
10 C. Fehn, "Depth-image-based Rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV," Proc. of SPIE, Stereoscopic Displays and Virtual Reality Systems XI, pp. 93-104, 2004.
11 J. R. Ohm, "Stereo/Multi-view Video Encoding Using the MPEG Family of Standards," Proc. of Electronic Imaging, Invited Paper, 1999.
12 J. Sun, L. Yuan, J. Jia and H. Y. Shum, "Image Completion with Structure Propagation," Proc. of ACM SIGGRAPH, Vol.24, pp. 861-868, 2005.   DOI   ScienceOn
13 I. Drori, D. Cohen-Or and H. Yeshurun, "Fragment-Based Image Completion," Proc. of ACM SIGGRAPH, Vol. 22, pp. 303-312, 2003.   DOI   ScienceOn
14 M. M. Oliveira, B. Bowen, R. McKenna and Y. S. Chang, "Fast Digital Image Inpainting," Proc. of the International Conference on Visualization Imaging and Image Processing, pp. 261-266, 2001.
15 A. Efros and W. T. Freeman, "Image Quilting for Texture Synthesis and Transfer," Proc. of ACM SIGGRAPH, pp. 341-346, 2001.
16 K. Wegner and O. Stankiewicz, "Similarity measures for depth estimation," Proc. of 3DTV Conference: The True Vision," - Capture, Transmission and Display of 3D Video, 2009.
17 J.-F. Lalonde and A. Efors, "Using Color Compatibility for Assessing Image Realism," Proc. of IEEE International Conference on Computer Vision, pp. 1-8, 2007.
18 D. Scharstein, "View Synthesis Using Stereo Vision," Springer Press, 1999.
19 A. Efros and T. Leung, "Texture Synthesis by Non-parametric Sampling," Proc. of IEEE International Conference on Computer Vision , pp. 1033-1038, 1999.
20 S. Battiatoa, S. Curtib, M. L. Casciac, M. Tortorac and E. Scordatoc, "Depth Map Generation by Image Classification," Proc. of SPIE Electronic Imaging, pp. 95-104, 2004.