Browse > Article
http://dx.doi.org/10.5909/JEB.2012.17.2.363

Intermediate Depth Image Generation using Disparity Increment of Stereo Depth Images  

Koo, Ja-Myung (Kwangwoon University)
Seo, Young-Ho (Kwangwoon University)
Choi, Hyun-Jun (Mokpo National Maritime University)
Yoo, Ji-Sang (Kwangwoon University)
Kim, Dong-Wook (Kwangwoon University)
Publication Information
Journal of Broadcast Engineering / v.17, no.2, 2012 , pp. 363-373 More about this Journal
Abstract
This paper proposes a method to generate a depth image at an arbitrary intermediate view-point, which is targeting a video service for free-view, auto-stereoscopy, holography, etc. It assumes that the leftmost and the rightmost depth images are given and they both have been camera-calibrated and image-rectified. This method calculates and uses a disparity increment per depth value. In this paper, it is obtained by stereo matching for the given two depth image by considering more general cases. The disparity increment is used to find the location in the intermediate view-point depth image (IVPD) for each depth in the given images. Thus, this paper finds two IVPDs, from left image and from right image. Noises are removed and holes are filled in each IVPDs and the two results are combined to get the final IVPD. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated IVPD corresponds to 33.84dB of PSNR in average and it takes about 1 second to generate a HD IVPD. We evaluate that this image quality is quite good by considering the low correspondency among the left images, intermediate images, and the right images in the test sequences. If the execution speed is improved, the proposed method can be a very useful method to generate an IVPD at an arbitrary view-point, we believe.
Keywords
depth map; intermediate view-point; depth camera; stereo matching; disparity increment;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. A. Benton and V. M. Bove, Holographic Imaging, John Wiley & Sons, Hoboken, NJ, 2008.
2 S. Reichelt, et al., "Holographic 3-D Displays - Electro-holography within the Grasp of Commercialization", A part of the Book named as Advances in Lasers and Electro Optics, INTECH, pp. 683-710, April 2010.
3 http://vision.middlebury.edu/stereo/.
4 SR4000Data Sheet, http://www.mesa-imaging.ch/prodview4k.php, MESA Imaging, Oct. 2010.
5 J. L. Wilson, Microsoft kinect for Xbox 360, PC Mag. Com, Nov. 10, 2010.
6 A. Smolic, et al., "Intermediate View Interpolation based on Multiview Video plus Depth for Advanced 3D Video Systems," IEEE ICIP, pp.2448-2451, 2008.
7 Y. Mori, et al., "View Generation with 3D Warping using Depth Information for FTV," Elsevier J.of Image Communications, Vol. 24, pp. 65-72, Oct. 2008.
8 M. Zararim, et al., "A Joint Multivew plus Depth image Coding Scheme Based on 3D Warping," ACM Conf. on 3DVP, 2010.
9 G. Cheung, et al., "On Dependent Bit Allocation for Multiview Image Coding with Depth-Image-Based Rendering", IEEE Trans. on Image Processing, Vol. 20, No. 11, pp. 3179-3194, Nov. 2011.   DOI   ScienceOn
10 E. K. Lee, et al., "High-Resolution Depth Map Generation by Applying Stereo Matching based on Initial Depth Information," IEEE 3DTV-CON, pp. 201-204, 2008.
11 S. Y. Kim, et al., "Generation of ROI Enhanced Depth Maps using Stereoscopic Cameras and a Depth Camera, " IEEE Trans. on Broadcasting, Vol. 54, No. 4, pp. 732-739, Dec. 2008.   DOI   ScienceOn
12 Edited by Oliver Schreer, et al., 3D Video Communication, John Wiley and Sons, West Sussex, England, 2005.
13 Chia-Ming Cheng, et al., "Spatio-Temporally Consistent Novel View Synthesis Algorithm from Video-plus-Depth Sequences for Autostereoscopic Displays," IEEE Trans. on Broadcasting, Vol. 57, No. 2, pp. 523-532, June 2011.   DOI   ScienceOn
14 Li Yu, et al., "Depth based View Synthesis with Artifacts Removal for FTV," IEEE Intl. Conf. on Image and Graphics, pp. 506-510, 2011.