Browse > Article
http://dx.doi.org/10.6109/jkiice.2015.19.1.127

Study on the Methods of Enhancing the Quality of DIBR-based Multiview Intermediate Images using Depth Expansion and Mesh Construction  

Park, Kyoung Shin (Department of Multimedia Engineering, Dankook University)
Kim, Jiseong (Department of Media Software, Sangmyung University)
Cho, Yongjoo (Department of Media Software, Sangmyung University)
Abstract
In this research, we conducted an experiment on evaluating the extending depth information method and surface reconstruction method and the interaction of these two methods in order to enhance the final intermediate view images, which are acquired using DIBR (Depth-Image-Based Rendering) method. We evaluated the experimental control groups using the Microsoft's "Ballet" and "Break Dancer" data sets with three different hole-filling algorithms. The result revealed that the quality was improved the most by applying both extending depth information and surface reconstruction method as compared to the previous point clouds only. In addition, it found that the quality of the intermediate images was improved vastly by only applying extending depth information when using no hole-filling algorithm.
Keywords
Depth-Image-Based Rendering; Mesh Construction; Extending depth information; Multiview Display;
Citations & Related Records
Times Cited By KSCI : 5  (Citation Analysis)
연도 인용수 순위
1 M. Kim and Y. Cho, "Design and Implementation of DIBR-based Multi-view Image Generation Simulation System", The Journal of Korean Institute of Information Technology, vol. 10, no. 8, pp. 189-198, Aug. 2012.
2 J. Lee and C. Kim, "Stereoscopic Image Generation with Optimal Disparity using Depth Map Preprocessing and Depth Information Analysis", Journal of Broadcast Engineering, vol. 14, no. 2, pp. 164-177, Jan. 2009.   DOI   ScienceOn
3 Z. Ni, D. Tian, S. Bhagavathy, J. Llach, and B. S. Manjunath, "Improving the Quality of Depth Image Based Rendering for 3D Video Systems", in Proceeding of IEEE International Conference on Image Processing, Santa Barbara, CA, pp. 513-516, 2009.
4 W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud, "Smoothing depth maps for improved stereoscopic image quality", in Proceedings of SPIE Conf. Three-Dimensional TV, Video, and Display III, Philadelphia, PA, vol. 5599, pp. 162-172, 2004.
5 W. J. Tam and L. Zhang, "Non-uniform smoothing of depth maps before image-based rendering", in Proceedings of SPIE Conf. Three-Dimensional TV, Video, and Display III, Philadelphia, PA, vol. 5599, pp. 173-183, 2004.
6 L, Zhang, W. J. Tam, "Stereoscopic image generation based on depth images for 3D TV," IEEE Trans. on Broadcasting, vol. 51, pp. 191-199, June 2005.   DOI
7 J. An and J. Yoo, "Seam Carving based Occlusion Region Compensation Algorithm", Journal of Broadcast Engineering, vol. 16, no. 7, pp. 573-583, Jul. 2011.   DOI
8 Y-J Kim, S. H. Lee, J-I Park, "A High-Quality Occlusion Filling Method Using Image Inpainting", Journal of Broadcast Engineering, vol. 15, no. 1, pp. 3-13, Jan. 2010.   DOI
9 M. Kim, Y. Cho, H-G Choo, J. Kim, and K. S. Park, "Effects of Depth Map Quantization for Computer- Generated Multiview Images using Depth Image-Based Rendering", KSII Transactions of Internet and Information Systems, vol. 5, no. 11, pp. 2175-2190, Nov. 2011.   과학기술학회마을   DOI
10 J-H Jung, J. Yeom, J. Hong, K. Hong, S-W Min, B. Lee, "Effect of fundamental depth resolution and cardboard effect to perceived depth resolution on multi-view display", Optics Express, pp. 20468-20482, Oct. 2011.
11 F. Bernardino, J. Mittleman, H. Rushmeier, C. Silva, and G. Taubin, "The Ball-Pivoting Algorithm for Surface Reconstruction", Journal of IEEE Transactions on Visualization and Computer Graphics, vol. 5, no. 4, pp. 349-359, Oct. 1999.   DOI   ScienceOn
12 A. Telea, "An Image Inpainting Technique Based on the Fast Marching Method", Journal of Graphics, GPU, and Game Tools, vol. 9, no. 1, pp. 23-34, 2004.
13 R. Tang, S. Halim, and M. Zulkepli, "Surface Reconstruction Algorithms: Review and Comparison", in Proceedings of the 8th International Symposium on Digital Earth, Sarawak, Malaysia, 2013.
14 C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation", ACM Transactions on Graphics, vol. 23, no. 3, pp. 600-608, Aug. 2004.   DOI