Browse > Article
http://dx.doi.org/10.6109/jkiice.2013.17.8.1908

Fast Generation of Intermediate View Image Using GPGPU-Based Disparity Increment Method  

Koo, Ja-Myung (Department of Electronic Materials Engineering, Kwangwoon University)
Seo, Young-Ho (Department of Liberal Arts, Kwangwoon University)
Kim, Dong-Wook (Department of Electronic Materials Engineering, Kwangwoon University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.17, no.8, 2013 , pp. 1908-1918 More about this Journal
Abstract
Free-view, auto-stereoscopic video service is a next generation broadcasting system which offers a three-dimensional video, images of the various point are needed. This paper proposes a method that parallelizes the algorithm for arbitrary intermediate view-point image fast generation and make it faster using General Propose Graphic Processing Unit(GPGPU) with help of the Compute Unified Device Architecture(CUDA). It uses a parallelized stereo-matching method between the leftmost and the rightmost depth images to obtain disparity information and It use data calculated disparity increment per depth value. The disparity increment is used to find the location in the intermediate view-point image for each depth in the given images. Then, It is eliminate to disocclusions complement each other and remaining holes are filled image using hole-filling method and to get the final intermediate view-point image. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated intermediate view-point image corresponds to 30.47dB of PSNR in average and it takes about 38 frames per second to generate a Full HD intermediate view-point image.
Keywords
3D display; intermediate view image generation; GPGPU; CUDA;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 L. McMillan, Jr., "An image-based approach to threedimensional computer graphics," Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC, 1997.
2 S. Zinger, L. Do, and P. H. N. de With, "Free-viewpoint depth image based rendering," J. Vis. Commun. Image Representation, vol. 21, no. 5-6, pp. 533-541, 2010.   DOI   ScienceOn
3 K.-J. Oh, S. Yea, and Y.-S. Ho, "Hole filling method using depth based inpainting for view synthesis in free viewpoint television and 3-D video," in Proc. Picture Coding Symp., Chicago, IL, May 2009, pp. 233-236.
4 Jungsik Park, Ji-Youn Choi, In Ryu, and Jong-Il Park, "Universal View Synthesis Unit for Glassless 3DTV," IEEE Transactions on Consumer Electronics, 58(2): 706-711, May 2012   DOI   ScienceOn
5 Luat Do, et al., "GPU-accelerated Real-time Free-viewpoint DIBR for 3DTV," IEEE Transactions on Consumer Electronics, 58(2): 633-640, May 2012   DOI   ScienceOn
6 A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, 2004.   DOI   ScienceOn
7 I. Daribo, B. Pesquet "Depth-aided image inpainting for novel view synthesis," Multimedia Signal Processing (MMSP), IEEE International Workshop on pp 167-170, 2010
8 J-M Koo, Y-H Seo, H-J Choi, J-S Yoo, and D-W Kim, "Intermediate Depth Image Generation using Disparity Increment of Stereo Depth Images", Journal of broadcast engineering, Vol. 17. Issue 2, pp. 363-373, March. 2012.   DOI   ScienceOn
9 http://wg11.sc29.org/svn/repos/MPEG-4/test/trunk/ 3Dview_synthesis/VSRS
10 H. Shin, Y. Kim, H. Park, and J. Park, "Fast View Synthesis using GPU for 3D Display", In IEEE Trans. Consumer Electronics, vol. 54, no. 4, pp. 2068-2076, Nov. 2008.   DOI   ScienceOn
11 Reichelt, et al., "Holographic 3-D Displays - Electroholography within the Grasp of Commercialization", A part of the Book named as Advances in Lasers and Electro Optics, INTECH, pp. 683-710, April 2010.
12 Edited by O. Schreer, et al., 3D Video Communications, John Wiley & Sons Ltd., Atrium, England, 2005.
13 ISO IWA3, Image safety reducing the incidence of undesirable biomedical effects caused by visual image sequences, 2005.
14 3D Consortium, "3DC Safety Guideline for Popularization of Human-friendly 3D," 2006.
15 Li Yu, et al., "Depth based View Synthesis with Artifacts Removal for FTV," IEEE Intl. Conf. on Image and Graphics, pp. 506-510, 2011.
16 Chia-Ming Cheng, et al., "Spatio-Temporally Consistent Novel View Synthesis Algorithm from Video-plus-Depth Sequences for Autostereoscopic Displays," IEEE Trans. on Broadcasting, Vol. 57, No. 2, pp. 523-532, June 2011.   DOI   ScienceOn
17 S. A. Benton and V. M. Bove, Jr., Holographic Imaging, John Wiley and Sons Inc., Hoboken NJ, 2008.
18 J. L. Wilson, Microsoft kinect for Xbox 360, PC Mag. Com, Nov. 10, 2010.
19 A. Smolic, et al., "Intermediate View Interpolation based on Multiview Video plus Depth for Advanced 3D Video Systems," IEEE ICIP, pp.2448-2451, 2008.
20 SR4000Data Sheet, http://www.mesa-imaging.ch/prodview 4k.php, MESA Imaging, Oct. 2010.
21 G. Cheung, et al., "On Dependent Bit Allocation for Multiview Image Coding with Depth-Image-Based Rendering", IEEE Trans. on Image Processing, Vol. 20, No. 11, pp. 3179-3194, Nov. 2011.   DOI   ScienceOn