Browse > Article
http://dx.doi.org/10.6109/jkiice.2013.17.12.2927

GPGPU based Depth Image Enhancement Algorithm  

Han, Jae-Young (Department of Electronic Engineering, Kwangwoon University)
Ko, Jin-Woong (Department of Electronic Engineering, Kwangwoon University)
Yoo, Jisang (Department of Electronic Engineering, Kwangwoon University)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.17, no.12, 2013 , pp. 2927-2936 More about this Journal
Abstract
In this paper, we propose a noise reduction and hole removal algorithm in order to improve the quality of depth images when they are used for creating 3D contents. In the proposed algorithm, the depth image and the corresponding color image are both used. First, an intensity image is generated by converting the RGB color space into the HSI color space. By estimating the difference of distance and depth between reference and neighbor pixels from the depth image and difference of intensity values from the color image, they are used to remove noise in the proposed algorithm. Then, the proposed hole filling method fills the detected holes with the difference of euclidean distance and intensity values between reference and neighbor pixels from the color image. Finally, we apply a parallel structure of GPGPU to the proposed algorithm to speed-up its processing time for real-time applications. The experimental results show that the proposed algorithm performs better than other conventional algorithms. Especially, the proposed algorithm is more effective in reducing edge blurring effect and removing noise and holes.
Keywords
depth map; depth map enhancement; noise removal; hole filling;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. Choi, D. Min, B. Ham and K. Sohn, "Spatial and temporal up-conversion technique for depth video," IEEE International Conference on Image Processing(ICIP), Cairo, pp. 3525-3528, Nov. 2009.
2 O. P. Gangwal and R. P. Benetty, "Depth map post-processing for 3D-TV," Digest of Technical Papers International Conference on Consumer Electronics(ICCE), Las Vegas, NV, pp. 1-2, Jan. 2009.
3 Y. Li and, L. Sun, "A novel up-sampling scheme for depth map compression in 3DTV system," Picture Coding Symposium(PCS), Nagoya, pp. 186-189, Dec. 2010.
4 J. Park, H. Kim, Y. Tai, M. Brown, and I. Kweon, "High quality depth map up-sampling for 3D-TOF cameras," IEEE International Conference on Computer Vision (ICCV), Barcelona, pp. 1623-1630, Nov. 2011.
5 J. Y. Han, Y. H. Seo, J. Yoo, "Depth map enhancement using advanced joint bilateral filter based on GPGPU," KICS Conference, Youngpyong, pp. 157-158, Jan. 2013.
6 C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," IEEE International Conference on Computer Vision, Bombay, pp.839-846, Jan. 1998.
7 Sylvain Paris and Fredo Durand, "A fast approximation of the bilateral filter using a signal processing approach," Springer International Journal of Computer Vision, vol.81, no.1, pp.24-52, Jan. 2009   DOI   ScienceOn
8 J. Kopf, M. Cohen, D. Kischinski and M. Uyttendaele, "Joint bilateral up-sampling," ACM Trans. on Graphics, vol.26, no.3, article 96, pp.2:1-2:9, July 2007.   DOI   ScienceOn
9 S. Mattoccia, M. Viti and F. Ries, "Near real-time Fast Bilateral Stereo on the GPU," Computer Vision and Pattern Recognition Workshops(CVPRW), Colorado Springs, CO pp.136-143, June 2011.
10 L. Wang, R. Yang, M. Gong and, M. Liao, "Real-time stereo using approximated joint bilateral filtering and dynamic programming," Journal of Real-Time Image Processing, pp.1-15, Sept. 2012.
11 J. Wasza, S. Bauer and J. Hornegger, "Real-time preprocessing for dense 3-D range imaging on the GPU: Defect interpolation, bilateral temporal averaging and guided filtering," Computer Vision Workshops(ICCV Workshops), Barcelona, pp.1221-1227, Nov. 2011.
12 J. Wasza, S. Bauer and J. Hornegger, "High Performance GPU-Based Preprocessing for Time-of-Flight Imaging in Medical Applications," Bildverarbeitung Fur Die Medizin 2011, Lubeck, pp.324-328, Mar. 2011.