Browse > Article
http://dx.doi.org/10.5909/JBE.2015.20.3.414

Temporally-Consistent High-Resolution Depth Video Generation in Background Region  

Shin, Dong-Won (School of Information and Communication)
Ho, Yo-Sung (School of Information and Communication)
Publication Information
Journal of Broadcast Engineering / v.20, no.3, 2015 , pp. 414-420 More about this Journal
Abstract
The quality of depth images is important in the 3D video system to represent complete 3D contents. However, the original depth image from a depth camera has a low resolution and a flickering problem which shows vibrating depth values in terms of temporal meaning. This problem causes an uncomfortable feeling when we look 3D contents. In order to solve a low resolution problem, we employ 3D warping and a depth weighted joint bilateral filter. A temporal mean filter can be applied to solve the flickering problem while we encounter a residual spectrum problem in the depth image. Thus, after classifying foreground andbackground regions, we use an upsampled depth image for a foreground region and temporal mean image for background region.Test results shows that the proposed method generates a time consistent depth video with a high resolution.
Keywords
Kinect v2; depth flickering; temporal consistency; upsampling; warping;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 D. Shin and Y. Ho, "Flickering Elimination Method for Background Region in Depth Video," Proc. of International Workshop on Advanced Image Technology, OS10-73, Jan. 2015.
2 P. Kauff, N. Atzpadin, C. Fehn, M. Muller, O. Schreer, A. Smolic, and R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Image Commun, vol. 22, no. 2, pp. 217-234, Feb. 2007.
3 C. Fehn, "Depth-image-based rendering (DIBR), Compression and Transmission for a New Approach on 3-D TV," Proc. of SPIE Conference Stereoscopic Displays and Virtual Reality Systems, vol. 5291, pp. 93-104, Jan. 2004.
4 http://www.microsoft.com/en-us/kinectforwindows/meetkinect/features.aspx
5 Camera Calibration Toolbox for MATLAB: http://www.vision.caltech.edu/bouguetj
6 W. R. Mark, L. McMillan, and G. Bishop, "Post-rendering 3D Warping," Proc. of Symposium on Interactive 3D Graphics, pp. 7-16, April 1997.
7 J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM Transactions on Graphics, vol. 26, no. 3, pp. 1-5, July 2007.   DOI   ScienceOn
8 D. Shin and Y. Ho, "Real-time Depth Image Refinement using Joint Bilateral Filter," Proc. of 2013 Korean Society of Broadcast Engineers Autumn Conference, vol. 19, pp. 116-119, Nov. 2013.