Browse > Article
http://dx.doi.org/10.3837/tiis.2014.09.011

Auto-Covariance Analysis for Depth Map Coding  

Liu, Lei (Institute of Information Science, Beijing Jiaotong University)
Zhao, Yao (Institute of Information Science, Beijing Jiaotong University)
Lin, Chunyu (Institute of Information Science, Beijing Jiaotong University)
Bai, Huihui (Institute of Information Science, Beijing Jiaotong University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.9, 2014 , pp. 3146-3158 More about this Journal
Abstract
Efficient depth map coding is very crucial to the multi-view plus depth (MVD) format of 3-D video representation, as the quality of the synthesized virtual views highly depends on the accuracy of the depth map. Depth map contains smooth area within an object but distinct boundary, and these boundary areas affect the visual quality of synthesized views significantly. In this paper, we characterize the depth map by an auto-covariance analysis to show the locally anisotropic features of depth map. According to the characterization analysis, we propose an efficient depth map coding scheme, in which the directional discrete cosine transforms (DDCT) is adopted to substitute the conventional 2-D DCT to preserve the boundary information and thereby increase the quality of synthesized view. Experimental results show that the proposed scheme achieves better performance than that of conventional DCT with respect to the bitrate savings and rendering quality.
Keywords
Multi-view plus depth (MVD); depth coding; auto-covariance model; directional discrete cosine transform (DDCT); 3-D video;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Maitre and M. N. Do, "Joint encoding of depth image based representation using shape-adaptive wavelets," in Proc. of IEEE Int. Conf. Image Process. (ICIP 2008), pp. 1768-1771, Oct. 2008.
2 G. Shen, W.-S. Kim, S. K. Narang, A. Ortega, J. Lee, and H. Wey, "Edge-adaptive transforms for efficient depth map coding," in Proc. Picture Coding Symp. (PCS 2010), pp. 566-569, Dec. 2010.
3 W.-S. Kim, S. K. Narang, and A. Ortega, "Graph based transforms for depth video coding," in Proc. of Int. Conf. Acoustics, Speech and Signal Process. (ICASSP 2012), pp. 813-816, Mar. 2012.
4 J. Xu, B. Zeng, and F. Wu, "An overview of directional transforms in image coding," in Proc. of IEEE Int. Symp. Circuits and Systems (ISCAS 2010), pp. 3036-3039, May 2010.
5 Z. Gu, W. Lin, B.-S. Lee, and C. T. Lau, "Rotated orthogonal transform (ROT) for motion-compensation residual coding," IEEE Trans. Image Process., Vol. 21, No. 12, pp. 4770-4781, Dec. 2012.   DOI   ScienceOn
6 L. Liu, A. Wang, K. Zhu, C. Lin, and Y. Zhao, "Directional block compressed sensing for image coding," in Proc. of IEEE Int. Conf. Circ. Syst. (ISCAS 2013), pp. 1644-1647, May 2013.
7 B. T. Oh, J. Lee, and D. Park, "Depth map coding based on synthesized view distortion function," IEEE J. of Sel. Topics in Signal Process., Vol. 5, No. 7, pp. 1344-1352, Nov. 2011.   DOI   ScienceOn
8 Middlebury Stereo Datasets, http://vision.middlebury.edu/stereo/data/
9 G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," Tech. Rep. VCEG-M33, April 2001.
10 A. Smolic, K. Mueller, P. Merkle, C. Fehn, P. Kauf, P. Eisert, and T. Wiegand, "3D video and free view-point video-technologies, applications and MPEG standard," in Proc. of IEEE Int. Conf. Multimedia and Expo (ICME 2006), pp. 2161-2164, July 2006.
11 P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. of IEEE Int. Conf. Image Process. (ICIP 2007), pp. I-201-I-204, Sep. 2007.
12 C. Fehn, "A 3D-TV approach using depth-image-based rendering (DIBR)," in Proc. of Visual., Imag., Image Process., pp. 482-487, Sep. 2003.
13 M.-K. Kang and Y.-S. Ho, "Depth video coding using adaptive geometry based intra prediction for 3-D video systems," IEEE Trans. Multimedia, Vol. 14, No. 1, pp. 121-128, Feb. 2012.   DOI   ScienceOn
14 Y. Zhao, C. Zhu, Z. Chen, and L. Yu, "Depth no-synthesis-error model for view synthesis in 3-D video," IEEE Trans. Image Process., Vol. 20. No. 8, pp. 2221-2228, Aug. 2011.
15 B. Zeng and J.-J. Fu, "Directional discrete cosine transforms-A new framework for image coding," IEEE Trans. Circ. Syst. for Video Technology, Vol. 18, No. 3, pp. 305-313, Mar. 2008.   DOI   ScienceOn
16 ITU-T Rec. H.264 I ISO/IEC 14496-10 (MPEG-4 AVC), "Advanced video coding for generic audiovisual services," Mar. 2005.
17 G. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard," IEEE Trans. Circ. Syst. for Video Technology, Vol. 22, No. 12, pp. 1649-1668, Dec. 2012.   DOI   ScienceOn
18 W.-S. Kim, A. Ortega, P. Lai, D. Tian, and C. Gomila, "Depth map distortion analysis for view rendering and depth coding," in Proc. of IEEE Int. Conf. Image Process. (ICIP 2009), pp. 721-724, Nov. 2007.
19 G. Shen, W.-S. Kim, A. Ortega, J. Lee, and H. Wey, "Edge-aware intra prediction for depth-map coding," in Proc. of IEEE Int. Conf. Image Process. (ICIP 2010), pp. 3393-3396, Sep. 2010.
20 A. Vetro, S. Yea, M. Zwicker, W. Matusik, and H. Pfister, "Overview of multiview video coding and anti-aliasing for 3D displays," in Proc. of IEEE Int. Conf. Image Process. (ICIP 2007), pp. I-17-I-20, Sep. 2007.
21 F. Kamisli and J. S. Lim, "1-D transforms for the motion compensation residual," IEEE Trans. Image Process., Vol. 20, No. 4, pp. 1036-1046, April 2011.   DOI   ScienceOn