Browse > Article
http://dx.doi.org/10.3837/tiis.2016.06.015

Resolution-independent Up-sampling for Depth Map Using Fractal Transforms  

Liu, Meiqin (Institute of Information Science, Beijing Jiaotong University)
Zhao, Yao (Institute of Information Science, Beijing Jiaotong University)
Lin, Chunyu (Institute of Information Science, Beijing Jiaotong University)
Bai, Huihui (Institute of Information Science, Beijing Jiaotong University)
Yao, Chao (Institute of Information Science, Beijing Jiaotong University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.6, 2016 , pp. 2730-2747 More about this Journal
Abstract
Due to the limitation of the bandwidth resource and capture resolution of depth cameras, low resolution depth maps should be up-sampled to high resolution so that they can correspond to their texture images. In this paper, a novel depth map up-sampling algorithm is proposed by exploiting the fractal internal self-referential feature. Fractal parameters which are extracted from a depth map, describe the internal self-referential feature of the depth map, do not introduce inherent scale and just retain the relational information of the depth map, i.e., fractal transforms provide a resolution-independent description for depth maps and could up-sample depth maps to an arbitrary high resolution. Then, an enhancement method is also proposed to further improve the performance of the up-sampled depth map. The experimental results demonstrate that better quality of synthesized views is achieved both on objective and subjective performance. Most important of all, arbitrary resolution depth maps can be obtained with the aid of the proposed scheme.
Keywords
depth up-sampling; 3D coding; fractal theory; resolution-independent; self-referential;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Multi-view video plus depth representation and coding," in Proc. of IEEE International Conference on Image Processing(ICIP), pp. 201-204, September 16-19, 2007. Article (CrossRef Link)
2 C. Fehn, "Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV," in Proc. of SPIE 5291, Stereoscopic Displays and Virtual Reality Systems XI, pp. 93-104, May 21, 2004. Article (CrossRef Link)
3 3D-AVC Test Model 5, Document JCT3V-C1003, ITU-TSG16WP3 and ISO/IEC JTC1/SC29/WG11, January, 2013. Article (CrossRef Link)
4 E. Ekmekcioglu, S. T. Worrall, and A. M. Kondoz, “Bit-rate adaptive downsampling for the coding of multi-view video with depth information,” 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D video, pp.137-140, May 28-30, 2008. Article (CrossRef Link)
5 D.Chan, H.Buisman, C.Theobalt, S.Thrun, "A noise-aware filter for real-time depth upsampling," in Proc. of Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications-M2SFA2 2008, 2008. Article (CrossRef Link)
6 KJ. Oh, S. Yea, A. Vetro, and YS. Ho, “Depth reconstruction filter and down/up sampling for depth coding in 3-D video,” IEEE Signal Processing Letters, vol.16, no.9, pp.747-750, September, 2009. Article (CrossRef Link)   DOI
7 H. Deng, L. Yu, and Z. Xiong, "Edge-preserving interpolation for down/up sampling-based depth compression," in Proc. of IEEE Conference on Image Processing (ICIP), pp.1301-1304, September 30-October 3, 2012. Article (CrossRef Link)
8 H. Deng, L. Yu, J. Qiu and J. Zhang, "A joint texture/depth edge-directed up-sampling algorithm for depth map coding," in Proc. of IEEE International Conference on Multimedia and Expro(ICME), pp.646-650, July 9-13, 2012. Article (CrossRef Link)
9 Q.Liu, Y.Yang, R.Ji, Y.Gao and L.Yu, “Cross-View Down/Up-Sampling Method for Multiview Depth Video Coding,” IEEE Signal Processing Letters, vol.19, no.5, pp.295-298, May, 2012. Article (CrossRef Link)   DOI
10 D. Ferstl, C.Reinbacher, R.Ranftl and M.Ruether, "Image guided depth upsampling using anisotropic total generalized variation," in Proc. of IEEE Conference on Computer Vision (ICCV), pp. 993-1000, December 1-8, 2013. Article (CrossRef Link)
11 C.Zhu, Y.Zhao, L.Yu and M.Tanimoto, “3D-TV system with depth-image-based rendering,” Springer-Verlag, New York, 2012. Article (CrossRef Link)
12 MY. Liu, O. Tuzel, and Y. Taguchi, "Joint geodesic upsampling of depth images," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.169-176, June 23-28, 2013. Article (CrossRef Link)
13 J. Kim, G. Jeon, and J. Jeong, “Joint-adaptive bilateral depth map upsampling,” Signal Processing: Image Communication, vol. 29, no. 4, pp. 506-513, April, 2014. Article (CrossRef Link)   DOI
14 Y.Yang, X.Wang, Q.Liu, M.Xu, L.Yu, “A bundled-optimization model of multiview dense depth map synthesis for dynamic scene reconstruction,” Information Sciences, vol.320, pp.306-319, November, 2014. Article (CrossRef Link)   DOI
15 H.Bai, M.Zhang, A.Wang, Y.Zhao, “Multiple Description Video Coding Using Correlation Optimized Temporal Sampling,” Science China Information Sciences, vol.57, no.5, pp.1-10, May, 2014. Article (CrossRef Link)   DOI
16 M.Barnsley, A.Vince, “Developments in fractal geometry,” Bulletin of Mathematical Sciences, vol.3, no.2, pp.299-348, August 2013. Article (CrossRef Link)   DOI
17 M.Berry, "Benefiting from fractals," in Proc. of Symposia in Pure Math, vol.72, pp.31-33, 2004. Article (CrossRef Link)
18 M.F.Barnsley, “Fractal image compression,” Notice of the AMS, vol.43, no.6, pp.657-662 June, 1996. Article (CrossRef Link)
19 Y.Fisher, Fractal image compression, Springer, New York, 1995. Article (CrossRef Link)
20 Y. Xu, H. Ji, C. Fermüller, “Viewpoint invariant texture description using fractal analysis,” International Journal of Computer Vision, vol.83, pp.85-100, June, 2009. Article (CrossRef Link)   DOI
21 M. Tanimoto, T. Fujii, and K. Suzuki, “View synthesis algorithm in view synthesis reference software 3.5 (VSRS3.5) Document M16090, ISO/IEC JTC1/SC29/WG11 (MPEG),” May, 2009.
22 J. Lei, S. Li, C. Zhu, M. Sun and C. Hou, “Depth coding based on depth-texture motion and structure similarities,” IEEE Transactions on Circuits and Systems for Video Technology, vol.25, no.2, pp.275-286, February, 2015. Article (CrossRef Link)   DOI
23 Y.Zhao, B.Yuan, “A new affine transformation: its theory and application to image coding,” IEEE Transaction on Circuits and Systems for Video Technology, vol.8, no.3, pp. 269-274, June, 1998. Article (CrossRef Link)   DOI
24 Y.Sun, Y.Zhao, B.Yuan, “Region-based fractal image coding with freely-shaped partition,” Chinese Journal of Electronics, vol.13, no.3, pp.506-511, July, 2004. Article (CrossRef Link)
25 Y.Chen, P.Pandit, S.Yea and C.Lim, "Draft reference software for MVC," in Proc. of Joint Video Team (JVT) of ISO/IEC/MPEG and ITU-T/VCEG, Doc. JVT-AE 207, London, U.K., 2009. Article (CrossRef Link)