Browse > Article
http://dx.doi.org/10.5909/JBE.2016.21.6.878

Boundary Artifacts Reduction in View Synthesis of 3D Video System  

Lee, Dohoon (Korea Aerospace University)
Yang, Yoonmo (Korea Aerospace University)
Oh, Byung Tae (Korea Aerospace University)
Publication Information
Journal of Broadcast Engineering / v.21, no.6, 2016 , pp. 878-888 More about this Journal
Abstract
This paper proposes an efficient method to remove the boundary artifacts of rendered views caused by damaged depth maps in the 3D video system. First, characteristics of boundary artifacts with the compression noise in depth maps are carefully studied. Then, the artifacts suppression method is proposed by the iterative projection onto convex sets (POCS) algorithm with setting the convex set in pixel and frequency domain. The proposed method is applied to both texture and depth maps separately during view rendering. The simulation results show the boundary artifacts are greatly reduced with improving the quality of synthesized views.
Keywords
Boundary artifact; 3D video; Multiview plus depth map; POCS;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 G. Bjontegaard, "Calculation of average PNSR differences between RD-curves," ITU-T SG.16 Q.6, Doc. VCEG M33, 2001.
2 L. Yang, T. Yendo, M.P. Tehrani, T. Fujii, and M. Tanimoto. "Error suppression in view synthesis using reliability reasoning for FTV." IEEE 3DTV-Conf. The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1-4, 2010.
3 L. Yang, T. Yendo, M.P. Tehrani, T. Fujii, and M. Tanimoto. "Artifact reduction using reliability reasoning for image generation of FTV." Journal of Visual Communication and Image Representation, vol. 21, no. 5, pp. 542-560, 2010.   DOI
4 A. Zakhor, "Iterative procedures for reduction of blocking effects in transform image coding," IEEE Trans. on Circuits Syst. Video Technol., vol. 2, no. 1, pp. 91-95, 1992.   DOI
5 S. Minami and A. Zakhor, "An optimization approach for removing blocking effects in transform coding," IEEE Trans. on Circuits Syst. Video Technol., vol. 5, no. 2, pp. 74-82, Apr. 1995.   DOI
6 J.H. Lee, and C.H. Lee, "POCS based interpolation method for irregularly sampled image," Journal of Broadcast Engineering, vol. 16, no. 4, pp. 669-679, July 2011.   DOI
7 Y. Kim, C.S. Park, and S.J. Ko. "Fast POCS based post-processing technique for HDTV." IEEE Trans. Consumer Electron., vol. 24, no. 4, pp. 1438-1447, 2003.
8 G.R. Kwon, H.K. Kim, Y. Kim, and S.J. Ko. "An efficient POCS-based post-processing technique using wavelet transform in HDTV." IEEE Trans. Consumer Electron., vol. 51, no. 4, pp. 1283-1290, 2005.   DOI
9 3D-AVC Test Model 5, ITU-T SG16 WP3 ISO/IEC JTC1/SC29/WG11, Doc. JCT3V-C1003, Geneva, 2013.
10 Common test condition of 3DV core experiments, ITU-T SG16 WP3 ISO/IEC JTC1/SC29/WG11, Doc. JCT3V-C1100, Geneva, 2013.
11 P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Multiview video plus depth representation and coding," in Proc. IEEE Int. Conf. on Image Proc., vol. 1, pp. 201-204, 2007.
12 J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling", Proc. ACM Siggraph, vol. 26, no. 3, pp. 96, 2007.   DOI
13 Y.S. Kang, S.B. LEE, and Y.S. Ho, "Depth map upsampling using depth local features," Electron. Lett., vol. 50, no. 3, pp. 170-171, 2014.   DOI
14 S.Y Kim, M.B. Kim, and Y.S. Ho, "Depth map denoising based on the common distance Transform," Journal of Broadcast Engineering, vol. 17, no. 4, pp. 565-571, July 2012.   DOI
15 D.W. Shin, and Y.S Ho, "Real-time depth Image refinement using hierarchical joint bilateral filter," Journal of Broadcast Engineering, vol. 19, no. 2, pp. 140-147, March 2014.   DOI
16 3D-CE3.a results on dilation filter for depth post processing, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Doc. JCT2-A0038, Stockholm, 2012.
17 Y. Zhao, C. Zhu, Z. Chen, D. Tian, and L. Yu. "Boundary artifact reduction in view synthesis of 3D video: from perspective of texture-depth alignment." IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 510-522, 2011.   DOI
18 C. Lee, and Y.S. Ho. "Boundary filtering on synthesized views of 3D video." IEEE Second Int. Conf. Future Generation Communication and Networking Symposia, FGCNS'08, vol. 3, pp. 15-18, 2008.
19 Text of ISO/IEC 14496-10:200X/FDAM 1 Multi-View Video Coding, ISO/IEC JTC1/SC29/WG11, Doc. N9978, Hannover, Germany, 2008.
20 C.H. Li, J.J. Tsai, and H.M. Hang. "A triangular-warping based view synthesis scheme with enhanced artifact reduction for FTV." in Proc. IEEE Int. Conf. on Image Proc., pp. 1969-1972, 2011.
21 A. Smolic, K. Mueller, N. Stefanoski, J. Ostermann, A. Gotchev, G. B. Akar, G. Triantafyllidis, and A. Koz, "Coding algorithms for 3DTV a survey," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1606-1621, 2007.   DOI