Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Boundary Artifacts Reduction in View Synthesis of 3D Video System

3차원 비디오의 합성영상 경계 잡음 제거

  • 이도훈 (한국항공대학교 항공전자정보공학부) ;
  • 양윤모 (한국항공대학교 항공전자정보공학부) ;
  • 오병태 (한국항공대학교 항공전자정보공학부)
  • Received : 2016.09.07
  • Accepted : 2016.10.26
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes an efficient method to remove the boundary artifacts of rendered views caused by damaged depth maps in the 3D video system. First, characteristics of boundary artifacts with the compression noise in depth maps are carefully studied. Then, the artifacts suppression method is proposed by the iterative projection onto convex sets (POCS) algorithm with setting the convex set in pixel and frequency domain. The proposed method is applied to both texture and depth maps separately during view rendering. The simulation results show the boundary artifacts are greatly reduced with improving the quality of synthesized views.

본 논문에서는 3차원 비디오 시스템에서 손상된 깊이영상으로 인하여 합성된 가상시점 영상에서 발생하는 경계 잡음을 효과적으로 제거하는 방식을 제안한다. 제안 방식에서는 손실 압축에 의한 깊이영상의 잡음으로부터 발생하는 경계 잡음의 특징을 분석하고, 이를 바탕으로 픽셀 도메인과 주파수 도메인에서의 convex set을 설정하여 해당 조건들을 반복적으로 사영시키는 projection onto convex sets (POCS) 기법을 활용하여 올바른 정보는 유지한 채 경계 잡음만을 제거한다. 이 논문에서 제안한 방식은 영상합성 과정에서 생성되는 컬러 및 깊이영상에 모두 적용하였다. 실험 결과 제안 기법은 경계 잡음을 효과적으로 제거하여 가상시점 영상의 화질을 향상시켰음을 확인하였다.

Keywords

References

  1. Text of ISO/IEC 14496-10:200X/FDAM 1 Multi-View Video Coding, ISO/IEC JTC1/SC29/WG11, Doc. N9978, Hannover, Germany, 2008.
  2. A. Smolic, K. Mueller, N. Stefanoski, J. Ostermann, A. Gotchev, G. B. Akar, G. Triantafyllidis, and A. Koz, "Coding algorithms for 3DTV a survey," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1606-1621, 2007. https://doi.org/10.1109/TCSVT.2007.909972
  3. P. Merkle, A. Smolic, K. Muller, and T. Wiegand, "Multiview video plus depth representation and coding," in Proc. IEEE Int. Conf. on Image Proc., vol. 1, pp. 201-204, 2007.
  4. J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling", Proc. ACM Siggraph, vol. 26, no. 3, pp. 96, 2007. https://doi.org/10.1145/1276377.1276497
  5. Y.S. Kang, S.B. LEE, and Y.S. Ho, "Depth map upsampling using depth local features," Electron. Lett., vol. 50, no. 3, pp. 170-171, 2014. https://doi.org/10.1049/el.2013.3956
  6. S.Y Kim, M.B. Kim, and Y.S. Ho, "Depth map denoising based on the common distance Transform," Journal of Broadcast Engineering, vol. 17, no. 4, pp. 565-571, July 2012. https://doi.org/10.5909/JBE.2012.17.4.565
  7. D.W. Shin, and Y.S Ho, "Real-time depth Image refinement using hierarchical joint bilateral filter," Journal of Broadcast Engineering, vol. 19, no. 2, pp. 140-147, March 2014. https://doi.org/10.5909/JBE.2014.19.2.140
  8. 3D-CE3.a results on dilation filter for depth post processing, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Doc. JCT2-A0038, Stockholm, 2012.
  9. Y. Zhao, C. Zhu, Z. Chen, D. Tian, and L. Yu. "Boundary artifact reduction in view synthesis of 3D video: from perspective of texture-depth alignment." IEEE Trans. Broadcasting, vol. 57, no. 2, pp. 510-522, 2011. https://doi.org/10.1109/TBC.2011.2120730
  10. C. Lee, and Y.S. Ho. "Boundary filtering on synthesized views of 3D video." IEEE Second Int. Conf. Future Generation Communication and Networking Symposia, FGCNS'08, vol. 3, pp. 15-18, 2008.
  11. C.H. Li, J.J. Tsai, and H.M. Hang. "A triangular-warping based view synthesis scheme with enhanced artifact reduction for FTV." in Proc. IEEE Int. Conf. on Image Proc., pp. 1969-1972, 2011.
  12. L. Yang, T. Yendo, M.P. Tehrani, T. Fujii, and M. Tanimoto. "Error suppression in view synthesis using reliability reasoning for FTV." IEEE 3DTV-Conf. The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1-4, 2010.
  13. L. Yang, T. Yendo, M.P. Tehrani, T. Fujii, and M. Tanimoto. "Artifact reduction using reliability reasoning for image generation of FTV." Journal of Visual Communication and Image Representation, vol. 21, no. 5, pp. 542-560, 2010. https://doi.org/10.1016/j.jvcir.2009.09.009
  14. A. Zakhor, "Iterative procedures for reduction of blocking effects in transform image coding," IEEE Trans. on Circuits Syst. Video Technol., vol. 2, no. 1, pp. 91-95, 1992. https://doi.org/10.1109/76.134377
  15. S. Minami and A. Zakhor, "An optimization approach for removing blocking effects in transform coding," IEEE Trans. on Circuits Syst. Video Technol., vol. 5, no. 2, pp. 74-82, Apr. 1995. https://doi.org/10.1109/76.388056
  16. J.H. Lee, and C.H. Lee, "POCS based interpolation method for irregularly sampled image," Journal of Broadcast Engineering, vol. 16, no. 4, pp. 669-679, July 2011. https://doi.org/10.5909/JEB.2011.16.4.669
  17. Y. Kim, C.S. Park, and S.J. Ko. "Fast POCS based post-processing technique for HDTV." IEEE Trans. Consumer Electron., vol. 24, no. 4, pp. 1438-1447, 2003.
  18. G.R. Kwon, H.K. Kim, Y. Kim, and S.J. Ko. "An efficient POCS-based post-processing technique using wavelet transform in HDTV." IEEE Trans. Consumer Electron., vol. 51, no. 4, pp. 1283-1290, 2005. https://doi.org/10.1109/TCE.2005.1561857
  19. 3D-AVC Test Model 5, ITU-T SG16 WP3 ISO/IEC JTC1/SC29/WG11, Doc. JCT3V-C1003, Geneva, 2013.
  20. Common test condition of 3DV core experiments, ITU-T SG16 WP3 ISO/IEC JTC1/SC29/WG11, Doc. JCT3V-C1100, Geneva, 2013.
  21. G. Bjontegaard, "Calculation of average PNSR differences between RD-curves," ITU-T SG.16 Q.6, Doc. VCEG M33, 2001.