ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Post-processing of 3D Video Extension of H.264/AVC for a Quality Enhancement of Synthesized View Sequences

  • Bang, Gun (Broadcasting & Telecommunications Media Research Laboratory, ETRI, Department of Computer Science and Engineering, Korea University) ;
  • Hur, Namho (Broadcasting & Telecommunications Media Research Laboratory, ETRI) ;
  • Lee, Seong-Whan (Department of Brain and Cognitive Engineering, Korea University)
  • Received : 2013.09.22
  • Accepted : 2013.12.30
  • Published : 2014.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

Since July of 2012, the 3D video extension of H.264/AVC has been under development to support the multi-view video plus depth format. In 3D video applications such as multi-view and free-view point applications, synthesized views are generated using coded texture video and coded depth video. Such synthesized views can be distorted by quantization noise and inaccuracy of 3D wrapping positions, thus it is important to improve their quality where possible. To achieve this, the relationship among the depth video, texture video, and synthesized view is investigated herein. Based on this investigation, an edge noise suppression filtering process to preserve the edges of the depth video and a method based on a total variation approach to maximum a posteriori probability estimates for reducing the quantization noise of the coded texture video. The experiment results show that the proposed methods improve the peak signal-to-noise ratio and visual quality of a synthesized view compared to a synthesized view without post processing methods.

Keywords

References

  1. ITU-T Rec. H.264 and ISO/IEC 14496-10 AVC: Advanced Video Coding for Generic Audio-Visual Services, ITU-T and ISO/IEC JTC 1, May 2003 (and subsequent editions).
  2. M.M. Hannuksela et al., Eds., 3D-AVC Draft Text 7, no. JCT3VE1002, ITU-T/ISO/IEC JCT-3V, Sept. 2013, work in progress.
  3. Y. Morvan, D. Farin, and P.H.N. de With, "Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images," Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, vol. 5, Sept. 16 - Oct. 19, 2007, pp. 105-108.
  4. S. Milani and G. Calvagno, "A Depth Image Coder Based on Progressive Silhouettes," IEEE Signal Process. Lett., vol. 17, no. 8, Aug. 2010, pp. 711-714. https://doi.org/10.1109/LSP.2010.2051619
  5. D.V.S.X. De Silva, W.A.C. Fernando, and S.L.P. Yasakethu, "Object Based Coding of Depth Maps for 3D Video Coding," IEEE Trans. Consum. Electron., vol. 55, no. 3, Aug. 2009, pp. 1699-1706. https://doi.org/10.1109/TCE.2009.5278045
  6. B. Kamolrat et al., "3D Motion Estimation for Depth Image Coding in 3D Video Coding," IEEE Trans. Consum. Electron., vol. 55, no. 2, May 2009, pp. 824-830. https://doi.org/10.1109/TCE.2009.5174461
  7. J. Heo and Y.-S. Ho, "Improved Context-Based Adaptive Binary Arithmetic Coding over H.264/AVC for Lossless Depth Map Coding," IEEE Signal Process. Lett., vol. 17, no. 10, Oct. 2010, pp. 835-838. https://doi.org/10.1109/LSP.2010.2059014
  8. C. Fehn, "Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV," Proc. SPIE Conf. Stereoscopic Display Virtual Reality Syst. XI, vol. 5291, San Jose, CA, USA, Jan. 2004, pp. 93-104.
  9. L. Zhang and W.J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Trans. Broadcast., vol. 51, no. 2, June 2005, pp. 191-199. https://doi.org/10.1109/TBC.2005.846190
  10. O.P. Gangwal and R.-P. Berretty, "Depth Map Post-Processing for 3D-TV," Dig. Int. Conf. Consum. Electron., Las Vegas, NV, USA, Jan. 10-14, 2009, pp. 1-2.
  11. E. Ekmekcioglu et al., "Utilisation of Edge Adaptive Upsampling in Compression of Depth Map Videos for Enhanced Free-Viewpoint Rendering," Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 7-10, 2009, pp. 733-736.
  12. ITU-T Rec. H.265 and ISO/IEC 23008-2 HEVC: High Efficiency Video Coding, ITU-T and ISO/IEC JTC 1, June 2013.
  13. S. Wittmann and T. Wedi, "Transmission of Post-Filter Hints for Video Coding Schemes," IEEE Int. Conf. Image Process., San Antonio, TX, USA, vol. 1, Sept. 16 - Oct. 19, 2007, pp. 81-84.
  14. W.-J. Chien and M. Karczewicz, Adaptive Filter Based on Combination of Sum-Modified Laplacian Filter Indexing and Quadtree Partitioning, ITU-T Q6/SG16, doc. VCEG-AL27, London, UK/Geneva, Switzerland, July 2009. Accessed Mar. 2014. http://wftp3.itu.int/av-arch/video-site/0906_LG/VCEG-AL27.zip
  15. H. Paek, R.-C. Kim, and S.-U. Lee, "On the POCS-Based Postprocessing Technique to Reduce the Blocking Artifacts in Transform Coded Images," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 3, June 1998, pp. 358-367. https://doi.org/10.1109/76.678636
  16. D. Sun and W.-K. Cham, "Postprocessing of Low Bit-Rate Block DCT Coded Images Based on a Fields of Experts Prior," IEEE Trans. Image Process., vol. 16, no. 11, Nov. 2007, pp. 2743-2751. https://doi.org/10.1109/TIP.2007.904969
  17. D. Rusanovskyy et al., 3D-AVC Test Model 6, JCT-3V document D1003, Incheon, Rep. of Korea, Apr. 2013.
  18. Y. Chen et al., CE2.a related: MB-level NBDV for 3D-AVC, JCT- 3V document D0185, Incheon, Rep. of Korea, Apr. 2013.
  19. D. Rusanovskyy, K. Muller, and A. Vetro, Common Test Conditions of 3DV Core Experiments, JCT-3V document D1100, Incheon, Rep. of Korea, Apr. 2013.
  20. G. Tech et al., 3D-HEVC Test Model 4, JCT-3V document D1005, Incheon, Rep. of Korea, Apr. 2013.
  21. G. Tech, K. Muller, and T. Wiegand, "Evaluation of View Synthesis Algorithms for Mobile 3DTV," Proc. 3DTV Conf., Antalya, Turkey, May16-18, 2011, pp.1-4.
  22. M.A. Robertson and R.L. Stevenson, "DCT Quantization Noise in Compressed Images," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, Jan. 2005, pp. 27-38. https://doi.org/10.1109/TCSVT.2004.839995
  23. A.B. Hamza and H. Krim, "A Variational Approach to Maximum a Posteriori Estimation for Image Denoising," Proc. 3rd Int. Workshop Energy Minimization Methods Comput. Vision Pattern Recognition, Sophia Antipolis, France, vol. 2134, Sept. 3-5, 2001, pp. 19-34.
  24. L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, no. 1-4, Nov. 1, 1992, pp. 259-268. https://doi.org/10.1016/0167-2789(92)90242-F

Cited by

  1. Inter-layer Texture and Syntax Prediction for Scalable Video Coding vol.4, pp.6, 2014, https://doi.org/10.5573/ieiespc.2015.4.6.422