[KSCI] Korea Science Citation Index Service

http://dx.doi.org/10.4218/etrij.14.2113.0082

Post-processing of 3D Video Extension of H.264/AVC for a Quality Enhancement of Synthesized View Sequences

Bang, Gun (Broadcasting & Telecommunications Media Research Laboratory, ETRI, Department of Computer Science and Engineering, Korea University)
Hur, Namho (Broadcasting & Telecommunications Media Research Laboratory, ETRI)
Lee, Seong-Whan (Department of Brain and Cognitive Engineering, Korea University)

Publication Information

ETRI Journal / v.36, no.2, 2014 , pp. 242-252 More about this Journal

Abstract

Since July of 2012, the 3D video extension of H.264/AVC has been under development to support the multi-view video plus depth format. In 3D video applications such as multi-view and free-view point applications, synthesized views are generated using coded texture video and coded depth video. Such synthesized views can be distorted by quantization noise and inaccuracy of 3D wrapping positions, thus it is important to improve their quality where possible. To achieve this, the relationship among the depth video, texture video, and synthesized view is investigated herein. Based on this investigation, an edge noise suppression filtering process to preserve the edges of the depth video and a method based on a total variation approach to maximum a posteriori probability estimates for reducing the quantization noise of the coded texture video. The experiment results show that the proposed methods improve the peak signal-to-noise ratio and visual quality of a synthesized view compared to a synthesized view without post processing methods.

Keywords

3D video coding; view synthesis; post-processing; denoising; MAP; total variation;

Citations & Related Records

Reference

1	S. Wittmann and T. Wedi, "Transmission of Post-Filter Hints for Video Coding Schemes," IEEE Int. Conf. Image Process., San Antonio, TX, USA, vol. 1, Sept. 16 - Oct. 19, 2007, pp. 81-84.
2	W.-J. Chien and M. Karczewicz, Adaptive Filter Based on Combination of Sum-Modified Laplacian Filter Indexing and Quadtree Partitioning, ITU-T Q6/SG16, doc. VCEG-AL27, London, UK/Geneva, Switzerland, July 2009. Accessed Mar. 2014. http://wftp3.itu.int/av-arch/video-site/0906_LG/VCEG-AL27.zip
3	H. Paek, R.-C. Kim, and S.-U. Lee, "On the POCS-Based Postprocessing Technique to Reduce the Blocking Artifacts in Transform Coded Images," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 3, June 1998, pp. 358-367. DOI ScienceOn
4	D. Sun and W.-K. Cham, "Postprocessing of Low Bit-Rate Block DCT Coded Images Based on a Fields of Experts Prior," IEEE Trans. Image Process., vol. 16, no. 11, Nov. 2007, pp. 2743-2751. DOI ScienceOn
5	D. Rusanovskyy et al., 3D-AVC Test Model 6, JCT-3V document D1003, Incheon, Rep. of Korea, Apr. 2013.
6	Y. Chen et al., CE2.a related: MB-level NBDV for 3D-AVC, JCT- 3V document D0185, Incheon, Rep. of Korea, Apr. 2013.
7	D. Rusanovskyy, K. Muller, and A. Vetro, Common Test Conditions of 3DV Core Experiments, JCT-3V document D1100, Incheon, Rep. of Korea, Apr. 2013.
8	G. Tech et al., 3D-HEVC Test Model 4, JCT-3V document D1005, Incheon, Rep. of Korea, Apr. 2013.
9	G. Tech, K. Muller, and T. Wiegand, "Evaluation of View Synthesis Algorithms for Mobile 3DTV," Proc. 3DTV Conf., Antalya, Turkey, May16-18, 2011, pp.1-4.
10	M.A. Robertson and R.L. Stevenson, "DCT Quantization Noise in Compressed Images," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 1, Jan. 2005, pp. 27-38. DOI ScienceOn
11	A.B. Hamza and H. Krim, "A Variational Approach to Maximum a Posteriori Estimation for Image Denoising," Proc. 3rd Int. Workshop Energy Minimization Methods Comput. Vision Pattern Recognition, Sophia Antipolis, France, vol. 2134, Sept. 3-5, 2001, pp. 19-34.
12	L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, no. 1-4, Nov. 1, 1992, pp. 259-268. DOI ScienceOn
13	ITU-T Rec. H.264 and ISO/IEC 14496-10 AVC: Advanced Video Coding for Generic Audio-Visual Services, ITU-T and ISO/IEC JTC 1, May 2003 (and subsequent editions).
14	M.M. Hannuksela et al., Eds., 3D-AVC Draft Text 7, no. JCT3VE1002, ITU-T/ISO/IEC JCT-3V, Sept. 2013, work in progress.
15	Y. Morvan, D. Farin, and P.H.N. de With, "Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images," Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, vol. 5, Sept. 16 - Oct. 19, 2007, pp. 105-108.
16	S. Milani and G. Calvagno, "A Depth Image Coder Based on Progressive Silhouettes," IEEE Signal Process. Lett., vol. 17, no. 8, Aug. 2010, pp. 711-714. DOI ScienceOn
17	D.V.S.X. De Silva, W.A.C. Fernando, and S.L.P. Yasakethu, "Object Based Coding of Depth Maps for 3D Video Coding," IEEE Trans. Consum. Electron., vol. 55, no. 3, Aug. 2009, pp. 1699-1706. DOI ScienceOn
18	C. Fehn, "Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV," Proc. SPIE Conf. Stereoscopic Display Virtual Reality Syst. XI, vol. 5291, San Jose, CA, USA, Jan. 2004, pp. 93-104.
19	B. Kamolrat et al., "3D Motion Estimation for Depth Image Coding in 3D Video Coding," IEEE Trans. Consum. Electron., vol. 55, no. 2, May 2009, pp. 824-830. DOI ScienceOn
20	J. Heo and Y.-S. Ho, "Improved Context-Based Adaptive Binary Arithmetic Coding over H.264/AVC for Lossless Depth Map Coding," IEEE Signal Process. Lett., vol. 17, no. 10, Oct. 2010, pp. 835-838. DOI ScienceOn
21	L. Zhang and W.J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Trans. Broadcast., vol. 51, no. 2, June 2005, pp. 191-199. DOI ScienceOn
22	O.P. Gangwal and R.-P. Berretty, "Depth Map Post-Processing for 3D-TV," Dig. Int. Conf. Consum. Electron., Las Vegas, NV, USA, Jan. 10-14, 2009, pp. 1-2.
23	E. Ekmekcioglu et al., "Utilisation of Edge Adaptive Upsampling in Compression of Depth Map Videos for Enhanced Free-Viewpoint Rendering," Proc. 16th IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 7-10, 2009, pp. 733-736.
24	ITU-T Rec. H.265 and ISO/IEC 23008-2 HEVC: High Efficiency Video Coding, ITU-T and ISO/IEC JTC 1, June 2013.