Browse > Article
http://dx.doi.org/10.5573/IEIESPC.2015.4.6.434

Scalable Multi-view Video Coding based on HEVC  

Lim, Woong (Department of Computer Engineering, Kwangwoon University)
Nam, Junghak (Department of Computer Engineering, Kwangwoon University)
Sim, Donggyu (Department of Computer Engineering, Kwangwoon University)
Publication Information
IEIE Transactions on Smart Processing and Computing / v.4, no.6, 2015 , pp. 434-442 More about this Journal
Abstract
In this paper, we propose an integrated spatial and view scalable video codec based on high efficiency video coding (HEVC). The proposed video codec is developed based on similarity and uniqueness between the scalable extension and 3D multi-view extension of HEVC. To improve compression efficiency using the proposed scalable multi-view video codec, inter-layer and inter-view predictions are jointly employed by using high-level syntaxes that are defined to identify view and layer information. For the inter-view and inter-layer predictions, a decoded picture buffer (DPB) management algorithm is also proposed. The inter-view and inter-layer motion predictions are integrated into a consolidated prediction by harmonizing with the temporal motion prediction of HEVC. We found that the proposed scalable multi-view codec achieves bitrate reduction of 36.1%, 31.6% and 15.8% on the top of ${\times}2$, ${\times}1.5$ parallel scalable codec and parallel multi-view codec, respectively.
Keywords
High efficiency video coding; Scalable video coding; Multi-view video coding;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Wiegand, G.-J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE trans. on Circuits and Systems for Video Technology, vol. 13, no.7, pp. 560-576, July 2003.   DOI
2 A. Tamhankar and K.-R. Rao, "An Overview of H.264/MPEG-4 part 10," 4th EURASIP Conference on Video/Image Processing and Multimedia Communications, vol. 1, pp. 1-51, June 2003.
3 T. Wiegand, G. Sullivan, and A. Luthra, "Draft ITU-T recommendation and final draft international standard of joint video specification," JVT Document, JVT-G050r1, Geneva, CH, May 2003.
4 H. Schwarz, T. Hinz, D. Marpe, and T. Wiegand, "Constrained inter-layer prediction for single-loop decoding in spatial scalability," IEEE International Conference on Image Processing, pp. 870-873, Genoa, IT, Sep. 2005.
5 H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE trans. on Circuits and Systems for Video Technology, vol. 17, no. 9, pp. 1103-1120, Sep. 2007.   DOI
6 M. Wien, H. Schwarz, and T. Oelbaum, "Performance analysis of SVC," IEEE trans. on Circuits and Systems for Video Technology, vol. 17, no. 9, pp. 1194-1203, Sep. 2007.   DOI
7 K. De Wolf, D. De Schrijver, S. De Zutter, and R. Van de Walle, "Analysis and coding performance of inter-layer prediction," International Symposium on Signal Processing and Its Applications, pp. 1-4, Sharjah, AE, Feb. 2007.
8 C.-S. Park, S.-Jin. Baek, M.-S. Yoon, H.-K. Kim, and S.-J. Ko, "Selective inter-layer residual prediction for SVC-based video streaming," IEEE Trans. Consumer Electronics., vol. 55, no. 1, pp. 235-239, Feb. 2009.   DOI
9 Y. Ho and K. Oh, "Overview of Multi-view Video Coding," 6th EURASIP Conference focused on Speech and Image Processing, vol. 1, pp. 1-51, June 2007.
10 ISO/IEC JTC1/SC29/WG11, "Requirements on Multi-view Video Coding v.7," The 77th MPEG meeting, N8218, July 2006.
11 ISO/IEC MPEG & ITU-T VCEG, "Joint Draft 1.0 on Multi-view Video Coding," The JVT meeting, JVT-U209, Nov. 2006.
12 K. McCann, W.-J Han, I.-K Kim, J-H Min, E. Alshina, A. Alshin, T. Lee, J. Chen, V. Seregin, S. Lee, Y.-M Hong, M.-S. Cheon, and N. Shlyakhov, "Samsung's Response to the Call for Proposals on Video Compression Technology," The 1st JCT-VC meeting, JCTVC-A124, Dresden, DE, Apr. 2010.
13 M. Winken, S. Bobe, B. Bross, P. Helle, T. Hinz, H. Kirchhoffer, H. Lakshman, D. Marpe, S. Oudin, M. Preib, H. Schwarz, M. Siekmann, K. Suhring, and T. Wiegand, "Description of video technology proposal by Fraunhofer HHI," The 1st JCT-VC meeting, JCTVC-A116, Dresden, DE, Apr. 2010.
14 G. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
15 T. Wiegand, J. Ohm, G. Sullivan, W. Han, R. Joshi, T. Tan, and K. Ugur, "Special section on the joint call for proposals on high efficiency video coding (HEVC) standardization," IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 12, pp. 1661-1666, Dec. 2010.   DOI
16 J. Kim and et al., "TE9: Report on large block structure testing," The 3rd JCT-VC meeting, JCT-VC C067 (m18090), Guangzhou, CN, Oct. 2010.
17 B. Bross, W.-J. Han, J.-R. Ohm, G.J. Sullivan, and T. Wiegand, "WD6: Working draft 6 of high-efficiency video coding," The 8th JCT-VC meeting, JCT-VC H1003, San Jose, CA, Jan. 2012.
18 I. Kim, J. Min, W. Han, and J. Park, "Block Partitioning Structure in HEVC Standard," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
19 P. Helle, S. Oudin, B. Bross, D. Marpe, M. Bici, K. Ugur, J. Jung, G. Clare, and T. Wiegand, "Block Merging for Quadtree-based Partitioning in HEVC," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
20 J. Lainema, F. Bossen, W. Han, J. Min, and K. Ugur, "Intra Coding of the HEVC standard," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
21 R. Sjoberg, Y. Chen, A. Fujibayashi, M. Hanuksela, J. Samuelsson, T. Tan, Y. Wang, and S. Wenger, "Overview of the HEVC High-level syntax and reference picture management," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
22 A. Norkin, G. Bjontegaard, A. Fuldseth, M. Narroschke, M. Ikeda, K. Andersson, M. Zhou, and G. Van der Auwera, "HEVC deblocking filter," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
23 H. Choi, J. Nam, D. Sim, and I. V, Bajic, "Scalable video coding based on high efficiency video coding (HEVC)," IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp.346-351, Victoria, CA, Aug. 2011.
24 C. Fu, E. Alshina, Y. Huang, C. Chen, C. Tsai, C. Hsu, S. Lei, J. Park, and W. Han, "Sample adaptive offset in HEVC Standard," IEEE trans. on Circuits and Systems for Video Technology, to be published, 2012.
25 A. Luthra, "Scalable enhancement requirements for HEVC," Document of Joint Collaborative Team on Video Coding, JCTVC-E502, Geneva, CH, Mar. 2011.
26 A. Luthra, J. Ohm, and J. Ostermann, "Draft call for proposals on the scalable video coding extensions of HEVC," The 98th MPEG meeting, N12398, Geneva, CH, Nov. 2011.
27 H. Choi, J. Nam, and D. Sim, "Scalable structures and inter-layer predictions for HEVC scalable extension," The 6th JCT-VC meeting, JCT-VC F096 (m20509), Torino, IT, Jul. 2011.
28 ISO/IEC JTC1/SC29/WG11, "Applications and requirements on 3D video coding," The 96th MPEG meeting, N12035, Geneva, CH, Mar. 2011.
29 ISO/IEC JTC1/SC29/WG11, "Call for proposals on 3D video coding technology," The 96th MPEG meeting, N12036, Geneva, CH, Mar. 2011.
30 J. Nam, W. Lim, D. Sim, and I. Bajic, "Multi-view video coding based on high efficiency video coding (HEVC)," The 26th International Technical Conference on Circuits and Syst., Computers, and Communications, pp. 169-172, Gyeongju, KR, Jun. 2011.
31 http://hevc.kw.bbc.co.uk/trac/browser/tags/HM-6.1, HM6.1 S/W.
32 K. McCann, B. Bross, S. Sekiguchi, and W. Han, "High efficiency video coding (HEVC) test model 6 (HM 6) encoder description," and T. Wiegand, "WD6: Working draft 6 of high-efficiency video coding," The 8th JCT-VC meeting, JCT-VC H1002, San Jose, CA, Jan. 2012.
33 G. Bjontegaard, "Calculation of average PSNR differences between RD-Curves," ITU-T SG16/Q.6, VCEG-M33, Austin, TX, Apr. 2001.
34 F. Bossen, "Common test conditions and software reference configurations," The 8th JCT-VC meeting, JCT-VC H1100, San Jose, CA, Jan. 2012.