Browse > Article
http://dx.doi.org/10.3837/tiis.2016.03.014

Fast CU Encoding Schemes Based on Merge Mode and Motion Estimation for HEVC Inter Prediction  

Wu, Jinfu (School of Aerospace Science and Technology, Xidian University)
Guo, Baolong (School of Aerospace Science and Technology, Xidian University)
Hou, Jie (School of Aerospace Science and Technology, Xidian University)
Yan, Yunyi (School of Aerospace Science and Technology, Xidian University)
Jiang, Jie (Ocean Electronic Lab, Hangzhou Dianzi University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.10, no.3, 2016 , pp. 1195-1211 More about this Journal
Abstract
The emerging video coding standard High Efficiency Video Coding (HEVC) has shown almost 40% bit-rate reduction over the state-of-the-art Advanced Video Coding (AVC) standard but at about 40% computational complexity overhead. The main reason for HEVC computational complexity is the inter prediction that accounts for 60%-70% of the whole encoding time. In this paper, we propose several fast coding unit (CU) encoding schemes based on the Merge mode and motion estimation information to reduce the computational complexity caused by the HEVC inter prediction. Firstly, an early Merge mode decision method based on motion estimation (EMD) is proposed for each CU size. Then, a Merge mode based early termination method (MET) is developed to determine the CU size at an early stage. To provide a better balance between computational complexity and coding efficiency, several fast CU encoding schemes are surveyed according to the rate-distortion-complexity characteristics of EMD and MET methods as a function of CU sizes. These fast CU encoding schemes can be seamlessly incorporated in the existing control structures of the HEVC encoder without limiting its potential parallelization and hardware acceleration. Experimental results demonstrate that the proposed schemes achieve 19%-46% computational complexity reduction over the HEVC test model reference software, HM 16.4, at a cost of 0.2%-2.4% bit-rate increases under the random access coding configuration. The respective values under the low-delay B coding configuration are 17%-43% and 0.1%-1.2%.
Keywords
High Efficiency Video Coding (HEVC); inter prediction; mode decision; early termination;
Citations & Related Records
연도 인용수 순위
  • Reference
1 "High efficiency video coding," ITU-T and R. H. ISO/IEC 23008-2 (HEVC), Oct. 2014.
2 G. Sullivan, J. Ohm, W.-J. Han, and T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Dec. 2012. Article (CrossRef Link)   DOI
3 "Advanced video coding for generic audiovisual services," ITU-T and R. H. ISO/IEC 14496-10 (AVC), Mar. 2009.
4 J. Ohm, G. J. Sullivan, H. Schwarz, T. K. Tan, and T. Wiegand, “Comparison of the coding efficiency of video coding standards - including high efficiency video coding (HEVC),” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1669-1684, Dec. 2012. Article (CrossRef Link)   DOI
5 P. Helle et al., “Block merging for quadtree-based partitioning in HEVC,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1720-1731, Dec. 2012. Article (CrossRef Link)   DOI
6 F. Bossen, B. Bross, K. Suhring, and D. Flynn, “HEVC complexity and implementation analysis,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1685-1696, Dec. 2012. Article (CrossRef Link)   DOI
7 I. K. Kim, J. Min, T. Lee, W. J. Han, and J. Park, “Block partitioning structure in the HEVC standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1697-1706, Dec. 2012. Article (CrossRef Link)   DOI
8 Y. Yuan et al., “Quadtree based non-square block structure for inter frame coding in HEVC,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1707-1719, Dec. 2012. Article (CrossRef Link)   DOI
9 K. McCann, C. Rosewarne, B. Bross, M. Naccari, K. Sharman, and G. J. Sullivan, "High efficiency video coding (HEVC) test model 16 (HM 16) encoder description," ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC), Document JCTVC-R1002, Jul. 2014.
10 K. Choi, S.-H. Park, and E. S. Jang, "Coding tree pruning based CU early termination," Document JCTVC-F092, Torino, Italy, Jul. 2011.
11 JCT-VC (2015) Subversion repository for the HEVC test model reference software, ver. HM 16.4 Article (CrossRef Link)
12 J. Lee, S. Kim, K. Lim, and S. Lee, “A fast CU size decision algorithm for HEVC,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 3, pp. 411-421, Mar. 2015. Article (CrossRef Link)   DOI
13 H. Zeng, C. Cai, and K.-K. Ma, “Fast mode decision for H.264/AVC based on macroblock motion activity,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 19, no. 4, pp. 491-499, Apr. 2009. Article (CrossRef Link)   DOI
14 L. Shen, Z. Liu, T. Yan, Z. Zhang, and P. An, “View-adaptive motion estimation and disparity estimation for low complexity mulatiview video coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 6, pp. 925-930, Jun. 2010. Article (CrossRef Link)   DOI
15 F. Bossen, "Common test conditions and software reference configurations," Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Document: JCTVC-L1100, 12th Meeting: Geneva, CH, 2013.
16 G. Bjontegaard, “Calculation of average PSNR difference between RD-curves,” VCEG-M33, Austin, TX, USA, Apr. 2001.
17 C. Yan, Y. Zhang, J. Xu et al., “A highly parallel framework for HEVC coding unit partitioning tree decision on many-core processors,” IEEE Signal Processing Letters, vol. 21, no. 5, pp. 573-576, May 2014. Article (CrossRef Link)   DOI
18 C. Yan, Y. Zhang, J. Xu et al., “Efficient parallel framework for HEVC motion estimation on many-core processors,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 12, pp. 2077-2089, Dec. 2014. Article (CrossRef Link)   DOI
19 R. H. Gweon and Y. L. Lee, "Early termination of CU encoding to reduce HEVC complexity," Document JCTVC-F045, Torino, Italy, Jul. 2011.
20 J. Yang, J. Kim, K. Won, H. Lee, and B. Jeon, "Early skip detection for HEVC," Document JCTVC-G543, Geneva, Switzerland, Nov. 2011.
21 L. Shen, Z. Liu, X. Zhang, W. Zhao, and Z. Zhang, “An effective CU size decision method for HEVC encoders,” IEEE Transactions on Multimedia, vol. 15, no. 2, pp. 465-470, Feb. 2013. Article (CrossRef Link)   DOI
22 L. Shen, Z. Zhang, and Z. Liu, “Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatiotemporal correlations,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 10, pp. 1709-1722, Oct. 2014. Article (CrossRef Link)   DOI
23 J. Xiong, H. Li, Q. Wu, and F. Meng, “A fast HEVC inter CU selection method based on pyramid motion divergence,” IEEE Transactions on Multimedia, vol. 16, no. 2, pp. 559-564, Feb. 2014. Article (CrossRef Link)   DOI
24 J. Vanne, M. Viitanen, and T. Hamalainen, “Efficient mode decision schemes for HEVC inter prediction,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 9, pp. 1579-1593, Sep. 2014. Article (CrossRef Link)   DOI
25 S. Ahn, B. Lee and M. Kim, “A novel fast CU encoding scheme based on spatiotemporal encoding parameters for HEVC inter coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 3, pp. 422-435, Mar. 2015. Article (CrossRef Link)   DOI
26 Z. Pan, S. Kwong, M.-T. Sun, and J. Lei, “Early MERGE mode decision based on motion estimation and hierarchical depth correlation for HEVC,” IEEE Transactions on Broadcasting, vol. 60, no. 2, pp. 405-412, Jun. 2014. Article (CrossRef Link)   DOI