Browse > Article
http://dx.doi.org/10.3837/tiis.2019.09.015

Maximum A Posteriori Estimation-based Adaptive Search Range Decision for Accelerating HEVC Motion Estimation on GPU  

Oh, Seoung-Jun (Department of Electronics Engineering, Kwangwoon University)
Lee, Dongkyu (Hyundai Mobis)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.13, no.9, 2019 , pp. 4587-4605 More about this Journal
Abstract
High Efficiency Video Coding (HEVC) suffers from high computational complexity due to its quad-tree structure in motion estimation (ME). This paper exposes an adaptive search range decision algorithm for accelerating HEVC integer-pel ME on GPU which estimates the optimal search range (SR) using a MAP (Maximum A Posteriori) estimator. There are three main contributions; First, we define the motion feature as the standard deviation of motion vector difference values in a CTU. Second, a MAP estimator is proposed, which theoretically estimates the motion feature of the current CTU using the motion feature of a temporally adjacent CTU and its SR without any data dependency. Thus, the SR for the current CTU is parallelly determined. Finally, the values of the prior distribution and the likelihood for each discretized motion feature are computed in advance and stored at a look-up table to further save the computational complexity. Experimental results show in conventional HEVC test sequences that the proposed algorithm can achieves high average time reductions without any subjective quality loss as well as with little BD-bitrate increase.
Keywords
adaptive search range (ASR); High Efficiency Video Coding (HEVC); GPU computung; motion estimation (ME); parallel reduction; motion vector difference (MVD);
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 F. Bossen, B. Bross, K. Suhring and D. Flynn, "HEVC complexity and implementation analysis," IEEE Trans. on Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1685-1696, Dec. 2012.   DOI
2 M. Viitanen, J. Vanne, T. D. Hämäläinen, M. Gabbouj and J. Lainema, "Complexity analysis of next-generation HEVC decoder," in Proc. of 2012 IEEE International Symposium on Circuits and Systems, pp. 882-885, May 2012.
3 I.-K. Kim, J. Min, T. Lee, W.-J. Han, and J. Park, "Block partitioning structure in the HEVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1679-1706, Dec. 2012.
4 J. Vanne, M. Viitanen, and T. D. Hamalainen, "Efficient mode decision schemes for HEVC inter prediction," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 9, pp. 1579-1593, Sep. 2014.   DOI
5 Y.-G. Lee, "Early search termination for fast motion estimation," EURASIP Journal on Image and Video Processing, 2015(29), Sep. 2015.
6 R. Khemiri, N. Bahri, F. Belghith, F. Sayadi, M. Atri, and N. Masmoudi, "Fast motion estimation for HEVC video coding," in Proc. of 2016 IEEE International Image Processing, Applications and Systems, pp. 1-4, Nov. 2016.
7 Z. Pan, J. Lei, Y. Zhang, X. Sun, and S. Kwong, "Fast motion estimation based on content property for low-complexity H.265/HEVC encoder" IEEE. Transactions on Broadcasting, vol. 62, no. 3, pp. 675-684, June 2016.   DOI
8 S.-H. Yang, J.-Z. Jiang, and H.-J. Yang, "Fast motion estimation for HEVC with directional search," Electron. Lett., vol. 50, no. 9, pp. 673-675, Apr. 2014.   DOI
9 H. Kibeya, F. Belghith, M. A. B. Ayed, and N. Masmoudi, "Adaptive motion estimation search window size for HEVC standard," in Proc. of 2016 7th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT), Dec. 2016.
10 T.-K. Lee, Y.-L Chan, and W.-C. Siu, "Adaptive search range for HEVC motion estimation based on depth information," IEEE Trans. Circuits Syst. Video Technol., vol. 27, no. 10, pp. 2216-2230, Oct. 2017.   DOI
11 K. Singh, S. R. Ahamed, "Computationally efficient motion estimation algorithm for HEVC," Journal of Signal Processing Systems, Springer, vol. 90, no. 12, pp. 1713-1727, Dec. 2018.   DOI
12 J. D. Owens, D. Luebke, N. Govindaraju, M. Harris, J. Kruger, A. E. Lefohn, and T. Purcell, "A Survey of General-Purpose Computation on Graphics Hardware," Computer Graphics Forum, vol. 26, no. 1, pp. 80-113, 2007.   DOI
13 J.-L. Lin, Y.-W. Chen, Y.-W. Huang, and S.-M. Lei, "Motion vector coding in the HEVC standard," IEEE J. Sel. Topics Signal Process., vol. 7, no. 6, pp. 957-968, Dec. 2013.   DOI
14 Y. Tian, J. Yan, S. Dong, and T. Huang, "PA-Search: Predicting units adaptive motion search for surveillance video coding," Computer Vison and Image Understanding, Elsevier, vol. 170, pp. 14-27, May 2018.   DOI
15 D. Lee, C. -B. Ahn, Y. Chung, and S.-J. Oh, "An adaptive search range decision algorithm for parallel motion estimation," in Proc. of 2018 International Workshop on Advanced Image Technology (IWAIT), May 2018.
16 Y. J. Ahn, T. J. Hwang, L. D, S. Kim, S. J. Oh and D. Sim, "Study of parallelization methods for software based real-time HEVC encoder implementation," Journal of Broadcast Engineering, vol. 18, no. 6, pp. 835-849, 2013.   DOI
17 Y. J. Ahn, T. J. Hwang, D. G. Sim and W. J. Han, "Complexity model based load-balancing algorithm for parallel tools of HEVC," in Proc. of IEEE Visual Communications and Image Processing (VCIP), pp. 1-5, 2013.
18 N. M. Cheung, O. C. Au, M. C. Kung, P. H. W. Wong and C. H. Liu, "Highly parallel rate-distortion optimized intra-mode decision on multicore graphics processors," IEEE Transactions on Circuits and Systems for Video Technology, vol. 19, no. 11, pp. 1692-1703, 2009.   DOI
19 B. Pieters, C. F. J. Hollemeersch, J. De Cock, Lambert P, W. De Neve and R. Van de Walle, "Parallel deblocking filtering in MPEG-4 AVC/H. 264 on massively parallel architectures," IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 1, pp. 96-100, 2011.   DOI
20 S. Kim, D. Lee, Y. Ahn, T. J. Hwang, D. Sim and S. J. Oh, "DCT-based interpolation filtering for HEVC on graphics processing units," in Proc. of the International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp. 155-158, 2013.
21 D. K. Lee and S. J. Oh, "Variable block size motion estimation implementation on compute unified device architecture (CUDA)," in Proc. of the IEEE International Conference on Consumer Electronics, Las Vegas, pp. 635-636, Jan. 2013.
22 W. N. Chen and H. M. Hang, "H.264/AVC motion estimation implementation on compute unified device architecture (CUDA)," in Proc. of the IEEE International Conference on Multimedia and Expo (ICME), pp. 697-700, 2008. .
23 Z. Jing, J. Liangbao and C. Xuehong, "Implementation of parallel full search algorithm for motion estimation on multi-core processors," in Proc. of IEEE International Conference on Next Generation Information Technology, pp. 31-35, 2011.
24 R. Rodriguez-Sanchez, J. L. Martinez, G. Fernandez-Escribano, J. M. Claver and J. L. Sanchez, "Reducing complexity in H. 264/AVC motion estimation by using a GPU," in Proc. of IEEE 13th International Workshop on Multimedia Signal Processing (MMSP), pp. 1-6, 2011.
25 D. Lee, D. Sim and S. J. Oh, "Integer-pel motion estimation for HEVC on compute unified device architecture (CUDA)," IEIE Transactions on Smart Processing and Computing, vol. 3, no. 6, pp. 397-403, 2014.   DOI
26 X. Jiang et al., "High Efficieny Video Coding (HEVC) Motion Estimation Parallel Algorithms on GPU," in Proc. of the IEEE International Conference Consumer Electronics-Taiwan (ICCE-Taiwan), pp. 115-116, 2014.
27 F. Takano, H. Igarashi, and T. Moriyoshi, "4K-UHD real-time HEVC encoder with GPU accelerated motion estimation," in Proc. of IEEE Int. Conf. on Image Processing (ICIP), Sep. 2017.
28 S. Radicke, J. Hahn, C. Grecos, & Q. Wang, "A highly-parallel approach on motion estimation for high efficiency video coding (HEVC)," in Proc. of IEEE Int. Conf. on Consumer Electronics, pp.187-188, 2014.
29 D. K. Lee, D. Sim, K. Cho and S. J. Oh, "Fast motion estimation for HEVC on graphic processing unit (GPU)," Journal of Real-Time Image Processing, Springer, vol. 12, issue 2, pp. 549-562, Aug. 2016.   DOI
30 Y.-G. Xue, H.-Y. Su, J. Ren, M. Wen, C.-Y. Zhang, and L.-Q. Xiao, "A highly parallel and scalable motion estimation algorithm with GPU for HEVC," Scientific Programming, Hindawi, vol. 2017, pp. 1-15, Oct. 2017.
31 C. Rosewarne, B. Bross, M. Naccari, K. Sharman, and G. Sullivan, "High Efficiency Video Coding (HEVC) Test Model 16 (HM16) Improved Encoder Description Update 6," Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-X1002, Jun. 2016.
32 T.K. Tan, R. Weerakkody, M. Mrak, N. Ramzan, V. Baroncini, J. Ohm, and G. Sullivan, "Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance," IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 1, pp. 76-90, Jan. 2016.   DOI
33 W.-J. Han et al., "Improved video compression efficiency through flexible unit representation and corresponding extension of coding tools," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 12, pp. 1709-1720, Dec. 2010.   DOI
34 G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1649-1668, Dec. 2012.   DOI
35 ITU-T, High Efficiency Video Coding, Rec. ITU-T H.265 and ISO/IEC 23008-2, Oct. 2014.
36 G. J. Sullivan, J. M. Boyce, Y. Chen, J.-R. Ohm, C. A. Segall, A. Vetro, "Standardized Extensions of High Efficiency Video Coding," IEEE Journal on Selected Topics in Signal Processing, vol. 7, no. 6, pp 1001-1016, Dec. 2013.   DOI
37 G. Correa, P. Assuncao, L. Agostini, and L. A. da Silva Cruz, "Performance and computational complexity assessment of high-efficiency video encoders," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1899-1909, Dec. 2012.   DOI