Browse > Article
http://dx.doi.org/10.3837/tiis.2020.07.016

Fast Depth Video Coding with Intra Prediction on VVC  

Wei, Hongan (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Zhou, Binqian (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Fang, Ying (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Xu, Yiwen (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Zhao, Tiesong (Fujian Key Lab for Intelligent Processing and Wireless Transmission of Media Information, College of Physics and Information Engineering, Fuzhou University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.14, no.7, 2020 , pp. 3018-3038 More about this Journal
Abstract
In the stereoscopic or multiview display, the depth video illustrates visual distances between objects and camera. To promote the computational efficiency of depth video encoder, we exploit the intra prediction of depth videos under Versatile Video Coding (VVC) and observe a diverse distribution of intra prediction modes with different coding unit sizes. We propose a hybrid scheme to further boost fast depth video coding. In the first stage, we adaptively predict the HADamard (HAD) costs of intra prediction modes and initialize a candidate list according to the HAD costs. Then, the candidate list is further improved by considering the probability distribution of candidate modes with different CU sizes. Finally, early termination of CU splitting is performed at each CU depth level based on the Bayesian theorem. Our proposed method is incorporated into VVC intra prediction for fast coding of depth videos. Experiments with 7 standard sequences and 4 Quantization parameters (Qps) validate the efficiency of our method.
Keywords
Depth video; intra prediction; Versatile Video Coding (VVC); fast coding algorithm; mode decision; early termination;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Sanchez, L. Agostini and C. Marcon, "Complexity reduction by modes reduction in RD-list for intra-frame prediction in 3D-HEVC depth maps," in Proc. of 2017 IEEE International Symposium on Circuits and Systems (ISCAS), Baltimore, MD, pp. 1-4, May. 2017.
2 L. Shen, K. Li, G. Feng, P. An and Z. Liu, "Efficient intra mode selection for depth-Map coding utilizing spatiotemporal, inter-component and inter-view correlations in 3D-HEVC," IEEE Transactions on Image Processing, vol. 27, no. 9, pp. 4195-4206, Sept. 2018.   DOI
3 P. Merkle, K. Muller, D. Marpe and T. Wiegand, "Depth Intra Coding for 3D Video Based on Geometric Primitives," in Proc. of IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 3, pp. 570-582, Mar. 2016.   DOI
4 R. Zhang, K. Jia, P. Liu and Z. Sun, "Edge-Detection Based Fast Intra-Mode Selection for Depth Map Coding in 3D-HEVC," in Proc. of 2019 IEEE Visual Communications and Image Processing (VCIP), Sydney, Australia, pp. 1-4, 2019.
5 Calculation of average PSNR differences between RDcurves, VCEG M33, 2001.
6 G. J. Sullivan, J. Ohm, W. J. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1688, Dec. 2012.   DOI
7 Common test conditions and software reference configurations , JVET J1010-v1, 2018.
8 J. Chen, Y. Ye, S. Kim, "Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2)," in Proc. o f Document JVET-K1002-v2 11th JVET Meeting, Ljubljana, SI, July, 2018.
9 T. Lin, H. Jiang, J. Huang and P. Chang, "Fast intra coding unit partition decision in H.266/FVC based on spatial features," Journal of Real-Time Image Processing, 17, 493-510, 2020.   DOI
10 G. J. Sullivan and T. Wiegand, "Video compression-from concepts to the H.264/AVC standard," Proceedings of the IEEE, vol. 93, no. 1, pp. 18-31, Jan. 2005.   DOI
11 D. Yoon and Y. Ho, "Fast depth video coding method using adaptive edge classification," in Proc. of 2011 Visual Communications and Image Processing (VCIP), Tainan, pp. 1-4, 2011.
12 G. Sanchez, M. Saldanha, G. Balota, B. Zatt, M. Porto and L. Agostini, "Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm," in Proc. of 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, pp. 3209-3213, Jan. 2014.
13 T. L. Da Silva, L. V. Agostini and L. A. da Silva Cruz, "Fast mode selection algorithm based on texture analysis for 3D-HEVC intra prediction," in Proc. of 2015 IEEE International Conference on Multimedia and Expo (ICME), Turin, Italy, pp. 1-6, June, 2015.
14 M. Kim, N. Ling, L. Song, "Fast single depth intra mode decision for depth map coding in 3D-HEVC," in Proc. o f 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Turin, Italy, pp. 1-6, 2015.
15 H. Wang and Q. Li, "Fast Decision Algorithm for Intra Mode in Depth Map of 3D-HEVC," Proc. of 2019 IEEE 2nd International Conference on Information Communication and Signal Processing (ICICSP), Weihai, China, pp. 327-331, 2019.
16 H. Hamout and A. Elyousfi, "Fast Depth Map Intra Coding for 3D Video Compression Based Tensor Feature Extraction and Data Analysis," IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 7, pp. 1933-1945, 2020.   DOI
17 R. Conceicao, G. Avila, G. Correa, M. Porto, B. Zatt and L. Agostin, "Complexity reduction for 3D-HEVC depth map coding based on early Skip and early DIS scheme," in Proc. of 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, pp. 1116-1120, 2016.
18 H. Chen, C. Fu, Y. Chan and X. Zhu, "Early intra block partition decision for depth maps in 3D-HEVC," in Proc. of 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, pp. 1777-1781, 2018.
19 K. Chung, Y. Huang, C. Lin and J. Fang, "Novel bitrate saving and fast coding for depth videos in 3D-HEVC," IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 10, pp. 1859-1869, Oct. 2016.   DOI
20 L. F. R. Lucas, K. Wegner, N. M. M. Rodrigues, C. L. Pagliari, E. A. B. da Silva and S. M. M. de Faria, "Intra predictive depth map coding using flexible block partitioning," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 4055-4068, Nov. 2015.   DOI
21 Methodology for the subjective assessment of video quality in multimedia applications, ITU-R Rec. BT. 1788, 2007.
22 Y. Hsu, J. Lin, M. Chen, C. Yeh, M. Lin and W. Lu, "Acceleration of Depth Intra Coding for 3D-HEVC by Efficient Early Termination Algorithm," in Proc. of 2018 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Chengdu, pp. 127-130, 2018.
23 Q. Zhang, N. Li, L. Huang and Y. Gan, "Effective early termination algorithm for depth map intra coding in 3D-HEVC," Electronics Letters, vol. 50, no. 14, pp. 994-996, July 2014.   DOI
24 C. Fu, H. Chen, Y. Chan, S. Tsang, H. Hong and X. Zhu, "Fast Depth Intra Coding Based on Decision Tree in 3D-HEVC," IEEE Access, vol. 7, pp. 173138-173147, 2019.   DOI
25 Z. Zheng, J. Huo, B. Li and H. Yuan, "Fine virtual view distortion estimation method for depth map coding," IEEE Signal Processing Letters, vol. 25, no. 3, pp. 417-421, Mar. 2018.   DOI
26 H. Wei, M. Wang, Y. Xu, Y. Liu, T. Zhao, "Probability-based intra encoder optimization in high efficiency video coding," in Proc. of 2018 IEEE Visual Communications and Image Processing (VCIP), Tai Wan, China, 1-4, 2018.
27 S. Cho and M. Kim, "Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding," IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, no. 9, pp. 1555-1564, Sept. 2013.   DOI