Browse > Article
http://dx.doi.org/10.5909/JBE.2018.23.5.718

Deep Learning based Inter Prediction Technique for Video Coding  

Lee, Jeongkyung (Department of Electronic and Electrical Engineering, Ewha W. University)
Kim, Nayoung (Department of Electronic and Electrical Engineering, Ewha W. University)
Kang, Je-Won (Department of Electronic and Electrical Engineering, Ewha W. University)
Publication Information
Journal of Broadcast Engineering / v.23, no.5, 2018 , pp. 718-721 More about this Journal
Abstract
This paper presents an inter-prediction technique using deep learning, where a virtual reference frame of the current frame is synthesized by using the reconstructed frames to improve coding efficiency. Experimental results demonstrate that the proposed algorithm provides 1.9% BD-rate reduction on average as compared to HEVC reference software in the Random Access condition.
Keywords
HEVC; deep learning; virtual reference frame;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 J. Kang, S. Kim, and K. M. Lee, "Multi-modal Multi-scale Convolutional Neural Network based In-loop Filter Design for Next Generation Video Codec," IEEE International Conference on Image Processing, 2017.
2 J.K. Lee and J.-W. Kang, "Video coding technique based on deep learning", 2018 KIBME Summer Conference.
3 B. D. Brabandere, X. Jia, T. Tuytelaars, and L. V. Gool, "Dynamic filter networks," Neural Information Processing Systems (NIPS). 2016.
4 S. Niklaus, L. Mai, and F. Liu. "Video frame interpolation via adaptive separable convolution," International Conference on Computer Vision, 2017.
5 HM16.9 software, available at: https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.9
6 F. Bossen, "JCTVC-L1100: Common test conditions and software reference configurations" in ISO/IEC/JTC1/SC29/WG11 and ITU-T SG16 Q.6, Jan.2013.
7 S.H Cho, Y. H. Kim, W. Lim, H.W. Kim, and C.S. Choi, "A Technical Analysis on Deep Learning based Image and Video Compression", Journal of Broadcast Engineering, Vol. 23, No. 3, 383-394, May 2018   DOI
8 W. Park and M. Kim, "CNN-based in-loop filtering for coding efficiency improvement," IEEE Image, Video, and Multidimensional Signal Processing Workshop, 2016.
9 S. Liu, L. Wang, P. Wu, and H. Yang, "JVET AHG report 9: Neural Networks in Video Coding (AHG9)" in ISO/IEC/JTC1/SC29/ WG11 and ITU-T SG16 Q.6, Apr. 2018.