그림 1. 공간적 확장 스케일러블 부호화 알고리즘 개념도 Fig. 1. A block diagram of a scalable video coding with spatial scalability
그림 2. 심층신경망 기반 업스케일링 네트워크 구조 Fig. 2. Structure of proposed up-sampling network based on a convolutional neural network
그림 3. 성능 평가에 이용된 실험 영상 Fig. 3. Test sequences for performance evaluation
그림 4. bus 영상의 향상 계층 65 kbps 부호화 결과 영상 (41번째 프레임) Fig. 4. Decoded frame of bus of the enhancement layer at 65 kbps (41st frame)
그림 5. calendar 영상의 향상 계층 45 kbps 부호화 결과 영상 (42번째 프레임) Fig. 5. Decoded frame of calendar of the enhancement layer at 45 kbps (42nd frame)
그림 6. waterfall 영상의 향상 계층 85 kbps 부호화 결과 영상 (64번째 프레임) Fig. 6. Decoded frame of waterfall of the enhancement layer at 85 kbps (64th frame)
표 1. 기존 SHVC 프레임워크와 제안 deepSHVC 프레임워크의 부호화 성능 Table 1. Coding performance of the conventional SHVC and the proposed deepSHVC framework
References
- G. J. Sullivan, J.-R. Ohm, W.-J. Han, T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, pp. 1648-1667, Dec. 2012.
- B. Bross, Working Draft 1 of Versatile Video Coding, document JVET-J1001, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Apr. 2018.
- E. Agustsson, F. Mentzer, M. Tschannen, L. Cavigelli, R. Timofte, L. Benini, L. V. Gool, "Soft-to-hard vector quantization for end-to-end learning compressible representations," Proceeding of Advances in Neural Information Processing Systems, Long beach, California, pp. 1141-1151, 2017.
- J. Balle, V. Laparra, E. P. Simoncelli, "End-to-end optimized image compression," Proceeding of International Conference on Learning Representations, Toulon, France, 2017.
- C.-Y. Wu, N. Singhal, P. Krahenbühl, "Video compression through image interpolation," Proceeding of European Conference on Computer Vision, Munich, Germany, 2018.
- W.-S. Park, M. Kim, "CNN-based In-loop Filtering for Coding Efficiency Improvement," Proceeding of IEEE Image Video and Multidimensional Signal Processing (IVMSP) workshop, Bordeaux, France, pp. 1-5, 2016.
- N. Yan, D. Liu, H. Li, F. Wu, "A convolutional neural network approach for half-pel interpolation in video coding," Proceeding of International Symposium on Circuits and Systems, Baltimore, Maryland, pp. 1-4, 2017.
- D. Liu, H. Ma, Z. Xiong, F. Wu, "CNN-based DCT-like transform for image compression," Proceeding of International Conference on Multimedia Modeling, Bangkok, Thailand, pp. 61-72, 2018.
- Z. Liu, X. Yu, Y. Gao, S. Chen, X. Ji, D. Wang, "CU partition mode decision for HEVC hardwired intra encoder using convolution neural network," IEEE Trans. Image Processing, vol. 25, no. 11, pp. 5088-5103, Nov. 2016. https://doi.org/10.1109/TIP.2016.2601264
- H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007. https://doi.org/10.1109/TCSVT.2007.905532
- J. M. Boyce, Y. Ye, J. Chen, A. K. Ramasubramonian, "Overview of SHVC: Scalable extensions of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 1, pp. 20-34, Jan. 2016. https://doi.org/10.1109/TCSVT.2015.2461951
- W. Shi, J. Caballero, F. Huszar, J. Totz, A.P. Aitken, R. Bishop, D. Rueckert, Z. Wang, "Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, Nevada, pp. 1874-1883, 2016.
- A. L. Maas, A. Y. Hannun, A. Y. Ng, "Rectifier nonlinearities improve neural network acoustic models," Proceeding of International Conference on Machine Learning, Atlanta, Georgia, p. 3, 2013.
- D. P. Kingma, J. L. Ba, "Adam: A method for stochastic optimization," Proceeding of International Conference for Learning Representations, San Diego, California, pp. 1-41, 2015.
- Ultra Video Groupm, http://ultravideo.cs.tut.fi/#testsequences (accessed Jan. 2, 2019).
- SJTU 4K Video Sequence, http://medialab.sjtu.edu.cn/web4k/index.html (accessed Jan. 2, 2019).