Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Intra Coding Tools of Enhanced Compression beyond VVC Capability

  • Kim, Bumyoon (Department of Electrical and Computer Engineering, Sungkyunkwan University) ;
  • Jeon, Byeungwoo (Department of Electrical and Computer Engineering, Sungkyunkwan University)
  • Received : 2022.10.04
  • Accepted : 2022.12.13
  • Published : 2022.12.20
Download PDF
⟨ Previous Next ⟩

Abstract

Even after the standardization of VVC completed in 2020, continuing efforts for developing even better video coding technology are still under way. In this context, the Joint Video Experts Group (JVET) is developing various video compression technologies under the name of enhanced compression beyond VVC capability which has reported BDBR gain of -6.75%, -14.05%, and -15.25% on its test model, ECM version 5.0, respectively in Y, Cb, and Cr channels by just having a few new or improved intra coding tools. The current activity has so far adopted 11 intra coding tools beyond VVC which can generate more sophisticated predictors, reduce signaling overhead, or combine various predictors. In this tutorial paper, we will review these techniques.

Keywords

Acknowledgement

This research was supported the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (NRF-2020R1A2C2007673).

References

  1. F. Bossen, X. Li, and K. Suehring, AHG report: Test model software development (AHG3), Joint Video Experts Team (JVET), 20th Meeting, teleconference, JVET-T0003, v.1, 2020.
  2. ECM reference software, https://vcgit.hhi.fraunhofer.de/ecm/ECM/-/tree/ECM-5.0 (accessed Oct. 4).
  3. M. Karczewicz et al., JVET AHG report: Enhanced compression beyond VVC capability (AHG12), Joint Video Experts Team (JVET), 27th Meeting, teleconference, JVET-AA0012, v.1, 2022.
  4. M. Coban, F. Leannec, K. Naser, and J. Strom, Algorithm description of Enhanced Compression Model 5 (ECM 5), Joint Video Experts Team (JVET), 26th Meeting, teleconference, JVET- Z2025, v.2, 2022.
  5. M. Coban, F. Leanne, J. Strom, and Y. Ye, Preliminary draft of algorithm description for Enhanced Compression Model 1 Software (ECM 1), Joint Video Experts Team (JVET), 23rd Meeting, teleconference, JVET-W0102, v.2, 2021.
  6. Y. Chang et al., EE2: Tests of compression efficiency methods beyond VVC, Joint Video Experts Team (JVET), 22nd Meeting, teleconference, JVET-V0120, v.2, 2021.
  7. K. Zhang, J. Chen, L. Zhang, and M. Karczewicz, Enhanced Cross-component Linear Model Intra-prediction, Joint Video Experts Team (JVET), 4th Meeting, Chengdu, JVET-D0110, v.3, 2016.
  8. G. Auwera, V. Seregin, A. Said, A. Ramasubramonian, and M. Karczewicz, CE3: Simplified PDPC (Test 2.4.1), Joint Video Experts Team (JVET), 11th Meeting, Ljubljana, JVET-K0063, v.2, Jul. 2018.
  9. B. Ray, G. Auwera, and M. Karczewicz, Unified PDPC for angular intra modes, Joint Video Experts Team (JVET), 17th Meeting, Brussels, JVET-Q0391, v.3, 2020.
  10. L. Li et al., CE3-6.2.1: Extended MPM list, Joint Video Experts Team (JVET), 12th Meeting, Macao, JVET-L0165, v.4, 2018.
  11. V. Seregin, W. Chien, and M. Karczewicz, Block shape dependent intra mode coding, Joint Video Experts Team (JVET), 4th Meeting, Chengdu, JVET-D0114, v.1, 2016.
  12. X. Zhao, V. Seregin, and M. Karczewicz, Six tap intra interpolation filter, Joint Video Experts Team (JVET), 4th Meeting, Chengdu, JVET-D0119, v.1, 2016.
  13. M. Abdoli et al., Non-CE3: Decoder-side Intra Mode Derivation with Prediction Fusion Using Planar, Joint Video Experts Team (JVET), 15th Meeting, Gothenburg, JVET-O0449, v.2, 2019.
  14. M. Abdoli, E. Mora, T. Guionnet, and M. Raulet, Non-CE3: Decoder-side Intra Mode Derivation with Prediction Fusion, Joint Video Experts Team (JVET), 14th Meeting, Geneva, JVET-N0342, v.5, 2019.
  15. E. Mora, A. Nasrallah, M. Abdoli, and M. Raulet, CE3: Decoder-side Intra Mode Derivation (tests 3.1.1, 3.1.2, 3.1.3 and 3.1.4), Joint Video Experts Team (JVET), 13th Meeting, Marrakech, JVET- M0094, v.2, 2019.
  16. E. Mora, A. Nasrallah, and M. Raulet, CE3-related: Decoder-side Intra Mode Derivation, Joint Video Experts Team (JVET), 12th Meeting, Macao, JVET-L0164, v.2, 2018.
  17. K. Naser, F. Leannec, T. Poirier, and F. Galpin, Evaluation of Template Matching Prediction for VVC, Joint Video Experts Team (JVET), 21st Meeting, teleconference, JVET-U0048, v.1, 2021.
  18. K. Naser T. Poirier, F. Leannec, and G. Martin-Cocher, EE2: Intra Template Matching, Joint Video Experts Team (JVET), 22nd Meeting, teleconference, JVET-V0130, v.6, 2021.
  19. X. Xu, X. Li, and S. Liu, CE8: CPR mode with local search ranges (Test CE8.3.1 and CE8.3.2), Joint Video Experts Team (JVET), 12th Meeting, Macao, JVET-L0293, v.2, 2018.
  20. X. Xiu, Y. He, and Y. Ye, Decoder-side intra mode derivation, Joint Video Experts Team (JVET), 3rd Meeting, Geneva, JVET-C0061, v.1, 2016.
  21. Y. Wang, L. Zhang, K. Zhang, Z. Deng, and N. Zhang, EE2-related: Template-based intra mode derivation using MPMs, Joint Video Experts Team (JVET), 22nd Meeting, teleconference, JVET-V0098-v2, 2021.
  22. K. Cao, N. Hu, V. Seregin, and M. Karczewicz, EE2-related: Fusion for template-based intra mode derivation, Joint Video Experts Team (JVET), 23rd Meeting, teleconference, JVET-W0123, v.2, 2021.
  23. K. Cao, Y. Chang, B. Ray, V. Seregin, and M. Karczewicz, EE2-2.1: Extended MRL candidate list," Joint Video Experts Team (JVET), 25th Meeting, teleconference, JVET-Y0116, v.1, 2022.
  24. J. Lainema, A. Aminlou, P. Astola, and R. Youvalari, AHG12: Slope adjustment for CCLM, Joint Video Experts Team (JVET), 25th Meeting, teleconference, JVET-Y0055, v.1, 2022.
  25. J. Lainema, A. Aminlou, P. Astola, and R. Youvalari, EE2-1.1: Slope adjustment for CCLM, Joint Video Experts Team (JVET), 26th Meeting, teleconference, JVET-Z0049, v.1, 2022.
  26. X. Li, R. Liao, J. Chen, and Y. Ye, Non-EE2: On chroma intra prediction mode, Joint Video Experts Team (JVET), 25th Meeting, teleconference, JVET-Y0092, v.3, 2022.
  27. X. Li, R. Liao, J. Chen, and Y. Ye, EE2-1.2: On chroma intra prediction, Joint Video Experts Team (JVET), 26th Meeting, teleconference, JVET-Z0051, v.1, 2022.
  28. L. Zhang, K. Zhang, H. Liu, Y. Wang, P. Zhao, and D. Hong, CE3-related: Modified chroma derived mode, Joint Video Experts Team (JVET), 12th Meeting, Macao, JVET-L0272, v.2, 2018.
  29. N. Choi, M. Park, and K. Choi, CE3-related: Chroma DM modification, Joint Video Experts Team (JVET), 12th Meeting, Macao, JVET-L0053, v.3, 2018.
  30. F. Bossen, J. Boyce, K. Suehring, X. Li, and V. Seregin, JVET common test conditions and software reference configurations for SDR video, Joint Video Experts Team (JVET), 14th Meeting, Geneva, JVET-N1010, v.1, 2019.
  31. F. Bossen, J. Boyce, K. Suehring, X. Li, and V. Seregin, VTM common test conditions and software reference configurations for SDR video, Joint Video Experts Team (JVET), 20th Meeting, tele- conference, JVET-T2010, v.1, 2020.
  32. M. Karczewicz and Y. Ye, Common test conditions and evaluation procedures for enhanced compression tool testing, Joint Video Experts Team (JVET), 21st Meeting, teleconference, JVET-U2017, v.1, 2021.
  33. M. Karczewicz and Y. Ye, Common test conditions and evaluation procedures for enhanced compression tool testing, Joint Video Experts Team (JVET), 22nd Meeting, teleconference, JVET-V2017, v.1, 2021.
  34. M. Karczewicz and Y. Ye, Common test conditions and evaluation procedures for enhanced compression tool testing, Joint Video Experts Team (JVET), 24th Meeting, teleconference, JVET-X2017, v.1, 2021.
  35. M. Karczewicz and Y. Ye, Common test conditions and evaluation procedures for enhanced compression tool testing, Joint Video Experts Team (JVET), 25th Meeting, teleconference, JVET-Y2017, v.1, 2022.
  36. M. Xu and B. Jeon, "User-Priority Based AV1 Coding Tool Selection," IEEE Trans. Broadcast., Vol.67, No.3, pp. 736-745, Sept. 2021, doi: https://doi.org/10.1109/TBC.2021.3071013.
  37. J. Park, B. Kim, and B. Jeon, "Machine Learning-Based Early Skip Decision for Intra Subpartition Prediction in VVC," IEEE Access, Vol.10, pp. 111052-111065, Oct. 2022. doi: https://doi.org/10.1109/ACCESS.2022.3215163.