DOI QR코드

DOI QR Code

VVC Intra Triangular Partitioning Prediction for Screen Contents

스크린 콘텐츠를 위한 VVC 화면내 삼각형 분할 예측 방법

  • 최재륜 (한밭대학교 정보통신전문대학원 멀티미디어공학과) ;
  • 권대혁 (한밭대학교 정보통신전문대학원 멀티미디어공학과) ;
  • 한희지 (한밭대학교 정보통신전문대학원 멀티미디어공학과) ;
  • 이하현 (한국전자통신연구원) ;
  • 강정원 (한국전자통신연구원) ;
  • 최해철 (한밭대학교 정보통신전문대학원 멀티미디어공학과)
  • Received : 2020.03.25
  • Accepted : 2020.05.04
  • Published : 2020.05.30

Abstract

Versatile Video Coding (VVC) is a new video coding standard that is being developed by the Joint Video Experts Team of ISO/IEC/ITU-T and it has adopted various technologies including screen content coding tools. Screen contents have a feature that blocks are likely to have diagonal edges like character regions. If triangular partitioning coding is allowed for screen contents having such the feature, coding efficiency would increase. This paper proposes a intra prediction method using triangular partitioning prediction for screen content coding. Similar to the Triangular Prediction Mode of VVC that supports the triangular partitioning prediction, the proposed method derives two prediction blocks using Horizontal and Vertical modes and then it blends the predicted blocks applying masks with triangle shape to generate a final prediction block. The experimental results of the proposed method showed an average of 1.86%, 1.49%, and 1.55% coding efficiency in YUV, respectively, for VVC screen content test sequences.

VVC(Versatile Video Coding)는 ISO/IEC/ITU-T의 JVET(Joint Video Experts Team)에서 표준화 중인 새로운 비디오 부호화 표준으로 스크린 콘텐츠 부호화 툴을 포함한 다양한 기술을 채택하고 있다. 스크린 콘텐츠는 문자 영역과 같이 사선 방향 에지가 자주 발생하는 특징을 가지며, 이런 특징을 갖는 영상에 삼각형 형태의 분할 부호화를 적용하면 압축 효율이 증가할 수 있다. 본 논문에서는 스크린 콘텐츠를 위한 VVC 기반 화면내 삼각형 분할 예측 방법을 제안한다. 기존 VVC의 화면간 예측 부호화에서 삼각형 분할 예측을 지원하는 Triangular Prediction Mode 방법과 유사하게, 제안 방법은 화면내 예측 부호화에서 수직과 수평 방향 예측 모드와 주변 복원 참조 라인을 이용하여 두 개의 사각형 예측 블록을 생성하고 삼각형 모양의 마스크로 두 예측 블록을 가중합하여 최종 예측 신호를 만든다. 제안 방법의 실험 결과는 All Intra 스크린 콘텐츠 영상 실험에서 YUV 각각 평균 1.86%, 1.49%, 1.55% 부호화 성능향상을 보이고, 자연 영상 실험 조건에서는 부호화 효율에 미미한 손실을 보였다. 결론적으로, 화면내 예측 부호화 모드에 제안 방법을 적용하여 압축 성능을 향상할 수 있었다.

Keywords

References

  1. A Segall, V Baroncini, J Boyce, J Chen, T Suzuki, "Joint Call for Proposals on Video Compression with Capability beyond HEVC," ITU-T/ISO/IEC JVET, JVET-H1002, Oct. 2017. https://mpeg.chiariglione.org/standards/exploration/future-video-coding/n17195-jointcall-proposals-video-compression-capability
  2. B. Bross, J. Chen, S. Liu, and Y.-K. Wang, "Versatile Video Coding (Draft 8)," ISO/IEC/ITU-T JVET, JVET-Q2001, Jan. 2020. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=9675
  3. J. Chen, Y. Ye, and S. Kim, "Algorithm Description for Versatile Video Coding and Test Model 8 (VTM 8)," ISO/IEC/ITU-T JVET, JVET-Q2002, Jan. 2020. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=9676
  4. High Efficiency Video Coding (HEVC), Rec. ITU-T H.265 and ISO/IEC 23008-2, Jan. 2013. https://www.itu.int/itu-t/recommendations/rec.aspx?rec=12905
  5. Gary J. Sullivan, Jens-Rainer Ohm, Woo-Jin Han, and Thomas Wiegand, "Overview of the High Efficiency Video Coding (HEVC) Standard," IEEE Trans. Circuits Syst. Video Technol., Vol. 22, No. 12, pp. 1649-1668, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  6. F. Bossen, X. Li, and K. Suhring, "JVET AHG Report: Test Model Software Development (AHG3)," ISO/IEC/ITU-T JVET, JVETQ0003, Jan. 2020. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=9363
  7. B. Bross, "Versatile Video Coding (VVC) on the Final Stretch," ITU workshop on the future of media, Geneva, Switzerland, Oct. 2019. https://www.itu.int/en/ITU-T/Workshops-and-Seminars/20191008/Pages/programme.aspx
  8. Jong-Seok Lee, Jun-Taek Park, Han-Sol Choe, Ju-Hyeong Byeon, and Dong-Gyu Sim, "Overview of VVC," Broadcasting and Media Magazine, Vol. 24, No. 3, pp.10-25, Oct. 2019.
  9. Heeji Han, Jaeryun Choe, Daehyeok Gwon, and Haechul Choi, "VVC Intra Prediction and Coding Tools," Broadcasting and Media Magazine, Vol. 24, No. 3, pp.39-54, , Oct. 2019.
  10. Liang Zhao, Xin Zhao, Shan Liu and Xiang Li, "CE3-related: Unification of angular intra prediction for square and non-square blocks," ITU-T/ISO/IEC JVET, JVET-L0279, Oct. 2018. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=4374
  11. D. Park, Y. Yoon, J.-G. Kim, J. Lee, and J. Kang, "CE10-related: Simplification of Triangular Partitions," ISO/IEC/ITU-T JVET, JVET-M0352, Jan. 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=5159
  12. F. Chen and Li Wang, "CE10-related: Simplified Triangle Prediction Unit Mode," ISO/IEC/ITU-T JVET, JVET-M0328, Jan. 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=5135
  13. X. Wang, Y.-W. Chen, X. Xiu, and T.-C. Ma, "CE4-related: An Improved Method for Triangle Merge List Construction," ISO/IEC/ITU-T JVET, JVET-N0340, March. 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=6061
  14. Jungwon Kang and Hahyun Lee, "VVC Inter Prediction Coding Technologies," Broadcasting and Media Magazine, Vol. 24, No. 3, pp.55-70, , Oct. 2019.
  15. Ru-Ling Liao and Chong Soon Lim, "CE10.3.1.b: Triangular prediction unit mode," ITU-T/ISO/IEC JVET, JVET-L0124, Oct. 2018. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=4205
  16. B. Bross, P. Keydel, H. Schwarz, D. Marpe, T. Wiegand, L. Zhao, X. Zhao, X. Li, S. Liu, Y.-J. Chang, H.-Y. Jiang, P.-H. Lin, C.-C. Kuo, C.-C. Lin, and C.-L. Lin, "CE3: Multiple Reference Line Intra Prediction (Test 1.1.1, 1.1.2, 1.1.3 and 1.1.4)," ISO/IEC/ITU-T JVET, JVET-L0283, Oct. 2018. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=4379
  17. J. Chen, Y. Ye, and S. H. Kim "Algorithm Description for Versatile Video Coding and Test Model 6 (VTM 6)," ISO/IEC/ITU-T JVET, JVET-O2002, July 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=7826
  18. F. Bossen, J. Boyce, X. Li, V. Seregin, and K. Sharing, "JVET Common Test Conditions and Software Reference Configurations for SDR Video," ISO/IEC/ITU-T JVET, JVET-N1010, Mar. 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=6643
  19. G. Bjontegaard, "Calculation of Average PSNR Differences Between RD Curves," ITU-T SG16 Q.6 VCEG, VCEG-M33, Apr. 2001. http://wftp3.itu.int/av-arch/video-site/0104_Aus/VCEG-M33.doc
  20. W.-J. Chien, V. Seregin, and M. Karczewicz, "CE8-related: CPR Mode Signaling and Interaction with Inter Coding Tools," ISO/IEC/ITU-T JVET, JVET-M0483, Jan. 2019. http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.php?id=5293