DOI QR코드

DOI QR Code

Wrap-around Motion Vector Prediction for 360 Video Streams in Versatile Video Coding

VVC에서 360 비디오를 위한 랩-어라운드 움직임 벡터 예측 방법

  • Lee, Minhun (Dept. of Electronic Engineering, Kwangwoon University) ;
  • Lee, Jongseok (Dept. of Computer Engineering, Kwangwoon University) ;
  • Park, Juntaek (Dept. of Computer Engineering, Kwangwoon University) ;
  • Lim, Woong (Electronics and Telecommunications Research Institute) ;
  • Bang, Gun (Electronics and Telecommunications Research Institute) ;
  • Sim, Dong Gyu (Dept. of Computer Engineering, Kwangwoon University) ;
  • Oh, Seoung-Jun (Dept. of Electronic Engineering, Kwangwoon University)
  • Received : 2020.03.23
  • Accepted : 2020.05.07
  • Published : 2020.05.30

Abstract

In this paper, we propose a motion vector prediction method that increases the coding efficiency at the boundary of an image by utilizing the 360 video characteristic. In the current VVC method, the location of a neighbor block is excluded from the candidate list for inter prediction in case that it is out of boundary. This can reduce coding efficiency as well as subject quality. To solve this problem, we construct new candidates adding the location of the neighbor block at the boundary of the picture from already decoded information based on the projection method for 360 video coding. To evaluate the performance of the proposed method, we compare with VTM6.0 and 360Lib9.1 under Random Access condition of JVET-360 CTC. As a result, the coding performance shows a BD-rate reduction of 0.02% on average in luma component and 0.05%, 0.06% on average in chroma components respectively, without additional computational complexity. The coding performance at the picture boundary shows a BD-rate reduction of 0.29% on average in luma component and 0.45%, 0.43% on average in chroma components, respectively. Furthermore, we perform subjective quality test with the DSCQS method and obtain MOS values. The MOS value is improved by 0.03 value, and we calculate BD-MOS using MOS value and bit-rate. As a result, the proposed method improved performance by up to 8.78% and 5.18% on average.

본 논문에서는 360 비디오의 특성을 이용하여 픽쳐 경계에서 코딩 효율을 증가시키는 움직임 벡터 예측 방법을 제안한다. VVC의 화면간 예측에서 움직임 벡터 후보군을 구성할 때 주변 블록의 위치가 픽쳐의 경계 바깥이면 후보군 구성 과정에서 제외되어 픽쳐 경계에서 코딩 효율이 감소하게 된다. 이를 해결하기 위해 360 비디오의 부/복호화를 위한 투영 방법의 특성을 이용하여 이미 복호화된 정보로부터 픽쳐의 경계에서 추가로 후보군을 구성하는 방법을 제안한다. 제안하는 방법의 성능 평가를 위하여 JVET-360 CTC의 임의 접근 환경에서 VTM6.0 및 360Lib9.1와 비교한다. 그 결과로써 제안하는 방법은 추가 계산 복잡도 없이 휘도 성분에서 평균 0.02%, 색차 성분에서 각각 평균 0.05%, 0.06%의 비트율 감소를 보이고, 픽쳐의 경계에서는 비트율이 휘도 성분에서 평균 0.29%, 색차 성분에서 각각 평균 0.45%, 0.43% 감소하였다. 그리고 DSCQS (Double Stimulus Continuous Quality-Scale) 방법을 통해 제안하는 방법의 주관적 화질 평가를 수행하여 MOS (Mean Opinion Score)값을 얻는다. MOS값은 평균 0.03 향상되었고, MOS값과 비트량을 이용하여 BD-MOS를 구한다. 그 결과, 제안하는 방법의 성능이 최대 8.78%, 평균 5.18% 향상하였다.

Keywords

References

  1. C. Kim, "A Comparative Study for Virtual Reality $360^{\circ}$ Contents Shooting Equipments Based on Real World", Journal of Broadcast Engineering, Vol.21, No. 5, pp.714-725, Sep. 2016. https://doi.org/10.5909/JBE.2016.21.5.714
  2. J. Lee, J. Park, H. Choi, J. Byeon, and D. Sim, "Overview of VVC", Broadcasting and Media Magazine, Vol.24, No.4, pp.10-25, Oct. 2019.
  3. F. Bossen, X. Li, and K. Suehring, JVET-P0003, "AHG report: Test model software development (AHG3)", Oct. 2019.
  4. VTM, https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM
  5. Y. Sun, A. Lu, and L. Yu, JVET-D0040, "AHG8: WS-PSNR for 360 video objective quality evaluation", Oct. 2016.
  6. M. Yu, H. Lakshman, and B. Girod, "A framework to evaluate omnidirectional video coding schemes", in 2015 IEEE International Symposium on Mixed and Augmented Reality, pp. 31-36, Oct. 2015.
  7. V. Zakharchenko, K. P. Choi, E. Alshina, and J. H. Park, "Omnidirectional video quality metrics and evaluation process", in 2017 Data Compression Conference, pp. 472-472, Apr. 2017.
  8. 360Lib, https://jvet.hhi.fraunhofer.de/svn/svn_360Lib/
  9. S. Yoon and G. Park, "Improve Compression Efficiency of 360degree VR Video by Correcting Perspective in Cubemap Projection", Journal of Broadcast Engineering, Vol.22, No.1, pp.136-139, May. 2017. https://doi.org/10.5909/JBE.2017.22.1.136
  10. Y. Yoon, Y. Ahn, D. Sim, and J. Kim, "Efficient methods of inactive regions padding for segmented sphere projection (SSP) of 360 video", IEICE TRANSACTIONS on Information and Systems, Vol.101, No.11, pp.2836-2839, Nov. 2018.
  11. B. Bross, J. Chen, and S. Liu, JVET-O2001, "Versatile Video Coding (Draft 6)", Jul. 2019.
  12. P. Hanhart, J. Boyce, K. Choi, and J.-L. Lin, JVET-L1012, "JVET common test conditions and evaluation procedures for $360^{\circ}$ video", Oct. 2018.
  13. G. Bjontegaard, VCEG-M33, "Calculation of average PSNR differences between RD-curves", Apr. 2014.
  14. ITU-R BT.500-13, "Methodology for the subjective assessment of the quality of television pictures", Jan. 2012.
  15. P. Hanhart, M. Rerabek, F. De Simone, and T. Ebrahimi, "Subjective quality evaluation of the upcoming HEVC video compression standard", Applications of digital image processing XXXV, Vol.8499, pp.1 -13, Aug. 2012.
  16. YUView, https://https://github.com/IENT/YUView