Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

S-JND based Perceptual Rate Control Algorithm of HEVC

S-JND 기반의 HEVC 주관적 율 제어 알고리즘

  • Kim, JaeRyun (Dept. of Computer Engineering, Kwangwoon University) ;
  • Sim, Donggyu (Dept. of Computer Engineering, Kwangwoon University)
  • 김재련 (광운대학교 컴퓨터공학과) ;
  • 심동규 (광운대학교 컴퓨터공학과)
  • Received : 2017.01.20
  • Accepted : 2017.04.13
  • Published : 2017.05.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, the perceptual rate control algorithm is studied for HEVC (High Efficiency Video Coding) encoder with bit allocation based on perceived visual quality. This paper proposes perceptual rate control algorithm which could consider perceived quality for HEVC encoding method. The proposed rate control algorithm employs adaptive bit allocation for frame and CTU level using the perceived visual importance of each CTU. For performance evaluation of the proposed algorithm, the proposed algorithm was implemented on HM 16.9 and tested for sequences in Class B under the CTC (Common Test Condition) RA (Random Access) case. Experimental results show that the proposed method reduces the bitrate of 3.12%, and improves BD-PSNR of 0.08dB and bitrate accuracy of 0.07% on average. And also, we achieved MOS improvement of 0.16 with the proposed method, compared with the conventional method based on DSCQS (Double Stimulus Continuous Quality Scale).

본 논문에서는 주관적 화질 기반의 비트 분배를 수행하는 율 제어 알고리즘을 수행하는 HEVC (High Efficiency Video Coding) 부호화 방법을 위한 연구를 진행하였다. 본 논문은 이러한 단점을 해소하고자 율 왜곡 최적화 시의 화질 측정에서 주관적 화질을 고려할 수 있는 율 제어 알고리즘을 통한 HEVC 부호화 방법을 제안한다. 제안하는 방법은 영상을 하나의 CTU 마다 인지 시각적 중요도를 측정하여, 이를 이용하여 픽쳐 단위, CTU 단위에의 비트 분배 시 적응적인 분배를 수행한다. 본 논문에서 제안하는 방법은 HEVC 참조 소프트웨어 16.9 버전 대비 CTC (Common Test Condition) Class B 영상에서 평균적으로 BD-rate 3.12%의 성능향상과 BD-PSNR의 0.08dB 향상 및 목표 비트율에의 비트 정확도 0.07% 증가를 보였다. 또한 주관적 화질 측정 결과도 기존 HEVC의 참조 소프트웨어에 적용된 율 제어 알고리즘 대비 DSCQS 스케일에서 평균 0.16 향상된 것을 확인하였다.

Keywords

References

  1. Cisco, Cisco visual networking index: Global mobile data traffic forecast update, 2015-2020 Cisco White Paper, Feb. 2016.
  2. T. Wiegand, G. J. Sullivan, G. Bjontegaard and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560-576, Jul. 2003. https://doi.org/10.1109/TCSVT.2003.815165
  3. B. Bross, W. J. Han, G. J. Sullivan, J. R. Ohm and T. Wiegand, "High Efficiency Video Coding (HEVC) text specification draft 10 for FDIS & last call," Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-L1003_v34, Geneva, CH, Jan. 2013.
  4. J. R. Ohm, G. J. Sullivan, H. Schwarz, T. K. Tan and T. Wiegand, "Comparison of the coding efficiency of video coding standards-including High Efficiency Video Coding (HEVC)," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1668-1683, Dec. 2012.
  5. I. K. Kim, J. Min, T. Lee, W. J. Han and J. Park, "Block partitioning structure in the HEVC standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1697-1706, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2223011
  6. J. Lainema, F. Bossen, W. J. Han, J. Min and K. Ugur, "Intra coding of the HEVC standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1792-1801, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2221525
  7. G. Sullivan, J. Ohm, W. Han and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  8. A. Norkin, G. Bjontegaard, A. Fuldseth, M. Narroschke, M. Ikeda, K. Andersson, M. Zhou and G. Auwera, "HEVC deblocking filter," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1746-1754, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2223053
  9. Y. J. Ahn, S. J. Park and D. G. Sim, "Implementation and commercialization techniques of HEVC codec," The Magazine of the Institute of Electronics and Information Engineers, vol. 41, no. 19, pp. 939-947, Oct. 2014.
  10. http://hevc.kw.bbc.co.uk/trac/browser/tags/HM-16.9, HM 16.9 S/W.
  11. D. G. Sim and H. H. Jo, Understanding of HEVC standard and technology, HongRung Publishing Company, Korea, 2015.
  12. Q. Lin and G. Feng, "The bit allocation and RDO mode based rate control algorithm," 2010 International Conference on Anti-Counterfeiting Security and Identification in Communication (ASID), Chengdu, China, pp. 154-157, Jul. 2010.
  13. C. Chou and Y. Li, "A perceptually tuned subband image coder based on the measure of Just-Noticeable-Distortion profile," IEEE transactions on Circuits and Systems for Video Technology, vol. 5, no. 6, pp. 467-476, Dec. 1995. https://doi.org/10.1109/76.475889
  14. Z. Wei and K. N. Ngan, "Spatio-temporal Just Noticeable Distortion profile for grey scale image/video in DCT domain," IEEE transactions on Circuits and Systems for Video Technology, vol. 19, no. 3, pp. 337-346, Mar. 2009. https://doi.org/10.1109/TCSVT.2009.2013518
  15. W. Lim and D. G. Sim, "Coding unit-level multi-loop encoding method based on JND for perceptual coding," Journal of the Institute of Electronics and Information Engineers, vol. 52, no. 5, pp. 147-154, May 2015. https://doi.org/10.5573/ieie.2015.52.5.147
  16. J. Kim, Y. J. Ahn, W. Lim and D. G. Sim, "A perceptual rate control algorithm with S-JND model for HEVC encoder," Journal of Broadcast Engineering, vol. 21, no. 6, pp. 929-943, Nov. 2016. https://doi.org/10.5909/JBE.2016.21.6.929
  17. S. Goferman, L. Zelnik-Manor, A. Tal, "Context-aware saliency detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 10, pp. 1915-1926, Oct. 2012. https://doi.org/10.1109/TPAMI.2011.272
  18. W. Lim, J. Nam and D. Sim, "Scalable multi-view video coding based on HEVC," IEIE transactions on Smart Processing and Computing, vol. 4, no. 6, pp. 434-442, Dec. 2015. https://doi.org/10.5573/IEIESPC.2015.4.6.434
  19. Recommendation ITU-R BT.500-11, "Methodology for the subjective assessment of the quality of television pictures," Recommendation ITU-R BT.500-11, ITU-Telecommunication Standardization Sector, no. 22, pp. 25-34, Jan. 2002.
  20. H. Choi, J. Nam, J. Yoo, D. Sim and I. V. Bajic, "Rate control based on unified RQ model for HEVC," Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-H0213, San Jose, CA, Jan. 2012.
  21. H. Choi, J. Yoo, J. Nam, D. Sim and I. V. Bajic, "Pixel-wise Unified Rate-Quantization model for multi-level rate control," IEEE Journal of Selected Topics in Signal Processing, vol. 7, no. 6, pp. 1112-1123, Dec. 2013. https://doi.org/10.1109/JSTSP.2013.2272241
  22. B. Li, H. Li, L. Li and J. Zhang, "Rate control by R-lambda model for HEVC," Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-K0103, Shanghai, China, Oct. 2012.
  23. V. Sze, M. Budagavi and G. J. Sullivan, High Efficiency Video Coding (HEVC): algorithms and architectures, Springer International Publishing, Sep. 2014.
  24. Mathias Wien, High Efficiency Video Coding (HEVC): coding tools and specification, Springer International Publishing, Sep. 2014.
  25. F. Bossen, "Common test conditions and software reference configurations," Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-L1100, Geneva, CH, Jan. 2013.
  26. G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," ITU-Telecommunications Standardization Sector, VCEG-M33, pp. 290-294, Austin, TX, Apr. 2001.