Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Adaptive Reference Structure Decision Method for HEVC Encoder

HEVC 부호화기의 적응적 참조 구조 변경 방법

  • Mok, Jung-Soo (Dept. of Computer Engineering, Kwangwoon University) ;
  • Kim, JaeRyun (Dept. of Computer Engineering, Kwangwoon University) ;
  • Ahn, Yong-Jo (Dept. of Computer Engineering, Kwangwoon University) ;
  • Sim, Donggyu (Dept. of Computer Engineering, Kwangwoon University)
  • 목정수 (광운대학교 컴퓨터공학과) ;
  • 김재련 (광운대학교 컴퓨터공학과) ;
  • 안용조 (광운대학교 컴퓨터공학과) ;
  • 심동규 (광운대학교 컴퓨터공학과)
  • Received : 2016.06.03
  • Accepted : 2017.01.16
  • Published : 2017.01.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes adaptive reference structure decision method to improve the performance of HEVC (High Efficiency Video Coding) encoder. When an event occurs in the input sequence, such as scene change, scene rotation, fade in/out, or light on/off, the proposed algorithm changes the reference structure to improve the inter prediction performance. The proposed algorithm divides GOP (Group Of Pictures) into two sub-groups based on the picture that has such event and decides the reference pictures in the divided sub-groups. Also, this paper proposes fast encoding method which changes the picture type of first encoded picture in the GOP that has such event to CRA (Clean Random Access). With the statistical feature that intra prediction is selected by high probability for the first encoded picture in the GOP carrying such event, the proposed fast encoding method does not operate inter prediction. The experimental result shows that the proposed adaptive reference structure decision method improves the BD-rate 0.3% and reduces encoding time 4.9% on average under the CTC (Common Test Condition) for standardization. In addition, the proposed reference structure decision method with the picture type change reduces the average encoding time 12.2% with 0.11% BD-rate loss.

본 논문에서는 HEVC (High Efficiency Video Coding) 부호화기의 성능 향상을 위한 적응적 참조 구조 변경 방법을 제안한다. 제안하는 방법은 입력 영상 내에 장면 전환, 장면 회전, Light on/off, Fade in/out 등의 이벤트 발생 시 저하되는 화면 간 예측의 성능을 향상시키기 위해 참조 픽쳐 리스트를 수정하여 참조 구조를 변경한다. GOP (Group Of Pictures) 단위로 한정된 계층적 참조 구조에서 영상 이벤트가 발생한 픽쳐를 기준으로 두 개의 서브 그룹으로 분할하고 각각의 서브 그룹 내에서 참조 픽쳐를 결정한다. 이를 통해, 시간적 중복성이 높은 참조 픽쳐를 화면 간 예측에서 사용하여 부호화 효율을 향상시킨다. 또한, HEVC의 계층적 부호화 구조 특징을 이용하여 이벤트 발생 후 처음으로 부호화되는 픽쳐를 CRA (Clean Random Access) 픽쳐로 변경하여 부호화 속도를 향상시키는 방법을 제안한다. 제안하는 방법은 이벤트 발생 후 처음으로 부호화되는 프레임은 화면 내 예측이 매우 높은 확률로 선택된다는 통계적 특징을 기반으로 화면 간 예측을 수행하지 않는다. 실험 결과 본 논문에서 제안하는 적응적 참조 구조 변경 방법은 HM 16.0 대비 CTC (Common Test Condition)에서 평균 0.3%의 BD-rate를 개선하였으며 부호화 속도는 평균 4.9% 향상시켰다. 또한, 이벤트 발생에 따른 픽쳐 타입 변경 방법은 평균 0.11%의 BD-rate 저하가 있었지만 부호화 속도를 평균 12.2% 향상시킬 수 있었다.

Keywords

References

  1. T. Wiegand, J. Ohm, G. Sullivan, W. Han, R. Joshi, T. Tan, and K. Ugur, "Special section on the joint call for proposals on high efficiency video coding (HEVC) standardization," IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, no. 12, pp. 1661-1666, Dec. 2010. https://doi.org/10.1109/TCSVT.2010.2095692
  2. High Efficiency Video Coding, Rec. ITU-T H.265 and ISO/IEC 23008-2, Jan. 2013.
  3. Y. J. Ahn, W. J. Han, and D. G. Sim, "Study of decoder complexity for HEVC and AVC standards based on tool-by-tool comparison," SPIE Applications of Digital Image Processing XXXV, Proceedings of SPIE Volume 8499, Paper number 8499-32, San Diego, USA, August, 2012.
  4. Y. J. Ahn, T. J. Hwang, S. E. Yoo, W. -J. Han, and D. G. Sim, "Statistical characteristics and complexity analysis of HEVC encoder software," Journal of Broadcasting & Electronic Media, vol. 17, no. 6, pp. 1091-1105, Nov. 2012.
  5. I.-K. Kim, J. Min, T. Lee, W.-J. Han, and J. Park, "Block partitioning structure in the HEVC standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1697-1706, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2223011
  6. G. Sullivan, J. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, Dec. 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  7. Li, Houqiang, Bin Li, and Jizheng Xu. "Rate-distortion optimized reference picture management for high efficiency video coding," IEEE transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp.1844-1857. Oct. 2012. https://doi.org/10.1109/TCSVT.2012.2223038
  8. A. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm," IEEE transactions on Information Theory, vol. 13, no.2, pp. 260-269, Apr. 1967. https://doi.org/10.1109/TIT.1967.1054010
  9. Schwarz, Sebastian, and Marta Mrak. "Improved reference picture list sorting in video coding," Systems, Signals and Image Processing (IWSSIP), 2015 International Conference on IEEE, 2015.
  10. Jiang, Xiaolong, et al. "A flexible reference picture management scheme," Multimedia and Expo Workshops (ICMEW), 2014 IEEE International Conference on IEEE, 2014.
  11. Tianwu, Yang, and Zhou Changjiu. "Rate-distortion optimized reference picture selection," Industrial Electronics and Applications (ICIEA), 2012 7th IEEE Conference on IEEE, 2012.
  12. K. Y. Min, W. Lim, J. H. Nam, D. G. Sim, I. V. Bajic, "Distributed video coding supporting hierarchical GOP structures with transmitted motion vectors," EURASIP Journal on Image and Video Processing, vol. 2015, Dec. 2015.
  13. JCT-VC, HM Reference software, https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.0/
  14. D. G. Sim, H. H. Jo, "Understanding of HEVC standard and technology," Hongrung Publishing Company, Korea, 2015.
  15. Sjoberg, Rickard, et al. "Overview of HEVC high-level syntax and reference picture management," IEEE transactions on Circuits and Systems for Video Technology, vol. 22. no. 12, pp. 1858-1870. Oct. 2012. https://doi.org/10.1109/TCSVT.2012.2223052
  16. F. Bossen, "Common test conditions and software reference configurations," JCTVC-L1100, 12th JCT-VC meeting, Geneva, CH, Jan. 2013.
  17. Xiang Li, et al. "Block Level Difference based Scene Change Detection Method," 2015 Korea Signal Processing Conference, Nov. 2015.
  18. G. Bjontegaard, "Calculation of average PSNR differences between RD-curves," ITU-Telecommunications Standardization Sector, VCEG-M33, pp. 290-294, Austin, TX, April 2001.