Journal of the Institute of Electronics and Information Engineers (전자공학회논문지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Coding Unit-level Multi-loop Encoding Method based on JND for Perceptual Coding

JND 모델을 사용한 코딩 유닛 레벨 멀티-루프 인코딩 기반의 비디오 압축 방법

  • Lim, Woong (Department of Computer Engineering, Kwangwoon University) ;
  • Sim, Donggyu (Department of Computer Engineering, Kwangwoon University)
  • 임웅 (광운대학교 컴퓨터공학과) ;
  • 심동규 (광운대학교 컴퓨터공학과)
  • Received : 2015.03.31
  • Accepted : 2015.04.22
  • Published : 2015.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we employed a model which defines the sensitivity according to the background luminance, so called JND (Just Noticeable Difference), and applied to the video coding. The proposed method finds out the maximum possible quantization parameter for the current unit based on the threshold of JND model and reduce the bitrate with similar perceptual quality. It selects the higher quantization parameter and reduce the bitrate when the reconstructed signal which is coded with higher quantization parameter is in a range of allowance based on the JND threshold, i.e. the signal has the similar perceptual quality compared to that is coded with the initial quantization parameter. The proposed algorithm was implemented on HM16.0, which is a reference software of the latest video coding standard HEVC (High Efficiency Video Coding) and the coding performance was evaluated. Compared to HM16.0, the proposed algorithm achieved maximum 20.21% and 6.18% of average bitrate reduction with the similar perceptual quality.

본 논문에서는 주변의 밝기에 대한 HVS의 민감도를 모델링한 JND (Just Noticeable Difference)를 비디오 코딩에 적용함으로써, JND 모델에 따른 임계치를 기준으로 현재 코딩 유닛에 적용 가능한 최대 양자화 파라미터를 결정하여 유사한 주관적 화질에서 비트율을 절감시키는 방법을 제안한다. 제안하는 방법은 입력된 현재 코딩 유닛에 대하여 기준이 되는 양자화 파라미터가 적용된 복원 신호 대비 더 높은 양자화 파라미터를 적용한 복원 신호가 JND 관점에서 유사하게 인지되는 경우에 더 높은 양자화 파라미터를 선택함으로써 비트율을 절감시킨다. 제안하는 알고리즘의 성능 검증을 위하여 최신 비디오 압축 표준인 HEVC (High Efficiency Video Coding)의 참조 소프트웨어인 HM16.0에 본 알고리즘을 적용하였으며, HM16.0을 통해 압축된 영상 대비 유사한 화질에서 최대 20.21%, 평균적으로 약 6.18%의 비트율 절감을 달성하였다.

Keywords

References

  1. B. Bross, W.-J. Han, J.-R. Ohm, G. Sullivan, Y.-K. Wang, and T. Wiegand, "High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Last Call," ITU-T SG16 WP3 & ISO/IEC JTC1/SC29/WG11 JCTVC-L1003, January 2013.
  2. A. Tamhankar and K.-R. Rao, "An Overview of H.264/MPEG-4 part 10," 4th EURASIP Conference on Video/Image Processing and Multimedia Communications, vol. 1, pp. 1-51, June 2003.
  3. G. J. Sullivan, J. R. Ohm, W. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, pp. 1649-1668, December 2012. https://doi.org/10.1109/TCSVT.2012.2221191
  4. C. Chou and Y. Li, "A Perceptually Tuned Subband Image Coder Based on the Measure of Just-Noticeable-Distortion Profile," IEEE Transactions on Circuits and Systems for Video Tech., vol. 5, no. 6, pp. 467-476, December 1995. https://doi.org/10.1109/76.475889
  5. Y. Ahn and D. Sim, "Square-type-first inter-CU tree search algorithm for acceleration of HEVC encoder," Journal of Real-Time Image Processing, February 2015.
  6. 유성은, 안용조, 심동규 "CU 깊이 우선 결정 기반의 HEVC 고속 부호화 방법," 전자공학회지, 제49권, 제3호, 40 - 50쪽, 2012년 5월.
  7. 김영조, 김재석 "쿼드트리 구조와 SATD를 이용한 HEVC 인코더의 고속 인트라 예측 방식," 전자공학회지, 제51권, 제3호, 129-138쪽, 2014년 3월.
  8. 김재일, 안상수, 김대은, 김문철, "HEVC 기술 소개 -Part I: 기본 구성 요소," 전자공학회지, 제41권, 제10호, 18-30쪽, 2014년 10월.
  9. 안용조, 황태진, 유성은, 한우진, 심동규 "HEVC 부호화기 소프트웨어의 통계적 특성 및 복잡도 분석," 방송공학회논문지, 제17권 제6호, 1091-1105쪽, 2012년 11월. https://doi.org/10.5909/JBE.2012.17.6.1091
  10. T. Hwang, Y. Ahn, J. Ryu and D. Sim, "Optimized Implementation of Interpolation Filters for HEVC Encoder," Journal of The Institute of Electronics Engineers of Korea vol. 50, no. 10, October 2013.
  11. H. Ryu, Y. Ahn, J. Mok and D. Sim "Performance Analysis of HEVC Parallelization Methods for High-Resolution Videos," IEIE Transactions on Smart Processing and Computing, vol. 4, no. 1, February 2015.
  12. G. J. Sullivan and R. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Processing Magazine, vol. 15, no. 6, pp.74-90, November 1998. https://doi.org/10.1109/79.733497
  13. K. Minoo and T. Nguyen, "Perceptual Video Coding with H.264," Signals, Systems and Computers, 2005. Conference Record of the Thirty-Ninth Asilomar Conference on, pp. 741-745, Pacific Grove, CA, October 2005.
  14. J. Kim, S. Bae and M. Kim, "An HEVC-Compliant Perceptual Video Coding Scheme based on JND Models for Variable Block-sized Transform Kernels," IEEE Transactions on Circuits and Systems for Video Tech., vol. pp, no. 99, pp. 1, 2015.
  15. G. Jin, R. Cohen, A. Vetro and H. Sun, "Joint perceptually-based Intra prediction and quantization for HEVC," Signal & Information Processing Association Annual Summit and Conference, pp. 1-10, Hollywood, CA, 2012.
  16. W. Lim, H. Jo and D. Sim, "Perceptual Coding based on JND model for High Efficiency Video Coding," in international conference on 3 Dimensional Systems and Applications, Seoul, Korea, 2014.
  17. C. Lee, P. Lin, L. Chen, and W. Wang, "Image enhancement approach using the just-noticeable difference model of the human visual system," J. Electron. Imaging., vol. 21, July 2012.
  18. F. Bossen, "Common test conditions and software reference configurations," The 8th JCT-VC meeting, JCT-VC H1100, San Jose, CA, Jan. 2012.