Journal of the Institute of Electronics and Information Engineers (전자공학회논문지)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Keypoint-based Fast CU Depth Decision for HEVC Intra Coding

HEVC 인트라 부호화를 위한 특징점 기반의 고속 CU Depth 결정

  • Kim, Namuk (School of Electronic and Electrical Engineering, Sungkyunkwan University) ;
  • Lim, Sung-Chang (Electronics and Telecommunications Research Institute) ;
  • Ko, Hyunsuk (Electronics and Telecommunications Research Institute) ;
  • Jeon, Byeungwoo (School of Electronic and Electrical Engineering, Sungkyunkwan University)
  • 김남욱 (성균관대학교 전자전기공학부) ;
  • 임성창 (한국전자통신연구원) ;
  • 고현석 (한국전자통신연구원) ;
  • 전병우 (성균관대학교 전자전기공학부)
  • Received : 2015.12.05
  • Accepted : 2016.01.31
  • Published : 2016.02.25
Download PDF
⟨ Previous Next ⟩

Abstract

The High Efficiency Video Coding (MPEG-H HEVC/ITU-T H.265) is the newest video coding standard which has the quadtree-structured coding unit (CU). The quadtree-structure splits a CU adaptively, and its optimum CU depth can be determined by rate-distortion optimization. Such HEVC encoding requires very high computational complexity for CU depth decision. Motivated that the blob detection, which is a well-known algorithm in computer vision, detects keypoints in pictures and decision of CU depth needs to consider high frequency energy distribution, in this paper, we propose to utilize these keypoints for fast CU depth decision. Experimental results show that 20% encoding time can be saved with only slightly increasing BDBR by 0.45% on all intra case.

MPEG-H HEVC/ITU-T H.265는 quadtree 구조의 CU (Coding Unit)를 갖는 최신의 비디오 부호화 표준 기술이다. HEVC 부호화기는 모든 가능한 CU 구조에 대해서 Rate-distortion 최적화 과정을 통하여 최적 부호화 성능의 CU depth를 구할 수 있지만, 그 과정에 매우 많은 계산량을 필요로 한다. 본 연구에서는 컴퓨터 비젼 분야에서 잘 알려진 blob detection을 통하여 특징점을 찾는 과정이 저역 필터를 거치는 것과 같은 효과를 가진다는 것과 CU depth의 결정에는 영상의 고주파수 에너지 분포를 고려하는 것이 중요하다는 사실에 착안하여, blob detection 방법을 사용하여 추출된 특징점을 사용하여 HEVC 부호화기의 인트라 예측의 계산 복잡도를 낮추고자 한다. 실험을 통하여 all intra의 경우 0.45%의 BDBR 저하만으로 20% 정도의 부호화 시간을 절감할 수 있음을 보인다.

Keywords

References

  1. G. J. Sullivan and J. R. Ohm, "Recent development in standardization of high efficiency video coding (HEVC)," Proc. SPIE, vol. 7798, p.77980V, Sep. 2010.
  2. G. J. Sullivan and R. L. Baker, "Efficient quadtree coding of images and video," Proc. ICASSP, vol. 4, pp. 2661-2664, May 1991.
  3. T. Lindeberg, "Scale selection properties of generalized scalespace interest point detectors," Journal of Mathematical Imaging and Vision, vol. 4, Sept. 2012.
  4. D. G. Lowe. "Distinctive image features from scale-invariant keypoints," IJCV, 60(2):91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  5. L. Zhao, L. Zhang, S. Ma, D. Zhao, "Fast Mode Decision Algorithm for Intra Prediction in HEVC," IEEE Visual Communications and Image Processing (VCIP), pp. 1-4, Nov. 2011.
  6. J. Lee and S. Lee, "Early CU size determination for HEVC," Proc. Conference of the Institute of Electronics Engineers of Korea, pp. 476-477, 2012.
  7. S. E. Yoo, Y. J. Ahn, and D. G. Sim, "Fast HEVC Encoding based on CU-Depth First Decision," Journal of the Institute of Electronics Engineers of Korea, vol. 49, no. 3, pp. 40-50, 2012.
  8. Q. Yu, Y. Rong, and Y. He, "Fast intra mode decision strategy for HEVC," Proc. IEEE China Summit Int. Conf. Signal Info. Process., Jul. pp. 500-504, 2013.
  9. Y. Shi et al., "Local saliency detection based fast mode decision for HEVC intra coding," Proc. IEEE 15th Int. Workshop Multimedia Signal Process. (MMSP), pp. 429-433, Oct. 2013.
  10. J. Kim, J. Y. Yang, H. Y. Lee, and B. Jeon, "Fast Intra Mode Decision of HEVC based on Hierarchical Structure," 8th International Conference on Information, Communication and Signal Processing, pp. 1-4, Dec. 2011.
  11. W. Jiang, H. J. Ma, and Y. W. Chen, "Gradient Based Fast Mode Decision Algorithm for Intra Prediction in HEVC," Proc. 2nd International Conference on Consumer Electronics, Communi cations and Networks, pp. 1836-1840, Apr. 2012.
  12. Y. Zhang, Z. Li, and B. Li, "Gradient-based fast decision for intra prediction in HEVC," Proc. IEEE Vis. Commun. Image Process. (VCIP), pp. 1-6, Nov. 2012.
  13. G. Chen, Z. Liu, T. Ikenaga, and D. Wang, "Fast HEVC intra mode decision using matching edge detector and kernel density estimation alike histogram generation," Proc. IEEE ISCAS, pp. 53 -56, May 2013.
  14. S. Chao and M. Kim, "Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 9, pp. 1555-1563, Sep. 2013. https://doi.org/10.1109/TCSVT.2013.2249017
  15. D. H. Gwon and H. Choi, "Edge and Relative RMD Cost based Fast Intra Prediction Mode Decision in HEVC," Journal of the Institute of Electronics Engineers of Korea, pp. 154-163, 2014.
  16. Hoyoung Lee, Huik Jae Shim, Younghyun Park, and Byeungwoo Jeon, "Early Skip Mode Decision for Fast HEVC Encoder," IEEE Trans. Broadcasting, vol. 61, No.3, pp.388-397, Sept. 2015. https://doi.org/10.1109/TBC.2015.2419172
  17. Kwanghyun Won and Byeungwoo Jeon, "Complexity-Efficient Rate Estimation for Mode Decision of HEVC encoder," IEEE Trans. Broadcasting, vol.61, No.3, pp.425-435, Sept. 2015. https://doi.org/10.1109/TBC.2015.2432451
  18. Hoyoung Lee, Seungha Yang, Younghyun Park, and Byeungwoo Jeon, "Fast Quantization Method with Simplified Rate-Distortion Optimized Quantization for HEVC Encoder," IEEE.Trans. Circ. and Syst. for Video Technology (Sepcial issue on HEVC Implementation), VOL. 26, No.1, pp.107-116, Jan. 2016. https://doi.org/10.1109/TCSVT.2015.2450151
  19. http://citeseerx.ist.psu.edu/viewdoc/download?rep=rep1&type=pdf&doi=10.1.1.217.4931
  20. C. Harris and M. Stephens, "A Combined Corner and EdgeDetector," Proc. Alvey Vision Conf., pp. 147-151, 1988.
  21. R. O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification. pp 20-26, JohnWiley & Sons, 2001.
  22. G. Bjontegaard, "Calculation of average PSNR difference between RD-curves," Proc. 13th VCEG-M33 Meeting, Austin, TX, USA, Apr. 2001.