Selective B Slice Skip Decoding for Complexity Scalable H.264/AVC Video Decoder

H.264/AVC 복호화기의 복잡도 감소를 위한 선택적 B 슬라이스 복호화 스킵 방법

  • Lee, Ho-Young (School of Information and Communication Engineering, Sungkyunkwan University) ;
  • Kim, Jae-Hwan (School of Information and Communication Engineering, Sungkyunkwan University) ;
  • Jeon, Byeung-Woo (School of Information and Communication Engineering, Sungkyunkwan University)
  • 이호영 (성균관대학교 정보통신공학부) ;
  • 김재환 (성균관대학교 정보통신공학부) ;
  • 전병우 (성균관대학교 정보통신공학부)
  • Received : 2011.02.07
  • Accepted : 2011.03.03
  • Published : 2011.05.25

Abstract

Recent development of embedded processors makes it possible to play back video contents in real-time on portable devices. Because of their limited battery capacity and low computational performance, however, portable devices still have significant problems in real-time decoding of high quality or high resolution compressed video. Although previous approaches are successful in achieving complexity-scalable decoder by controlling computational complexity of decoding elements, they cause significant objective quality loss coming from mismatch between encoder and decoder. In this paper, we propose a selective B slice skip-decoding method to implement a low complexity video decoder. The proposed method performs selective skip decoding process of B slice which satisfies the proposed conditions. The skipped slices are reconstructed by simple reconstruction method utilizing adjacent reconstructed pictures. Experimental result shows that proposed method not only reduces computational complexity but also maintains subjective visual quality.

임베디드 프로세서의 발달로 인해 휴대 단말을 이용한 동영상의 실시간 재생이 가능하게 되었으나, 휴대 단말의 제한된 배터리와 낮은 프로세서의 연산 능력을 고려할 때 고화질 및 고해상도 동영상의 실시간 복호화 구현에는 아직 어려움이 있다. 이러한 문제점을 해결하기 위하여 기존에 연구되었던 복호화 요소들의 연산 복잡도를 조절하여 비디오 복호화기의 복잡도를 조절하는 방법들을 사용할 수는 있으나 부/복호화기 사이의 연산 과정의 불일치에 의한 에러 전파로 객관적 화질이 크게 떨어 지는 문제점이 발생한다. 본 논문에서는 저 복잡도 비디오 복호화기를 달성하기 위해 B 슬라이스의 선택적인 복호화 스킵 방법을 제안한다. 제안 방법은 B 슬라이스를 복호화 하기에 앞서 특정 조건을 만족하는지 여부를 판단하여 해당 B 슬라이스의 선택적 복호화 스킵을 결정하고, 복호화 스킵일 경우 주변 복호화 된 참조 화면들을 사용하여 해당 B 슬라이스를 매우 간략한 방법으로 복원한다. 실험 결과를 통해 제안 방법은 복호화기의 복잡도를 감소시킬 수 있을 뿐만 아니라 움직임 끊김 현상을 효과적으로 제거함으로써 동영상의 재생 시 주관적 화질이 크게 떨어지지 않음을 확인할 수 있다.

Keywords

References

  1. S. Peng, "Complexity scalable video decoding via IDCT data pruning," in Proc. of IEEE Conference on Consumer Electronics 2001, Los Angeles, CA, June 2001.
  2. Y. Chen, Z. Zhong, T. Lan, S. Peng, and K. Van Zon, "Regulated complexity scalable MPEG-2 video decoding for media processors," IEEE Transactions on Circuits and Systems for Video Technology, vol.12, no.8, pp. 678- 687, Aug 2002. https://doi.org/10.1109/TCSVT.2002.800861
  3. C. Lei, Y. Chen, and W. Ji, "A complexity scalable decoder in an AVS video codec," in Proc. of the 6th International Conference on Advances in Mobile Computing and Multimedia(MoMM '08), ACM, New York, USA.
  4. S. Park, Y. Lee, J. Lee, and H. Shin, "Quality-adaptive requantization for low-energy MPEG-4 video decoding in mobile devices," IEEE Trans. Consumer Electron., vol. 51, pp. 999-1005, Aug. 2005. https://doi.org/10.1109/TCE.2005.1510514
  5. T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 560-576, Jul. 2003.
  6. T. Wiegand and G. Sullivan, "Draft ITU-T recommendation and final draft international standard of joint video specification," ITU-T Rec. H.264 ISO/IEC 14496.10 AVC, 2003.
  7. M.J. Chen, M.C. Chu, and C.W. Pan, "Efficient motion-estimation algorithm for reduced frame-rate video transcoder," IEEE Transactions on Circuits and Systems for Video Technology, vol.12, no.4, pp.269-275, Apr 2002. https://doi.org/10.1109/76.999204
  8. S. Tripathi, E.M. Piccinelli, "A scene change independent high quality constant bit rate control algorithm for MPEG4 simple profile transcoding," in Proc. of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp.1-4, March 2008.
  9. H. Shu and L. P. Chau, "Dynamic frame-skipping transcoding with motion information considered," IET Image Processing, vol. 1, pp. 335-342, Dec. 2007. https://doi.org/10.1049/iet-ipr:20050308
  10. C.T. Hsu, C.H. Yeh, C.Y. Chen and M. J. Chen, "Arbitrary frame rate transcoding through temporal and spatial complexity," IEEE Transactions on Broadcasting, vol.55, no.4, pp.767-775, Dec. 2009. https://doi.org/10.1109/TBC.2009.2032802
  11. A. M. Tekalp, Digital Video Processing, Prentice hall, NJ, 1995.
  12. S. Liu, J. Kim, and C.-C. J. Kuo, "Non-linear motion-compensated interpolation for low bit rate video," in Proc. of SPIE Int. Symp. Optical Science, Engineering, Instrumentation, Appl. Digital Image Process., San Diego, CA, Jul. 2000.
  13. H.P. Deng, L. Yu, W. Xiong, Q.D. He, and R. Li, "Adaptive Interpolation/Extrapolation and Motion Vector Processing Method for Frame Rate Up Conversion," In Proc. of International Conference on Image and Graphics 2009, (ICIG '09), pp.18-22, Sept. 2009.
  14. J. Zhai, K. Yu, J. Li, and S. Li, "A low complexity motion compensated frame interpolation method," IEEE International Symposium on Circuits and Systems, Vol. 5, pp. 4927- 4930, May 2005.
  15. Y. Wu, M.N.S. Swamy, and M.O. Ahmad, "Error concealment for motion-compensated interpolation," Image Processing, IET, vol.4, no.3, pp.195-210, June 2010. https://doi.org/10.1049/iet-ipr.2009.0059
  16. Joint Video Team Reference Software, Version 17.0 (JM 17.0). [Online] Available: http://bs.hhi.de/-suehring/tml/download/.