Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

A New Method for Thumbnail Extraction in H.264/AVC Bitstreams

H.264/AVC 비트스트림에서 썸네일 추출을 위한 새로운 방법

  • 홍승환 (광운대학교 VIA-멀티미디어 센터) ;
  • 김지언 (광운대학교 VIA-멀티미디어 센터) ;
  • 진영민 (KT 중앙연구소) ;
  • 권재철 (KT 중앙연구소) ;
  • 오승준 (광운대학교 VIA-멀티미디어 센터)
  • Received : 2010.09.13
  • Accepted : 2010.11.04
  • Published : 2010.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, thumbnail techniques are required to index a high-performance video at digital convergence-based multimedia service like IPTV and DMB. Therefore a thumbnail extraction method in H.264/AVC bitstreams has been proposed. However, thumbnail quality deterioration problem at converting the general equation of spatial domain to frequency domain which is generated by not considering about H.264/AVC transform and quantization processing and rounding-off operation in intra prediction. In this paper, we propose a new thumbnail extraction method in H.264/AVC bitstreams. The proposed scheme is based on H.264/AVC core-transform for a thumbnail extraction in frequency domain, and probability theory, intra rounding-off error compensation. Through the implementation and performance evaluation, the subjective quality difference between the output of our scheme and the output of reference decoder is negligible and better than the conventional method, and moreover PSNR gain by up to 8.66 dB.

IPTV, DMB 등과 같은 방통융합 기반 멀티미디어 서비스에서는 고성능 비디오 인덱싱을 위한 썸네일 기술이 요구되므로 H.264/AVC 비트스트림으로부터 직접 썸네일을 추출하는 방법이 제안되었다. 그러나 화소 공간에서 정의한 일반화 수식을 주파수 공간으로 변환하는 과정에서 H.264/AVC에 정의된 변환 및 양자화, 그리고 인트라 예측의 반올림을 고려하지 않음으로써 썸네일 화질을 저하시키는 문제점이 있다. 본 논문에서는 H.264/AVC 비트스트림에서의 새로운 썸네일 추출 방법을 제안한다. 제안하는 방법은 H.264/AVC 핵심 변환을 기반으로 주파수 공간에서의 썸네일 추출 방법을 이론적으로 정리하고 확률적 방법으로 인트라 예측의 반올림 보상 방법을 제시한다. 제안한 방법을 통해 얻은 썸네일은 참조 복호화기를 통해 얻은 썸네일과 주관적 화질은 크게 차이 나지 않으며 이전에 제안된 방법과 비교하여 주관적 화질 향상과 최대 8.66 dB의 PSNR 이득을 얻었다.

Keywords

References

  1. B. Yeo and B. Liu, "Rapid scene analysis on compressed video", IEEE Trans. Circuit and System for video Technology, vol. 5, no. 6, pp.533-540, 1995. https://doi.org/10.1109/76.475896
  2. Wing-San Chau, Oscar C. Au, Tak-Song Chong, Tai-Wai Chan, Chi-Shun Cheung, "Efficient Scene Change Detection in MPEG Compressed Video Using Composite Block Averaged Luminance Image Sequence", IEEE ICICS, pp. 688-691, 2005.
  3. 윤자천, 설상훈, "압축영역에서 빠른 축소 영상 추출을 위한 다중부호 룩업테이블 설계", 한국방송공학회, vol. 10, no. 3, pp. 413-421, 2005.
  4. N. Merhav and V. Bhaskaran, "Fast algorithms for DCT-domain image down-sampling and for inverse motion compensation", IEEE Trans. Circuit and System for video Technology, vol. 7, pp. 468-476, 1997. https://doi.org/10.1109/76.585926
  5. Taskiran, C. Jau-Yuen Chen, Bouman, C.A. Delp, E.J. "A compressed video database structured for active browsing and search," IEEE image Processing, vol.3, pp.133-137, Oct. 1998. https://doi.org/10.1109/ICIP.1998.999004
  6. Ja-Cheon Yoon, Hyeokman Kim, Seong Soo Chun, Jung-Rim Kim, Sanghoon Sull, "Real-Time Video Indexing System for Live Digital Broadcast TV Programs," Lecture Notes in Computer Science, CVIR2004, vol. 3115, pp. 261-269, Jul. 2004.
  7. G.C. Feng and J. Jiang, "Image extraction in DCT domain," IEE Proc.-Vis. Image Signal Process., Vol. 150, No. 1, pp.20-27, Feb. 2003. https://doi.org/10.1049/ip-vis:20030157
  8. J. Song and B.L. Yeo, "Fast Extraction of Spatially Reduced Image Sequences from MPEG-2 Compressed Video," IEEE Trans. Circuits and Systems for Video Technology, vol. 9, no.7, pp. 1100-1114. Oct. 1999. https://doi.org/10.1109/76.795061
  9. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC), 2003.
  10. Henrique S. Malvar, Antti Hallapuro, Marta Karczewicz, and Louis Kerofsky, "Low-Complexity Transform and Quantization in H.264/AVC", IEEE Trans. Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 598-603, July 2003. https://doi.org/10.1109/TCSVT.2003.814964
  11. Chen Chen, Ping-Hao Wu and Chen H, "Transform-Domain Intra Prediction for H.264," IEEE ISCAS, pp.1497-1500, May 2005.
  12. 유상준, 윤명근, 김은석, 손채봉, 심동규, 오승준, "H.264/AVC 비트스트림에서 효율적으로 축소 영상을 추출하는 방법," 한국방송공학회, 제13권, 제2호, pp,222-235, Mar, 2008. https://doi.org/10.5909/JBE.2008.13.2.222
  13. Eun-Seok Kim, Tae-Woong Um, and Seoung-Jun Oh, "A Fast Thumbnail Extraction Method in H.264/AVC Video Streams," IEEE Trans. Consumer Electronics, vol. 55, no. 3, pp. 1424-1430, Aug. 2009. https://doi.org/10.1109/TCE.2009.5278009
  14. 홍승환, 이여송, 조혜정, 안창범, 오승준, "H.264/AVC 비트스트림에 대한 공간주파수 영역에서의 썸네일 추출 방법," 한국방송공학회 학술대회, pp,277-280, Nov, 2009
  15. Yu-Kuang Tu, Jar-Ferr Yang, and Ming-Ting Sun, "Efficient Rate-Distortion Estimation for H.264/AVC Coders", IEEE Trans. Circuits and Systems for Video Technology, vol. 16, no. 5, pp. 600-611, May 2006. https://doi.org/10.1109/TCSVT.2006.873160
  16. Jeong Mee Moon, and Jae Ho Kim, "A New Low-Complexity Integer Distortion Estimation Method for H.264/AVC Encoder", IEEE Trans. Circuits and Systems for Video Technology, vol. 20, no. 2, pp. 207-212, Feb. 2010. https://doi.org/10.1109/TCSVT.2009.2031389
  17. Yuichiro Nakaya, Yoshinori Suzuki, and Satoshi Misaka, "Avoidance of error accumulation in motion compensation," Doc. Q15-A-35R1, June 1997
  18. H.264/AVC Reference Software Model (JM 12.2) : http://iphome.hhi.de/suehring/tml/download/old jm