Algorithm and Implementation for Real-Time Intelligent Browsing of HD Bitstream in DTV PVR

DTV PVR에서 HD급 데이터의 실시간 지능형 검색을 위한 알고리즘 및 구현

  • 정수운 (한양대학교 전자컴퓨터공학부) ;
  • 장경훈 (LG전자 DTV 연구소) ;
  • 이동호 (한양대학교 전자컴퓨터공학부)
  • Published : 2003.11.01

Abstract

This paper presents a low-complexity algorithm lot browsing a HD bit stream in DTV PVR according to its characteristics and also presents its implementation results. We propose an efficient algorithm which detects shots using some information after decoding MPEG-2 data, clusters them into scene and episode, and intelligently browses them according to some criteria after calculating their complexity. Some simulation results are presented to show the performance feasibility of the proposed algorithm. To implement it in real time, we propose an efficient hybrid architecture which partitions the algorithm into two parts of hardware and software. The hardware covers decoding process and extraction of some basic information which take most complexity in implementing the algorithm. The software covers the heuristic part of tile algorithm which has low complexity and needs to be expandable.

본 논문은 DTV PVR에 입력되는 HD급 방송 데이터에 대하여 영상의 특성에 따라 지능적으로 검색을 할 수 있는 저 복잡도의 알고리즘과 이의 실시간 구현에 관한 결과를 제시한다. MPEG-2 비디오 데이터에 대해 이를 복호하여 샷을 검출하고 이를 통해 신과 에피소드로 클러스터링하는 효율적인 알고리즘과 각 신의 복잡도를 계산하여 이를 기준으로 비선형적으로 검색하는 알고리즘을 제안한다. 또한 모의실험을 통해 제안하는 알고리즘 성능의 적절성을 검증하였다. 그리고 이의 실시간 구현을 위해 전체 알고리즘을 구현하는 데 있어서 대부분의 연산량을 차지하는 디코더와 기본 정보를 추출하는 부를 하드웨어적으로 구현하고, 이를 이용하여 실제 검색을 위한 핵심적이고 확장이 요구되는 알고리즘을 소프트웨어로 구현하는 혼합 구조를 제시하고 실제 이를 구현하였다.

Keywords

References

  1. A. Hanjalic, R. L. Lagendijk, and J. Biemond, 'Automated High-level Movie Segmentation for Advanced Video-Retrieval Systems', IEEE transaction on circuits and systems for video technology, vol. 9, no. 4, pp. 580-588, June 1999 https://doi.org/10.1109/76.767124
  2. Minerva M. Yeung, Boon-Lock Yeo, 'Video Visualization for Compact Presentaion and Fast Browsing of Pictorial Content', IEEE transaction on circuits and sysems for video technology, VOL7, No 5, pp. 771-785, Oct, 1997 https://doi.org/10.1109/76.633496
  3. Minerva Yeung, Boon-Lock Yeo, Bede Liu, 'Extracting Story Units from Long Programs for Video Browsing and Navigation', Proceedings of multimedia, pp. 296305, 1996 https://doi.org/10.1109/MMCS.1996.534991
  4. J.Berens, G.D. Finlayson and G.Qiu, 'Image indexing using compressed colour histograms', IEE Proc.-Vis. Image Signal Process, vol. 147, no 4, pp. 349-355, August 2000 https://doi.org/10.1049/ip-vis:20000630
  5. Rick Rickman, Paul Rosin, 'Content Based Image Retrieval using Colour N-grams', The Institution of Electrical Engineers, pp. 15/1-15/6, 1996
  6. W.A.C. Fermando, C.N. Cangarajah and D.R. Bull, 'Scene change detection algorithms for content-based video indexing and retrieval', Electronics & Communication Engineering Journal, pp. 117-126, June 2001 https://doi.org/10.1049/ecej:20010302
  7. Cuneyt Taskiran, Jau-Yuen Chen, Charles A. Bouman and Edward J.Delp, 'A compressed Video Database Structured for Active Browsing and Search', IEEE. vol. 3, pp. 133-137, 1998 https://doi.org/10.1109/ICIP.1998.999004
  8. AjayDivakaran, Anthony Vetro, Kohtaro Asai, Hirofumi Nishikawa, 'Video Browsing System Based on Compressed Domain Feature Extraction', IEEE, pp. 637-644, 2000 https://doi.org/10.1109/30.883424
  9. Ullas Gargi, Rangachar Kasturi, and Susan H. Strayer, 'Performance Characterization of Video -Shot-Change Detection Method', IEEE Transaction on Circuits & System for video technology, vol. 10, no. 1, pp. 1-13, February 2000 https://doi.org/10.1109/76.825852
  10. Sung-Bae Jun, Kyoungro Yoon, Hee-Youn Lee, 'Dissolve Transition Detection Algorithm Using Spatio-Temporal Distribution of MPEG MacroBlock Types', ACM, 2000 https://doi.org/10.1145/354384.354542
  11. ISO/IEC 13818-2 MPEG-2, 'Generic Coding of moving pictures and associated audio information : Video', July 1995
  12. ISO/IEC 13818-2 MPEG-2, 'Generic codings of moving pictures and associated audio information : Systems', July 1995