Creating highlights of Soccer video

축구 비디오 하이라이트 생성

  • Published : 2001.08.01

Abstract

비디오 하이라이트(highlights)는 원래의 비디오 보다 짧고 많은 양의 의미를 갖는다. 기존의 파노라마 형태의 추상화 기법은 여러 프레임을 하나의 프레임으로 모자이크하는 형태이었고, TV 드라마 하이라이트 방법은 카메라의 이동이나 특수효과에 의존하기 때문에 스포츠 비디오에 적용은 부적합하다. 이 논문에서는 축구 비디오를 대상으로 시각정보와 자막을 이용하는 새로운 비디오 하이라이트 생성 방법과 이벤트 기반 비디오 인덱싱 방법을 제안한다. 하이라이트 생성은 하이라이트 생성 규칙에 따라 자막에 의해 추출된 TIT을 중심으로 시각정보에 의해 추출된 샷을 합성하여 생성하였고, 인덱싱은 자막으로 추출된 샷은 주요소로, 시각정보에 의해 추출된 샷은 부가적 요소로 구성하였다. 실험에서는 샷 추출기법 중 대표적인 컬러히스토그램과 $\chi$$^2$히스토그램과의 성능을 비교하여 제안한 하이라이트 기법이 다른 방식보다 우수함을 증명하였다.

Keywords

References

  1. P. Aigrain, H. J. Zhang and D. Petkovic, 'Content-based representation and Retrieval of Visual Media : a State-of-the-Art Review,' Multimedia Tools and Applications, Vol.3, pp.179-202, 1996 https://doi.org/10.1007/BF00393937
  2. M. A. Smith and T. Kanade, 'Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques,' Proceedings of CVPR'97, pp. 775-781, 1997
  3. R. Lienhart, S. Pfeiffer and W. Effelsberg, 'Video Abstrac-ting, 'ACM Communication, Vol.40, No.12, pp.55-62, 1997 https://doi.org/10.1145/265563.265572
  4. L. He, E. Sanocki, A. Gupta and J. Grudin, 'Auto-Summari-zation of Audio-Video Presentations,' Proceedings of ACM Multimedia'99, pp.489-498, 1999 https://doi.org/10.1145/319463.319691
  5. Sun, X., Kankanhalli, M.,;Zhu, Y. & Wu, J., 'Content-Based Representative Frame Extraction for Digital Video,' Inter-national Conference on Multimedia Computing and Sys-tems, pp.190-193, 1998 https://doi.org/10.1109/MMCS.1998.693638
  6. Smith, M. A. & Kanade, T., 'Video Skimming for Quick Browsing based on Audio and Image Characterization,' Technical Report No.CMU-CS-95-186, School of Computer Science, Carnegie Mellon University, 1995
  7. Zhang, H. J., Low, C. Y. & Smoliar, S. W., 'Video Parsing and Browsing using Compressed Data,' Multimedia tools and Applications 1, pp.89-111, 1995 https://doi.org/10.1007/BF01261227
  8. W. Chang, G. Sheikholeslami, J. Wang and A. Zhang, 'Data Rescource Selection in Distributed Visual Information Sys-tems, 'IEEE Trans. on Knowledge and Data Engineering, Vol.10, No.6, pp.926-946, 1998 https://doi.org/10.1109/69.738358
  9. M. Smith and T. Janade, 'Video Skimming for Quick Brow-sing based on Audio and Image Characterization,' Tech. Report CMU-CS-95-186, Computer Science Department, Carneigie Mellon University, July, 1995
  10. M. Yeung and Boon-Lock Yeo, 'Video Visualization for Computer Presentation and Fast Browsing of Pictorial Content,' IEEE Trans. on Circuits and Systems for Video Technology, Vol.17, No.5, pp.771-785, 1997 https://doi.org/10.1109/76.633496
  11. N. Vasconcelos and A. Lippman, 'A Spatiotemporal Motion Model for Video Summarization,' CVPR, Santa Barbara, 1998 https://doi.org/10.1109/CVPR.1998.698631
  12. G. Medioni, R. Nevatia and I. Cohen, 'Event detection and Analysis from Video Streams,' DARPA98, pp.63-72, 1998
  13. R. Rosales and S. Sclaroff, '3D Trajectory for Tracking Multiple Objects and Trajectory Guided Recognition of Actions,' CVPR, June 1999 https://doi.org/10.1109/CVPR.1999.784618
  14. D. Pfoser and Y. Theodoridis, 'Generating Semantics-Based Trajectories of Moving Objects,' International Workshop on Emerging Technologies for Geo-Based Applications, Ascona, Swizerland, 2000
  15. Hampapur, A., R.Jain and T. Weymouth, 'Digital Video Indexing in Multimedia Systems,' in Proc. of AAAI-94 Workshop on Indexing and reuse in Multimedia Systems, 1994
  16. Hampapur, A., R. Jain and T.Weymouth, 'Production Model Based Digital Video Segmentation,' Multimedia Tools and Applications, Vol.1, No.1, pp.9-46, 1995 https://doi.org/10.1007/BF01261224
  17. E. Ardizzone, M. L. Cascia, 'Automatic Video Database Indexing and Retrieval,' Multimedia Tools and Applications, Vol.4, No.1, pp.29-56, 1997 https://doi.org/10.1023/A:1009630331620
  18. J. C. Lee, Q. Li, W. Xiong, 'VIMS : A Video Information Management System,' Multimedia Tools and Applications, Vol.4, No.1, pp.7-28, 1997 https://doi.org/10.1023/A:1009655814781
  19. B. Furht, S. W. Smoliar, H. J. Zhang, 'Video and Image Processing in Multimedia System,' Kluwer Academic Publishers, pp.335-356, 1995
  20. S. J. Dennis, R. Kasturi, U. Gargi, S.Antani, 'An Evaluating of Color Histogram Based Methods in Video Indexing,' Research Progress Report CSE-96-053 for the contract MDA 904-95-C 2263, 1995
  21. Zhang, H. J., J. Y. A. Wang and Y. Altunbasak, 'Content-based Video Retrieval and Compression : A Unified Solu-tion,' Proc. ICIP '97, Int. Conf. on Image Processing, pp.113-16, 1997 https://doi.org/10.1109/ICIP.1997.647372
  22. Zhong, D. and S. F. Chang, 'Spatio-Temporal Video Search Using the Object Based Representation,' Proc. ICIP '97. Int. Conf. on Image Processing, pp.I21-24, 1997 https://doi.org/10.1109/ICIP.1997.647374
  23. Zabih, R., J. Miller and K. Mai, 'Feature-based Algorithms for Detecting and Classifying Scene Breaks,' Proc. ACM Int. Conf. on Multimedia, pp.189-200, 1995 https://doi.org/10.1145/217279.215266
  24. Armen, F., A. Hsu and M. Y. Chiu, 'Feature Management for Large Video Databases,' Storage and Retrieval for Image and Video Databases, Proc. SPIE, 1908 : pp.2-12, 1993 https://doi.org/10.1117/12.143638