Generation of Video Clips Utilizing Shot Boundary Detection

샷 경계 검출을 이용한 영상 클립 생성

  • Published : 2001.12.01

Abstract

Video indexing plays an important role in the applications such as digital video libraries or web VOD which archive large volume of digital videos. Video indexing is usually based on video segmentation. In this paper, we propose a software tool called V2Web Studio which can generate video clips utilizing shot boundary detection algorithm. With the V2Web Studio, the process of clip generation consists of the following four steps: 1) Automatic detection of shot boundaries by parsing the video, 2) Elimination of errors by manually verifying the results of the detection, 3) Building a modeling structure of logical hierarchy using the verified shots, and 4) Generating multiple video clips corresponding to each logically modeled segment. The aforementioned steps are performed by shot detector, shot verifier, video modeler and clip generator in the V2Web Studio respectively.

대용량 영상을 다루는 디지털 비디오 라이브러리나 웹 방송에서는 영상 색인이 매우 중요한 역할을 하며, 이는 영상을 내용 단위로 분할하는 알고리즘에 기반한다. 본 논문에서 구현된 V2Web Studio는 영상 색인을 지원하는 시스템으로서, 샷 경계 검출 알고리즘을 이용한 영상 클립 생성 시스템이다. V2Web Studio는 영상 클립 생성 과정을 1) 영상 신호를 분석하여 샷 경계를 자동 검출하는 단계, 2) 검출된 결과에 포함될 수 있는 오류를 수작업으로 제거하는 단계, 3) 물리적인 샷 경계를 논리적인 계층구조로 모델링하는 단계, 4) 계층구조로 모델링된 각 모델링 인스턴스를 다양한 표준 압축 포맷으로 생성하는 단계로 구분하고, 각 단계에 해당하는 작업은 샷 검출기, 샷 검증기, 영상 모델기, 클립 생성기라는 독립적인 소프트웨어 도구로 구현하였다.

Keywords

References

  1. J. S. Boreczky, L. A. Rowe, 'Comparison of video boundary detection technique,' Proc. of Storage and Retrieval for Image and Video Database IV, SPIE Vol.2670, pp.170-179, 1996 https://doi.org/10.1117/12.234794
  2. A. Hampapur, R. Jain, T. Weymouth, 'Digital video segmentation,' Proc. Of ACM Multimedia, pp.357 -564, 1994 https://doi.org/10.1145/192593.192699
  3. H. Kim, S. -J. Park, J. Lee, W. M. Kim, S. M. Song, 'Processing of partial video data for detection of wipes,' Proc, of Storage and Retrieval for Image and Video Databases VII, SPIE Vol.3656, pp.280-289, San Jose, California, January 1999 https://doi.org/10.1117/12.333847
  4. H. Kim, J. Lee, J.-H. Yang, W. M. Kim, S. M. Song, 'Visual rhythm and shot verifiction,' To appear in Multimedia Tools and Applications, Kluwer Academic Publishers, Vol.15, No,3, November 2001 https://doi.org/10.1023/A:1012452131892
  5. J. Meng, Y. Juan, S. Chang, 'Scene change detection in a MPEG compressed video sequence,' Proc. of Digital Video Compression: Algorithms and Technologies, SPlE Vol. 2419, pp.14-25, 1995 https://doi.org/10.1117/12.206359
  6. Y. Nakajima, K. Ujihara, A. Yoneyama, 'Universal scene change detection on MPEG-coded data domain,' Proc, of Visual Communication and Image Processing, SPIE Vol.3024, pp.992-1003, 1997 https://doi.org/10.1117/12.263179
  7. S. M. Song, T.-H. Kwon, W. M. Kim. H. Kim, B.-D. Rhee, 'On detection of gradual scene changes for parsing of video data,' Proc. of Storage and Retrieval for Image and Video Database VI, SPIE Vol.3312, pp.404-413, 1998 https://doi.org/10.1117/12.298449
  8. B.-L. Yeo, B. Liu, 'Rapid scene analysis on compressed video,' IEEE Transactions on Circuits and Systems for Video Technology, Vol.5, No.6, pp.533-544, Dec. 1995 https://doi.org/10.1109/76.475896
  9. M. M. Yeung, B.-L Yeo, W. Wolf, B. Liu, 'Video browsing using clustering and scene transitions on compressed sequences,' Proc. of Multimedia Computing and Networking, SPIE Vol.2417, pp.399 -413, 1995 https://doi.org/10.1117/12.206067
  10. H. Zhang, K. Kankanhalli, S. Smoliar, 'Automatic partitioning of full-motion video,' Multimedia Systems, Vol. 1, No.1, pp,10-28, 1993 https://doi.org/10.1007/BF01210504
  11. D. Zhong, H. Zhang, S.-F. Chang, 'Clustering methods for video browsing and annotation,' Proc. of Storage and Retrieval for Image and Video Database VI. SPIE Vol.2670, pp.239-246, 1996 https://doi.org/10.1117/12.234800