Journal of KIISE:Software and Applications (한국정보과학회논문지:소프트웨어및응용)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지

Shot Boundary Verification using Visual Rhythm

시각 율동을 이용한 샷 경계 검증

  • Published : 2000.03.15
Download PDF
⟨ Previous Next ⟩

Abstract

Recent works regarding video shot change detection algorithms show that abrupt shot changes are detected fairly well. However, gradual shot changes including wipes and dissolves are often missed or falsely detected. A robust shot change detection system, therefore, must include a shot verification step to further enhance the overall system performance. In this paper, we introduce the concept of the visual rhythm which is a single image, a subsampled version of a full video. On the visual rhythm, the different video edit effects such as cuts, wipes and dissolves manifest themselves as different patterns. Using this characteristic, it becomes possible, without sequentially playing the entire video, to find false positive shots as well as undetected shots. Thus, inclusion of the visual rhythm in the shot boundary verification process will aid the operator to exclude falsely detected shots as well as to find undetected shots fast and efficiently. For this purpose we have developed a new tool, a shot verifier incorporating the visual rhythm. The usefulness of the visual rhythm during the shot verification process will be presented.

샷 경계 검출 알고리즘은 영상 제작시 사용된 컷, 와이프, 디졸브 등의 편집 효과로 인해 완벽한 결과를 기대하기 어렵다. 따라서 정확한 샷 경계를 얻기 위해서는 수작업에 의한 검증이 필요하다. 본고에서는 시각 율동을 이용한 샷 경계 검증 방법을 제시한다. 시각 율동은 영상의 내용 변화를 요약한 한 장의 이미지이다. 편집 효과는 수직선, 사선, 곡선, 점진적 색상의 변화 등 시각적으로 인지 가능한 형태로 시각 율동에 표현된다. 따라서 영상을 재생시키지 않고도 시각 율동의 변화만을 파악하여 샷 경계로 의심되는 부분들을 쉽고 빠르게 찾아낼 수 있다. 또한 이 특성을 이용한 샷 검증기를 구현하여 시각 율동의 유용성을 보인다.

Keywords

References

  1. J. S. Boreczky, L. A. Rowe, 'Comparison of video boundary detection techniques,' Proc. of SPIE Storage and Retrieval for Image and Video Database IV, SPIE Vol.2670, pp.170-179, 1996
  2. G. Davenport, T. A. Smith, N. Pincever, 'Cinematic primitives for multimedia,' IEEE Computer Graphics and Applications, pp.67-74, July 1991 https://doi.org/10.1109/38.126883
  3. A. Hampapur, R. Jain, T. Weymouth, 'Digital video segmentation,' Proc. Of ACM Multimedia,pp.357-564, 1994 https://doi.org/10.1145/192593.192699
  4. H. Kim, S.-J. Park, J. Lee, W. M. Kim, S. M. Song, 'Processing of partial video data for detection of wipes,' Proc. of SPIE Storage and Retrieval for Image and Video Databases VII, SPIE Vol.3656, pp.280-289, 1999
  5. J. Meng, Y. Juan, S. Chang, 'Scene change detection in a MPEG compressed video sequence,' Proc. of Digital Video Compression: Algorithms and Technologies, SPIE Vol. 2419, pp.14-25, 1995 https://doi.org/10.1117/12.206359
  6. Y. Nakajima, K. Ujihara, A. Yoneyama, 'Universal scene change detection on MPEG-coded data domain,' Proc. of SPIE Visual Communication and Image Processing, SPIE Vol.3024, pp.992-1003, 1997 https://doi.org/10.1117/12.263179
  7. J. Song, B.-L. Yeo, 'Spatially reduced image extraction from MPEG-2 video: fast algorithms and applications,' Proc. of SPIE Storage and Retrieval for Image and Video Database VI, SPIE Vol.3312, pp.93-107, 1998 https://doi.org/10.1117/12.298473
  8. S. M. Song, T.-H. Kwon, W. M. Kim. H. Kim, B.-D. Rhee, 'On detection of gradual scene changes for parsing of video data,' Proc. of SPIE Storage and Retrieval for Image and Video Database VI, SPIE Vol.3312, pp.404-413, 1998 https://doi.org/10.1117/12.298449
  9. B.-L. Yeo, B. Liu, 'Rapid scene analysis on compressed video,' IEEE Transactions on Circuits and Systems for Video Technology, Vol.5, No.6, pp.533-544, Dec. 1995 https://doi.org/10.1109/76.475896
  10. M. M. Yeung, B.-L. Yeo, W. Wolf, B. Liu, 'Video browsing using clustering and scene transitions on compressed sequences,' Proc. of SPIE Multimedia Computing and Networking, SPIE Vol.2417, pp.399-413, 1995 https://doi.org/10.1117/12.206067
  11. H. Zhang, K. Kankanhalli, S. Smoliar, 'Automatic partitioning of full-motion video,' Multimedia Systems, Vol. 1, No. 1, pp.10-28, 1993 https://doi.org/10.1007/BF01210504