Browse > Article

Detection of Video Scene Boundaries based on the Local and Global Context Information  

강행봉 (가톨릭대학교 컴퓨터전자공학부)
Publication Information
Journal of KIISE:Computing Practices and Letters / v.8, no.6, 2002 , pp. 778-786 More about this Journal
Abstract
Scene boundary detection is important in the understanding of semantic structure from video data. However, it is more difficult than shot change detection because scene boundary detection needs to understand semantics in video data well. In this paper, we propose a new approach to scene segmentation using contextual information in video data. The contextual information is divided into two categories: local and global contextual information. The local contextual information refers to the foreground regions' information, background and shot activity. The global contextual information refers to the video shot's environment or its relationship with other video shots. Coherence, interaction and the tempo of video shots are computed as global contextual information. Using the proposed contextual information, we detect scene boundaries. Our proposed approach consists of three consecutive steps: linking, verification, and adjusting. We experimented the proposed approach using TV dramas and movies. The detection accuracy of correct scene boundaries is over than 80%.
Keywords
Scene segmentation; contextual information; semantics;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 S. Chang and H. Sundaram 'Structural and Semantic Analysis of Video,' Proc. ICME'00, Aug. 2000   DOI
2 M. Yeung, B. Yeo and B. Liu, 'Segmentation of Video by Clustering and Graph Analysis,' Computer Vision and Image Understanding, Vol. 71, No. 1, pp. 94-109, 1998   DOI   ScienceOn
3 H. Sundaram and S. Chang, 'Determining Computable Scenes in Films and their Structures using Audio-Visual Memory Models,' Proc. ACM Multimedia'00, 2000   DOI
4 W. Grosky, R. Jain and R. Mehrotra, The Handbook of Multimedia Information Management, Prentice Hall PTR, 1997
5 L. Vincent and P. Soille, 'Watersheds in Digital Spaces: An Efficient Algorithms based on Immersion Simulation,' IEEE Trans. PAMI, Vol. 13, No. 6, pp. 583-598, Jun. 1991   DOI   ScienceOn
6 S. Cooray, N. O'Connor, S. Marlow, N. Murphy, and T. Curran, 'Hierarchical Semi-Automatic Video Object Segmentation for Multimedia Applications,' Proc. SPIE Internet Multimedia Management Systems II, pp.10-19, 2001
7 A. Hanjalic, R. Lagendijk and J. Biemond, 'Automated High-Level Movie Segmentation for Advanced Video-Retrieval Systems,' IEEE Trans. Cir. and Sys. for Video Tech., Vol. 9, No. 4, pp. 580-588, June 1999   DOI   ScienceOn
8 J. Kender and B. Yeo, 'Video Scene Segmentation Via Continuous Video Coherence,' Proc. CVPR'98, June 1998   DOI
9 W. Wolf, 'Key Frame Selection by Motion Analysis,' Proc. ICASSP' 96, pp. 1228-1231, 1996   DOI
10 M. Kim, J. Choi, D. Kim, H. Lee, C. Ahn and Y. Ho, 'A VOP Generation Tool: Automatic Segmentation of Moving Objects in Image Sequences Based on Spatio-Temporal Information,' IEEE Trans. Cir. Sys. for Video Tech., Vol. 9, No. 8, pp. 1216-1226, Dec. 1999   DOI   ScienceOn
11 E. Chang, B. Li and C. Li, 'Toward Perception-Based Image Retrieval,' Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 101-105, Jun. 2000   DOI
12 H. Zhang, J. Wu, D. Zhong and S. Smoliar, 'An Integrated System for Content-based Video Retrieval and Browsing,' Pattern Recognition, 30(4), pp. 643-658, 1997   DOI   ScienceOn
13 강행봉, '비디오 셧으로부터 영역, 모션 및 퍼지 이론을 이용한 계층적 대표 프레임 선택', 정보과학회 논문지, 제 27권 5호, pp. 510-520, 2000   과학기술학회마을
14 B. Lucas and T. Kanade, 'An Iterative Techinque of Image Registration and Its Application to Stereo,' Proc. IJACI, pp. 674-679, 1981
15 V. Kobla and D. Doermann, 'Compressed domain video indexing techniques using DCT and motion vector information in MPEG video,' Proc. of SPIE, 1997
16 J. Corridoni, A. Bimbo, and P. Pala, 'Image Retrieval by Color Semantics,' ACM Multimedia Systems Journal, Vol. 7, No. 5, pp. 359-368, Sept. 1999   DOI
17 E. Goldstein, Sensation and perception, Brooks/Cole, 1999