한국정보과학회논문지:소프트웨어및응용 (Journal of KIISE:Software and Applications)

한국정보과학회 (Korean Institute of Information Scientists and Engineers)
권호 표지

특이값 분해와 점증적 클러스터링을 이용한 뉴스 비디오 샷 경계 탐지

News Video Shot Boundary Detection using Singular Value Decomposition and Incremental Clustering

  • 이한성 (고려대학교 컴퓨터통신공학부) ;
  • 임영희 (고려대학교 컴퓨터정보학과) ;
  • 박대희 (고려대학교 컴퓨터정보학과) ;
  • 이성환 (고려대학교 컴퓨터통신공학부)
  • 발행 : 2009.02.15
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 뉴스 기사 분할 관점에서, 뉴스 비디오 샷 경계 탐지 알고리즘의 특성을 고려한 다음과 같은 설계 기준을 제시하고, 이를 모두 만족하는 새로운 샷 경계 탐지 알고리즘을 제안하고자 한다. 1) 뉴스 비디오 샷 경계 탐지의 재현율을 높임으로써, 앵커 샷 탐지 단계에서 입력으로 사용될 데이타의 오류를 최소화한다; 2) 급격한 장면 변환과 점증적 장면 변환을 하나의 알고리즘으로 탐지함으로써 한번의 데이타 탐색으로 샷 분할을 수행한다; 3) 분할된 샷들을 정적 샷과 동적 샷으로 분류함으로써 앵커샷 탐지 단계의 탐색 공간을 축소한다. 제안된 뉴스 비디오 샷 경계 탐지 알고리즘은 특이간 분해를 기반으로 점증적 클러스터링 알고리즘과 머서 커널을 결합한 구조로서, 위에서 제시한 기준을 모두 만족하도록 설계되었다. 제안된 방법론은 특이간 분해를 통해 특징 벡터의 차원축소 뿐만 아니라, 뉴스 비디오를 구성하는 연속적인 프레임에서의 잡음과 아주 작은 변화를 제거함으로써 분류 성능을 높일 수 있다. 또한 머서 커널의 도입은 쉽게 분류되지 않는 데이타를 고차원 공간으로 매핑함으로써 구분하기 어려운 샷 경계의 탐지 가능성을 높여준다. 실험을 통하여 제안된 방법론이 매우 높은 재현율을 보이며, 앵커 샷 탐지를 위한 탐색 공간 축소를 효과적으로 수행함을 보인다.

In this paper, we propose a new shot boundary detection method which is optimized for news video story parsing. This new news shot boundary detection method was designed to satisfy all the following requirements: 1) minimizing the incorrect data in data set for anchor shot detection by improving the recall ratio 2) detecting abrupt cuts and gradual transitions with one single algorithm so as to divide news video into shots with one scan of data set; 3) classifying shots into static or dynamic, therefore, reducing the search space for the subsequent stage of anchor shot detection. The proposed method, based on singular value decomposition with incremental clustering and mercer kernel, has additional desirable features. Applying singular value decomposition, the noise or trivial variations in the video sequence are removed. Therefore, the separability is improved. Mercer kernel improves the possibility of detection of shots which is not separable in input space by mapping data to high dimensional feature space. The experimental results illustrated the superiority of the proposed method with respect to recall criteria and search space reduction for anchor shot detection.

키워드

참고문헌

  1. X. Gao, J. Li, and B. Yang, 'A graph-theoretical clustering based anchorperson shot detection for news video indexing,' in Proceedings of International Conference on Computational Intelligence and Multimedia Applications, pp. 108-113, 2003 https://doi.org/10.1117/12.539898
  2. C. Ko and W. Xie, 'News Video Segmentation and Categorization Techniques for Content-Demand Browsing,' in Proceedings of Congress on Image and Signal Processing, Vol.2, pp. 530-534, 2008
  3. Y. Fang, X. Zhai, and J. Fan, 'News Video Story Segmentation,' in Proceedings of the International Conference on Multi-Media Modeling, pp. 397-400, 2006
  4. F. Colace, P. Foggia, and G. Percannella, 'A Probabilistic Framework for TV-News Stories Detection and Classification,' in Proceedings of International Conference on Multimedia and Expo, pp. 1350-1353, 2005
  5. L. chaisorn, T. Chua, C. Lee, and Q. Tian, 'A Hierarchical Approach to Story Segmentation of Large Broadcast News Video Corpus,' in Proceedings of International Conference on Multimedia and Expo, pp. 1095-1098, 2004
  6. L. Chaisorn, T. Chua, and C. Lee, 'A Multi-Modal Approach to Story Segmentation for News Video,' World Wide Web: Internet and Web Information Systems, Vol.6, pp. 187-208, 2003 https://doi.org/10.1023/A:1023622605600
  7. J. Yuan, H. Wang, L. Xiao, W. Zheng, J. Li, F. Lin, and B. Zhang, 'A Formal Study of Shot Boundary Detection,' IEEE Transaction on Circuit and System for Video Technology, Vol.17, No.2, pp. 168-186, 2007 https://doi.org/10.1109/TCSVT.2006.888023
  8. Y. Gong and X. Liu, 'Video Summarization using Singular Value Decomposition,' in Proceedings of International Conference on Computer Vision and Pattern Recognition, Vol.2, pp. 174-180, 2000 https://doi.org/10.1007/s00530-003-0086-3
  9. H. Fang, J. Jiang, and Y. Feng, 'A Fuzzy Logic Approach for Detection of Video Shot Boundary,' Pattern Recognition, Vol.39, pp. 2092-2100, 2006 https://doi.org/10.1016/j.patcog.2006.04.044
  10. Z. Cernekova, I. Pitas, and C. Nikou, 'Information Theory-Based Shot Cut/Fade Detection and Video Summarization,' IEEE Transaction on Circuit and System for Video Technology, Vol.16, No.1, pp. 82-91, 2006 https://doi.org/10.1109/TCSVT.2005.856896
  11. X. Ling, Q. Yuanxin, L. Huan, and X. Zhang, 'A Method for Fast Shot Boundary Detection based on SVM,' in Proceedings of Congress on Image and Signal Processing, Vol.2, pp. 445-449, 2008
  12. M. Cooper, T. Liu, and E. Rieffel, 'Video Segmentation via Temporal Pattern Classification,' IEEE Transaction on Multimedia, Vol.9, No.3, pp. 610-618, 2007 https://doi.org/10.1109/TMM.2006.888015
  13. Z. Cernekova, C. Kotropoulos, and I. Pitas, 'Video Shot Segmentation using Singular Value Decomposition,' in Proceedings of International Conference on Acoustics, Speech, and Signal Processing, Vol.3, pp. 181-184, 2003
  14. H. Feng, W. Fang, S. Liu, and Y. Fang, 'A New General Framework for Shot Boundary Detection Based on SVM,' in Proceedings of International Conference on Neural Networks and Brain, Vol.2, pp. 1112-1117, 2005 https://doi.org/10.1109/ICNNB.2005.1614812
  15. X. Xu, G. Li, and J. Yuan, 'A Shot Boundary Detection Method for News Video based on Object Segmentation and Tracking,' in Proceedings of International Conference on Machine Learning and Cybernetics, Vol.5, pp. 2470-2475, 2008
  16. X. Ling, L. Chao, L. Huan, and X. Zhang, 'A General Method for Shot Boundary Detection,' in Proceedings of International Conference on Multimedia and Ubiquitous Engineering, pp. 394-397, 2008 https://doi.org/10.1109/MUE.2008.102
  17. X. Gao and X. Tang, 'Unsupervised Video Shot Segmentation and Model Free Anchor Person Detection for News Video Story Parsing,' IEEE Transaction on Circuit and System for Video Technology, Vol.12, No.9, pp. 765-776, 2002 https://doi.org/10.1109/TCSVT.2002.800510
  18. G. Golub and C. Van Loan, Matrix Computations, The Johns Hopkins University Press, 3rd Ed., pp. 72-73, 1996
  19. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernelbased Learning Methods, Cambridge University PRESS, pp. 93-124, 2000
  20. A. Baraldi and E. Chang, 'Simplified ART: A New Class of ART Algorithms,' International Computer Science Institute, TR 98-004, 1998