Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Shot Boundary Detection Algorithm by Compensating Pixel Brightness and Object Movement

화소 밝기와 객체 이동을 이용한 비디오 샷 경계 탐지 알고리즘

  • 이준구 (단국대학교 컴퓨터과학과) ;
  • 한기선 (강동대학교 방송영상미디어과) ;
  • 유병문 ((주)엘앤와이비젼) ;
  • 황두성 (단국대학교 컴퓨터과학과)
  • Received : 2013.03.22
  • Accepted : 2013.05.05
  • Published : 2013.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Shot boundary detection is an essential step for efficient browsing, sorting, and classification of video data. Robust shot detection method should overcome the disturbances caused by pixel brightness and object movement between frames. In this paper, two shot boundary detection methods are presented to address these problem by using segmentation, object movement, and pixel brightness. The first method is based on the histogram that reflects object movements and the morphological dilation operation that considers pixel brightness. The second method uses the pixel brightness information of segmented and whole blocks between frames. Experiments on digitized video data of National Archive of Korea show that the proposed methods outperforms the existing pixel-based and histogram-based methods.

비디오 데이터를 효율적으로 검색, 정렬, 탐색, 분류하기 위해서는 프레임 간의 샷 전환 탐지가 선행되어야 한다. 프레임 간 화소 밝기와 객체 이동은 높은 탐지율을 보장하는 샷 탐지 알고리즘이 극복해야할 문제이다. 본 논문에서는 프레임의 블록화 및 객체의 이동과 프레임의 밝기를 고려하는 샷 탐지 방법을 제안한다. 먼저 연속하는 두 프레임 사이에서 발생할 수 있는 객체의 이동을 고려하여 계산된 히스토그램과 밝기 차이를 반영하는 모폴러지 팽창 연산을 이용하는 알고리즘을 제안한다. 다음으로 화소 밝기 차를 보상한 프레임 블록의 화소정보와 프레임의 전역적인 밝기 히스토그램의 변화를 함께 이용하는 샷 탐지 방법을 제안한다. 제안된 방법들은 국가기록원 소장 비디오 데이터에 대한 실험에서 화소 또는 히스토그램 기반 알고리즘에 비해 높은 샷 탐지율을 보였다.

Keywords

References

  1. Jinhui Yuan, Huiyi Wang, Lan Xian, Wujie Zheng, Jianmin Li, Fuzong Li, Bo Zhang, "A Formal Study of Shot Boundary Detection," IEEE Trans. on Circuits and Systems for Video Technology, Vol. 17, No. 2, pp. 168-186, Feb. 2007 https://doi.org/10.1109/TCSVT.2006.888023
  2. H. J. Jhang, A. Kankanhalli, S. W. Smoliar, "Automatic Partitioning of Full-Motion Video," Multimedia Systems, Vol. 1, No. 1, pp. 10-28, June 1993. https://doi.org/10.1007/BF01210504
  3. Xiaoquan Yi, Nam Ling, "Fast Pixel-Based Video Scene Change Detection," IEEE Int. Symposium on Circuits and Systems, Vol. 4, pp. 3443-3446, May 2005.
  4. A. Nagasaka, Y. Tanaka, "Automatic Video Indexing and Full-Video Search for Object Appearances," IFIP Proceeding of Visual Database Systems, pp. 113-127, 1992.
  5. Young-Wook Han, Seong-Il Cheong, Seong-Jae Kim, Si-Young Lee, Sung-Ho Kim, "Improving Histogram Scene Change Detection Method Using Motion Vector," Proceedings of Fall Conf. on Korean Institute of Information Scientists and Engineers(KIISE-1999), Vol. 26, No. 2, pp. 410-412, 1999.
  6. B. H. Shekar, Holla K. Raghurama, Kumari M. Sharmila, "Video Cut Detection Using Chromaticity Histogram," Int. Journal of Machine Intelligence, Vol. 3, No. 4, pp. 371-375, Dec. 2011.
  7. Z. Cernekova, C. Kotropoulos, I. Pitas, "Video Shot Segmentation Using Singular Value Decomposition," Proc. 2003 IEEE Int. Conf. Multimedia and Expo, Baltimore, Maryland, Vol. 2, pp. 301-304, July 2003.
  8. Priyadarshinee Adhikari, Neeta Gargote, Jyothi Digge, B. G. Hogade, "Abrupt Scene Change Detection," World Academy of Science, Engineering and Technology 42 2008.
  9. R. Zabih, J. Miller, K. Mai, "A Feature-based Algorithm for Detecting and Classification Production effects," ACM Multimedia System, Vol. 7, No. 1, pp. 119-128, March 1999. https://doi.org/10.1007/s005300050115
  10. Robert A. Joyce, "Temporal Segmentation of Video using Frame and Histogram-Space," IEEE Trans. on Multimedia, Vol. 8, No. 1, pp. 130-140, Feb. 2006. https://doi.org/10.1109/TMM.2005.861285
  11. In-Shik Jeong, Oh-Jin Kwon, "Video Shot Boundary Detection using Relative Difference between Frames," Optical Engineering, Vol. 42, No. 3, pp. 604-605, March 2003. https://doi.org/10.1117/1.1547771
  12. Matsumoto, Kazunori, "SVM-Based Shot Boundary Detection with a Novel Feature," IEEE Int. Conf. on Multimedia and Expo, pp. 1837-1840, July 2006.
  13. Shin S. Y., Baik S. E., Pyo S. B., Rhee Y. W., "Scene Change Detection Using Local $\chi^{2}$," Journal of The Korean Society of Computer and Information, Vol. 15, No. 1, pp. 203-207, 2007 June.