DOI QR코드

DOI QR Code

A shot change detection algorithm based on frame segmentation and object movement

프레임 블록화와 객체의 이동을 이용한 샷 전환 탐지 알고리즘

  • Kim, Seung-Hyun (Dept. of Computer Science, Dankook University) ;
  • Hwang, Doosung (Dept. of Kinesiologic Medical Science & Computer Science, Dankook University)
  • 김승현 (단국대학교 컴퓨터과학과) ;
  • 황두성 (단국대학교 운동의과학과)
  • Received : 2015.04.04
  • Accepted : 2015.04.28
  • Published : 2015.05.30

Abstract

This paper proposes a shot change detection algorithm by using frame segmentation and the object changes among moving blocks. In order to detect the rapid moving changes of objects between two consecutive frames, the moving blocks on the diagonal are defined, and their histograms are calculated. When a block of the current frame is compared to the moving blocks of the next frame, the block histograms are used and the threshold of a shot change detection is automatically adjusted by Otsu's threshold method. The proposed algorithm was tested for the various types of color or gray videos such as films, dramas, animations, and video tapes in National Archives of Korea. The experimental results showed that the proposed algorithm could enhance the detection rate when compared to the studied methods that use brightness, histogram, or segmentation.

본 논문에서는 프레임 블록화와 이동블록 간 객체 이동을 이용한 샷 전환 탐지 알고리즘을 제안한다. 객체의 급격한 이동을 탐지하기 위해 연속 프레임의 현재 블록의 대각선상에 위치한 이동 블록을 정의하고 블록 히스토그램을 비교한다. 제안 방법은 두 연속 프레임 내 블록 간 객체 이동 여부를 검사하며, 객체 이동 블록 정보를 가지고 프레임 간 샷 전환 탐지를 예측한다. 현재 프레임의 블록이 다음 프레임의 이동 블록과 비교 시, 블록 히스토그램이 사용되며 샷 전환 임계값은 Otsu 임계값 방법을 이용하여 자동으로 선정한다. 제안 방법은 영화, 드라마, 애니메이션, 국가기록원 소장 영상 등과 같이 다양한 흑백 또는 칼라 영상에 대해 테스트되었다. 실험결과 제안하는 방법은 기존의 알고리즘과 비교 시 탐지율을 높일 수 있었다.

Keywords

References

  1. H. J. Zhang, A. Kankanhalli, S. W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Systems, Vol. 1, No. 1, pp. 10-28, 1993. https://doi.org/10.1007/BF01210504
  2. Xiaoquan Yi, Nam Ling, "Fast Pixel-Based Video Scene Change Detection," IEEE Int. Symposium on circuits and Systems, Vol. 4, pp. 3343-3346, May 2005.
  3. S. Y. Tak, S. Yoo, B. R. Lee, W. J. Lee, K. S. Ryu, T. G. Kim, H. C. Kang, "Scene change detection of various color space using difference of histogram," Proceedings of the Spring Conf. on The Korea Contents Association, pp. 466-468, May 2010.
  4. S. J. Kang, S. I. Cho, S. J. Yoo, Y. H. Kim, "Scene Change Detection Using Multiple Histograms for Motion-Compensated Frame Rate Up-Conversion," Journal of Display Technology, Vol. 8, No. 3, pp. 121-126, March 2012. https://doi.org/10.1109/JDT.2011.2167740
  5. S. G. Hong, B. K. Cho, Y. S. Choe, "Adaptive Thresholding for Scene Change Detection," IEEE Third Int. Conf. on Consumer Electronics - Berlin, pp. 75-78, Sept. 2013.
  6. S. Y. Shin, S. E. Baik, S. B. Pyo, Y. W. Rhee, "Scene Change Detection Using Local $x^2$," Journal of The Korea Society of Computer and Information, Vol. 15, No. 1, pp. 203-207, June 2007.
  7. J. K. Jin, J. H. Cho, J. H. Jeong, D. S. jeong, "Fast Scene Change Detection Using Macro Block Information and Spatio-temporal Histogram," Journal of The Institute of Electronics Engineers of Korea, Vol. 48-SP, No. 1, pp. 141-148, Jan. 2011.
  8. J. G. Lee, K. S. Han, B. M. Yoo, D. S. Hwang, "Shot Boundary Detection Algorithm by compensating Pixel Brightness and Object Movement," Journal of The Korea Society of Computer and Information, Vol. 18, No. 5, pp. 35-42, May 2013. https://doi.org/10.9708/jksci.2013.18.5.035
  9. S. M. Go, H. G. Kim, M. S. Oh, "A Study on block histogram's comparison for cut detection," Journal of The Korean Institute of Maritime Information and Communication Sciences, Vol. 5, No. 7, pp. 1301-1307, Dec. 2001.
  10. J. R. Parker, "Algorithms for Image Processing and computer vision 2nd Edition," wiley publishing, pp. 149-151, 2011.
  11. Puneet, Naresh Kumar Garg, "Binarization Techniques used for Grey Scale Images," International Journal of Computer Applications, Vol. 71, No. 1, pp. 8-11, June 2013. https://doi.org/10.5120/12320-8533