Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Adaptive Shot Change Detection Technique Using Histogram Mean within Extension Sliding Window and Its Implementation on Portable Multimedia Player

확장 참조 구간의 히스토그램 평균값을 이용한 적응적인 장면 전환 검출 기법과 휴대용 멀티미디어 재생기에서의 구현

  • Kim, Won-Hee (Department of Computer Engineering, PuKyong National University) ;
  • Cho, Gyeong-Yeon (Department of Computer Engineering, PuKyong National University) ;
  • Kim, Jong-Nam (Department of Computer Engineering, PuKyong National University)
  • 김원희 (부경대학교 컴퓨터공학과) ;
  • 조경연 (부경대학교 컴퓨터공학과) ;
  • 김종남 (부경대학교 컴퓨터공학과)
  • Published : 2009.07.25
Download PDF
⟨ Previous Next ⟩

Abstract

A shot change detection technique is an important technique for effective management of video data, thus it requires an adaptive algorithm for various video sequences to detect an accurate shot change frames. In this paper, we propose an adaptive shot change detection algorithm using histogram mean of frames within extension sliding window. Our algorithm calculates a frame feature value using histogram and defines an adaptive threshold using an average of histogram mean of frames within the extension sliding window and determines a shot change by comparing the feature value and the threshold. We obtained better detection rate than the conventional methods maximally by 15% in the experiment with the same test sequence. We verified real-time operation of shot change detection in the hardware platform with low performance by implementing it on TVUS HM-900 PLUS model of Homecast. The Proposed algorithm can be useful in the hardware platform such as portable multimedia player(PMP) or cellular phone with low CPU performance.

장면 전환 검출 기술은 대용량 비디오 데이터의 효율적인 관리를 위한 주요 기술로서, 다양한 비디오 데이터에 적용하기 위한 적응적인 검출 알고리즘이 요구된다. 본 논문에서는 확장 참조 구간 동안의 프레임들의 히스토그램 평균값을 이용한 적응적인 장면 전환 검출 알고리즘을 제안한다. 제안하는 방법은 히스토그램을 이용해서 프레임들의 특징값을 계산하고, 확장 참조 구간 동안의 프레임들의 히스토그램 평균값을 이용해서 임계값을 정의하여 특징값과 임계값의 비교를 통해서 장면 전환 발생 여부를 판단한다. 동일한 비디오 데이터를 사용한 실험을 통해서 제안하는 방법이 기존의 방법들보다 검출 정확도에서 최대 15% 이상 향상되었음을 확인하였다. Homecast사의 TVUS HM-900 PLUS 모델의 휴대용 멀티미디어 재생기에서 제안하는 방법을 구현하여 PC보다 성능이 낮은 하드웨어 플랫폼에서도 실시간으로 장면 전환 검출이 동작하는 것을 확인하였다. 본 논문에서 제안하는 방법은 휴대용 미디어 재생 장치나 휴대 전화 등 비교적 낮은 하드웨어 플랫폼에서 유용하게 사용될 수 있다.

Keywords

References

  1. C. Cotsaces, N. Nikolaidis, and I. Pitas, 'Video shot detection and condensed representation,' IEEE Signal Processing Magazine, Vol. 23, pp. 28-37, 2006 https://doi.org/10.1109/MSP.2006.1621446
  2. S. W. Smoliar and H. J. Zhang, 'Content-based video indexing and retrieval,' IEEE Multimedia, Vol. 1, No. 2, pp. 62-72, 2006 https://doi.org/10.1109/93.311653
  3. J. Yu and M. D. Srinath, 'An efficient method for scene cut detection,' Pattern Recognition Letters, Vol. 22, pp. 1379-1391, 2001 https://doi.org/10.1016/S0167-8655(01)00085-X
  4. J. Bescos, G. Cisneros, J. M. Menendez, and J. Cabrera, 'A unified model for techniques on video-shot transition detection,' IEEE transaction on Multimedia, Vol. 7, pp. 293-307, 2005 https://doi.org/10.1109/TMM.2004.840598
  5. U. Gargi, R. Kasturi, and S. H. Strayer, 'Performance characterization of video-shot- change detection methods,' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 1, pp. 1-13, 2000 https://doi.org/10.1109/76.825852
  6. H. J. Zhang, A. Kankamhalli, and S. W. Smoliar, Automatic partitioning of full-motion video, ACM Multimedia Systems, New York, 1993
  7. A. Hampapur, R. Jain, and T. Weymouth, "Digital video segmentation," Proc. ACM Multimedia 94, pp. 357-364, 1994 https://doi.org/10.1145/192593.192699
  8. B. Shahraray, 'Scene change detection and content-based sampling of video sequences,' Proc. in Digital Video Compression: Algorithms and Technologies, Vol. SPIE-2419, pp. 2-13, 1995 https://doi.org/10.1117/12.206348
  9. J. C. M. Lee, Q. Li, and W. Xiong, 'Automotive and dynamic video manipulation,' Research and Development in Information Retrieval, 1998.
  10. Y. Tonomura, 'Video handing based on structured information for hypermedia system,' Proc. ACM International Conference Multimedia Information Systems, pp. 333-344, 1991
  11. A. Nagasaka and Y. Tanaka, 'Automatic video indexing and full video search for object appearances,' Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II, pp. 113-127, 1991
  12. H. Ueda, T. Miyatake, and S. Yoshizawa, 'ImPACT: An interactive natural-motion-picture dedicated multimedia authoring system,' in Proceedings of CHI, pp. 343-350, 1991
  13. U. Gargi, R. Kasturi, and S. Antani, 'Evaluation of video sequence indexing and hierarchical video indexing,' in Proc. SPIE Conf. Storage and Retrieval in Image and Video Databases, pp. 1522-1530, 1995
  14. S. Y. Shin, G. R. Sheng, and K. H. Park, 'A scene change detection scheme using local x2-test on telematics,' International Conference on Hybrid Information Technology, Vol. 1, pp. 588-592, 2006 https://doi.org/10.1109/ICHIT.2006.253550
  15. J. Meng, Y. Juan, and S. F. Chang, 'Scene change detection in a MPEG compressed video sequence,' Digital Video Compression: Algorithms and Technologies, Vol. SPIE-2419, pp. 14-25, 1995
  16. B. Yeo and B. Liu, 'Rapid scene analysis on compressed video,' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 5, No. 6, pp. 533-540, 1995 https://doi.org/10.1109/76.475896
  17. W. A. C. Fernando, C. N. Canagarajah, and D. R. Bull, 'Scene change detection algorithms for content-based video indexing and retrieval,' Electronics and Communication Journal, Vol. 13, No. 3, pp. 117-126, 2001 https://doi.org/10.1049/ecej:20010302
  18. Y. K. Seong, Y. Choi, J. Park, and T. Choi, 'A hard disk drive embedded digital satellite receiver with scene change detector for video indexing,' IEEE Transactions on Consumer Electronics, Vol. 48, No. 3, pp. 776-782, 2002 https://doi.org/10.1109/TCE.2002.1037074
  19. I. K. Sethi and N. Patal, 'A statistical approach to scene change detection,' Storage and Retrieval for Image and Video Databases III, Vol. SPIE-2420, pp. 329-338, 1995
  20. J. R. Kim, S. J. Suh, and S. H. Sull, 'Fast scene change detection for personal video recorder,' IEEE Transaction on Consumer Electronics, Vol. 49, pp. 683-688, 2003 https://doi.org/10.1109/TCE.2003.1233802
  21. M. Zhi and A. N. Cai, 'Shot change detection with adaptive thresholds,' VLSI Design and Video Technology 2005 IEEE International Workshop on, pp. 147-149, 2005
  22. T. Lu and P.N. Suganthan, 'An adaptive cumulation algorithm for video shot detection," Intelligent Multimedia, Video and Speech Processing 2001 International Symposium on, pp. 296-299, 2001
  23. H. Li, G. Liu, Z. Zhang, and Y. Li, "Adaptive scene-detection algorithm for VBR video stream," Multimedia IEEE Transactions on, Vol. 6, pp. 624-633, 2004 https://doi.org/10.1109/TMM.2004.830812
  24. S. K. Lee and M. H. Hayes, 'Scene change detection using adaptive threshold and sub-macroblock images in compressed seqeunces,' ICME 2001 IEEE International Conference on, pp. 52-55, 2001
  25. Y. Cheng, X. Yang, and D. Xu, 'A method for shot boundary detection with automatic threshold,' Proceedings of IEEE TENCON, Vol. 1, pp. 582-585, 2002
  26. K. C. Ko and Y. W. Rhee, 'Video segmentation using the automated threshold decision algorithm,' KSCI Journal, Vol. 10, No. 6, pp. 65-73, 2005
  27. G. Boccignone, A. Chinaese, V. Moscato, and A. Picariello, 'Foveated shot detection for video segmentation,' IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, pp. 365-377, 2005 https://doi.org/10.1109/TCSVT.2004.842603