Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

An Efficient Video Indexing Algorithm for Video Sequences with Abrupt Brightness Variation

급격한 밝기 변화가 있는 비디오 시퀀스에서 효율적인 비디오 색인 알고리즘

  • Published : 2004.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

With increase in digitalmedia data, various video indexing and video sequence matching algorithms have been proposed to efficiently manage and utilize digital media. In this paper, we propose a robust video indexing algorithm to detect scene changes for video sequences with abrupt luminance variations and an efficient video sequence matching algorithm for video sequence query. To improve the accuracy and to reduce the computational complexity for video indexing with abrupt luminance variations, the proposed algorithm utilizes edge features as well as color features, which yields a remarkably better performance than conventional algorithms. In the proposed algorithm first we extract the candidate shot boundaries using color histograms and then determine using edge matching and luminance compensation if they are shot boundaries or luminance changes. If the scene contains trivial brighness variations, the edge matching and luminance compensation are performed only for shot boundaries. In experimental results, the proposed method gives remarkably a high performance and efficiency than the conventional methods with the similar computational complexity.

디지털 미디어 데이터의 증가에 따라 디지털 미디어를 효과적으로 관리하고 사용하기 위하여 다양한 비디오 색인 및 비디오 시퀀스 정합 알고리즘이 제안되었다. 본 논문에서는 급격한 밝기 변화를 가지는 비디오 시퀀스에 대해서 효율적인 비디오 색인 알고리즘과 비디오 시퀀스 질의에 대한 비디오 시퀀스 정합 알고리즘을 제안한다. 급격한 밝기 변화를 고려한 비디오 색인의 정확도를 향상시키고 계산량을 줄이기 위해 제안한 알고리즘은 칼라 특성뿐만 아니라 에지 특성도 함께 사용하였으며 기존의 알고리즘에 비해 현저한 성능 향상을 보였다. 제안한 알고리즘은 먼저 칼라 히스토그램을 사용하여 후보 샷경계 지점을 추출하고 에지 정합과 밝기 보상을 이용하여 후보점들이 샷경계인지 밝기 변화인지를 결정한다 장면내의 밝기 변화가 작은 경우 에지 정합과 밝기 보상은 샷경계에서만 일어난다. 실험 결과 제안한 방법은 기존의 방법에 비해 비슷한 계산량으로 현저히 향상된 성능과 효율을 보였다.

Keywords

References

  1. N. D. Doulamis, A. D. Doulamis, Y. S. Avrithis, K. S. Ntalianis, and S. D. Kollias, 'Efficient summarization of stereoscopic video sequences,' IEEE Trans. Circuits and Systems for Video Technology, vol. CSVT-10, no. 4, pp. 501-517, June 2000 https://doi.org/10.1109/76.844996
  2. X. Gao and X. Tang, 'Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing,' IEEE Trans. Circuits and Systems for Video Tech., vol. 12, no. 9, pp. 765-776, Sep. 2002 https://doi.org/10.1109/TCSVT.2002.800510
  3. Nilesh V. Patel, Ishwar K. Sethi, 'Video Shot Detection and Characterization for Video Databases,' Pattern Recognition, Vol.30, No.4, pp.583-592, 1997 https://doi.org/10.1016/S0031-3203(96)00114-8
  4. V. Kobla, D. Doermann, and K. I. Lin, 'Archiving, indexing, and retrieval of video in compressed domain,' in Proc. SPIE Conf. Multimedia Storage and Archiving Systems, vol. 2916, pp. 78-89, Boston, MA, USA, Nov. 1996 https://doi.org/10.1117/12.257312
  5. J. Meng, Y. Juan, and S. F. Chang, 'Scene change detection in a MPEG compressed video sequence,' in Proc. SPIE Symposium Digital Video Compression: Algorithms and Technologies, vol. 2419, pp. 14-25, San Jose, CA, USA, Feb. 1995 https://doi.org/10.1117/12.206359
  6. C.-L. Huang and B.-Y. Liao, 'A robust scene change detection method for video segmentation,' IEEE Trans. Circuits and Systems for Video Technology, vol. CSVT-11, no. 12, pp. 1281-1288, Dec. 2001 https://doi.org/10.1109/76.974682
  7. B.-L. Yeo and B. Liu, 'Rapid scene analysis on compressed video,' IEEE Trans. Circuits and Systems for Video Technology, vol. CSVT-5, no. 6, pp. 533-544, Dec. 1995 https://doi.org/10.1109/76.475896
  8. W. J. Heng and K. N. Ngan, 'Post shot boundary detection technique: Flashlight scene determination,' in Proc. Fifth Int. Symposium on Signal Processing and Its Applications, pp. 447-450, Brisbane, Australia, Aug. 1999 https://doi.org/10.1109/ISSPA.1999.818208
  9. R. Brunelli, O. Mich, and C.Modena, 'A Survey of the Automatic Indexing of Video Date', Journal of Visual Communication and Image Representation, Vol.10, pp. 78-112,1999 https://doi.org/10.1006/jvci.1997.0404
  10. Ullas Gargi, Tangachar Kasturi, and Susan H. Srayer, 'Performance Characterization of Videl-Shot-Change Detection Methods', IEEE Trans. Circuits and Systems for Video Technology, pp.1-13, Vol. 10, No.1, 2000 https://doi.org/10.1109/76.825852
  11. J. Hafner, H.S. Sawhney, W. Equitz, M. Flickner, and W. Niblack, 'Efficient color histogram indexing for quadratic form distance functions,' IEEE Transactions on PAMI, vol. 17, num. 7, pp. 729-736, 1995 https://doi.org/10.1109/34.391417
  12. A. M. Ferman, A. M. Tekalp, and R. Mehrotra, 'Robust color histogram descriptors for video segment retrieval and identification,' IEEE Trans. Image Processing, vol. IP-11, no. 5, pp. 497-508, May 2002 https://doi.org/10.1109/TIP.2002.1006397
  13. S. H. Kim and R.-H. Park, 'A novel approach to scene change detection using a cross entropy,' in Proc. 2000 IEEE Int. Conf. Image Processing, vol. 3, pp. 937-940, Vancouver, Canada, Sept. 2000 https://doi.org/10.1109/ICIP.2000.899611
  14. J. Song and B.-L. Yeo, 'Fast extraction of spatially reduced image sequences from MPEG-2 compressed video,' IEEE Trans. Circuits and Systems for Video Technology, vol. CSVT-9, no. 7, pp. 1100-1114, Oct. 1999 https://doi.org/10.1109/76.795061
  15. S.-W. Lee, Y.-M. Kim, and S. W. Choi, 'Fast scene change detection using direct feature extraction from MPEG compressed videos,' IEEE Trans. Multimedia. vol. 2, no. 4, pp. 240-254, Dec. 2000 https://doi.org/10.1109/6046.890059
  16. R. Kasturi and R. C. Jain, Computer Vision: Principles. IEEE Computer Society Press, Los Alamitos, CA, 1991
  17. S. H. Kim and R.-H. Park, 'Robust video indexing for video sequences with complex brightness variations,' in Proc. IASTED Int. Conf. Signal and Image Processing, pp. 410-414, Kauai, HI, USA, Aug. 2002