Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지

Similar Movie Contents Retrieval Using Peak Features from Audio

오디오의 Peak 특징을 이용한 동일 영화 콘텐츠 검색

  • Published : 2009.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

Combing through entire video files for the purpose of recognizing and retrieving matching movies requires much time and memory space. Instead, most current similar movie-matching methods choose to analyze only a part of each movie's video-image information. Yet, these methods still share a critical problem of erroneously recognizing as being different matching videos that have been altered only in resolution or converted merely with a different codecs. This paper proposes an audio-information-based search algorithm by which similar movies can be identified. The proposed method prepares and searches through a database of movie's spectral peak information that remains relatively steady even with changes in the bit-rate, codecs, or sample-rate. The method showed a 92.1% search success rate, given a set of 1,000 video files whose audio-bit-rate had been altered or were purposefully written in a different codec.

검색을 위해 동영상 데이터 전체를 이용하면 많은 시간과 저장 공간이 필요하다. 이를 보완하고자 기존의 동일 영화 검색은 영상 정보의 일부를 이용하여 동일한 영상 검색에 사용해 왔다. 그러나 이 방법은 같은 영상임에도 비디오 부호화기이나 해상도가 다른 경우 전혀 다른 영상으로 인식한다. 따라서 본 논문에서는 동영상의 오디오 정보를 이용하여 동일한 동영상을 찾는 알고리즘을 제안한다. 제안 방법은 부호화율, 부호화기, 샘플링 수의 변화에도 유사한 파형을 형성하는 Peak 정보를 바탕으로 데이터베이스에 색인하고, 검색한다. 논문에서는 제안 방법의 성능을 확인하기 위해 1,000개의 동영상 데이터를 검색 실험하였으며, 92.1%의 성공률을 나타내었다.

Keywords

References

  1. M.J. Swain and D.H. Ballard, "Color indexing," International Journal of Computer Vision, Vol.7, No.1, pp. 11-32, 1991. https://doi.org/10.1007/BF00130487
  2. L.M. Kaplan, R. Murenzi, and K.R. Namuduri, "Fast Texture Database Retrieval Using Extended Fractal Features," SPIE proc. Storage and Retrieval for Image and Video Database, Vol.3312, pp. 162-175, 1998.
  3. J. Huang, S.R. Kumar, M. Mitra, W.J. Zhu, and R. Zabih, "Image Indexing Using Color Corrlograms," IEEE Proc. Computer Vision and Pattern Recognition, pp. 744-749, 1997.
  4. R. Mehrotra and J.E. Gray, "Similar-shape Retrieval in Shape Data Management," IEEE Computer, Vol.28, No.9, pp. 57-62, 1995.
  5. B.S. Manjunath and W.Y. Ma, "Texture Features for Browsing and Retrieval of Image data," IEEE Trans. Pattern Analysis and Machine Intelligence, Vol.18, pp. 837-842, 1996. https://doi.org/10.1109/34.531803
  6. S.W. Smoliar and H.J. Zhang, "Content-based Video Indexing and Retrieval," IEEE Multimedia, Vol,1 pp. 62-72, 1994. https://doi.org/10.1109/93.311653
  7. W.A.C. Faernando, C.N. Canagarajah, and D.R. Bull, "Scene Change Detection Algorithms for Content-based Video Indexing and Retrieval," Electronics & Communication Engineering Journal, Vol.13, pp. 117-126, 2001. https://doi.org/10.1049/ecej:20010302
  8. J. Meng, Y. Juan, and S.F. Chang, "Scene Change Detection in a MPEG Compressed Video Sequence," IS&T/SPIE Symposium Proceeding, Vol.2419, pp. 14-25, 1995.
  9. M.F. McKinney and J. Breebaart, "Features for Audio and Music Classification," International Symposium on Music Information Retrieval, pp. 151-158, 2003.
  10. G. Tzanetakis and P. Cook, "Multifeature Audio Segmentation for Browsing and Annotation, "Workshop on Applications of Signal Processing to Audio and Acustics, pp. 103-106, 1999.
  11. G. Tzanetakis and P. Cook, "Musical Genre Classification of Audio Signal," IEEE Transactions on Speech and Audio Processing, Vol.10, No.5, pp. 293-302, 2002. https://doi.org/10.1109/TSA.2002.800560
  12. 정명범, 성보경, 고일주, "내용 기반 음악 검색의 문제점 해결을 위한 전처리" 한국 컴퓨터 정보학회지, Vol.12, pp. 97-104, 2007.
  13. F. Idris and S. Panchanathan, "Review of Image and Video Indexing Techniques," Journal of Visual Communication and Image Presentation, Vol.8, No.2, PP. 146-166, 1997. https://doi.org/10.1006/jvci.1997.0355
  14. G. Lupatini, C. Saraceno, and R. Leonardi, "Scene Break Detection: a Comparison," International Workshop on ContinuousMedia Databases and Application, pp. 34-41, 1998.
  15. Y. Yusoff, W. Christmas, and J. Kitter, "A Study on Automatic Shot Change Detection," European Conference on Multimedia Applications, No.1425, pp. 177-189, 1998.
  16. R. Zabih, J. Miller, and K. Mai, "A Feature-based Algorithm for Detecting and Classifying Scene Breaks," ACM Conference on Multimedia, pp. 189-200, 1995.
  17. M.A. Stricker and M. Orengo, "Similarity of Color Images," International Society for Optical Engineering, Vol.2420, pp. 381-392, 1995.
  18. Y. Yusoff, K. Kitter, and W. Christmas, "Combining Multiple Experts for Classifying Shot Changes in Video Sequences," IEEE International Conference on Multimedia Computing and Systems, Vol.2, pp, 700-704, 1999.
  19. 이훈철, 고윤호, 윤병주, 김성대, 유상조, "클러 스터링을 이용한 급격한 장면 전환 검출 기법" 대한전자공학회, 전자공학회논문지, Vol.38, pp. 114-122, 2001.
  20. M.R. Naphade, R. Mehrotra, A.M. Ferman, J. Warnick, T.S. Huang, and A.M. Tekalp, "A High-Performance Shot Boundary Detection Algorithm Using Multiple Cues," International Conference on Image Processing, Vol.1, pp. 4-7, 1998.
  21. R. Dugad, K. Ratakonda, and N. Ahuja, "Robust Video Shot Change Detection," IEEE Transactions on Multimedia Signal Processing, pp. 376-381, 1998.
  22. 김정수, 성보경, 구광효, 고일주, "최소파형모형 을 이용한 음악 시작점 검출 방법" 한국 컴퓨터 정보학회 하계학술발표 논문집, Vol.16, pp. 137-141, 2008.