Browse > Article

Automatic Music Summarization Using Vector Quantization and Segment Similarity  

Kim, Sang-Ho (The School of Engineering at Information and Communications University)
Kim, Sung-Tak (The School of Engineering at Information and Communications University)
Kim, Hoi-Rin (The School of Engineering at Information and Communications University)
Abstract
In this paper, we propose an effective method for music summarization which automatically extracts a representative part of the music by using signal processing technology. Proposed method uses a vector quantization technique to extract several segments which can be regarded as the most important contents in the music. In general, there is a repetitive pattern in music, and human usually recognizes the most important or catchy tune from the repetitive pattern. Thus the repetition which is extracted using segment similarity is considered to express a music summary. The segments extracted are again combined to generate a complete music summary. Experiments show the proposed method captures the main theme of the music more effectively than conventional methods. The experimental results also show that the proposed method could be used for real-time application since the processing time in generating music summary is much faster than other methods.
Keywords
Music summarization; Repetitive pattern; Segment similarity; Vector quantization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Cooper and J. Foote, "Automatic Music Summarization via Similarity Analysis, Proc. " IRCAM, 81-85, Oct. 2002
2 J. Foote, "Automatic Audio Segmentation using a Measure of Audio Novelty," In Proceedings of IEEE International Conference on Multimedia and Expo, I, 452-455
3 B. Logan, and S. Chu,"Music summarization using key phrases," In Proc. IEEE ICASSP. 2000
4 N. Maddage, X. Changsheng, M. Kankanhalli, and X. Shao. "Content -based music structure analysis with applications to music semantics understanding," In 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, October 2004
5 J. Foote, "Visualizing Music and Audio using Self- Similarity," Proc. ACM Multimedia Conference, 77-80, Orlando, Florida, November 1999
6 International Federation of the Phonographic Industry (IFPI), 2005 Digital Music Report
7 L. Lu, M. Wang and H. J. Zhang, "Repeating Pattern Discovery and Structure Analysis from Acoustic Music Data," Workshop on Multimedia InformationRetrieval 2004, in conjuction with ACM Multimedia 2004, Oct 15-16,2004, New York, NY,2004
8 W. Chai,"Semantic segmentation and summarization of music," IEEE signal processing magazine, March 2006
9 M. Cooper and J. Foote, Summarizing " popular music via structural similarity analysis," IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, October, 2003
10 G. Peeters, A. L. Burthe and X. Rodet, "Toward Automatic Music Audio Summary Generation from Signal Analysis," Proc. ISMIR, Paris, 2002
11 Sangho Kim, Sungtak Kim, Suk-bong Kwon, and Hoirin Kim, "A Music summarization scheme using tempo tracking and two stage clustering," IEEE workshop on Multimedia Signal Processing 2006, Vol. 1, pp 225-228, Victoria, Canada, October 4, 2006
12 X. Shao, N. C. Maddage, C. Xu and M. S. Kankanhalli, "Automatic Music Summarization Based on Music Structure Analysis," In IEEE International Conf on Acoustics, Speech and Signal Processing (ICASSP05), Philadelphia, USA, 2005