Journal of IKEEE (전기전자학회논문지)

Institute of Korean Electrical and Electronics Engineers (한국전기전자학회)
권호 표지

Contents Analysis and Synthesis Scheme for Music Album Cover Art

  • Received : 2010.12.03
  • Accepted : 2010.12.29
  • Published : 2010.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

Most recent web search engines perform effective keyword-based multimedia contents retrieval by investigating keywords associated with multimedia contents on the Web and comparing them with query keywords. On the other hand, most music and compilation albums provide professional artwork as cover art that will be displayed when the music is played. If the cover art is not available, then the music player just displays some dummy or random images, but this has been a source of dissatisfaction. In this paper, in order to automatically create cover art that is matched with music contents, we propose a music album cover art creation scheme based on music contents analysis and result synthesis. We first (i) analyze music contents and their lyrics and extract representative keywords, (ii) expand the keywords using WordNet and generate various queries, (iii) retrieve related images from the Web using those queries, and finally (iv) synthesize them according to the user preference for album cover art. To show the effectiveness of our scheme, we developed a prototype system and reported some results.

Keywords

References

  1. Google, http://www.google.com/
  2. Flickr, http://www.flickr.com/
  3. J. H. Kim, B. Tomasik, D. Turnbull, "Using artist similarity to propagate semantic information," 10th International society for music information retrieval conference (ISMIR 2009), pp.375-380, Oct. 2009
  4. R. Mayer, R. Neumayer, and A. Rauber, "Rhyme and style features for musical genre categorisation by song lyrics," ISMIR 2008 pp.337-342, 2008
  5. X. Hu, et al., "Lyrics text mining in music mood classification," ISMIR 2009, pp.411-416, Oct. 2009
  6. Byeong-jun Han, Seungmin Rho, Roger B. Dannenberg, Eenjun Hwang, "SMERS: Music emotion recognition using support vector regression," ISMIR 2009, pp.651-656, Oct. 2009
  7. stopwords, http://en.wikipedia.org/wiki/Stop_words/
  8. WordNet, http://wordnet.princeton.edu/
  9. Flickr API, http://www.flickr.com/services/api/
  10. Google API, http://code.google.com
  11. A. Ghias, et al., "Query by humming - musical information retrieval in an audio database", in Proceedings of ACM Multimedia 95, 1995,pp.231-236
  12. Hoashi, Zeitler, Inoue, "Implementation of relevance feedback for content-based music retrieval based on user preferences", ACM SIGIR 2002, pp.385-286, 2002
  13. Hoashi, Matsumoto, Inoue, "Personalization of user profiles for content-based music retrieval based on relevance feedback", ACM Multimedia 2003, pp.110-119, 2003
  14. Lie Lu, Dan Liu, Hong-Jiang Zhang, "Automatic Mood Detection and Tracking of Music Audio Signals", IEEE Transactions on Audio, Speech and Audio Processing, vol.14, no.1, Jan.2006, pp. 5-18 https://doi.org/10.1109/TSA.2005.860344
  15. Yazhong F,Yueting Z, Yunhe P, "Music information retrieval by detecting mood via computational media aesthetics", IEEE/WIC International Conference on, pp235-241, Oct. 2003
  16. R. E. Thayer: "The Biopsychology of Mood and Arousal," NewYork: Oxford University Press, 1989
  17. P.N. Juslin and J.A. Sloboda: "Music and Emotion: Theory and research," Oxford Univ. Press, 2001
  18. J. A. Russell, "A Circumplex Model of Affect," Journal of Personality and Social Psychology, Vol. 39, 1980
  19. ID3, http://en.wikipedia.org/wiki/ID3/
  20. Smola, Alex J., et al., "A tutorial on support vector regression," Statistics and computing, vol. 14, pp.199-222, 2004 https://doi.org/10.1023/B:STCO.0000035301.49549.88
  21. M. F. Porter, "An algorithm for suffix stripping", Program, 14(3):130-137, 1980 https://doi.org/10.1108/eb046814
  22. D. Yang, and W. Lee: "Disambiguating music Emotion Using Software Agents," In Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR'04), 2004.
  23. Yajie Hu, Xiaoou Chen and Deshun Yang, "Lyric-based song emotion detection with affective lexicon and fuzzy clustering method," 10th International Society for Music Information Retrieval Conference (ISMIR 2009), 2009