Browse > Article

Contents Analysis and Synthesis Scheme for Music Album Cover Art  

Moon, Dae-Jin (School of Electrical Engineering, Korea University)
Rho, Seung-Min (School of Electrical Engineering, Korea University)
Hwang, Een-Jun (School of Electrical Engineering, Korea University)
Publication Information
Journal of IKEEE / v.14, no.4, 2010 , pp. 305-311 More about this Journal
Abstract
Most recent web search engines perform effective keyword-based multimedia contents retrieval by investigating keywords associated with multimedia contents on the Web and comparing them with query keywords. On the other hand, most music and compilation albums provide professional artwork as cover art that will be displayed when the music is played. If the cover art is not available, then the music player just displays some dummy or random images, but this has been a source of dissatisfaction. In this paper, in order to automatically create cover art that is matched with music contents, we propose a music album cover art creation scheme based on music contents analysis and result synthesis. We first (i) analyze music contents and their lyrics and extract representative keywords, (ii) expand the keywords using WordNet and generate various queries, (iii) retrieve related images from the Web using those queries, and finally (iv) synthesize them according to the user preference for album cover art. To show the effectiveness of our scheme, we developed a prototype system and reported some results.
Keywords
album cover art; music mood; keyword extraction; wordnet; content-based retrieval;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D. Yang, and W. Lee: "Disambiguating music Emotion Using Software Agents," In Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR'04), 2004.
2 Yajie Hu, Xiaoou Chen and Deshun Yang, "Lyric-based song emotion detection with affective lexicon and fuzzy clustering method," 10th International Society for Music Information Retrieval Conference (ISMIR 2009), 2009
3 X. Hu, et al., "Lyrics text mining in music mood classification," ISMIR 2009, pp.411-416, Oct. 2009
4 Byeong-jun Han, Seungmin Rho, Roger B. Dannenberg, Eenjun Hwang, "SMERS: Music emotion recognition using support vector regression," ISMIR 2009, pp.651-656, Oct. 2009
5 stopwords, http://en.wikipedia.org/wiki/Stop_words/
6 WordNet, http://wordnet.princeton.edu/
7 Flickr API, http://www.flickr.com/services/api/
8 Google API, http://code.google.com
9 A. Ghias, et al., "Query by humming - musical information retrieval in an audio database", in Proceedings of ACM Multimedia 95, 1995,pp.231-236
10 Hoashi, Zeitler, Inoue, "Implementation of relevance feedback for content-based music retrieval based on user preferences", ACM SIGIR 2002, pp.385-286, 2002
11 Hoashi, Matsumoto, Inoue, "Personalization of user profiles for content-based music retrieval based on relevance feedback", ACM Multimedia 2003, pp.110-119, 2003
12 Lie Lu, Dan Liu, Hong-Jiang Zhang, "Automatic Mood Detection and Tracking of Music Audio Signals", IEEE Transactions on Audio, Speech and Audio Processing, vol.14, no.1, Jan.2006, pp. 5-18   DOI
13 J. A. Russell, "A Circumplex Model of Affect," Journal of Personality and Social Psychology, Vol. 39, 1980
14 Yazhong F,Yueting Z, Yunhe P, "Music information retrieval by detecting mood via computational media aesthetics", IEEE/WIC International Conference on, pp235-241, Oct. 2003
15 R. E. Thayer: "The Biopsychology of Mood and Arousal," NewYork: Oxford University Press, 1989
16 P.N. Juslin and J.A. Sloboda: "Music and Emotion: Theory and research," Oxford Univ. Press, 2001
17 ID3, http://en.wikipedia.org/wiki/ID3/
18 Smola, Alex J., et al., "A tutorial on support vector regression," Statistics and computing, vol. 14, pp.199-222, 2004   DOI
19 M. F. Porter, "An algorithm for suffix stripping", Program, 14(3):130-137, 1980   DOI
20 Google, http://www.google.com/
21 Flickr, http://www.flickr.com/
22 J. H. Kim, B. Tomasik, D. Turnbull, "Using artist similarity to propagate semantic information," 10th International society for music information retrieval conference (ISMIR 2009), pp.375-380, Oct. 2009
23 R. Mayer, R. Neumayer, and A. Rauber, "Rhyme and style features for musical genre categorisation by song lyrics," ISMIR 2008 pp.337-342, 2008