• Proceedings of the Korea Information Processing Society Conference
• /
• 2003.11c
• /
• pp.1403-1406
• /
• 2003

XML이 가지는 다양한 장점을 이용하기 위해, 음악을 XML로 표현하려는 다양한 연구가 계속되고 있다. 그러나, SMDL, MNML, MusicXML과 같은 기존의 연구는 악보상의 정보를 그대로 표현하거나, 전자 음악의 표준인 MIDI 포맷과의 상호교환성을 중심으로 연구되어 왔기 때문에 음악에 대해 구조-내용 기반 복합 검색을 하기에는 부적합하다. 이를 해결하기 위해 본 논문에서는 음악의 대표 선율을 이용한 구조-내용 기반 복합 검색을 위한 XML 스키마를 제안한다. 먼저, 본 논문에서는 사용자가 질의할 가능성이 높은 첫 동기, 절정, 일정 유사도 내에서 반복되는 주제 선율을 해당 음악을 대표하는 선율로서 XML 스키마에 표현하였다. 제안한 XML 스키마에 대해 XML 질의 언어를 이용하여 구조-내용 기반 복합 검색시 전체 선율을 검색하지 않고 대표 선율만을 검색하여 사용자의 응답 시간을 빠르게 할 수 있다.

• The KIPS Transactions:PartD
• /
• v.11D no.3
• /
• pp.495-508
• /
• 2004

Recently, in content-based music information retrieval systems, to enhance the response time of retrieving music data from large music database, some researches have adopted the indexing mechanism that extracts and indexes the representative melodies. The representative melody of music data must stand for the music itself and have strong possibility to use as users' input queries. However, since the previous researches have not considered the musical composition forms, they are not able to correctly catch the contrast, repetition and variation of motif in musical forms. In this paper, we use an index automatically constructed from representative melodies such like first melody, climax melodies and similarly repeated theme melodies. At first, we expand the clustering algorithm in order to extract similarly repeated theme melodies based on the musical composition forms. If the first melody and climax melodies are not included into the representative melodies of music by the clustering algorithm, we add them into representative melodies. We implemented a prototype system and did experiments on comparison the representative melody index with other melody indexes. Since, we are able to construct the representative melody index with the lower storage by 34％ than whole melody index, the response time can be decreased. Also, since we include first melody and climax melody which have the strong possibility to use as users' input query into representative melodies, we are able to get the more correct results against the various users' input queries than theme melody index with the cost of storage overhead of 20％.

• Journal of KIISE:Software and Applications
• /
• v.34 no.12
• /
• pp.1037-1044
• /
• 2007

Recently, we extract the representative melody of the music and index the music to reduce searching time at the content-based music retrieval system. The existing study has used MIDI data to extract a representative melody but it has a weak point that can use only MIDI data. Therefore, this paper proposes a representative melody retrieval method that can be use at all audio file format and uses digital signal processing. First, we use Fast Fourier Transform (FFT) and find the tempo and node for the representative melody retrieval. And we measure the frequency of high value that appears from PCM Data of each node. The point which the high value is gathering most is the starting point of a representative melody and an eight node from the starting point is a representative melody section of the audio data. To verity the performance of the method, we chose a thousand of the song and did the experiment to extract a representative melody from the song. In result, the accuracy of the extractive representative melody was 79.5% among the 737 songs which was found tempo.

• The KIPS Transactions:PartD
• /
• v.10D no.3
• /
• pp.547-558
• /
• 2003

From the viewpoint of that music melody has the similar features to time-series data, music melody is transformed to a time-series data with normalization and corrections and the similarity between melodies is defined as the Euclidean distance between the transformed time-series data. Then, based the similarity between melodies of a music object, melodies are clustered and the representative of each cluster is extracted as one of theme melodies for the music. To construct the theme melody index, a theme melody is represented as a point of the multidimensional metric space of M-tree. For retrieval of user's query melody, the query melody is also transformed into a time-series data by the same way of indexing phase. To retrieve the similar melodies to the query melody given by user from the theme melody index the range query search algorithm is used. By the implementation of the prototype system using the proposed theme melody index we show the effectiveness of the proposed methods.

• Journal of KIISE:Databases
• /
• v.30 no.5
• /
• pp.507-520
• /
• 2003

In this paper, an automatic construction method of theme melody index for large music database and an associative content-based music retrieval mechanism in which the constructed theme melody index is mainly used to improve the users' response time are proposed. First, the system automatically extracted the theme melody from a music file by the graphical clustering algorithm based on the similarities between motifs of the music. To place an extracted theme melody into the metric space of M-tree, we chose the average length variation and the average pitch variation of the theme melody as the major features. Moreover, we added the pitch signature and length signature which summarize the pitch variation pattern and the length variation pattern of a theme melody, respectively, to increase the precision of retrieval results. We also proposed the associative content-based music retrieval mechanism in which the k-nearest neighborhood searching and the range searching algorithms of M-tree are used to select the similar melodies to user's query melody from the theme melody index. To improve the users' satisfaction, the proposed retrieval mechanism includes ranking and user's relevance feedback functions. Also, we implemented the proposed mechanisms as the essential components of content-based music retrieval systems to verify the usefulness.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.10b
• /
• pp.229-231
• /
• 2004

내용 기반 음악 검색 시스템은 사용자가 원하는 음악에 대해 사전 정보를 모르더라도 곡의 일부로 질의를 함으로써 원하는 결과를 얻을 수 있게 한다. 그러나 내용 기반 음악 검색 시스템은 사용자의 질의에 대해 결과에 대한 순위만을 제공할 뿐 사용자의 취향이나 선호도와 같은 개인 정보를 고려하지 않기 때문에 사용자가 충분히 만족할만한 정보를 제공받지 못해 사용자의 만족도가 떨어진다. 이를 해결하기 위해 본 논문에서는 대표 선율을 이용하여 유사한 곡들로 클러스터링을 수행하고 내용 기반 검색 시 질의가 속하는 클러스터를 찾고 해당 클러스터 안에서 거리함수를 통해 질의와 유사한 곡들을 선별한다. 선별된 곡들과 사용자의 프로파일을 통해 음악 취향을 고려할 수 있는 내용 기반음악 필터링 기법을 적용하여 사용자의 만족을 증가시키는 결과를 제공한다.

• Proceedings of the Korea Contents Association Conference
• /
• 2008.05a
• /
• pp.43-48
• /
• 2008

And this study intends to discuss especially the one using emotional filter among various information processing methods. The existing music recommendation service on the web has a weak point that it makes the user feel bored by recommending songs only with similar feeling of the same genre, because music is classified by tune, melody, atmosphere and genre before recommendation. The service using emotion filter, suggested in this study, recommends the song and lyrics appropriate to the current emotional state of the user by abstracting emotional words that could reflect the sensitivity of human and then search the words within lyrics to match in order to overcome the weak point of the existing service. This study starts where the current emotional status for the user is being input. As for the range to choose, there are the seven representatives of emotion which are, love, separation, joy, sorrow-gloom, happiness-lonesome, and anger. As the service receives input of user's emotion, it matches the emotional words appropriate for the emotion input with the lyrics, and ranks the lyrics in the order of priority, so that it recommends the song and it lyrics to the user.