Browse > Article
http://dx.doi.org/10.3745/JIPS.04.0032

Rough Set-Based Approach for Automatic Emotion Classification of Music  

Baniya, Babu Kaji (Dept. of Computer Science and Engineering, Chonbuk National University)
Lee, Joonwhoan (Dept. of Computer Science and Engineering, Chonbuk National University)
Publication Information
Journal of Information Processing Systems / v.13, no.2, 2017 , pp. 400-416 More about this Journal
Abstract
Music emotion is an important component in the field of music information retrieval and computational musicology. This paper proposes an approach for automatic emotion classification, based on rough set (RS) theory. In the proposed approach, four different sets of music features are extracted, representing dynamics, rhythm, spectral, and harmony. From the features, five different statistical parameters are considered as attributes, including up to the $4^{th}$ order central moments of each feature, and covariance components of mutual ones. The large number of attributes is controlled by RS-based approach, in which superfluous features are removed, to obtain indispensable ones. In addition, RS-based approach makes it possible to visualize which attributes play a significant role in the generated rules, and also determine the strength of each rule for classification. The experiments have been performed to find out which audio features and which of the different statistical parameters derived from them are important for emotion classification. Also, the resulting indispensable attributes and the usefulness of covariance components have been discussed. The overall classification accuracy with all statistical parameters has recorded comparatively better than currently existing methods on a pair of datasets.
Keywords
Attributes; Covariance; Discretize; Rough Set; Rules;
Citations & Related Records
연도 인용수 순위
  • Reference
1 R. Panda, R. Malheiro, B. Rocha, A. Oliveira, and R. P. Paiva, "Multi-modal music emotion recognition: a new dataset, methodology and comparative analysis," in Proceedings of 10th International Symposium on Computer Music Multidisciplinary Research (CMMR'2013), Marseille, France, 2013, pp. 1-13.
2 B. K. Baniya, D. Ghimire, and J. Lee, "Evaluation of different audio features for musical genre classification" in Proceedings of IEEE Workshop on Signal Processing Systems (SiPS), Taipei, Taiwan, 2013, pp. 260-265.
3 B. K. Baniya, J. Lee, and Z. N. Li, "Audio feature reduction and analysis for automatic music genre classification," in Proceedings of 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), San Diego, CA, 2004, pp. 457-462.
4 B. K. Baniya, D. Ghimire, and J. Lee, "Automatic music genre classification using timbral texture and rhythmic content features," in Proceedings of 17th International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea, 2015, pp. 434-443.
5 B. K. Baniya and C. S. Hong, "Music mood classification using reduced audio features," in Proceedings of Korea Computer Congress (KCC), Jeju, Korea, 2015, pp. 915-917.
6 ROSE2 (Rough Sets Data Explorer) [Online]. Available: http://idss.cs.put.poznan.pl/site/rose.html.
7 Soundtracks datasets for music and emotion [Online]. Available: www.jyu.fi/music/coe/materials/emotion/soundtracks.
8 MOODetector [Online]. Available: http://mir.dei.uc.pt/downloads.html.
9 P. Saari, T. Eerola, and O. Lartillot, "Generalizability and simplicity as criteria in feature selection: application to mood classification in music," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 6, pp. 1802-1812, 2011.   DOI
10 J. A. Russell, A. Weiss, and G. A. Mendelsohn, "Affect grid: a single-item scale of pleasure and arousal," Journal of Personality and Social Psychology, vol. 57, no. 3, pp. 493-502, 1989.   DOI
11 H. S. Nguyen, "Discretization of real value attributes: a Boolean reasoning approach," Ph.D. dissertation, Department of Mathematics, Warsaw University, Warsaw, Poland, 1997.
12 Z. Pawlak, "Rough set theory and its applications," Journal of Telecommunications and Information Technology, vol. 9, no. 3, pp. 7-10, 2002.
13 A. Papoulis and S. Unnikrishna Pillai, Probability, Random Variables, and Stochastic Processes. Boston, MA: McGraw-Hill, 2002.
14 Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data. Dordrecht: Kluwer Academic Publisher, 1991.
15 S. Dalai, B. Chatterjee, D. Dey, S. Chakravorti, and K. Bhattacharya, "Rough-set-based feature selection and classification for power quality sensing device employing correlation techniques," IEEE Sensors Journal, vol. 13, no. 2, pp. 563-573, 2013.   DOI
16 T. Li and M. Ogihara, "Content-based music similarity search and emotion detection," in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'04), Toulouse, France, 2004, pp. 705-708.
17 Y. H. Yang, Y. C. Lin, Y. F. Su, and H. H. Chen, "A regression approach to music emotion recognition," IEEE Transactions on Audio, Speech, and Language Processing, vol. 16, no. 2, pp. 448-457, 2008.   DOI
18 D. Cabrera, "PsySound: a computer program for psychoacoustical analysis," in Proceedings of the Australian Acoustical Society Conference, Melbourne, 1999, pp. 47-54.
19 G. Tzanetakis and P. Cook, "Musical genre classification of audio signals," IEEE Transactions on Speech and Audio Processing, vol. 10, no. 5, pp. 293-302, 2002.   DOI
20 L. Lu, D. Liu, and H. J. Zhang, "Automatic mood detection and tracking of music audio signals," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 1, pp. 5-18, 2006.   DOI
21 A. Sen and M. Srivastava, Regression Analysis: Theory, Methods, and Applications. New York: Springer, 1990.
22 A. J. Smola and B. Scholkopf, "A tutorial on support vector regression," Statistics and Computing, vol. 14, no. 3, pp. 199-222, 2004.   DOI
23 Y. H. Yang and H. H. Chen, "Ranking-based emotion recognition for music organization and retrieval," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 762-774, 2011.   DOI
24 D. P. Solomatine and D. L. Shrestha, "AdaBoost.RT: a boosting algorithm for regression problems," in Proceedings of IEEE International Joint Conference on Neural Networks, Budapest, Hungary, 2004, pp. 1163- 1168.
25 O. Lartillot and P. Toivianen, "MIR in MATLAB (II): a toolbox for musical feature extraction from audio," in Proceedings of the 8th International Conference on Music Information Retrieval (ISMIR2007), Vienna, Austria, 2007, pp. 127-130.
26 E. Pampalk, "A MATLAB toolbox to compute music similarity from audio," in Proceedings of the 5th International Conference on Music Information Retrieval (ISMIR2004), Barcelona, Spain, 2004, pp. 1-4.
27 F. Pachet and P. Roy, "Improving multilabel analysis of music titles: a large-scale validation of the correction approach," IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 2, pp. 335-343, 2009.   DOI