Browse > Article
http://dx.doi.org/10.5143/JESK.2011.30.6.705

Discrimination of Three Emotions using Parameters of Autonomic Nervous System Response  

Jang, Eun-Hye (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Park, Byoung-Jun (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Eum, Yeong-Ji (Department of Psychology/Brain Research Institute, Chungnam National University)
Kim, Sang-Hyeob (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute)
Sohn, Jin-Hun (Department of Psychology/Brain Research Institute, Chungnam National University)
Publication Information
Journal of the Ergonomics Society of Korea / v.30, no.6, 2011 , pp. 705-713 More about this Journal
Abstract
Objective: The aim of this study is to compare results of emotion recognition by several algorithms which classify three different emotional states(happiness, neutral, and surprise) using physiological features. Background: Recent emotion recognition studies have tried to detect human emotion by using physiological signals. It is important for emotion recognition to apply on human-computer interaction system for emotion detection. Method: 217 students participated in this experiment. While three kinds of emotional stimuli were presented to participants, ANS responses(EDA, SKT, ECG, RESP, and PPG) as physiological signals were measured in twice first one for 60 seconds as the baseline and 60 to 90 seconds during emotional states. The obtained signals from the session of the baseline and of the emotional states were equally analyzed for 30 seconds. Participants rated their own feelings to emotional stimuli on emotional assessment scale after presentation of emotional stimuli. The emotion classification was analyzed by Linear Discriminant Analysis(LDA, SPSS 15.0), Support Vector Machine (SVM), and Multilayer perceptron(MLP) using difference value which subtracts baseline from emotional state. Results: The emotional stimuli had 96% validity and 5.8 point efficiency on average. There were significant differences of ANS responses among three emotions by statistical analysis. The result of LDA showed that an accuracy of classification in three different emotions was 83.4%. And an accuracy of three emotions classification by SVM was 75.5% and 55.6% by MLP. Conclusion: This study confirmed that the three emotions can be better classified by LDA using various physiological features than SVM and MLP. Further study may need to get this result to get more stability and reliability, as comparing with the accuracy of emotions classification by using other algorithms. Application: This could help get better chances to recognize various human emotions by using physiological signals as well as be applied on human-computer interaction system for recognizing human emotions.
Keywords
Emotion recognition; Physiological signal; Support vector machine; Multilayer perceptron;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Sauter, D. A., Eisner, F., Ekman, P. & Scott, S. K., "Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations," Proceeding of the National Academy of Science of United Sates of America, 107(6), 2408-2412, 2010.   DOI
2 Seok, K. H. and Rye, T. W., The efficiency of boosting on SVM, Journal of Korean Data & Information Science Society, 13(2), 55-64, 2002.   과학기술학회마을
3 Stephens, C. L., Christie, I. C. & Friedman, B. H., Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis, Biological Psychology, 84(3), 463-473, 2010.   DOI   ScienceOn
4 Vapnik V., "The nature of statistical learning theory," New York: Springer Verlag, 1995.
5 Wagner, J., Kim, N. J. and Andre, R., "From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification," Proceeding of IEEE International Conference Multimedia and Expo, 940-943, 2005.
6 Kim, K., Bang, S. and Kim, S., "Emotion recognition system using shortterm monitoring of physiological signals," Medical and Biological Engineering and Computing, 42(3), 419-427, 2004.   DOI
7 Kreibig, S. D., Autonomic nervous system activity in emotion: a review, Biological Psychology, 84(3), 394-421, 2010.   DOI   ScienceOn
8 Liu, C. Conn, K. Sarkar, N. and Stone, W., Physiology-based affect recognition for computer-assisted intervention of children with autism spectrum disorder, International Journal of Human-Computer Studies, 66(9), 662-677, 2008.   DOI
9 Nakatsu, R., Nicholson, J. and Tosa, N., "Emotion recognition and its application to computer agents with spontaneous interactive capabilities," Proceeding of the seventh ACM international conference on Multimedia, 343-351, 1999.
10 Nasoz, F., Alvarez, K., Lisetti, C. L. and Finkelstein, N., "Emotion recognition from physiological signals for presence technologies," International Journal of Cognition, Technology and Work, Special Issue on Presence, 6(1), 2003.
11 Palomba, D., Sarlo, M., Angrilli, A., and Mini, A., Cardiac responses associated with affective processing of unpleasant film stimulus, International Journal of Psychology, 36, 45-57 2000.
12 Park, J. Y., Park, D. S., Park, J. H. and Park, R. J. H. "Development of human sensibility recognition system using Hidden Markov Model," Human-Computer Interaction, 1-2, 16-21, 2004
13 Ekman, P., An argument for basic emotions, Cognitive emotion, 62, 45-57, 1992.
14 Picard R. W., Vyzas, E. and Healey, J., Toward machine emotional intelligence: analysis of affective physiological state, IEEE Transaction Pattern Analysis and Machine Intelligence, 23, 2001.
15 Plutchik, R., A psychoevolutionary theory of emotion, Social Science Information, 21(4-5), 529-553, 1982.   DOI
16 Calvo, R. A., Brown, I. and Scheding, S., "Effect of experimental factors on the recognition of affective mental states through physiological measures," Proceeding of 22nd Australasian Joint Conference on Artificial Intelligence, 2009.
17 Ekman, P., Levenson, R. W. and Friesen, W. V., Autonomic nervous system activity distinguishes among emotions, Science, 221, 1983.
18 Ekman, P. and Friesen, R. W., Facial Action Coding System: A technique for the measurement of facial movement, Consulting Psychologists Press, 1978.
19 Eom, J. S., Park, H. J., Noh, J. H. and Sohn, J. H., Cardiovascular response to surprise stimulus, Korean Journal of the Science of Emotion & Sensibility, 14(1), 147-156, 2011.   과학기술학회마을
20 Fisher, R. A., The use of multiple measurements in taxonomic problems, Annals of Eugenics, 7(2), 179-188, 1936.   DOI
21 Gu, S. H., Computation of noncentral F probabilities using multilayer neural network, Korean Journal of Information Processing, 9-b(3), 271-276, 2002.   과학기술학회마을   DOI
22 Haag, A., Goronzy, S., Schaich, P. and Williams, J., Emotion recognition using bio-sensors: First steps towards an automatic system, Affective Dialogue Systems, 3068, 36-48, 2004.   DOI
23 Bailenson, J. N., Pontikakis, E. D., Mauss, I. B., Gross, J. J., Jabon, M. E., Hutcherson, C. A. C., Nass, C. and John, O., Real-time classification of evoked emotions using facial feature tracking and physiological responses, International Journal of Human-Computer Studies, 66(5), 303-317, 2008.   DOI
24 Kanade, T., Cohn, J. and Tian, Y., "Comprehensive database for facial expression analysis," Proceeding of the 4th IEEE International Conference on Automatic Face and Gesture Recognition, 46-53, 2000.
25 Kim, D. S. and Huntsberger, T. L., Fuzzy neural network pattern classifier, Journal of Fuzzy Logic and Intelligent System, 1(3), 4-19, 1991.
26 Arroyo-Palacios, J. and Romano, D. M. "Towards a standardization in the use of physiological signals for affective recognition systems." Proceeding of the 6th International Conference of Methods and Techniques in Behavioral Research, Maastricht. Netherlands. 2008.