Journal of the Ergonomics Society of Korea (대한인간공학회지)

Ergonomics Society of Korea (대한인간공학회)
권호 표지
DOI QR코드

DOI QR Code

Discrimination of Three Emotions using Parameters of Autonomic Nervous System Response

  • Jang, Eun-Hye (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute) ;
  • Park, Byoung-Jun (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute) ;
  • Eum, Yeong-Ji (Department of Psychology/Brain Research Institute, Chungnam National University) ;
  • Kim, Sang-Hyeob (BT Convergence Technology Research Department, Electronics and Telecommunications Research Institute) ;
  • Sohn, Jin-Hun (Department of Psychology/Brain Research Institute, Chungnam National University)
  • Received : 2011.07.18
  • Accepted : 2011.10.20
  • Published : 2011.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: The aim of this study is to compare results of emotion recognition by several algorithms which classify three different emotional states(happiness, neutral, and surprise) using physiological features. Background: Recent emotion recognition studies have tried to detect human emotion by using physiological signals. It is important for emotion recognition to apply on human-computer interaction system for emotion detection. Method: 217 students participated in this experiment. While three kinds of emotional stimuli were presented to participants, ANS responses(EDA, SKT, ECG, RESP, and PPG) as physiological signals were measured in twice first one for 60 seconds as the baseline and 60 to 90 seconds during emotional states. The obtained signals from the session of the baseline and of the emotional states were equally analyzed for 30 seconds. Participants rated their own feelings to emotional stimuli on emotional assessment scale after presentation of emotional stimuli. The emotion classification was analyzed by Linear Discriminant Analysis(LDA, SPSS 15.0), Support Vector Machine (SVM), and Multilayer perceptron(MLP) using difference value which subtracts baseline from emotional state. Results: The emotional stimuli had 96% validity and 5.8 point efficiency on average. There were significant differences of ANS responses among three emotions by statistical analysis. The result of LDA showed that an accuracy of classification in three different emotions was 83.4%. And an accuracy of three emotions classification by SVM was 75.5% and 55.6% by MLP. Conclusion: This study confirmed that the three emotions can be better classified by LDA using various physiological features than SVM and MLP. Further study may need to get this result to get more stability and reliability, as comparing with the accuracy of emotions classification by using other algorithms. Application: This could help get better chances to recognize various human emotions by using physiological signals as well as be applied on human-computer interaction system for recognizing human emotions.

Keywords

References

  1. Arroyo-Palacios, J. and Romano, D. M. "Towards a standardization in the use of physiological signals for affective recognition systems." Proceeding of the 6th International Conference of Methods and Techniques in Behavioral Research, Maastricht. Netherlands. 2008.
  2. Bailenson, J. N., Pontikakis, E. D., Mauss, I. B., Gross, J. J., Jabon, M. E., Hutcherson, C. A. C., Nass, C. and John, O., Real-time classification of evoked emotions using facial feature tracking and physiological responses, International Journal of Human-Computer Studies, 66(5), 303-317, 2008. https://doi.org/10.1016/j.ijhcs.2007.10.011
  3. Calvo, R. A., Brown, I. and Scheding, S., "Effect of experimental factors on the recognition of affective mental states through physiological measures," Proceeding of 22nd Australasian Joint Conference on Artificial Intelligence, 2009.
  4. Ekman, P., An argument for basic emotions, Cognitive emotion, 62, 45-57, 1992.
  5. Ekman, P., Levenson, R. W. and Friesen, W. V., Autonomic nervous system activity distinguishes among emotions, Science, 221, 1983.
  6. Ekman, P. and Friesen, R. W., Facial Action Coding System: A technique for the measurement of facial movement, Consulting Psychologists Press, 1978.
  7. Eom, J. S., Park, H. J., Noh, J. H. and Sohn, J. H., Cardiovascular response to surprise stimulus, Korean Journal of the Science of Emotion & Sensibility, 14(1), 147-156, 2011.
  8. Fisher, R. A., The use of multiple measurements in taxonomic problems, Annals of Eugenics, 7(2), 179-188, 1936. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x
  9. Gu, S. H., Computation of noncentral F probabilities using multilayer neural network, Korean Journal of Information Processing, 9-b(3), 271-276, 2002. https://doi.org/10.3745/KIPSTB.2002.9B.3.271
  10. Haag, A., Goronzy, S., Schaich, P. and Williams, J., Emotion recognition using bio-sensors: First steps towards an automatic system, Affective Dialogue Systems, 3068, 36-48, 2004. https://doi.org/10.1007/978-3-540-24842-2_4
  11. Kanade, T., Cohn, J. and Tian, Y., "Comprehensive database for facial expression analysis," Proceeding of the 4th IEEE International Conference on Automatic Face and Gesture Recognition, 46-53, 2000.
  12. Kim, D. S. and Huntsberger, T. L., Fuzzy neural network pattern classifier, Journal of Fuzzy Logic and Intelligent System, 1(3), 4-19, 1991.
  13. Kim, K., Bang, S. and Kim, S., "Emotion recognition system using shortterm monitoring of physiological signals," Medical and Biological Engineering and Computing, 42(3), 419-427, 2004. https://doi.org/10.1007/BF02344719
  14. Kreibig, S. D., Autonomic nervous system activity in emotion: a review, Biological Psychology, 84(3), 394-421, 2010. https://doi.org/10.1016/j.biopsycho.2010.03.010
  15. Liu, C. Conn, K. Sarkar, N. and Stone, W., Physiology-based affect recognition for computer-assisted intervention of children with autism spectrum disorder, International Journal of Human-Computer Studies, 66(9), 662-677, 2008. https://doi.org/10.1016/j.ijhsc.2008.04.003
  16. Nakatsu, R., Nicholson, J. and Tosa, N., "Emotion recognition and its application to computer agents with spontaneous interactive capabilities," Proceeding of the seventh ACM international conference on Multimedia, 343-351, 1999.
  17. Nasoz, F., Alvarez, K., Lisetti, C. L. and Finkelstein, N., "Emotion recognition from physiological signals for presence technologies," International Journal of Cognition, Technology and Work, Special Issue on Presence, 6(1), 2003.
  18. Palomba, D., Sarlo, M., Angrilli, A., and Mini, A., Cardiac responses associated with affective processing of unpleasant film stimulus, International Journal of Psychology, 36, 45-57 2000.
  19. Park, J. Y., Park, D. S., Park, J. H. and Park, R. J. H. "Development of human sensibility recognition system using Hidden Markov Model," Human-Computer Interaction, 1-2, 16-21, 2004
  20. Picard R. W., Vyzas, E. and Healey, J., Toward machine emotional intelligence: analysis of affective physiological state, IEEE Transaction Pattern Analysis and Machine Intelligence, 23, 2001.
  21. Plutchik, R., A psychoevolutionary theory of emotion, Social Science Information, 21(4-5), 529-553, 1982. https://doi.org/10.1177/053901882021004003
  22. Sauter, D. A., Eisner, F., Ekman, P. & Scott, S. K., "Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations," Proceeding of the National Academy of Science of United Sates of America, 107(6), 2408-2412, 2010. https://doi.org/10.1073/pnas.0908239106
  23. Seok, K. H. and Rye, T. W., The efficiency of boosting on SVM, Journal of Korean Data & Information Science Society, 13(2), 55-64, 2002.
  24. Stephens, C. L., Christie, I. C. & Friedman, B. H., Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis, Biological Psychology, 84(3), 463-473, 2010. https://doi.org/10.1016/j.biopsycho.2010.03.014
  25. Vapnik V., "The nature of statistical learning theory," New York: Springer Verlag, 1995.
  26. Wagner, J., Kim, N. J. and Andre, R., "From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification," Proceeding of IEEE International Conference Multimedia and Expo, 940-943, 2005.