Journal of the Semiconductor & Display Technology (반도체디스플레이기술학회지)

The Korean Society Of Semiconductor & Display Technology (한국반도체디스플레이기술학회)
권호 표지

Human Emotion Recognition based on Variance of Facial Features

얼굴 특징 변화에 따른 휴먼 감성 인식

  • Lee, Yong-Hwan (Department Of Digital Contents, Wonkwang University) ;
  • Kim, Youngseop (Department of Electronic and Electronical Engineering, Dankook University)
  • 이용환 (원광대학교 디지털콘텐츠공학과) ;
  • 김영섭 (단국대학교 전자전기공학과)
  • Received : 2017.12.14
  • Accepted : 2017.12.27
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Understanding of human emotion has a high importance in interaction between human and machine communications systems. The most expressive and valuable way to extract and recognize the human's emotion is by facial expression analysis. This paper presents and implements an automatic extraction and recognition scheme of facial expression and emotion through still image. This method has three main steps to recognize the facial emotion: (1) Detection of facial areas with skin-color method and feature maps, (2) Creation of the Bezier curve on eyemap and mouthmap, and (3) Classification and distinguish the emotion of characteristic with Hausdorff distance. To estimate the performance of the implemented system, we evaluate a success-ratio with emotional face image database, which is commonly used in the field of facial analysis. The experimental result shows average 76.1% of success to classify and distinguish the facial expression and emotion.

Keywords

References

  1. Ralph Adolphs, "Recognizing Emotion from Facial Expressions: Psychological and Neurological Mechanisms", Behavioral and Cognitive Neuroscience Reviews, 1(1), (2002).
  2. Ira Cohen, Ashutosh Garg, Thomas S. Huang, "Emotion Recognition from Facial Expressions using Multilevel HMM", Proceeding of the Workshop on Affective Computing, pp.1-7, (2000).
  3. Nicu Sebe, Ira Cohen, Theo Gevers, Thomas S. Huang, "Multimodal Approaches for Emotion Recognition: A Survey", Internet Imaging VI, SPIE, 5670, pp. 56-67. (2005).
  4. Hatice Gunes, Massimo Piccardi, "Automatic Temporal Segment Detection and Affect Recognition from Face and Body Display", IEEE Transactions on Systems, Man, and Cybernetics - Part B, 39(1), pp.64-84, (2009). https://doi.org/10.1109/TSMCB.2008.927269
  5. Paul Ekman, Wallace V. Friesen, "Facial Action Coding System (FACS): Investigator's Guide", Consulting Psychologists Press, (1978).
  6. Yuu Nakanishi, Yasunari Yoshitomi, Taro Asada, Masayoshi Tabuse, "Facial Expression Recognition for Speaker using Thermal Image Processing and Speech Recognition System", IEEE International Symposium on Robot and Human Interactive Communication, (2009).
  7. Ioannou S. V., Raouzaiou A. T., Tzouvaras V. A., Mailis T. P., Karpouzis K. C., Kollias S. D., "Emotion Recognition through Facial Expression Analysis based on a Neurofuzzy Network", Neural Networks, 18(4), pp.423-435, (2005). https://doi.org/10.1016/j.neunet.2005.03.004
  8. M. Pantic, I. Patras, "Dynamics of Facial Expression: Recognition of Facial Actions and their Temporal Segments from Face Profile Image Sequences", IEEE Transactions on Systems, Man and Cybernetics, 36(2), pp.433-449, (2006). https://doi.org/10.1109/TSMCB.2005.859075
  9. M. Pantic, Leon J.M. Rothkrantz, "Facial Action Recognition for Facial Expression Analysis from Static Face Images", IEEE Transactions on Systems, Man and Cybernetics - Part B, 34(3), pp.1449-1461, (2004). https://doi.org/10.1109/TSMCB.2004.825931
  10. Michel F. Valster, Maja Pantic, Zara Ambadar, Jeffrey F. Cohn, "Spontaneous vs. Posed Facial Behavior: Automatic Analysis of Brow Actions", International Conference on Multimodal Interfaces, pp.162-170, (2006).
  11. Rafael C. Gonzalea, Richard E.Woods, Steven L. Eddins, "Digital Image Processing using Matlab", Prentice Hall, (2004).
  12. Yong-Hwan Lee, Tae-Kyu Han, Young-Seop Kim, Sang-Burm Rhee, "An Efficient Algorithm for Face Recognition in Mobile Environments", Asian Journal of Information Technology, 4(8), pp.796-802, (2005).
  13. Rein-Lien Hsu, Mohamed Abdel-Mattaleb, Anil K. Jain, "Face Detection in Color Images", IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), pp.696-701, (2002). https://doi.org/10.1109/34.1000242
  14. Samuel R. Buss, "3D Computer Graphics - A Mathematical Introduction with OpenGL", Cambridge University Press, (2003).
  15. Mohammed Riazur Rahman, M. Ameer Ali, Golam Sorwar, "Finding Significant Points for Parametric Curve Generation Techniques", Journal of Advanced Computations, 2(2), (2008).
  16. Seon-Hong Kim, Young Joon Ahn, "An Approximation of Circular Arcs by Quartic Bezier Curves", Computer-Aided Design, 39(6), pp.490-493, (2007). https://doi.org/10.1016/j.cad.2007.01.004
  17. Carlos Eduardo, Thomaz Gilson, Antonio Giraldi, "A New Ranking Method for Principal Components Analysis and its Application to Face Image Analysis", Image and Vision Computing, 28(6), pp.902-913, (2010). https://doi.org/10.1016/j.imavis.2009.11.005
  18. Takeo Kanade, Jeffrey F. Cohn Yingli Tian, "Comprehensive Database for Facial Expression Analysis", Proceedings of the International Conference on Automatic Face and Gesture Recognition, pp.484-491, (2000).
  19. Wuri Han, Yong-Hwan Lee, Jeho Park, Youngseop Kim, "Dynamic Emotion Classification through Facial Recognition", Journal of the Semiconductor and Display Technology, 12(3), (2013).
  20. Yong-Hwan Lee, Heung-Jun Kim, "Evaluation of Feature Extraction and Matching Algorithms for the use of Mobile Application", Journal of the Semiconductor and Display Technology, 14(4), (2015).