DOI QR코드

DOI QR Code

Emotion Recognition of Korean and Japanese using Facial Images

얼굴영상을 이용한 한국인과 일본인의 감정 인식 비교

  • Lee, Dae-Jong (Research Institute for Computer & Information Communication, ChungBuk National University) ;
  • Ahn, Ui-Sook (Research Institute for Computer & Information Communication, ChungBuk National University) ;
  • Park, Jang-Hwan (School of Electrical, Electronic and Information Engineering, Chungju National University) ;
  • Chun, Myung-Geun (Research Institute for Computer & Information Communication, ChungBuk National University)
  • 이대종 (충북대학교 전기전자컴퓨터공학부 컴퓨터정보통신연구소) ;
  • 안의숙 (충북대학교 전기전자컴퓨터공학부 컴퓨터정보통신연구소) ;
  • 박장환 (충주대학교 전기전자정보공학부) ;
  • 전명근 (충북대학교 전기전자컴퓨터공학부 컴퓨터정보통신연구소)
  • Published : 2005.04.01

Abstract

In this paper, we propose an emotion recognition using facial Images to effectively design human interface. Facial database consists of six basic human emotions including happiness, sadness, anger, surprise, fear and dislike which have been known as common emotions regardless of nation and culture. Emotion recognition for the facial images is performed after applying the discrete wavelet. Here, the feature vectors are extracted from the PCA and LDA. Experimental results show that human emotions such as happiness, sadness, and anger has better performance than surprise, fear and dislike. Expecially, Japanese shows lower performance for the dislike emotion. Generally, the recognition rates for Korean have higher values than Japanese cases.

본 논문에서는 얼굴영상을 이용하여 한국인과 일본인의 감정인식에 대하여 연구하였다. 얼굴의 감정인식을 위하여 심리학자인 Ekman과 Friesen의 연구에 의해 문화에 영향을 받지 않고 공통으로 인식하는 6개의 기본 감정인 기쁨, 슬픔, 화남, 놀람, 공포, 혐오를 바탕으로 실험하였다. 감정인식에서 입력영상은 이산 웨이블렛을 기반으로 한 다해상도 분석기법을 사용하여 데이터 수를 압축한 후, 각각의 영상에서 주성분분석기법 및 선형판별분석기법에 의해 얼굴의 감정특징을 추출하였다. 실험결과 한국인과 일본인 모두 "기쁨", "슬픔", "화남" 감정은 비교적 인식률이 높은 반면에 "놀람", "공포", "혐오" 감정은 인식률이 저조하게 나타냈다. 특히, 일본인의 경우 "혐오" 감정이 가장 저조한 결과를 나타냈으며, 전반적으로 한국인에 비해 일본인의 감정인식결과가 낮은 것으로 나타났다.

Keywords

References

  1. Albert Mehrabian. Communication without words. In Joseph A. DeVito, editor, Communication Concepts and Process, pp.106-114. Prentice-Hall, Inc., 1971
  2. P.Ekman and W.V. Friesen. Emotion in the human face System. Cambridge University Press, San Francisco, CA, second edition, 1982
  3. M. Turk, A. Pentland, 'Eigenfaces for recognition', Journal of Cognitive Neuroscience, Vol. 3, No. 1, pp. 71-86, 1991 https://doi.org/10.1162/jocn.1991.3.1.71
  4. P. Penev, J. Atick, 'Local feature analysis: a general statistical theory for object representation', Network : Computation in Neural Systems, Vol. 7, pp. 477-500, 1996 https://doi.org/10.1088/0954-898X/7/3/002
  5. P. Belhumeur, J. Hespanha, D. Kriegman, 'Eigenfaces vs. fisherfaces: Recognition using class specific linear projection', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 19, No. 7, pp. 711-720, 1997 https://doi.org/10.1109/34.598228
  6. C. Padgett, G. Cottrell, 'Representing face images for emotion classification', Advances in Neural Information Processing Systems, Vol. 9, MIT Press. 1997
  7. Z. Zhang, M. Lyons, M. Schuster, S. Akamatsu, 'Comparison between geometry based and gabor- wavelets-based facial expression recognition using multi-layer perceptron', Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 454-459, 1998
  8. Katsuhiro Matsuno and Saburo Tsuji. 'Recognizing human facial expressions in a potential field. In Proc CVPR, pp 44-49, 1994
  9. M. Turk, A. Pentland, 'Face recognition using eigenfaces', Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 586-591, 1991
  10. P. N. Belhumeur, J. P. Hespanha, D. J. Kriegmaqn, 'Eigenfaces vs. Fisherfaces : recognition using class specific Linear Projection', IEEE Trans. on Pattern Analysis and Machine Intell., 19(7), pp. 711-720, 1997 https://doi.org/10.1109/34.598228
  11. Richard O. Duda, Peter E. Hart, David G. Stork, Pattern Classification, JOHN WILEY&SONS, INC. Second Edition, 2002
  12. Stephane Mallat, A wavelet tour of signal processing, Academic press, 1999
  13. Michael J. Lyons, Julien Budynek, Shigeru Akamatsu, 'Automatic Classification of Single Facial Images', IEEE Trans. on Pattern Analysis and Machine Intell., Vol. 21, No. 12. 1999