DOI QR코드

DOI QR Code

Face Emotion Recognition by Fusion Model based on Static and Dynamic Image

정지영상과 동영상의 융합모델에 의한 얼굴 감정인식

  • Lee Dae-Jong (Chungbuk National University School of Electrical and Computer Engineering) ;
  • Lee Kyong-Ah (Dasan Networks) ;
  • Go Hyoun-Joo (Chungbuk National University School of Electrical and Computer Engineering) ;
  • Chun Myung-Geun (Chungbuk National University School of Electrical and Computer Engineering)
  • 이대종 (충북대학교 전기전자컴퓨터공학부) ;
  • 이경아 (다산네트웍스) ;
  • 고현주 (충북대학교 전기전자컴퓨터공학부) ;
  • 전명근 (충북대학교 전기전자컴퓨터공학부)
  • Published : 2005.10.01

Abstract

In this paper, we propose an emotion recognition using static and dynamic facial images to effectively design human interface. The proposed method is constructed by HMM(Hidden Markov Model), PCA(Principal Component) and wavelet transform. Facial database consists of six basic human emotions including happiness, sadness, anger, surprise, fear and dislike which have been known as common emotions regardless of nation and culture. Emotion recognition in the static images is performed by using the discrete wavelet. Here, the feature vectors are extracted by using PCA. Emotion recognition in the dynamic images is performed by using the wavelet transform and PCA. And then, those are modeled by the HMM. Finally, we obtained better performance result from merging the recognition results for the static images and dynamic images.

본 논문에서는 인간과 컴퓨터의 인터페이스를 좀더 자연스럽고 쉬운 형태의 능동적인 휴먼 인터페이스로 구현하기 위해 정지영상 및 동영상에서의 감정인식기법을 제안하고자 한다. 제안된 얼굴의 감정인식 기법은 Hidden Markov Model(HMM), 주성분분석기법(PCA)와 웨이블렛 변환을 기반으로 구성하였다. 얼굴의 감정인식을 위하여 심리학자인 Ekman과 Friesen의 연구에 의해 문화에 영향을 받지 않고 공통으로 인식하는 6개의 기본 감정인 기쁨, 슬픔, 화남, 놀람, 공포, 혐오를 바탕으로 실험하였다. 감정인식에서 입력영상은 이산 웨이블렛을 기반으로 한 다해상도 분석기법을 사용하여 데이터 수를 압축한 후, 각각의 영상에서 PCA 특징벡터를 추출한 후 이를 사용하여 HMM의 모델을 생성한다. 인식단계에서는 정지영상에서의 인식값과 동영상에서의 인식값을 정규화 과정을 통하여 상호보완 함으로써 인식률을 높일 수 있었다.

Keywords

References

  1. P.Ekman and W.V. Friesen. Emotion in the human face System. Cambridge University Press, San Francisco, CA, second edition, 1982
  2. David S. Bolme, Elastic Bunch Graph Matching, Thesis of the Degree of Master, Colorado University, Summer 2003
  3. M. Turk, A. Pentland, 'Eigenfaces for recognition', Journal of Cognitive Neuroscience, Vol. 3, No.1, pp. 71-86, 1991 https://doi.org/10.1162/jocn.1991.3.1.71
  4. P. Penev, J Atick, 'Local feature analysis: a general statistical theory for object representation', Network: Computation in Neural Systems, Vol. 7, pp. 477-500, 1996 https://doi.org/10.1088/0954-898X/7/3/002
  5. P. Belhumeur, J Hespanha, D. Kriegman, 'Eigenfaces vs. fisherfaces: Recognition using class specific linear projection', IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 19, No.7, pp. 711-720, 1997 https://doi.org/10.1109/34.598228
  6. C. Padgett, G. Cottrell, 'Representing face images for emotion classification', Advances in Neural Information Processing Systems, Vol. 9, MIT Press. 1997
  7. Z. Zhang, M. Lyons, M. Schuster, S. Akamatsu, 'Comparison between geometry based and gabor-wavelets-based facial expression recognition using multi-layer perceptron', Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 454-459, 1998
  8. Katsuhiro Matsuno and Saburo Tsuji. 'Recognizing human facial expressions in a potential field. In Proc CVPR, pp 44-49, 1994
  9. H. Ushida, T. Takagi, and T. Yamaguchi. 'Recognition of facial expressions using conceptual fuzzy set.' In Proc. CVPR, pp594-499, 1993
  10. 전명근, 생체인식(Biometric) 총론, 한국정보통신 교육원, 2002
  11. Rodrigo de Luis-Garcia, Carlos Alberola-Lopez, Otman Aghzout and Juan Ruiz- Alzola 'Biometric identification systerns' Signal Processing, Vol. 83, Issue 12. pp. 2539-2557, December 2003 https://doi.org/10.1016/j.sigpro.2003.08.001
  12. Lin Hong, Anil Jain, 'Integrating Faces and Fingerprints for Personal Identification', IEEE Trans. on Pattern analysis and machine intelligene, Vol. 20, No. 12, 1998
  13. Stephane Mallat, A wavelet tour of signal processing, Academic press, 1999
  14. Rabiner, LR, 'A tutorial on hidden markov models and selesced applications in speech recognition' proceedings of the IEEE, Vol. 77, Issue 2, pp. 257-286, 1989