Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2006.13B.7.653

Emotion Recognition Based on Facial Expression by using Context-Sensitive Bayesian Classifier  

Kim, Jin-Ok (대구한의대학교 정보경영대학 모바일콘텐츠학부)
Abstract
In ubiquitous computing that is to build computing environments to provide proper services according to user's context, human being's emotion recognition based on facial expression is used as essential means of HCI in order to make man-machine interaction more efficient and to do user's context-awareness. This paper addresses a problem of rigidly basic emotion recognition in context-sensitive facial expressions through a new Bayesian classifier. The task for emotion recognition of facial expressions consists of two steps, where the extraction step of facial feature is based on a color-histogram method and the classification step employs a new Bayesian teaming algorithm in performing efficient training and test. New context-sensitive Bayesian learning algorithm of EADF(Extended Assumed-Density Filtering) is proposed to recognize more exact emotions as it utilizes different classifier complexities for different contexts. Experimental results show an expression classification accuracy of over 91% on the test database and achieve the error rate of 10.6% by modeling facial expression as hidden context.
Keywords
Facial Expression Recognition; Emotion Recognition; Bayesian Classifier; HCI;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 H. J. Kushner, A. S. Budhiraja, 'A Nonlinear Filtering Algorithm based on an Appoximation of the Conditional Distribution,' IEEE Trans. Automatic Control, Vol.45, pp.580-585, 2000   DOI   ScienceOn
2 M. Harries, K. Horn, 'Learing Static Concepts in Domains with Hidden Changes in Context,' 13th ICML, workshop on Learing in Context Sensitive Domains, Italy, 1996
3 J. O. Kim, K. H. Jung, C. H. Chung, 'On a Face Recognition by the Modified Nonsingular Discriminant Analysis for a Ubiquitous Computing,' Lecture Notes in Computer Science 3980, Vol.1, pp. 929-937, May., 2006   DOI   ScienceOn
4 김진옥, '빛보상과 외형기반의 특징을 이용한 얼굴 특징 검출,' 한국인터넷정보학회 논문지, 제7권 제4호, pp. 143-153, 2006   과학기술학회마을
5 T. Minka, 'A Family of Algorithms for Approximate Bayesian Inference,' Ph.D. Thesis, MIT, 2001
6 M. J. Lyongs, J. Budynek, S. Akamatsu, 'Automatic classification of single facial images,' IEEE Trans. Pattern Anal. Mach, Intel., Vol.21, No.12, pp.1357-1362, 1999   DOI   ScienceOn
7 A. Pentland, 'Looking at People: Sensing for ubiquitous and wearable computing,' IEEE Trans. on PAMI, Vol. 22, No.1, January. 2000   DOI   ScienceOn
8 Z. Zhang, M. Lyongs, M. Schuster, S. Akamatsu, 'Feature Comparison between Geometry Based and Gabor-Wavelets Based Facial Expression Recognition using Multi-layer Perceptron,' Proc. 3rd IEEE Int. Conf. Automatic Face and Gesture Recognition, pp.454-459, 1998   DOI
9 G. Guo, C. R. Dyer, 'Learning from Examples in the Small Sample Case: Face Expression Recognition,' IEEE Trans. On Systems, Man and Cybernetics, Part B: Cybernetics, Vol.35, No.3, pp.477-489, 2005   DOI   ScienceOn
10 A. Lanitis, C. Taylor, T. Cootes, 'Automatic Interpretation and Coding ace Images using Flexible Models,' IEEE Trans. Pattern Anal. Mach. Intel., Vol. 19, No.7. pp.743-756, 1997   DOI   ScienceOn
11 C. Padget, G. Cottrell, 'Identifying Emotion in Static Imges,' Proc. 2nd Joint Symp. Neural Computation, Vol.5, pp.91-101, 1997
12 M. F. Valstar, M. Pantic and I. Patras, 'Motion History for Facial Action Detection from Face Video,' Proc. IEEE Conf. SMC, pp.635-640, 2004   DOI
13 M. S. Bartlett, 'Machine Learning Methods for Fully Automatic Recognition of Facial Expressions and Actions,' Proc. IEEE Conf. SMC, pp.592-597, 2004   DOI
14 Y. Tian, T. Kanade, J. F. Cohn, 'Recognizing Action Unts for Facial Expression Analysis,' IEEE Trans. PAMI, Vol.23, No.2, pp.97-115, 2001   DOI   ScienceOn
15 T. Kanade, J. Cohn, Y. Tian, 'Comprehensive Database for Facial Expression Analysis,' Proc. IEEE Conf. FGR, pp.46-53, 2000   DOI
16 C. Darwin, 'The Expression of the Emotions in Man and Animals,' Univ. of Chicgo Press, 1965
17 D. Keltner and P. Ekman, 'Facial Expression of Emotion,' Handbook of Emotions, pp.236-249, 2000
18 I. Essa, A. Pentland, 'Coding, Analysis, Interpretation and Recognition of Facial Expressions,' IEEE Trans. PAMI, Vol.19, No.7, pp. 757-763, 1997   DOI   ScienceOn
19 K. Mace, 'Recognition of Facial Expression from Optical Flow,' IEICE Transactions. Vol.E74, No.10, pp.3474-3483, 1991
20 M. Pantie, L. J. M. Rothkrantz, 'Automatic Analysis fo Facial Expressions: The state of the art,' IEEE Trans. Pattern Anal. Mach. Intel., Vol.22. No.12, pp.1424-1445, 2000   DOI   ScienceOn
21 P. Ekman and W. Fresen, 'Facial Action Coding System,' Consulting Psychologist Press, 1978
22 M. J. Lyons, S. Akamatsu, M. Kamachi, J. Gyoba, 'Coding Facial Expressions with Gabor Wavelets,' Proceedings, Third IEEE International Conference on Automatic Face and Gesture Recognition, pp.200-205, 1998   DOI
23 A. Rahardja, A. Sowmya, W. Wilson, 'A Neural Network Approach to Compnent vs. Holistic Recognition of Facial Expressions in Images,' SPIE Proc. Intelligent Robots and Computer Vision X : Algorithms and Techniques, Vol.1607, pp.62-70, 1991   DOI
24 G. Gottrell, J. Metcalfe, 'Face, Gender and Emotion Recognition using Holons,' Adv. Neural Inform. Process. Syst. Vol. 3, pp. 564-571, 1991