Browse > Article
http://dx.doi.org/10.5391/JKIIS.2009.19.6.821

Real-time Recognition System of Facial Expressions Using Principal Component of Gabor-wavelet Features  

Yoon, Hyun-Sup (숭실대학교 전자공학과)
Han, Young-Joon (숭실대학교 전자공학과)
Hahn, Hern-Soo (숭실대학교 전자공학과)
Publication Information
Journal of the Korean Institute of Intelligent Systems / v.19, no.6, 2009 , pp. 821-827 More about this Journal
Abstract
Human emotion can be reflected by their facial expressions. So, it is one of good ways to understand people's emotions by recognizing their facial expressions. General recognition system of facial expressions had selected interesting points, and then only extracted features without analyzing physical meanings. They takes a long time to find interesting points, and it is hard to estimate accurate positions of these feature points. And in order to implement a recognition system of facial expressions on real-time embedded system, it is needed to simplify the algorithm and reduce the using resources. In this paper, we propose a real-time recognition algorithm of facial expressions that project the grid points on an expression space based on Gabor wavelet feature. Facial expression is simply described by feature vectors on the expression space, and is classified by an neural network with its resources dramatically reduced. The proposed system deals 5 expressions: anger, happiness, neutral, sadness, and surprise. In experiment, average execution time is 10.251 ms and recognition rate is measured as 87~93%.
Keywords
Facial Expression Recognition; Expression Feature; Gabor Wavelet; PCA;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Pantic M, Rothkrantz L.J.M, 'Automatic analysis of facial expressions: the state of the art,' IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.22, No.12, pp.1424-1445, 2000   DOI   ScienceOn
2 B. Fasel, J. Luettin, Beat Fasel, Juergen Luettin, 'Automatic Facial Expression Analysis: A Survey,' Pattern Recognition, Vol.36, pp.259-275, 1999   DOI   ScienceOn
3 C. Padgett, G.W. Cottrell, 'Representing face images for emotion classification,' Proc. Conf. Advances in Neural Information Processing Systems, Vol.9, pp.894-900, 1997
4 Matthew N. Dailey, Garrison W. Cottrell, Curtis Padgett, and Ralph Adolphs, 'EMPATH: A Neural Network that Categorizes Facial Expressions,' Journal of cognitive neuroscience, Vol.14, pp.1158-1173, 2002   DOI   ScienceOn
5 Bouchra Abboud, Franck Davoine, Mo Dang, 'Facial expression recognition and synthesis based on an appearance model,' Signal Processing: Image Communication, Vol.19, No.8, pp.723-740, 2004   DOI   ScienceOn
6 Yoav Freund, Robert E. Schapire, 'A decision-theoretic generalization of on-line learning and an application to boosting,' In Computational Learning Theory: Eurocolt' 95, pp.23-37, 1995
7 Jie Zou, Qiang Ji, G. Nagy, 'A Comparative Study of Local Matching Approach for Face Recognition,' IEEE Transactions on Image Processing, Vol.16, No.10, pp.2617-2628, 2007   DOI   ScienceOn
8 The Postech Faces' 01 Database http://nova.postech.ac.kr/special/imdb/imdb.html
9 고현주, 이대종, 박장환, 전명근, '웨이블릿 변환을 이용한 음성에서의 감정 추출 및 인식 기법,' 퍼지 및 지능 시스템학회 논문지, 14권, 2호, pp.150-155, 2004
10 정성욱, 김도형, 안광호, 정명진, '실시간 얼굴 표정 인식을 위한 새로운 사각 특징 형태 선택기법', 제어자동화시스템공학회지, 12권, 2호, pp.130-137, 2006
11 The Chinese Academy Sciences-Pose, Expression, Accessories, and Lighting(CAS-PEAL) Database http://www.jdl.ac.cn/peal/index.html
12 Yeongjae Cheon, Daijin Kim, 'A Natural Facial Expression Recognition Using Differential-AAM and k-NNS,' Pattren Recognition, Vol.42, No.7, pp.1340-1350, 2008
13 Andreas Haag, Silke Goronzy, Peter Schaich and Jason Williams, 'Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System,' In Proceedings of LNCS, Vol.3068, pp.36-48, 2004   DOI   ScienceOn
14 Viola P., Jones M., 'Rapid object detection using a boosted cascade of simple features,' Computer Vision and Pattern Recognition 2001, Vol.1 pp.511-518, 2001
15 Gokturk. S.B, Bouguet. J.-Y, Tomasi. C, Girod. B, 'Model-based face tracking for view-independent facial expression recognition,' IEEE International Conference on Automatic Face and Gesture Recognition, pp.287-293, 2002
16 Geng Xue, Zhang Youwei, 'Facial Expression Recognition Based on the Difference of Statistical Features,' International Conference on Signal Processing 2006, Vol.3, pp.16-20, 2006
17 I.T. Jollie, 'Principal Components Analysis,' Springer-verlag New York, 1986
18 The Japanese Female Facial Expression(JAFFE) Database http://www.kasrl.org/jaffe.html
19 Michael J. Black, Yaser Yacoob, 'Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion,' International Journal of Computer Vision, Vol.25, No.1, pp.23-48, 2004
20 심귀보, 박창현, '음성인식으로 감정인식 요소 분석,' 퍼지 및 지능 시스템학회 논문지, 11권, 11호, pp.510-515, 2001
21 Shishir Bashyala, Ganesh K. Venayagamoorthy, 'Recognition of facial expressions using Gabor wavelets and learning vector quantization,' Engineering Applications of Artificial Intelligence, Vol.21, No.7, pp.1056-1064, 2008   DOI   ScienceOn
22 P. Ekman, W. Friesen, 'Facial Action Coding System: A Technique for the Measurement of Facial Movement,' Consulting Psychologists Press, 1978