Browse > Article
http://dx.doi.org/10.6109/jicce.2011.9.5.505

Facial Expression Classification through Covariance Matrix Correlations  

Odoyo, Wilfred O. (Department of Computer Engineering, Chosun University)
Cho, Beom-Joon (Department of Computer Engineering, Chosun University)
Abstract
This paper attempts to classify known facial expressions and to establish the correlations between two regions (eye + eyebrows and mouth) in identifying the six prototypic expressions. Covariance is used to describe region texture that captures facial features for classification. The texture captured exhibit the pattern observed during the execution of particular expressions. Feature matching is done by simple distance measure between the probe and the modeled representations of eye and mouth components. We target JAFFE database in this experiment to validate our claim. A high classification rate is observed from the mouth component and the correlation between the two (eye and mouth) components. Eye component exhibits a lower classification rate if used independently.
Keywords
covariance matrices; eigenvectors; facial component features;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 P. Ekman and W.V. Friesen, Facial Action Coding System (FACS), Consulting Psychologist Press, Inc., 1978.
2 Y. Yacoob and L. S. Davis, "Recognizing Human Facial Expressions from Long Image Sequences Using Optical Flow", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, pp. 636-642, June 1996.   DOI   ScienceOn
3 P. Michael, R. E. Kaliouby, "Real Time Facial Expression Recognition in Video using Support Vector Machines", ICMI 2003, pp.258-264, 2003.
4 J. Zhang, Y. Yan, and M. Lades, " Face Recognition: Eigenface, Elastic Matching, and Neural Nets," Proc. IEEE, vol. 85, no. 9, pp. 1423 - 1435, 1997.   DOI   ScienceOn
5 P. S. Penev and J. J. Atick, "Local Feature Analysis: A General Statistical theory for Object Representation," Network: Computation in Neural Systems, vol. 7, no. 3, pp. 477-500, 1996.   DOI   ScienceOn
6 M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, vol. 19, pp. 743-720, 1997.
7 X. W. Chen and T. Huang, "Facial expression recognition: a clustering-based approach," Pattern Recognition Letter, vol. 24, pp.1295-1302, 2003.   DOI   ScienceOn
8 Y. Zhu, L. C. De Silve, C. C. Ko, "Using Moment Invariants and HMM in Facial Expression Recognition", Pattern Recognition Letters, vol. 23, pp. 83-91, 2002.   DOI   ScienceOn
9 G.J. Edwards, C.J. Taylor, T.F. Cootes, "Interpreting face images using active appearance models", 3rd IEEE Inter. Conf. of Automatic Face and Gesture Recognition, vol. 3, pp. 30, 1998.
10 A. U. Batur and M.H. Hayes, "Adaptive Active Appearance Models", IEEE Transactions on Image Processing, vol. 14, no. 11, pp. 1707-1721, November 2005.   DOI   ScienceOn
11 Haizhou Ai, L. Liang and G. Xu, "Face Detection based on Template Matching and Support Vector Machines", Proceedings of International Conference on Image Processing, pp. 1006-1009, 2001.
12 Byungsung Lee, Junchul Chun, Peom Park, "Classification of Facial Expression Using SVM for Emotion Care Service System," 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, pp.8-12, 2008.
13 O. Tuzel, F. Porikli, and P. Meer, "Region Covariance: A fast Descriptor for Detection and Classification", European Conference on Computer Vision (ECCV, 2006TR2005-111), May 2006.
14 W. Forstner and B. Moonen, "A metric for covariance matrices", Technical report, Dept. of Geodesy and Geoinformatics, Struttgart University, 1999.
15 M. J. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with Gabor Wavelets", Proceedings, Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara japan, IEEE Computer Society, pp. 200-205, 1998.
16 W. O. Odoyo, G. B. Lee and J. J. Park and B. J. Cho, "Facial component features for facial expression identification using Active Appearance Model," IEEE Africon 2009, vol. 9, pp. 1-5, 2009.
17 W. O. Odoyo and B. J. Cho, "Global Feature Extraction and Recognition from Matrices of Gabor Feature Faces," International Journal of Maritime Information and Communication Sciences, vol. 9, no. 2, pp. 207-211, April 2011.