ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Hybrid Facial Representations for Emotion Recognition

  • Yun, Woo-Han (IT Convergence Technology Research Laboratory, ETRI) ;
  • Kim, DoHyung (IT Convergence Technology Research Laboratory, ETRI) ;
  • Park, Chankyu (IT Convergence Technology Research Laboratory, ETRI) ;
  • Kim, Jaehong (IT Convergence Technology Research Laboratory, ETRI)
  • Received : 2013.03.31
  • Accepted : 2013.09.23
  • Published : 2013.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Automatic facial expression recognition is a widely studied problem in computer vision and human-robot interaction. There has been a range of studies for representing facial descriptors for facial expression recognition. Some prominent descriptors were presented in the first facial expression recognition and analysis challenge (FERA2011). In that competition, the Local Gabor Binary Pattern Histogram Sequence descriptor showed the most powerful description capability. In this paper, we introduce hybrid facial representations for facial expression recognition, which have more powerful description capability with lower dimensionality. Our descriptors consist of a block-based descriptor and a pixel-based descriptor. The block-based descriptor represents the micro-orientation and micro-geometric structure information. The pixel-based descriptor represents texture information. We validate our descriptors on two public databases, and the results show that our descriptors perform well with a relatively low dimensionality.

Keywords

References

  1. B. Fasel and J. Luettin, "Automatic Facial Expression Analysis: A Survey," Pattern Recog., vol. 36, no. 1, Jan. 2003, pp. 259-275. https://doi.org/10.1016/S0031-3203(02)00052-3
  2. V. Bettadapura, "Face Expression Recognition and Analysis: The State of the Art," tech report, Apr. 2012.
  3. T. Wu et al., "Multilayer Architectures for Facial Action Unit Recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 4, Aug. 2012, pp. 1027-1038. https://doi.org/10.1109/TSMCB.2012.2195170
  4. M.F. Valstar et al., "The First Facial Expression Recognition and Analysis Challenge," Proc. FG, Mar. 2011, pp. 921-926.
  5. L. Wiskott et al., "Face Recognition by Elastic Bunch Graph Matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, July 1997, pp. 775-779. https://doi.org/10.1109/34.598235
  6. I. Kotsia, I. Buciu, and I. Pitas, "An Analysis of Facial Expression Recognition under Partial Facial Image Occlusion," Image Vision Comput., vol. 26, no. 7, July 2008, pp. 1052-1067. https://doi.org/10.1016/j.imavis.2007.11.004
  7. T. Ojala, M. Pietikainen, and D. Harwood, "A Comparative Study of Texture Measures with Classification Based on Featured Distribution," Pattern Recog., vol. 29, no. 1, Jan. 1996, pp. 51-59. https://doi.org/10.1016/0031-3203(95)00067-4
  8. C. Shan, S. Gong, and P.W. McOwan, "Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study," Image and Vision Comput., vol. 27, no. 6, May 2009, pp. 803-816. https://doi.org/10.1016/j.imavis.2008.08.005
  9. T. Ojala, M. Pietikäinen, and T. Maenpaa, "Multiresolution Gray- Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, July 2002, pp. 971-987. https://doi.org/10.1109/TPAMI.2002.1017623
  10. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proc. CVPR, vol. 1, June 2005, pp. 886-893.
  11. W. Yun et al., "Face Recognition Using HOG Features," Proc. URAI, vol. 1, 2008, pp. 442-445.
  12. C. Shan, S. Gong, and P.W. McOwan, "Beyond Facial Expressions: Learning Human Emotion from Body Gestures," Proc. BMVC, 2007, pp. 1-10.
  13. M.J. Lyons et al., "Coding Facial Expressions with Gabor Wavelets," Proc. FG, 1998, pp. 200-205.
  14. P. Lucey et al., "The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression," Proc. IEEE Int. Works CVPR4HB, 2010, pp. 94-101.
  15. T. Kanade, J.F. Cohn, and Y. Tian, "Comprehensive Database for Facial Expression Analysis," Proc. FG, 2000, pp. 46-53.
  16. M. Turk and A.P. Pentland, "Face Recognition Using Eigenfaces," Proc. CVPR, 1991, pp. 586-591.
  17. C. Chang and C. Lin, "LIBSVM: A Library for Support Vector Machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, Apr. 2011, pp. 1-27.
  18. L. Maaten, E. Postma, and J. Herik, "Dimensionality Reduction: A Comparative Review," technical report, Tilburg University, 2009. http://homepage.tudelft.nl/19j49/Matlab_Toolbox_for_Dimensio nality_Reduction.html
  19. M. Eckhardt, I. Fasel, and J. Movellan, "Towards Practical Facial Feature Detection," Int. J. Pattern Recog. AI, vol. 23, no. 3, May 2009, pp. 379-400. https://doi.org/10.1142/S0218001409007247
  20. W. Zhang et al., "Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A Novel Non-Statistical Model for Face Representation and Recognition," Proc. ICCV, 2005, pp. 786-791.
  21. D.M. Hawkins and G.J. McLachlan, "High-Breakdown Linear Discriminant Analysis," J. Am. Stat. Assoc., vol. 92, no. 437, Mar. 1997, pp. 136-143. https://doi.org/10.1080/01621459.1997.10473610

Cited by

  1. Improved Two-Phase Framework for Facial Emotion Recognition vol.37, pp.6, 2013, https://doi.org/10.4218/etrij.15.0114.0523
  2. Study on predicting sentiment from images using categorical and sentimental keyword-based image retrieval vol.72, pp.9, 2016, https://doi.org/10.1007/s11227-015-1510-0
  3. Big Data in Forecasting Research: A Literature Review vol.27, pp.None, 2013, https://doi.org/10.1016/j.bdr.2021.100289