Browse > Article
http://dx.doi.org/10.9717/kmms.2017.20.5.748

Learning Directional LBP Features and Discriminative Feature Regions for Facial Expression Recognition  

Kang, Hyunwoo (Smart Vision Research Section, ETRI)
Lim, Kil-Taek (Smart Vision Research Section, ETRI)
Won, Chulho (Dept. of Biomedical Engineering, Kyungil University)
Publication Information
Journal of Korea Multimedia Society / v.20, no.5, 2017 , pp. 748-757 More about this Journal
Abstract
In order to recognize the facial expressions, good features that can express the facial expressions are essential. It is also essential to find the characteristic areas where facial expressions appear discriminatively. In this study, we propose a directional LBP feature for facial expression recognition and a method of finding directional LBP operation and feature region for facial expression classification. The proposed directional LBP features to characterize facial fine micro-patterns are defined by LBP operation factors (direction and size of operation mask) and feature regions through AdaBoost learning. The facial expression classifier is implemented as a SVM classifier based on learned discriminant region and directional LBP operation factors. In order to verify the validity of the proposed method, facial expression recognition performance was measured in terms of accuracy, sensitivity, and specificity. Experimental results show that the proposed directional LBP and its learning method are useful for facial expression recognition.
Keywords
Directional Local Binary Pattern; Facial Expression Recognition; AdaBoost Learning; Support Vector Machine;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Y. Cheon and D. Kim, "A Natural Facial Expression Recognition Using Differential-AAM and k-NNS," Journal of Pattern Recognition, Vol. 42, No. 7, pp. 1340-1350, 2008.
2 Y. Tian, T. Kanade, and J. Cohn, "Recognizing Action Units for Facial Expression Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 2, pp. 97-115, 2001.   DOI
3 N.D. Matthew, W. Garrison, P. Curtis, and A. Ralph, "EMPATH: A Neural Network that Categorizes Facial Expressions," Journal of Cognitive Neuroscience, Vol. 14, No. 8, pp. 1158-1173, 2002.   DOI
4 C.L. Lisetti and D.E. Rumelhart, "Facial Expression Recognition Using a Neural Network," Proceeding of The 11th International Flairs Conference, pp. 323-332, 1998.
5 C. Shan, S. Gong, and P.W. McOwan, "Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study," Journal of Image and Vision Computing, Vol. 27, No. 6, pp. 803-816, 2009.   DOI
6 C. Won, "Recognition of Facial Emotion Using Multi-scale LBP," Journal of Korea Multimedia Society, Vol. 17, No. 12, pp. 1383-1392, 2014.   DOI
7 K.T. Lim and C. Won, "Face Image Analysis Using Adaboost Learning and Non-Square Differential LBP," Journal of Korea Multimedia Society, Vol. 19, No. 6, pp. 1014-1023, 2016.   DOI
8 T.F. Cootes, G.J. Edwards, and C.J. Taylor, "Active Appearance Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, pp. 681-685, 2001.   DOI
9 A.B. Ashraf, K. Prkachin, T. Chen, S. Lucey, P. Solomon, Z. Ambadar, et al., "The Painful Face-Pain Expression Recognition Using Active Appearance Models," Journal of Image and Vision Computing, Vol. 12, No. 3, pp. 1788-1796, 2009.
10 T. Ojala, M. Pietikainen, and T. Maenpaa, "Multi-resolution Gray-scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 24, No. 7, pp. 971-987, 2002.   DOI
11 C. Cortes and V. Vapnik, "Support-Vector Networks," Journal of Machine Learning, Vol. 20, No. 3, pp. 273-297, 1995.
12 Y. Freund and R.E. Schapire. "A Short Introduction to Boosting," Journal of Japanese Society for Artificial Intelligence, Vol. 14, No. 5, pp. 771-780, 1999.
13 C.W. Hsu and C.J. Lin, "A Comparison of Methods for Mu1ticlass Support Vector Machines," IEEE Transactions on Neural Networks, Vol. 13, No. 2, pp. 415-425, 2002.   DOI
14 S. Junding, Z. Shisong, and W Xiaosheng, "Image Retrieval Based on an Improved CS-LBP Descriptor," Proceeding of The 2nd IEEE International Conference on Information Management and Engineering, pp. 115-117, 2010.