Browse > Article
http://dx.doi.org/10.9717/kmms.2014.17.12.1383

Recognition of Facial Emotion Using Multi-scale LBP  

Won, Chulho (Dept. of Biomedical Engineering)
Publication Information
Journal of Korea Multimedia Society / v.17, no.12, 2014 , pp. 1383-1392 More about this Journal
Abstract
In this paper, we proposed a method to automatically determine the optimal radius through multi-scale LBP operation generalizing the size of radius variation and boosting learning in facial emotion recognition. When we looked at the distribution of features vectors, the most common was $LBP_{8.1}$ of 31% and sum of $LBP_{8.1}$ and $LBP_{8.2}$ was 57.5%, $LBP_{8.3}$, $LBP_{8.4}$, and $LBP_{8.5}$ were respectively 18.5%, 12.0%, and 12.0%. It was found that the patterns of relatively greater radius express characteristics of face well. In case of normal and anger, $LBP_{8.1}$ and $LBP_{8.2}$ were mainly distributed. The distribution of $LBP_{8.3}$ is greater than or equal to the that of $LBP_{8.1}$ in laugh and surprise. It was found that the radius greater than 1 or 2 was useful for a specific emotion recognition. The facial expression recognition rate of proposed multi-scale LBP method was 97.5%. This showed the superiority of proposed method and it was confirmed through various experiments.
Keywords
Local Binary Pattern; Facial Expression; Boosting Algorithm;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 C.L. Lisetti and D.E. Rumelhart, "Facial Expression Recognition using a Neural Network," Proceeding of The 11th International Flairs Conference, pp. 323-332, 1998.
2 Y.H. Hong, Y.J. Han, and H.S. Han, "Facial Expression Recognition by Combining Adaboost and Neural Network Algorithms," J ournal of Korean Institute of Intelligent Systems, Vol. 20, No. 6, pp. 806-813, 2010.   과학기술학회마을   DOI   ScienceOn
3 Y. Cheon and D. Kim, "A Natural Facial Expression Recognition Using Differential-AAM and k-NNS," Pattern Recognition, Vol. 42, No. 7, pp. 1340-1350, 2008.
4 Y. Gao, K.H. Leung, S.C. Hui, and M.W. Tananda, "Facial Expression Recognition From Line-based Caricatures," IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, Vol. 33, No. 3, pp. 405-412, 2003.
5 C. Padgett and G.W. Cottrell, "Representing Face Images for Emotion Classification," Proceeding of Conference on Advances in Neural Information Processing Systems, Vol. 9, pp. 894-900, 1997.
6 D. Ghimire and J.W. Lee, "Geometric Feature-based Facial Expression Recognition in Image Sequences using Multi-Class AdaBoost and Support Vector Machines," Sensors, Vol. 13, No. 6, pp. 7714-7734, 2013.   DOI   ScienceOn
7 O. Rudovic, M. Pantic, and I. Patras, "Coupled Gaussian Processes for Pose-invariant Facial Expression Recognition," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 35, No. 6, pp. 1357-1369, 2012.
8 T. Ojala, M. Pietikainen, and T. Maenpaa, "Multi-resolution Gray-scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 24, No. 7, pp. 971-987, 2002.   DOI   ScienceOn
9 C. Shan, S. Gong, and P.W. McOwan, "Facial Expression Recognition Based on Local Binary Patterns: A Comprehensive Study," Image and Vision Computing, Vol. 27, No. 6, pp. 803-816, 2009.   DOI   ScienceOn
10 C. Won, "A Study on Facial Expression Recognition using Boosted Local Binary Pattern," Journal of Korea Multimedia Society, Vol. 16, No. 12, pp. 1357-1367, 2013.   과학기술학회마을   DOI
11 Y. Freund and R.E. Schapire. "A Short Introduction to Boosting," Journal of J apanese Society for Artificial Intelligence, Vol. 14, No. 5, pp. 771-780, 1999.
12 C. Cortes and V. Vapnik, "Support-vector Networks," Machine Learning, Vol. 20, No. 3, pp. 273-297, 1995.
13 C.W. Hsu and C.J. Lin, "A Comparison of Methods for Mu1ticlass Support Vector Machines," IEEE Transactions on Neural Networks, Vol. 13, No. 2, pp. 415-425, 2002.   DOI   ScienceOn