Browse > Article
http://dx.doi.org/10.9717/kmms.2017.20.5.758

Using Spatial Pyramid Based Local Descriptor for Face Recognition  

Kim, Kyeong Tae (Division of Computer and Electronic Systems Engineering, Hankuk University of Foreign Studies)
Choi, Jae Young (Division of Computer and Electronic Systems Engineering, Hankuk University of Foreign Studies)
Publication Information
Journal of Korea Multimedia Society / v.20, no.5, 2017 , pp. 758-768 More about this Journal
Abstract
In this paper, we present a novel method to extract face representation based on multi-resolution spatial pyramid. In our method, a face is subdivided into increasingly finer sub-regions (local regions) and represented at multiple levels of histogram representations. To cope with misaligned problem, patch-based local descriptor extraction has been also developed in a novel way. To preserve multiple levels of detail in local characteristics and also encode holistic spatial configuration, histograms from all levels of spatial pyramid are integrated by using dimensionality reduction and feature combination, leading to our spatial-pyramid face feature representation. We incorporate our proposed face features into general face recognition pipeline and achieve state-of-the-art results on challenging face recognition problems.
Keywords
Face Recognition; Spatial Pyramid; Local Descriptor; Histogram Representation; Feature Combination;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 J.T. Chien and C.C. Wu, "Discriminant Waveletfaces and Nearest Feature Classifiers for Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 12, pp. 1644-1649, 2002.   DOI
2 Y. Su, S. Shan, X. Chen, and W. Gao, "Hierarchical Ensemble of Global and Local Classifiers for Face Recognition," IEEE Transactions Image Processing, Vol. 18, No. 8, pp. 1885-1886, 2009.   DOI
3 J. Sivic and A. Zisserman, "Efficient Visual Search Cast as Text Retrieval," IEEE Transactions Pattern Analysis and Machine Intelligence, Vol. 31, No. 4, pp. 591-606, 2009.   DOI
4 L. Fei-Fei and P. Perona, "A Bayesian Hierarchical Model for Learning Natural Scene Categories," Proceeding of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 524-531, 2005.
5 S. Lazebnik, C. Schmid, and J. Ponce, "Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories," Proceeding of 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 2169-2178, 2006.
6 Z.S. Li, J. Imai, and M. Kaneko, "Robust Face Recognition Using Block-based Bag of Words," Proceeding of International Conference on Pattern Recognition, pp. 1285-1288, 2010.
7 Z.S. Li, J. Imai, and M. Kaneko, "Block-Based Bag of Words for Robust Face Recognition under Variant Conditions of Facial Expression," Illumination, and Partial Occlusion, IEICE Transactions on Fundamentals, Vol. 94, No. 2, pp. 533-541, 2011.
8 Le An, M. Kafai, and B. Bhanu, "Face Recognition in Multi-Camera Surveillance Videos using Dynamic Bayesian Network," Proceeding of International Conferenceon Distributed Smart Cameras, pp.1-6, 2012.
9 K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Transactions Pattern Analysis and Machine Intelligence, Vol. 27, No. 10, pp. 1615-1630, 2005.   DOI
10 T. Sim, S. Baker, and M. Bsat, "The CMU Pose, Illumination, and Expression Database," IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 25, No. 12, pp. 1615-1618, 2003.   DOI
11 P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss, "The FERET Evaluation Methodology for Face Recognition Algorithms," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 10, pp. 1090-1104, 2000.   DOI
12 G.B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, Technical Report 07-49, University of Massachusetts, Amherst, Vol. 1, No. 2, pp. 3, 2007.
13 P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. I-511-I518, 2001.
14 K. Mikolajczyk and C. Schmid, "Scale and Affine Invariant Interest Point Detectors," International J ournal of Computer Vision, Vol. 60, No. 1, pp. 63-86, 2004.   DOI
15 A. Vedaldi and B. Fulkerson, "VLFeat-An Open and Portable Library of Computer Vision Algorithms," Proceedings of the 18th ACM International Conference on Multimedia, pp. 1469-1472, 2010.
16 S. Hua1, G. Chen, H. Wei, and Q. Jiang, "Similarity Measure for Image Resizing Using SIFT feature," EURASIP Journal on Image and Video Processing, Vol. 6, pp. 1-11, 2012.   DOI
17 S.J. Lee, C.M. Oh, and C.W. Lee, "Improved Face Recognition based on 2D-LDA using Weighted Covariance Scatter", Journal of Korea Multimedia Society, Vol. 17, No. 12, pp. 1446-1452, 2014.   DOI
18 D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, Vol. 60, No. 2, pp. 91-110, 2004.   DOI
19 P. Gehler and S. Nowozin, "On Feature Combination for Multiclass Object Classification," Proceeding of 2009 IEEE 12th International Conference on Computer Vision, pp. 221-228, 2009.
20 M. Brown, G. Hua, and S. Winder, "Discriminative Learning of Local Image Descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 33, No. 1, pp. 43-57, 2011.   DOI
21 J. Lu, K.N. Plataniotis, and A.N. Venetsanopoulos, "Face Recognition Using Kernel Direct Discriminant Analysis Algorithms," IEEE Transactions on Neural Networks, Vol. 14, No. 1, pp. 117-126, 2003.   DOI
22 M.A. Turk and A.P. Pentland, "Eigenfaces for Recognition," Journal of Cognitive Neuroscience, Vol. 3, No. 1, pp. 71-86, 1991.   DOI
23 J.Y. Choi, Y.M. Ro, and K.N. Plataniotis, "Color Local Texture Features for Color Face Recognition," IEEE Transactions on Image Processing, Vol. 21, No. 3, pp. 1366-1380, 2012.   DOI
24 Leung, Thomas, Malik, and Jitendra, "Representing and Recognizing the Visual Appearance of Materials Using Three-dimensional Textons," International Journal of Computer Vision, Vol. 43, No. 1, pp. 29-44, 2001.   DOI
25 G. Csurka, C. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual Categorization with Bags of Keypoints," Proceeding of ECCV Workshop on Statistical Learning in Computer Vision, Vol. 1, No. 1-22, pp. 1-2, 2004.
26 X. Tan and B. Triggs, "Enhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditions," IEEE Transactions on Image Processing, Vol. 19, No. 6, pp. 1635-1650, 2010.   DOI
27 T. Ahonen, A. Hadid, and M. Pietikainen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 12, pp. 2037-2041, 2006.   DOI
28 Y. Su, S. Shan, X. Chen, and W. Gao, "Hierarchical Ensemble of Global and Local Classifiers for Face Recognition," IEEE Transactions on Image Processing, Vol. 18, No. 8, pp. 1885-1896, 2009.   DOI
29 S. Xie, S. Shan, X. Chen, and J. Chen, "Fusing Local Patterns of Gabor Magnitude and Phase for Face Recognition," IEEE Transactions on Image Processing, Vol. 19, No. 5, pp. 1349-1361, 2010.   DOI
30 W. Hwang, H. Wang, H. Kim, S.C. Kee, and J. Kim, "Face Recognition System Using Multiple Face Model of Hybrid Fourier Feature under Uncontrolled Illumination Variation," IEEE Transactions on Image Processing, Vol. 20, No. 4, pp. 1152-1165, 2011.   DOI
31 X. Tan and B. Triggs, "Fusing Gabor and LBP Feature Sets for Kernel-based Face Recognition," Proceeding of International Workshop on Analysis and Modeling of Faces and Gestures, pp. 235-249, 2007.
32 C. Chan, M. Tahir, J. Kittler, and M. Pietikainen, "Multiscale Local Phase Quantisation for Robust Component-based Face Recognition using Kernel Fusion of Multiple Descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, No. 5, pp. 1164-1177, 2013.   DOI
33 C. Ding, J.H Choi, D. Tao, and L.S. Davis, "Multi-directional Multi-Level Dual-Cross Patterns for Fobust Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 38, No. 3, pp. 518-531, 2016.   DOI
34 S.I. Choi, "Feature Generation Method for Low-Resolution Face Recognition", Journal of Korea Multimedia Society, Vol. 18, No. 9, pp. 1039-1046, 2015.   DOI
35 S. Liao and A.K. Jain, "Partial Face Recognition: An Alignment Free Approach," Proceeding of International Joint Conference on Biometrics, pp. 1-8, 2011.
36 P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenges," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 947-954, 2005.