Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Viewpoint Unconstrained Face Recognition Based on Affine Local Descriptors and Probabilistic Similarity

  • Gao, Yongbin (Div. of Computer Science and Engineering, Chonbuk National University) ;
  • Lee, Hyo Jong (Div. of Computer Science and Engineering, Chonbuk National University)
  • Received : 2014.07.29
  • Accepted : 2015.04.09
  • Published : 2015.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Face recognition under controlled settings, such as limited viewpoint and illumination change, can achieve good performance nowadays. However, real world application for face recognition is still challenging. In this paper, we propose using the combination of Affine Scale Invariant Feature Transform (SIFT) and Probabilistic Similarity for face recognition under a large viewpoint change. Affine SIFT is an extension of SIFT algorithm to detect affine invariant local descriptors. Affine SIFT generates a series of different viewpoints using affine transformation. In this way, it allows for a viewpoint difference between the gallery face and probe face. However, the human face is not planar as it contains significant 3D depth. Affine SIFT does not work well for significant change in pose. To complement this, we combined it with probabilistic similarity, which gets the log likelihood between the probe and gallery face based on sum of squared difference (SSD) distribution in an offline learning process. Our experiment results show that our framework achieves impressive better recognition accuracy than other algorithms compared on the FERET database.

Keywords

References

  1. G. Hua, M. H. Yang, E. Learned-Miller, Y. Ma, M. Turk, D. J. Kriegman, and T. S. Huang, "Introduction to the special section on real-world face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 1, pp. 1921-1924, 2011. https://doi.org/10.1109/TPAMI.2011.182
  2. H. T. Ho and R. Chellappa, "Pose-invariant face recognition using Markov random fields," IEEE Transactions on Image Processing, vol. 22, no. 4, pp. 1573-1584, 2013. https://doi.org/10.1109/TIP.2012.2233489
  3. S. R. Arashloo and J. Kittler, "Energy normalization for pose-invariant face recognition based on MRF model image matching," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 6, pp. 1274-1280, 2011. https://doi.org/10.1109/TPAMI.2010.209
  4. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: a unifying framework," International Journal of Computer Vision, vol. 56, no. 3, pp. 221-255, 2004. https://doi.org/10.1023/B:VISI.0000011205.11775.fd
  5. A. B. Ashraf, S. Lucey, and T. Chen, "Learning patch correspondences for improved viewpoints invariant face recognition," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR2008), Anchorage, AK, 2008, pp. 1-8.
  6. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, 2003. https://doi.org/10.1109/TPAMI.2003.1227983
  7. M. De Marsico, M. Nappi, D. Riccio, and H. Wechsler, "Robust face recognition for uncontrolled pose and illumination changes," IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 43, no. 1, pp. 149-162, 2013. https://doi.org/10.1109/TSMCA.2012.2192427
  8. S. Milborrow and F. Nicolls, "Locating facial features with an extended active shape model," in Proceedings of 10th European Conference on Computer Vision, Marseille, France, 2008, pp. 504-513, 2008.
  9. L. Wolf, T. Hassner, and Y. Taigman, "Effective unconstrained face recognition by combining multiple descriptors and learned background statistics," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 10, pp. 1978-1990, 2011. https://doi.org/10.1109/TPAMI.2010.230
  10. A. Li, S. Shan, and W. Gao, "Coupled bias-variance tradeoff for cross-pose face recognition," IEEE Transactions on Image Processing, vol. 21, no. 1, pp. 305-315, 2012. https://doi.org/10.1109/TIP.2011.2160957
  11. Y. Zhang, M. Shao, E. K. Wong, and Y. Fu, "Random faces guided sparse many-to-one encoder for pose-invariant face recognition," in Proceedings of IEEE International Conference on Computer Vision (ICCV), Sydney, Australia, 2013, pp. 2416-2423.
  12. Z. Zhu, P. Luo, X. Wang, and X. Tang, "Deep learning identity preserving face space," in Proceedings of IEEE International Conference on Computer Vision (ICCV), Sydney, Australia, 2013, pp. 113-120.
  13. S. J. D. Prince, J. Warrell, J. H. Elder, and F. M. Felisberti, "Tied factor analysis for face recognition across large pose differences," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 970-984, 2008. https://doi.org/10.1109/TPAMI.2008.48
  14. K. Mikolajczyk and C. Schmid, "Scale and affine invariant interest point detectors," International Journal of Computer Vision, vol. 60, no. 1, pp. 63-86, 2004. https://doi.org/10.1023/B:VISI.0000027790.02288.f2
  15. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. V. Gool, "A comparison of affine region detectors," International Journal of Computer Vision, vol. 65, no. 1-2, pp. 43-72, 2005. https://doi.org/10.1007/s11263-005-3848-x
  16. J. M. Morel and G. Yu, "ASIFT: a new framework for fully affine invariant image comparison," SIAM Journal on Imaging Sciences, vol. 2, no. 2, pp. 438-469, 2009. https://doi.org/10.1137/080732730
  17. W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang, "Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition," in Proceedings of IEEE International Conference on Computer Vision (ICCV), Beijing, China, 2005, pp. 786-791.
  18. D. Chen, X. Cao, F. Wen, and J. Sun, "Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, 2013, pp. 3025-3032.
  19. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  20. J. Beis and D. G. Lowe, "Shape indexing using approximate nearest-neighbour search in high-dimensional spaces," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 1000-1006.
  21. P. V. Hough, "Method and means for recognizing complex patterns," U.S. Patent 3069654, 1962.
  22. P. J. Phillips, H. Wechsler, J. Huang, and P. Rauss, "The FERET database and evaluation procedure for face-recognition algorithms," Image and Vision Computing, vol. 16, no. 5, pp. 295-306, 1998. https://doi.org/10.1016/S0262-8856(97)00070-X
  23. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: application to face recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, 2006. https://doi.org/10.1109/TPAMI.2006.244