International Journal of Fuzzy Logic and Intelligent Systems

Korean Institute of Intelligent Systems (한국지능시스템학회)
권호 표지
DOI QR코드

DOI QR Code

A Spatial Regularization of LDA for Face Recognition

  • Park, Lae-Jeong (Department of Electronics Engineering, Gangnung-Wonju National University)
  • Received : 2009.10.15
  • Accepted : 2010.05.12
  • Published : 2010.06.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a new spatial regularization of Fisher linear discriminant analysis (LDA) to reduce the overfitting due to small size sample (SSS) problem in face recognition. Many regularized LDAs have been proposed to alleviate the overfitting by regularizing an estimate of the within-class scatter matrix. Spatial regularization methods have been suggested that make the discriminant vectors spatially smooth, leading to mitigation of the overfitting. As a generalized version of the spatially regularized LDA, the proposed regularized LDA utilizes the non-uniformity of spatial correlation structures in face images in adding a spatial smoothness constraint into an LDA framework. The region-dependent spatial regularization is advantageous for capturing the non-flat spatial correlation structure within face image as well as obtaining a spatially smooth projection of LDA. Experimental results on public face databases such as ORL and CMU PIE show that the proposed regularized LDA performs well especially when the number of training images per individual is quite small, compared with other regularized LDAs.

Keywords

References

  1. R. A. Fisher, "The use of multiple measures in taxonmic problems," Ann. Eugenics, vol. 7, pp. 179-188, 1936. https://doi.org/10.1111/j.1469-1809.1936.tb02137.x
  2. R. Chellapa, C. Whilson, and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. of IEEE, vol 83, no. 5, pp. 705-740, 1995. https://doi.org/10.1109/5.381842
  3. K. Fukunga, Introduction to Statistical Pattern Recognition, Academic Press, New York, 1991.
  4. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenface vs. fisherface: Recognition using class specific linear projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18. no, 7, pp. 711-720, 1997. https://doi.org/10.1109/34.598228
  5. L. Chen, H. Liao, M. Ko, J. Lin, and G. Yu, "A new LDAbased face recognition system which can solve the small sample size problem," Pattern Recognition, vol. 33, no. 10, pp. 1713-1726, 2000. https://doi.org/10.1016/S0031-3203(99)00139-9
  6. K. Liu, Y. Cheng, J. Yang, H. Yu, and J. Yang, "A direct LDA algorithm for high-dimensional data with application to face recognition," Pattern Recognition, vol. 34, no. 10, pp. 2067-2070, 2001. https://doi.org/10.1016/S0031-3203(00)00162-X
  7. J. H. Friedman, "Regularized discriminant analysis," J. of the American Statistical Association, vol. 84, no. 405, pp. 165-175, 1989. https://doi.org/10.2307/2289860
  8. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulo, "Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition," Pattern Recognition Letters, vol. 26, no. 2, pp. 181-191, 2005. https://doi.org/10.1016/j.patrec.2004.09.014
  9. D.-Q. Dai and P. C. Yuen, "Face recognition by regularized discriminant analysis," IEEE Trans. on SMC-PART B, vol. 37, no. 4, pp. 1080-1085, 2007. https://doi.org/10.1109/TSMCB.2007.895363
  10. X. Jiang, B. Mandal, and A. Kot, "Eigenfeature regularization and extraction in face recognition," IEEE Tran. on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 383-394, 2008. https://doi.org/10.1109/TPAMI.2007.70708
  11. T. Hastie, A. Buja, and R. Tibshirani, "Penalized discriminant analysis", The Annals of Statisticis, vol. 23, no. 1, pp. 73-102, 1995. https://doi.org/10.1214/aos/1176324456
  12. D. Cai, X. He, Y. Hu, J. Han, and T. Husang, "Learning a spatially smooth subspace for face recognition", Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1-7, 2007.
  13. J. Ye, R. Janardan, and Q. Li, "Two-dimensional Linear Discriminant Analysis", Proc. of Neural Information Processing Systems, pp. 1569-1576, 2004.
  14. F. O'Sullivan, "Discretized Laplacian smoothing by Fourier methods," J. of the American Statistical Association, vol. 86, pp. 634-642, 1991. https://doi.org/10.2307/2290392
  15. ORL Face Database, AT&T Laboratories Cambridge, 2005.
  16. T. Sim, S. Baker, and M. Bsat, "The CMU pose," Proc. of Conf. on Automatic Face and Gesture Recognition, pp. 46-51, 2002.