Browse > Article
http://dx.doi.org/10.5391/IJFIS.2010.10.2.095

A Spatial Regularization of LDA for Face Recognition  

Park, Lae-Jeong (Department of Electronics Engineering, Gangnung-Wonju National University)
Publication Information
International Journal of Fuzzy Logic and Intelligent Systems / v.10, no.2, 2010 , pp. 95-100 More about this Journal
Abstract
This paper proposes a new spatial regularization of Fisher linear discriminant analysis (LDA) to reduce the overfitting due to small size sample (SSS) problem in face recognition. Many regularized LDAs have been proposed to alleviate the overfitting by regularizing an estimate of the within-class scatter matrix. Spatial regularization methods have been suggested that make the discriminant vectors spatially smooth, leading to mitigation of the overfitting. As a generalized version of the spatially regularized LDA, the proposed regularized LDA utilizes the non-uniformity of spatial correlation structures in face images in adding a spatial smoothness constraint into an LDA framework. The region-dependent spatial regularization is advantageous for capturing the non-flat spatial correlation structure within face image as well as obtaining a spatially smooth projection of LDA. Experimental results on public face databases such as ORL and CMU PIE show that the proposed regularized LDA performs well especially when the number of training images per individual is quite small, compared with other regularized LDAs.
Keywords
Face recognition; LDA; regularization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 D.-Q. Dai and P. C. Yuen, "Face recognition by regularized discriminant analysis," IEEE Trans. on SMC-PART B, vol. 37, no. 4, pp. 1080-1085, 2007.   DOI   ScienceOn
2 X. Jiang, B. Mandal, and A. Kot, "Eigenfeature regularization and extraction in face recognition," IEEE Tran. on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 383-394, 2008.   DOI   ScienceOn
3 T. Hastie, A. Buja, and R. Tibshirani, "Penalized discriminant analysis", The Annals of Statisticis, vol. 23, no. 1, pp. 73-102, 1995.   DOI
4 D. Cai, X. He, Y. Hu, J. Han, and T. Husang, "Learning a spatially smooth subspace for face recognition", Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1-7, 2007.
5 J. Ye, R. Janardan, and Q. Li, "Two-dimensional Linear Discriminant Analysis", Proc. of Neural Information Processing Systems, pp. 1569-1576, 2004.
6 F. O'Sullivan, "Discretized Laplacian smoothing by Fourier methods," J. of the American Statistical Association, vol. 86, pp. 634-642, 1991.   DOI
7 ORL Face Database, AT&T Laboratories Cambridge, 2005.
8 T. Sim, S. Baker, and M. Bsat, "The CMU pose," Proc. of Conf. on Automatic Face and Gesture Recognition, pp. 46-51, 2002.
9 R. A. Fisher, "The use of multiple measures in taxonmic problems," Ann. Eugenics, vol. 7, pp. 179-188, 1936.   DOI
10 R. Chellapa, C. Whilson, and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. of IEEE, vol 83, no. 5, pp. 705-740, 1995.   DOI   ScienceOn
11 K. Fukunga, Introduction to Statistical Pattern Recognition, Academic Press, New York, 1991.
12 P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenface vs. fisherface: Recognition using class specific linear projection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18. no, 7, pp. 711-720, 1997.   DOI   ScienceOn
13 L. Chen, H. Liao, M. Ko, J. Lin, and G. Yu, "A new LDAbased face recognition system which can solve the small sample size problem," Pattern Recognition, vol. 33, no. 10, pp. 1713-1726, 2000.   DOI   ScienceOn
14 J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulo, "Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition," Pattern Recognition Letters, vol. 26, no. 2, pp. 181-191, 2005.   DOI   ScienceOn
15 K. Liu, Y. Cheng, J. Yang, H. Yu, and J. Yang, "A direct LDA algorithm for high-dimensional data with application to face recognition," Pattern Recognition, vol. 34, no. 10, pp. 2067-2070, 2001.   DOI   ScienceOn
16 J. H. Friedman, "Regularized discriminant analysis," J. of the American Statistical Association, vol. 84, no. 405, pp. 165-175, 1989.   DOI