DOI QR코드

DOI QR Code

Greedy Learning of Sparse Eigenfaces for Face Recognition and Tracking

  • Kim, Minyoung (Department of Electronics and IT Media Engineering, Seoul National University of Science and Technology)
  • 투고 : 2014.06.17
  • 심사 : 2014.09.20
  • 발행 : 2014.09.25

초록

Appearance-based subspace models such as eigenfaces have been widely recognized as one of the most successful approaches to face recognition and tracking. The success of eigenfaces mainly has its origins in the benefits offered by principal component analysis (PCA), the representational power of the underlying generative process for high-dimensional noisy facial image data. The sparse extension of PCA (SPCA) has recently received significant attention in the research community. SPCA functions by imposing sparseness constraints on the eigenvectors, a technique that has been shown to yield more robust solutions in many applications. However, when SPCA is applied to facial images, the time and space complexity of PCA learning becomes a critical issue (e.g., real-time tracking). In this paper, we propose a very fast and scalable greedy forward selection algorithm for SPCA. Unlike a recent semidefinite program-relaxation method that suffers from complex optimization, our approach can process several thousands of data dimensions in reasonable time with little accuracy loss. The effectiveness of our proposed method was demonstrated on real-world face recognition and tracking datasets.

키워드

참고문헌

  1. K. Pearson, "LIII. On lines and planes of closest fit to systems of points in space," Philosophical Magazine Series 6, vol. 2, no. 11, pp. 559-572, Nov. 1901. http://dx.doi.org/10.1080/14786440109462720
  2. H. Hotelling, "Analysis of a complex of statistical variables into principal components," Journal of Educational Psychology, vol. 24, no. 6, pp. 417-441, Sep. 1933. http://dx.doi.org/10.1037/h0071325
  3. I. T. Jolliffe, Principal Component Analysis, New York: Springer-Verlag, 1986.
  4. L. Sirovich and M. Kirby, "Low-dimensional procedure for the characterization of human faces," Journal of the Optical Society of America A: Optics and Image Science, vol. 4, no. 3, pp. 519-524, Mar. 1987. https://doi.org/10.1364/JOSAA.4.000519
  5. M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Transactions on Pattern analysis and Machine Intelligence, vol. 12, no. 1, pp. 103-108, 1990. https://doi.org/10.1109/34.41390
  6. M. Turk and A. Pentland, "Face recognition using eigenfaces," Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 586-591, 1991. http://dx.doi.org/10.1109/34.41390
  7. M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991. http://dx.doi.org/10.1162/jocn.1991.3.1.71
  8. D. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking," International Journal of Computer Vision, vol. 77, no. 1-3, pp. 125-141, May 2008. http://dx.doi.org/10.1007/s11263-007-0075-7
  9. I. T. Jolliffe, N. T. Trendafilov, and M. Uddin, "A modified principal component technique based on the LASSO," Journal of Computational and Graphical Statistics, vol. 12, no. 3, pp. 531-547, Sep. 2003. http://dx.doi.org/10.1198/1061860032148
  10. H. Zou, T. Hastie, and R. Tibshirani, "Sparse principal component analysis," Journal of Computational and Graphical Statistics, vol. 15, no. 2, pp. 265-286, Jun. 2006. http://dx.doi.org/10.1198/106186006X113430
  11. A. d'Aspremont, L. El Ghaoui, M. Jordan, and G. Lanckriet, "A direct formulation of sparse PCA using semidefinite programming," SIAM Review, vol. 49, no. 3, pp. 434-448, 2007. http://dx.doi.org/10.1137/050645506
  12. L. Vandenberghe and S. Boyd, "Semidefinite programming," SIAM Review, vol. 38, no. 1, pp. 49-95, 1996. http://dx.doi.org/10.1137/1038003
  13. K. C. Toh, M. J. Todd, and R. Tutuncu, "SDPT3: a Matlab software package for semidefinite programming, version 1.3," Optimization Methods and Software,vol. 11, no. 1-4, pp. 545-581, Jan. 1999. http://dx.doi.org/10.1080/10556789908805762
  14. R. Tutuncu, K. C. Toh, and M. J. Todd, "Solving semidefinite-quadratic-linear programs using SDPT3," Mathematical Programming, vol. 95, no. 2, pp. 189-217, Feb. 2003. http://dx.doi.org/10.1007/s10107-002-0347-5
  15. B. Moghaddam, Y. Weiss, and S. Avidan, "Spectral bounds for sparse PCA: exact and greedy algorithms," Advances in Neural Information Processing Systems, vol. 18, pp. 915-922, 2005.
  16. M. Isard and A. Blake, "Contour tracking by stochastic propagation of conditional density," ," in Computer Vision: ECCV '96, Lecture Notes in Computer Science Vol. 1064, B. Buxton and R. Cipolla, Eds. Heidelberg: Springer Berlin, 1996, pp. 343-356. http://dx.doi.org/10.1007/BFb0015549
  17. A. Levey and M. Lindenbaum, "Sequential Karhunen-Loeve basis extraction and its application to images," IEEE Transactions on Image Processing, vol. 9, no. 8, pp. 1371-1374, Aug. 2000. http://dx.doi.org/10.1109/83.855432
  18. M. E. Tipping and C. M. Bishop, "Probabilistic principal component analysis," Journal of the Royal Statistical Society, Series B: Statistical Methodology, vol. 61, no. 3, pp. 611-622, 1999.http://dx.doi.org/10.2307/2680726
  19. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: illumination cone models for face recognition under variable lighting and pose," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, Jun. 2001. http://dx.doi.org/10.1109/34.927464