Browse > Article
http://dx.doi.org/10.3837/tiis.2014.04.017

A Novel Multiple Kernel Sparse Representation based Classification for Face Recognition  

Zheng, Hao (School of Mathematics and Information Technology, Nanjing XiaoZhuang University)
Ye, Qiaolin (Computer science department, Nanjing Forestry University)
Jin, Zhong (School of Computer Science and Technology, Nanjing University of Science and Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.4, 2014 , pp. 1463-1480 More about this Journal
Abstract
It is well known that sparse code is effective for feature extraction of face recognition, especially sparse mode can be learned in the kernel space, and obtain better performance. Some recent algorithms made use of single kernel in the sparse mode, but this didn't make full use of the kernel information. The key issue is how to select the suitable kernel weights, and combine the selected kernels. In this paper, we propose a novel multiple kernel sparse representation based classification for face recognition (MKSRC), which performs sparse code and dictionary learning in the multiple kernel space. Initially, several possible kernels are combined and the sparse coefficient is computed, then the kernel weights can be obtained by the sparse coefficient. Finally convergence makes the kernel weights optimal. The experiments results show that our algorithm outperforms other state-of-the-art algorithms and demonstrate the promising performance of the proposed algorithms.
Keywords
sparse representation; dictionary; multiple kernels; face recognition;
Citations & Related Records
연도 인용수 순위
  • Reference
1 H. Zheng, J. Xie, Z. Jin, "Heteroscedastic Sparse Representation Classification for Face Recognition," Neural Processing Letters, Vol. 35, Issues 3, pp 233-244, 2012.   DOI
2 Aizerman, M. A., Braverman, E. M. and Rozonoer, L. I., "Theoretical foundation of potential function method in pattern recognition learning," Automat. Remote Contr.25, 821-837, 1964.
3 B. Scholkopf, S. Alexander, and K. Muller, "Nonlinear component analysis as a kernel eigenvalue problem," Neural Comput. 10, 1299-1319, 1998.   DOI   ScienceOn
4 S. Mike, G. Ratsch, J. Weston, B. Scholkopf, and K. Muller, "Fisher discriminant analysis with kernels," in Proc. of Proceedings of the 1999 IEEE Signal Processing Society Workshop Neural Networks for Signal Processing, vol. IX, pp. 41-48, 1999.
5 S. Mike, G. Ratsch, B. Scholkopf, A. Smola, J. Weston, and K.R. Muller, Invariant feature extraction and classification in kernel spaces," in Proc. of Proceedings of the 13th Annual Neural Information Processing Systems Conference, pp. 526-532, 1999.
6 A. Argyriou, R. Hauser, C. A. Micchelli, and M. Pontil, A DC algorithm for kernel selection," in Proc. of 23rd Int. Conf. Mach., Pittsburgh,PA, pp. 41-49, 2006.
7 A. Argyriou, C. A. Micchelli, and M. Pontil, "Learning convex combinations of continuously parameterized basic kernels," in Proc. of 18th Annu. Conf. Learn. Theory, Bertinoro, Italy, pp. 338-352, 2005.
8 C. S. Ong, A. J. Smola, and R. C. Williamson, "Learning the kernel with hyperkernels," J. Mach. Learn. Res., vol. 6, pp. 1043-1071, 2005.
9 25. A. Rakotomamonjy, F. Bach, S. Canu, and Y. Grandvalet, "More efficiency in multiple kernel learning," in Proc. of 24th Int. Conf. Mach.Learn., Corvallis, OR, pp. 775-782, 2007.Article (CrossRef Link)
10 A. Rakotomamonjy, F. R. Bach, S. Canu, and Y. Grandvalet, "SimpleMKL," J. Mach. Learn. Res., vol. 9, pp. 2491-2521, 2008.
11 Sonnenburg, G. Ratsch, C. Schafer, and B. Scholkopf, "Large scale multiple kernel earning," J. Mach. Learn. Res., vol. 7, pp. 1531-1565, 2006.
12 Y. Gao, M. Wang, Z. Zha, and Q. Tian, "Less is More: Efficient 3D Object Retrieval with Query View Selection," IEEE Trans. on Multimedia, vol. 13, no. 5, pp. 41007-1018, 2011.
13 Duda, R.O. and Hart, P.E., "Pattern Classification and Scene Analysis," Wiley, New York, 1973.
14 S.Z. Li and J. Lu, "Face recognition using nearest feature line method," IEEE Trans. Neural Network, vol. 10, no. 2, pp. 439-443, 1999.   DOI   ScienceOn
15 J.T. Chien, and C.C. Wu, "Discriminant waveletfaces and nearest feature classifiers for face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 12, pp. 1644-1649, 2002.   DOI
16 J. Laaksonen, "Local subspace classifier", in Proc. of Int'l Conf. Artificial Neural Networks, 1997.
17 K. Lee, J. Ho, and D. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 684-698, 2005.   DOI   ScienceOn
18 S.Z. Li, "Face recognition based on nearest linear combinations," in Proc. of IEEE Int'l Conf. Computer Vision and Pattern Recognition, 1998.
19 I. Naseem, R. Togneri, and M. Bennamoun, "Linear regression for face recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 11, pp. 2106-2112, 2010.   DOI
20 Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y., "Robust face recognition via sparse representation," TPAMI, vol. 31(2), pp. 210-227, 2009.   DOI   ScienceOn
21 M. Yang and L. Zhang, "Gabor Feature based Sparse Representation for Face Recognition with Gabor Occlusion Dictionary," in Proc. of European Conf. Computer Vision, 2010.
22 J.Z. Huang, X.L. Huang, and D. Metaxas, "Simultaneous image transformation and sparse representation recovery," in Proc. of IEEE Conf. Computer Vision and Pattern Recognition, 2008.
23 J. Yu and D. Tao, "Adaptive Hypergraph Learning and Its Application in Image Classification," IEEE Trans. on Image Processing, vol. 21, no. 7, pp. 3262-3271, 2012.   DOI   ScienceOn
24 A. Wagner, J. Wright, A. Ganesh, Z.H. Zhou, and Y. Ma, "Towards a Practical Face Recognition System: Robust Registration and Illumination by Sparse Representation," in Proc. of IEEE Conf. Computer Vision and Pattern Recognition, 2009.
25 P. N. Belhumeur, J. P. Hespanha, and D. J. Kriengman, "Eigenfaces versus Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, 1997.   DOI   ScienceOn
26 Li H, Jiang T, Zhang K., "Efficient and robust feature extraction by maximum margin criterion," In Proc. of Proceedings of the advances in neural information processing systems, vol.16. MIT Press, Vancouver, Canada, 2004.
27 J. Yu , M. Wang and D. Tao, "Semisupervised Multiview Distance Metric Learning for Cartoon Synthesis," IEEE Trans. on Image Processing, vol. 21, no. 11, pp. 4636-3271, 2012.   DOI   ScienceOn
28 J. Yu , D. Liu and D. Tao, "On Combining Multiview Features for Cartoon Character Retrieval and Clip Synthesis," IEEE Trans. on Systems, Man, and Cybernetics, vol. 42, no. 5, pp. 1413-1427, 2012.   DOI   ScienceOn
29 M. Wang, X. Hua, J. Tang, and R. Hong, "Beyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation," IEEE Trans. on Multimedia, vol. 11, no. 3, pp. 465-476, 2009.   DOI   ScienceOn
30 M. Wang, B. Ni, X. Hua, and T. Chua, "Assistive Tagging: A Survey of Multimedia Tagging with Human-Computer Joint Exploration," ACM Computing Surveys, vol. 4, no. 4, Article 25, 2012.
31 M. Wang, and X. Hua. "Active Learning in Multimedia Annotation and Retrieval: A Survey," ACM Transactions on Intelligent Systems and Technology, vol. 2, no. 2, pp. 10-31, 2011.
32 Y. Gao, M. Wang, Z. Zha, and J. Shen, "Visual Texttual Joint Relevance Learning for Tag-Based Social Image Search," IEEE Trans. on Image Processing, vol. 22, no. 1, pp. 363-376, 2012.
33 A. Zien and C. S. Ong, "Multiclass multiple kernel learning," in Proc. of 24th Int. Conf. Mach. Learn., Corvallis, OR, pp. 1191-1198, 2007.
34 Y. Gao, M. Wang, D. Tao, and R. Ji, "3D Object Retrieval and Recognition with Hypergraph Analysis," IEEE Trans. on Image Processing, vol. 21, no. 9, pp. 4290-4303, 2012.   DOI   ScienceOn
35 M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.   DOI   ScienceOn
36 X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, 2005.   DOI   ScienceOn
37 C. J. C. Burges, "Simplified support vector decision rules," in Proc. of 13th Int. Conf. Mach. Learn., San Mateo, CA, pp. 71-77, 1996.
38 B. Scholkopf and A. Smola, "Learning with Kernels," Cambridge,MA: MIT Press, 2002.
39 D. Nguyen and T. Ho, "An efficient method for simplifying support vector machines," in Proc. of 22nd Int. Conf. Mach. Learn., Bonn, Germany, pp. 617-624, 2005.
40 M. Wu, B. Scholkopf, and B. Bakir, "A direct method for building sparse kernel learning algorithms," J. Mach. Learn. Res., vol. 7, pp.603-624, 2006.
41 M. Wu, B. Scholkopf, and G. Bakir, 'Building sparse large margin classifiers," in Proc. of 22nd Int. Conf. Mach. Learn., Bonn, Germany, pp. 996-1003, 2005.
42 Jun Yin, Zhong Jin, "Kernel sparse representation based classification," Neurocomputing, vol. vol. 77, no. 1, pp. 120-128, 2012.   DOI   ScienceOn
43 Shenghua Gao, Ivor Wai-Hung Tsang, Liang-Tien chia, "Kernle Sparse Representation for Image Classification and Face Recognition," In Proc. of Proceedings 11th European Conference on Computer Vision, pp. 1-14, 2010.
44 Li Zhang, Wei-Da zhou, "Kernel sparse representation-based classifier," IEEE Transactions on Signal Processing, vol. 60, no. 4, pp. 1684-1695, 2012.   DOI   ScienceOn
45 M. Wang, X. Hua, R. Hong, J. Tang, G. Qi, and Y. Song, "Unified Video Annotation via Multigraph Learning," IEEE Trans. on Circuits and System for Video Technology, vol. 19, no. 5, pp. 733-746, 2009.   DOI   ScienceOn
46 Tibshirani, R., "Regression shrinkage and selection via the lasso," Journal of the Royal Statistical Society B, vol. 58, no. 1, pp. 267-288, 1996.
47 Lanckriet, G.R.G., et al., "Learning the Kernel Matrix with Semidefinite Programming," J.Machine Learning Research 5, 27-72, 2004.
48 P. J. Phillips, H. Moon, S. A. Rivzi, and P. Rauss, "The FERET EvaluationMethodology for Face-Recognition Algorithms," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, pp. 1090-1104, 2000.   DOI   ScienceOn
49 Z. Zhou, A. Wagner, H. Mobahi, J. Wright, and Y. Ma, "Face recognition with contiguous occlusion using markov random fields," in Proc. of IEEE Int'l Conf. Computer Vision, 2009.