Browse > Article
http://dx.doi.org/10.3837/tiis.2018.07.012

Two Dimensional Slow Feature Discriminant Analysis via L2,1 Norm Minimization for Feature Extraction  

Gu, Xingjian (College of Information Science and Technology, Nanjing Agricultural University)
Shu, Xiangbo (School of Computer Science and Engineering, Nanjing University of Science and Technology)
Ren, Shougang (College of Information Science and Technology, Nanjing Agricultural University)
Xu, Huanliang (College of Information Science and Technology, Nanjing Agricultural University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.12, no.7, 2018 , pp. 3194-3216 More about this Journal
Abstract
Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.
Keywords
sparse projection; slow feature discriminant analysis; feature extraction; $L_{2,1}$ norm;
Citations & Related Records
연도 인용수 순위
  • Reference
1 W. Yu, X. Teng, C. Liu, "Face recognition using discriminant locality preserving projections," Image and Vision computing, vol. 24, no. 3, pp.239-248, March, 2006.   DOI
2 S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, S. Lin, "Graph embedding and extensions: a general framework for dimensionality reduction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no.1, pp.40-51, November, 2006.   DOI
3 H.-W. Chang, T.-L. Liu, "Local discriminant embedding and its variants," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, 2005, pp. 846-853, June 20-25, 2005.
4 L. Wiskott, T. Sejnowski, "Slow feature analysis: Unsupervised learning of invariances," Neural computation, vol. 14, no. 4, pp.715-770, April, 2002.   DOI
5 R. Legenstein, N. Wilbert, L. Wiskott, "Reinforcement learning on slow features of high dimensional input streams," PLoS computational biology vol. 6, no.8, pp.833-835, August, 2010.
6 M. Franzius, N. Wilbert, L. Wiskott, "Invariant object recognition and pose estimation with slow feature analysis," Neural computation vol. 23, no.9, pp. 2289-2323, September, 2011.   DOI
7 P. Berkes, L. Wiskott, "Slow feature analysis yields a rich repertoire of complex cell properties," Journal of Vision, vol. 5, no.6, pp. 579-602, 2005.
8 M. Franzius, H. Sprekeler, L. Wiskott, "Slowness and sparseness lead to place, head-direction, and spatial-view cells," PLoS Computational Biology, vol.3, no.8, pp1605-1622, August, 2007.
9 Z. Zhang, D. Tao, "Slow feature analysis for human action recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence vol.34, no.3, pp.436-450, March 2012.   DOI
10 Y. Huang, J. Zhao, Y. Liu, S. Luo, Q. Zou, M. Tian, "Nonlinear dimensionality reduction using a temporal coherence principle," Information Sciences, vol. 181, no.16, pp.3284-3307, August, 2011.   DOI
11 X. Gu, C. Liu, S. Wang, "Supervised slow feature analysis for face recognition," Biometric Recognition, pp. 178-184, November 16-17, 2013.
12 Y. Huang, J. Zhao, M. Tian, Q. Zou, S. Luo, "Slow Feature Discriminant Analysis and its application on handwritten digit recognition," in Proc. of International Symposium on Neural Networks, pp. 1294-1297, June 14-19, 2009.
13 X. Gu, C. Liu, S. Wang, C. Zhao, "Feature extraction using adaptive slow feature discriminant analysis," Neurocomputing,vol.154, pp. 139-148, Aprial, 2015,   DOI
14 Z. Jin, J.-Y. Yang, Z.-M. Tang, Z.-S. Hu, "A theorem on the uncorrelated optimal discriminant vectors," Pattern Recognition, vol. 34, no.10, pp. 2041-2047, October, 2001.   DOI
15 X. Jing, S. Li, D. Zhang, J. Yang, "Face recognition based on local uncorrelated and weighted global uncorrelated discriminant transforms," in Proc. of IEEE International Conference on Image Processing, pp. 3049-3052, September 11-14, 2011.
16 C. Zhao, D. Miao, Z. Lai, C. Gao, C. Liu, J. Yang, "Two-dimensional color uncorrelated discriminant analysis for face recognition," Neurocomputing, vol. 113, pp. 251-261, August, 2013,   DOI
17 J. Yang, D. Zhang, A. F. Frangi, J.-y. Yang, "Two-dimensional pca: a new approach to appearance-based face representation and recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no.1, pp.131-137, January, 2004,   DOI
18 X. Li, Y. Pang, Y. Yuan, "L1-norm-based 2dpca," IEEE transactions on systems, man, and cybernetics. Part B, vol. 40, no.4, pp. 1170-1175, August 2010,   DOI
19 M. Li, B. Yuan, "2d-lda: A statistical linear discriminant analysis for image matrix," Pattern Recognition Letters, vol. 26, no. 5, pp. 527-532, Aprial, 2005.   DOI
20 F. Zhang, J. Yang, J. Qian, Y. Xu, "Nuclear norm-based 2-dpca for extracting features from images," IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no.10, October, 2015.
21 S. Chen, H. Zhao, M. Kong, B. Luo, "2d-lpp: a two-dimensional extension of locality preserving projections," Neurocomputing, vol.70, no.4, pp. 912-921, January, 2007.   DOI
22 D. Hu, G. Feng, Z. Zhou, "Two-dimensional locality preserving projections (2dlpp) with its application to palmprint recognition," Pattern recognition, vol. 40, no.1, pp. 339-342, January, 2007.   DOI
23 B. Niu, Q. Yang, S. C. K. Shiu, S. K. Pal, "Two-dimensional laplacianfaces method for face recognition," Pattern Recognition, vol. 41, no.10, pp.3237-3243, October, 2008.   DOI
24 H. Zhang, Q. M. Wu, Tommy W. S. Chow, and M. Zhao, "A two-dimensional Neighborhood Preserving Projection for appearance-based face recognition," Pattern Recognition, vol. 45, no. 5, pp. 1866-1876, May, 2012.   DOI
25 H. Zhao, H. Xing, X. Wang et al., "$L_1$-Norm-Based 2DLPP," in Proc. of Control and Decision Conference, vol. 1-6, pp.1259-1264, May 23-25, 2011.
26 Y. Tang, Z. Zhang,Y. Zhang et al., "Robust $L_1$-norm matrixed locality preserving projection for discriminative subspace learning," in Proc. of International Joint Conference on Neural Networks, pp.4199-4204, July 24-29, 2016.
27 F. Nie, H. Huang, X. Cai, C. H. Ding, "Efficient and robust feature selection via joint $l_{2,1}$-norms minimization," Advances in Neural Information Processing Systems, pp. 1813-1821, December 6-9 2010.
28 D. Zhang, Z.-H. Zhou, "(2d) 2pca: Two-directional two-dimensional pca for efficient face representation and recognition," Neurocomputing, vol.69, no.1, pp.224-231, September 17-19, 2005.   DOI
29 Q. Gu, Z. Li, J. Han, "Joint feature selection and subspace learning," in Proc. of International Joint Conference on Artificial Intelligence, pp. 1294-1299, July 16-22, 2011.
30 H. Kong, L. Wang, E. K. Teoh, X. Li, J.-G. Wang, R. Venkateswarlu, "Generalized 2d principal component analysis for face image representation and recognition," Neural Networks, vol.18, no.5, pp. 585-594, June, 2005.   DOI
31 Y. Li, Z. Tan, Y. Zhan, "Two-dimensional bilinear preserving projections for image feature extraction and classification," Neural Computing and Applications, vol.24, no.3-4, pp.901-909, March, 2014.   DOI
32 J. Yang, C. Liu, "Horizontal and vertical 2dpca-based discriminant analysis for face verification on a large-scale database," IEEE Transactions on Information Forensics and Security vol.2, no.4, pp.781-792, December, 2017.   DOI
33 X. Gu, C. Liu, S. Wang, C. Zhao, S. Wu, "Uncorrelated slow feature discriminant analysis using globality preserving projections for feature extraction," Neurocomputing, vol.168, pp.488-499, November, 2015.   DOI
34 Z. Zhang, F.Li, M.Zhao et al., "Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction," IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, 26(4):1607-1622, Aprial, 2017.   DOI
35 D. Cai, X. He, J. Han, "Spectral regression for efficient regularized subspace learning," in Proc. of International Conference on Computer Vision, pp. 214-221, October 14-21, 2007.
36 Jinhui Tang, Zechao Li, Meng Wang, Ruizhen Zhao. "Neighborhood Discriminant Hashing for Large-Scale Image Retrieval," IEEE Transactions on Image Processing, vol. 24, no. 9, 2015.
37 Z. Lai, M. Wan, Z. Jin, J. Yang, "Sparse two-dimensional local discriminant projections for feature extraction," Neurocomputing, vol.74, no.4, pp. 629-637, January, 2011.   DOI
38 Z. Zhang, F. Li, M. Zhao, et al. "Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction," IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society, vol. 26, no. 4, pp. 1607-1622, 2017.   DOI
39 N. Ali, B.Bajwa, R.Sablatnig and Z. Mehmood. "Image retrieval by addition of spatial information based on histograms of triangular regions," Computers & Electrical Engineering, vol. 54, pp. 539-550, August , 2016,   DOI
40 N.Ali, K.Bajwa et al., "A Novel Image Retrieval Based on Visual Words Integration of SIFT and SURF," Plos One, vol.11, no.6, pp.e0157428, Jun, 2016,   DOI
41 Haojie Li, Xiaohui Wang, Jinhui Tang, Chunxia Zhao, "Combining global and local matching of multiple features for precise item image retrieval," Multimedia Syst., vol. 19, no. 1, pp, 37-49, February, 2013,   DOI
42 H. Tan,Y. Gao,Z. Ma, "Regularized constraint subspace based method for image set classification," Pattern Recognition, vol.76, PP. 434-448, April, 2017.
43 X. Zhu, X. Li, S. Zhang, "Block-Row Sparse Multiview Multilabel Learning for Image Classification," IEEE Transactions on Cybernetics, vol.46, no.2, pp.450-461, February, 2015.   DOI
44 M. Turk, A. Pentland, "Eigenfaces for Recognition," Journal of Cognitive Neuroscience,vol. 3, no.1, pp. 71-86, 1991.   DOI
45 P. N. Belhumeur, J. P. Hespanha, D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, pp. 711-720, July,1997.   DOI
46 X. He, S. Yan, Y. Hu, P. Niyogi, H.-J. Zhang,"Face recognition using laplacianfaces," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 328-340, March, 2005,   DOI
47 X. He, D. Cai, S. Yan, H.-J. Zhang, "Neighborhood preserving embedding," in Proc. of IEEE International Conference on Computer Vision, Vol. 2, pp. 1208-1213 , October 17-20, 2005,
48 T. Zhang, J. Yang, D. Zhao, X. Ge, "Linear local tangent space alignment and application to face recognition," Neurocomputing,vol.70, no.7, pp. 1547-1553, March, 2007.   DOI