KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Feature Extraction via Sparse Difference Embedding (SDE)

  • Wan, Minghua (College of Computer Science and Software Engineering, Shenzhen University) ;
  • Lai, Zhihui (College of Computer Science and Software Engineering, Shenzhen University)
  • Received : 2016.12.11
  • Accepted : 2017.04.28
  • Published : 2017.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

The traditional feature extraction methods such as principal component analysis (PCA) cannot obtain the local structure of the samples, and locally linear embedding (LLE) cannot obtain the global structure of the samples. However, a common drawback of existing PCA and LLE algorithm is that they cannot deal well with the sparse problem of the samples. Therefore, by integrating the globality of PCA and the locality of LLE with a sparse constraint, we developed an improved and unsupervised difference algorithm called Sparse Difference Embedding (SDE), for dimensionality reduction of high-dimensional data in small sample size problems. Significantly differing from the existing PCA and LLE algorithms, SDE seeks to find a set of perfect projections that can not only impact the locality of intraclass and maximize the globality of interclass, but can also simultaneously use the Lasso regression to obtain a sparse transformation matrix. This characteristic makes SDE more intuitive and more powerful than PCA and LLE. At last, the proposed algorithm was estimated through experiments using the Yale and AR face image databases and the USPS handwriting digital databases. The experimental results show that SDE outperforms PCA LLE and UDP attributed to its sparse discriminating characteristics, which also indicates that the SDE is an effective method for face recognition.

Keywords

References

  1. W. Fang, P. Ma, Z. Cheng, D. Yang, X. Zhang, "2-dimensional projective non-negative matrix factorization and its application to face recognition [J]," Acta Automatica Sinica, 38: 1503-1512, 2012. https://doi.org/10.3724/SP.J.1004.2012.01503
  2. M. Shao, D. Kit, Y. Fu, "Generalized transfer subspace learning through low-rank constraint [J]," International Journal of Computer Vision, 109: 74-93, 2014. https://doi.org/10.1007/s11263-014-0696-6
  3. Y. Xie, W. Zhang, Y. Qu, "Discriminative subspace learning with sparse representation view-based model for robust visual tracking [J]," Pattern Recognition, 47: 1383-1394, 2014. https://doi.org/10.1016/j.patcog.2013.07.010
  4. S. Wang, W. Pedrycz, Q. Zhu, "Subspace learning for unsupervised feature selection via matrix factorization [J]," Pattern Recognition, 48: 10-19, 2015. https://doi.org/10.1016/j.patcog.2014.08.004
  5. M. Turk, A. Pentland, "Eigenfaces for recognition [J]," Cognitive Neuroscience, 3: 71-86, 1991. https://doi.org/10.1162/jocn.1991.3.1.71
  6. D. Swets, J. Weng, "Using discriminant eigenfeatures for image retrieval [J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 18: 831-836, 1996. https://doi.org/10.1109/34.531802
  7. Wan, Minghua, et al., "Local graph embedding based on maximum margin criterion via fuzzy set[J]," Fuzzy Sets and Systems 318, 120-131, 2017. https://doi.org/10.1016/j.fss.2016.06.001
  8. S. Roweis, L. Saul, "Nonlinear Dimensional Reduction by Locally Linear Embedding [J]," Science. 290: 2323-2326, 2000. https://doi.org/10.1126/science.290.5500.2323
  9. J. Tenenbaum, V. DeSilva, J. Langford, "A Global Geometric Framework for Nonlinear Dimensionality Reduction [J]," Science, 290: 2319-2323, 2000. https://doi.org/10.1126/science.290.5500.2319
  10. M. Belkin, P. Niyogi, "Laplacian Eigenmaps for Dimensionality Reduction and Data Representation [J]," Neural Computation.15: 1373-1396, 2003. https://doi.org/10.1162/089976603321780317
  11. Wan, Minghua, et al., "Feature extraction using two-dimensional maximum embedding difference[J]," Information Sciences, 274, 55-69, 2014. https://doi.org/10.1016/j.ins.2014.02.145
  12. X. He, S. Yan, Y. Hu, Niyogi, H. Zhang. Face Recognition Using Laplacianfaces [J]," IEEE Trans. Pattern Analysis and Machine Intelligence, 27: 328-340, 2005. https://doi.org/10.1109/TPAMI.2005.55
  13. J. Yang, D. Zhang, J.Y. Yang, B. Niu, "Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics [J]," IEEE Trans Pattern Anal and Mach Intelligence, 29: 650-664, 2007. https://doi.org/10.1109/TPAMI.2007.1008
  14. Gao S Q, Jing X Y, Lan C, et al, "Feature extraction based on sparsity embedding with manifold information for face recognition[C]," in Proc. of Computational Intelligence and Software Engineering (CiSE), 2010 International Conference on. IEEE, 2010.
  15. Z. Lai, "Sparse facial feature extraction via Manifold learning [D]," Nanjing University of Technology and Engineering, 2011.
  16. A. Wagner, J. Wright, "A. Ganesh, et al. Toward a practical face recognition system: Robust alignment and illumination by sparse representation [J]," IEEE Trans on Pattern Analysis and Machine Intelligence, 34: 372-386, 2012. https://doi.org/10.1109/TPAMI.2011.112
  17. J. Yang, L. Zhang, Y. Xu, "Beyond sparsity: The role of L1-optimizer in pattern classification [J]," Pattern Recognition, 45: 1104-1118, 2012. https://doi.org/10.1016/j.patcog.2011.08.022
  18. Tibshirani, Robert, "Regression shrinkage and selection via the lasso: a retrospective," Journal of the Royal Statistical Society: Series B (Statistical Methodology) 73.3, 273-282, 2011. https://doi.org/10.1111/j.1467-9868.2011.00771.x
  19. B. Efron, T. Hastie, I. Johnstone, "Least angle regression [J]," Annals of Statistics, 32(2):407-99, 2004. https://doi.org/10.1214/009053604000000067
  20. H. Zou, T. Hastie, "Regression shrinkage and selection via the Elastic Net, with applications to microarrays [J]," Journal of the Royal Statistical Society Series B: Methodological, 67: 301-320, 2005. https://doi.org/10.1111/j.1467-9868.2005.00503.x
  21. Li Z, Liu J, Tang J, et al, "Robust structured subspace learning for data representation[J]," IEEE transactions on pattern analysis and machine intelligence, 37(10): 2085-2098, 2015. https://doi.org/10.1109/TPAMI.2015.2400461
  22. Li Z, Tang J, "Unsupervised feature selection via nonnegative spectral analysis and redundancy control[J]," IEEE Transactions on Image Processing, 24(12): 5343-5355, 2015. https://doi.org/10.1109/TIP.2015.2479560
  23. Li Z, Tang J, "Weakly Supervised Deep Matrix Factorization for Social Image Understanding[J]," IEEE Transactions on Image Processing, 26(1): 276-288, 2017. https://doi.org/10.1109/TIP.2016.2624140
  24. Zhang D, He J, Zhao Y, et al, "Global plus local: A complete framework for feature extraction and recognition[J]," Pattern Recognition, 47(3): 1433-1442, 2014. https://doi.org/10.1016/j.patcog.2013.10.005
  25. M. Imani, H. Ghassemian, "Ridge regression-based feature extraction for hyperspectral data [J]," International Journal of Remote Sensing, 36: 1728-1742, 2015. https://doi.org/10.1080/01431161.2015.1024894

Cited by

  1. Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements vol.10, pp.10, 2020, https://doi.org/10.3390/app10103479