KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Dual graph-regularized Constrained Nonnegative Matrix Factorization for Image Clustering

  • Sun, Jing (School of Electronics and Information Engineering, Liaoning University of Technology) ;
  • Cai, Xibiao (School of Electronics and Information Engineering, Liaoning University of Technology) ;
  • Sun, Fuming (School of Electronics and Information Engineering, Liaoning University of Technology) ;
  • Hong, Richang (School of Computer and Information, Hefei University of Technology)
  • Received : 2016.12.05
  • Accepted : 2017.03.12
  • Published : 2017.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Nonnegative matrix factorization (NMF) has received considerable attention due to its effectiveness of reducing high dimensional data and importance of producing a parts-based image representation. Most of existing NMF variants attempt to address the assertion that the observed data distribute on a nonlinear low-dimensional manifold. However, recent research results showed that not only the observed data but also the features lie on the low-dimensional manifolds. In addition, a few hard priori label information is available and thus helps to uncover the intrinsic geometrical and discriminative structures of the data space. Motivated by the two aspects above mentioned, we propose a novel algorithm to enhance the effectiveness of image representation, called Dual graph-regularized Constrained Nonnegative Matrix Factorization (DCNMF). The underlying philosophy of the proposed method is that it not only considers the geometric structures of the data manifold and the feature manifold simultaneously, but also mines valuable information from a few known labeled examples. These schemes will improve the performance of image representation and thus enhance the effectiveness of image classification. Extensive experiments on common benchmarks demonstrated that DCNMF has its superiority in image classification compared with state-of-the-art methods.

Keywords

References

  1. J. Wright, A. Y. Yang and A. G. Thuy, "Robust face recognition via sparse representation," in Proc. of 8th Int. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1-2, September 17-19, 2008.
  2. Z. Li, J. Liu, Y. Yang and X. Zhou, "Clustering-guided sparse structural learning for unsupervised feature selection," IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 9, pp. 2138-2150, September, 2014. https://doi.org/10.1109/TKDE.2013.65
  3. A. K. Jain, M. N. Murty and P. J. Flynn, "Data clustering: a review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, September, 1999. https://doi.org/10.1145/331499.331504
  4. T. M. Mitchell, J. G. Garbonell and R. S. Michalski, "Machine learning,"McGraw-Hill, New York, 1986.
  5. H. Zha, X. He, C. H. Q. Ding, H. D. Simon and M. Gu, "Spectral relaxation for k-means clustering," in Proc. of 14th Int. Neural Information Processing Systems: Natural and Synthetic, pp.1057-1064, December 3-8, 2001.
  6. I. Dhillon, Y. Guan and B. Kulis, "Weighted graph cuts without eigenvectors: a multilevel approch," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1944-1957, September, 2007. https://doi.org/10.1109/TPAMI.2007.1115
  7. C. H. Q. Ding and X. He, "On the equivalence of non-negative matrix factorization and spectral clustering," in Proc. of 5th Int. SIAM Conference on Data Mining, pp.606-610, April 21-23, 2005.
  8. D. D. Lee and H. S. Seung, "Algorithms for nonnegative matrix factorization," in Proc. of 13th Int. Advances in Neural Information Processing Systems (NIPS), pp.556-562, November 27-30, 2000.
  9. D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 6755, no. 401, pp. 788-791, October, 1999.
  10. F. Sun, M. Xu, X. Hu and X. Jiang, "Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation," Neurocomputing, vol. 173, no. 2, pp. 233-244, January, 2016. https://doi.org/10.1016/j.neucom.2015.01.103
  11. P. Paatero and U. Tapper, "Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, pp. 111-126, June, 1994. https://doi.org/10.1002/env.3170050203
  12. F. Shang, L. C. Jiao, J. Shi and J. Chai, "Robust positive semidefinite L-Isomap ensemble," Pattern Recognition Letters, vol. 32, no. 4, pp. 640-649, March, 2011. https://doi.org/10.1016/j.patrec.2010.12.005
  13. X. B. Shu, J.H. Tang, G. J. Qi, Z. C. Li, Y. G. Jiang and S. C. Yan, "Image classification with tailored fine-grained dictionaries," IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, September, 2016.
  14. J. B. Tenenbaum, V. de Silva and J.C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, December, 2000. https://doi.org/10.1126/science.290.5500.2319
  15. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, December, 2000. https://doi.org/10.1126/science.290.5500.2323
  16. M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," Advances in Neural Informatioon Processing Systems, vol. 14, no. 9, pp. 585-591, April, 2002.
  17. M. Belkin, P. Niyogi and V. Sindhwani, "Manifold regularization: a geometric framework for learning from labeled and unlabeled examples," Journal of Machine Learning Research, vol. 7, no. 1, pp. 2399-2434, December, 2006.
  18. C. Deng, X. He, J. Han and T. S. Huang, "Graph regularized non-negative matrix factorization for data representation," IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI), vol. 33, no. 8, pp. 1548-1560, December, 2010. https://doi.org/10.1109/TPAMI.2010.231
  19. V. Sindhwani, J. Hu and A. Mojsilovic, "Regularized co-clustering with dual supervision," in Proc. of 21th Int. Advances in Neural Information Processing Systems (NIPS), pp.1505-1512, December 8-11, 2008.
  20. A. Narita, K. Hayashi, R. Tomioka and H. Kashima, "Tensor factorization using auxiliary information," Data Mining and Knowledge Discovery, vol. 25, no. 2, pp. 501-516, September, 2012.
  21. F. Sun, J. Tang, H. Li, G. J. Qi and T. S. Huang, "Multi-label image categorization with sparse factor representation," IEEE Transactions on Image Processing, vol. 23, no. 3, pp.1028-1037, March, 2014. https://doi.org/10.1109/TIP.2014.2298978
  22. X. Jia, F. Sun, H. Li, Y. Cao and X. Zhang, "Image multi-label annotation based on supervised nonnegative matrix factorization with new matching measurement," Neurocomputing, September, 2016.
  23. Q. Gu and J. Zhou, "Co-clustering on manifolds," in Proc. of 15th Int. ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pp.359-368, June 28-July 01, 2009.
  24. F. H. Shang, L. C. Jiao and F. Wang, "Graph dual regularization non-negative matrix factorization for co-clustering," Pattern Recognition, vol. 45, no. 6, pp. 2237-2250, June, 2012. https://doi.org/10.1016/j.patcog.2011.12.015
  25. H. Liu, Z. Wu, D. Cai and T. S. Huang, "Constrained non-negative matrix factorization for image representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1299-1311, July, 2012. https://doi.org/10.1109/TPAMI.2011.217
  26. Z. Q. Shu and C. X. Zhao, "Graph-regularized constrained non-negative matrix factorization algorithm and its application to image representation," Pattern Recognition and Artificial Intelligence, vol. 26, no. 3, pp. 300-306, March, 2013.
  27. W. Michael, A. Shakhina and W. G. Stewart, "Computing sparse reduced-rank approximations to sparse matrices," ACM Transactions on Mathematical Software (TOMS), vol. 31, no.2, pp. 252-269, June, 2005. https://doi.org/10.1145/1067967.1067972

Cited by

  1. Vehicle Face Recognition Algorithm Based on Weighted Nonnegative Matrix Factorization with Double Regularization Terms vol.14, pp.5, 2017, https://doi.org/10.3837/tiis.2020.05.017