Browse > Article
http://dx.doi.org/10.3837/tiis.2017.05.017

Dual graph-regularized Constrained Nonnegative Matrix Factorization for Image Clustering  

Sun, Jing (School of Electronics and Information Engineering, Liaoning University of Technology)
Cai, Xibiao (School of Electronics and Information Engineering, Liaoning University of Technology)
Sun, Fuming (School of Electronics and Information Engineering, Liaoning University of Technology)
Hong, Richang (School of Computer and Information, Hefei University of Technology)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.11, no.5, 2017 , pp. 2607-2627 More about this Journal
Abstract
Nonnegative matrix factorization (NMF) has received considerable attention due to its effectiveness of reducing high dimensional data and importance of producing a parts-based image representation. Most of existing NMF variants attempt to address the assertion that the observed data distribute on a nonlinear low-dimensional manifold. However, recent research results showed that not only the observed data but also the features lie on the low-dimensional manifolds. In addition, a few hard priori label information is available and thus helps to uncover the intrinsic geometrical and discriminative structures of the data space. Motivated by the two aspects above mentioned, we propose a novel algorithm to enhance the effectiveness of image representation, called Dual graph-regularized Constrained Nonnegative Matrix Factorization (DCNMF). The underlying philosophy of the proposed method is that it not only considers the geometric structures of the data manifold and the feature manifold simultaneously, but also mines valuable information from a few known labeled examples. These schemes will improve the performance of image representation and thus enhance the effectiveness of image classification. Extensive experiments on common benchmarks demonstrated that DCNMF has its superiority in image classification compared with state-of-the-art methods.
Keywords
Nonnegative matrix factorization; dual graph-regularized; manifold; feature manifold; label information;
Citations & Related Records
연도 인용수 순위
  • Reference
1 W. Michael, A. Shakhina and W. G. Stewart, "Computing sparse reduced-rank approximations to sparse matrices," ACM Transactions on Mathematical Software (TOMS), vol. 31, no.2, pp. 252-269, June, 2005.   DOI
2 J. Wright, A. Y. Yang and A. G. Thuy, "Robust face recognition via sparse representation," in Proc. of 8th Int. IEEE International Conference on Automatic Face and Gesture Recognition, pp. 1-2, September 17-19, 2008.
3 Z. Li, J. Liu, Y. Yang and X. Zhou, "Clustering-guided sparse structural learning for unsupervised feature selection," IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 9, pp. 2138-2150, September, 2014.   DOI
4 A. K. Jain, M. N. Murty and P. J. Flynn, "Data clustering: a review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, September, 1999.   DOI
5 T. M. Mitchell, J. G. Garbonell and R. S. Michalski, "Machine learning,"McGraw-Hill, New York, 1986.
6 H. Zha, X. He, C. H. Q. Ding, H. D. Simon and M. Gu, "Spectral relaxation for k-means clustering," in Proc. of 14th Int. Neural Information Processing Systems: Natural and Synthetic, pp.1057-1064, December 3-8, 2001.
7 I. Dhillon, Y. Guan and B. Kulis, "Weighted graph cuts without eigenvectors: a multilevel approch," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 1944-1957, September, 2007.   DOI
8 C. H. Q. Ding and X. He, "On the equivalence of non-negative matrix factorization and spectral clustering," in Proc. of 5th Int. SIAM Conference on Data Mining, pp.606-610, April 21-23, 2005.
9 D. D. Lee and H. S. Seung, "Algorithms for nonnegative matrix factorization," in Proc. of 13th Int. Advances in Neural Information Processing Systems (NIPS), pp.556-562, November 27-30, 2000.
10 D. D. Lee and H. S. Seung, "Learning the parts of objects by non-negative matrix factorization," Nature, vol. 6755, no. 401, pp. 788-791, October, 1999.
11 F. Sun, M. Xu, X. Hu and X. Jiang, "Graph regularized and sparse nonnegative matrix factorization with hard constraints for data representation," Neurocomputing, vol. 173, no. 2, pp. 233-244, January, 2016.   DOI
12 P. Paatero and U. Tapper, "Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, no. 2, pp. 111-126, June, 1994.   DOI
13 F. Shang, L. C. Jiao, J. Shi and J. Chai, "Robust positive semidefinite L-Isomap ensemble," Pattern Recognition Letters, vol. 32, no. 4, pp. 640-649, March, 2011.   DOI
14 X. B. Shu, J.H. Tang, G. J. Qi, Z. C. Li, Y. G. Jiang and S. C. Yan, "Image classification with tailored fine-grained dictionaries," IEEE Transactions on Circuits and Systems for Video Technology, pp. 1-1, September, 2016.
15 J. B. Tenenbaum, V. de Silva and J.C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, December, 2000.   DOI
16 S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, December, 2000.   DOI
17 M. Belkin and P. Niyogi, "Laplacian eigenmaps and spectral techniques for embedding and clustering," Advances in Neural Informatioon Processing Systems, vol. 14, no. 9, pp. 585-591, April, 2002.
18 M. Belkin, P. Niyogi and V. Sindhwani, "Manifold regularization: a geometric framework for learning from labeled and unlabeled examples," Journal of Machine Learning Research, vol. 7, no. 1, pp. 2399-2434, December, 2006.
19 V. Sindhwani, J. Hu and A. Mojsilovic, "Regularized co-clustering with dual supervision," in Proc. of 21th Int. Advances in Neural Information Processing Systems (NIPS), pp.1505-1512, December 8-11, 2008.
20 C. Deng, X. He, J. Han and T. S. Huang, "Graph regularized non-negative matrix factorization for data representation," IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI), vol. 33, no. 8, pp. 1548-1560, December, 2010.   DOI
21 A. Narita, K. Hayashi, R. Tomioka and H. Kashima, "Tensor factorization using auxiliary information," Data Mining and Knowledge Discovery, vol. 25, no. 2, pp. 501-516, September, 2012.
22 F. Sun, J. Tang, H. Li, G. J. Qi and T. S. Huang, "Multi-label image categorization with sparse factor representation," IEEE Transactions on Image Processing, vol. 23, no. 3, pp.1028-1037, March, 2014.   DOI
23 X. Jia, F. Sun, H. Li, Y. Cao and X. Zhang, "Image multi-label annotation based on supervised nonnegative matrix factorization with new matching measurement," Neurocomputing, September, 2016.
24 Q. Gu and J. Zhou, "Co-clustering on manifolds," in Proc. of 15th Int. ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pp.359-368, June 28-July 01, 2009.
25 F. H. Shang, L. C. Jiao and F. Wang, "Graph dual regularization non-negative matrix factorization for co-clustering," Pattern Recognition, vol. 45, no. 6, pp. 2237-2250, June, 2012.   DOI
26 H. Liu, Z. Wu, D. Cai and T. S. Huang, "Constrained non-negative matrix factorization for image representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1299-1311, July, 2012.   DOI
27 Z. Q. Shu and C. X. Zhao, "Graph-regularized constrained non-negative matrix factorization algorithm and its application to image representation," Pattern Recognition and Artificial Intelligence, vol. 26, no. 3, pp. 300-306, March, 2013.