Browse > Article
http://dx.doi.org/10.3837/tiis.2022.03.004

Multi-view Clustering by Spectral Structure Fusion and Novel Low-rank Approximation  

Long, Yin (School of Computer and Science Technology, Southwest University of Science and Technology)
Liu, Xiaobo (School of Computer and Science Technology, Southwest University of Science and Technology)
Murphy, Simon (School of Computer Science, University of Alberta)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.3, 2022 , pp. 813-829 More about this Journal
Abstract
In multi-view subspace clustering, how to integrate the complementary information between perspectives to construct a unified representation is a critical problem. In the existing works, the unified representation is usually constructed in the original data space. However, when the data representation in each view is very diverse, the unified representation derived directly in the original data domain may lead to a huge information loss. To address this issue, different to the existing works, inspired by the latest revelation that the data across all perspectives have a very similar or close spectral block structure, we try to construct the unified representation in the spectral embedding domain. In this way, the complementary information across all perspectives can be fused into a unified representation with little information loss, since the spectral block structure from all views shares high consistency. In addition, to capture the global structure of data on each view with high accuracy and robustness both, we propose a novel low-rank approximation via the tight lower bound on the rank function. Finally, experimental results prove that, the proposed method has the effectiveness and robustness at the same time, compared with the state-of-art approaches.
Keywords
Multi-view subspace clustering; rank-norm approximation; multi-view fusion; spectral structure; ADMM;
Citations & Related Records
연도 인용수 순위
  • Reference
1 G. Chao, S. Sun, and J. Bi, "A survey on multi-view clustering," arXiv preprint arXiv:1712.06246, Dec. 2017.
2 C. Lu, S. Yan and Z. Lin, "Convex sparse spectral clustering: Single-view to multi-view," IEEE Trans. Image Process., vol. 25, no. 6, pp. 2833-2843, Apr. 2016.   DOI
3 Z. Kang, G. Shi, S. Huang, W. Chen, X. Pu, J. T. Zhou and Z. Xu, "Multi-graph fusion for multi-view spectral clustering," Knowl. Based Syst., vol. 189, pp. 105102-105110, Feb. 2020.   DOI
4 K. Fan, "On a theorem of Weyl concerning eigenvalues of linear transformations I," in Proc of the National Academy of Sciences of the United States of America, vol. 35, no. 11, pp. 652-655, Nov. 1949.   DOI
5 Y. Wang, L. Wu, X. Lin and J. Gao, "Multiview spectral clustering via structured low-rank matrix factorization," IEEE Trans. Neural Networks Learn. Syst., vol. 29, no. 10, pp. 4833-4843, 2018.   DOI
6 S. Gu, Q. Xie, D. Meng, W. Zuo, X. Feng and L. Zhang, "Weighted nuclear norm minimization and its applications to low level vision," Int. J. Comput. Vis., vol. 121, no. 2, pp. 183-208, Jan. 2017.   DOI
7 I, Daubechies, M. Defrise and C. De Mol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, Aug. 2004.   DOI
8 D. L. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, May 1995.   DOI
9 M. Brbic, M. Piskorec, V. Vidulin, A. Krisko, T. Smuc and F. Supek, "The landscape of microbial phenotypic traits and associated genes," Nucleic Acids Res., vol. 44, no. 21, pp. 10074-10090, Dec. 2016.   DOI
10 S. Liu, X. Liu, S. Wang and K. Muhammad, "Fuzzy-aided solution for out-of-view challenge in visual tracking under iot-assisted complex environment," Neural. Comput. Appl., vol. 33, pp.1055-1065, Feb. 2021.   DOI
11 S. Wang, D. Liu, and Z. Zhang, "Nonconvex relaxation approaches to robust matrix recovery," in Proc of the Twenty-Third International Joint Conference on Artificial Intelligence, pp. 1764-1770, Aug. 2013.
12 S. Liu, S. Wang, X. Liu, C. T. Lin and Z. Lv, "Fuzzy detection aided real-time and robust visual tracking under complex environments," IEEE Trans. Fuzzy Syst., vol. 29, pp. 90-102, Jun. 2020.
13 D. D. Lewis, Y. Yang, T.G. Rose and F. Li, "Rcv1: A new benchmark collection for text categorization research," J. Mach. Learn. Res., vol. 5, pp. 361-397, Apr. 2004.
14 R. K. Xia, P. Yan, D. Lei and Y. Jian, "Robust multi-view spectral clustering via low-rank and sparse decomposition," in Proc of the AAAI conference on artificial intelligence, Quebec, Canada, vol. 28, no. 1, pp. 2149-2155, Jun. 2014.
15 X. Cao, C. Zhang, H. Fu, S. Liu and H. Zhang, "Diversity-induced multi-view subspace clustering," in Proc of the IEEE conference on computer vision and pattern recognition, pp. 586-594, 2015.
16 F. Nie, J. Li and X. Li, "Self-weighted Multiview Clustering with Multiple Graphs," in Proc of the Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 2564-2570, 2017.
17 G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal., vol. 35, no. 1, pp. 171-184, Jan. 2013.   DOI
18 J. Cao, Y. Fu, X. Shi and B. W. Ling, "Subspace Clustering Based on Latent Low Rank Representation with Schatten-p Norm," in Proc of the 2020 2nd World Symposium on Artificial Intelligence, Guangzhou, China, pp. 58-62, Jul. 2020.
19 H. Zhang, J. Yang, J. Xie, J. Qin and B. Zhang, "Weighted sparse coding regularized nonconvex matrix regression for robust face recognition," Inf. Sci., vol. 394, pp. 1-17, Jul. 2017.   DOI
20 S. Liu, S. Wang, X. Liu, A. H. Gandomi, M. Daneshmand, K. Muhammad and V. H. C. De Albuquerque, "Human memory update strategy: a multi-layer template update mechanism for remote visual monitoring," IEEE Trans. Multimedia, vol. 23, pp. 2188-2198, Mac. 2021.   DOI
21 X. Wang, X. Guo, Z. Lei, C. Zhang and S. Z. Li, "Exclusivity-consistency regularized multi-view subspace clustering," in Proc of the IEEE conference on computer vision and pattern recognition, pp. 923-931, 2017.
22 M. Brbic, I. Kopriva, "Multi-view low-rank sparse subspace clustering," Pattern Recognit., vol. 73, pp. 247-258, Jan. 2018.   DOI
23 C. Xu, D. Tao and C. Xu, "A survey on multi-view learning," arXiv preprint arXiv:1304.5634, Apr. 2013.