Browse > Article
http://dx.doi.org/10.3745/JIPS.04.0197

A Graph Embedding Technique for Weighted Graphs Based on LSTM Autoencoders  

Seo, Minji (Dept. of Computer Science, Sookmyung Women's University)
Lee, Ki Yong (Dept. of Computer Science, Sookmyung Women's University)
Publication Information
Journal of Information Processing Systems / v.16, no.6, 2020 , pp. 1407-1423 More about this Journal
Abstract
A graph is a data structure consisting of nodes and edges between these nodes. Graph embedding is to generate a low dimensional vector for a given graph that best represents the characteristics of the graph. Recently, there have been studies on graph embedding, especially using deep learning techniques. However, until now, most deep learning-based graph embedding techniques have focused on unweighted graphs. Therefore, in this paper, we propose a graph embedding technique for weighted graphs based on long short-term memory (LSTM) autoencoders. Given weighted graphs, we traverse each graph to extract node-weight sequences from the graph. Each node-weight sequence represents a path in the graph consisting of nodes and the weights between these nodes. We then train an LSTM autoencoder on the extracted node-weight sequences and encode each nodeweight sequence into a fixed-length vector using the trained LSTM autoencoder. Finally, for each graph, we collect the encoding vectors obtained from the graph and combine them to generate the final embedding vector for the graph. These embedding vectors can be used to classify weighted graphs or to search for similar weighted graphs. The experiments on synthetic and real datasets show that the proposed method is effective in measuring the similarity between weighted graphs.
Keywords
Graph Embedding; Graph Similarity; LSTM Autoencoder; Weighted Graph Embedding; Weighted Graph;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 S. V. N. Vishwanathan, N. N. Schraudolph, R. Kondor, and K. M. Borgwardt, "Graph kernels," Journal of Machine Learning Research, vol. 11, pp. 1201-1242, 2010.
2 F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Monfardini, "The graph neural network model," IEEE Transactions on Neural Networks, vol. 20, no. 1, pp. 61-80, 2009.   DOI
3 T. N. Kipf and M. Welling, "Semi-supervised classification with graph convolutional networks," in Proceedings of International Conference on Learning Representations (ICLR), Toulon, France, 2017.
4 A. Taheri, K. Gimpel, and T. Berger-Wolf, "Learning graph representations with recurrent neural network autoencoders," in Proceedings of the 24th ACM SIGKDD Conference of Knowledge Discovery and Data Mining: Deep Learning Day, London, UK, 2018.
5 P. Yanardag and S. V. N. Vishwanathan, "Deep graph kernels," in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia, 2015, pp. 1364-1374.
6 A. Narayanan, M. Chandramohan, R. Venkatesan, L. Chen, Y., and S. Jaiswal, "graph2vec: learning distributed representations of graphs," in Proceedings of 13th International Workshop on Mining and Learning with Graphs (MLG), Halifax, Canada, 2017.
7 Q. Le and T. Mikolov, "Distributed representations of sentences and documents," in Proceedings of International Conference on Machine Learning, Beijing, China, 2014, pp. 1188-1196.
8 T. Mikolov, K. Chen, G. Corrado, and J. Dean, "Efficient estimation of word representations in vector space," 2013 [Online]. Available: https://arxiv.org/abs/1301.3781.
9 P. Goyal and E. Ferrara, "Graph embedding techniques, applications, and performance: a survey," Knowledge-Based Systems, vol. 151, pp. 78-94, 2018.   DOI
10 S. Hochreiter and J. Schmidhuber. "Long short-term memory," Neural computation, vol. 9, no. 8, pp.1735-1780, 1997.   DOI
11 M. A. Kramer, "Nonlinear principal component analysis using autoassociative neural networks," AIChE Journal, vol. 37, no. 2, pp. 233-243, 1991.   DOI
12 S. Maity, M. Abdel-Mottaleb, and S. S. Asfour, "Multimodal biometrics recognition from facial video with missing modalities using deep learning," Journal of Information Processing Systems, vol. 16, no. 1, pp. 6-29, 2020.   DOI
13 A. Grover and J. Leskovec, "node2vec: scalable feature learning for networks," in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 2016, pp. 855-864.
14 PubChem: an open chemistry database at the National Institutes of Health [Online]. Available: https://pubchem.ncbi.nl m.nih.gov/.
15 H. Cai, V. W. Zheng, and K. C. C. Chang, "A comprehensive survey of graph embedding: problems, techniques, and applications," IEEE Transactions on Knowledge and Data Engineering, vol. 30, no. 9, pp. 1616-1637, 2018.   DOI
16 M. Seo and K. Y. Lee, "A weighted graph embedding technique based on LSTM autoencoders," in Proceedings of the Korea Software Congress (KSC), Pyeongchang, South Korea, 2019.
17 M. J. J. Ghrabat, G. Ma, I. Y. Maolood, S. S. Alresheedi, and Z. A. Abduliabbar, "An effective image retrieval based on optimized genetic algorithm utilized a novel SVM-based convolutional neural network classifier," Human-centric Computing and Information Sciences, vol. 9, article no. 31, 2019.
18 D. Lee and J. H. Park, "Future trends of AI-based smart systems and services: challenges, opportunities, and solutions," Journal of Information Processing Systems, vol. 15, no. 4, pp. 717-723, 2019.   DOI
19 E. Gultepe and M. Makrehchi, "Improving clustering performance using independent component analysis and unsupervised feature learning," Human-centric Computing and Information Sciences, vol. 8, article no. 25, 2018.