KIPS Transactions on Software and Data Engineering (정보처리학회논문지:소프트웨어 및 데이터공학)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Bilinear Graph Neural Network-Based Reasoning for Multi-Hop Question Answering

다중 홉 질문 응답을 위한 쌍 선형 그래프 신경망 기반 추론

  • Received : 2020.06.11
  • Accepted : 2020.07.22
  • Published : 2020.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Knowledge graph-based question answering not only requires deep understanding of the given natural language questions, but it also needs effective reasoning to find the correct answers on a large knowledge graph. In this paper, we propose a deep neural network model for effective reasoning on a knowledge graph, which can find correct answers to complex questions requiring multi-hop inference. The proposed model makes use of highly expressive bilinear graph neural network (BGNN), which can utilize context information between a pair of neighboring nodes, as well as allows bidirectional feature propagation between each entity node and one of its neighboring nodes on a knowledge graph. Performing experiments with an open-domain knowledge base (Freebase) and two natural-language question answering benchmark datasets(WebQuestionsSP and MetaQA), we demonstrate the effectiveness and performance of the proposed model.

지식 그래프 기반의 질문 응답 문제는 자연어 질문들에 대한 깊은 이해뿐만 아니라, 대규모 지식 그래프 상에서 올바른 답변을 찾기 위한 효과적인 추론 능력을 필요로 한다. 본 논문에서는 다중 홉 추론을 요구하는 복잡한 자연어 질문에 대해 연관 지식 그래프 위에서 답변 추론을 효과적으로 수행할 수 있는 심층 신경망 모델을 제안한다. 제안 모델에서는 지식 그래프 상의 각 개체 노드와 이웃 노드 간의 양방향 특징 전파를 허용할뿐만 아니라, 두 이웃 노드 쌍 간의 맥락 정보까지 활용할 수 있는, 표현력이 뛰어난 쌍 선형 그래프 신경망(BGNN)을 이용한다. 본 논문에서는 오픈 도메인의 지식 베이스인 Freebase, 자연어 질문 응답을 위한 벤치마크 데이터 집합들인 WebQuestionsSP와 MetaQA를 이용한 실험들을 통해, 제안 모델의 효과와 우수성을 확인하였다.

Keywords

References

  1. A. Miller, A. Fisch, J. Dodge, A. Karimi, A. Bordes and J. Weston, "Key-value memory networks for directly reading documents," in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, Texas, pp. 1400-1409, 2016.
  2. H. Sun, B. Dhingra, M. Zaheer, K. Mazaitis, R. Salakhutdinov and W. Cohen, "Open domain question answering using early fusion of knowledge bases and text," in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, pp. 4231-4242, 2018.
  3. T. N. Kipf and M. Welling, "Semi-supervised classification with graph convolutional networks," in Proceedings of the 5th International Conference on Learning Representations, Toulon, 2017.
  4. W. Yih, M. Richardson, C. Meek, M. Chang and J. Suh, "The value of semantic parse labeling for knowledge base question answering," in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, pp. 201-206, 2016.
  5. Y. Zhang, H. Dai, Z. Kozareva, A. J. Smola and L. Song, "Variational reasoning for question answering with knowledge graph," in Proceedings of Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, pp. 6069-6076, 2018.
  6. J. Lehmann, R. Isele, M. Jakob, A. Jentzsch, D. Kontokostas, P. N. Mendes, S. Hellmann, M. Morsey, P. V. Kleef, S. Auer and C. Bizer, “DBpedia - a large-scale, multilingual knowledge base extracted from wikipedia,” Semantic Web, Vol. 6, No. 2, pp. 167-195, 2015. https://doi.org/10.3233/SW-140134
  7. J. Berant, A. Chou, R. Frostig and P. Liang, "Semantic parsing on freebase from question-answer pairs," in Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, Washington, pp. 1533-1544, 2013.
  8. W. Yih, M. Chang, X. He and J. Gao, "Semantic parsing via staged query graph generation: Question answering with knowledge base," in Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, pp. 1321-1331, 2015.
  9. Y. Yang and M. Chang, "S-MART: novel tree-based structured learning algorithms applied to tweet entity linking," in Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, pp. 504-513, 2015.
  10. S. Sukhbaatar, A. Szlam, J. Weston and R. Fergus, "Endto-end memory networks," in Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, pp. 2440-2448, 2015.
  11. C. Liang, J. Berant, Q. Le, K. D. Forbus and N. Lao, "Neural symbolic machines: Learning semantic parsers on freebase with weak supervision," in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, pp. 23-33, 2017.
  12. R. Das, S. Dhuliawala, M. Zaheer, L. Vilnis, I. Durugkar, A. Krishnamurthy, A. Smola and A. McCallum, "Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning," in Proceedings of the 6th International Conference on Learning Representations, Vancouver, 2018.
  13. Y. Li, D. Tarlow, M. Brockschmidt and R. Zemel, "Gated graph sequence neural networks," in Proceedings of the 4th International Conference on Learning Representations, San Juan, 2016.
  14. P. Velickovic, G. Cucurull, A. Casanova, A. Romero, P. Lio and Y. Bengio, "Graph attention networks," in Proceedings of the 6th International Conference on Learning Representations, Vancouver, 2018.
  15. W. L. Hamilton, R. Ying and J. Leskovec, "Inductive representation learning on large graphs," in Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, California, pp. 1025-1035, 2017.
  16. H. Zhu, F. Feng, X. He, X. Wang, Y. Li, K. Zheng and Y. Zhang, "Bilinear graph neural network with neighbor interactions," arXiv preprint arXiv:2002.03575, 2020.
  17. D. Sorokin and I. Gurevych, "Modeling semantics with gated graph neural networks for knowledge base question answering," in Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, New Mexico, pp. 3306-3317, 2018.
  18. Y. Fang, S. Sun, Z. Gan, R. Pillai, S. Wang and J. Liu, "Hierarchical graph network for multi-hop question answering," arXiv preprint arXiv:1911.03631, 2019.
  19. M. Tu, G. Wang, J. Huang, Y. Tang, X. He and B. Zhou, "Multi-hop reading comprehension across multiple documents by reasoning over heterogeneous graphs," in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, pp. 2704-2713, 2019.