KIISE Transactions on Computing Practices (정보과학회 컴퓨팅의 실제 논문지)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지
DOI QR코드

DOI QR Code

Coreference Resolution using Hierarchical Pointer Networks

계층적 포인터 네트워크를 이용한 상호참조해결

  • Received : 2017.04.04
  • Accepted : 2017.06.28
  • Published : 2017.09.15
⟨ Previous Next ⟩

Abstract

Sequence-to-sequence models and similar pointer networks suffer from performance degradation when an input is composed of multiple sentences or when the length of the input sentence is long. To solve this problem, this paper proposes a hierarchical pointer network model that uses both the word level and sentence level information to encode input sequences composed of several sentences at the word level and sentence level. We propose a hierarchical pointer network based coreference resolution that performs a coreference resolution for all mentions. The experimental results show that the proposed model has a precision of 87.07%, recall of 65.39% and CoNLL F1 74.61%, which is an improvement of 21.83% compared to an existing rule-based model.

Sequence-to-sequence 모델과 이와 유사한 포인터 네트워크는 입력이 여러 문장으로 이루어 지거나 입력 문장의 길이가 길어지면 성능이 저하되는 문제가 있다. 이러한 문제를 해결하기 위해 본 논문에서는 여러 문장으로 이루어진 입력열을 단어 레벨과 문장 레벨로 인코딩을 수행하고, 디코딩에서 단어 레벨과 문장 레벨 정보를 모두 이용하는 계층적 포인터 네트워크 모델을 제안하고, 이를 이용하여 모든 멘션(mention)에 대한 상호참조해결을 수행하는 계층적 포인터 네트워크 기반 상호참조해결을 제안한다. 실험 결과, 본 논문에서 제안한 모델이 정확률 87.07%, 재현율 65.39%, CoNLL F1 74.61%의 성능을 보였으며, 기존 규칙기반 모델 대비 24.01%의 성능 향상을 보였다.

Keywords

Acknowledgement

Grant : (엑소브레인-1세부) 휴먼 지식증강 서비스를 위한 지능진화형 WiseQA 플랫폼 기술 개발

Supported by : 정보통신기술진흥센터, 강원대학교

References

  1. O. Vinyals, M. Fortunato and N. Jaitly, Pointer Networks, Advances in Neural Information Processing Systems, pp. 2674-2682, 2015.
  2. D. Bahdanau, K. Cho and Y. Bengio, Neural machine translation by jointly learning to align and translate, Proceedings of ICLR' 15, 2015.
  3. K. Cho, B. Van Merriënboer and C. Gulcehre, Learning phrase representation using RNN encoder- decoder for statistical machine translation, Proceedings of EMNLP' 14, 2014.
  4. H. Lee, A. Chang, Y. Peirsman N. Chambers, M. Surdeanu and D. Jurafsky, Deterministic coreference resolution based on entity-centric, precision- ranked rules, Computational Linguistics 39.4: pp. 885-916, 2013. https://doi.org/10.1162/COLI_a_00152
  5. C. Park, K.H. Choi and C. Lee, Korean Coreference Resolution using Multi-pass Sieve, JOK, Vol. 41, No. 11, pp. 992-1005, 2014. https://doi.org/10.5626/JOK.2014.41.11.992
  6. A. Rahman, and V. Ng, Supervised models for coreference resolution, Proc. of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2-Volume 2, Association for Computational Linguistics, pp. 968-977, 2009.
  7. C. Park, K.H. Choi, C. Lee and S. Lim, Korean Coreference Resolution with Guided Mention Pair Model using the Deep Learning, ETRI Journal, 38.6, pp. 1207-1217, 2016. https://doi.org/10.4218/etrij.16.0115.0896
  8. C. Park and C. Lee, Coreference Resolution for Pronouns with Pointer Networks, KCC 2016, pp. 699-701, 2016.
  9. M. Vilain, J.Burger, J. Aberdeen, D. Connolly and L. Hirschman, A model-theoretic coreference scoring scheme, Proc. of the 6th conference on Message understanding, Association for Computational Linguistics, pp. 45-52, 1995.
  10. C. Lee, J. Kim and J. Kim, Korean Dependency Parsing using Deep Learning, The 26th Annual Conference on Human & Cognitive Language Technology, pp. 87-91, 2014.
  11. S.W. Jeong, M. Choi and H. Kim, Coreference Resolution for Korean Using Random Forests, KIPS transactions on software and data engineering, 5(11), pp. 535-540, 2016. https://doi.org/10.3745/KTSDE.2016.5.11.535