언어자원 구축과 단어 임베딩 기법을 이용한 딥러닝 기반의 자연어 분석 및 생성

  • Published : 2019.07.30

Abstract

Keywords

Acknowledgement

Supported by : 한국연구재단

References

  1. I. Sutskever, J. Martens, and G. Hinton, "Generating Text with Recurrent Neural Networks", ICML-11, pp.1017-1024, 2011.
  2. Y. LeCun, Y. Bengio and G. Hinton, "Deep Learning", Nature, Vol.521, pp.436-444, 28th May 2015. https://doi.org/10.1038/nature14539
  3. J. Schmidhuber, "Deep Learning in Neural Networks: An overview", Neural networks, Vol.61, pp.85-117, 8th October 2014. https://doi.org/10.1016/j.neunet.2014.09.003
  4. T. Young, D. Hazarika, S. Poria, ard E. Cambria, "Recent Trends in Deep Learning based Natural Language Processing", IEEE, pp.55-75, 2018.
  5. T. Mikolov, I Sutskever, K. Chen, G. Corrado, and J Dean, "Distributed Representations of Words and Phrases and their Compositionality", arXiv:1310.4546v1, 2013.
  6. M. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, L. Zettlemoyer, "Deep Contextualized Word Representations", NAACL, pp.2227-2237, 2018.
  7. J. Devlin, M. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", Proceedings of NAACL-HLT 2019, pp.4171-4186, 2019.
  8. M. Nagao, "A Framework of a Mechanical Translation between Japanese and English by Analogy Principle", Artificial and Human Intelligence, 1984.
  9. K. Cho, B. Merrienboer, D. Bahdanau, and Y. Bengio, "On the Properties of Neural Machine Translation: Encoder-Deccder Approaches", Proceedings of SSST-8, pp.103-111, 2014.
  10. 강승식, 한국어 정보화 세부 실행 계획 수립, 문화체육관광부 연구보고서, 2011년 7월.
  11. 강승식, 한국어 기계학습 및 평가용 Gold Standard 언어지원 뱅크 구축, 차세대정보컴퓨팅 기술개발사업 연구보고서, 2019년 5월.
  12. X. Zheng, H. Chen, and T. Xu, "Deep Learning for Chinese Word Segmentation and POS Taggng", EMNLP, pp.647-657, 2013.
  13. Z. Huang, W. Xu, and K. Yu, "Bidirectional LSTM-CRF Models for Sequence Tagging", arXiv preprint arXiv:1508.01991, 2015.
  14. D. Chen, and C. Manning, "A Fast and Accurate Dependency Parser using Neural Networks", EMNLP, pp.740-750, 2014.
  15. C. Dyer, M. Ballesteros, W. Ling, A. Matthews and N. A. Smith, "Transition-Based Dependency Parsing with Stack Long Short-Term Memory", ACL, pp.334-343, 2015.
  16. X. Zhang and M. Lapsta, "Chinese Poetry Generation with Recurrent Neural networks", EMNLP, pp.670-680, 2014.
  17. Y. Zhang, Z. Gan, K. Fan, Z. Chen, R. Henao, D. Shen and L. Carin, "Adversarial Feature Matching for Text Generation", In Proceedings of the 34th International Conference on Machine Leaning-Volume 70, pp.4006-4015, 2017.
  18. T. H. Wen, M. Gasic, N. Mrksic, P. H. Su, D. Vandyke and S. Young, "Semanticalty Conditioned LSTM-Based Natural Language Generation for Spoken Dialogue Systems", arXiv preprint arXiv:1508.01745, 2015.