심층학습을 이용한 기계번역 연구동향

  • Published : 2015.10.18

Abstract

Keywords

References

  1. Geoffrey E. Hinton, Simon Osindero, and Yee-Whye The. "A fast learning algorithm for deep belief nets." Neural Computation, vol. 18, no. 7, pp. 1527-1554, 2006. https://doi.org/10.1162/neco.2006.18.7.1527
  2. Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R. Salakhutdinov. "Improving neural networks by preventing co-adaptation of feature detectors." arXiv preprint arXiv, 1207.0580, 2012
  3. Sepp Hochreiter, and Jurgen Schmidhuber. "Long short-term memory." Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735
  4. Kyunghyun Cho, Bart Van Merrienboer, Caglar Gulcehre, Dzmitty Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. "Learning phrase representations using run encoder-decoder for statistical machine translation." arXiv preprint arXiv, 1406.1078, 2014.
  5. Harold Somers, "Review article: Example-based machine translation." Machine Translation, vol. 14, no. 2, pp.113-157, 1999. https://doi.org/10.1023/A:1008109312730
  6. Sergei Nirenburg, Constantine Domashnev, and Dean J. Grannes. "Two approaches to matching in example-based machine translation." In Proc. of the 5th International Conference on Theoretical and Methodological Issues in Machine Translation, pp. 47-57, 1993.
  7. Philipp Koehn, Franz Josef Och, and Daniel Marcu. "Statistical phrase-based translation." In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, vol 1, pp. 48-54, 2003.
  8. Kenji Yamada, and Kevin Knight. "A syntax-based statistical translation model." In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, pp. 523-530, 2001.
  9. Kristie Seymore, and Ronald Rosenfeld. "Scalable backoff language models." In Proceedings of the Fourth International Conference on Spoken Language Processing, vol. 1, pp. 232-235, 1996.
  10. Stanley F. Chen, and Joshua Goodman. "An empirical study of smoothing techniques for language modeling." Computer Speech & Language, vol. 13, no. 4, pp. 359-393, 1998. https://doi.org/10.1006/csla.1999.0128
  11. Koehn, Philipp, and Hieu Hoang. "Factored Translation Models." In Proceedings of EMNLP-CoNLL, pp. 868-876. 2007.
  12. Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard Schwartz, and John Makhoul. "Fast and robust neural network joint models for statistical machine translation." In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol. 1, pp. 1370-1380, 2014.
  13. Yoshua Bengio, Rejean Ducharme, Pascal Vincent, and Christian Janvin. "A neural probabilistic language model." The Journal of Machine Learning Research, vol 3, pp. 1137-1155, 2003.
  14. Tomas Mikolov, Martin Karafiat, Lukas Burget, Jan Cernocky, and Sanjeev Khudanpur. "Recurrent neural network based language model." In Proceedings of 11th Annual Conference of the International Speech Communication Association, pp. 1045-1048, 2010.
  15. Ronald J. Williams, and David Zipser. "Experimental analysis of the real-time recurrent learning algorithm." Connection Science, vol 1, no. 1, pp. 87-111, 1989. https://doi.org/10.1080/09540098908915631
  16. Martin Sundermeyer, Ralf Schlliter, and Hermann Ney. "LSTM Neural Networks for Language Modeling." In Proceedings of 13th Annual Conference of the International Speech Communication Association, 2012.
  17. Nal Kalchbrenner, and Phil Blunsom. "Recurrent Continuous Translation Models." In Proceedings of EMNLP, pp. 1700-1709, 2013.
  18. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. "Neural machine translation by jointly learning to align and translate." arXiv preprint arXiv, 1409.0473, 2014.
  19. Sebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. "On Using Very Large Target Vocabulary for Neural Machine Translation.", In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, 2015.
  20. Caglar Gulcehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loic Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. "On Using Monolingual Corpora in Neural Machine Translation." arXiv preprint arXiv, 1503.03535, 2015.
  21. Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio. "On the properties of neural machine translation: Encoder-decoder approaches." arXiv preprint arXiv, 1409.1259, 2014.
  22. Ilya Sutskever, Oriol Vinyals, and Quoc VV Le. "Sequence to sequence learning with neural networks." In Advances in Neural Information Processing Systems, pp. 3104-3112, 2014.
  23. Michel Simard, and Elliott Macklovitch. "Studying the Human Translation Process through the TransSearch Log-Files." In AAAl Spring Symposium: Knowledge Collection from Volunteer Contributors, pp. 70-77, 2005.
  24. Minh-Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, and Wojciech Zaremba. "Addressing the rare word problem in neural machine translation." In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, 2015.
  25. Rohan Chitnis, and John DeNero. "Variable-Length Word Encodings for Neural Translation Models.", In Proceedings of EMNLP, 2015.
  26. Sebastien Jean, Orhan Firat, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. "Montreal Neural Machine Translation Systems for WMT' 15." In Proceedings of the Tenth Workshop on Statistical Machine Translation, pp. 134-140, 2015.
  27. Daxiang Dong, Hua Wu, Wei He, Dianhai Yu, and Haifeng Wang. "Multi-task lear'ning for multiple language translation." In Proceedings of the 53nd Annual Meeting of the Association for Computational Linguistics, 2015.