Browse > Article
http://dx.doi.org/10.7583/JKGS.2018.18.5.83

A Study on Automatic Comment Generation Using Deep Learning  

Choi, Jae-yong (Dept. of Game & Multimedia Engineering, Korea Polytechnic University)
Sung, So-yun (Dept. of Game & Multimedia Engineering, Korea Polytechnic University)
Kim, Kyoung-chul (Dept. of Game & Multimedia Engineering, Korea Polytechnic University)
Abstract
Many studies in deep learning show results as good as human's decision in various fields. And importance of activation of online-community and SNS grows up in game industry. Even it decides whether a game can be successful or not. The purpose of this study is to construct a system which can read texts and create comments according to schedule in online-community and SNS using deep learning. Using recurrent neural network, we constructed models generating a comment and a schedule of writing comments, and made program choosing a news title and uploading the comment at twitter in calculated time automatically. This study can be applied to activating an online game community, a Q&A service, etc.
Keywords
Deep Learning; Online Community; Natural Language Generation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Geoffrey E. Hinton , Simon Osindero and Yee-Whye Teh, "A Fast Learning Algorithm for Deep Belief Nets", Neural Computation Volume 18 Issue 7, pp.1527-1554, 2006.   DOI
2 Google, "Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone", https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html, 2018.
3 OpenAI, "Dota 2", https://blog.openai.com/dota-2/, 2017.
4 Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks", http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks, 2012.
5 Haoxiang Li, Zhe Lin, Xiaohui Shen, Jonathan Brandt, Gang Hua, "A Convolutional Neural Network Cascade for Face Detection", The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.5325-5334, 2015.
6 Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Zhiheng Huang, Alan Yuille "Deep Captioning With Multimodal Recurrent Neural Networks (m-RNN)", https://arxiv.org/abs/1412.6632, 2015.
7 Ian Goodfellow, Yoshua Bengio And Aron Courville, "Deep Learning", The MIT Press, pp.363-382, 2016.
8 Alex Graves, Abdel-rahman Mohamed, Geoffrey Hinton, "Speech Recognition with Deep Recurrent Neural Networks", https://arxiv.org/abs/1303.5778, 2013.
9 "Long Short-Term Memory", Neural Computation Volume 9 Issue 8, pp.1735-1780, 1997.   DOI
10 Oren Melamud, Omer Levy, Ido Dagan, "A Simple Word Embedding Model for Lexical Substitution", Proceedings of NAACL-HLT 2015, pp.1-7, 2015.
11 Ian Goodfellow, Yoshua Bengio And Aron Courville, "Deep Learning", The MIT Press, pp.385-400, 2016.
12 Kyunghyun Cho, Bart Van Merrienboer, Dzmitry Bahdanau, Yoshua Bengio, "On the properties of neural machine translation: Encoder-decoder approaches", https://arxiv.org/abs/1409.1259, 2014.
13 Subhashini Venugopalan, Marcus Rohrbach, Jeffrey Donahue, Raymond Mooney, Trevor Darrell, Kate Saenko, "Sequence to Sequence - Video to Text", The IEEE International Conference on Computer Vision (ICCV), pp.4534-4542, 2015
14 Andrej Karpathy, "The Unreasonable Effectiveness of Recurrent Neural Networks", http://karpathy.github.io/2015/05/21/rnn-effectiveness, 2015.
15 Andrej Karpathy, "Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch" https://github.com/karpathy/char-rnn, 2015.
16 insikk, "Korean language requires a little different treatment when we run character level RNN", https://github.com/insikk/kor-char-rnn-tensorflow, 2017.
17 Yong Du, Wei Wang, Liang Wang, "Hierarchical Recurrent Neural Network for Skeleton Based Action Recognition", The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1110-1118, 2015.
18 Google, "TensorFlow Neural Machine Translation Tutorial", https://github.com/tensorflow/nmt, 2017.
19 Rico Sennrich, Barry Haddow, Alexandra Birch, "Neural Machine Translation of Rare Words with Subword Units", https://arxiv.org/abs/1508.07909, 2016.
20 Minh-Thang Luong, Hieu Pham, Christopher D. Manning, "Effective Approaches to Attention-based Neural Machine Translation", https://arxiv.org/abs/1508.04025, 2015.