Social Media based Real-time Event Detection by using Deep Learning Methods

  • Nguyen, Van Quan (Dept. of Electronics and Computer Engineering, Chonnam National University) ;
  • Yang, Hyung-Jeong (Dept. of Electronics and Computer Engineering, Chonnam National University) ;
  • Kim, Young-chul (Dept. of Electronics and Computer Engineering, Chonnam National University) ;
  • Kim, Soo-hyung (Dept. of Electronics and Computer Engineering, Chonnam National University) ;
  • Kim, Kyungbaek (Dept. of Electronics and Computer Engineering, Chonnam National University)
  • Received : 2017.07.25
  • Accepted : 2017.09.25
  • Published : 2017.09.30

Abstract

Event detection using social media has been widespread since social network services have been an active communication channel for connecting with others, diffusing news message. Especially, the real-time characteristic of social media has created the opportunity for supporting for real-time applications/systems. Social network such as Twitter is the potential data source to explore useful information by mining messages posted by the user community. This paper proposed a novel system for temporal event detection by analyzing social data. As a result, this information can be used by first responders, decision makers, or news agents to gain insight of the situation. The proposed approach takes advantages of deep learning methods that play core techniques on the main tasks including informative data identifying from a noisy environment and temporal event detection. The former is the responsibility of Convolutional Neural Network model trained from labeled Twitter data. The latter is for event detection supported by Recurrent Neural Network module. We demonstrated our approach and experimental results on the case study of earthquake situations. Our system is more adaptive than other systems used traditional methods since deep learning enables to extract the features of data without spending lots of time constructing feature by hand. This benefit makes our approach adaptive to extend to a new context of practice. Moreover, the proposed system promised to respond to acceptable delay within several minutes that will helpful mean for supporting news channel agents or belief plan in case of disaster events.

Keywords

References

  1. M. Avvenuti, S. Cresci, M.N. La Polla, A. Marchetti and M. Tesconi, "Earthquake emergency management by Social Sensing," The Second IEEE International Workshop on Social and Community Intelligence, pp. 587-592, 2014.
  2. S. Hochreiter, and J. Schmidhuber, "Long short-term memory," Neural Computation. vol. 9, no. 8, pp. 1735-1780, 1997. https://doi.org/10.1162/neco.1997.9.8.1735
  3. T. Sakaki, M. Okazaki, and Y. Matsuo, "Earthquake shakes twitter users: real-time event detection by social sensors," Proceedings of the 19th international conference on World Wide Web, pp. 851-860, 2010.
  4. A. T. Chatfield and U. Brajawidagda, "Twitter early tsunami warning system: A case study in Indonesia's natural disaster management," System Science (HICSS), 2013 46th Hawaii International Conference on, pp. 2050-2060, 2013.
  5. T. V. Duc, N. V. Quyet, and Kyungbaek Kim, "Design and Implementation of Geo-Social information based Personalized Warning Notification system," Smart Media Journal, vol. 5, no. 2, pp. 42-50, 2016.
  6. T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, "Distributed representations of words and phrases and their compositionality," NIPS'13 Proceedings of the 26th International Conference on Neural Information Processing Systems, pp. 3111-3119, 2013.
  7. N. Kalchbrenner, E. Grefenstette, and P. Blunsom, "A convolutional neural network for modelling sentences," in Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, vol. 1, pp. 655-665, 2014.
  8. Q. Huang, G. Cervone, D. Jing, and C. Chang, "DisasterMapper: A CyberGIS framework for disaster management using social media data," BigSpatial'15 Proceedings of the 4th International ACM SIGSPATIAL Workshop on Analytics for Big Geospatial Datan,pp. 1-6, 2015.
  9. Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, 2015. https://doi.org/10.1038/nature14539
  10. Y. Kim, "Convolutional Neural Networks for Sentence Classification," in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP 2014), pp. 1746-1751, 2014.
  11. R. Johnson and T. Zhang, "Effective use of word order for text categorization with convolutional neural networks," arXiv:1412.1058v2, 2015.
  12. Y. Zhang and B. Wallace, "A Sensitivity Analysis of Convolutional Neural Networks for Sentence Classification," arXiv:1510.03820v4, 2016.
  13. D. Z. Matthew, "ADADELTA: An Adaptive Learning Rate Method," arXiv:1212.5701, 2012.
  14. R. Sebastian, "An overview of gradient descent optimization algorithms," arXiv:1609.04747, 2016.
  15. D. T. Nguyen, and E. J. Jai, "Real-time event detection for online behavioral analysis of big social data," Future Generation Compter Systems, vol. 66, pp.137-145, 2017. https://doi.org/10.1016/j.future.2016.04.012
  16. V. Q. Nguyen, H. J. Yang, Y. Kim, S. Kim, G. S. Lee, and M. Kwon, "Design and Implementation of Event Detection System on Hadoop." in Proceedings 1st International. Conference Software & Smart Convergence (ICSSC 2017), vol. 6, no. 2, pp. 201-205, 2017.
  17. J. Pennington, R. Socher, and C. D. Manning, "Glove: Global vectors for word representation," in Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP), vol. 14, pp. 1532-1543, 2014.