Browse > Article
http://dx.doi.org/10.3745/KTSDE.2017.6.6.309

Storm-Based Dynamic Tag Cloud for Real-Time SNS Data  

Son, Siwoon (강원대학교 컴퓨터과학과)
Kim, Dasol (강원대학교 컴퓨터과학과)
Lee, Sujeong (강원대학교 컴퓨터과학과)
Gil, Myeong-Seon (강원대학교 컴퓨터과학과)
Moon, Yang-Sae (강원대학교 컴퓨터과학과)
Publication Information
KIPS Transactions on Software and Data Engineering / v.6, no.6, 2017 , pp. 309-314 More about this Journal
Abstract
In general, there are many difficulties in collecting, storing, and analyzing SNS (social network service) data, since those data have big data characteristics, which occurs very fast with the mixture form of structured and unstructured data. In this paper, we propose a new data visualization framework that works on Apache Storm, and it can be useful for real-time and dynamic analysis of SNS data. Apache Storm is a representative big data software platform that processes and analyzes real-time streaming data in the distributed environment. Using Storm, in this paper we collect and aggregate the real-time Twitter data and dynamically visualize the aggregated results through the tag cloud. In addition to Storm-based collection and aggregation functionalities, we also design and implement a Web interface that a user gives his/her interesting keywords and confirms the visualization result of tag cloud related to the given keywords. We finally empirically show that this study makes users be able to intuitively figure out the change of the interested subject on SNS data and the visualized results be applied to many other services such as thematic trend analysis, product recommendation, and customer needs identification.
Keywords
Dynamic Visualization; Big Data; Real-Time Processing; SNS Analysis; Tag Cloud;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Social Networking Service [Internet], https://en.wikipedia.org /wiki/Social_networking_service.
2 Social Mining Part 1: How Big Data is transforming customer insights [Internet], http://www.incite-group.com/data-and-insights/social-mining-part-1-how-big-data-transforming-customer-insights.
3 J. Manyika, M. Chui, B. Brown, J. Bughin, R. Dobbs, C. Roxburgh, and A. Byers, "Big Data: The Next Frontier for Innovation, Competition, and Productivity," Technical Report, McKinsey Global Institute, 2011.
4 M. A. Hearst and D. Rosner, "Tag Clouds: Data Analysis Tool or Social Signaller?," In Proc. of the 41st Int'l Conf. on System Sciences, pp.1-10, Jan., 2008.
5 Example of Tag Cloud [Internet], https://www.nngroup.com/articles/tag-cloud-examples/.
6 Apache Storm [Internet], http://storm.apache.org/.
7 A. Toshniwal, S. Taneja, A. Shukla, K. Ramasamy, J. M. Patel, S. Kulkarni, J. Jackson, K. Gade, M. Fu, J. Donham, N. Bhagat, S. Mittal, and D. Ryaboy, "Storm@Twitter," In Proc. of the Int'l Conf. on Management of Data, ACM SIGMOD, pp.147-156, June, 2014.
8 Apache Hadoop [Internet], http://hadoop.apache.org/.
9 Apache Spark [Internet], http://spark.apache.org/.
10 EsperTech Esper [Internet], http://www.espertech.com/esper/.
11 Apache Storm Trident Tutorial [Internet], http://storm.apach e.org/relea ses/current/Trident-tutorial.html.
12 Y. Hassan-Montero and V. Herrero-Solana, "Improving Tag-Clouds as Visual Information Retrieval Interfaces," In Proc. of the Int'l Conf. on Multidisciplinary Information Sciences and Technologies, Oct., 2006.
13 M. A. Hearst and D. Rosner, "Tag Clouds: Data Analysis Tool or Social Signaller?," In Proc. of the Hawaii Int'l Conf. on System Sciences, Jan., 2008.
14 O. kaser and D. Lemire, "Tag-Cloud Drawing: Algorithms for Cloud Visualization," In Proc. of World Wide Web Workshop on Taggings and Metadata for Social Information Organization, Mar., 2007.
15 D3.js [Internet], https://d3js.org/.
16 Twitter4j [Internet], http://twitter4j.org/en/index.html.