Browse > Article
http://dx.doi.org/10.7472/jksii.2020.21.6.57

Characterization and Detection of Opinion Manipulation on Common Interest Groups in Online Communities  

Lee, Sihyung (School of Computer Science and Engineering, Kyungpook National University)
Publication Information
Journal of Internet Computing and Services / v.21, no.6, 2020 , pp. 57-69 More about this Journal
Abstract
As more people share their opinions in online communities, such as Internet portals and social networking services, more opinions are manipulated for the benefit of particular individuals and groups. In particular, when manipulations occur for political purposes, they influence election results as well as government policies and the quality of life. This type of manipulation has targeted the general public, and their analysis and detection has also focused on such manipulation. However, to more efficiently spread propaganda, recent manipulations have targeted common interest groups(e.g., a group of those interested in real estate) and propagated information whose content and style are customized to those groups. This work characterizes such manipulations on common interest groups and proposes method to detect manipulations. To this end, we collected and analyzed opinions posted on 10 common interest groups before and after an election. As a result, we found that manipulations on common interest groups indeed occurred and were gradually increasing toward the election date. We also proposed a detection system that examines individual opinions, their authors, and their collaborators. Using the collected opinions, we demonstrated that the proposed system can accurately classify more than 90% of manipulated opinions and that many of these opinions were posted by multiple collaborators. We believe that regular audits of opinions using the proposed system can quickly isolate manipulations and decrease their impact. Moreover, the proposed features can be used to identify manipulations in domains other than politics.
Keywords
Opinion Manipulation; Online Community; Interest Group; Political Manipulation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Fraser and S. Dutta, "Throwing sheep in the boardroom: how online social networking will transform your life, work and world," Wiley, 2008. https://books.google.co.kr/books?id=BlfPVTcFPyQC
2 D. Centola, "The spread of behavior in an online social network experiment," Science, vol. 329, no. 5596, pp. 1194-1197, 2010. https://doi.org/10.1126/science.1185231   DOI
3 D. Mocanu, L. Rossi, Q. Zhang, M. Karsai, and W. Quattrociocchi, "Collective attention in the age of (mis)information," Computing in Human Behavior, Vol. 51, Part B, pp. 1198-1204, 2015. https://doi.org/10.1016/j.chb.2015.01.024   DOI
4 S. Choe, "Prosecutors detail attempt to sway South Korean election," The New York Times, 2013. https://www.nytimes.com/2013/11/22/world/asia/prosecutors-detail-bid-to-sway-south-korean-election.html
5 S. Choe, "Ally of south Korean leader conspired to rig online opinion, inquiry finds," The New York Times, 2018. https://www.nytimes.com/2018/08/27/world/asia/moon-jae-in-online-scandal.html
6 S. Shane and M. Mazzetti, "Inside a 3-year Russian campaign to influence U.S. voters," The New York Times, 2018. https://www.nytimes.com/2018/02/16/us/politics/russiamueller-election.html
7 R. Bond, et al., "A 61-million-person experiment in social influence and political mobilization," Nature, vol. 489, no. 7415, pp. 295-298, 2012. https://www.nature.com/articles/nature11421   DOI
8 R. K. Garrett and B. E. Weeks, "The promise and peril of real-time corrections to political misperceptions," ACM CSCW, pp. 1047-1058, 2013. https://dl.acm.org/doi/10.1145/2441776.2441895
9 S. Lee, "Detection of political manipulation in online communities through measures of effort and collaboration," ACM Transactions on the Web, Vol. 9, No. 3, Article No. 16, 2015. https://doi.org/10.1145/2767134   DOI
10 J. Ratkiewicz, M. D. Conover, M. Meiss, B. Goncalves, A. Flammini and F. Menczer, "Detecting and tracking political abuse in social media," AAAI ICWSM, 2011. https://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/view/2850
11 H. Grassegger and M. Krogerus, "The data that turned the world upside down," VICE Media Group, 2017. https://www.vice.com/en_us/article/mg9vvn/how-our-likes-helped-trump-win
12 J. Robertson, M. Riley, and A. Willis, "How to hack an election," Bloomberg, 2016. https://www.bloomberg.com/features/2016-how-to-hackan-election/
13 K. Kohli, "Congress vs. BJP: the curious case of trolls and politics," The Times of India, 2013. https://timesofindia.indiatimes.com/india/Congress-vs-BJP-The-curious-case-of-trolls-and-politics/articleshow/23970818.cms
14 B. Collins and S. Wodinsky, "Twitter pulls down bot network that pushed pro-Saudi talking points about disappeared journalist," NBC News, 2018. https://www.nbcnews.com/tech/tech-news/exclusive-twitter-pulls-down-bot-network-pushing-pro-saudi-talking-n921871
15 W. Youyou, M. Kosinski, and D. Stillwell, "Computerbased personality judgments are more accurate than those made by humans," PNAS, 2015. https://doi.org/10.1073/pnas.1418680112   DOI
16 M. B. Khalifa, Z. Elouedi, and E. Lefevre, "Evidental group spammers detection," IPMU, pp. 341-353, 2020. https://dx.doi.org/10.1007/978-3-030-50143-3_26   DOI
17 "Bulletin board posting guidelines," Administrator of real-estate cafe in Naver, 2020. https://cafe.naver.com/jaegebal/258720
18 V. Gupta, A. Aggarwal, and T. Chakraborty, "Detecting and characterizing extremist reviewer groups in online product reviews," IEEE Transactions on Computational Social Systems, Vol. 7, No. 3, pp. 741-750, 2020. https://doi.org/10.1109/TCSS.2020.2988098   DOI
19 "Naver cafe," Naver, 2020. https://cafe.naver.com
20 "Daum cafe," Daum, 2020. http://cafe.daum.net
21 J. Lee, "Manipulation of recommendation counts by military and government agencies," Media Today, 2013. http://www.mediatoday.co.kr/news/articleView.html?idxno=112725
22 B. Liu, "Web data mining: exploring hyperlinks, contents, and usage data," Springer, 2011. https://doi.org/10.1007/978-3-642-19460-3
23 "News articles in Naver news," Naver, 2020. https://news.naver.com
24 "News articles in Daum news," Daum, 2020. https://news.daum.net
25 E. L. Park and S. Cho, "KoNLPy: Korean natural language processing in Python," HCLT, pp. 133-136, 2014. https://konlpy.org/
26 "Weka: the workbench for machine learning," 2020. https://www.cs.waikato.ac.nz/ml/weka/
27 S. Choe, "Shadowy church is at center of coronavirus outbreak in South Korea," The New York Times, 2020. https://www.nytimes.com/2020/02/21/world/asia/south-korea-coronavirus-shincheonji.html
28 H. K. Lee, "South Korea takes new measures to have enough face masks domestically amid coronavirus," ABC News, 2020. https://abcnews.go.com/International/south-korea-takes-measures-face-masks-domestically-amid/story?id=69254114
29 R. E. Schapire, "A brief introduction to boosting," IJCAI, Vol. 2, pp. 1401-1406, 1999. https://dl.acm.org/doi/10.5555/1624312.1624417   DOI
30 P. Sen, G. Namata, M. Bilgic, L. Getoor, B. Galligher, and T. Eliassi-Rad, "Collective classification in network data," AI Magazine, Vol. 29, No. 3, pp. 93-106, 2008. https://doi.org/10.1609/aimag.v29i3.2157   DOI
31 A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Communications of the ACM, Vol. 60, No. 6, pp. 84-90, 2017. https://dl.acm.org/doi/10.1145/3065386   DOI
32 L. Breiman, "Random forests," Springer Machine Learning, Vol. 45, No. 1, pp. 5-32, 2001. https://doi.org/10.1023/A:1010933404324   DOI
33 V. N. Vapnik, "The nature of statistical learning theory," Springer, 2000. https://doi.org/10.1007/978-1-4757-3264-1   DOI
34 G. H. Nguyen, A. Bouzerdoum, and S. L. Phung, "A supervised learning approach for imbalanced data sets," ICPR, pp. 1-4, 2008. https://doi.org/10.1109/ICPR.2008.4761278   DOI
35 G. Dupret and M. Koda, "Boostrap re-sampling for unbalanced data in supervised learning," Elsevier European Journal of Operational Research, Vol. 134, No. 1, pp. 141-156, 2001. https://doi.org/10.1016/S0377-2217(00)00244-7   DOI
36 Y. Kim, "We can do everything with Naver IDs illegally sold at only 800 won," Money Today, 2020. https://v.kakao.com/v/20200205133018153