지식경영연구 (Knowledge Management Research)

한국지식경영학회 (The Knowledge Management Society of Korea)
권호 표지
DOI QR코드

DOI QR Code

스택오버플로 배지 시스템의 게임화 효과에 관한 연구

The Effect of Badges Gamification on Participation Behavior in StackOverflow

  • 투고 : 2022.08.03
  • 심사 : 2022.08.30
  • 발행 : 2022.09.30
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

온라인 커뮤니티를 비롯한 다양한 온라인 플랫폼이 발전하면서 플랫폼의 성과는 사용자 참여에 따라 크게 좌우될 수 있다. 이에 플랫폼 운영자들은 사용자 참여를 유도하는 여러 전략을 활용하고 있는 가운데 게임화(gamification)가 주목 받고 있다. 본 연구에서는 대표적인 게임화 전략인 배지시스템이 실제 사용자 참여 증가에 미치는 영향을 확인하였다. 또한 플랫폼 맥락에서 맞춤형 게임화 전략 적용의 가능성을 확인하기 위해, 온라인 사용자 정보공개 수준에 따른 맞춤화 전략의 효과를 살펴보았다. 이를 위해 개발자 Q&A 커뮤니티 사이트인 스택오버플로에서 파이썬 배지를 획득한 사용자 557명의 답변 1,048,020개를 직접 수집하여 분석에 활용하였다. 연구 결과 배지를 제공하는 것이 사용자 참여 양을 증가시키는데 효과적으로 작용한 데 반해, 참여 질에는 부분적인 증가 효과가 있음을 확인하였다. 또한 사용자 정보 공개 수준이 배지 획득 이후 참여의 감소에 미치는 영향을 조절하지는 않는 것으로 나타났다. 이 연구 결과는 목표 행동에 따른 게임화의 효과 차이와 맞춤형 게임화에 대한 관심을 환기했다는 점에서 실무적인 시사점이 있다.

This study aims to investigate the gamification effect of the badge awards, the most popular gamification process, on users participation behavior. This study also attempts to investigate the effect of tailored gamification, which designs the system of gamification differently based on users' characteristics, focusing on the level of online user information disclosure. For this, we collect and analyze data on 557 users and 1,048,020 answers from StackOverflow, an online Q&A community for developers. The results show that providing a badge is effective for increasing the amount of user participation, whereas providing a goal through the badge is partially effective for increasing the quality of participation. However, the moderating effect of whether users disclose their SNS information on the relationship between badge gaining and participation decrease is not statistically significant. For platform operators, our findings emphasize the importance of gamification design to enhance user engagement effectively.

키워드

과제정보

본 연구는 고려대학교 미디어학부 특별연구비 지원을 받아 수행되었음. 또한 2019년 대한민국 교육부와 한국연구재단의 지원을 받아 수행된 연구이며 (NRF-2019S1A3A2099973), 과학기술정보통신부 및 정보통신기획평가원의 대학ICT연구센터지원사업의 연구결과로 수행되었음(IITP-2020-0-01749).

참고문헌

  1. 김상균 (2021, 6월). 게임화: 일, 재미를 만나다. 동아비즈니스 리뷰, 107. https://dbr.donga.com/article/view/1202/article_no/4998/ac/search
  2. 김재석 (2021, 11월 21일). [지스타 2021] " 타버스가 뭔데?" 문가들이 대답한다. 디스이즈게임. https://www.thisisgame.com/webzine/news/nboard/4/?category=2&n=137613
  3. 김혜정, 황승엽, 곽유신, 최정혜 (2022). 온라인 커뮤니티이용자 참여 증진을 위한 관리자의 운영 전략: 대학별 대나무숲 분석을 중심으로. 지식경영연구, 23(2), 211-228. https://doi.org/10.15813/KMR.2022.23.2.011
  4. 두경일 (2020). 효과적 마케팅 전략으로서 게이미피케이션 활용 사례 연구. 디지털융복합연구, 18(2), 395-401. https://doi.org/10.14400/JDC.2020.18.2.395
  5. 박윤하, 윤재영 (2019). 성취목표성향에 따른 운동증진을 위한 게이미피케이션 (Gamification) 융합적 전략 연구. 한국과학예술융합학회지, 37(2), 141-155.
  6. 안상희 (2021, 4월 5일a). [Interview] '게이미피케이션 선도자' 게이브 지커만 "코로나19, 게이미피케이션 긍정 효과 알리는 기회 마련". 이코노미조선. http://economychosun.com/client/news/view.php?boardName=C00&t_num=13610550
  7. 안상희 (2021, 4월 5일b). [Interview] 위카이 초우 옥탈리시스 그룹 창업자 "혁신 제3 물결은 '인간의 욕구'...게이미피케이션이 답". 이코노미조선. http://economychosun.com/client/news/view.php?boardName=C00&t_num=13610555
  8. 이하은 (2021, 10월 7일). [인터뷰] "메타버스는 게임화 현상의 하나...게임법 정비 필요". 시사저널e. http://www.sisajournal-e.com/news/articleView.html?idxno=237935
  9. 장윤정, 조은영, 김희웅 (2015). 정성적 연구를 통한 온라인 친사회적 행동의 동기 요인 탐색. 지식경영연구, 16(1), 225-242. https://doi.org/10.15813/kmr.2015.16.1.011
  10. 전병호, 김경미, 강병구 (2008). 기업주도형 커뮤니티의 성공요인에 관한 탐색적 연구: 커뮤니티 운영자 관점에서. 지식경영연구, 9(2), 15-34. https://doi.org/10.15813/KMR.2008.9.2.002
  11. Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2013, May). Steering user behavior with badges. In Proceedings of the 22nd International Conference on World Wide Web, 95-106.
  12. Antin, J., & Churchill, E. F. (2011, May). Badges in social media: A social psychological perspective. In CHI 2011 Gamification Workshop Proceedings, 7, 2-4.
  13. Bartle, R. (1996). Hearts, clubs, diamonds, spades: Players who suit MUDs. Journal of MUD research, 1(1), 19.
  14. Barua, A., Thomas, S. W., & Hassan, A. E. (2014). What are developers talking about? An analysis of topics and trends in stack overflow. Empirical Software Engineering, 19(3), 619-654. https://doi.org/10.1007/s10664-012-9231-y
  15. Bista, S. K., Nepal, S., Colineau, N., & Paris, C. (2012). Using gamification in an online community. In 8th International Conference on Collaborative Computing: Networking, Applications And Worksharing, 611-618.
  16. Bonde, M. T., Makransky, G., Wandall, J., Larsen, M. V., Morsing, M., Jarmer, H., et al. (2014). Improving biotech education through gamified laboratory simulations. Nature Biotechnology, 32(7), 694-697. https://doi.org/10.1038/nbt.2955
  17. Bosu, A., Corley, C. S., Heaton, D., Chatterji, D., Carver, J. C., & Kraft, N. A. (2013). Building reputation in stackoverflow: An empirical investigation. In 2013 10th Working Conference on Mining Software Repositories (MSR), 89-92.
  18. Burke, M., & Hiltbrand, T. (2011). How gamification will change business intelligence. Business Intelligence Journal, 16(2), 8-16.
  19. Burtch, G., Hong, Y., Bapna, R., & Griskevicius, V. (2018). Stimulating online reviews by combining financial incentives and social norms. Management Science, 64(5), 2065-2082. https://doi.org/10.1287/mnsc.2016.2715
  20. Cabrera, A., & Cabrera, E. F. (2002). Knowledge-sharing dilemmas. Organization Studies, 23(5), 687-710. https://doi.org/10.1177/0170840602235001
  21. Cavusoglu, H., Li, Z., & Kim, S. H. (2021). How do virtual badges incentivize voluntary contributions to online communities? Information & Management, 58(5), 103483. https://doi.org/10.1016/j.im.2021.103483
  22. Christy, K. R., & Fox, J. (2014). Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women's math performance. Computers & Education, 78, 66-77. https://doi.org/10.1016/j.compedu.2014.05.005
  23. Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627. https://doi.org/10.1037/0033-2909.125.6.627
  24. Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining "amification" In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Me dia Environments, 9-15.
  25. Dobuski, M. (2021, April 20). Last day for Yahoo Answers users to post questions, comments. ABC News, https://abcnews.go.com/Technology/day-yahoo-answers-users-post-questions-comments/story?id=77168528
  26. Edwards, E. A., Lumsden, J., Rivas, C., Steed, L., Edwards, L. A., Thiyagarajan, A., ... & Walton, R. T. (2016). Gamification for health promotion: Systematic review of behaviour change techniques in smartphone apps. BMJ Open, 6(10), e012447. https://doi.org/10.1136/bmjopen-2016-012447
  27. Elliot, A. J. (1999). Approach and avoidance motivation and achievement goals. Educational Psychologist, 34(3), 169-189. https://doi.org/10.1207/s15326985ep3403_3
  28. Faisal, M. S., Daud, A., Akram, A. U., Abbasi, R. A., Aljohani, N. R., & Mehmood, I. (2019). Expert ranking techniques for online rated forums. Computers in Human Behavior, 100, 168-176. https://doi.org/10.1016/j.chb.2018.06.013
  29. Fandt, P. M., & Ferris, G. R. (1990). The management of information and impressions: When employees behave opportunistically. Organizational Behavior and Human Decision Processes, 45(1), 140-158. https://doi.org/10.1016/0749-5978(90)90008-w
  30. Fredheim, R., Moore, A., & Naughton, J. (2015). Anonymity and online commenting: The broken windows effect and the end of drive-by commenting. In Proceedings of the ACM Web Science Conference, 1-8.
  31. Goes, P. B., Guo, C., & Lin, M. (2016). Do incentive hierarchies induce user effort? Evidence from an online knowledge exchange. Information Systems Research, 27(3), 497-516. https://doi.org/10.1287/isre.2016.0635
  32. Guo, C., & Caine, K. (2021). Anonymity, user engagement, quality, and trolling on Q&A sites. In Proceedings of the ACM on Human-Computer Interaction, 1-27.
  33. Gutt, D., Von Rechenberg, T., & Kundisch, D. (2020). Goal achievement, subsequent user effort and the moderating role of goal difficulty. Journal of Business Research, 106, 277-287. https://doi.org/10.1016/j.jbusres.2018.06.019
  34. Hajarian, M., Bastanfard, A., Mohammadzadeh, J., & Khalilian, M. (2019). A personalized gamification method for increasing user engagement in social networks. Social Network Analysis and Mining, 9(1), 1-14. https://doi.org/10.1007/s13278-018-0544-8
  35. Hamari, J. (2017). Do badges increase user activity? A field experiment on the effects of gamification. Computers in Human Behavior, 71, 469-478. https://doi.org/10.1016/j.chb.2015.03.036
  36. Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? A literature review of empirical studies on gamification. In 2014 47th Hawaii International Conference on System Sciences, 3025-3034.
  37. Hofacker, C. F., De Ruyter, K., Lurie, N. H., Manchanda, P., & Donaldson, J. (2016). Gamification and mobile marketing effectiveness. Journal of Interactive Marketing, 34(1), 25-36. https://doi.org/10.1016/j.intmar.2016.03.001
  38. Hsiao, C. (2003). Analysis of panel data (2nd ed.). New York: Cambridge University Press.
  39. Hsu, C. L., & Chen, M. C. (2018). How gamification marketing activities motivate desirable consumer behaviors: Focusing on the role of brand love. Computers in Human Behavior, 88, 121-133. https://doi.org/10.1016/j.chb.2018.06.037
  40. Huang, W. H. Y., & Soman, D. (2013). Gamification of education. Report Series: Behavioural Economics in Action, 29, 11-12.
  41. Hull, C. L. (1932). The goal-gradient hypothesis and maze learning. Psychological Review, 39(1), 25-43. https://doi.org/10.1037/h0072640
  42. Huotari, K., & Hamari, J. (2017). A definition for gamification: Anchoring gamification in the service marketing literature. Electronic Markets, 27(1), 21-31. https://doi.org/10.1007/s12525-015-0212-z
  43. Jia, Y., Xu, B., Karanam, Y., & Voida, S. (2016). Personality-targeted gamification: A survey study on personality traits and motivational affordances. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2001-2013.
  44. Khern-am-nuai, W., Kannan, K., & Ghasemkhani, H. (2018). Extrinsic versus intrinsic rewards for contributing reviews in an online platform. Information Systems Research, 29(4), 871-892. https://doi.org/10.1287/isre.2017.0750
  45. Kim, J., & Dindia, K. (2011). Online self-disclosure: A review of research. In K. B. Wright & L. M. Webb (Eds.), Computer-mediated communication in personal relationships (pp. 156-180). New York: Peter Lang Publishing.
  46. Kivetz, R., Urminsky, O., & Zheng, Y. (2006). The goal-gradient hypothesis resurrected: Purchase acceleration, illusionary goal progress, and customer retention. Journal of Marketing Research, 43(1), 39-58. https://doi.org/10.1509/jmkr.43.1.39
  47. Klock, A. C. T., Gasparini, I., Pimenta, M. S., & Hamari, J. (2020). Tailored gamification: A review of literature. International Journal of Human-Computer Studies, 144, 102495. https://doi.org/10.1016/j.ijhcs.2020.102495
  48. Koivisto, J., & Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International Journal of Information Management, 45, 191-210. https://doi.org/10.1016/j.ijinfomgt.2018.10.013
  49. Lerner, J. S., & Tetlock, P. E. (1999). Accounting for the effects of accountability. Psychological Bulletin, 125(2), 255-275. https://doi.org/10.1037/0033-2909.125.2.255
  50. Looyestyn, J., Kernot, J., Boshoff, K., Ryan, J., Edney, S., & Maher, C. (2017). Does gamification increase engagement with online programs? A systematic review. PloS One, 12(3), e0173403. https://doi.org/10.1371/journal.pone.0173403
  51. Lowry, P. B., Moody, G., Vance, A., Jensen, M., Jenkins, J. L., & Wells, T. (2012). Using an Elaboration likelihood approach to better understand the persuasiveness of website privacy assurance cues for online consumers. Journal of the American Society for Information Science and Technology, 63(4), 755-766. https://doi.org/10.1002/asi.21705
  52. Lowry, P. B., Zhang, D., Zhou, L., & Fu, X. (2010). Effects of culture, social presence, and group composition on trust in technology-supported decision-making groups. Information Systems Journal, 20(3), 297-315. https://doi.org/10.1111/j.1365-2575.2009.00334.x
  53. Lustria, M. L. A., Noar, S. M., Cortese, J., Van Stee, S. K., Glueckauf, R. L., & Lee, J. (2013). A meta-analysis of web-delivered tailored health behavior change interventions. Journal of Health Communication, 18(9), 1039-1069. https://doi.org/10.1080/10810730.2013.768727
  54. Malone, T. W. (1981). Toward a theory of intrinsically motivating instruction. Cognitive Science, 5(4), 333-369. https://doi.org/10.1016/S0364-0213(81)80017-1
  55. Marczewski, A. (2015). Even Ninja Monkeys like to play. London: Blurb Inc, 1(1), 28.
  56. Mekler, E. D., BrBhlmann, F., Opwis, K., & Tuch, A. N. (2013). Do points, levels and leaderboards harm intrinsic motivation? An empirical analysis of common gamification elements. In Proceedings of the First International Conference on Gameful Design, Research, and Applications, 66-73.
  57. Merchant, A., Shah, D., Bhatia, G. S., Ghosh, A., & Kumaraguru, P. (2019). Signals matter: Understanding popularity and impact of users on stack overflow. In The World Wide Web Conference, 3086-3092.
  58. Movshovitz-Attias, D., Movshovitz-Attias, Y., Steenkiste, P., & Faloutsos, C. (2013, August). Analysis of the reputation system and user contributions on a question answering website: Stackoverflow. In 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013), 886-893.
  59. Mutter, T., & Kundisch, D. (2014). Behavioral mechanisms prompted by badges: The goal-gradient hypothesis. In Proceedings of the 35th International Conference on Information Systems (ICIS), Auckland, New Zealand.
  60. Oliveira, W., Hamari, J., Joaquim, S., Toda, A. M., Palomino, P. T., Vassileva, J., & Isotani, S. (2022). The effects of personalized gamification on students' flow experience, motivation, and enjoyment. Smart Learning Environments, 9(1), 1-26. https://doi.org/10.1186/s40561-021-00182-7
  61. Orji, R., Nacke, L. E., & Di Marco, C. (2017, May). Towards personality-driven persuasive health games and gamified systems. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 1015-1027.
  62. Paternoster, R., Brame, R., Mazerolle, P., & Piquero, A. (1998). Using the correct statistical test for the equality of regression coefficients. Criminology, 36(4), 859-866. https://doi.org/10.1111/j.1745-9125.1998.tb01268.x
  63. Richter, G., Raban, D. R., & Rafaeli, S. (2015). Studying gamification: The effect of rewards and incentives on motivation. In T. Reiners & L. C. Wood (Eds.), Gamification in education and business (pp. 21-46). Berlin: Springer.
  64. Rimer, B. K., & Kreuter, M. W. (2006). Advancing tailored health communication: A persuasion and message effects perspective. Journal of Communication, 56(1), 184-201.
  65. Rodrigues, L., Toda, A. M., Palomino, P. T., Oliveira, W., & Isotani, S. (2020). Personalized gamification: A literature review of outcomes, experiments, and approaches. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, 699-706.
  66. Santos, C., Almeida, S., Pedro, L., Aresta, M., & Koch-Grunberg, T. (2013). Students' perspectives on badges in educational social media platforms: The case of SAPO campus tutorial badges. In 2013 IEEE 13th International Conference on Advanced Learning Technologies, 351-353.
  67. Scholten, L., Van Knippenberg, D., Nijstad, B. A., & De Dreu, C. K. (2007). Motivated information processing and group decision-making: Effects of process accountability on information processing and decision quality. Journal of Experimental Social Psychology, 43(4), 539-552. https://doi.org/10.1016/j.jesp.2006.05.010
  68. Schopler, J., Insko, C. A., Drigotas, S. M., Wieselquist, J., Pemberton, M. B., & Cox, C. (1995). The role of identifiability in the reduction of interindividual-intergroup discontinuity. Journal of Experimental Social Psychology, 31(6), 553-574. https://doi.org/10.1006/jesp.1995.1025
  69. Suh, A., Wagner, C., & Liu, L. (2018). Enhancing user engagement through gamification. Journal of Computer Information Systems, 58(3), 204-213. https://doi.org/10.1080/08874417.2016.1229143
  70. Teng, C. I. (2017). Strengthening loyalty of online gamers: Goal gradient perspective. International Journal of Electronic Commerce, 21(1), 128-147. https://doi.org/10.1080/10864415.2016.1204195
  71. Tetlock, P. E., Skitka, L., & Boettger, R. (1989). Social and cognitive strategies for coping with accountability: Conformity, complexity, and bolstering. Journal of Personality and Social Psychology, 57(4), 632-640. https://doi.org/10.1037//0022-3514.57.4.632
  72. Tondello, G. F., & Nacke, L. E. (2020). Validation of user preferences and effects of personalized gamification on task performance. Frontiers in Computer Science, 2, 29. https://doi.org/10.3389/fcomp.2020.00029
  73. Tondello, G. F., Wehbe, R. R., Diamond, L., Busch, M., Marczewski, A., & Nacke, L. E. (2016). The gamification user types hexad scale. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, 229-243.
  74. Vance, A., Lowry, P. B., & Eggett, D. (2015). Increasing accountability through user-interface design artifacts. MIS Quarterly, 39(2), 345-366. https://doi.org/10.25300/MISQ/2015/39.2.04
  75. Wang, L., Gunasti, K., Shankar, R., Pancras, J., & Gopal, R. (2020). Impact of gamification on perceptions of word-of-mouth contributors and actions of word-of-mouth consumers. MIS Quarterly, 44(4), 1987-2011. https://doi.org/10.25300/MISQ/2020/13726
  76. Williams, K., Harkins, S. G., & LatanB, B. (1981). Identifiability as a deterrant to social loafing: Two cheering experiments. Journal of Personality and Social Psychology, 40(2), 303-311. https://doi.org/10.1037//0022-3514.40.2.303
  77. Xi, N., & Hamari, J. (2020). Does gamification affect brand engagement and equity? A study in online brand communities. Journal of Business Research, 109, 449-460. https://doi.org/10.1016/j.jbusres.2019.11.058
  78. Yanovsky, S., Hoernle, N., Lev, O., & Gal, K. (2021). One size does not fit all: A study of badge behavior in stack overflow. Journal of the Association for Information Science and Technology, 72(3), 331-345. https://doi.org/10.1002/asi.24409