The Journal of Information Systems (한국정보시스템학회지:정보시스템연구)

Korea Association of Information Systems (한국정보시스템학회)
권호 표지
DOI QR코드

DOI QR Code

The Impact of User Trust and Anthropomorphism on the Continuance Intention to Use ChatGPT

사용자 신뢰와 의인화가 ChatGPT의 지속적인 사용 의도에 미치는 영향

  • 장지영 (경북대학교 대학원 경영학부 ) ;
  • 서창교 (경북대학교 경영학부 )
  • Received : 2024.02.11
  • Accepted : 2024.03.12
  • Published : 2024.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Purpose The purpose of this study is to empirically investigate the factors that influence users' continuous intention to use ChatGPT based on the Expectation Confirmation Model(ECM). Drawing from the literature, this study identifies anthropomorphism and trust as key characteristics of generative AI and ChatGPT. Design/methodology/approach The research model was developed based on ECM and literature research to investigate the impacts of anthropomorphism and trust on continuous intention of using ChatGPT. In order to test the hypothese, a total of 193 questionnaires were collected and analyzed for the structural equation modeling with SmartPLS 4.0. Findings The study's findings show that all proposed hypotheses were supported, suggesting that the ECM is a valid framework for examining continuous intention of using ChatGPT. Moreover, the study stressed the crucial role of anthropomorphism in the model, showing the positive impact on expectation confirmation, perceived usefulness, and trust in ChatGPT. Also, trust positively affects perceived usefulness. These findings provide valuable insights for enhancing user satisfaction and continuous usage intention, serving as a foundation for development strategies for ChatGPT and similar AI-based systems.

Keywords

References

  1. 김종원, 김대길 (2020), "기대일치와 인지된 혜택이 대학의 온라인 수업의 만족도와 지속적 사용 의도에 미치는 영향", 정보시스템연구, 29(4), 153-169.
  2. 민윤정, 안재경, 김소영 (2020), "기술수용모형을 적용한 학습용 챗봇 사용의도와 영향요인 간 구조적 관계 분석," 교육정보 미디어연구, 26(4), 799-825.
  3. 양지훈, 양성병, 윤상혁 (2023), "생성형 AI 서비스의 성공요인에 대한 탐색적 연구: 텍스트 마이닝과 ChatGPT 를 활용하여," 경영정보학연구, 25(2), 125-144.
  4. 이진희, 정철, 김남조 (2019), "유튜브 관광콘텐츠 특성이 확신, 지각된 유용성, 만족, 충성도에 미치는 영향: 기대일치모형 (Expectation-Confirmation Model: ECM)의 적용,"관광연구, 34(8), 47-69.
  5. 이한진, 박영근, 민대환 (2020), "모바일 식품구매 서비스의 지속사용의도에 관한 연구", 정보시스템연구, 29(2), 95-110.
  6. 정동아, 김하연, 이상우 (2023), "가상인간의 의인화에 따른 이용자 호감도에 관한 연구: 사회비교 경험과 자기향상욕구를 중심으로", 정보시스템연구, 32(4)), 163-188.
  7. 정영권, 안현철 (2023), "챗봇의 특성이 지속사용의도에 미치는 영향에 관한 연구: 후 기수용모델을 중심으로," 한국컴퓨터정보학회논문지, 28(6), 169-179. https://doi.org/10.9708/JKSCI.2023.28.06.169
  8. 정지희, 정기한 (2012),"스마트폰 사용에 대한 만족과 지속사용의도 및 추천의도에 관한 연구", 유통경영학회지, 15(4), 93-104. https://doi.org/10.17961/JDMR.15.4.201209.93
  9. Ambalov, I. A. (2018), "A meta-analysis of IT continuance: An evaluation of the expectation-confirmation model," Telematics and Informatics, 35(6), 1561-1571. https://doi.org/10.1016/j.tele.2018.03.016
  10. Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020), "I, Chatbot: Modeling the determinants of users' satisfaction and continuance intention of AI-powered service agents," Telematics and Informatics, 54, 101473.
  11. Aydin, O., & KARAARSLAN, E. (2023), "Is chatgpt leading generative AI? what is beyond expectations?," Academic Platform Journal of Engineering and Smart Systems, 11(3), 118-134.
  12. Bagozzi, R. P., & Yi, Y. (1988), "On the evaluation of structural equation models," Journal of the Academy of Marketing Science, 16, 74-94.
  13. Bedue, P., & Fritzsche, A. (2022), "Can we trust AI? An empirical investigation of trust requirements and guide to successful AI adoption,"Journal of Enterprise Information Management, 35(2), 530-549.
  14. Bhattacherjee, A. (2001). "Understanding information systems continuance: An expectation-confirmation model," MIS Quarterly, 25(3), 351-370. https://doi.org/10.2307/3250921
  15. Biswas, S. S. (2023), "Role of ChatGPTt in public health,"Annals of Biomedical Engineering, 51(5), 868-869.
  16. Chen, S. C., Yen, D. C., & Peng, S. C. (2018). "Assessing the impact of determinants in e-magazines acceptance: An empirical study," Computer Standards & Interfaces, 57, 49-58
  17. Cheng, X., Zhang, X., Coh.en, J., & Mou, J. (2022), "Human vs. AI: Understanding the impact of anthropomorphism on consumer response to chatbots from the perspective of trust and relationship norms," Information Processing & Management, 59(3), 102940.
  18. Chin, W. W. (1998), "The partial least squares approach to structural equation modeling," Modern Methods for Business Research, 295(2), 295-336.
  19. Choudhury, A., & Shamszare, H. (2023), "Investigating the Impact of user trust on the adoption and use of ChatGPT: Survey analysis," Journal of Medical Internet Research, 25, e47184.
  20. Cohen J. (1988), Statistical Power Analysis for the Behavioral Sciences (2nd Ed), NJ: Lawrence Erlbaum Associates.
  21. Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989), "User acceptance of computer technology: A comparison of two theoretical models," Management Science, 35(8), 982-1003.
  22. Dhiman, N., & Jamwal, M. (2023), "Tourists' post-adoption continuance intentions of chatbots: Integrating task-technology fit model and expectation-confirmation theory," Foresight, 25(2), 209-224.
  23. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). "'So what if ChatGPT wrote it?'Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy," International Journal of Information Management, 71, 102642.
  24. Falk, R. F., & Miller, N. B. (1992). A Primer for Soft Modeling, University of Akron Press.
  25. Fornell, C., & Larcker, D. F. (1981),"Evaluating structural equation models with unobservable variables and measurement error,"Journal of Marketing Research, 18(1), 39-50..
  26. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023), "How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment," JMIR Medical Education, 9(1), e45312.
  27. Go, E., & Sundar, S. S. (2019), "Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions," Computers in Human Behavior, 97, 304-316.
  28. Goyal, S., Venkatesh, V., & Shi, X. (2022), "Role of users' status quo on continuance intentions," Information & Management, 59(8), 103686.
  29. Hair Jr, J. F., Sarstedt, M., Hopkins, L., & Kuppelwieser, V. G. (2014), "Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research," European Business Review, 26(2), 106-121.
  30. Haleem, A., Javaid, M., & Singh, R. P (2022), "An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges," BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2(4), 100089.
  31. Han, M. C. (2021), "The impact of anthropomorphism on consumers' purchase decision in chatbot commerce," Journal of Internet Commerce, 20(1), 46-65. https://doi.org/10.1080/15332861.2020.1863022
  32. Hsiao, K. L., & Chen, C. C. (2022), "What drives continuance intention to use a food-ordering chatbot? An examination of trust and satisfaction," Library Hi Tech, 40(4), 929-946.
  33. Jacobs, O., Pazhoohi, F., & Kingstone, A. (2023), "Brief exposure increases mind perception to ChatGPT and is moderated by the individual propensity to anthropomorphize," PsyArXiv, https://doi.org/10.31234/ osf.io/pn29d
  34. Jiao, W., Wang, W., Huang, J. T., Wang, X., & Tu, Z. P. (2023), "Is ChatGPT a good translator? Yes with GPT-4 as the engine," arXiv, https://doi.org/10.48550/arXiv.2301.08745
  35. Jungherr, A. (2023), "Using CHATGPT and Other Large Language Model (LLM) Applications for Academic Paper Assignments," SocArXiv, https://doi.org/10.31235/osf.io/d84q6
  36. Kasneci, E., Sessler, K., Kuchemann, S., Bannert, M., Dementieva, D., Fischer, F., & Kasneci, G. (2023), "ChatGPT for good? On opportunities and challenges of large language models for education," Learning and Individual Differences, 103, 102274.
  37. Klein, K., & Martinez, L. F. (2023), "The impact of anthropomorphism on customer satisfaction in chatbot commerce: An experimental study in the food sector," Electronic Commerce Research, 23(4), 2789-2825.
  38. Korzynski, P., Mazurek, G., Altmann, A., Ejdys, J., Kazlauskaite, R., Paliszkiewicz, J., & Ziemba, E. (2023), "Generative artificial intelligence as a new context for management theories: Analysis of ChatGPT," Central European Management Journal, 31(1), 3-13.
  39. Lee, J. C., Tang, Y., & Jiang, S. (2023), "Understanding continuance intention of artificial intelligence (AI)-enabled mobile banking applications: an extension of AI characteristics to an expectation confirmation model," Humanities and Social Sciences Communications, 10(1), 1-12.
  40. Lian, L. K., & Lian, S. B. (2023), "Examining anthropomorphism of chatbots and its effect on user satisfaction and user loyalty in the service industry," Electronic Journal of Business and Management, 8(1), 1-14.
  41. Lim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023). "Generative AI and the future of education: Ragnarok or reformation? A paradoxical perspective from management educators," The International Journal of Management Education, 21(2), 100790.
  42. Liu, K., & Tao, D. (2022), "The roles of trust, personalization, loss of privacy, and anthropomorphism in public acceptance of smart healthcare services," Computers in Human Behavior, 127, 107026.
  43. Lohr, T., Brook, E., Chase, S., Krishna, S., Shank, M., Edin, P., Frolick, E., (2023), Generative AI: From Buzz to Business Value, KPMG, https://kpmg.com/kpmg-us/content/dam/kpmg/pdf/2023/generative-ai-survey.pdf.
  44. Lucchi, N. (2023), "ChatGPT: A case study on copyright challenges for generative artificial intelligence systems," European Journal of Risk Regulation, 1-23.
  45. Lu, C. C., Wu, L., & Hsiao, W. H. (2019), "Developing customer product loyalty through mobile advertising: Affective and cognitive perspectives," International Journal of Information Management, 47, 101-111.
  46. Lu, L., Cai, R., & Gursoy, D. (2019), "Developing and validating a service robot integration willingness scale," International Journal of Hospitality Management, 80, 36-51.
  47. McDuff, D., Cheng, R., & Kapoor, A. (2018), "Identifying bias in AI using simulation," arXiv, https://doi.org/10.48550/arXiv.1810.00471
  48. Mou, J., Shin, D. H., & Cohen, J. (2017), "Understanding trust and perceived usefulness in the consumer acceptance of an e-service: a longitudinal investigation," Behaviour & Information Technology, 36(2), 125-139.
  49. Nguyen, D. M., Chiu, Y. T. H., & Le, H. D. (2021), "Determinants of continuance intention towards banks' chatbot services in Vietnam: A necessity for sustainable development," Sustainability, 13(14), 7625.
  50. Oliver, R. L. (1980), "A cognitive model of the antecedents and consequences of satisfaction decisions," Journal of Marketing Research, 17(4), 460-469. https://doi.org/10.1177/002224378001700405
  51. Oviedo-Trespalacios, O., Peden, A. E., Cole-Hunter, T., Costantini, A., Haghani, M., Rod, J. E., & Reniers, G. (2023), "The risks of using ChatGPT to obtain common safety-related information and advice," Safety Science, 167, 106244.
  52. Panda, S., & Kaur, N. (2023), "Exploring the viability of ChatGPT as an alternative to traditional chatbot systems in library and information centers," Library Hi Tech News, 40(3), 22-25.
  53. Pavlik, J. V. (2023), "Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education," Journalism & Mass Communication Educator, 78(1), 84-93.
  54. Roy, R., & Naidoo, V. (2021), "Enhancing chatbot effectiveness: The role of anthropomorphic conversational styles and time orientation," Journal of Business Research, 126, 23-34.
  55. Sheehan, B., Jin, H. S., & Gottlieb, U. (2020), "Customer service chatbots: Anthropomorphism and adoption," Journal of Business Research, 115, 14-24.
  56. Susnjak, T. (2022), "ChatGPT: The end of online exam integrity?," arXiv, https://doi.org/10.48550/ arXiv.2212.09292
  57. Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023), "What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education," Smart Learning Environments, 10(1), 15.
  58. Troshani, I., Rao Hill, S., Sherman, C., & Arthur, D. (2021), "Do we trust in AI? Role of anthropomorphism and intelligence," Journal of Computer Information Systems, 61(5), 481-491.
  59. Veeramootoo, N., Nunkoo, R., & Dwivedi, Y. K. (2018), "What determines success of an e-government service? Validation of an integrative model of e-filing continuance usage," Government Information Quarterly, 35(2), 161-174.
  60. Veglis, A., & Maniou, T. A. (2019), "Chatbots on the rise: A new narrative in journalism," Studies in Media and Communication, 7(1), 1-6.
  61. Venkatesh, V. (2022), "Adoption and use of AI tools: A research agenda grounded in UTAUT," Annals of Operations Research, 1-12.
  62. von Eschenbach, W. J. (2021), "Transparency and the black box problem: Why we do not trust AI," Philosophy & Technology, 34(4), 1607-1622.
  63. Wetzels, M., Odekerken-Schroder, G., & Van Oppen, C. (2009). "Using PLS path modeling for assessing hierarchical construct models: Guidelines and empirical illustration," MIS Quarterly, 33(1), 177-195.
  64. Wu, T., He, S., Liu, J., Sun, S., Liu, K., Han, Q. L., & Tang, Y. (2023), "A brief overview of ChatGPT: The history, status quo and potential future development," IEEE/CAA Journal of Automatica Sinica, 10(5), 1122-1136.
  65. Yilmaz, R., & Yilmaz, F. G. K. (2023), "Augmented intelligence in programming learning: Examining student views on the use of ChatGPT for programming learning." Computers in Human Behavior: Artificial Humans, 1(2), 100005.
  66. Zhou, W., Tsiga, Z., Li, B., Zheng, S., & Jiang, S. (2018), "What influence users'e-finance continuance intention? The moderating role of trust," Industrial Management & Data Systems, 118(8), 1647-1670.