DOI QR코드

DOI QR Code

Effects of the use of a conversational artificial intelligence chatbot on medical students' patient-centered communication skill development in a metaverse environment

  • Hyeonmi Hong (Education Research Institute, Seoul National University) ;
  • Sunghee Shin (Department of Elementary and Early Childhood Education, Queens College, City University of New York)
  • Received : 2024.09.05
  • Accepted : 2024.09.11
  • Published : 2024.09.30

Abstract

This study investigated how the use of a conversational artificial intelligence (AI) chatbot improved medical students' patient-centered communication (PCC) skills and how it affected their motivation to learn using innovative interactive tools such as AI chatbots throughout their careers. This study adopted a one-group post-test-only design to investigate the impact of AI chatbot-based learning on medical students' PCC skills, their learning motivation with AI chatbots, and their perception towards the use of AI chatbots in their learning. After a series of classroom activities, including metaverse exploration, AI chatbot-based learning activities, and classroom discussions, 43 medical students completed three surveys that measured their motivation to learn using AI tools for medical education, their perception towards the use of AI chatbots in their learning, and their self-assessment of their PCC skills. Our findings revealed significant correlations among learning motivation, PCC scores, and perception variables. Notably, the perception towards AI chatbot-based learning and AI chatbot learning motivation showed a very strong positive correlation (r=0.72), indicating that motivated students were more likely to perceive chatbots as beneficial educational tools. Additionally, a moderate correlation between motivation and self-assessed PCC skills (r=0.54) indicated that students motivated to use AI chatbots tended to rate their PCC skills more favorably. Similarly, a positive relationship (r=0.68) between students' perceptions of chatbot usage and their self-assessed PCC skills indicated that enhancing students' perceptions of AI tools could lead to better educational outcomes.

Keywords

Acknowledgement

This work was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-2020S1A5B5A16084033).

References

  1. Sapci AH, Sapci HA. Artificial intelligence education and tools for medical and health informatics students: systematic review. JMIR Med Educ 2020;6:e19285.
  2. Chan KS, Zary N. Applications and challenges of implementing artificial intelligence in medical education: integrative review. JMIR Med Educ 2019;5:e13930.
  3. Baglivo F, De Angelis L, Casigliani V, Arzilli G, Privitera GP, Rizzo C. Exploring the possible use of AI chatbots in public health education: feasibility study. JMIR Med Educ 2023;9:e51421.
  4. Strong E, DiGiammarino A, Weng Y, Kumar A, Hosamani P, Hom J, et a;. Chatbot vs medical student performance on free-response clinical reasoning examinations. JAMA Intern Med 2023;183:1028-30.
  5. Bjerring JC, Busch J. Artificial intelligence and patient-centered decision-making. Philos Technol 2020;34:349-71.
  6. Ghorashi N, Ismail A, Ghosh P, Sidawy A, Javan R. AI-powered chatbots in medical education: potential applications and implications. Cureus 2023;15:e43271.
  7. Shorey S, Ang E, Yap J, Ng ED, Lau ST, Chui CK. A virtual counseling application using artificial intelligence for communication skills training in nursing education: development study. J Med Internet Res 2019;21:e14658.
  8. Dastani M, Mohseni M. Artificial intelligence chatbots in medical education: a literature review of potential benefits and challenges. Int J Med Rev 2024;11:710-5.
  9. Glynn SM, Brickman P, Armstrong N, Taasoobshirazi G. Science motivation questionnaire II: validation with science majors and non-science majors. J Res Sci Teach 2011;48:1159-76.
  10. de Haes H, Bensing J. Endpoints in medical communication research, proposing a framework of functions and outcomes. Patient Educ Couns 2009;74:287-94.
  11. Algherairy A, Ahmed M. A review of dialogue systems: current trends and future directions. Neural Comput & Applic 2024;36:6325-51.
  12. Danforth DR, Procter M, Chen R, Johnson M, Heller R. Development of virtual patient simulations for medical education. J Virtual Worlds Res 2009;2:3-11.