A Study on a Chatbot Service Model Architecture using Open Source Chatbot Builders

  • Received : 2022.09.21
  • Accepted : 2022.12.12
  • Published : 2022.12.31

Abstract

Due to the development of IT technology and the on-going Coronavirus disease, non-face-to-face services have been activated. To overcome the inconvenience of non-face-to-face service, service providers have adopted chatbots as a way to feel like a human being. As the increasing chatbot services, chatbot builders have emerged, which can help non-developers to build them. Although its popularity has increased, its performance evaluation has not been conducted on such chatbot builders. In this paper, we implement a prototype chatbot that classifies hospital departments in the medical field using Dialogflow and Rasa, which are popular chatbot builders. By measuring the accuracy of the chatbot's classification of medical subjects, we evaluated the level of accuracy that the most used chatbot builder can have when they are used to build a chatbot service. The simulation results showed that Dialogflow had 87%, 65%, and 60%, and Rasa did 64%, 70%, and 63% in surgery dermatology, and otolaryngology, respectively.

Keywords

Acknowledgement

Funding for this paper was provided by Namseoul University year 2021.

References

  1. A. Abdellatif, K. Badran, D. Costa, E. Shihab, A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineering, IEEE Transactions on Software Engineering , 2021, pp 1-1.
  2. HaeKyung Chung and Jungjo Na, Development of Wine Recommendation App Using Artificial Intelligence-Based Chatbot Service, Journal of the Semiconductor & Display Technology, Vol. 18, No. 3. September 2019, pp. 93-99.
  3. T. Lalwani, S. Bhalotia, A. Pal, S. Bisen, V. Rathod, "Implementation of a Chatbot System using AI and NLP" IJIRCST (International Journal of Innovative Research in Computer Science & Technology), Vol. 6, 2018.
  4. J. Weizenbaum, ELIZA A Computer Program For the Study of Natural Language Communication Between Man and Machine, Communication of the ACM, 1966, Vol. 9, pp. 36-45. https://doi.org/10.1145/365153.365168
  5. A. F. Muhammad, D. Susanto, A. Alimudin, F. Adila, M. H. Assidiqi, S. Nabhan, Developing English Conversation Chatbot Using Dialogflow, 2020 International Electronics Symposium (IES), 2020.
  6. Y. B. Yoon, "Prospects of Using AI Chatbots in Tech Speaking in Primary English: With Special Reference to Dialogflow" The Journal of Korea Elementary Education, 2021, Vol. 32, pp. 15-28.
  7. S. Salvi, G. V, S. K. S, Jamura: A Conversational Smart Home Assistant Built on Telegram and Google Dialogflow, 2019 Region 10 Conference IEEE, 2019
  8. T. Bocklisch, J. Faulkner, N. Pawlowski, A. Nichol, "Rasa: Open Source Language Understanding and Dialogue Management" 2017, arXiv:1712.05181.