• Title/Summary/Keyword: Chatbot Accuracy

Search Result 24, Processing Time 0.017 seconds

An Application of RASA Technology to Design an AI Virtual Assistant: A Case of Learning Finance and Banking Terms in Vietnamese

  • PHAM, Thi My Ni;PHAM, Thi Ngoc Thao;NGUYEN, Ha Phuong Truc;LY, Bao Tuyen;NGUYEN, Truc Linh;LE, Hoanh Su
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.9 no.5
    • /
    • pp.273-283
    • /
    • 2022
  • Banking and finance is a broad term that incorporates a variety of smaller, more specialized subjects such as corporate finance, tax finance, and insurance finance. A virtual assistant that assists users in searching for information about banking and finance terms might be an extremely beneficial tool for users. In this study, we explored the process of searching for information, seeking opportunities, and developing a virtual assistant in the first stages of starting learning and understanding Vietnamese to increase effectiveness and save time, which is also an innovative business practice in Use-case Vietnam. We built the FIBA2020 dataset and proposed a pipeline that used Natural Language Processing (NLP) inclusive of Natural Language Understanding (NLU) algorithms to build chatbot applications. The open-source framework RASA is used to implement the system in our study. We aim to improve our model performance by replacing parts of RASA's default tokenizers with Vietnamese tokenizers and experimenting with various language models. The best accuracy we achieved is 86.48% and 70.04% in the ideal condition and worst condition, respectively. Finally, we put our findings into practice by creating an Android virtual assistant application using the model trained using Whitespace tokenizer and the pre-trained language m-BERT.

An Exploratory Study of Success Factors for Generative AI Services: Utilizing Text Mining and ChatGPT (생성형AI 서비스의 성공요인에 대한 탐색적 연구: 텍스트 마이닝과 ChatGPT를 활용하여)

  • Ji Hoon Yang;Sung-Byung Yang;Sang-Hyeak Yoon
    • Information Systems Review
    • /
    • v.25 no.2
    • /
    • pp.125-144
    • /
    • 2023
  • Generative Artificial Intelligence (AI) technology is gaining global attention as it can automatically generate sentences, images, and voices that humans previously generated. In particular, ChatGPT, a representative generative AI service, shows proactivity and accuracy differentiated from existing chatbot services, and the number of users is rapidly increasing in a short period of time. Despite this growing interest in generative AI services, most preceding studies are still in their infancy. Therefore, this study utilized LDA topic modeling and keyword network diagrams to derive success factors for generative AI services and to propose successful business strategies based on them. In addition, using ChatGPT, a new research methodology that complements the existing text-mining method, was presented. This study overcomes the limitations of previous research that relied on qualitative methods and makes academic and practical contributions to the future development of generative AI services.

Natural Language Processing Model for Data Visualization Interaction in Chatbot Environment (챗봇 환경에서 데이터 시각화 인터랙션을 위한 자연어처리 모델)

  • Oh, Sang Heon;Hur, Su Jin;Kim, Sung-Hee
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.9 no.11
    • /
    • pp.281-290
    • /
    • 2020
  • With the spread of smartphones, services that want to use personalized data are increasing. In particular, healthcare-related services deal with a variety of data, and data visualization techniques are used to effectively show this. As data visualization techniques are used, interactions in visualization are also naturally emphasized. In the PC environment, since the interaction for data visualization is performed with a mouse, various filtering for data is provided. On the other hand, in the case of interaction in a mobile environment, the screen size is small and it is difficult to recognize whether or not the interaction is possible, so that only limited visualization provided by the app can be provided through a button touch method. In order to overcome the limitation of interaction in such a mobile environment, we intend to enable data visualization interactions through conversations with chatbots so that users can check individual data through various visualizations. To do this, it is necessary to convert the user's query into a query and retrieve the result data through the converted query in the database that is storing data periodically. There are many studies currently being done to convert natural language into queries, but research on converting user queries into queries based on visualization has not been done yet. Therefore, in this paper, we will focus on query generation in a situation where a data visualization technique has been determined in advance. Supported interactions are filtering on task x-axis values and comparison between two groups. The test scenario utilized data on the number of steps, and filtering for the x-axis period was shown as a bar graph, and a comparison between the two groups was shown as a line graph. In order to develop a natural language processing model that can receive requested information through visualization, about 15,800 training data were collected through a survey of 1,000 people. As a result of algorithm development and performance evaluation, about 89% accuracy in classification model and 99% accuracy in query generation model was obtained.

A Study on Evaluation and Improvement Plan for Applications for Smart-phone Overdependence Prevention (스마트폰 과의존 방지 애플리케이션 평가 및 서비스 주체별 개선방안 연구)

  • Gyoo Gun Lim;Hai Yan Jin;Hye min Hwang;Hye won Cho;Jae Ik Ahn
    • Journal of Service Research and Studies
    • /
    • v.12 no.1
    • /
    • pp.36-48
    • /
    • 2022
  • As the use of smartphones has rapidly increased due to the development of digital technology, the expansion of smartphones, and the COVID-19 incident, dependence on smartphones and the Internet is emerging as a serious social problem. As one of the solutions to the smartphone overdependence problem, the government and companies are releasing smartphone overdependence prevention applications. However, research on the effectiveness of smartphone overdependence prevention applications is insufficient. Therefore, this study selects 25 applications serviced in Korea as analysis targets and evaluates smartphone overdependence prevention applications in terms of function and service using the FGI survey method to identify problems and propose improvements. In the function evaluation, the functions of blocking illegal/harmful apps/websites, limiting smartphone usage time, and monitoring smartphone usage status are provided in most applications, so satisfaction scores are also highly evaluated. However, functions such as location check, smombie prevention, and body camphishing prevention served by some applications are evaluated low due to poor performance and poor accuracy. Classified by service provider, government-providing applications need to accurately perform functions and improve convenience of use. Mobile-Carrier-providing applications need to improve connectivity with other carriers and compatibility with other smart devices like smartphone, tablet, etc. Other private enterprise-providing applications need to open AS channels such as customer service centre and chatbot to improve service.