• Journal of Digital Convergence
• /
• v.17 no.8
• /
• pp.37-46
• /
• 2019

The purpose of this study is to explore the effects of the use of artificial intelligence chatbots on improving Korean college students' English grammar skills. 70 undergraduate students participated in the present study. They were taking a General English class offered by a university in Korea. There were two groups in this study. Participants in the chatbot group consisted of 36 students while those in the human group were 34. Over 16 weeks, the chatbot group engaged in ten chat sessions with a chatbot while the human group had a chat with a human chat partner. Both pre- and post-tests were performed to examine changes in the participants' grammar skills over time. To compare the improvement between the two groups, an independent t-test was then run. Main findings are as follows: First, participants in both groups significantly improved their English grammar skills, indicating the beneficial effects of engaging in chat. Also, there was a statistically significant difference in the improvement between the chatbot and human groups, indicating the superior effects of the chatbot use. This study confirmed the improved grammar skills by the participants in the chatbot group, comparison with those in the human group. Based on these findings, suggestions for the future chatbot study are discussed.

• Journal of Service Research and Studies
• /
• v.13 no.3
• /
• pp.82-104
• /
• 2023

This study analyzes the effect of users' experiences using AI chatbot services on relationship quality and behavioral intention. For the study, a survey was conducted on users who experienced AI chatbot services, and the research hypothesis was verified by analyzing the final 299 copies of valid data. As a result of the analysis, it was confirmed that satisfaction and trust, which are the relationship quality dimensions of AI chatbot service, were formed in users through the cognitive experience, emotional experience, and relational experience. In addition, it was confirmed that satisfaction and trust have a positive effect on the intention to continue using and recommending AI chatbot services, which correspond to the level of consumers' behavioral intentions, respectively. In addition, in terms of relationship quality, it was significant in all paths of the road of behavior, but in satisfaction, the path coefficient of the road of continuous use of AI chatbot and recommended road was significantly higher than the path coefficient in trust. This study provided a theoretical foundation that the relationship with relationship quality that affects behavioral intention also affects AI chatbot services in the online environment, and it is significant in that it suggests that relationship quality is an important mediating factor in establishing long-term relationships with consumers.

• The Mathematical Education
• /
• v.63 no.3
• /
• pp.467-484
• /
• 2024

The rapid advancement of generative AI has ushered in an era where anyone can create and freely utilize personalized chatbots without the need for programming expertise. This study aimed to develop a customized chatbot based on OpenAI's GPTs for the purpose of pre-service teacher education and to analyze its educational performance in mathematics as assessed by educators guiding pre-service teachers. Responses to identical questions from a general-purpose chatbot (ChatGPT), a customized GPTs-based chatbot, and an elementary mathematics education expert were compared. The expert's responses received an average score of 4.52, while the customized GPTs-based chatbot received an average score of 3.73, indicating that the latter's performance did not reach the expert level. However, the customized GPTs-based chatbot's score, which was close to "adequate" on a 5-point scale, suggests its potential educational utility. On the other hand, the general-purpose chatbot, ChatGPT, received a lower average score of 2.86, with feedback indicating that its responses were not systematic and remained at a general level, making it less suitable for use in mathematics education. Despite the proven educational effectiveness of conventional customized chatbots, the time and cost associated with their development have been significant barriers. However, with the advent of GPTs services, anyone can now easily create chatbots tailored to both educators and learners, with responses that achieve a certain level of mathematics educational validity, thereby offering effective utilization across various aspects of mathematics education.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.7
• /
• pp.17-25
• /
• 2020

Based on the successful use of chatbot technology, this study examined what business values each company is creating. The chatbot service contributes to improving the productivity of the company by helping to answer or respond to the questions of employees inside the company or customers. And in the field of education, Instead of instructor, AI technology responds the questions and feedback of the students to reduce the work of the instructor. In the field of commerce, offline stores provide convenient and new purchasing experiences to customers by providing product purchasing services through artificial intelligence speakers and personalization service. Although chatbot service is creating business value in some business cases, it is still limited to the process of a specific company, and the spread rate is still slowing because the service scope, convenience, and usefulness are not greater than expected. Therefore, some chatbot development service providers is providing an integrated development platform to improve usability, Chatbots have the features and advantages of providing convenience instead of answering human questions. However, there is a disadvantage that the level of communication can be lowered by reducing various human subjective views and giving mainly objective answers. Through this study, we will discuss the characteristics, advantages and disadvantages of chatbot services by comparing them.

• Journal of The Korean Association For Science Education
• /
• v.44 no.3
• /
• pp.231-248
• /
• 2024

This study developed a chatbot for first-year high school students, employing open-source software and the Korean Sentence-BERT model for AI-powered document classification. The chatbot utilizes the Sentence-BERT model to find the six most similar Q&A pairs to a student's query and presents them in a carousel format. The initial dataset, built from online resources, was refined and expanded based on student feedback and usability throughout over the operational period. By the end of the 2023 academic year, the chatbot integrated a total of 30,819 datasets and recorded 3,457 student interactions. Analysis revealed students' inclination to use the chatbot when prompted by teachers during classes and primarily during self-study sessions after school, with an average of 2.1 to 2.2 inquiries per session, mostly via mobile phones. Text mining identified student input terms encompassing not only science-related queries but also aspects of school life such as assessment scope. Topic modeling using BERTopic, based on Sentence-BERT, categorized 88% of student questions into 35 topics, shedding light on common student interests. A year-end survey confirmed the efficacy of the carousel format and the chatbot's role in addressing curiosities beyond integrated science learning objectives. This study underscores the importance of developing chatbots tailored for student use in public education and highlights their educational potential through long-term usage analysis.

• Knowledge Management Research
• /
• v.25 no.2
• /
• pp.49-68
• /
• 2024

Increasing concerns regarding personal data privacy have complicated the acquisition of customer data through online marketing. This study investigates factors influencing customers' willingness to disclose information via a generative AI-based chatbot. Drawing on privacy calculus theory and regulatory focus theory, we explore how customer regulatory focus and familiarity with the generative AI-based chatbot shape disclosure intentions. Our study, involving 473 participants, reveals that low familiarity with the chatbot leads individuals with a prevention focus to perceive higher privacy risks and lower perceived usefulness compared to those with a promotion focus. However, with high familiarity, these differences diminish. Moreover, individuals with a promotion focus show a greater inclination to disclose information when familiarity with the generative AI-based chatbot is low, whereas this regulatory focus does not significantly impact disclosure intentions when familiarity is high. Perceived privacy risks mediate these relationships, underscoring the importance of understanding familiarity with the generative AI-based chatbot in facilitating personal information disclosure.

• Education of Primary School Mathematics
• /
• v.27 no.3
• /
• pp.303-320
• /
• 2024

This study presents the development and performance evaluation of a custom GPT-based chatbot tailored to provide solutions following Polya's problem-solving stages. A beta version of the chatbot was initially deployed to assess its mathematical capabilities, followed by iterative error identification and correction, leading to the final version. The completed chatbot demonstrated an accuracy rate of approximately 89.0%, correctly solving an average of 57.8 out of 65 image-based problems from a 6th-grade elementary mathematics textbook, reflecting a 4 percentage point improvement over the beta version. For a subset of 50 problems, where images were not critical for problem resolution, the chatbot achieved an accuracy rate of approximately 91.0%, solving an average of 45.5 problems correctly. Predominant errors included problem recognition issues, particularly with complex or poorly recognizable images, along with concept confusion and comprehension errors. The custom chatbot exhibited superior mathematical performance compared to the general-purpose ChatGPT. Additionally, its solution process can be adapted to various grade levels, facilitating personalized student instruction. The ease of chatbot creation and customization underscores its potential for diverse applications in mathematics education, such as individualized teacher support and personalized student guidance.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2018.05a
• /
• pp.275-278
• /
• 2018

As the population ages socially and the diet of people becomes westernized, the incidence of chronic diseases is increasing due to irregular lifestyle. Chronic diseases can be prevented and improved with just regular lifestyle and diet. Most of the recently released diet management mobile applications are aimed at obesity management and diet, and applications that aim to prevent or improve chronic diseases are hard to find. In this paper, we develop a web service that identifies diabetes most frequently encountered among chronic diseases, and implements a chatbot service that helps diabetes management by using Chatscript.

• Journal of Information Technology Services
• /
• v.16 no.4
• /
• pp.149-160
• /
• 2017

Sentiment analysis is the process of determining whether a piece of document, text or conversation is positive, negative, neural or other emotion. Sentiment analysis has been applied for several real-world applications, such as chatbot. In the last five years, the practical use of the chatbot has been prevailing in many field of industry. In the chatbot applications, to recognize the user emotion, sentiment analysis must be performed in advance in order to understand the intent of speakers. The specific emotion is more than describing positive or negative sentences. In light of this context, we propose deep learning models for conducting multi-class sentiment analysis for identifying speaker's emotion which is categorized to be joy, fear, guilt, sad, shame, disgust, and anger. Thus, we develop convolutional neural network (CNN), long short term memory (LSTM), and multi-layer neural network models, as deep neural networks models, for detecting emotion in a sentence. In addition, word embedding process was also applied in our research. In our experiments, we have found that long short term memory (LSTM) model performs best compared to convolutional neural networks and multi-layer neural networks. Moreover, we also show the practical applicability of the deep learning models to the sentiment analysis for chatbot.

• International Journal of Internet, Broadcasting and Communication
• /
• v.14 no.2
• /
• pp.55-62
• /
• 2022

A smart tourism chatbot is needed as a user interface to efficiently provide smart tourism services such as recommended travel products, tourist information, my travel itinerary, and tour guide service to tourists. We have been developed a smart tourism app and a smart tourism information system that provide smart tourism services to tourists. We also developed a smart tourism chatbot service consisting of khaiii morpheme analyzer, rule-based intention classification, and tourism information knowledge base using Neo4j graph database. In this paper, we develop the Korean and English smart tourism Name Entity (NE) datasets required for the development of the NER model using the pre-trained language models (PLMs) for the smart tourism chatbot system. We create the tourism information NER datasets by collecting source data through smart tourism app, visitJeju web of Jeju Tourism Organization (JTO), and web search, and preprocessing it using Korean and English tourism information Name Entity dictionaries. We perform training on the KoBERT-CRF NER model using the developed Korean and English tourism information NER datasets. The weight-averaged precision, recall, and f1 scores are 0.94, 0.92 and 0.94 on Korean and English tourism information NER datasets.