• The Mathematical Education
• /
• v.63 no.2
• /
• pp.187-207
• /
• 2024

In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.1
• /
• pp.71-79
• /
• 2024

ChatGPT, an interactive artificial intelligence (AI) chatbot developed by Open AI in the U.S., gaining popularity with great repercussions around the world. Some academia are concerned that ChatGPT can be used by students for plagiarism, but ChatGPT is also widely used in a positive direction, such as being used to write marketing phrases or website phrases. There is also an opinion that ChatGPT could be a new future for "search," and some analysts say that the focus should be on fostering rather than excessive regulation. This study analyzed consciousness about ChatGPT for college students through a survey of their perception of ChatGPT. And, plagiarism inspection systems were prepared to establish an education support model using ChatGPT and ChatGPT. Based on this, a university education support model using ChatGPT was constructed. The education model using ChatGPT established an education model based on text, digital, and art, and then composed of detailed strategies necessary for the era of the 4th industrial revolution below it. In addition, it was configured to guide students to use ChatGPT within the permitted range by using the ChatGPT detection function provided by the plagiarism inspection system, after the instructor of the class determined the allowable range of content generated by ChatGPT according to the learning goal. By linking and utilizing ChatGPT and the plagiarism inspection system in this way, it is expected to prevent situations in which ChatGPT's excellent ability is abused in education.

• Journal of Information Technology Applications and Management
• /
• v.30 no.4
• /
• pp.11-28
• /
• 2023

This paper proposes a method of integrating ChatGPT with traditional chatbot systems to enhance conversational artificial intelligence(AI) and create more efficient conversational systems. Traditional chatbot systems are primarily based on classification models and are limited to intent classification and simple response generation. In contrast, ChatGPT is a state-of-the-art AI technology for natural language generation, which can generate more natural and fluent conversations. In this paper, we analyze the business service areas that can be integrated with ChatGPT and traditional chatbots, and present methods for conducting conversational scenarios through case studies of service types. Additionally, we suggest ways to integrate ChatGPT with traditional chatbot systems for intent recognition, conversation flow control, and response generation. We provide a practical implementation example of how to integrate ChatGPT with traditional chatbots, making it easier to understand and build integration methods and actively utilize ChatGPT with existing chatbots.

• Journal of Korean Biological Nursing Science
• /
• v.25 no.3
• /
• pp.183-204
• /
• 2023

Purpose: The purpose of this study was to evaluate the applicability of ChatGPT in biological nursing science education. Methods: This study was conducted by entering questions about the field of biological nursing science into ChatGPT versions GPT-3.5 and GPT-4 and evaluating the answers. Three questions each related to microbiology and pharmacology were entered, and the generated content was analyzed to determine its applicability to the field of biological nursing science. The questions were of a level that could be presented to nursing students as written test questions. Results: The answers generated in English had 100.0% accuracy in both GPT-3.5 and GPT-4. For the sentences generated in Korean, the accuracy rate of GPT-3.5 was 62.7%, and that of GPT-4 was 100.0%. The total number of Korean sentences in GPT-3.5 was 51, while the total number of Korean sentences in GPT-4 was 68. Likewise, the total number of English sentences in GPT-3.5 was 70, while the total number of English sentences in GPT-4 was 75. This showed that even for the same Korean or English question, GPT-4 tended to be more detailed than GPT-3.5. Conclusion: This study confirmed the advantages of ChatGPT as a tool to improve understanding of various complex concepts in the field of biological nursing science. However, as the answers were based on data collected up to 2021, a guideline reflecting the most up-to-date information is needed. Further research is needed to develop a reliable and valid scale to evaluate ChatGPT's responses.

• The Journal of Information Systems
• /
• v.33 no.1
• /
• pp.91-114
• /
• 2024

Purpose The purpose of this study is to empirically investigate the factors that influence users' continuous intention to use ChatGPT based on the Expectation Confirmation Model(ECM). Drawing from the literature, this study identifies anthropomorphism and trust as key characteristics of generative AI and ChatGPT. Design/methodology/approach The research model was developed based on ECM and literature research to investigate the impacts of anthropomorphism and trust on continuous intention of using ChatGPT. In order to test the hypothese, a total of 193 questionnaires were collected and analyzed for the structural equation modeling with SmartPLS 4.0. Findings The study's findings show that all proposed hypotheses were supported, suggesting that the ECM is a valid framework for examining continuous intention of using ChatGPT. Moreover, the study stressed the crucial role of anthropomorphism in the model, showing the positive impact on expectation confirmation, perceived usefulness, and trust in ChatGPT. Also, trust positively affects perceived usefulness. These findings provide valuable insights for enhancing user satisfaction and continuous usage intention, serving as a foundation for development strategies for ChatGPT and similar AI-based systems.

• International Journal of Advanced Culture Technology
• /
• v.11 no.4
• /
• pp.378-384
• /
• 2023

In this study, we explore social awareness, interest, and acceptance of generative AI, including chatGPT, which has revolutionized web search, 30 years after web search was released. For this purpose, we performed a machine learning-based topic modeling analysis based on Korean news big data collected from November 30, 2022, when chatGPT was released, to August 31, 2023. As a result of our research, we have identified seven topics related to chatGPT and generative AI; (1)growth of the high-performance hardware market, (2)service contents using generative AI, (3)technology development competition, (4)human resource development, (5)instructions for use, (6)revitalizing the domestic ecosystem, (7)expectations and concerns. We also explored monthly frequency changes in topics to explore social interest related to chatGPT and Generative AI. Based on our exploration results, we discussed the high social interest and issues regarding generative AI. We expect that the results of this study can be used as a precursor to research that analyzes and predicts the diffusion of innovation in generative AI.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.4
• /
• pp.659-666
• /
• 2023

Among the tools based on generative artificial intelligence, the possibility of using ChatGPT is being explored. However, studies that have confirmed what factors should be considered when using it educationally based on learners' actual perceptions are insufficient. Through qualitative research method, this study was to derive consideration factors when using ChatGPT in the education. The results showed that there were five key factors as follows: critical thinking on generated information, recognizing it as a tool to support learning and avoiding dependent use, conducting prior training on ethical usage, generating clear and appropriate questions, and reviewing and synthesizing answers. It is necessary to develop an instructional design model that comprehensively composes the above elements.

• Journal of KIBIM
• /
• v.13 no.3
• /
• pp.21-29
• /
• 2023

ChatGPT, a chatbot based on GPT large language models, has gained immense popularity among the general public as well as domain professionals. To assess its proficiency in specialized fields, ChatGPT was tested on mainstream exams like the bar exam and medical licensing tests. This study evaluated ChatGPT's ability to answer questions related to Building Information Modeling (BIM) by testing it on Korea's BIM expertise exam, focusing primarily on multiple-choice problems. Both GPT-3.5 and GPT-4 were tested by prompting them to provide the correct answers to three years' worth of exams, totaling 150 questions. The results showed that both versions passed the test with average scores of 68 and 85, respectively. GPT-4 performed particularly well in categories related to 'BIM software' and 'Smart Construction technology'. However, it did not fare well in 'BIM applications'. Both versions were more proficient with short-answer choices than with sentence-length answers. Additionally, GPT-4 struggled with questions related to BIM policies and regulations specific to the Korean industry. Such limitations might be addressed by using tools like LangChain, which allow for feeding domain-specific documents to customize ChatGPT's responses. These advancements are anticipated to enhance ChatGPT's utility as a virtual assistant for BIM education and modeling automation.

• Therapeutic Science for Rehabilitation
• /
• v.13 no.1
• /
• pp.65-74
• /
• 2024

Objective : This study assessed ChatGPT, an artificial intelligence system based on a large language model, for its ability to pass the National Korean Occupational Therapy Licensure Examination (NKOTLE). Methods : Using NKOTLE questions from 2018 to 2022, provided by the Korea Health and Medical Personnel Examination Institute, this study employed English prompts to determine the accuracy of ChatGPT in providing correct answers. Two researchers independently conducted the entire process, and the average accuracy of both researchers was used to determine whether ChatGPT passed over the 5-year period. The degree of agreement between ChatGPT answers of the two researchers was assessed. Results : ChatGPT passed the 2020 examination but failed to pass the other 4 years' examination. Specifically, its accuracy in questions related to medical regulations ranged from 25% to 57%, whereas its accuracy in other questions exceeded 60%. ChatGPT exhibited a strong agreement between researchers, except for medical regulation questions, and this agreement was significantly correlated with accuracy. Conclusion : There are still limitations to the application of ChatGPT to answer questions influenced by language or culture. Future studies should explore its potential as an educational tool for students majoring in occupational therapy through optimized prompts and continuous learning from the data.

• The Korean Journal of Food & Health Convergence
• /
• v.9 no.4
• /
• pp.19-23
• /
• 2023

The integration of ChatGPT, an AI-powered language model, is causing a profound transformation within the food industry, impacting various domains. It offers novel capabilities in recipe creation, personalized dining, menu development, food safety, customer service, and culinary education. ChatGPT's vast culinary dataset analysis aids chefs in pushing flavor boundaries through innovative ingredient combinations. Its personalization potential caters to dietary preferences and cultural nuances, democratizing culinary knowledge. It functions as a virtual mentor, empowering enthusiasts to experiment creatively. For personalized dining, ChatGPT's language understanding enables customer interaction, dish recommendations based on preferences. In menu development, data-driven insights identify culinary trends, guiding chefs in crafting menus aligned with evolving tastes. It suggests inventive ingredient pairings, fostering innovation and inclusivity. AI-driven data analysis contributes to quality control, ensuring consistent taste and texture. Food writing and marketing benefit from ChatGPT's content generation, adapting to diverse strategies and consumer preferences. AI-powered chatbots revolutionize customer service, improving ordering experiences, and post-purchase engagement. In culinary education, ChatGPT acts as a virtual mentor, guiding learners through techniques and history. In food safety, data analysis prevents contamination and ensures compliance. Overall, ChatGPT reshapes the industry by uniting AI's analytics with culinary expertise, enhancing innovation, inclusivity, and efficiency in gastronomy.