• The Mathematical Education
• /
• v.63 no.2
• /
• pp.187-207
• /
• 2024

In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.715-718
• /
• 2023

본 연구는 ChatGPT 모델의 특성과 장점을 활용하여 프롬프트 엔지니어링 기법을 연구하고자 하였다. 프롬프트는 엔지니어가 원하는 결과를 잘 얻을 수 있도록 하는 것이 목표이기 때문에 ChatGPT와 프롬프트 엔지니어링의 상호작용과 효과적인 프롬프트 엔지니어링 기법을 개발할 필요가 있다. 연구 방법으로는 ChatGPT에 대한 학습자 사전 설문조사에서 학습자를 분석하였고, 이를 반영하여 프로그래밍 문제를 제시하고 해결하는 과정을 거치면서 다양한 ChatGPT 사용에 대한 분석과 학습자 분석이 이루어졌다. 그 결과 비전공자가 듣고 있는 프로그래밍 수업에서 ChatGPT를 활용하여 얻은 통찰력으로 프롬프트에 필요한 가이드 라인을 마련하였다. 본 연구를 기반으로 향후 비전공자를 위한 파이썬 프로그래밍 수업에서 ChatGPT를 활용한 수업모델을 제시하고 학습자의 피드백 또는 적응형 학습에 활용할 수 있는 방법을 모색할 것이다.

• Journal of Information Technology Applications and Management
• /
• v.30 no.4
• /
• pp.11-28
• /
• 2023

This paper proposes a method of integrating ChatGPT with traditional chatbot systems to enhance conversational artificial intelligence(AI) and create more efficient conversational systems. Traditional chatbot systems are primarily based on classification models and are limited to intent classification and simple response generation. In contrast, ChatGPT is a state-of-the-art AI technology for natural language generation, which can generate more natural and fluent conversations. In this paper, we analyze the business service areas that can be integrated with ChatGPT and traditional chatbots, and present methods for conducting conversational scenarios through case studies of service types. Additionally, we suggest ways to integrate ChatGPT with traditional chatbot systems for intent recognition, conversation flow control, and response generation. We provide a practical implementation example of how to integrate ChatGPT with traditional chatbots, making it easier to understand and build integration methods and actively utilize ChatGPT with existing chatbots.

• Education of Primary School Mathematics
• /
• v.26 no.2
• /
• pp.99-113
• /
• 2023

In this study, I explored the possibility of using ChatGPT math education. For this purpose, students' problem-solving outputs and conversation data between pre-service teachers and a student were selected as an analysis case. A case was analyzed using ChatGPT and compared with the results of mathematics education experts. The results that ChatGPT analyzed students' problem-solving strategies and mathematical thinking skills were similar to those of math education experts. ChatGPT was able to analyze teacher questions with evaluation criteria, and the results were similar to those of math education experts. ChatGPT could also respond with mathematical theory as a source of evaluation criteria. These results demonstrate the potential of ChatGPT to analyze students' thinking and teachers' practice in mathematics education. However, there are limitations in properly applying the evaluation criteria or providing inaccurate information, so the further review of the derived information is required.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.5
• /
• pp.707-719
• /
• 2023

In the Fourth Industrial Revolution era, AI technologies, such as Chat GPT, have moved beyond assisting to actively analyzing data and providing solutions. This research assessed Chat GPT's e-service quality's influence on perceived value, innovativeness, and subsequent learning outcomes. Findings revealed that while ease of use and responsiveness weren't significant, safety and reliability were positively related to perceived value and innovativeness. A negative correlation was found between trustworthiness and perceived value. Users who saw Chat GPT as valuable and innovative experienced enhanced learning. The study emphasizes the need for guidelines in deploying Chat GPT academically. Given Chat GPT's recent introduction, further nuanced research is necessary.

• Journal of Engineering Education Research
• /
• v.27 no.3
• /
• pp.3-13
• /
• 2024

Since the launch of ChatGPT, many college students used it extensively in various ways in their curricular learning activities. This study investigates the utilization of ChatGPT in the curriculum of first and second-year engineering students, aiming to examine its influence from a learner perspective. We explored how ChatGPT is used in each subject and learning activity to understand how learners perceive the use of ChatGPT. From the survey data on engineering college students at E university, we examined students' perception on 'shortening time to perform tasks' through ChatGPT, 'dependence on ChatGPT', 'their contribution to individual capacity building', and 'their influence on academic grade'. The majority of students reported extensive use of ChatGPT for learning activities, particularly showing high dependency in liberal arts subjects and coding-related activities. While the use of ChatGPT in liberal arts was seen as not contributing to the enhancement of individual capacity, its use in coding was positively evaluated. Furthermore, the contribution of ChatGPT to the creativity in report writing tasks was highly rated. These findings offer several important implications for the use of AI tools like ChatGPT in engineering education. Firstly, the positive impact of ChatGPT's high usability and individual-capacity enhancement in coding should be expanded to other areas of learning. Secondly, as AI technology progresses, the contribution of AI tools compared to learners is expected to increase, suggesting that students should be encouraged to effectively use AI tools to achieve their learning objectives while maintaining a balanced approach to avoid overreliance on AI.

• Journal of Korean Home Economics Education Association
• /
• v.35 no.4
• /
• pp.1-12
• /
• 2023

At a time when interest in the educational use of ChatGPT is increasing, it is necessary to investigate the perception of ChatGPT among college students. A survey was conducted to compare the current status of internet and interactive artificial intelligence use and perceptions of ChatGPT after using it in the following courses in Spring 2023; 'Family Life and Culture', 'Fashion and Museums', and 'Fashion in Movies' in the first semester of 2023. We also looked at comparative analysis reports and reflection diaries. Information for coursework was mainly obtained through internet searches and articles, but only 9.84% used interactive AI, showing that its application to learning is still insufficient. ChatGPT was first used in the Spring semester of 2023, and ChatGPT was mainly used among conversational AI. ChatGPT is a bit lacking in terms of information accuracy and reliability, but it is convenient because it allows students to find information while interacting easily and quickly, and the satisfaction level was high, so there was a willingness to use ChatGPT more actively in the future. Regarding the impact of ChatGPT on education, students said that it was positive that they were self-directed and that they set up a cooperative class process to verify information through group discussions and problem-solving attitudes through questions. However, problems were recognized that lowered trust, such as plagiarism, copyright, data bias, lack of up-to-date data learning, and generation of inaccurate or incorrect information, which need to be improved.

• Journal of The Korean Association For Science Education
• /
• v.44 no.1
• /
• pp.119-130
• /
• 2024

This study explores the possibility of using a generative artificial intelligence, ChatGPT, for student assessment in science subjects. In order to achieve our goal, we developed assessment items, collected students' responses, and input them into ChatGPT to implement the assessment procedures. Subsequently, we shared the assessment results from ChatGPT with science teachers and compared them to the teachers' assessment process to investigate the use of ChatGPT in student assessment. Regarding the results, in terms of setting the scoring rubric, we found the rubric generated by ChatGPT to be generally appropriate. However, the consistency between the scoring results obtained from ChatGPT and those determined by the teachers was relatively low. This inconsistency was more pronounced in items with additional assessment components and a more intricate rubric. In regard to feedback on student responses, there were some instances where the feedback generated was scientifically incorrect or beyond the scope of the curriculum, but there were also some positives, such as the provision of exemplary answers to questions and additional examples that helped students learn further. From these results, the teachers perceived limitations in using ChatGPT to conduct assessment in terms of reliability, which is considered crucial in student assessment, but suggested that it could be used to support assessment. Finally, synthesizing these findings, implications for utilizing ChatGPT in student assessment were suggested.

• Journal of Internet of Things and Convergence
• /
• v.9 no.6
• /
• pp.45-50
• /
• 2023

In software development, the elicitation and analysis of requirements is a crucial phase, and it involves considerable time and effort due to the involvement of various stakeholders. ChatGPT, having been trained on a diverse array of documents, is a large language model that possesses not only the ability to generate code and perform debugging but also the capability to be utilized in the domain of software analysis and design. This paper proposes a method of requirements engineering that leverages ChatGPT's capabilities for eliciting software requirements, analyzing them to align with system goals, and documenting them in the form of use cases. In software requirements engineering, it suggests that stakeholders, analysts, and ChatGPT should engage in a collaborative model. The process should involve using the outputs of ChatGPT as initial requirements, which are then reviewed and augmented by analysts and stakeholders. As ChatGPT's capability improves, it is anticipated that the accuracy of requirements elicitation and analysis will increase, leading to time and cost savings in the field of software requirements engineering.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.3
• /
• pp.933-942
• /
• 2024

With the development of AI, Chat GPT, an artificial intelligence chatbot that appeared in 2022, is rapidly spreading to a wide range of people and expanding its usefulness. This study was conducted to examine college students' intention to continue using Chat GPT using a technology acceptance model. As a result of the study, all of Chat GPT's features had a positive effect on college students' perceived usefulness and perceived ease of use. However, among the features of Chat GPT, system quality and relative advantages did not directly affect the intention to continue using it. However, it was confirmed that it had an effect when perceived usefulness and perceived ease of use were mediated. The perceived usefulness and perceived ease of Chat GPT were verified to have a positive effect on the intention to continue using it.