• Journal of Digital Policy
• /
• v.2 no.4
• /
• pp.1-10
• /
• 2023

This study conducted preliminary study to identify effective ways to use ChatGPT in traffic policing by analyzing ChatGPT's responses to the driver's license test and the road traffic accident appraiser test. I collected ChatGPT responses for the driver's license test item pool and the road traffic accident appraiser test using the OpenAI API with Python code for 30 iterative experiments, and analyzed the percentage of correct answers by test, year, section, and consistency. First, the average correct answer rate for the driver's license test and the for road traffic accident appraisers test was 44.60% and 35.45%, respectively, which was lower than the pass criteria, and the correct answer rate after 2022 was lower than the average correct answer rate. Second, the percentage of correct answers by section ranged from 29.69% to 56.80%, showing a significant difference. Third, it consistently produced the same response more than 95% of the time when the answer was correct. To effectively utilize ChatGPT, it is necessary to have user expertise, evaluation data and analysis methods, design a quality traffic law corpus and periodic learning.

• Journal of Internet Computing and Services
• /
• v.25 no.1
• /
• pp.79-90
• /
• 2024

This study focused on user trust in ChatGPT, a generative AI technology, and explored the factors that affect usage status and intention to continue using, and whether the influence of trust varies depending on the purpose. For this purpose, the survey was conducted targeting people in their 20s and 30s who use ChatGPT the most. The statistical analysis deploying IBM SPSS 27 and SmartPLS 4.0. A structural equation model was formulated on the foundation of Bhattacherjee's Expectation-Confirmation Model (ECM), employing path analysis and Multi-Group Analysis (MGA) for hypothesis validation. The main findings are as follows: Firstly, ChatGPT is mainly used for specific needs or objectives rather than as a daily tool. The majority of users are cognizant of its hallucination effects; however, this did not hinder its use. Secondly, the hypothesis testing indicated that independent variables such as expectation- confirmation, perceived usefulness, and user satisfaction all exert a positive influence on the dependent variable, the intention for continuance intention. Thirdly, the influence of trust varied depending on the user's purpose in utilizing ChatGPT. trust was significant when ChatGPT is used for information retrieval but not for creative purposes. This study will be used to solve reliability problems in the process of introducing generative AI in society and companies in the future and to establish policies and derive improvement measures for successful employment.

• Journal of dental hygiene science
• /
• v.24 no.1
• /
• pp.62-70
• /
• 2024

Background: This study aimed to evaluate ChatGPT's performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT's incorrect responses, this research intended to pinpoint the predominant types of errors. Methods: To evaluate ChatGPT-3.5's performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5's problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT's responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.47 no.6
• /
• pp.1038-1056
• /
• 2023

This study investigates the effects of ChatGPT's quality characteristics (service and information) on purchase intention and word of mouth intention. We distributed questionnaires among domestic men and women aged in their 20s and 30s who had experience of using ChatGPT. A total of 222 responses were subjected to frequency analysis, factor analysis, correlation analysis, and multiple linear regression analysis using the IBM SPSS statistical program version 26. The major findings were as follows: (1) The factors of service quality were categorized as Tangibility, Reliability, Empathy, and Assurance, while the factors of information quality were categorized as Recency, Accuracy, and Usefulness. (2) Among the service quality factors of ChatGPT, two factors (Reliability and Empathy) significantly impacted purchase intention, and three factors (Tangibility, Reliability, and Empathy) significantly affected word of mouth intention. (3) Among ChatGPT's information quality factors, two factors (Usefulness and Recency) had a significant effect on purchase intention, and two factors (Usefulness and Accuracy) exerted a significant influence on word of mouth intention. (4) Purchase intention had a significant effect on word of mouth intention.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.2
• /
• pp.565-574
• /
• 2024

ChatGPT is causing significant reverberations across all sectors of our society, and this holds true for the field of education as well. However, scholarly and societal discussions regarding ChatGPT in academic settings have primarily focused on issues such as plagiarism, with relatively limited research on the positive effects of utilizing generative AI. Additionally, amidst the educational crisis of the post-COVID era, there is a growing recognition of the need to enhance academic engagement. In light of these concerns, we investigated how academic engagement varies based on students' levels of ChatGPT literacy and examined whether students' academic confidence and perceived academic competence serve as mediators between ChatGPT literacy and academic engagement. An analysis using SPSS was conducted on the data collected from 406 college students. The results showed that ChatGPT literacy had a positive effect on academic engagement, and academic confidence mediated the relationship between ChatGPT literacy and academic engagement. Also, when the mediating effect of perceived academic competence was significant only when it was serially mediated. Based on these findings, we discussed the theoretical contributions of identifying the theoretical mechanism between ChatGPT literacy and academic engagement. In addition, practical implications regarding the importance of ChatGPT literacy education were described.

• Imaging Science in Dentistry
• /
• v.54 no.3
• /
• pp.271-275
• /
• 2024

Purpose: Recent advancements in artificial intelligence (AI), particularly tools such as ChatGPT developed by OpenAI, a U.S.-based AI research organization, have transformed the healthcare and education sectors. This study investigated the effectiveness of ChatGPT in answering dentistry exam questions, demonstrating its potential to enhance professional practice and patient care. Materials and Methods: This study assessed the performance of ChatGPT 3.5 and 4 on U.S. dental exams - specifically, the Integrated National Board Dental Examination (INBDE), Dental Admission Test (DAT), and Advanced Dental Admission Test (ADAT) - excluding image-based questions. Using customized prompts, ChatGPT's answers were evaluated against official answer sheets. Results: ChatGPT 3.5 and 4 were tested with 253 questions from the INBDE, ADAT, and DAT exams. For the INBDE, both versions achieved 80% accuracy in knowledge-based questions and 66-69% in case history questions. In ADAT, they scored 66-83% in knowledge-based and 76% in case history questions. ChatGPT 4 excelled on the DAT, with 94% accuracy in knowledge-based questions, 57% in mathematical analysis items, and 100% in comprehension questions, surpassing ChatGPT 3.5's rates of 83%, 31%, and 82%, respectively. The difference was significant for knowledge-based questions(P=0.009). Both versions showed similar patterns in incorrect responses. Conclusion: Both ChatGPT 3.5 and 4 effectively handled knowledge-based, case history, and comprehension questions, with ChatGPT 4 being more reliable and surpassing the performance of 3.5. ChatGPT 4's perfect score in comprehension questions underscores its trainability in specific subjects. However, both versions exhibited weaker performance in mathematical analysis, suggesting this as an area for improvement.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.19 no.2
• /
• pp.135-145
• /
• 2023

ChatGPT is an artificial intelligence-based conversation agent developed by OpenAI using natural language processing technology. In this study, an empirical study was conducted on incumbent teachers on the intention to use the newly emerged Chat GPT. First, we studied how accuracy, entertainment, system accessibility, perceived usefulness, and perceived ease of use affect ChatGPT's acceptance intention. In addition, we analyzed whether perceived usefulness and perceived ease of use differ in the intention to accept depending on the digital technology of teachers. As a result of the study, the suitability of the structural equation model was generally good. Accuracy and entertainment were found to have a significant effect on perceived usefulness, and system accessibility was found to have a significant effect on perceived ease of use. In the analysis of teachers' digital technology control effects, it was found that perceived usefulness and perceived ease of use had a control effect between acceptance intentions. It was found that the group with high digital skills of teachers was strongly intended to accept the service regardless of perceived usefulness and ease of use. In the group with low digital skills of teachers, it is thought that ChatGPT's service shows the acceptance intention only when the perceived usefulness and ease of use are high. Therefore, in the group with low digital technology, it is necessary to seek teaching activities such as the development of instructional models using ChatGPT.

• Journal of Information Technology Services
• /
• v.22 no.6
• /
• pp.17-35
• /
• 2023

This study investigated how helpful the use of generative AI such as ChatGPT is in conducting engaged learning at each university. In this study, based on the experiences of users using generative AI technology, we analyzed the relationship between usability and ease in consideration of the characteristics of learners, and examined whether there is an intention to continue using generative AI technology in the future. In this study, in order to verify the factors affecting the intention to use ChatGPT technology in order to solve the problems given in the participating classes, we examined previous papers based on the Technology Acceptance Model (TAM) and the Information System Success Model (IS), extracted the factors affecting the intention of ChatGPT technology, and presented the research model and hypothesis. Empirical research on the continuous use of generative AI in participatory learning using ChatGPT was conducted to determine whether it is suitable for long-term and continuous use in the educational environment, and whether it is sustainable by examining the intention of learners to continue using it. First, user satisfaction was positively related to the intention to continue using generative AI technology. Second, if the user experience has a great influence on the intention to continue using ChatGPT technology, and users gain experiences such as usefulness, interest, and effective response in the process of using the technology, the evaluation of the technology is positively formed and the intention to continue using it is high. Third, the ease of use of the technology also showed that it was intended to be used continuously when an environment was provided in which users could easily and conveniently utilize generative AI technology.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.18 no.6
• /
• pp.1285-1290
• /
• 2023

Although the environment in virtual space (hereinafter referred to as VR) has the problem of being difficult to access compared to existing PCs and smartphones, it has the advantage of being more realistic and providing endless experiences and functions compared to existing environments. In this VR environment, there is a need to develop technologies that help people handle tasks more conveniently in the virtual world by studying interfaces and interactions using ChatGPT, a recently popular AI technology. The ChatGPT interface and interaction in the VR environment are also studied to provide personalized services. Through this, users can choose the interface that suits them and the secretary interface can also provide customized services optimized for users. Accordingly, in this study, we design a convenient interaction method by linking the ChatGPT system in a VR environment and use it as a previous study for the development of an AI assistant.

• Journal of KIBIM
• /
• v.14 no.2
• /
• pp.25-34
• /
• 2024

This study proposes a new methodology to increase the flexibility and efficiency of the design data evaluation system by combining Building Information Modeling (BIM) technology in the architectural industry, OpenAI's interactive artificial intelligence, and ChatGPT. BIM technology plays an important role in digitally modeling and managing architectural information. Since architectural information is included, research and development are underway to review and evaluate BIM data according to conditions through program development. However, in the process of reviewing BIM design data, if the review criteria or evaluation criteria according to design change occur frequently, it is necessary to update the program anew. In order for designers or reviewers to apply the changed criteria, requesting a program developer will delay time. This problem was studied by using ChatGPT to modify and update the design data evaluation program code in real time. In this study, it is aimed to improve the changing standards and accuracy by enabling programming non-professionals to change the design regulations and calculation standards of the BIM evaluation program system using ChatGPT. In this study, in the BIM-based design certification automation evaluation program, a program in which the automation evaluation method is being studied based on the design certification evaluation manual was first used. In the design certification automation evaluation program, the programming non-majors checked the automation evaluation code by linking ChatGPT, and the changed calculation criteria were created and modified interactively. As a result of the evaluation, the change in the calculation standard was explained to ChatGPT and the applied result was confirmed.