• The Journal of Economics, Marketing and Management
• /
• v.12 no.5
• /
• pp.75-89
• /
• 2024

Purpose: This study applies the Unified Theory of Acceptance and Use of Technology (UTAUT) to explore the impact of ChatGPT users' technology acceptance (performance expectancy, effort expectancy, and social influence) on WOM. Research design, data, and methodology: A survey was conducted targeting ChatGPT users in their 20s or older in Korea and used for analysis. Testing of research hypotheses is performed using SPPS and AMOS. Results: First, ChatGPT users' technology acceptance (performance expectancy, effort expectancy, social influence) was found to have a positive effect on continuous use intention. Second, ChatGPT users' continuous use intention was found to have a positive effect on WOM. Third, ChatGPT users' continuous use intention ChatGPT was found to have a full or partial mediation effect on the relationship between technology acceptance and WOM. Conclusions: These results mean that ChatGPT's outstanding functional utility, convenience of use, and recommendations from people around them have a significant impact on the continuous use intention ChatGPT and WOM. As Generative AI becomes routine, disruptive innovation through Retailtech is expected to promote changes in distribution. This study confirmed the relationship between continuance use/WOM and technology acceptance. Distribution companies need to improve efficiency/convenience using Generative AI and implement various WOM marketing.

• Journal of dental hygiene science
• /
• v.24 no.1
• /
• pp.62-70
• /
• 2024

Background: This study aimed to evaluate ChatGPT's performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT's incorrect responses, this research intended to pinpoint the predominant types of errors. Methods: To evaluate ChatGPT-3.5's performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5's problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT's responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.20 no.3
• /
• pp.61-70
• /
• 2024

This study aimed to analyze the impact of perceived usefulness, ease of use, and satisfaction with ChatGPT on the intention to use it. Data were collected through an online survey, and the results showed differences in perceived usefulness, ease of use, and intention to use according to the demographic characteristics of the research subjects. Furthermore, a multiple regression analysis was conducted to examine the impact of ChatGPT's usability, ease of use, and satisfaction on the intention to use. The results indicated statistically significant differences in perceived usefulness, ease of use, and intention to use ChatGPT between students in different academic years. In addition, perceived usefulness, ease of use, and satisfaction with ChatGPT showed a significant positive influence on the intention to use it. This study is significant as it analyzes the intention to use ChatGPT, considering the role of generative AI in digital education and innovative teaching methods in the educational context.

• Imaging Science in Dentistry
• /
• v.54 no.3
• /
• pp.271-275
• /
• 2024

Purpose: Recent advancements in artificial intelligence (AI), particularly tools such as ChatGPT developed by OpenAI, a U.S.-based AI research organization, have transformed the healthcare and education sectors. This study investigated the effectiveness of ChatGPT in answering dentistry exam questions, demonstrating its potential to enhance professional practice and patient care. Materials and Methods: This study assessed the performance of ChatGPT 3.5 and 4 on U.S. dental exams - specifically, the Integrated National Board Dental Examination (INBDE), Dental Admission Test (DAT), and Advanced Dental Admission Test (ADAT) - excluding image-based questions. Using customized prompts, ChatGPT's answers were evaluated against official answer sheets. Results: ChatGPT 3.5 and 4 were tested with 253 questions from the INBDE, ADAT, and DAT exams. For the INBDE, both versions achieved 80% accuracy in knowledge-based questions and 66-69% in case history questions. In ADAT, they scored 66-83% in knowledge-based and 76% in case history questions. ChatGPT 4 excelled on the DAT, with 94% accuracy in knowledge-based questions, 57% in mathematical analysis items, and 100% in comprehension questions, surpassing ChatGPT 3.5's rates of 83%, 31%, and 82%, respectively. The difference was significant for knowledge-based questions(P=0.009). Both versions showed similar patterns in incorrect responses. Conclusion: Both ChatGPT 3.5 and 4 effectively handled knowledge-based, case history, and comprehension questions, with ChatGPT 4 being more reliable and surpassing the performance of 3.5. ChatGPT 4's perfect score in comprehension questions underscores its trainability in specific subjects. However, both versions exhibited weaker performance in mathematical analysis, suggesting this as an area for improvement.

• International Journal of Advanced Culture Technology
• /
• v.11 no.4
• /
• pp.56-61
• /
• 2023

The present study explored a comprehensive investigation of university professors' perspectives on the implementation of ChatGPT - an artificial intelligence-powered language model - in their teaching practices. A diverse group of 30 university professors responded to a questionnaire about the level of their interest in implementing the tool, willingness to apply it, and concerns they have regarding the intervention of ChatGPT in higher education setting. The results showed that the participants are highly interested in employing the tool into their teaching practice, and find that the students are likely to benefit from using ChatGPT in classroom settings. On the other hand, they displayed concerns regarding high depandency on data, privacy-related issues, lack of supports required, and technical contraints. In today's fast-paced society, educators are urged to mindfully apply this inevitable generative AI means with thoughtfulness and ethical considerations to and for their learners. Relevant topics are discussed to successfully intervene AI tools in teaching practices in higher education.

• Journal of Internet Computing and Services
• /
• v.25 no.1
• /
• pp.79-90
• /
• 2024

This study focused on user trust in ChatGPT, a generative AI technology, and explored the factors that affect usage status and intention to continue using, and whether the influence of trust varies depending on the purpose. For this purpose, the survey was conducted targeting people in their 20s and 30s who use ChatGPT the most. The statistical analysis deploying IBM SPSS 27 and SmartPLS 4.0. A structural equation model was formulated on the foundation of Bhattacherjee's Expectation-Confirmation Model (ECM), employing path analysis and Multi-Group Analysis (MGA) for hypothesis validation. The main findings are as follows: Firstly, ChatGPT is mainly used for specific needs or objectives rather than as a daily tool. The majority of users are cognizant of its hallucination effects; however, this did not hinder its use. Secondly, the hypothesis testing indicated that independent variables such as expectation- confirmation, perceived usefulness, and user satisfaction all exert a positive influence on the dependent variable, the intention for continuance intention. Thirdly, the influence of trust varied depending on the user's purpose in utilizing ChatGPT. trust was significant when ChatGPT is used for information retrieval but not for creative purposes. This study will be used to solve reliability problems in the process of introducing generative AI in society and companies in the future and to establish policies and derive improvement measures for successful employment.

• Journal of Practical Engineering Education
• /
• v.16 no.4
• /
• pp.471-479
• /
• 2024

This study aims to examine the cognitive and affective changes in university students' writing self-efficacy when engaging in reflective writing classes utilizing ChatGPT. Over ten sessions, reflective writing classes using ChatGPT were conducted for students enrolled in a mandatory writing course at S University in Gyeonggi Province. The reflective journals written by the students during these sessions were meticulously reviewed as qualitative data with statistical analysis of pre- and post-surveys on writing self-efficacy. The results confirmed that utilizing ChatGPT in reflective writing classes positively impacted students' writing self-efficacy. Participants showed increased interest and confidence in their writing abilities when using ChatGPT. It was reported that they received cognitive assistance in outlining and paragraph structuring from samples generated by ChatGPT. Although survey results showed an overall increase in writing self-efficacy, the only statistically significant change was in the 'plagiarism response' category, which means a clear awareness of plagiarism issues. The process of personalizing the ChatGPT-generated samples requires consistent practice, and systematic guidelines on using such helpful tool effectively should be reinforced as a future task.

• Journal of Engineering Education Research
• /
• v.27 no.3
• /
• pp.3-13
• /
• 2024

Since the launch of ChatGPT, many college students used it extensively in various ways in their curricular learning activities. This study investigates the utilization of ChatGPT in the curriculum of first and second-year engineering students, aiming to examine its influence from a learner perspective. We explored how ChatGPT is used in each subject and learning activity to understand how learners perceive the use of ChatGPT. From the survey data on engineering college students at E university, we examined students' perception on 'shortening time to perform tasks' through ChatGPT, 'dependence on ChatGPT', 'their contribution to individual capacity building', and 'their influence on academic grade'. The majority of students reported extensive use of ChatGPT for learning activities, particularly showing high dependency in liberal arts subjects and coding-related activities. While the use of ChatGPT in liberal arts was seen as not contributing to the enhancement of individual capacity, its use in coding was positively evaluated. Furthermore, the contribution of ChatGPT to the creativity in report writing tasks was highly rated. These findings offer several important implications for the use of AI tools like ChatGPT in engineering education. Firstly, the positive impact of ChatGPT's high usability and individual-capacity enhancement in coding should be expanded to other areas of learning. Secondly, as AI technology progresses, the contribution of AI tools compared to learners is expected to increase, suggesting that students should be encouraged to effectively use AI tools to achieve their learning objectives while maintaining a balanced approach to avoid overreliance on AI.

• Journal of Intelligence and Information Systems
• /
• v.29 no.4
• /
• pp.111-127
• /
• 2023

This study is a study on user perception of ChatGPT use. The goal of this study is to analyze the relationship between user policy expectations and user innovativeness on ChatGPT technology acceptance and intention to use using variables of TRA (Theory of Reasoned Action). The impact of policy expectations and user innovativeness on the intention to use by mediating usefulness and hedonic motivation, and the impact of subjective norms on the usefulness and intention to use were analyzed by dividing them into the MZ generation and the non-MZ generation. It was verified whether there was a moderating effect on the effect of age differences on usefulness by interacting with policy expectations. An online survey was conducted on 300 ChatGPT users using PLS (Partial Least Square) structural equations and SPSS Package, and statistical analysis was performed using PLS and SPSS. According to the analysis results, it was confirmed that the higher the initial user's innovativeness, the higher the intention to use ChatGPT. In addition, the moderating effect analysis comparing the differences between the MZ generation and the non-MZ generation showed that policy expectations had a negative effect on the usefulness of ChatGPT use.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.233-256
• /
• 2023

This study conducted foundational research to derive ways to use ChatGPT in mathematics education by analyzing ChatGPT's responses to questions from the National Assessment of Educational Achievement (NAEA) and the College Scholastic Ability Test (CSAT). ChatGPT, a generative artificial intelligence model, has gained attention in various fields, and there is a growing demand for its use in education as the number of users rapidly increases. To the best of our knowledge, there are very few reported cases of educational studies utilizing ChatGPT. In this study, we analyzed ChatGPT 3.5 responses to questions from the three-year National Assessment of Educational Achievement and the College Scholastic Ability Test, categorizing them based on the percentage of correct answers, the accuracy of the solution process, and types of errors. The correct answer rates for ChatGPT in the National Assessment of Educational Achievement and the College Scholastic Ability Test questions were 37.1% and 15.97%, respectively. The accuracy of ChatGPT's solution process was calculated as 3.44 for the National Assessment of Educational Achievement and 2.49 for the College Scholastic Ability Test. Errors in solving math problems with ChatGPT were classified into procedural and functional errors. Procedural errors referred to mistakes in connecting expressions to the next step or in calculations, while functional errors were related to how ChatGPT recognized, judged, and outputted text. This analysis suggests that relying solely on the percentage of correct answers should not be the criterion for assessing ChatGPT's mathematical performance, but rather a combination of the accuracy of the solution process and types of errors should be considered.