• Journal of KIBIM
• /
• v.13 no.3
• /
• pp.21-29
• /
• 2023

ChatGPT, a chatbot based on GPT large language models, has gained immense popularity among the general public as well as domain professionals. To assess its proficiency in specialized fields, ChatGPT was tested on mainstream exams like the bar exam and medical licensing tests. This study evaluated ChatGPT's ability to answer questions related to Building Information Modeling (BIM) by testing it on Korea's BIM expertise exam, focusing primarily on multiple-choice problems. Both GPT-3.5 and GPT-4 were tested by prompting them to provide the correct answers to three years' worth of exams, totaling 150 questions. The results showed that both versions passed the test with average scores of 68 and 85, respectively. GPT-4 performed particularly well in categories related to 'BIM software' and 'Smart Construction technology'. However, it did not fare well in 'BIM applications'. Both versions were more proficient with short-answer choices than with sentence-length answers. Additionally, GPT-4 struggled with questions related to BIM policies and regulations specific to the Korean industry. Such limitations might be addressed by using tools like LangChain, which allow for feeding domain-specific documents to customize ChatGPT's responses. These advancements are anticipated to enhance ChatGPT's utility as a virtual assistant for BIM education and modeling automation.

• The Journal of the Convergence on Culture Technology
• /
• v.10 no.3
• /
• pp.933-942
• /
• 2024

With the development of AI, Chat GPT, an artificial intelligence chatbot that appeared in 2022, is rapidly spreading to a wide range of people and expanding its usefulness. This study was conducted to examine college students' intention to continue using Chat GPT using a technology acceptance model. As a result of the study, all of Chat GPT's features had a positive effect on college students' perceived usefulness and perceived ease of use. However, among the features of Chat GPT, system quality and relative advantages did not directly affect the intention to continue using it. However, it was confirmed that it had an effect when perceived usefulness and perceived ease of use were mediated. The perceived usefulness and perceived ease of Chat GPT were verified to have a positive effect on the intention to continue using it.

• Journal of Distribution Science
• /
• v.21 no.8
• /
• pp.83-96
• /
• 2023

Purpose: This study examined the relationship between the factors (Credibility, Usability) and user Innovativeness of the ChatGPT on TRA (Theory of Reasoned Action; Subjective Norm, Attitude) and Switching Intention. TRA and Innovation Diffusion Theory (IDT) were used. Research design, data and methodology: From April 26 to 27, 2023, an online panel survey agency was commissioned to conduct a survey of GhatGPT users in their 20s and 40s in Korea, and a total of 210 people were used for the final analysis. Verification of the research model was performed using SPSS and AMOS. Results: First, ChatGPT factors (Credibility, Usability) were found to have positive effects on TRA (Subjective Norm, Attitude). Second, ChatGPT user Innovativeness was found to have a positive effect on TRA (Subjective Norm, Attitude). Third, ChatGPT users' TRA (Subjective Norm, Attitude) were found to have positive effects on Switching Intention. Conclusions: These results mean that the superior Usability and Credibility of ChatGPT and the Innovativeness of users have a significant effect on the Switching Intention from existing Portal Service (Naver, Google, Daum, etc.) to ChatGPT. Generative AI such as ChatGPT should strive to develop various services such as improving the convenience of functions so that innovative users can use them easily and conveniently in order to provide services that meet expectations.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.139-163
• /
• 2024

The purpose of this study is to examine the capabilities of ChatGPT as a tool for supporting students in generating mathematical arguments that can be considered proofs. To examine this, we engaged students enrolled in a mathematics pathways course in evaluating and revising their original arguments using ChatGPT feedback. Students attempted to find and prove a method for the area of a triangle given its side lengths. Instead of directly asking students to prove a formula, we asked them to explore a method to find the area of a triangle given the lengths of its sides and justify why their methods work. Students completed these ChatGPT-embedded proving activities as class homework. To investigate the capabilities of ChatGPT as a proof tutor, we used these student homework responses as data for this study. We analyzed and compared original and revised arguments students constructed with and without ChatGPT assistance. We also analyzed student-written responses about their perspectives on mathematical proof and proving and their thoughts on using ChatGPT as a proof assistant. Our analysis shows that our participants' approaches to constructing, evaluating, and revising their arguments aligned with their perspectives on proof and proving. They saw ChatGPT's evaluations of their arguments as similar to how they usually evaluate arguments of themselves and others. Mostly, they agreed with ChatGPT's suggestions to make their original arguments more proof-like. They, therefore, revised their original arguments following ChatGPT's suggestions, focusing on improving clarity, providing additional justifications, and showing the generality of their arguments. Further investigation is needed to explore how ChatGPT can be effectively used as a tool in teaching and learning mathematical proof and proof-writing.

• Journal of Service Research and Studies
• /
• v.13 no.3
• /
• pp.172-189
• /
• 2023

This study investigated the potential contribution of ChatGPT, a massive language and information model, in the decision-making process of public design policies, focusing on the characteristics inherent to public design. Public design utilizes the principles and approaches of design to address societal issues and aims to improve public services. In order to formulate public design policies and plans, it is essential to base them on extensive data, including the general status of the area, population demographics, infrastructure, resources, safety, existing policies, legal regulations, landscape, spatial conditions, current state of public design, and regional issues. Therefore, public design is a field of design research that encompasses a vast amount of data and language. Considering the rapid advancements in artificial intelligence technology and the significance of public design, this study aims to explore how massive language and information models like ChatGPT can contribute to public design policies. Alongside, we reviewed the concepts and principles of public design, its role in policy development and implementation, and examined the overview and features of ChatGPT, including its application cases and preceding research to determine its utility in the decision-making process of public design policies. The study found that ChatGPT could offer substantial language information during the formulation of public design policies and assist in decision-making. In particular, ChatGPT proved useful in providing various perspectives and swiftly supplying information necessary for policy decisions. Additionally, the trend of utilizing artificial intelligence in government policy development was confirmed through various studies. However, the usage of ChatGPT also unveiled ethical, legal, and personal privacy issues. Notably, ethical dilemmas were raised, along with issues related to bias and fairness. To practically apply ChatGPT in the decision-making process of public design policies, first, it is necessary to enhance the capacities of policy developers and public design experts to a certain extent. Second, it is advisable to create a provisional regulation named 'Ordinance on the Use of AI in Policy' to continuously refine the utilization until legal adjustments are made. Currently, implementing these two strategies is deemed necessary. Consequently, employing massive language and information models like ChatGPT in the public design field, which harbors a vast amount of language, holds substantial value.

• Journal of Internet Computing and Services
• /
• v.25 no.2
• /
• pp.79-92
• /
• 2024

ChatGPT, as a representative chatbot leveraging generative artificial intelligence technology, is used valuable not only in scientific and technological domains but also across diverse sectors such as society, economy, industry, and culture. This study conducts an explorative analysis of user sentiments and needs for ChatGPT by examining global social media discourse on Reddit. We collected 10,796 comments on Reddit from December 2022 to August 2023 and then employed keyword analysis, sentiment analysis, and need-mining-based topic modeling to derive insights. The analysis reveals several key findings. The most frequently mentioned term in ChatGPT-related comments is "time," indicative of users' emphasis on prompt responses, time efficiency, and enhanced productivity. Users express sentiments of trust and anticipation in ChatGPT, yet simultaneously articulate concerns and frustrations regarding its societal impact, including fears and anger. In addition, the topic modeling analysis identifies 14 topics, shedding light on potential user needs. Notably, users exhibit a keen interest in the educational applications of ChatGPT and its societal implications. Moreover, our investigation uncovers various user-driven topics related to ChatGPT, encompassing language models, jobs, information retrieval, healthcare applications, services, gaming, regulations, energy, and ethical concerns. In conclusion, this analysis provides insights into user perspectives, emphasizing the significance of understanding and addressing user needs. The identified application directions offer valuable guidance for enhancing existing products and services or planning the development of new service platforms.

• Environmental Analysis Health and Toxicology
• /
• v.17 no.3
• /
• pp.239-243
• /
• 2002

Changes of plasma vitellogenin (VTG) and glutamate pyruvate transaminase (GPT) were examined for determining whether hepatocyte was damaged during the process of VTG induction in the juvenile rockfish, Sebastes schlegeli exposed to exogenous estrogen (estradiol-l7$\beta$, E$_2$). Rockfishes were intraperitoneally injected with E$_2$(5 mg/kg B.W.) in 70% ethanol and plasma sampling were extracted at 0, 1, 3, 6, 9, 12, 15 days af-ter E$_2$administration. VTG and GPT were then analyzed by SDS -PAGE and Reitman -Frankel method, respectively. VTG band was detected at a molecular weight position of 175 kDa on Day 3 after E$_2$administration. This band became more distinct at 6 days, but its was gradually thinned with time -course, and not detected at 15 days. GPT was suddenly increased at 1 days after 22 administration and highest GPT was detected at 3 days. However. GPT was gradually decreased with time -course as the change of VTG. These results suggest that the process of VTG induction by exogenous E$_2$damage to hepatocyte, and plasma GPT was temporarily increased in the juvenile rockfish.

• The Journal of Information Systems
• /
• v.33 no.1
• /
• pp.91-114
• /
• 2024

Purpose The purpose of this study is to empirically investigate the factors that influence users' continuous intention to use ChatGPT based on the Expectation Confirmation Model(ECM). Drawing from the literature, this study identifies anthropomorphism and trust as key characteristics of generative AI and ChatGPT. Design/methodology/approach The research model was developed based on ECM and literature research to investigate the impacts of anthropomorphism and trust on continuous intention of using ChatGPT. In order to test the hypothese, a total of 193 questionnaires were collected and analyzed for the structural equation modeling with SmartPLS 4.0. Findings The study's findings show that all proposed hypotheses were supported, suggesting that the ECM is a valid framework for examining continuous intention of using ChatGPT. Moreover, the study stressed the crucial role of anthropomorphism in the model, showing the positive impact on expectation confirmation, perceived usefulness, and trust in ChatGPT. Also, trust positively affects perceived usefulness. These findings provide valuable insights for enhancing user satisfaction and continuous usage intention, serving as a foundation for development strategies for ChatGPT and similar AI-based systems.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.233-256
• /
• 2023

This study conducted foundational research to derive ways to use ChatGPT in mathematics education by analyzing ChatGPT's responses to questions from the National Assessment of Educational Achievement (NAEA) and the College Scholastic Ability Test (CSAT). ChatGPT, a generative artificial intelligence model, has gained attention in various fields, and there is a growing demand for its use in education as the number of users rapidly increases. To the best of our knowledge, there are very few reported cases of educational studies utilizing ChatGPT. In this study, we analyzed ChatGPT 3.5 responses to questions from the three-year National Assessment of Educational Achievement and the College Scholastic Ability Test, categorizing them based on the percentage of correct answers, the accuracy of the solution process, and types of errors. The correct answer rates for ChatGPT in the National Assessment of Educational Achievement and the College Scholastic Ability Test questions were 37.1% and 15.97%, respectively. The accuracy of ChatGPT's solution process was calculated as 3.44 for the National Assessment of Educational Achievement and 2.49 for the College Scholastic Ability Test. Errors in solving math problems with ChatGPT were classified into procedural and functional errors. Procedural errors referred to mistakes in connecting expressions to the next step or in calculations, while functional errors were related to how ChatGPT recognized, judged, and outputted text. This analysis suggests that relying solely on the percentage of correct answers should not be the criterion for assessing ChatGPT's mathematical performance, but rather a combination of the accuracy of the solution process and types of errors should be considered.

• Therapeutic Science for Rehabilitation
• /
• v.13 no.1
• /
• pp.65-74
• /
• 2024

Objective : This study assessed ChatGPT, an artificial intelligence system based on a large language model, for its ability to pass the National Korean Occupational Therapy Licensure Examination (NKOTLE). Methods : Using NKOTLE questions from 2018 to 2022, provided by the Korea Health and Medical Personnel Examination Institute, this study employed English prompts to determine the accuracy of ChatGPT in providing correct answers. Two researchers independently conducted the entire process, and the average accuracy of both researchers was used to determine whether ChatGPT passed over the 5-year period. The degree of agreement between ChatGPT answers of the two researchers was assessed. Results : ChatGPT passed the 2020 examination but failed to pass the other 4 years' examination. Specifically, its accuracy in questions related to medical regulations ranged from 25% to 57%, whereas its accuracy in other questions exceeded 60%. ChatGPT exhibited a strong agreement between researchers, except for medical regulation questions, and this agreement was significantly correlated with accuracy. Conclusion : There are still limitations to the application of ChatGPT to answer questions influenced by language or culture. Future studies should explore its potential as an educational tool for students majoring in occupational therapy through optimized prompts and continuous learning from the data.