• Title/Summary/Keyword: GPT-4

Search Result 766, Processing Time 0.03 seconds

Exploring automatic scoring of mathematical descriptive assessment using prompt engineering with the GPT-4 model: Focused on permutations and combinations (프롬프트 엔지니어링을 통한 GPT-4 모델의 수학 서술형 평가 자동 채점 탐색: 순열과 조합을 중심으로)

  • Byoungchul Shin;Junsu Lee;Yunjoo Yoo
    • The Mathematical Education
    • /
    • v.63 no.2
    • /
    • pp.187-207
    • /
    • 2024
  • In this study, we explored the feasibility of automatically scoring descriptive assessment items using GPT-4 based ChatGPT by comparing and analyzing the scoring results between teachers and GPT-4 based ChatGPT. For this purpose, three descriptive items from the permutation and combination unit for first-year high school students were selected from the KICE (Korea Institute for Curriculum and Evaluation) website. Items 1 and 2 had only one problem-solving strategy, while Item 3 had more than two strategies. Two teachers, each with over eight years of educational experience, graded answers from 204 students and compared these with the results from GPT-4 based ChatGPT. Various techniques such as Few-Shot-CoT, SC, structured, and Iteratively prompts were utilized to construct prompts for scoring, which were then inputted into GPT-4 based ChatGPT for scoring. The scoring results for Items 1 and 2 showed a strong correlation between the teachers' and GPT-4's scoring. For Item 3, which involved multiple problem-solving strategies, the student answers were first classified according to their strategies using prompts inputted into GPT-4 based ChatGPT. Following this classification, scoring prompts tailored to each type were applied and inputted into GPT-4 based ChatGPT for scoring, and these results also showed a strong correlation with the teachers' scoring. Through this, the potential for GPT-4 models utilizing prompt engineering to assist in teachers' scoring was confirmed, and the limitations of this study and directions for future research were presented.

Evaluation of the applicability of ChatGPT in biological nursing science education (ChatGPT의 기초간호학교육 활용 가능성 평가)

  • Sunmi Kim;Jihun Kim;Myung Jin Choi;Seok Hee Jeong
    • Journal of Korean Biological Nursing Science
    • /
    • v.25 no.3
    • /
    • pp.183-204
    • /
    • 2023
  • Purpose: The purpose of this study was to evaluate the applicability of ChatGPT in biological nursing science education. Methods: This study was conducted by entering questions about the field of biological nursing science into ChatGPT versions GPT-3.5 and GPT-4 and evaluating the answers. Three questions each related to microbiology and pharmacology were entered, and the generated content was analyzed to determine its applicability to the field of biological nursing science. The questions were of a level that could be presented to nursing students as written test questions. Results: The answers generated in English had 100.0% accuracy in both GPT-3.5 and GPT-4. For the sentences generated in Korean, the accuracy rate of GPT-3.5 was 62.7%, and that of GPT-4 was 100.0%. The total number of Korean sentences in GPT-3.5 was 51, while the total number of Korean sentences in GPT-4 was 68. Likewise, the total number of English sentences in GPT-3.5 was 70, while the total number of English sentences in GPT-4 was 75. This showed that even for the same Korean or English question, GPT-4 tended to be more detailed than GPT-3.5. Conclusion: This study confirmed the advantages of ChatGPT as a tool to improve understanding of various complex concepts in the field of biological nursing science. However, as the answers were based on data collected up to 2021, a guideline reflecting the most up-to-date information is needed. Further research is needed to develop a reliable and valid scale to evaluate ChatGPT's responses.

Study on the Activity of GOT and GPT in the Hepatotoxic Rat Treated (구기자 투여 간손상 흰쥐에서 GOT 및 GPT의 활성화 연구)

  • 김병원;노광수
    • Biomedical Science Letters
    • /
    • v.6 no.3
    • /
    • pp.187-192
    • /
    • 2000
  • The present study was undertaken in order to investigate betaine production by tissue culture and its medicinal effect in Lycium chinone Mill. In order to ulvestigate the protective effect of L. chinense on the hepatoxicity induced by $CCl_4$, 0.5 g/kg water extract of the compound mixture (leaves, roots and shoots) of L. chinense and its callus were fed to rat (SD line) once a day. As a result, the activity of GOT and GPT in the group fed compound mixture (GOT 760.4 and GPT 540 Karmen unit) and callus (G0T 772.1 and GPT 556.4 Karmen unit) was decreased in the blood serume relative to the controlled rat group (GOT 949 and GPT 640 Karmen unit) and the same result was obtained in the group fed with 0.1 g/kg sylimarin (the activity of GOT and GPT was shown 492.6 and 320.4 Karmen unit respectively. These results strongly indicate that water extracts of the mixture and callus from L. chinense do have the same decreasing effect of GOT and GPT in the hepatotoxic rat induced by $CCl_4$.

  • PDF

Evaluation Coding Performance of GPT-3.5 and GPT-4 in Terms of Completeness and Consistency (완전성과 일관성 측면에서의 GPT-3.5 와 GPT-4 의 코딩 성능 평가)

  • Jimin Jung;Chanho Lee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.05a
    • /
    • pp.754-755
    • /
    • 2023
  • 본 연구는 GPT-3.5 와 GPT-4 를 대상으로 완전성과 일관성 측면에서 코딩 협업 환경에 어떤 버전이 더 적합한지 평가하는 것을 목표로 한다. 두 버전을 대상으로 실험한 결과, GPT-4 가 GPT-3.5보다 완전성과 일관성 측면에서 더 높은 성능을 보였다. 특히 GPT-4 는 모든 항목들에서 100%의 완전성을 보였으나, 일관성은 여전히 개선이 필요함을 확인하였다. 프롬프트 수정만으로는 한계가 있으며, GPT-4 자체의 업그레이드가 필요하다는 의미이며, 향후 연구를 통해 타 생성형 AI 의 성능들도 평가할 예정이다.

A Study on A Study on the University Education Plan Using ChatGPTfor University Students (ChatGPT를 활용한 대학 교육 방안 연구)

  • Hyun-ju Kim;Jinyoung Lee
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.1
    • /
    • pp.71-79
    • /
    • 2024
  • ChatGPT, an interactive artificial intelligence (AI) chatbot developed by Open AI in the U.S., gaining popularity with great repercussions around the world. Some academia are concerned that ChatGPT can be used by students for plagiarism, but ChatGPT is also widely used in a positive direction, such as being used to write marketing phrases or website phrases. There is also an opinion that ChatGPT could be a new future for "search," and some analysts say that the focus should be on fostering rather than excessive regulation. This study analyzed consciousness about ChatGPT for college students through a survey of their perception of ChatGPT. And, plagiarism inspection systems were prepared to establish an education support model using ChatGPT and ChatGPT. Based on this, a university education support model using ChatGPT was constructed. The education model using ChatGPT established an education model based on text, digital, and art, and then composed of detailed strategies necessary for the era of the 4th industrial revolution below it. In addition, it was configured to guide students to use ChatGPT within the permitted range by using the ChatGPT detection function provided by the plagiarism inspection system, after the instructor of the class determined the allowable range of content generated by ChatGPT according to the learning goal. By linking and utilizing ChatGPT and the plagiarism inspection system in this way, it is expected to prevent situations in which ChatGPT's excellent ability is abused in education.

Game System for Autonomous Level Design Based on ChatGPT (ChatGPT 기반의 자율형 레벨 디자인을 위한 게임 시스템)

  • Do-Hoon Jung;Jun-Gyeong Lee;Sung-Jun Park
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.24 no.4
    • /
    • pp.113-119
    • /
    • 2024
  • In this paper, a model was devised to change the numerical values that affect the game balance by using Chat-GPT for game balancing. Based on the usability of Chat-GPT shown in several studies and cases using Chat-GPT, Chat-GPT is automated to directly adjust detailed and objective in-game numerical values. In this paper, the format of Chat-GPT responses was consistently adjusted so that the numerical values required for game balancing could be obtained directly from the answers. As an experimental method, it was confirmed that four players autonomously designed the game level through five rounds to adjust the balance. These studies suggest the possibility that games can be produced using Chat-GPT in the future.

A Study on the Service Integration of Traditional Chatbot and ChatGPT (전통적인 챗봇과 ChatGPT 연계 서비스 방안 연구)

  • Cheonsu Jeong
    • Journal of Information Technology Applications and Management
    • /
    • v.30 no.4
    • /
    • pp.11-28
    • /
    • 2023
  • This paper proposes a method of integrating ChatGPT with traditional chatbot systems to enhance conversational artificial intelligence(AI) and create more efficient conversational systems. Traditional chatbot systems are primarily based on classification models and are limited to intent classification and simple response generation. In contrast, ChatGPT is a state-of-the-art AI technology for natural language generation, which can generate more natural and fluent conversations. In this paper, we analyze the business service areas that can be integrated with ChatGPT and traditional chatbots, and present methods for conducting conversational scenarios through case studies of service types. Additionally, we suggest ways to integrate ChatGPT with traditional chatbot systems for intent recognition, conversation flow control, and response generation. We provide a practical implementation example of how to integrate ChatGPT with traditional chatbots, making it easier to understand and build integration methods and actively utilize ChatGPT with existing chatbots.

Evaluating ChatGPT's Competency in BIM Related Knowledge via the Korean BIM Expertise Exam (BIM 운용 전문가 시험을 통한 ChatGPT의 BIM 분야 전문 지식 수준 평가)

  • Choi, Jiwon;Koo, Bonsang;Yu, Youngsu;Jeong, Yujeong;Ham, Namhyuk
    • Journal of KIBIM
    • /
    • v.13 no.3
    • /
    • pp.21-29
    • /
    • 2023
  • ChatGPT, a chatbot based on GPT large language models, has gained immense popularity among the general public as well as domain professionals. To assess its proficiency in specialized fields, ChatGPT was tested on mainstream exams like the bar exam and medical licensing tests. This study evaluated ChatGPT's ability to answer questions related to Building Information Modeling (BIM) by testing it on Korea's BIM expertise exam, focusing primarily on multiple-choice problems. Both GPT-3.5 and GPT-4 were tested by prompting them to provide the correct answers to three years' worth of exams, totaling 150 questions. The results showed that both versions passed the test with average scores of 68 and 85, respectively. GPT-4 performed particularly well in categories related to 'BIM software' and 'Smart Construction technology'. However, it did not fare well in 'BIM applications'. Both versions were more proficient with short-answer choices than with sentence-length answers. Additionally, GPT-4 struggled with questions related to BIM policies and regulations specific to the Korean industry. Such limitations might be addressed by using tools like LangChain, which allow for feeding domain-specific documents to customize ChatGPT's responses. These advancements are anticipated to enhance ChatGPT's utility as a virtual assistant for BIM education and modeling automation.

Effect of Nonylphenol on Plasma Glutamate Oxaloacetate Transaminase (GOT) and Glutamate Pyruvate Transaminase (GPT) in the Juvenile Rockfish, Sebastes schlegeli

  • Hwang Un-Gi;Kang Ju-Chan
    • Fisheries and Aquatic Sciences
    • /
    • v.5 no.4
    • /
    • pp.308-310
    • /
    • 2002
  • Effect of 4-nonylphenol (4-NP), endocrine disrupting compounds (EDCs), on glutamate oxaloacetate transaminase (GOT) and glutamate pyruvate transaminase (GPT) were investigated in the plasma of juvenile rockfish, Sebastes schlegeli. Fish were injected with 4­NP (10, 50, 100 and 200 mg/kg body weight) in $70\%$ ethanol twice at 3-day intervals and plasma sampling were extracted at 7 days after the last injection. Controls received solvent only. 4-NP significant increased GOT in a dose-dependent manner. GPT was markedly elevated to $61\%$ (P<0.05) and $82\%$ (P<0.01) than that of the control at the 4-NP doses of 100 and 200mg, respectively. These results suggest that the estrogenic activity of 4-NP increase plasma GOT and GPT by toxic effect on hepatocyte.

User Factors and Trust in ChatGPT: Investigating the Relationship between Demographic Variables, Experience with AI Systems, and Trust in ChatGPT (사용자 특성과 ChatGPT 신뢰의 관계 : 인구통계학적 변수와 AI 경험의 영향)

  • Park Yeeun;Jang Jeonghoon
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.19 no.4
    • /
    • pp.53-71
    • /
    • 2023
  • This study explores the relationship between various user factors and the level of trust in ChatGPT, a sophisticated language model exhibiting human-like capabilities. Specifically, we considered demographic characteristics such as age, education, gender, and major, along with factors related to previous AI experience, including duration, frequency, proficiency, perception, and familiarity. Through a survey of 140 participants, comprising 71 females and 69 males, we collected and analyzed the data to see how these user factors have a relationship with trust in ChatGPT. Both descriptive and inferential statistical methods, encompassing multiple linear regression models, were employed in our analysis. Our findings reveal significant relationships between user factors such as gender, the perception of prior AI interactions, self-evaluated proficiency, and Trust in ChatGPT. This research not only enhances our understanding of trust in artificial intelligence but also offers valuable insights for AI developers and practitioners in the field.