Communications of Mathematical Education (한국수학교육학회지시리즈E:수학교육논문집)

Korean Society of Mathematical Education (한국수학교육학회)
권호 표지
DOI QR코드

DOI QR Code

Effective ChatGPT Prompts in Mathematical Problem Solving : Focusing on Quadratic Equations and Quadratic Functions

수학 문제 해결에서 효과적인 ChatGPT의 프롬프트 고찰: 이차방정식과 이차함수를 중심으로

  • 오세준 (이화여자대학교 사범대학부속 이화.금란고등학교)
  • Received : 2023.08.28
  • Accepted : 2023.09.22
  • Published : 2023.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study investigates effective ChatGPT prompts for solving mathematical problems, focusing on the chapters of quadratic equations and quadratic functions. A structured prompt was designed, following a sequence of 'Role-Rule-Example Solution-Problem-Process'. In this study, an artificial intelligence model combining GPT-4, Wolfram plugin, and Advanced Data Analysis was utilized. Wolfram was used as the primary tool for calculations to reduce computational errors. When using the structured prompt, the accuracy rate for problems from nine high school mathematics textbooks on quadratic equations and quadratic functions was 91%, showing higher performance compared to zero-shot prompts. This confirmed the effectiveness of the structured prompts in solving mathematical problems. The structured prompts designed in this study can contribute to the development of intelligent information systems for personalized and customized education.

본 연구는 이차방정식과 이차함수 단원을 중심으로 수학 문제 해결에 효과적인 ChatGPT의 프롬프트를 고찰하는 연구로 '역할-규칙-예제풀이-문제-과정'으로 이어지는 구조화된 프롬프트를 설계하였다. 본 연구에서는 GPT4, 울프람 플러그인, Advanced Data Analysis를 결합한 인공지능 모델을 활용하였으며, 계산 오류를 줄이기 위해 울프람 플러그인을 주요 연산의 도구로 사용하였다. 9종의 고등학교 수학 교과서의 이차방정식과 이차함수 단원 문제를 구조화된 프롬프트의 형태로 입력하였을 때 ChatGPT의 답변에 대한 정답률은 91%로, 제로샷 프롬프트 대비 높은 성과를 보였다. 이를 통해 수학 문제 해결에 효과적인 구조화된 프롬프트를 확인할 수 있었다. 본 연구에서 설계한 구조화된 프롬프트는 개별화 교육 및 맞춤형 교육을 위한 지능형 정보시스템 구축에 기여할 수 있을 것이다.

Keywords

References

  1. Kang, D. (2023). The advent of ChatGPT and the response of Korean language education. Korean Language and Literature, 82, 469-496. 
  2. Kwon O., Oh S., Yoon J., Lee K., Shin B., & Jung W. (2023). Analyzing mathematical performances of ChatGPT: Focusing on the solution of national assessment of educational achievement and the college scholastic ability test. Communication of Mathematical Education, 37(2), 233-256. 
  3. Kwon, O., Shin, J., Jun, I., Kim, M., Kim, C., Kim, T., ..., & Hwang, S. (2019). High school mathematics. Kyohaksa. 
  4. Kim, W., Cho, M., Bang, G., Yoon, J., Shin, J., Im, S., ..., & Jung, J. (2018). High school mathematics. Visang. 
  5. Ko, S., Lee, J., Lee, S., Cha, S., Kim, Y., Oh, T., & Cho, S. (2018). High school mathematics. Seoul: Sinsago. 
  6. Ministry of Education (2015). The 2nd comprehensive plan for mathematical education. Retrieved from https://www.moe.go.kr/boardCnts/viewRenew.do?boardID=294&lev=0&statusYN=C&s=moe&m=020402&opType=N&boardSeq=58701 
  7. Ministry of Education. (2020a). The 3rd comprehensive plans for mathematics education. Retrieved from https://www.moe.go.kr/boardCnts/viewRenew.do?boardID=294&lev=0&statusYN=W&s=moe&m=020402&opType=N&boardSeq=80718 
  8. Ministry of Education. (2020b). Mathematics curriculum. Proclamation of the Ministry of Education #2020-236[Annex 8]. Ministry of Education. 
  9. Ministry of Education. (2022). Mathematics curriculum. Proclamation of the Ministry of Education #2022-33[Annex 8]. Ministry of Education. 
  10. Kim N. (2002). A study on the GSP in the viewpoint of problem solving. School Mathematics, 4(1), 111-125. 
  11. Kim N. (2006). Using the Cabri3D program for enhancing problem solving ability. Journal of Educational Research in Mathematics, 16(4), 345-366. 
  12. Kim, S. K. (2018). Analysis of high school students' learning characteristic appeared in the 2016 National Assessment of Educational Achievement. The Journal of Curriculum Evaluation, 21(4), 151-176.  https://doi.org/10.29221/jce.2018.21.4.151
  13. Kim H., Park C. Jeong S., & Ko H. K. (2018). A view on complementary relation of human teacher and AI teacher in future education. Journal of Education & Culture, 24(6), 189-207. 
  14. Ryu, H., Sunwoo, H., Shin, B., Cho, J., Lee, B., Kim, Y., ..., & Jung, S. (2018). High school mathematics. Chunjae. 
  15. Mun, H. Y., & Kim, Y. (2011). An analysis of errors in problem solving of the function unit in the first grade highschool. Journal of the Korean School Mathematics Society, 14(3), 281-297. 
  16. Park, K., Lee, J., Kim, J., Nam, J., Kim, N., Im, J., ..., & Yang, J. (2018). High school mathematics. Donga. 
  17. 박장희, 유식규, & 이중권 (2012). The analysis of mathematics error type that appears from the process of solving problem related to real life. Journal of the Korean School Mathematics Society, 15(4), 699-718. 
  18. Park J. M, & Lee J. K. (2013). An analysis of students' problem solving ability on the equivalent mathematics situations-Focused on equations, inequalities, and functions-. Journal of the Korean School Mathematics Society, 16(4), 883-898. 
  19. Bae, J., Yeo, T., Cho, B., Kim, M., Chun, H., Cho, S., & Byun, D. (2018). High school mathematics. Geumsung. 
  20. Byun, J., & Kwon, Y. (2023). An investigation of generative AI in educational application: Focusing on the usage of ChatGPT for learning biology. Brain, Digital, & Learning, 13(1), 1-17. 
  21. Boo D. (2021). Improvement of the mathematical creativity using engineering tools in mathematics mentorship program. Communication of Mathematical Education, 35(1), 119-136.
  22. Son, T. (2023). Exploring the possibility of using ChatGPT in mathematics education: Focusing on student product and pre-service teachers' discourse related to fraction problems. Education of Primary School Mathematics, 26(2), 99-113. 
  23. Shin, D. K., Jung, H. K., & Lee, Y. S. (2023). Exploring the potential of using ChatGPT as a content-based English learning and teaching tool. Journal of the Korea English Education Society, 22(1), 171-192. 
  24. Shin, D. (2020). Artificial intelligence in primary and secondary education: A systematic review. Journal of Educational Research in Mathematics, 30(3), 531-552. 
  25. Oh, K. (2023). The impact of generative artificial intelligence on Korean education and response strategies - ChatGPT: A tool or threat for Korean education?. The Journal of Korean Language and Literature Education, 82, 143-189. 
  26. Oh, S. (2023). A study on the case of using ChatGPT & learners' perceptions in college liberal arts writing. Korean Journal of General Education, 17(3), 11-23. 
  27. Wang, G. (2023). Natural language analysis of Korean texts of AI-based chatbots and exploration of Korean education utilization -Focusing on ChatGPT and New-Bing. Culture & Convergence, 45(5), 01-17. 
  28. Yu, I., & Park, H. (2023). Developing an AI-based sentence-generating web service for writing activities in elementary language education. Journal of Research in Curriculum & Instruction, 27(2), 210-221. 
  29. Yu, J. (2023). Application of artificial intelligence for geography education - Focusing on question answering on ChatGPT -. Jorunal of Photo Geography, 33(1), 162-173. 
  30. Lee, J., Lee, J. H., & Kim, B. (2003). Middle school students' mathematical problem solving process through analogy: Focusing on clarity of thought. Communication of Mathematical Education, 16(0), 245-267. 
  31. Lee, J., Choi, B., Kim, D., Lee, J., Jeon, C., Chang, H., ..., & Kim, M. (2018). High school mathematics. Chunjae. 
  32. Huh N., & Ee J. H. (2018). A study on the relationship between artificial intelligence and change in mathematics education. Communication of Mathematical Education, 32(1), 23-36.
  33. Jeon, S. K., & Cho, C. (2015). A study on the written texts of a high school mathematics textbook and teacher's classroom discourse - A focus on 'The relationship between quadratic functions and quadratic equations' -. Journal of Educational Research in Mathematics, 25(4), 525-547. 
  34. Cha, M., & Im, H. (2023). A Study on university professors' perception on educational applicability of ChatGPT in English classes. Culture & Convergence, 45(5), 109-118. 10.33645/cnc.2023.05.45.05.109 
  35. Han. B. K. (2023, June, 2). US companies laid off 4,000 people due to AI in May... "AI appears for the first time in reasons for dismissal. KBS. Retrieved from https://news.kbs.co.kr/news/pc/view/view.do?ncd=7690005. 
  36. Han, S. H. & Chang, K. Y. (2009). Instrumental genesis of Computer Algebra System(CAS) in mathematical problem solving among high school students. School Mathematics, 11(3), 527-546. 
  37. Hong, S., Lee, J., Shin, T., Lee, C., Lee, B., Shin, Y., ..., & Kang, I. (2018). High school mathematics. Jihaksa. 
  38. Hwang, S., Kang, B., Yoon, G., Lee, K., Kim, S., Lee, M., ..., & Park, S. (2018). High school mathematics. Miraen.
  39. Beghetto, R. A. (2023). A new horizon for possibility thinking: A conceptual case study of Human × AI collaboration. Possibility Studies & Society, 1(3), 324-341.
  40. Bull, C., & Kharrufa, A. (2023). Generative AI assistants in software development education. arXiv preprint arXiv:2303.13936.
  41. Daun, M., & Brings, J. (2023, June). How ChatGPT will change software engineering education. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education, 1, 110-116,
  42. Drijvers, P. (2003). Algebra on screen, on paper, and in the mind. In J. Fey, A. Cuoco, C. Kieran, L. McMullin & R.M. Zbiek (Eds.), Computer Algebra Systems in secondary school mathematics education (pp. 241-267). NCTM.
  43. Giray, L. (2023). Prompt engineering with ChatGPT: A guide for academic writers. In Annals of Biomedical Engineering (pp.1-5).
  44. Heston, T. F., & Khun, C. (2023). Prompt engineering in medical education. International Medical Education, 2(3), 198-205.
  45. Lester, K. (1980). Research on problem solving. In R. J. Shumway (Ed.), Research in mathematics education. National Council of Teachers of Mathematics.
  46. Liu, V., & Chilton, L. B. (2022, April). Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (pp. 1-23).
  47. National Council of Teachers of Mathematics (2000). Principles and Standards for School Mathematics. NCTM.
  48. OpenAI (2023a). GPT4 technical report. arXiv:2303.08774 [cs.CL]
  49. OpenAI (2023b). Six strategies for getting better results. https://platform.openai.com/docs/guides/gpt-best-practices
  50. Patel, N., Nagpal, P., Shah, T., Sharma, A., Malvi, S., & Lomas, D. (2023). Improving mathematics assessment readability: Do large language models help?. Journal of Computer Assisted Learning, 39(3), 804-822.
  51. Polya, G. (1973). How to solve it: a new aspect of mathematical method. Princeton University Press.
  52. Raposo, G., Ribeiro, R., Martins, B., & Coheur, L. (2022, April). Question rewriting? Assessing its importance for conversational question answering. In European Conference on Information Retrieval (pp. 199-206). Springer International Publishing.
  53. Sallam, M. (2023, March). ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. In Healthcare, 11(6), 887.
  54. Shieh, J. (2023). Best practices for prompt engineering with OpenAI API. OpenAI, February https://help.openai.com/en/articles/6654000-best-practices-for-prompt-engineering-with-openai-api.
  55. Tall, D. (2003). Using technology to support an embodied approach to learning concepts in mathematics. Historia e tecnologia no Ensino da Matematica, 1, 1-28
  56. Trouche, L. (2004). Managing the complexity of human/machine interactions in computerized learning environments: Guiding students' command process through instrumental orchestrations. International Journal of Computers for mathematical learning, 9, 281-307. https://doi.org/10.1007/s10758-004-3468-5
  57. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
  58. Wei, J., Bosma, M., Zhao, V. Y., Guu, K., Yu, A. W., Lester, B., ... & Le, Q. V. (2021). Finetuned language models are zero-shot learners. arXiv preprint arXiv:2109.01652.
  59. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., ... & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35, 24824-24837.
  60. Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023, April). Why Johnny can't prompt: how non-AI experts try (and fail) to design LLM prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-21). Association for Computing Machinery.