Journal of Science Education (과학교육연구지)

Science Education Research Institute Kyungpook National University (경북대학교 과학교육연구소)
권호 표지
DOI QR코드

DOI QR Code

Development of STEAM Diagnostic Evaluation Tool to Strengthen the Implementation of STEAM Education

STEAM 교육의 실행 강화를 위한 학교 STEAM 역량 진단 도구 개발

  • Received : 2021.10.12
  • Accepted : 2021.11.22
  • Published : 2021.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to develop an instrument for school STEAM education diagnostic assessment. Literature reviews, the developmental study of a prototype instrument, experts' advices, and pilot study were administrated. The school STEAM education diagnostic assessment was consist of five areas: 'STEM education action and sustainability plan,' 'STEAM curriculum and instruction,' 'STEAM professional development,' 'process-based evaluation,' and 'community and partnerships.' Each area had one to five sub-areas. A total of 14 diagnosis items were developed, including items that can diagnose the school's STEAM environment base and STEAM education execution level at the school unit and member level for each area. The validation of the diagnostic assessment was conducted through the content validity of the expert group and the validity of a survey targeting school teachers. For applying the instrument for STEAM Education School Assessment to schools, a total of 267 elementary, middle, and high schools participated. As a result, the average of the five areas was 1.46 to 2.18. This instrument comprehensively diagnoses and evaluates the implementation and effectiveness of STEAM education in schools, and is expected to be used as basic data and core data for implementing STEAM education.

이 연구의 목적은 학교 STEAM 교육의 실행과 교육환경 기반을 진단하고 평가할 수 있는 학교 STEAM 교육 역량 진단 도구를 개발하는 것이다. 진단 도구의 개발은 STEAM 교육의 평가 또는 성과와 관련된 문헌 조사, 연구진의 반성적 재검토, 전문가 및 현장교사의 타당도 검증 등으로 이루어졌다. 학교 STEAM 교육 역량 진단 도구는 'STEAM 교육의 실천과 지속가능성의 계획', 'STEAM 교육과정 및 교수학습 방법', 'STEAM 학습 전문성 개발', '과정 중심 평가', '고등 교육 기관, 산업 파트너, 기술 센터와 연계 구축' 등 5개 영역과 하위영역의 총 14문항으로 구성된다. 학교 STEAM 역량 진단 도구의 타당화는 전문가의 내용 타당도 검증과 예비조사(pilot study)의 학교 교사의 실제에 의한 타당도를 통해 진행하였다. 개발된 학교 STEAM 역량 진단 도구를 활용하여 초등, 중, 고등학교 267개교를 진단한 결과, 5개 영역 평균이 1.46 ~ 2.18의 수준으로 나타났다. 이 진단 도구는 학교의 STEAM 교육의 실행 및 효과를 포괄적으로 진단·평가하고, 우리나라 STEAM 교육의 실행을 진단하고 이해하는데 기초 자료로 활용될 것으로 기대한다.

Keywords

Acknowledgement

이 논문은 2019년 한국과학창의재단의 지원을 받아 수행된 '융합교육 종합계획 수립을 위한 기초연구(연구보고 BD19090001)' 결과보고서의 일부 내용을 재구조화한 것임.

References

  1. Adams, E. L. (2017). The effect of a middle school STEM initiative on cognitive and non-cognitive outcomes: A quasi-experimental study using instrumental variables and inverse propensity weights. http://www.lib.ncsu.edu/resolver/1840.20/33614
  2. Allen, P. J., & Noam, G. G. (2016). STEM learning ecosystems: Evaluation and assessment findings. Belmont, MA: The PEAR Institute: Partnerships in education and resilience [Online]. Retrieved from http://stemecosystems.org/wp-content/uploads/2017/01/STEMEcosystems_Final_120616.pdf
  3. Baek, Y., Park, H., Kim, Y., Noh, S., Park, J., Lee, J., Jeoung, J., Choi, Y., & Han, H. (2011). STEAM education in Korea. Journal of Learner-Centerd Curriculum and Instruction, 11(4), 149-171.
  4. Bicer, A., & Capraro, R. M. (2019). Mathematics achievement in the secondary high school context of STEM and non-STEM schools. School Science and Mathematics, 119(2), 61-71. https://doi.org/10.1111/ssm.12321
  5. Bruce-Davis, M. N., Gubbins, E. J., Gilson, C. M., Villanueva, M., Foreman, J. L., & Rubenstein, L. D. (2014). STEM high school administrators', teachers', and students' perceptions of curricular and instructional strategies and practices. Journal of Advanced Academics, 25(3), 272-306. https://doi.org/10.1177/1932202X14527952
  6. Choi, Y., Yang, J., & Hong, S. (2016). The effects of smart media based STEAM program of 'Chicken Life Cycle' on academic achievement, Scientific process skills and affective domain of elementary school students. Journal of Korean Elementary Science Education, 35(2), 166-180. https://doi.org/10.15267/KESES.2016.35.2.166
  7. Drane, D., Micari, M., & Light, G. (2014). Students as teachers: Effectiveness of a peer-led STEM learning programme over 10 years. Educational Research and Evaluation, 20(3), 210-230. https://doi.org/10.1080/13803611.2014.895388
  8. Hahn, I., Hwang, S., & Yoo, J. (2016). Development and management of the advanced STEAM teacher training program. Journal of the Korean Association for Science Education, 36(3), 399-411. https://doi.org/10.14697/JKASE.2016.36.3.0399
  9. Hall-Lay, S. (2018). Gender effects of fobotics programs on STEM-related self-efficacy of high school students (Doctoral dissertation). Walden University, Minneapolis, MN.
  10. Han, H., & Lee, H. (2012). A study on the teachers' perceptions and needs of STEAM education. Journal of Learner-Centerd Curriculum and Instruction, 12(3), 573-603.
  11. Han, S., Capraro, R., & Capraro, M. M. (2015). How science, technology, engineering, and mathematics (STEM) project-based learning (PBL) affects high, middle, and low achievers differently: The impact of student factors on achievement. International Journal of Science and Mathematics Education, 13(5), 1089-1113. https://doi.org/10.1007/s10763-014-9526-0
  12. Havice, W., Havice, P., Waugaman, C., & Walker, K. (2018). Evaluating the effectiveness of integrative STEM education: Teacher and administrator professional development. Journal of Technology Education, 29(2), 73-90. https://doi.org/10.21061/jte.v29i2.a.5
  13. Jeon, J., & Lee, H. (2015). The development and application of STEAM education program based on systems thinking for high school students. Journal of the Korean Association for Science Education, 35(6), 1007-1018. https://doi.org/10.14697/JKASE.2015.35.6.1007
  14. Kang, C., & Kang, K. (2016). The effects of problem solving activities of STEAM program on middle school students' metacognition. Journal of Science Education, 40(1), 17-30. https://doi.org/10.21796/jse.2016.40.1.17
  15. Kang, J., & Jin, S. (2019). A meta-analysis on the effects of STEAM education as an education policy of Korean governments. Journal of the Korea Convergence Society, 10(12), 205-213. https://doi.org/10.15207/JKCS.2019.10.12.205
  16. LaForce, M., Noble, E., King, H., Century, J., Blackwell, C., Holt, S., Ibrahim, A., & Loo, S. (2016). The eight essential elements of inclusive STEM high schools. International Journal of STEM Education, 3(1), 21. https://doi.org/10.1186/s40594-016-0054-z
  17. Lee, M., & Kwon, S. (2017). Teacher's perception analysis of STEAM education policy: Implications for convergence education. Educational Research, 69, 121-161. https://doi.org/10.17253/swueri.2017.69..005
  18. Lim, Y., Min, B., & Hong, H. (2015). Development and application effect of design-based STEAM program for boosting the career consciousness of 5~6th grade elementary school students for natural sciences and engineering. Journal of the Korean Association for Science Education, 35(1), 73-84. https://doi.org/10.14697/JKASE.2015.35.1.0073
  19. McClain, M. L. (2015). The effect of STEM education on mathematics achievement of fourth-grade underrepresented minority students (Doctoral dissertation). Capella University, Minneapolis, MN.
  20. McKinnon, F. R. (2018). The effects of STEM education on elementary student achievement (Doctoral dissertation). Western Illinois University, Macomb, IL.
  21. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749. https://doi.org/10.1037/0003-066X.50.9.741
  22. Ministry of Education [MOE]. (2017). 융합인재교육(STEAM) 중장기 계획(2018-2022) [STEAM education medium and long-term plan(2018-2022)]. Sejong, Korea: Author.
  23. Ministry of Education [MOE]. (2020). 학습의 패러다임을 바꾸어 가는 융합교육종합계획(안) 2020년 ~ 2024년 [The 2nd STEAM education (2020~2024)]. Seoul, Korea: Author.
  24. Ministry of Education and Science Technology [MEST]. (2010a). 2011년 업무 보고 [2011 policy report]. Seoul, Korea: Author.
  25. Ministry of Education and Science Technology [MEST]. (2010b). 제2차 과학기술인재 육성.지원계획('11~'15) [The 2nd National Basic Plan for Human Resources in S&T(2011~2015)]. Seoul, Korea: Author.
  26. Organization for Economic Cooperation and Development [OECD]. (2018). The future of education and skills: Education 2030. OECD [Online]. Retrieved from http://www.oecd.org/education/2030-project/
  27. Park, H., Byun, S., Sim, J., Baek, Y., & Jeong, J. (2016). A study on the current status of STEAM education. Journal of the Korean Association for Science Education, 36(4), 669-679. https://doi.org/10.14697/JKASE.2016.36.4.0669
  28. Park, H., Kim, Y., Noh, S., Lee, J., Jeoung, J., Choi, Y., Han, H., & Baek, Y. (2011). Components of 4C-STEAM education and a checklist for the instructional design and instruction. The Journal of Learner-Centered Curriculum and Instruction, 12(4), 533-557.
  29. Park, H., Sim, J., Kim, E., Ham, H., Lee, Y., Lee, J., & Kwon, H. (2019). Developmental study of an instrument for STEAM education key competencies. Journal of Science Education, 43(2), 258-269. https://doi.org/10.21796/jse.2019.43.2.258
  30. Schwab, K.M. (2016). The Fourth Industrial Revolution: What it means, how to respond. World Economic Forum Agenda. World Economic Forum [Online]. Retrieved from http://www.weforum.org/agenda/2016/01/the-fourth-industrial-revolution-what-itmeans-and-how-to-respond
  31. Sim, J., Lee, Y., & Kim, H. (2015). Understanding STEM, STEAM education, and addressing the issues facing STEAM in the Korean context. Journal of the Korean Association for Science Education, 35(4), 709-723. https://doi.org/10.14697/JKASE.2015.35.4.0709
  32. Sim. J., Park, H., Baek, Y., & Byun, S. (2017). The development of assessment tools to measure STEAM problem solving abilities for elementary and secondary school students. Teacher Education Research, 56(2), 190- 210. https://doi.org/10.15812/ter.56.2.201706.190
  33. Song, E., & Lee, C. (2017). Effects of musical instrument production STEAM class with flipped learning on elementary school students' academic achievements and learning motivation. The Journal of Korean Practical Arts Education, 23(2), 147-167.
  34. Tolliver, E. R. (2016). The effects of science, technology, engineering and mathematics (STEM) education on elementary student achievement in urban schools (Doctoral dissertation). Grand Canyon university, Phoenix, AZ.
  35. Toma, R. B., & Greca, I. M. (2018). The effect of integrative STEM instruction on elementary students' attitudes toward science. Eurasia Journal of Mathematics, Science and Technology Education, 14(4), 1383-1395.
  36. Warwick Online (2011). School STEM assessment tool. Warwick Univ. Retrieved from https://warwick.ac.uk/fac/soc/ier/ngrf/stem/movingon/use-resources/school_stem_assessment_tool.docx
  37. White, C., Marshall, J. C., & Alston, D. (2019). Empirically supporting school STEM culture: The creation and validation of the STEM Culture Assessment Tool (STEM-CAT). School Science and Mathematics, 119(6), 299-311. https://doi.org/10.1111/ssm.12356