Browse > Article
http://dx.doi.org/10.21796/jse.2021.45.3.349

Development of STEAM Diagnostic Evaluation Tool to Strengthen the Implementation of STEAM Education  

Park, HyunJu (Chosun University)
Sim, Jaeho (Pusan National University)
Lee, Ji-Ae (Korea Institute of Energy Technology)
Lee, Youngtae (Korea Institute for Curriculum and Evaluation)
Publication Information
Journal of Science Education / v.45, no.3, 2021 , pp. 349-363 More about this Journal
Abstract
The purpose of this study is to develop an instrument for school STEAM education diagnostic assessment. Literature reviews, the developmental study of a prototype instrument, experts' advices, and pilot study were administrated. The school STEAM education diagnostic assessment was consist of five areas: 'STEM education action and sustainability plan,' 'STEAM curriculum and instruction,' 'STEAM professional development,' 'process-based evaluation,' and 'community and partnerships.' Each area had one to five sub-areas. A total of 14 diagnosis items were developed, including items that can diagnose the school's STEAM environment base and STEAM education execution level at the school unit and member level for each area. The validation of the diagnostic assessment was conducted through the content validity of the expert group and the validity of a survey targeting school teachers. For applying the instrument for STEAM Education School Assessment to schools, a total of 267 elementary, middle, and high schools participated. As a result, the average of the five areas was 1.46 to 2.18. This instrument comprehensively diagnoses and evaluates the implementation and effectiveness of STEAM education in schools, and is expected to be used as basic data and core data for implementing STEAM education.
Keywords
STEAM education; STEM school; competency assessment instrument; self-evaluation; diagnostic assessment; K-12;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Lee, M., & Kwon, S. (2017). Teacher's perception analysis of STEAM education policy: Implications for convergence education. Educational Research, 69, 121-161.   DOI
2 Lim, Y., Min, B., & Hong, H. (2015). Development and application effect of design-based STEAM program for boosting the career consciousness of 5~6th grade elementary school students for natural sciences and engineering. Journal of the Korean Association for Science Education, 35(1), 73-84.   DOI
3 McKinnon, F. R. (2018). The effects of STEM education on elementary student achievement (Doctoral dissertation). Western Illinois University, Macomb, IL.
4 Ministry of Education and Science Technology [MEST]. (2010a). 2011년 업무 보고 [2011 policy report]. Seoul, Korea: Author.
5 Ministry of Education and Science Technology [MEST]. (2010b). 제2차 과학기술인재 육성.지원계획('11~'15) [The 2nd National Basic Plan for Human Resources in S&T(2011~2015)]. Seoul, Korea: Author.
6 Organization for Economic Cooperation and Development [OECD]. (2018). The future of education and skills: Education 2030. OECD [Online]. Retrieved from http://www.oecd.org/education/2030-project/
7 Park, H., Byun, S., Sim, J., Baek, Y., & Jeong, J. (2016). A study on the current status of STEAM education. Journal of the Korean Association for Science Education, 36(4), 669-679.   DOI
8 Park, H., Sim, J., Kim, E., Ham, H., Lee, Y., Lee, J., & Kwon, H. (2019). Developmental study of an instrument for STEAM education key competencies. Journal of Science Education, 43(2), 258-269.   DOI
9 Sim. J., Park, H., Baek, Y., & Byun, S. (2017). The development of assessment tools to measure STEAM problem solving abilities for elementary and secondary school students. Teacher Education Research, 56(2), 190- 210.   DOI
10 Tolliver, E. R. (2016). The effects of science, technology, engineering and mathematics (STEM) education on elementary student achievement in urban schools (Doctoral dissertation). Grand Canyon university, Phoenix, AZ.
11 McClain, M. L. (2015). The effect of STEM education on mathematics achievement of fourth-grade underrepresented minority students (Doctoral dissertation). Capella University, Minneapolis, MN.
12 Hahn, I., Hwang, S., & Yoo, J. (2016). Development and management of the advanced STEAM teacher training program. Journal of the Korean Association for Science Education, 36(3), 399-411.   DOI
13 Toma, R. B., & Greca, I. M. (2018). The effect of integrative STEM instruction on elementary students' attitudes toward science. Eurasia Journal of Mathematics, Science and Technology Education, 14(4), 1383-1395.
14 White, C., Marshall, J. C., & Alston, D. (2019). Empirically supporting school STEM culture: The creation and validation of the STEM Culture Assessment Tool (STEM-CAT). School Science and Mathematics, 119(6), 299-311.   DOI
15 Ministry of Education [MOE]. (2020). 학습의 패러다임을 바꾸어 가는 융합교육종합계획(안) 2020년 ~ 2024년 [The 2nd STEAM education (2020~2024)]. Seoul, Korea: Author.
16 Bicer, A., & Capraro, R. M. (2019). Mathematics achievement in the secondary high school context of STEM and non-STEM schools. School Science and Mathematics, 119(2), 61-71.   DOI
17 Drane, D., Micari, M., & Light, G. (2014). Students as teachers: Effectiveness of a peer-led STEM learning programme over 10 years. Educational Research and Evaluation, 20(3), 210-230.   DOI
18 Baek, Y., Park, H., Kim, Y., Noh, S., Park, J., Lee, J., Jeoung, J., Choi, Y., & Han, H. (2011). STEAM education in Korea. Journal of Learner-Centerd Curriculum and Instruction, 11(4), 149-171.
19 Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749.   DOI
20 Allen, P. J., & Noam, G. G. (2016). STEM learning ecosystems: Evaluation and assessment findings. Belmont, MA: The PEAR Institute: Partnerships in education and resilience [Online]. Retrieved from http://stemecosystems.org/wp-content/uploads/2017/01/STEMEcosystems_Final_120616.pdf
21 Choi, Y., Yang, J., & Hong, S. (2016). The effects of smart media based STEAM program of 'Chicken Life Cycle' on academic achievement, Scientific process skills and affective domain of elementary school students. Journal of Korean Elementary Science Education, 35(2), 166-180.   DOI
22 Kang, C., & Kang, K. (2016). The effects of problem solving activities of STEAM program on middle school students' metacognition. Journal of Science Education, 40(1), 17-30.   DOI
23 Ministry of Education [MOE]. (2017). 융합인재교육(STEAM) 중장기 계획(2018-2022) [STEAM education medium and long-term plan(2018-2022)]. Sejong, Korea: Author.
24 Hall-Lay, S. (2018). Gender effects of fobotics programs on STEM-related self-efficacy of high school students (Doctoral dissertation). Walden University, Minneapolis, MN.
25 Han, H., & Lee, H. (2012). A study on the teachers' perceptions and needs of STEAM education. Journal of Learner-Centerd Curriculum and Instruction, 12(3), 573-603.
26 Adams, E. L. (2017). The effect of a middle school STEM initiative on cognitive and non-cognitive outcomes: A quasi-experimental study using instrumental variables and inverse propensity weights. http://www.lib.ncsu.edu/resolver/1840.20/33614
27 Schwab, K.M. (2016). The Fourth Industrial Revolution: What it means, how to respond. World Economic Forum Agenda. World Economic Forum [Online]. Retrieved from http://www.weforum.org/agenda/2016/01/the-fourth-industrial-revolution-what-itmeans-and-how-to-respond
28 Han, S., Capraro, R., & Capraro, M. M. (2015). How science, technology, engineering, and mathematics (STEM) project-based learning (PBL) affects high, middle, and low achievers differently: The impact of student factors on achievement. International Journal of Science and Mathematics Education, 13(5), 1089-1113.   DOI
29 Havice, W., Havice, P., Waugaman, C., & Walker, K. (2018). Evaluating the effectiveness of integrative STEM education: Teacher and administrator professional development. Journal of Technology Education, 29(2), 73-90.   DOI
30 LaForce, M., Noble, E., King, H., Century, J., Blackwell, C., Holt, S., Ibrahim, A., & Loo, S. (2016). The eight essential elements of inclusive STEM high schools. International Journal of STEM Education, 3(1), 21.   DOI
31 Warwick Online (2011). School STEM assessment tool. Warwick Univ. Retrieved from https://warwick.ac.uk/fac/soc/ier/ngrf/stem/movingon/use-resources/school_stem_assessment_tool.docx
32 Park, H., Kim, Y., Noh, S., Lee, J., Jeoung, J., Choi, Y., Han, H., & Baek, Y. (2011). Components of 4C-STEAM education and a checklist for the instructional design and instruction. The Journal of Learner-Centered Curriculum and Instruction, 12(4), 533-557.
33 Sim, J., Lee, Y., & Kim, H. (2015). Understanding STEM, STEAM education, and addressing the issues facing STEAM in the Korean context. Journal of the Korean Association for Science Education, 35(4), 709-723.   DOI
34 Song, E., & Lee, C. (2017). Effects of musical instrument production STEAM class with flipped learning on elementary school students' academic achievements and learning motivation. The Journal of Korean Practical Arts Education, 23(2), 147-167.
35 Kang, J., & Jin, S. (2019). A meta-analysis on the effects of STEAM education as an education policy of Korean governments. Journal of the Korea Convergence Society, 10(12), 205-213.   DOI
36 Jeon, J., & Lee, H. (2015). The development and application of STEAM education program based on systems thinking for high school students. Journal of the Korean Association for Science Education, 35(6), 1007-1018.   DOI
37 Bruce-Davis, M. N., Gubbins, E. J., Gilson, C. M., Villanueva, M., Foreman, J. L., & Rubenstein, L. D. (2014). STEM high school administrators', teachers', and students' perceptions of curricular and instructional strategies and practices. Journal of Advanced Academics, 25(3), 272-306.   DOI