Browse > Article
http://dx.doi.org/10.14697/jkase.2018.38.6.875

Meta Analysis of STEAM (Science, Technology, Engineering, Arts, Mathematics) Program Effect on Student Learning  

Kang, Nam-Hwa (Korea National University of Education)
Lee, Na-ri (Korea National University of Education)
Rho, Minjeong (Korea National University of Education)
Yoo, Jin Eun (Korea National University of Education)
Publication Information
Journal of The Korean Association For Science Education / v.38, no.6, 2018 , pp. 875-883 More about this Journal
Abstract
This study examined overall effect of STEAM programs on student learning through meta-analysis of journal articles published for the past six years. We examined the areas of effects that the research tested and analyzed overall effect across the research. We first identified academic journal articles that utilized quasi-experimental design in examining STEAM effects on student learning and presented appropriate data for meta-analysis such as effect size. A total of 63 articles were identified to be appropriate for meta-analysis. Using R packages, we first identified outliers and eliminated them in the analysis of mean effect size. Thus, 172 effect sizes from 60 studies were analyzed. The results showed that the mean effect was medium (effect size = 0.52). Analysis showed that moderators of the effect were affective measures, thinking skills, character measures, and career aspirations, which meant the studies that measured these variables had more effect than achievement measures. On the other hand, the school level (elementary, middle, and high school), the absence or presence of student products as program requirements, hours of intervention, and sample size did not moderate the effect. Thus, regardless of these variables STEAM programs produced medium effect in general. Based on these results, further research areas and topics are suggested.
Keywords
STEAM; meta-analysis; effective size; effect on student learning;
Citations & Related Records
Times Cited By KSCI : 9  (Citation Analysis)
연도 인용수 순위
1 Oh, D., Bae, J., & Park, S. (2016). The Effects of science based enrichment STEAM gifted program on creative thinking activities and emotional intelligence of elementary science gifted students. Journal of Korean Elementary Science Education, 35(1), 13-25.   DOI
2 Oh, J., Lee, J., & Kim, J. (2013). Development and application of STEAM based education program using scratch: Focus on 6th graders' science in elementary school. In Multimedia and ubiquitous engineering. The Journal of Korean Association of Computer Education, 15(3), 11-23.
3 Park, H., & Shin, Y. (2012). Effects of science lesson applying STEAM education on self-efficacy, interest, and attitude towards science. Biology Education, 40(1), 132-146.   DOI
4 Park, J., & Hyun, E. (2014). The effects of the education programs of integrating art with science and technology: Focusing on student's perceived learning achievement in science and technology. The Korean Journal of Educational Methodology Studies, 26(1), 137-161.
5 Park, M., Kim, Y., & O, K. (2012). Effects of the Diagram-Drawing Learning Method on the Science-Related Attitudes of the Middle School Students. Teacher Education Research, 51(3), 390-402.   DOI
6 Park, S. J., & Yoo, P. K. (2013). The effects of the learning motive, interest and science process skills using the 'Light' unit on science-based STEAM. Journal of Korean Elementary Science Education, 32(3), 225-238.   DOI
7 Kang, I., Kim, H., & Kim, D.(2012). A case study on the learning effects of the STEAM education using open source softwares in terms of students' interesting and attitudes toward science. Secondary Education Research, 60(4), 1105-1134.   DOI
8 Kang, H., & Seo, H. (2013). The development and application of a life science based STEAM program for middle school gifted students. Journal of Science Education for the Gifted, 5(3), 162-173.
9 Kang, N., Yoo, J., Byun, S., Lim, S., Oh. K., & Jeong, J. et al., (2017). The effect of STEAM projects: Year 2016 analysis. Seoul, KOFAC.
10 Kim, D. H., & Hong, S. H. (2014). STEAM program development and the application effect for the geological feature relation which can be executed at an indoors. Journal of Korean Elementary Science Education, 33(3), 510-523.   DOI
11 Kim, D. H., Ko, D. G., Han, M. J., & Hong, S. H. (2014). The Effects of science lessons applying STEAM education program on the creativity and interest levels of elementary students. Journal of the Korean Association for Science Education, 34(1), 43-54.   DOI
12 Kim, D., & Koo, D. (2013). Development and application of elementary science IT convergence education program. Korean Journal of Elementary Education, 24(3), 119-138.
13 Kim, G., & Choi, S. (2012). The effects of the creative problem solving ability and scientific attitude through the science-based STEAM program in the elementary gifted students. Journal of Korean Elementary Science Education, 31(2), 216-226.   DOI
14 Kim, H., & Choi, S. (2013). The Effects on the STEAM learning program of intelligent life in elementary school. Journal of Science Education, 37(3), 550-561.   DOI
15 Kim, H., & Choi, S. (2015). The Effects of the science inquiry and scientific attitude through the science-based PRIDE of STEAM program in the elementary science class. Journal of Education & Culture, 21(2), 137-158.   DOI
16 Park, S. (2013). The effects of STEAM program using storyline on elementary students' creative personality and science-related attitude. Journal of the Korean Association of information Education, 17(4), 487-496.   DOI
17 Pigott, T. (2012). Advances in meta-analysis. New York: Springer Science & Business Media.
18 Rhie, D., Kim, J., & Kim, J. (2015). Development and Application of STEAM Education Process Model for the 'Creative Design' Step of STEAM Learning Criteria. Korea Institute of Technical Education, 15(1).
19 Rho, M. & Yoo, J. E. (2016). A meta-analysis on STEAM programs and science affective domains. Journal of Educational Evaluation, 29(3), 597-617.
20 Park, H., Kim, Y., Noh, S. G., Lee, J., Jeong, J., Choi, Y. et al. (2012). Components of 4C-STEAM education and a checklist for the instructional design. Journal of Learner-Centered Curriculum and Instruction, 12(4), 533-557.
21 Schwab, K. (2016). The fourth industrial revolution. New York: World Economic Forum.
22 Schwichow, M., Croker, S., Zimmerman, C., Hoffler, T., & Hartig, H. (2016). Teaching the control-of-variables strategy: A meta-analysis. Developmental Review, 39, 37-63.   DOI
23 Seong, S., & Shin, Y. (2015). The Effect of the STEAM Program for Career Education on Career Development of Elementary School Students. The Journal of Education, 35(1), 1-23.
24 Son, J., Kim, J., & Kim, Y. (2014). Effects of astronomical STEAM program using co-teaching on self-directed learning attitude of elementary science gifted students. Journal of the Korean earth science society 35(7), 572-584.   DOI
25 Song, J., Lee, M., & Park, S. (2015). Effectiveness of STEAM Program Using Thinking Maps on Elementary School Students. The Journal of Elementary Education, 28(3), 145-171.
26 Han, M., & Hong, S. (2015). The development and application of a STEAM program making connections between the material transport systems of plants and animals. Journal of Educational Studies, 46(1), 69-91.   DOI
27 Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1(1), 39-65.   DOI
28 Hong, H. J., Bae, J. H., So, K. H.. (2015). The effects of the STEAM based field trip program on the elementary students' science process skills and attitude toward science. Biology Education, 43(4), 344-354.   DOI
29 Hunter, J. E. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
30 Jeon, S., & Lee, Y. (2014). Art based STEAM education program using EPL. Journal of The Korea Society of Computer and Information, 19(4), 149-158.   DOI
31 Johnson, C. C. Peters-Burton, E. E. Moore T. J. (eds.)(2016). STEM road map: A framework for integrated STEM education. New York: Routledge.
32 Jun, M., & Park, M. (2015). Effects of STEAM program development and application for the 1st grades of elementary school. Education of Primary School Mathematics, 18(2), 91-106.   DOI
33 Bae, J., Yun, B., & Kim, J. (2013). The effects of science lesson applying STEAM education on science learning motivation and science academic achievement of elementary school students. Journal of Korean Elementary Science Education, 32(4), 557-566.   DOI
34 Kim, J., & Hong, S. (2015). Development and effect of STEAM program on environment using smart equipment in elementary science. The Environmental Education 28(3), 178-192.
35 Kim, M., & Choi, S. (2013). The Effects of the STEAM project-based learning on students' creative problem solving and science achievement in the elementary science class. Science Education Research, 37(3), 562-572.
36 Kim, T., Yang, Y., & Kim, J. (2013). Kim, T., Yang, Y., & Kim, J. (2013). Development and Application of STEAM Education Program by Producing UCC - 2nd Graders in Elementary School. Journal of the Korean Association of Information Education, 17(3), 339-346.   DOI
37 Kim, Y., Paik, S., Choi, S., Kang, N., Maeng, S., & Joung, Y. (2015). Analysis on the trends of science education studies related to students' science learning in Korea. Journal of the Korean Association for Science Education, 35(4), 751-772.   DOI
38 Kim, J. W. & Won, H. H. (2014). The effect of creativity in STEAM education by meta-analysis in elementary school. Journal of Educational Evaluation, 27(4), 965-985.
39 Viechtbauer, W., & Cheung, M. W. L. (2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1(2), 112-125.   DOI
40 The R Foundation (2018). The R Project for Statistical Computing. https://www.r-project.org/. Accessed May 2, 2018.
41 Yu, S., & Kim, T. (2013). The effects of the STEAM-based robot learning on the creativity of elementary IT-gifted students. Korean Journal of Teacher Education, 29(3), 219-236.
42 Yang, J., & Hong, S. (2013). Effects of STEAM-based education program on environmental literacy and knowledge for effective micro organisms Korean Journal of Environmental Education, 26(4), 423-440.
43 Yang, J., & Hong, S. (2014). Development and application effects of STEAM program about flow of energy between organisms. Biology Education, 42(3), 249-264.   DOI
44 Yoo et al. (2016). Development of "Movie Production Project" science-arts convergence STEAM program and its effects on elementary school students' Career orientation of science, Career Awareness and Creative Personality. Journal of Science Education, 40(1), 31-51.   DOI
45 Yoon, H., & Kang, S. (2015). The Effect of integrated mind map activities on the creative thinking skills of 2nd year students in junior high school. Journal of the Korean Chemical Society, 59(2), 164-178.   DOI
46 Yoon, J., Kim B., & Kim, J. (2013). The effects of T-STEAM program on interesr and academic achievement in middle school technology subject. Korean Journal of Teacher Education, 29(3), 157-175.   DOI
47 Kim, J. W. & Won, H. H. (2016). The effect of creativity in STEAM education by meta-analysis. Korean Journal of Educational Research, 54(2), 169-195.
48 KOFAC (2018, July 17). About STEAM. Retrieved from https://steam.kofac.re.kr/?page_id=11269
49 Ko, C., Kim, J., Jin, S., Cho, H., Jung, S., & Park, Y. (2016). The effects of STEAM programs applied the practical personality education on STEAM attitudes and practical personalities for elementary school students. The Journal of Elementary Education, 29(1), 1-22.
50 Ko, E., & Hong, S. (2015). The development and application effects of STEAM program utilizing natural game for the ecosystem learning in elementary science. Biology Education, 43(4), 368-380.   DOI
51 Kim, D., & Hong, S. (2014). The Development and application effects of convergence program for field trip and STEAM education related geology. Journal of Korean Elementary Science Education, 33(2), 364-379.   DOI
52 Bae et al. (2014). The effects of science lesson applying STEAM education on creative thought activities and emotional intelligence of elementary school students. Journal of Korean Elementary Science Education, 33(4), 762-772.   DOI
53 Bae, D., Kim, B., & Kim, J. (2014). The effect of making bridge model STEAM program based SMART education on interest and STEAM literacy. The Korean Journal of Technology Education, 14(1), 158-176.
54 Bak, A., & Kim, Y. (2014). The effects of STEAM program on the scientific communication skills and the learning flow of elementary gifted students. Journal of Korean Elementary Science Education, 33(3), 439-452.   DOI
55 Bak, A., & Kim, Y. (2014). The effects of STEAM program on the scientific communication skills and the learning flow of elementary gifted students. Journal of Korean Elementary Science Education, 33(3), 439-452.   DOI
56 Banks F., & Barlex, D. (2014). Teaching STEM in the secondary school. New York: Routledge.
57 Brandwein, P. F., & Schwab, J. J. (1962). The teaching of science: The teaching of science as enquiry and Science in the Elementary School. Cambridge, MA: Harvard University Press.
58 Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to Meta-Analysis. Chichester, UK: Wiley.
59 Bybee, R. W. (2010). What is STEM education? Science, 329(5995), 996. https://doi.org/10.1126/science.1194998   DOI
60 Chae, H., & Noh, S. (2013).The effect of the STEAM activities on the elementary student's science process skills and science-related attitudes. Journal of Science Education, 37(3), 417-433.   DOI
61 Cho, S., & Park, C. (2013). The development and application of a STEAM program based on backward design. Journal of the Korean Educational Research Association, 17(4), 1385-1404.
62 Korea Ministry of Education (2015). 2015 revised curriculum: science. Sejong-si: Author.
63 Korea Ministry of Education (2018). Policy: focus, the fourth industrial revolution. Retrieved from http://happyedumoe.go.kr
64 Lee, D. (2015). Development of the G-STEAM program and its application with the application of project based learning: Focusing on 'Green City Project'. Journal of the Association of Korean Geographers, 4(2), 169-186.   DOI
65 Lee, D., & Park, H. (2015). Method application of the G-STEAM integrated curriculum based on project-based learning -Dokdo to make space for sustainable development project as a focus on-. Journal of the Association of Korean Photo-Geographers, 25(1), 63-85.
66 Lee, E., & Choi, Y. (2013). The Effect of the application of STEAM within the technology subject's information and communication technology unit on middle school students technological thinking disposition. The Korean Journal of Technology Education, 13(2), 128-155.
67 Lee, S. (2012). Effects of STEAM-based environmental program for elementary school students' environmental literacy. Korean Journal of Environmental Education, 25(1), 66-76.
68 Lee, S., Kwon, S., & Kwon, Y. (2015). Development of a convergence-oriented digital textbook on the structure and function of plant using iBooks Author. Biology Education, 42(4), 414-427.
69 Lee, S., & Lee, H. (2013). The effects of science lesson applying STEAM education on the creativity and science related attitudes of elementary school students. Journal of Korean Elementary Science Education, 32(1), 60-70.   DOI
70 Lee, W., & Kang, S. (2014). Creative and critical thinking skills-reinforced and STEAM-oriented teaching strategy of science for students' extracurricular activities through a junior high school intervention study program. Journal of Research in Curriculum Instruction, 18(2), 321-342.   DOI
71 Choi, Y., & Hong, S. (2013). The development and application effects of STEAM program about 'World of small organisms' unit in elementary science. Journal of Korean Elementary Science Education, 32(3), 361-377.   DOI
72 Choi, Y., & Hong, S. (2016). The development and application effects of 'Life Cycle of Plants' STEAM program using time-lapse based on smart media. Biology Education, 44(1), 35-48.   DOI
73 Choi, Y. M., Kim, E. H., Yang, J. H., & Hong, S. H. (2016). The influences of STEAM program using infragram for plant health monitoring on elementary student's creative problem solving ability, scientific process skills and affective domain. Biology Education, 44(1), 72-86.   DOI
74 Choi, Y., Yang, J., & Hong, S. (2016). The effects of smart media based STEAM program of chicken life cycle on academic achievement, scientific process skills and affective domain of Elementary School Students. Journal of Korean Elementary Science Education, 35(2), 166-180.   DOI
75 Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
76 Del Re, A. C. (2015). A practical tutorial on conducting meta-analysis in R. Quantitative Methods for Psychology, 11(1), 37-50.   DOI
77 Gleser, L. J., & Olkin, I. (2009). Stochastically dependent effect sizes. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta analysis (2nd ed., pp. 357-376). New York: Russell Sage Foundation.
78 Han, I., Hwang, S., & Yoo, J. (2016). Development and Management of the Advanced STEAM Teacher Training Program. Journal of the Korean Association for Research in Science Education, 36(3), 399-411.   DOI
79 Kang, J., Ju, E., & Jang, S. (2013). The effect of science-based STEAM program using a portfolio on elementary students' formation of science concepts. Journal of Korean Elementary Science Education, 32(4), 593-606.   DOI
80 Lee, Y., & Cho, J. (2012). Development and application of STEAM education program based on topic-specific project. Journal of the Korea Academia-Industrial Cooperation Society, 13(12), 5770-5775.   DOI
81 Lee, Y., & Cho, J. (2012). Development and application of STEAM education program based on topic-specific project. Journal of the Korea Academia-Industrial Cooperation Society, 13(12), 5770-5775.   DOI
82 Lee, Y., & Cho, J. (2012). Development and application of STEAM education program based on topic-specific project. Journal of the Korea Academia-Industrial Cooperation Society, 13(12), 5770-5775.   DOI
83 Lee, Y., & Kim, S. (2012). The effects of the space perception ability scientific attitudes through the science-based STEAM astronomical learning program. Journal of the Korean Society of Earth Science Education, 5(3), 297-306.   DOI
84 Lee, Y., & Kim, Y. (2012). The effects on the creative thinking and creative personality using the 'weather and our life' on science-based STEAM. Journal of the Korean Society of Earth Science Education, 5(2), 204-212.   DOI
85 Lee, Y., & Son, J. (2016). Effects of PAE-STEAM-Environment program in Environment literacy and creative problem solving of elementary students. Journal of Korean Practical Arts Education, 22(2), 15-31.
86 Lim, K., & Kim, H. (2014). The effects of STEAM education on scientific inquiry skills of high school students. Journal of the Korean society of earth science education, 7(2), 180-191.   DOI
87 Lim, Y., Min, B., & Hong, H. (2015). Development and Application Effect of Design-based STEAM Program for Boosting the Career Consciousness of 5- 6th Grade Elementary School Students for Natural Sciences and Engineering. Journal of the Korean Association for Science Education, 35(1), 73-84.   DOI
88 Moon, S., & Hong, S. (2016). Effects of STEAM program utilizing marine organism on scientific inquiry activity and affective domains of elementary students. Korean Journal of Teacher Education, 32(2), 1-25.
89 NGSS Lead States. (2013). Next generation science standards: For states, by States. Washington, DC: The National Academies Press.