Browse > Article
http://dx.doi.org/10.14697/jkase.2015.35.3.0465

Analysis on the Characteristics of National Assessment of Educational Achievement (NAEA) Items for Science Subject: With a Focus on Optics  

Lee, Bongwoo (Dankook University)
Lee, Inho (Korea Institute for Curriculum and Evaluation)
Publication Information
Journal of The Korean Association For Science Education / v.35, no.3, 2015 , pp. 465-475 More about this Journal
Abstract
The purpose of this study is to analyze the results of physics (optics) in nationwide standardized assessment and to investigate middle-school students' characteristics of achievement by using an option response rate distribution curve. For this purpose, we analyzed the 10 optics problems from the National Assessment of Educational Achievement (NAEA) items for middle school science subject conducted in 2010-2013. The results of this study are as follows; First, students showed a little higher achievement in optics than classical mechanics and electromagnetism. Second, students achieved significantly worse in 'formation of image' in 'light' part and 'variation of phase in propagation of wave' in 'wave' part. Third, students showed a context-dependent problem solving strategy and result. Additionally, we suggested some implications about the readjustment of some optics concepts level of national science curriculum, the need for teaching and learning strategies for basic level students, and the need for teaching and learning strategies focused on the realistic context.
Keywords
National Assessment of Educational Achievement (NAEA); option response rate distribution curve; item analysis; physics; optics;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 ACARA. (2013). The Australian curriculum. Retrived from http://www.australiancurriculum.edu.au.
2 Bendall, S. Goldberg, F., & Galili, I. (1993). Prospective elementary teachers' prior knowledge about light. Journal of Research in Science Teaching, 30(9), 1169-1187.   DOI   ScienceOn
3 Chang, H., Chen, J., Guo, C., Chen, C., Chang, C., Lin, S., Su, W., Lain, K., Hsu, S., Lin, J., Chen, C., Cheng, Y., Wang, L., & Tseng, Y. (2007). Investigating primary and secondary students' learning of physics concepts in Taiwan. International Journal of Science Education, 29, 465-482.   DOI   ScienceOn
4 Choi, W. (2013). Comparison of the Characteristics of each Educational Achievement Level of Elementary and Middle School Students shown in the Chemistry Items of the National Assessment of Educational Achievement. Journal of the Korean Association for Science Education, 33(6), 1186-1201.   DOI   ScienceOn
5 Choi, W., & Jeong, E. (2008). Relationship between Science Achievement and Student-related Variable in National Assessment of Educational Achievement in 2006. Journal of the Korean Association for Science Education, 28(8), 848-859.
6 Choi, W., Lee, I., Lee, C., Jeong, E., Park, J., & Sin, M. (2010). National Assessment of Educational Achievement in 2009 - Analysis of the Science Acievement Test Results. Korea Institute for Curriculum and Evaluation Research Paper RRE 2010-6-5.
7 Department of Education (2013) National Curriculum Science programmes of study: key stages 1 and 2 National curriculum in England. Department of Education, London.
8 Eshach, H., & Schwartz, J. (2006). Sound stuff? Naive materialism in middle-school students' conceptions of sound. International Journal of Science Education, 28, 733-764.   DOI   ScienceOn
9 Galili, I., Goldberg, F., & Bendall, S. (1991). Some reflections on plane mirrors and images. The Physics Teacher, 29(7), 471-477.   DOI
10 Goldberg, F., & McDermott, L. C. (1986). Student difficulties in understanding image formation by a plane mirror. The Physics Teacher, 24(8), 472-480.   DOI
11 Jeong, U. Y. & Choi, W. H. (2008). Trend Analysis of Students' Science Achievement in National Assessment of Educational Achievement from 2003 to 2006. Journal of the Korean Association for Science Education, 28(5), 438-452.
12 Kim, H., & Jeong, J., (2012). An Analysis of the Result of National Assessment of Educational Achievement in Science at Grade 9. Journal of the Korean Association for Science Education, 36(2), 394-407.
13 Kim, K., Kim, W., Choi, I., Sang, K., Kim, H., Shin, J., Kim, J., & Sohn, W. (2011a). Characteristics of Educational Academic Improvement from NAEA(National Assessment of Educational Achievement) 2010. Korea Institute for Curriculum and Evaluation Research Paper RRE 2011-2-4.
14 Kim, M., Kim, D., Kim, Y., Chin, J, Kim, H, Lee, B., Jo, Y., Lee, I., Kim, H., Lee, Y., & Lee, C. (2011b). A Study on the Development Process fo the National Assessment of Educational Achievement. Korea Institute for Curriculum and Evaluation Research Paper RRE 2011-3-1.
15 Kim K., Kim, J., Kim, K., & Han, B. (2007). Analysis of misconceptions about sound waves of pre-service teachers. Sae Mulli, 55(6), 397-408.
16 Kim, H., Lee, I., Lee, B., Lee, K., & Sim, J., (2015). Analysis on the Characteristics of National Assessment of Educational Achievement (NAEA) Items for Science Subject through the use of Option Response Rate Distribution Curve. Journal of the Korean Association for Science Education, 35(1), 121-130.   DOI   ScienceOn
17 Kim, D., Kim, D., Kim, Y., Kim, J., Lee, J., Seo, M., Jo, Y., Lee, K., Lee, I., Sim, J., Pae, J., Jung, G., Choi, W., & Park, Y. (2013a). A Study of the Features of Educational Achievement and Development of the National Assessment of Educational Achievement (NAEA) 2013. Korea Institute for Curriculum and Evaluation Research Paper RRE 2013-4.
18 Kim, D., Lee, I., Kim, M., Jeong, E., & Kang, H. (2012). Analysis of the 2011 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2013-37-4.
19 Kim, H., Lee, I., Kim, M., Jeong, J., & Sin, M. (2011c). Analysis of the 2010 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2011-3-5.
20 Kim, D., Lee, I., Sim, J., Choi, W., & Park, Y. (2013b). Analysis of the 2012 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2013-37-4.
21 Kim, Y., & Paik, S. (2008). The cognition changes related to the teaching methods of "Light" chapter for 7th grade as experienced by science teachers in abduction thinking. Journal of the Korean Association for Science Education, 28(6), 507-518.
22 Kucukozer, A. (2010). Prospective science teachers' misconceptions concerning wave. Journal of Turkish Science Education, 7(2), 66-75.
23 Lee, B., & Lee, Y. (2005). Analysis and evaluation of the physics content relevance in the 7th national science curriculum. Sae Mulli, 50(6), 383-393.
24 Kwon, G., Bang, S., Lee, S., & Lee, G. (2006). Context-dependency of students' conceptions in optics: Focused on vision & mirror image. Journal of the Korean Association for Science Education, 26(3), 406-414.
25 Lee, B. (2012). Analysis of 'image' in middle-school science textbooks. New Physics: Sae Mulli, 62(6), 589-600.   DOI
26 Lee, B., & Choi, E. (2008). Effect of learning Chinese characteres on understanding th vocabulary of physics. Sae Mulli, 57(2), 114-119.
27 Lee, C., Nam, M., Nam, G., Park, E., Kim, H., Kwon, J., Choi, W., Lee, I., Kim, M., Song, M, Jeong, E., Park, J., Sin, M., Choi, J., Ko, E., & Kim, D. (2010). A Study on improving the process of developing, implementing, and scoring the National Assessment of Educational Achievement (NAEA). Korea Institute for Curriculum and Evaluation Research Paper RRE 2010-6-1.
28 Lee, J., Nam, K., Son, J., & Lee, S. (2004). An analysis of the type of teacher and student's concept on ray-tracing and spectrum in the middle school. Journal of the Korean Association for Science Education, 24(6), 1189-1205.
29 Lee, I., Sim, J., Kim, H., Lee, K., & Lee, B. (2014). Analysis of the 2013 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2014-30-4.
30 Maurines, L. (1992). Spontaneous reasoning on the propagation of visible mechanical signals. International Journal of Science Education, 14, 279-293.   DOI   ScienceOn
31 Ministry of Education and Science Technology(MEST) (2009). National Science Curriculum.
32 Park, J., & Yoo, J. (2010). An analysis of physics textbooks' and of teachers' representations of sound waves in pipes from the views of concrete vs. abstract and microscopic vs. macroscopic. New Physics: Sae Mulli, 60(9), 960-975.   DOI
33 NGSS. (2013). Next Generation Science Standards: For States, By States. USA: NGSS Lead States.
34 Oh, W., & Kim, J. (2002). Middle school students' concepts of vision and of the properties of light. Sae Mulli, 45(3), 163-170.
35 Oh, W., & Kim, J. (2006). Concepts about light and waves of non-physics major secondary school-science teacher. Sae Mulli, 52(6), 512-520.
36 Pejuan, A., Bohigas, X., & Jaen, X. (2012). Misconceptions about sound among engineering students. Journal of Science Education and Technology, 21, 669-685.   DOI
37 Sengoren, S., Tanel, R., & Kavcar, N. (2006). Drawings and ideas of physics teacher candidates relating to the superposition principle on a continuous rope. Physics Education, 41(5), 453-461.   DOI   ScienceOn
38 Song, J., Kim, I., Kim, Y., Kwon, S., Oh, W., & Park, J. (2004). Science misconception map. Seoul: Books-Hill.
39 Wittmann, M C. (2002). The object coordination class applied to wavepulses: analysing student reasoning in wave physics. International Journal of Science Education, 24(1), 97-118.   DOI   ScienceOn
40 Wittmann, M. C., Steinberg, R. N. & Redish, E. F. (1999). Making sense of students making sense of mechanical waves. The Physics Teacher, 37, 15-21.   DOI   ScienceOn