Browse > Article
http://dx.doi.org/10.14697/jkase.2015.35.1.0121

Analysis of the Characteristics of National Assessment of Educational Achievement (NAEA) Items for Science Subject through the use of Option Response Rate Distribution Curve  

Kim, Hyun-Kyung (Korea Institute for Curriculum and Evaluation)
Lee, In-Ho (Korea Institute for Curriculum and Evaluation)
Lee, Bongwoo (Dankook University)
Lee, Kiyoung (Kangwon National University)
Sim, Jaeho (Pusan National University)
Publication Information
Journal of The Korean Association For Science Education / v.35, no.1, 2015 , pp. 121-130 More about this Journal
Abstract
Identifying students' achievement level and reflecting it on educational policy making or instructional improvement by analyzing the results of nationwide standardized assessment is an integral part of accountability in education. On the basis of this premise, we analyzed the characteristics of National Assessment of Educational Achievement (NAEA) items for middle school science subject conducted from 2010 to 2013 by using the option response rate distribution curve, the fittest graph estimated from the response rate of correct/incorrect options by achievement score. Furthermore, we classified the type of option response rate curve in terms of correct and incorrect options. Results of the analysis of option response curve showed that five types of correct option response curve (S-shaped, J-shaped, straight-shaped, F-shaped, and step-shaped) and 4 types of incorrect option response curve (down-slope, flat, mound, and up-slope) were identified. The most common type of items was the combination of S-shaped correct option response curve and down-slope incorrect option response curve, which are considered as appropriate items to discriminate the students according to achievement level. Moreover, correct option response was found to be correlated with incorrect option response. Based on the results, we also discussed some implications on teaching-learning method and classroom assessment in science education.
Keywords
National Assessment of Educational Achievement (NAEA); option response rate distribution curve; science assessment; item analysis;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Black, P. J. (1998). Testing: friend or foe? theory and practice of assessment and testing. London: Farmer.
2 Choi, W. (2013). Comparison of the Characteristics of each Educational Achievement Level of Elementary and Middle School Students shown in the Chemistry Items of the National Assessment of Educational Achievement. Journal of the Korean Association for Science Education, 33(6), 1186-1201.   DOI   ScienceOn
3 Choi, W., & Jeong, E. (2008). Relationship between Science Achievement and Student-related Variable in National Assessment of Educational Achievement in 2006. Journal of the Korean Association for Science Education, 28(8), 848-859.
4 Corcoran, T., & Silander, M. (2009). Instruction in high schools: The evidence and the challenge. The Future of Children: America's High Schools, 19, 157-183.
5 Corcoran, T., Mosher, F. A., & Rogat, A. (2009). Learning progressions in science: an evidence-based approach to reform (Consortium for Policy Research in Education Report #RR-63). Philadelphia, PA: Consortium for Policy Research in Education.
6 Duschl, R., Maeng, S., & Sezen, A. (2011). Learning progressions and teaching sequences: A review and analysis. Studies in Science Education, 47(2), 123-182.   DOI
7 Jeong, E., & Choi, W. (2008). Trend Analysis of Students' Science Achievement in National Assessment of Educational Achievement from 2003 to 2006. Journal of the Korean Association for Science Education, 28(5), 438-452.
8 Kim, D., Kim, D., Kim, Y., Kim, J., Lee, J., Seo, M., Jo, Y., Lee, K., Lee, I., Sim, J., Pae, J., Jung, G., Choi, W., & Park, Y. (2013a). A Study of the Features of Educational Achievement and Development of the National Assessment of Educational Achievement (NAEA) 2013. Korea Institute for Curriculum and Evaluation Research Paper RRE 2013-4.
9 Kim, D., Lee, I., Kim, M., Jeong, E., Kang, H., & Choi, Y. (2012). Analysis of the 2011 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2013-37-4.
10 Kim, D., Lee, I., Sim, J., Choi, W., Park, Y., & Joo, K. (2013b). Analysis of the 2012 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2013-37-4.
11 Kim, H., & Jeong, J. (2012). An Analysis of the Result of National Assessment of Educational Achievement in Science at Grade 9. Journal of Science Education, 36(2), 394-407.
12 Kim, H., Lee, I., Kim, M., Jeong, J., & Sin, M. (2011c). Analysis of the 2010 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2011-3-5.
13 Kim, K., Kim, W., Choi, I., Sang, K., Kim, H., Shin, J., Kim, J., & Sohn, W. (2011a). Characteristics of Educational Academic Improvement from NAEA(National Assessment of Educational Achievement) 2010. Korea Institute for Curriculum and Evaluation Research Paper RRE 2011-2-4.
14 Ministry of Education & Human Resources Development (2007). National Science Curriculum.
15 Kim, M., Kim, D., Kim, Y., Chin, J, Kim, H, Lee, B., Jo, Y., Lee, I., Kim, H., Lee, Y., & Lee, C. (2011b). A Study on the Development Process fo the National Assessment of Educational Achievement. Korea Institute for Curriculum and Evaluation Research Paper RRE 2011-3-1.
16 Lee, C., Nam, M., Nam, G., Park, E., Kim, H., Kwon, J., Choi, W., Lee, I., KIm, M., Song, M, Jeong, E., Park, J., Sin, M., Choi, J., Ko, E., & Kim, D. (2010). A Study on improving the process of developing, implementing, and scoring the National Assessment of Educational Achievement (NAEA). Korea Institute for Curriculum and Evaluation Research Paper RRE 2010-6-1.
17 Lee, I., Sim, J., Kim, H., Lee, K., Lee, B., & Jeong, I. (2014). Analysis of the 2013 National Assessment of Educational Achievement(Science). Korea Institute for Curriculum and Evaluation Research Paper ORM 2014-30-4.
18 Ministry of Education and Science Technology(MEST) (2009). National Science Curriculum.
19 National Research Council (2012). A framework for K-12 Science Education: Practices, cross-cutting concepts, and core ideas. Committee on a Conceptual Framework for New K-12 Science Education Standards. Washington DC: The National Academies Press.
20 National Research Council. (2007). Taking science to school: Learning and teaching science in grades K-8. committee on science learning, kindergarten through eighth grade. R.A. Duschl, H.A. Schweingruber, & A.W. Shouse (Eds.). The National Academies Press.