Communications of Mathematical Education (한국수학교육학회지시리즈E:수학교육논문집)

Korean Society of Mathematical Education (한국수학교육학회)
권호 표지
DOI QR코드

DOI QR Code

The Characteristic Analysis of Content Areas and Behavioral Areas Based on the Deviation of NAEA Achievement Level-Based Correct-Answer Rate

국가수준 학업성취도 평가의 성취수준별 정답률 편차에 따른 내용 영역과 행동 영역 특성 분석

  • Received : 2018.09.07
  • Accepted : 2018.09.19
  • Published : 2018.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The results analysis of National Assessment of Educational Achievement(NAEA) can provide various implications for teaching and learning in the school field. In this study we analyzed the deviation of NAEA achievement level-based correct-answer rate and the distribution of the responses percentages for three years from 2015 to 2017 focused on multiple-choice items. First we calculated the deviation of correct-answer rate between advanced level and proficient level and between proficient level and basic level, and then we selected the items whose deviation of correct-answer rate is more than the third quartile. We explored what the content areas, behavior areas and achievement standards of each item are and what the achievement standards and characteristics of these questions are. Based on the results of the analysis, we intended to derive implications for appropriate teaching-learning methods at each achievement-level.

국가수준 학업성취도 평가의 결과 분석은 학교 현장에 교수 학습 측면에서 다양한 시사점을 제공해 줄 수 있다. 본 연구에서는 2009 개정 수학과 교육과정이 중학교 국가수준 학업성취도 평가에 적용된 2015년부터 2017년까지 3개년 동안의 국가수준 학업성취도 평가의 답지 반응 분포와 성취수준별(우수학력, 보통학력, 기초학력) 정답률 편차를 분석하였다. 우수학력 수준과 보통학력 수준, 보통학력 수준과 기초학력 수준 사이의 정답률 편차를 계산하고 편차의 누적백분율 제3사분위수 이상의 문항을 선별한 후, 내용 영역과 행동 영역은 무엇이며 이러한 문항들의 성취기준 및 특성들을 탐색하였다. 분석 결과를 토대로 성취수준별 교수 학습 방법에 대한 시사점을 도출하고자 하였다.

Keywords

References

  1. Ko, S. G., Yang, W. Y. and Oh, H, S. (2008). New General Statistics. Seoul: Kyowoosa.
  2. Ko, J. H. (2008). An Analysis of the Characteristics of the Below-Basic Students in the Grade 3 National Diagnostic Assessment of Basic Competency. The Journal of Educational Research in Mathematics, 18(3), 283-308.
  3. Ministry of Education and Science Technology (2011). Mathematics Curriculum. Bulletin of MEST No.2011-361 [Seperate Volume #8].
  4. Ministry of Education (2013). The Basic Plan Announcement for 2017 National Assessment of Educational Achievement. Press release of MOE(2013.04.24.).
  5. Ministry of Education (2015). Mathematics Curriculum. Bulletin of MOE No.2015-84 [Seperate Volume #8].
  6. Ministry of Education (2017). The Result Announcement for 2017 National Assessment of Educational Achievement. Press release of MOE(2017.11.20.).
  7. Kwon, J. R. (2012). Comparison on proficient level and below basic level students' mathematical achievement in the National Achievement Evaluation and Assessment. J. Korean Soc. Math. Ed. Ser. E, 26(1), 29-50.
  8. Kim, K. H., Kim, W. S., Kim, J. H., Choi, I. B., Park, I. Y., Sin, J. A., Song, M. Y., Kim, H. K., Kim, D. Y., Kim, M. K., Sin, D. K., Lee, I. H., Choi, I. S., Han, K. T. & Han, J. A. (2013). The Introduction Method for Computer-Based National Assessment of Educational Achievement. KICE, DRE 2013-5.
  9. Kim, M. S., No, K. H., Park, J., Boo, J. Y., Yang, G. S. & Lee, H. Y. (1998). A Study on National Assessment of Educational Achievement. KICE, RRE 1998-8.
  10. Kim, S, J., Kim, W. S., Park, I. Y., Seo, M. H., Han, J. A., Kim, M. H., Min, S. H., Lee, B. R. & Son, J. Y. (2016). The Middle School Result of 2015 National Assessment of Educational Achievement. KICE, ORM 2016-32-1.
  11. Kim, J. C., Kim, S. H. & Kim, S. H. (2009). The Effect of the Order of Item Arrangement on Item Difficulty and Item Discrimination. Journal of Educational Evaluation, 22(2), 409-427.
  12. Do, J. H. & Ko, J. H. (2008). Representative items for each achievement level in the National Assessment of Educational Achievement of Mathematics: the concept and Use for Individualized Education. J. Korean Soc. Math. Ed. Ser. E, 22(2), 109-124.
  13. Dong, H. K., Kim, K. J., Kang, M. K., Jang, E. S., Sung, K. H., Rim, H. M., Kim, S. K., Lee, J. B., Bae, J. K., Kim, S. Y., Choi, B. T., Choi, W. H., Kim, Y. J. & Lee, G. Y. (2017a). A Study on Developing Items for 2017 National Assessment of Educational Achievement. KICE, RRE 2017-1.
  14. Dong, H. K., Rim, H. M., Kim, S. K. & Park, S. M. (2017b). The Result of Analysis for 2016 National Assessment of Educational Achievement-Mathematics-. KICE, ORM 2017-95-3.
  15. Park, D. S. (2003). Education Research Methodology. Seoul: Mooneumsa.
  16. Park, S. I., Hyun, J., Im, Y. K., Seo, H. K., Kim, Y. M., Shin, S. K., Lee, B. H. & Cheong, G. H. (1984). A Study on Program Development for Underachievers in the Middle School. KEDI, RR 84-12.
  17. Park, H. S., Park, K. Y., Kim, Y. K., Park, K. H., Park, Y. B., Kwon, H. C., Park, N. K., Back, Y. J. & Hwang, J. Y. (2004). On the Scheme to Cure the Mathematics Disliking Disposition of Underachievers in the Middle School. J. Korean Soc. Math. Ed. Ser. E, 43(2), 115-137.
  18. Bae, B. R. (2009). Modeling of Structural Equation Model: Principles and Practices. Seoul: Cheongram Publisher.
  19. Bae, J. D. and Cho, J. S. (2003). A Study on the Factors of Mathematics Underachievers in the Middle School. J. Korean Soc. Math. Ed. Ser. E, 15, 167-173.
  20. Seong, T, J. (2010). Understanding and Application of Modern Basic Statistics. Gyeonggi: Education-Science Publisher
  21. Shin, S. K., Kim, Y. M., Park, S. I., Seo, H. K. & Im, Y. K. (1984). A Study on Development of supplementary learning program for Underachievers in the Middle School. KEDI, TR 84-2.
  22. Shin, J. K., Yun, S. I. and Kim, Y. H. (2014). Efficient Teaching Method for the Underachieving Students through Level Differentiated Classes. J. Korean Soc. Math. Ed. Ser. E, 28(1), 81-96.
  23. Yang, S. H., Kim, S. K., Dong, H. K. & Park, S. M. (2018). The Primary Result of 2017 National Assessment of Educational Achievement-Middle School Mathematics-. KICE, PIM 2018-7-3.
  24. Woo, J., Kim, Y. and Shin, J. (2007). The Study on Characteristics of Operation Errors in Students with Mathematics Learning Disabilities of Elementary School. The journal of Special Education: Theory and Practice, 8(3), 575-596.
  25. Yu, J. P. (2014). Concept and Understanding of Structural Equation Model. Seoul: Hanarae Publisher.
  26. Lee, K. S. & Park, S. M. (2018). Analysis of Constructed Response Items of High School Mathematics in the 2015 National Assessment of Educational Achievement. The Journal of Educational Research in Mathematics, 28(2), 159-179. https://doi.org/10.29275/jerm.2018.05.28.2.159
  27. Lee, K. S. & Jo, Y. D. (2014). The Characteristics of Middle School Mathematics Achievement Levels Based on the Results of the National Assessment of Educational Achievement from 2010 to 2012. School Mathematics, 16(2), 237-257.
  28. Lee, K. H. & Ko, H. K. (2005). A study on Cases of Difficulty Variables in High School Mathematics Items. Journal of the Korean School Mathematics Society, 13(2), 323-343.
  29. Lee, B. J. (2013). A Comparative Analysis on Educational Achievement in Mathematics Classifying by Content Areas of th Primary and Secondary School Students. The Korean Journal for History of Mathematics, 23(4), 59-82.
  30. Lee, S. H., Lee, B. J. & Son, H. C. (2007). Estimating the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test. J. Korean Soc. Math. Ed. Ser. A, 46(4), 407-421.
  31. Lee, I. H., Lee, K. S., Rim, H. M. & Park, S. M. (2016). The Result of Analysis for 2015 National Assessment of Educational Achievement-Mathematics-. KICE, ORM 2016-31-3.
  32. Lee, C. H., Nam, M. W., Nam, G. Y., Park, E. A., Kim, H. S., Kwon, J. R., Choi, W. H., Lee. I. H., Kim, M. K. & Song, M. Y. (2010). A Study on Developing Items for 2010 National Assessment of Educational Achievement. KICE, RRE 2010-6-1.
  33. Cheong, G. H., Chae, S. H., Kim, J. C., Lee. J. G., Kim, J. H., Lee, B. J., Lee, M. K., Imm, C. B., Lee, K. H., Kim, K. H., Son, W. S., Min, B. G., Park, S. M. Cho, Y. M., Jeong, E. Y. & Kim, J. S. (2003). A Study on 2002 National Assessment of Educational Achievement(II). KICE, RRE 2003-1-1.
  34. Cho, Y. M. (2006). How to Make National Assessment of Educational Achievement Better for Managing National Mathematical Curriculum. Journal of Educational Research in Mathematics, 16(3), 199-220.
  35. Cho, Y. M., Lee, D. H. & Lee, B. J. (2004). A Study on 2013 National Assessment of Educational Achievement-Mathematics-. KICE, RRE 2004-1-4.
  36. Jo, Y. D. & Lee, K. S. (2014). Elementary school learning characteristic of each proficiency level that appears in 2010-2012 Nation Assessment of Educational Achievement. J. Korean Soc. Math. Ed. Ser. A, 53(2), 219-237.
  37. Jin, S. M. & Song, Y. M. (2007). A Case Study on the Difficulties in the Area of Function Suffered by the 3rd Grade Middle School Mathematics Underachievers. Journal of the Korean School Mathematics Society, 10(2), 187-206.
  38. Hong, E. J. and Seong, T. J. (2015). The Effect of the Order and Gender on the Accuracy of Estimation for Ability Parameters and Test Anxiety. Journal of Educational Evaluation, 28(2), 361-379.