• Journal of Educational Research in Mathematics
• /
• v.25 no.3
• /
• pp.281-302
• /
• 2015

In the current study, answer sheets from 8007 students in 236 Korean schools were selected and analyzed to examine errors that emerge in the process of solving descriptive questions of the National Educational Achievement Assessment in mathematics. Questions used in the analysis were response assessment covering middle school mathematics topics: "mathematical symbols and equations" and "functions." The behavioral domain of the questions was that of "problem solving and computation," which requires establishing an equation for a word problem and allows the calculation of an answer that meets a certain condition. The analysis results revealed various errors in each stage of each question, from understanding to solving; the study attempts to conjecture causes for these errors and draw pedagogical implications.

• Communications of Mathematical Education
• /
• v.37 no.2
• /
• pp.233-256
• /
• 2023

This study conducted foundational research to derive ways to use ChatGPT in mathematics education by analyzing ChatGPT's responses to questions from the National Assessment of Educational Achievement (NAEA) and the College Scholastic Ability Test (CSAT). ChatGPT, a generative artificial intelligence model, has gained attention in various fields, and there is a growing demand for its use in education as the number of users rapidly increases. To the best of our knowledge, there are very few reported cases of educational studies utilizing ChatGPT. In this study, we analyzed ChatGPT 3.5 responses to questions from the three-year National Assessment of Educational Achievement and the College Scholastic Ability Test, categorizing them based on the percentage of correct answers, the accuracy of the solution process, and types of errors. The correct answer rates for ChatGPT in the National Assessment of Educational Achievement and the College Scholastic Ability Test questions were 37.1% and 15.97%, respectively. The accuracy of ChatGPT's solution process was calculated as 3.44 for the National Assessment of Educational Achievement and 2.49 for the College Scholastic Ability Test. Errors in solving math problems with ChatGPT were classified into procedural and functional errors. Procedural errors referred to mistakes in connecting expressions to the next step or in calculations, while functional errors were related to how ChatGPT recognized, judged, and outputted text. This analysis suggests that relying solely on the percentage of correct answers should not be the criterion for assessing ChatGPT's mathematical performance, but rather a combination of the accuracy of the solution process and types of errors should be considered.

• School Mathematics
• /
• v.2 no.1
• /
• pp.73-95
• /
• 2000

In this study, on the basis of the seventh national mathematics curriculum, the achievement standards were developed to specify the objectives and contents of teaching-learning at the first and second elementary school mathematics. The assessment standards were also developed to differentiate students’ levels of achievement with ‘high’, ‘mid’ and ‘low’ categories. Furthermore, this stuffy suggested the exemplary test items including short-answer and open-ended questions while putting emphasis on students' real performance to increase their ability in solving problems rather than in calculating. In addition to the test items, it introduced the grading system developed to grade the items with concrete guidelines and to report students' achievement on doing mathematics.

• Journal of the Korean earth science society
• /
• v.32 no.5
• /
• pp.504-513
• /
• 2011

In this study, we investigated how elementary science teaching has changed with the introduction of the National Assessment of Educational Achievement (NAEA). Teachers are held accountable for student performance as measured by the mandatory nation-wide standards tests to satisfy the needs of accountability and quality assurance systems. In relation to the teaching of science in the elementary school, professionalism meets potential threats with the advent of national test. Through analysis of the classroom teaching and open-ended interviews, we explored the teacher's concerns about the national test and how their science classes have changed to prepare for this test. According to the results, the national test made elementary teachers accountable for the content of their science classes, limits teachers' autonomy in reconstruction of curriculum, and forced teachers to conduct conclusion-centered lessons even in elementary science classes. In addition, teachers argue that the national test precludes the possibility of differentiated education and differentiated assessment. Based on the results, we suggested a new professionalism in this accountability era, so called 'informed professionalism', which refers to the ability of teachers to interpret and implement curriculum and policy mandates at the local, school and classroom level to generate equitable and improved student outcomes through teaching and learning. We also suggested further research on the teacher professionalism in teaching science contents.

• Journal of the Korean Chemical Society
• /
• v.66 no.6
• /
• pp.493-508
• /
• 2022

Chemistry is the subject which includes properties, change, and composition of matter. Chemistry has the system which explains observable properties and change with microscopic level, it explains them using scientific theory and laws. In the national-level curriculum, the properties and changes of matter are continuously dealt with from elementary school to high school, and the curriculum are organized so that students could strengthen their understanding about matter. In other words, understanding of the properties and changes of matter is the base to explain everyday life with the view of chemistry, and these two are classified as domains of chemistry in the 2015 revised science curriculum. In this study, we confirmed students' understanding about properties of matter and change of matter, through the analysis about results of the National Assessment of Educational Achievement (NAEA). For that purpose, this study analyzed the 12 items about properties of matter, and 19 items about change of matter, which were used in the NAEA from 2015 to 2019. According to the results of classifying and analyzing questions according to the core concept, the understanding about the two domains significantly changed between the proficient achievement-level students and basic achievement-level students. Depending on the achievement-level, there was a difference in explaining the phenomenon by using the perspective of particles, and by associating scientific concepts and models, or there was a difference in understanding the inquiry related to these two domains. Based on this analysis, this study discussed some implications to be improved on teaching-learning for 'properties of matter', and 'change of matter'.

• Journal of the Korean Chemical Society
• /
• v.66 no.2
• /
• pp.136-149
• /
• 2022

Chemistry focuses on explaining macroscopic phenomena at the microscopic level with particles, such as atoms or molecules. Explanation using particles are bound to be considered as abstract by students, because it was dealing with invisible objects. For that reason, the science national curriculum presented to middle school students the explanation of the units related to the composition of matter. Therefore, understanding about the composition of matter in middle school students becomes an important basis for learning of chemistry, and it is necessary to investigate their understanding about composition of matter. In this study, students' understanding about 'composition of matter' region, which is first presented to middle school students, was confirmed at an overall level. In this line, this study analyzed the results of the items in the composition of matter region, and analyzed items were used in the National Assessment of Educational Achievement (NAEA) from 2015 to 2019. We analyzed the 9 items presented in the NAEA according to the response rate of options and response rate distribution curve, and explained the characteristics of understanding derived by each achievement level were examined. According to the analyzed results by dividing the conceptions about elements, atoms, and ions, students above the proficient achievement-level had scientific conceptions overall, but students below the basic achievement-level had inconsistent or naive conceptions. Based on the results for each item, this study discussed some implications to be considered or to be improved on teaching-learning for 'composition of matter'.

• Communications of Mathematical Education
• /
• v.32 no.3
• /
• pp.435-453
• /
• 2018

The results analysis of National Assessment of Educational Achievement(NAEA) can provide various implications for teaching and learning in the school field. In this study we analyzed the deviation of NAEA achievement level-based correct-answer rate and the distribution of the responses percentages for three years from 2015 to 2017 focused on multiple-choice items. First we calculated the deviation of correct-answer rate between advanced level and proficient level and between proficient level and basic level, and then we selected the items whose deviation of correct-answer rate is more than the third quartile. We explored what the content areas, behavior areas and achievement standards of each item are and what the achievement standards and characteristics of these questions are. Based on the results of the analysis, we intended to derive implications for appropriate teaching-learning methods at each achievement-level.

• The Journal of Korean Institute of Information Technology
• /
• v.16 no.12
• /
• pp.115-125
• /
• 2018

The one of goals of the 2015 revised national curriculum is the successful application of achievement standards-based assessment, which assesses both the results and process of learning, ensuring that all students have achieved the educational objectives, to schools. Therefore, an achievement standards and evaluation support system is required to manage a whole process of teaching and learning based on achievement standards and provide the personalized assessment feedback to students to improve their achievement levels. In this paper, we perform a design of integrated data model and system of teaching plan, subject content, assessment plan, assessment result, and feedback data is required based on an achievement standards repository. In addition, we create a student's dashboard webpage, which representing different types of achievement of the student, and perform the comparative analysis of data models to evaluate the quality of the proposed model.

• Journal of The Korean Association For Science Education
• /
• v.42 no.1
• /
• pp.149-160
• /
• 2022

Comparative studies using large-scale data such as TIMSS, PIRLS, and PISA inform us of the effectiveness of each educational system. Even though samples in the large-scale studies were representative, admitting potential discrepancy when applying the findings of the large-scale studies to local educational system is still needed. This study examines the structural relationship among students' attitude towards science, learning support from teachers, school life, and science academic achievement with both large-scale data and local comparative study data utilizing same variables. Responses on the TIMSS 2019 of 5,554 Korean seventh-grade students and National Assessment of Educational Achievement (NAEA) 2019 of 6,365 third-grade middle school students were used. The results indicate that: a) school life did not affect the science achievements in both data. However, in NAEA 2019, students' attitude mediated the relationship between school life and science achievement; b) learning support from teachers had a significant impact on TIMSS science achievements, and also had positive effect on achievement through students' attitude in TIMSS. On the other hand, learning support had a positive effect on achievement only when student's attitude mediated the relationship in NAEA; c) students 'attitude toward science had positive effect on science achievement on both data; d) the impact of gender was different on school life, academic achievement, students 'attitude towards science, and learning support from teachers on both data; and e) the impact of the number of books differed as well. There were differences in results between the international and domestic research, which inform us that we need to pay attention when interpreting the domestic environment through the results of international research.

• The Journal of Korean Association of Computer Education
• /
• v.11 no.5
• /
• pp.9-17
• /
• 2008

In this study, the achievement standards of the "Construction and Operation of Infomation unit were established as the revision of the middle school Infomatice Curriculum in 2007. Based upon archievement standards, the assessment standards were made. And the exemplification was presented for it. The levels of the achievement unit were set in the small unit level through the understanding and the analysis of the new curriculum. The achievement standards were stated in the point of views of the students. The assessment standards divide students' achievement into three level(high/middle/low) and state each level so that it can guide evaluation of achievement. Considering the education environments, the time of the course, and the students' levels, the achievement and assessment standards can be reconstructed and would be used. Before the application of the revised Informatics curriculum, we intend for the understanding about new curriculum to be improved and for the informatics of educational activities to be advanced in quality.