• Journal of Elementary Mathematics Education in Korea
• /
• v.16 no.1
• /
• pp.63-95
• /
• 2012

Since performance assessment was implemented for 10 years, a survey has been carried out from 212 elementary school teachers in Seoul area in terms of their perception and status about descriptive assessment. As results, most of teachers agreed strongly that using constructed-response items is necessary for assessment, and they showed that purpose of using constructed-response items in their mathematics classrooms was to evaluate accurately student achievement in accordance with learning objectives in mathematics and they referred mainly to items which they modified from problems or items in the textbook when they generate constructed-response items. In addition, they considered level of difficulty in creating constructed-response items mostly. Moreover, they indicated that the effects of assessment through constructed-response items would be improvement of students' problem solving and reasoning skills.

• Journal of the Korean School Mathematics Society
• /
• v.17 no.2
• /
• pp.275-290
• /
• 2014

This study aims to examine how secondary mathematics teachers perceive and how they use constructed-response assessment in their mathematics classrooms. For this purpose, we conducted a survey in Seoul, Inchun, and Gyeonggi-do; 189 teachers participated in the survey. Results from the data analysis suggest as follows: a) the secondary mathematics teachers participated in the survey seem to consider the primary goals of assessment through constructed-response items as evaluating student achievement and the development of students' thinking and creativity; b) the teachers perceive that constructed-response assessment would promote students' mathematical thinking and problem solving skills; c) in general, constructed-response items were included in both performance assessment(less than 20 percent) and paper-and-pencil test(20 to 40 percent); and d) constructed-response items were primarily used as a part of regular examination, rather than as an independent assessment.

• Journal of the Korean Geographical Society
• /
• v.47 no.6
• /
• pp.934-954
• /
• 2012

Constructed-response items are useful to estimate a higher-order thinking abilities such as sense of place, graphicacy, and geographical imaginations which are aimed by geography education. This study aims to identify the conception of the constructed-response items, to classify those feasible items in geography education, and to propose some comments and suggestions for development and application in Korea. The author tries to classify the constructed-response items by analyzing the NAEP items in the formal aspect and the aspect of cognitive dimension respectively. In the formal aspect, they are classified as 'question-standalone' type and 'material-presenting' type. In the aspect of cognitive dimension, they are classified into three types as 'knowledge-requirement', 'understanding-requirement', and 'applying-requirement'. Some comments and suggestions are as follows. First, it is necessary to develope the constructed-response items that coherent to both content and cognitive dimensions. Second, it is required for students who take an examination to use a great variety of graphics, photos, thematic maps related to geography. Third, we need to inquire the rubric, grade, process to scoring because they are vital to success of the constructed-response items.

• Journal of the Korean School Mathematics Society
• /
• v.16 no.1
• /
• pp.63-86
• /
• 2013

This study aimed to explore how middle school students perceive constructed-response items and how they solve those items and the patterns of the processes. For this purpose, data were collected from middle school students through survey, written responses on those items that were developed for this particular purpose, and interviews. The survey data were analyzed by using Excel and the written responses and interview data qualitatively. The findings about the students' perceptions about the constructed-response items suggested that the middle school students perceive the items primarily as involving writing solutions logically(17%) and being capable of explaining while solving them(7%). The most difficulties they encounter when solving the items were understanding(26%), applying(12%), mathematical writing(25%), computing(23%), and reasoning(14%). The findings about the students' mathematical proficiencies showed that they made an error most in reasoning (35%), then in understanding(31%), in applying(9%), and least in computing(3%).

• The Journal of Korean Association of Computer Education
• /
• v.17 no.2
• /
• pp.39-51
• /
• 2014

In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

• Journal of the Korean School Mathematics Society
• /
• v.16 no.4
• /
• pp.899-925
• /
• 2013

The purpose of this study was to examine how constructive-response questions in regular test was in aligned with the nature and goals of 2007 Curriculum Amendment. For this purpose, data were collected and analysed by using the framework for mathematical task and the cognitive demand of tasks suggested by Smith & Stein(1998) and mathematical proficiency suggested by National Research Council(2001). In particular, it aimed to reveal the overall picture of the level of cognitive demand and the proportion of mathematical proficiency of constructed-response items created by secondary mathematics teachers. The findings from the analysis showed that 70 percent of the constructed-response items were at low-level and the rest at high-level in terms of cognitive demand. Also, the constructed-response assessment focused on conputing (89%), understanding(45%), applying(30%) and least reasoning(17%). Most of the constructed-response items included computing and were algorithmic.

• Journal of the Korean School Mathematics Society
• /
• v.17 no.3
• /
• pp.409-435
• /
• 2014

This study examines relations between the 5th graders' fraction operation skills and error types on constructed-response items. As results, first, the participants have lower fraction operation skills on 'multiplication of fraction' than 'addition and subtraction of fraction'. Second, the participants have different error types depend on their constructed-response items. Most of error types which group with high ability made was 'leap of solving process', both groups error type with medium ability as well as low ability is 'misunderstanding of questions'. Third, the operation skills on 'addition and subtraction of fraction' have an influence on their operation skills on 'multiplication of fraction', and error types of 'understanding of questions' and 'understanding of solving process' have the most effects on the influence.

• Journal of Science Education
• /
• v.41 no.3
• /
• pp.382-404
• /
• 2017

This study aims to explore a learning progression for eight core concepts of middle school science using constructed response items in the national assessment of educational achievement (NAEA). For this purpose, a total of 7,390 responses of the 9th graders on 8 constructed response items in NAEA conducted in 2015 were inputted by computer and the inputted answers were analyzed and classified into different levels. After completing this process, five levels were set for each construct and a construct map was created according to the levels. In this study, the construct map was written in a progression-based rubric format, which was used as a criterion for leveling the answers of all students. In addition, the Rasch model was applied to measure the scores and achievements of the respondents by means of statistical analysis to correlate the scores of the students with the achievement levels of the constructs. Lastly, a preliminary learning progression was created by revising the construct map reflecting the results of Rasch model application. This study was meaningful in that it explored the possibility of developing the learning process by using constructed response items in NAEA. However, the preliminary learning progression developed in this study is still hypothetical and inferential because it is not longitudinally traced to individual students. Therefore, it is necessary to continually revise and supplement through iterative research process.

• Journal of Educational Research in Mathematics
• /
• v.23 no.3
• /
• pp.389-406
• /
• 2013

The purpose of this study is to analyze eighth grade students' errors in the constructed-response items to improve teaching and learning of mathematics in schools. By analyzing 99 students' responses to nine constructed-response items, we found several types of students' errors in their responses to the assessment items involving with mathematical reasoning and representations, problems within realistic contexts, and mathematical connections. Not only a single error but also multiple errors (a combination of two or more types of errors) were discovered. In particular, high achieving students showed more simple errors than multiple errors while low achieving students had more multiple errors in various kinds.

• Journal of Korean Elementary Science Education
• /
• v.32 no.4
• /
• pp.423-436
• /
• 2013

This research purports to analyze released items and G4 students' science achievement from TIMSS 2011 according to their academic achievement levels and gender. By doing so, it aims to draw educational implications for Korea from analyses results. Korea showed a lower rate of students at the advanced international benchmark - the highest achievement level - compared to Singapore. The difference was the smallest in Life Science among three content domains and knowing among three cognitive domains. The results of analysis according to gender showed that male students' achievement was significantly higher in Physical Science and Earth Science, and their achievement was also higher in the cognitive domains of Knowing and Applying. From the analysis of the released items, it was revealed that the students' achievement was low in items related to classification of organisms, functions of heart, matters that combust or emit light, and the concept of rotation. Moreover, students drew some illogical conclusions based on their personal experience. Male students were found to show high achievements in items that were not included in curriculum, constructed-response items in the form of short-answer questions, and multiple-choice items in the Knowing domain. Female students were found to show high achievement in items that were included in curriculum, constructed-response items that require reasons and methods, and items that represent experimental situations. Male students showed high achievement in forces concept and movements concept of bodies in the universe, while female students showed high achievement in solubility concept.