• Journal of the Korean association of regional geographers
• /
• v.11 no.5
• /
• pp.474-487
• /
• 2005

This paper aims to provide empirical evidence required to describe the level of achievement by analyzing students' item response in NAEP implemented in the United States in 2001. The geography assessment in the NAEP is aimed to test students of 4th, 8th, and 12th grades, and consists of content dimension and cognitive dimension, The former includes 'space and place' 'environment and society' and 'spatial dynamics and connections,' and the latter includes 'knowing' 'understanding' and 'applying,' The level of achievement is defined as three levels for each grade: Basic, Proficient, and Advanced. In this paper, descriptions of achievement is derived inductively from an analysis of student's responses to the items which were selected by using item-mapping method. As a result, there is a great difference between the level of achievement derived empirically from students' response and the level of achievement designed principally suggested by the expert committee. The former could have a contribution to the improvement in geography curriculum.

• Communications of Mathematical Education
• /
• v.22 no.2
• /
• pp.109-124
• /
• 2008

A characteristic of the national mathematics curriculum revised in 2007 is to repeal the level-oriented individualized curriculum and choose substance of individualized teaching and learning based on the student's achievement level and quality. To do this we first have to think through how to compare students' achievement and differentiate classes. In this paper, we introduce the (modified) Angoff method as a method for comparing students' achievement and the concept of representative items for each achievement level in the National Assessment of Educational Achievement of Mathematics, and discuss how to use them in individualized teaching and learning, especially comparing students' achievement.

• Journal of Educational Research in Mathematics
• /
• v.14 no.4
• /
• pp.387-401
• /
• 2004

The recent international comparative studies such as PISA(Program for International Student Assessment) and TIMSS-R(Third International Mathematics and Science Study-Repeat) provide results of relative mathematics achievement of participating countries. The purpose of this paper is to compare the mathematics results of PISA and TIMSS-R. To make PISA and TIMSS-R results comparable, they were standardized. The close investigation of these standardized results reveals that the two Asian countries(Korea and Japan) and several English speaking countries have the commonality in mathematics achievement. Thus this study looks for patterns and similarities within a group of Asian countries(Korea and Japan) and Western countries(the U.S and Australia) by in-depth analysis of PISA mathematics achievement based on item response theory. As a result, it was noted that Western countries tend to perform well on open constructed items and are likely to perform better when an item involves less formal mathematics. On the other hand, Asian countries perform well when an item involves numeric or algebraic computation related to curriculum-based content, but they are relative poor at an item calls for verbal explanations or interpretations of graphs.

• Journal of the Korean Chemical Society
• /
• v.57 no.1
• /
• pp.127-137
• /
• 2013

We investigated student's characteristics in each educational achievement level using the results of the NAEA (National Assessment of Educational Achievement) in 2009 and 2010 for Grade 9 students. The analysis of representative items of each educational achievement level revealed that (a) advanced level students could explain the change in phenomena with both the characteristics of matter and the model, (b) proficient level students could explain only simple phenomena with the model, and (c) basic level students did not understand the model and were therefore unable to use it to explain phenomena.

• The Mathematical Education
• /
• v.53 no.2
• /
• pp.219-237
• /
• 2014

In this study we desire to deduce implications for mathematics curriculum, teaching- learning, and evaluation from the data of Nation Assessment of Educational Achievement. For this, first we extracted the items written by the same achievement standard over two years from 2010 to 2012. Next we investigated whether the items are the representative items of a certain proficiency level and classified into the case of the items of the same proficiency level and the case of the items of different proficiency levels. Based on these we analysed learning characteristic of the each proficiency level. From the results of the above, we proposed what should be changed in mathematics curriculum, what should be considered in teaching-learning, and what should be paid attention to test item development.

• Journal of the Korean School Mathematics Society
• /
• v.19 no.4
• /
• pp.441-457
• /
• 2016

The purpose of this study is to analyze Korean students' mathematics achievement characteristics and draw implications for better math education in schools through comparing the results of three east Asian top level countries, Korea, Singapore, and Japan in PISA 2012 results. As a results, the rate of correct answers of Korea students was relatively low compared with those of Singapore, but relatively higher than Japan. From the results of effect size, similar results from t-test was discovered. As shown in analysis according to sub-elements in math assessment framework, the Korean students had low effect size in every sub-elements than Singapore. and they had high effect size at most of sub-elements than Japan, except "personal" context. In top performing level(above level 5), the Korean students had high effect size at "quantities" in mathematical contents, and "employ" in mathematical processes compared with Singapore. And they had row effect size at 6 sub-elements compared with Japan.

• Journal of The Korean Association For Science Education
• /
• v.33 no.6
• /
• pp.1186-1201
• /
• 2013

We investigated student's characteristics in each educational achievement level using the results of the NAEA (National Assessment of Educational Achievement) in 2009, 2010, and 2011 for Grade 6 students, and compared the characteristics between elementary and middle school students. The analysis of representative items for each educational achievement level of elementary and middle school students revealed that (a) advanced level students from both elementary and middle school could exactly understand the achievement criteria of the curriculum, (b) proficient level students from both elementary and middle school were understanding the achievement criteria of the curriculum superficially, for example, they could not understand concepts exactly but could memorize terms, and so should have compensational education under situations that ask for short answer or essay type items instead of multiple choice items, and (c) basic level students from both elementary and middle school almost could not understand the achievement criteria of curriculum, and so should have compensational education under situations that only deal with a simple situation. Science concepts treated in science curriculum are hierarchically organized by level of school, and simple compensational education for the students of below basic level will not solve learning deficits in science education. Differentiated education by educational achievement should be largely expanded instead.

• Journal of The Korean Association For Science Education
• /
• v.40 no.5
• /
• pp.473-483
• /
• 2020

The purpose of this study was to analyze the characteristics of students' academic achievement of middle school science curriculum achievement standards in the 2009 revised national curriculum and to generate implications for curriculum improvement. Based on the results of the 2015-2018 National Assessment of Educational Achievement (NAEA), we analyzed middle school students' mastery of 84 curriculum achievement standards. In the analysis, we used representative item information by achievement level and correct answer rate and checked the validity of the determination of mastery. According to the results of the analysis, 15 of the 84 achievement standards could not determine the degree of achievement. In science, many achievement standards could be mastered only by above-average group students. By achievement level, there were six achievement standards that advanced achievement-level students did not achieve, 38 achievement standards judged to represent mastery by advanced achievement-level students, 23 achievement standards judged to represent mastery by proficient achievement-level students, and two achievement standards judged to represent mastery by basic achievement-level students. By content area, the number of achievement standards corresponding to advanced and proficient levels was similar in the areas of motion and energy and earth and space domains. In the material and life domains, there were more achievement standards corresponding to advanced levels. Accordingly, it is necessary to reinforce customized teaching and learning activities in relation to achievement standards that were under-achieved.

• Journal of The Korean Association For Science Education
• /
• v.19 no.2
• /
• pp.185-193
• /
• 1999

The long term trend of studensts' science achievement is a very important factor to check the effectiveness of science educational policy. However, up to date no such effort to understand the trend of Korean students' science achievement has been put into action. Recently, the Science Education Center in Korea National University of Education has been attempted to collect nation wide data for students' science achievement. The first part of the effort was to develop item pools. This study was the second part to collect nation wide data and to check any change during the two year time interval. In this study, the item pools developed by Kwon et. al.(1998) were used with some modification. The data were collected two times; February 1997 and March 1999. The subjects collected nationally were 8,766 students in 1997 and were 4,398 in 1999. The subjects were collected randomly but stratified by region and sex. As the results, the trends of achievement change during the two years were different from elementary to high school. The achievement scores were decreased in elementary schools and increased in high school. In case of middle schools, the change was not significant. However, even in elementary schools the knowledge on theory was increased significantly while knowledge on facts and principles were decreased. In contrast, the knowledge on fact showed the most increase in high schools. In this study, the data were analysed in light of region, sex, behavioral objective levels(ability) and context of test items. The science achievement monitoring system developed by the Science Education Center in Korea National University of Education can be an effective tool for monitoring students' achievement on the national level.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.11
• /
• pp.509-520
• /
• 2015

College Scholastic Ability Test(CSAT) is a primary test to evaluate the study achievement of high-school students and used by most universities for admission decision in South Korea. Because its level of difficulty is a significant issue to both students and universities, the government makes a huge effort to have a consistent difficulty level every year. However, the actual levels of difficulty have significantly fluctuated, which causes many problems with university admission. In this paper, we build two types of data-driven prediction models to predict correct answer rate and to identify significant factors for CSAT English test through accumulated test data of CSAT, unlike traditional methods depending on experts' judgments. Initially, we derive candidate question-specific factors that can influence the correct answer rate, such as the position, EBS-relation, readability, from the annual CSAT practices and CSAT for 10 years. In addition, we drive context-specific factors by employing topic modeling which identify the underlying topics over the text. Then, the correct answer rate is predicted by multiple linear regression and level of difficulty is predicted by classification tree. The experimental results show that 90% of accuracy can be achieved by the level of difficulty (difficult/easy) classification model, whereas the error rate for correct answer rate is below 16%. Points and problem category are found to be critical to predict the correct answer rate. In addition, the correct answer rate is also influenced by some of the topics discovered by topic modeling. Based on our study, it will be possible to predict the range of expected correct answer rate for both question-level and entire test-level, which will help CSAT examiners to control the level of difficulties.