• Communications of Mathematical Education
• /
• v.28 no.2
• /
• pp.195-217
• /
• 2014

The College Scholastic Ability Test(CSAT) is the Korean national university examination based on the national curriculum. The CSAT is a high-stakes test because of powerful social forces which the college admission system has in Korea. This examination has changed many times through not only the national curriculum revision but also various external factors including the normalization of public education, mitigating the burden of students, etc. This study analysis the changes of assessment contents of the Mathematics of the CSAT due to the national curriculum revision. Additionally, this study analysis the mathematics content domains of the college entrance examinations in some foreign countries. Based on the result of this analysis, this study will derive implications for improvement directions of the Mathematics of the CSAT.

• Journal of The Korean Association For Science Education
• /
• v.30 no.4
• /
• pp.452-471
• /
• 2010

As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.

• Journal of the Korean School Mathematics Society
• /
• v.26 no.2
• /
• pp.137-158
• /
• 2023

This study aimed to analyze the shifts in the mathematics domains of the College Scholastic Ability Test (CSAT) since its inception in 1993, with the intent of identifying improvements for the future. The goal is to provide insights for exploring the direction of assessment in Korean high school mathematics education. To this end, we focused on the test system, content area, and behavioral area within the CSAT mathematics domains. Key findings include: first, the test structure influences the assessment factors and item types, in addition to the examination time and number of items. Second, by analyzing the content area, we established a correlation between the national curriculum and assessment area, and confirmed the importance of setting the assessment area. Third, the examination of the behavioral area tended to the item-type fixation, demonstrating the necessity of the ongoing modifications in evaluation item types. Building upon these findings, we discuss the direction of an evaluation that considers the evolving demands and shifts within mathematics education.

• Journal of the Korean association of regional geographers
• /
• v.23 no.1
• /
• pp.195-212
• /
• 2017

This study analyzed on the content validity of the Korean geography subject evaluation questions on the College Scholastic Ability Test(CSAT) from 2014 to 2016 regarding the national curriculum achievement standards. The main results are as follows. First, from 'the knowledge dimension' aspect, both the achievement standard and the CSAT questions showed the highest ratio of 'factual knowledge'. Second, from 'the cognitive process dimension' aspect, the percentage of 'understand' was the highest in the achievement standard, whereas in the CSAT questions, the ratio of 'analyze' and complex type of 'analyze' and 'understand' was the highest. Third, in the result of the analysis of the content validity of the Korean geography CSAT questions through proportion test, all of the analysis targets showed 'a little low'. Finally, the content validity analysis showed that there was a significant difference between the main types of the achievement standards and the CSAT questions in the 'Geomorphological Environment and Ecosystem part' and 'Space of Production and Consumption part' from the cognitive process aspect, which showed relatively low content validity compared to other areas. The results of this study suggest that the achievement standards should be reflected on the Korean geography CSAT questions and it should not be focused on evaluating the learner's analysing ability.

• Journal of Fisheries and Marine Sciences Education
• /
• v.27 no.6
• /
• pp.1556-1568
• /
• 2015

The objectives of this study were to inquiry of application types and use methodology of EBS-CSAT prep books of vocation education division in specialized vocational high schools. Research participants are 8 specialized vocational high school teachers in Seoul and Gyeonggi, and subjects are basic industry and basic drawing. The teachers had using EBS-CSAT prep books in class or after-school. The results are as follows: The teachers used items explanation of after-school rather than regular classes using EBS-CSAT prep books of vocation education division in specialized vocational high schools. Online lectures were used for self-directed learning of specialized vocational high school students rather than regular classes. Students and teachers of specialized vocational high school needed EBS-CSAT prep books of vocation education division by free gift instead of EBS-CSAT prep books of Korea language, english, math.

• Journal of the Korean School Mathematics Society
• /
• v.18 no.2
• /
• pp.169-186
• /
• 2015

According to changes of college admission policies and the first application for 2009 revised mathematics curriculum, we should redefine characterization of mathematics section in 2017 College Scholastic Ability Test(CSAT) and prepare a plan on details of making questions related to it. Specially, we need to reflect the voices of the school site in order to determine the method of making CSAT questions which is consistent with the intent of it and contributes to the normal operation of high school curriculum. In this study, we polled out 312 schools among 2,338 high schools nationwide and math teachers of the schools were been chosen were surveyed. The sampling method used a proportionate stratified sampling by the department of education. Analyzing the results of the survey, We redefined characterizations and roles of mathematics section in 2017 CSAT and suggested the details including questions distribution according to optional object of 2017 CSAT mathematics section.

• Journal of The Korean Association For Science Education
• /
• v.22 no.2
• /
• pp.345-356
• /
• 2002

This study investigated the trends in the number of applicants and mean score and applicants' responses on the test items of 'science inquiry' of the College Scholastic Ability Test(CSAT) implemented for 3 years$(1999\;{\sim}2001)$. The results of this study were as follows: The percentage of applicants of science track for 1995 CSAT were 43.13%, but reduced to 29.5% for 2001 CSAT. And unlike other tracks, the percentage of male applicants, ranking above average, of science track was 65.58%, which is about twofold of female applicants(34.42%). The mean score of 'Science inquiry' was 58.6 in 1999, and 69.5 in 2001. And the score of the applicants, ranking above average, of humanity and social science course and science course, were 85.8 and 90.7 respectfully in 2001 CSAT. These high mean scores were caused by the policy of "easy CSAT" so called. Most of test items were developed to have difficulty 60-79% or above 80%. This easy CSAT provoked intense dispute about the discriminating power of CSAT. The mean score of male applicants was higher than that of female. But the difference decreases every year. Applicants were generally very good at solving tests focusing on process skills only but poor at solving tests related to physics or calling for two or more science concepts. Thus special measures to cope with the decrease in applicants, especially female applicants, for science track should be provided. To increase discriminating power of CSAT, it is recommended to develop test items with wider range of difficulty and to reduce test items which are focussing process skills and can be solved without any special science concepts. And special consideration should be given to teaching the content area with poor achievement and high actual difficulty compared to the expected.

• Journal of Korean Society for Quality Management
• /
• v.50 no.2
• /
• pp.199-220
• /
• 2022

Purpose: The purpose of this study is to analyze the score data released by the Korea Institute of Curriculum and Evaluation to find out the problems with the current scoring system provided by the College Scholastic Ability Test and to suggest improvement measures to solve these problems. Methods: We calculated the descriptive statistics of the standard scores using the frequency distribution table of the standard scores and identified the characteristics of the standard scores by expressing the distribution as a graph. Also, we developed an index to evaluate whether each stanine level was stably assigned and calculated the indexes for each area/subject by using the data on the number of examinees for each level. Results: We found that the relationship of conversion from raw scores to integerized standard scores is different depending on the size of the standard deviation of the raw scores, and identified the problem that the raw score information is not fairly reflected in the calculation of the percentile and level as the two raw scores are converted to one standard score. This problem can be solved by calculating the standard score to a decimal point. Conclusion: In this study, as a way to improve the quality of the scores of the current CSAT, the standard score and percentile decimal notation, the specific regulations of the standard score and stanine level calculation method, and the expansion of the open range of the scores were suggested.

• Journal of Fisheries and Marine Sciences Education
• /
• v.25 no.5
• /
• pp.1148-1164
• /
• 2013

The purpose of this study was to inquiry of perception on outcomes and challenges of vocational education division CSAT by industry department teachers of specialized vocational high school. Therefore, it is highly desirable that researchers to survey what are the biggest outcomes of vocational education division CSAT and positive ripple effects of outcomes, what are the biggest challenges of vocational education division CSAT and importance of challenges undertaken 10 years. The survey included 100 industry department teachers of specialized vocational high school on 9 region from Korea. The analysis of survey results was by regions, industry department teacher's career of specialized vocational high school. The results are as follows. The biggest outcomes of vocational education division CSAT was extension of opportunity on continuing education and supply a demand for entrance university on specialized vocational high school students. The biggest positive ripple effects of the outcomes was also extension of opportunity on continuing education and supply a demand for entrance university on specialized vocational high school students. The biggest challenges of vocational education division CSAT and importance of challenges was not to use vocational education division CSAT score for the entrance on the most universities.

• Journal of the Korean Geographical Society
• /
• v.49 no.3
• /
• pp.472-487
• /
• 2014

This study aims to analyze the characteristics of GIS-related test items of high school Korean Geography in the 7th National Education Curriculum, and to discuss some issues and challenges. First, we developed a framework for analyzing test items based on the literature review and the content analysis on the textbooks, which categorizes test items in terms of content elements and activity elements. Then, we examined test items of nation-wide tests including CSAT(College Scholastic Ability Test) carried out 2004-2012 and analyzed the percentage of correct answers as well. According to the results, there was a significant predominance of particular test item categories, and the percentage of correct answers of GIS-related items was slightly higher than whole average but it depended on the test item categories. Finally, we discussed the implications of this analysis to the tests as well as the teaching-learning process in the classroom, and suggested improvement directions such as integration of GIS with other contents, reinforcement of the inquiry-based test items, maintaining moderate difficulty.