• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.11
• /
• pp.509-520
• /
• 2015

College Scholastic Ability Test(CSAT) is a primary test to evaluate the study achievement of high-school students and used by most universities for admission decision in South Korea. Because its level of difficulty is a significant issue to both students and universities, the government makes a huge effort to have a consistent difficulty level every year. However, the actual levels of difficulty have significantly fluctuated, which causes many problems with university admission. In this paper, we build two types of data-driven prediction models to predict correct answer rate and to identify significant factors for CSAT English test through accumulated test data of CSAT, unlike traditional methods depending on experts' judgments. Initially, we derive candidate question-specific factors that can influence the correct answer rate, such as the position, EBS-relation, readability, from the annual CSAT practices and CSAT for 10 years. In addition, we drive context-specific factors by employing topic modeling which identify the underlying topics over the text. Then, the correct answer rate is predicted by multiple linear regression and level of difficulty is predicted by classification tree. The experimental results show that 90% of accuracy can be achieved by the level of difficulty (difficult/easy) classification model, whereas the error rate for correct answer rate is below 16%. Points and problem category are found to be critical to predict the correct answer rate. In addition, the correct answer rate is also influenced by some of the topics discovered by topic modeling. Based on our study, it will be possible to predict the range of expected correct answer rate for both question-level and entire test-level, which will help CSAT examiners to control the level of difficulties.

• Journal of Korean Home Economics Education Association
• /
• v.34 no.1
• /
• pp.81-96
• /
• 2022

The purpose of this study was to examine the extent to which the contents of elementary and secondary curricula are connected and overlapped in the 'family life' area of Practical Arts(Technology & Home Economics) subjects. The procedure and results are as were like below. First, the types of criteria for analyzing curriculum contents are developed. The connectivity are classified as 'discontinuous hierarchy' and 'spiral hierarchy' and duplication are classified as 'repetition (high level of overlapping)', 'reproducing', 'deepening (intermediate level of overlapping)', 'substitution', and 'omission (low level of overlapping)'. Second, as a result of analyzing the contents of elementary and secondary curricula, the 'Human Development' area showed higher connectivity with a deepening type of duplication. The 'Safety' and the 'Lifelong Planning' concepts showed lower connectivity. Third, as a result of analyzing the achievement standards of the 2015 Curriculum, the secondary Home Economics curriculum showed a considerable increase in the level of difficulty and the volume compared to the elementary curriculum. There was low connectivity between the contents of elementary and secondary curricula in the core concepts 'Safety' and 'Lifelong Planning', an intermediate level of connectivity in 'Life Culture' and 'Management', and high connectivity in 'Development' and 'Relationship'. Also, there was a high level of duplication in the core concepts 'Safety' and 'Lifelong Planning', being classified as 'reproducing', 'substitution', and 'omission', analyzed to have low connectivity. When structuring the curriculum contents with a spiral hierarchy, one should connect the elementary and secondary school contents organically: the hierarchy with core concepts considering the different characters of constructuring knowledge in each school level, with a moderate volume, with a moderate difficulty level, with a moderate level of duplication of the contents, and with the minimum level of repetition of the same topics within the same school level.