• The Journal of Korean Association of Computer Education
• /
• v.9 no.6
• /
• pp.11-18
• /
• 2006

The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.4
• /
• pp.39-49
• /
• 2007

The purpose of this study is to provide analysis resources to develop high standard questions by analyzing item characteristics and item usability of 'Basic course of Information Technology' in the College Scholastic Ability Test, For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty, item discrimination, item reliability, and distracters. As a result of analyzing tests in 2005 and 2006, questions were equally extracted from educational contents. However, the standard of questions were in need of revision. The development of high quality contents in Vocational Education Section was needed in order to meet to the College Scholastic Ability Test standards. Therefore, it is required to develop various difficulties and acceptable distinguishable questions.

• Communications for Statistical Applications and Methods
• /
• v.17 no.3
• /
• pp.327-335
• /
• 2010

Item response theory provides a fixed results about students, regardless of the item difficulty and discrimina-tion and it is also a kind of item analysis methods which provides the same proper competence scores to students in spite of them taking different test repeatedly. In this paper, we researched item difficulty and item discrimina-tion and analyzed items in the national academic aptitude test which were given from 2000 to 2009 in the past 10 years through item response theory, especially, in connection with given items about statistical unit. As a result, we found that about 60 percents of the items were too difficult for high school students to solve, however, item discrimination proved to be great.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.818-828
• /
• 2010

It has already been 17 years since the first implementation of the Korean College Scholastic Ability Test (CSAT). Having been administered so many CSAT tests including practice tests, criticisms have been made against CAST tests being stuck to the same pattern and focusing mainly on knowledge-based items. To address this issue, we analyzed the chemistry items of the Japanese National Center Test for University Admissions (NCTUA) administered in January of 2009 with regard to content factors, behavioral domains, item types, and noted any peculiarities in comparison to CSAT. Also, we estimated the predicted percentage of correct answers from the perspectives of Korean candidates to arrive at implications for chemistry items of CSAT.

• Communications for Statistical Applications and Methods
• /
• v.1 no.1
• /
• pp.215-225
• /
• 1994

1994년도부터 새로 실시된 대학입시 본고사를 위한 고려대학교 출제관리위원회의 활동을 통계적 측면에서 보고한다. 특히 모의고사의 문항분석과 선택과목 등화(표준점수제)에 관한 통계적 방법론을 중점적으로 다루고 그 성과에 대하여 논의한다. 이 실증적 사례 연구가 새로 대학입시 본고사를 실시하는 타 대학에 실질적 도움이 되기를 희망한다.

• Proceedings of the Korea Society of Elementary Mathematics Education
• /
• 2010.08a
• /
• pp.157-172
• /
• 2010

본 연구는 현행 초등학교에서 이루어지고 있는 서술형 평가의 유형과 문제점을 분석해 보고 2007개정 교육과정에 따른 수학과 서술형 예시 평가 문항을 개발해 보는데 목표가 있다. 학교에서 시행되고 있는 평가 자료의 분석은 수학교과서, 국가수준 학업성취도 평가지, 서울시 교육청 보급 2010 장학자료집, 서울시내 학교에서 시행되고 있는 평가 문항을 분석해 보았다. 그리고 예시 서술형 평가 문항개발은 2007개정 교육과정에 따른 수학과 4학년을 대상으로 하였다. 평가 문항 분석의 결과는 문항 유형이 단순하고 교과서와 장학자료집의 수준을 벗어나지 못하고 있으며 창의성 영역의 평가는 거의 이루어지고 있지 않았다. 서술형 예시평가 문항의 개발은 수학과의 내용영역과 인지적 영역뿐 아니라 교육계의 화두가 되고 있는 창의성 영역까지 평가내용으로 포함시키고자 노력하였으며 영역별 1-2 문항을 개발하였다.

• Proceedings of The KACE
• /
• 2018.01a
• /
• pp.107-110
• /
• 2018

본 연구에서는 컴퓨팅 사고력 평가도구로써 비버 챌린지 문항을 활용하기 위하여 문항반응이론을 통해 비버 챌린지 문항을 분석하고, 비버 챌린지에서 기존에 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계를 분석하였다. 분석 결과 비버 챌린지는 쉽고 변별력이 높은 검사로 나타났으나, 비버 챌린지에서 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계는 없었다. 난이도에 따라 가점과 감점이 이루어지는 비버 챌린지 채점 기준을 고려할 때 정확한 컴퓨팅 사고력 측정을 위해서는 난이도에 대한 수정 및 보완이 필요하다.

• Education of Primary School Mathematics
• /
• v.15 no.1
• /
• pp.13-29
• /
• 2012

This study is the analytic research of items having gender gap in 6th grade students in 'National Assessment of Educational Achievement(NAEA)'. For this problem solving, the following was investigated. First, items having gender gap were selected in NAEA for the past eight years. Then, the mathematical factors that cause gender gap were analyzed. Second, to do this the field test was developed using item concept map. Finally, after the analysis of field test result the reason of gender gap was deduced. Through this study the improvement of mathematics teaching and learning method in elementary school is expected.

• Journal of the Korean Chemical Society
• /
• v.54 no.3
• /
• pp.329-337
• /
• 2010

In this study, we analyzed the end-of-chapter questions in 8 types of chemistry II textbooks for science teachers according to revised Bloom's taxonomy of educational objectives not only to raise interests of questions in textbooks but also acquire a basic material for using questions in textbooks effectively. The results of classification following Bloom's cognitive category showed that 'Understanding(44.7%)' level was the most, then 'Application(29.9%)', Knowledge(15.6%) and 'Analysis (9.5%)' in order, which is distinct difference from the result of classification of the end-of-chapter questions in college general chemistry books which was 'Application', 'Analysis' and 'Understanding' in order. Especially, questions of 'Evaluation' level were not found at all in any textbook investigated and 'Synthesis(0.3%)' level was very few. On the other hand, the percentage of questions in 'Understanding' and 'Executing Quantitative' which required specific algorithms was 70% of total with most of the questions in 'Application' were 'Executing Quantitative'.