• The Journal of Korean Association of Computer Education
• /
• v.23 no.1
• /
• pp.29-36
• /
• 2020

Various items were used as evaluation tools that identify the student's abilities accurately to confirm the completion of learning. Among them, the multiple choice item has the advantages of high objectivity and reliability in scoring, but it cannot remove the factor of guessing. In this paper, the multiple choice items are classified into two types according to the relationship between the questionnaire and the choices. One is the type used in the classical test theory with the probability of guessing 1/k for k choices and the other is the novel proposed type which introduces the concept of partial knowledge. In the proposed type, the probability of guessing when the number of knowledge i is (i+1)/k for k choices. Based on the assumptions of the previous theories about multiple choice items, we derive the guessing parameter about the proposed type. And we analyzed the effect of the guess on the correct answer in the existing type and the proposed type. This shows that the proposed type has more question guessing than the existing type.

• Journal of Science Education
• /
• v.42 no.3
• /
• pp.322-333
• /
• 2018

The purpose of this study is to identify the types and characteristics of the integrative thinking that learners with diverse learning backgrounds use in solving earth science problems. Four students in middle school were surveyed using questionnaires to know students' science learning background and test items with integrated content. A total of 200 items, 40 integrated items and 160 general items, were administered ten times. The students did not show a consistent relationship in terms of correct answer percentage in general items and that of in integrated items. In order to understand the type of integrative thinking of each student, after students solve an item, we analyzed the percentage of correct answers by types and interviewed them and analyzed the contents to identify the characteristics of the thinking used in solving each item. As a result, the types of integrative thinking used in problem solving were classified into three types, knowledge-based, real life-based, and integrated inquiry-based types. It is necessary to study various ways to improve the integrative thinking ability considering the characteristics of students in science teaching and learning.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2009.04a
• /
• pp.992-995
• /
• 2009

온라인 평가 시스템의 발전으로 오프라인을 통한 전통적인 시험에서 수준에 맞는 다양한 평가가 가능한 온라인 평가가 폭넓게 수행되고 있다. 하지만 평가문항에 대한 체계적인 유형 분류가 미흡하여 평가문항을 온라인 평가 시스템을 통해 표현하고 이기종 시스템간의 평가문항을 원활하게 공유하지 못하고 있다. 이 논문은 국내외 평가문항 유형 분류를 분석하고 온라인 상에서 평가문항을 효과적으로 표현하기 위한 명확한 문항 분류 기준을 제시한다.

• Communications of Mathematical Education
• /
• v.24 no.2
• /
• pp.445-474
• /
• 2010

The results of performing first survey after learning linear equation and second survey after 5 months to find out whether there is change in solving process while seventh grade students solve linear equations are as follows. First, as a result of performing McNemar Test in order to find out the correct answer ratio between first survey and second survey, it was shown as $p=.035^a$ in problem x+4=9 and $p=.012^a$ in problem $x+\frac{1}{4}=\frac{2}{3}$ of problem type A while being shown as $p=.012^a$ in problem x+3=8 and $p=.035^a$ in problem 5(x+2)=20 of problem type B. Second, while there were students not making errors in the second survey among students who made errors in the solving process of problem type A and B, students making errors in the second survey among the students who expressed the solving process correctly in the first survey were shown. Third, while there were students expressing the solving process of linear equation correctly for all problems (type A, type B and type C), there were students expressing several problems correctly and unable to do so for several problems. In conclusion, even if a student has expressed the solving process correctly on all problems, it would be difficult to foresee that the student is able to express properly in the solving process when another problem is given. According to the result of analyzing the reaction of students toward three problem types (type A, type B and type C), it is possible to determine whether a certain student is 'able' or 'unable' to express the solving process of linear equation by analyzing the problem solving process.

• Journal of Science Education
• /
• v.36 no.2
• /
• pp.293-302
• /
• 2012

The purpose of this study was to analyze of the science examination of middle school 7th grade by Klopfer's taxonomy of educational objectives. A total of 645 test items from 10 middle schools were analyzed for this study. The examination items were analyzed according to the objectives of science education, such as behavior and contents area, question types, and the degree of difficulty. It was shown that, when the distribution of behavioral objectives was considered, the items emphasized knowledge and comprehension, and were scientific knowledge oriented. The tests consisted of multiple choice questions at a relatively high rate, compared to short answer questions. Comparing the rate of teachers' expectations to the degree of difficulty, the ratio of "top" was low and that of "medium" was high. The results of this study suggested that using various types of question and multiple levels of content and behavior enabled more effective evaluation of the diverse thinking powers and learning of the students.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2000.05a
• /
• pp.268-273
• /
• 2000

기존의 웹 기반 학습 평가 시스템은 학습자의 선택 기회가 없는 상태에서 일방적으로 제시된 문제지로 평가하게 되거나, 문제 은행에서 임의로 추출한 문제도 단순히 무작위로나 난이도만을 고려하여 문제지를 구성하였고, 그 결과에 대한 성취도의 분석도 한 문제지에 대한 정오표 또는 점수로 단순하게 제시하기 때문에 학습자의 지속적인 학습 관리가 이루어지지 못하고 있다. 본 논문에서는 문제유형, 과목 및 단원 난이도, 문항 형태, 문항당 배점, 문항당 배당 시간등의 다양한 정보를 가진 유형별 문제 은행을 구축하였다. 학습자는 마치 문제집을 풀고 싶은 유형의 문제를 선택하듯이 문제 은행에서 문제를 자율적으로 구성하여 평가할 수 있는 유형별 문제지나 대학수학능력시험의 기준에 맞추어 자동 구성되는 종합 문제지로 다양하게 평가할 수 있다. 또한, 한문제지에 대한 결과뿐만 아니라 유형별, 월별 성취도 분석을 통하여 평가한 총점에 대한 획득한 점수의 누적 통계를 그래프로 일목요연하게 보여주어 한 학습자에 대한 지속적인 성취도 분석이 가능하도록 구축하였다.

• Proceedings of the Korea Society of Elementary Mathematics Education
• /
• 2010.08a
• /
• pp.157-172
• /
• 2010

본 연구는 현행 초등학교에서 이루어지고 있는 서술형 평가의 유형과 문제점을 분석해 보고 2007개정 교육과정에 따른 수학과 서술형 예시 평가 문항을 개발해 보는데 목표가 있다. 학교에서 시행되고 있는 평가 자료의 분석은 수학교과서, 국가수준 학업성취도 평가지, 서울시 교육청 보급 2010 장학자료집, 서울시내 학교에서 시행되고 있는 평가 문항을 분석해 보았다. 그리고 예시 서술형 평가 문항개발은 2007개정 교육과정에 따른 수학과 4학년을 대상으로 하였다. 평가 문항 분석의 결과는 문항 유형이 단순하고 교과서와 장학자료집의 수준을 벗어나지 못하고 있으며 창의성 영역의 평가는 거의 이루어지고 있지 않았다. 서술형 예시평가 문항의 개발은 수학과의 내용영역과 인지적 영역뿐 아니라 교육계의 화두가 되고 있는 창의성 영역까지 평가내용으로 포함시키고자 노력하였으며 영역별 1-2 문항을 개발하였다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.5
• /
• pp.457-463
• /
• 2015

This paper presents the need for the concept of collective intelligence based system for the timely learning and incorrect notes show the utilization and satisfaction. The old wrong answer note system is characterized by the provision of uniform right answer explanations for the questions whose answers were wrong by checking whether the evaluation items were answered right or wrong. The characteristic requires a lot of improvements in terms of wrong answer analysis and feedback since it cannot properly receive feedback on the items that a learner got right by luck in spite of poor understanding of them and on the errors in the selection process of wrong answers by individual learners. The SERO wrong answer note was designed to propose new ways to identify and capture such "score errors" and compensate for the practical weaknesses of learners. The Stability Emergency Risk Opportunity (SERO) wrong answer note is based on a method of categorizing and analyzing evaluation items answered by the examinee into four types (S, E, R and O type), and commentary correct as well as incorrect answers by presenting a variety of commentary notes using the collective intelligence of the study show that satisfaction is high.

• Journal of Educational Research in Mathematics
• /
• v.23 no.3
• /
• pp.389-406
• /
• 2013

The purpose of this study is to analyze eighth grade students' errors in the constructed-response items to improve teaching and learning of mathematics in schools. By analyzing 99 students' responses to nine constructed-response items, we found several types of students' errors in their responses to the assessment items involving with mathematical reasoning and representations, problems within realistic contexts, and mathematical connections. Not only a single error but also multiple errors (a combination of two or more types of errors) were discovered. In particular, high achieving students showed more simple errors than multiple errors while low achieving students had more multiple errors in various kinds.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.