• The Journal of Korean Association of Computer Education
• /
• v.23 no.1
• /
• pp.29-36
• /
• 2020

Various items were used as evaluation tools that identify the student's abilities accurately to confirm the completion of learning. Among them, the multiple choice item has the advantages of high objectivity and reliability in scoring, but it cannot remove the factor of guessing. In this paper, the multiple choice items are classified into two types according to the relationship between the questionnaire and the choices. One is the type used in the classical test theory with the probability of guessing 1/k for k choices and the other is the novel proposed type which introduces the concept of partial knowledge. In the proposed type, the probability of guessing when the number of knowledge i is (i+1)/k for k choices. Based on the assumptions of the previous theories about multiple choice items, we derive the guessing parameter about the proposed type. And we analyzed the effect of the guess on the correct answer in the existing type and the proposed type. This shows that the proposed type has more question guessing than the existing type.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2000.05a
• /
• pp.21-26
• /
• 2000

인간의 잠재적 능력을 측정하기 위하여 많은 검사가 이루어진다. 이러한 검사를 위하여 양질의 문항 제작이 필수적이다. 그러나 문항 제작의 중요성을 인식하지 못하고 단시간에 쉽게 제작된 문항들을 쓰고 폐기하는 경우가 많다. 본 논문에서는 양지르이 문항 제작을 위하여 문항 내용 분석, 문항 응답 자료 분석, 문항 난이도, 문항 변별도, 문항 추측도, 오답의 능률도를 이용하여 자료분석에 유용한 효과를 보이는 신경망을 이용한 학업 성취도 시스템 모델을 제안하였다.

• The Journal of Korean Association of Computer Education
• /
• v.6 no.2
• /
• pp.1-8
• /
• 2003

In existing the learner testing system, it has a weak point to determine differently the difficulty of each question which has been estimated by teacher's view and the subjective stand point. In this paper, we develops the learner testing system which supports the estimation of the individual ability of learner, provides the questions for suitable to the individual learner level, and able to estimate the question of individual that used by three parameters such as the difficulty parameter, discrimination parameter, and guessing parameter. Also, it is applied to three-parameters logistic model of IRT(Item Response Theory) for using CAT(Computer Adaptive Testing) technique.

• Proceedings of the Korea Contents Association Conference
• /
• 2009.05a
• /
• pp.1055-1060
• /
• 2009

In this paper, we design an e-Learning system for the Driver's License Teste studying through the Internet. The proposed system make users to be arrived at the goal for the license in a shorter time by offering learning contents and items according to the item-responses made by the users based on the Item Response Theory. Moreover we design the scheme to give the optimum items and the most necessary content to the user during the learning procedure in the form of concept-based objects. All the items in the problem bank DB maintain their difficulties, discriminations, and guessing parameters as is the case of 3-parameter logistic model. In addition user profile DB stores users' status informations, item responses, and ability parameters. Using these structures and combining agents, we can offer the optimum learning process or dynamic personalized studying structure to the user. We can construct interface agent and content selection and feedback agent with the DB's described above. User can study without any awareness of system operations or personal fitting scheme.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2007.11a
• /
• pp.609-612
• /
• 2007

정보사회와 컴퓨딩환경의 발전으로 언어, 학력, 인지도 등의 평가도구로서 컴퓨터기반의 평가환경이 보편화되었다. 특히 컴퓨터기반의 학력평가 환경을 위해서는 문항의 난이도와 변별도 등 문항의 특성을 정확히 분석하는 것이 필수적이다. 문항분석은 컴퓨터기반의 평가를 위한 양질의 문제은행 구성 및 문항과 수험자 능력의 정확한 추정과 체계적이고 과학적인 평가를 위한 전제조건이라 할 수 있다. 본 논문에서는 고전평가이론의 문제분석을 적용한 문제은행 시스템을 구현하였으며 수험결과를 분석하여 각 문제의 곤란도나 변별도, 문항분포도를 통하여 문제를 분석할 수 있도록 하였다. 또한 수험자가 각 문제를 푸는데 걸린 시간을 기록하여, 수험자의 문제에 이해도를 정확히 분석하고 수험자의 추측, 랜덤 선택 등으로 인한 정답을 맞힐 가능성과 한 문제를 읽고 이해하는 시간이 너무 오래걸린 이유에 대해서도 추정하였다. 문제분석 및 수험결과의 평가 및 분석으로 교사들은 문항의 양호도를 높일 수 있고 문제은행에 저장되어 있는 문항들을 수정하고 보완하여 양질의 문항을 출제할 수 있도록 하였다.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.6
• /
• pp.3609-3615
• /
• 2014

This study examined the difference in the item characteristics in multiple-choice aptitude tests focusing on the response position, response length and question types. A university aptitude test consisting of 80 questions was used for this study. The subjects were 3120 senior high school students from 80 schools nation-wide (liberal arts-1650, natural sciences-1467 patients). The results suggest that item prediction is higher for numbers 2 and 3 (located in the middle) than numbers 1 and 4. The item discrimination was higher for pick-the-'wrong'-items than pick-the-'right'-items. In addition, longer choices are preferred. The suggestions for future research are provided based on these findings.

• Journal of The Korean Association of Information Education
• /
• v.19 no.3
• /
• pp.271-278
• /
• 2015

This study proposed new approach for the information gifted discrimination test using EPL. We tried to distinguish high level thinking in the information gifted through test of this study. We categorized testing tool according to context type: simple attribute problem, complex same attribute problem, complex focus attribute problem, mathematic-verbal ability required problem. And testing tool divided into modifying scripts, guess scripts's result, using scratch program. In the effectiveness test of proposed tool, we confirmed content validity and credibility.

• Communications of Mathematical Education
• /
• v.18 no.1 s.18
• /
• pp.191-199
• /
• 2004

본 연구에서는, 6년 전에 개발된 수학 창의적 문제 해결력 검사(MCPSAT; 한국교육개발원(김흥원 외, 1997))에 대한 현시점의 적합성여부를 알아보기 위하여 이 검사의 중학교 1-3학년용 A형 1부 검사와 고등학교 1-2학년용 A형 1부 검사를 해당 학년 학생들에게 적용하여 분석하였다. 검사도구의 양호도는 비교적 좋은 것으로 나타났다. 즉, 중학교와 고등학교 모두 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수가 약간 떨어져 있지만 비교적 양호한 것으로 볼 수 있으며 변별도는 점이연 상관 계수가 0에 가까운 문항이 없는 것으로 나타났다. 따라서 모든 문항이 학생들의 수학 창의적 문제 해결력을 변별해 줄 수 있을 것으로 생각한다. 내적 타당도는 중학교의 경우 관대하게 본다면 수용할 만 하고, 고등학교의 경우 아직은 우려할 수준은 아니다. 즉, 중학교 문항 1과 문항 4는 적합도 지수 1.2를 상회하였으나 Infit과 Outfit 모두 1.5를 넘는 문항은 없었다. 고등학교의 문항 4는 문항의 적합도 지수 1.2를 상회하는 것으로 나타나고 있으나 Infit과 Outfit 모두 1.2를 상회하지 않았다. 난이도 측면에서 볼 때, 이 검사의 계속 사용은 염려스러운 면이 있다. 즉, 중학교에서는 6년 전 보다 쉬운 것으로 나타나고 있는 바 이것은 현재의 학생들이 이러한 유형의 문항을 많이 접하였을 것으로 추측할 수 있다. 고등학교에서는 6년 전 보다 조금 더 어려워 졌다고 볼 수 있다. 위의 사항을 종합할 때, 수학 창의적 문제 해결력 검사에서 중학생용은 현재의 학생들의 수준을 고려하여 재 표준화하는 것이 바람직하고, 고등학생용은 개발 당시의 신뢰도, 난이도, 변별도 등에서 유사하므로 당분간 계속 사용하여도 될 것이다.

• School Mathematics
• /
• v.19 no.4
• /
• pp.731-749
• /
• 2017

The purpose of this study is to find out whether the current mathematics textbooks are structured so as to cultivate students' statistical literacy. To do this, we analyzed the problems of the statistics units of 9 kinds of middle school 3rd grade mathematics textbook according to 2009 revised mathematics curriculum based on four types of context and statistical problem solving process. As a result of the analysis, among the four types of context, the problems that correspond to the type of personal context was the highest in 67% and among statistical problem solving process, the data analysis process was the highest in 72.85%. According to the results of this study, it is necessary to include the problems that can recognize the necessity of statistics through the use of various contexts and that can develop the statistical literacy through the activities that from the process of collecting data to guessing reasonable conclusions from the presented data.

• Journal of the Korean School Mathematics Society
• /
• v.17 no.4
• /
• pp.541-563
• /
• 2014

The purpose of this study is to investigate how the curriculum, in which pre-service teachers experience mathematical process and develop assessment items and standards through the process experience in a mathematical essay course, affects the pre-service teachers and suggest its implications for teacher education. Fourty nine pre-service teachers, registered at a mathematical essay course in a K university in Seoul, developed mathematical essay problems and their assessment standards, and their developed processes were analyzed. According to the analysis results, first, mathematical essay problems developed by the fifty students reflect components of mathematical processes. Especially, one characteristic in revising assessment items shows that pre-service teachers considered not only justification process through different levels of difficulty and mathematical reasoning, but also logical descriptions through problem solving, when they worked on group discussions and examined middle school and high school students' responses. Second, while pre-service teachers developed rubrics for their assessment items and revised the rubrics based on students' responses, they established assessment standards which employed mathematical process by focusing on problem solving process rather than results and considering students' unexpected problem solving. The results imply a concrete method in planning and executing a mathematical essay course which makes use of mathematical process in teacher education.