• Proceedings of the Korean Information Science Society Conference
• /
• 2001.04b
• /
• pp.673-675
• /
• 2001

본 논문에서는 근거리통신, 인터넷 등의 통신을 이용하여 해당 출제자의 분야 별로 출제한 주관식문제를 응시하면 학습자의 답안과 채점정보를 출제자에게 의뢰하여 채점결과와 해설을 학습자에게 알려주는 주간식문제채점 시스템에 관한 것으로, 학습자가 입력한 주관식 문제의 답을 채점하기 위해서 출제자에게 전자우편이나 전화로 연락하면 출제자가 이 주관식문제채점 시스템에 접속하여 출제자컴퓨터에 표시된 문제, 학습자의 답, 정답, 유사한 답, 배점, 해설 등을 보고 채점한 점수를 출제자화면에 입력하고, 상기 채점한 점수를 합한 점수와 틀린 문제의 해설을 해당 학습자에게 보여주는 주관식문제 채점보조 시스템에 관한 것이다.

• The KIPS Transactions:PartB
• /
• v.16B no.2
• /
• pp.173-180
• /
• 2009

The purpose of developing an automated scoring system for English composition is to score English writing tests and to give diagnostic feedback to the test-takers without human's efforts. The system developed through our research detects grammatical errors of a single sentence on morphological, syntactic and semantic stages, respectively, and those errors are calculated into the final score. The error detecting stages are independent from one another, which causes duplicating the identical errors with different labels at different stages. These duplicated errors become a hindering factor to calculating an accurate score. This paper presents a solution to detecting the duplicated errors and improving an accuracy in calculating the final score by eliminating one of the errors.

• The Journal of the Korea Contents Association
• /
• v.18 no.8
• /
• pp.345-352
• /
• 2018

The purpose of this study is to clarify the difference between the scoring results by scorer(doctors and standardization patients) and examination dates. A total of 101 students in the fourth grade of medical school participated in four clinical practice test. Students were randomly assigned to either day-1 or day-2, which was consisted of a standardized patient scoring set or a physician scoring set. Station checklists consisted of history taking, physical examination, patient education, physician-patient relationship and clinical courtesy. The achievement scores of each case and each domain were converted to the standard score, and the differences between groups were compared. Female students' achievement scores were significantly higher than male students' achievement scores in all domains. There was no significant difference between means by the standardized patients' group and doctors group. Day-2 group was significantly higher than day-1 group in both of history taking and physical examination domains. If the principles of checklist are clearly defined, the scorer status (either physician or standardized patients) does not determine the difference of students' practice test scores.

• Journal of The Korean Association For Science Education
• /
• v.36 no.3
• /
• pp.389-397
• /
• 2016

This study aims to test the efficacy of English-based automated computer scoring models and machine translation to score Korean college students' written responses on natural selection concept items. To this end, I collected 128 pre-service biology teachers' written responses on four-item instrument (total 512 written responses). The machine translation software (i.e., Google Translate) translated both original responses and spell-corrected responses. The presence/absence of five scientific ideas and three $na{\ddot{i}}ve$ ideas in both translated responses were judged by the automated computer scoring models (i.e., EvoGrader). The computer-scored results (4096 predictions) were compared with expert-scored results. The results illustrated that no significant differences in both average scores and statistical results using average scores was found between the computer-scored result and experts-scored result. The Pearson correlation coefficients of composite scores for each student between computer scoring and experts scoring were 0.848 for scientific ideas and 0.776 for $na{\ddot{i}}ve$ ideas. The inter-rater reliability indices (Cohen kappa) between computer scoring and experts scoring for linguistically simple concepts (e.g., variation, competition, and limited resources) were over 0.8. These findings reveal that the English-based automated computer scoring models and machine translation can be a promising method in scoring Korean college students' written responses on natural selection concept items.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2013.07a
• /
• pp.223-224
• /
• 2013

본 논문에서는 모바일 앱을 이용한 스노보드 경기의 채점 시스템 개발을 소개한다. 이 시스템은 오프라인 형식으로 진행하는 기존 채점시스템의 문제점을 극복하기 위하여 심판용 모바일 앱과 전광판 출력을 위한 관리 시스템으로 구성된다. 심판들의 채점상황은 모바일 앱을 통하여 실시간으로 원격 데이터베이스에 적재되고 관리시스템에서 자동 합산 및 점수화되어 전광판으로 해당 점수가 출력되게 된다. 이를 통하여 신속하고 정확한 채점 관리를 수행할 수 있으며 모바일 환경이 지원되는 대부분의 스노보드 경기장에서 활용될 수 있다. 본 연구결과는 국내 다양한 스노보드 경기에 적용하여 동계 스포츠분야의 열악한 정보화 환경을 개선할 수 있음을 보였다.

• Communications for Statistical Applications and Methods
• /
• v.1 no.1
• /
• pp.206-214
• /
• 1994

본 논문은 1994학년도 부터 부활된 대학별고사 실시에 따른 문항분석, 표준 점수제 그리고 검사동등화의 문제점을 지적하기 위하여 교육측정이론의 기본 개념을 소개하는데 있다. 대학별고사의 타당성과 신뢰성을 보장받기 위하여는 양질의 문항제작이 우선하여야하며, 이를 위하여 문항분석은 종전에 사용하던 고전검사이론 보다는 문항반응이론을 이용하는 것이 바람직하다. 문항반응이론에 의한 문항분석은 피험자 집단의 특성에 의하여 문항특성이 달리 분석되지 않는 특징을 지니고 있기 때문이다. 문항이 논술형일 경우 채점자간 신뢰도와 채점자 내 신뢰도를 간과하여서는 안될 것이다. 다양한 선택과목을 채택하는 대학별 고사에서 입학 사정을 위하여 원점수를 사용하거나, 표준점수 혹은 검사동등화 방법을 이용하고 있으나 이는 교육측정이론에 위배된다. 다른 과목에 대한 인가의 능력을 상대비교 할 수 없으며, 표준점수와 검사동등화는 동일 능력에 대한 상대비교를 위한 방법이다. 특히 검사동등화는 동일 특성, 공정성, 모교집단 불변성, 대칭성을 전제한다. 표준점수제에 의하여 수험생들의 다른 능력을 상대 비교하는 방법은 다른 능력이 점수로 표현되기 때문에 가능하나 그 점수가 무엇을 의미하는 가를 분석할 때는 교육평가의 기본 철학에도 위배된다.

• Annual Conference on Human and Language Technology
• /
• 2012.10a
• /
• pp.138-141
• /
• 2012

한국어 서답형 문항의 자동채점 프로그램을 개발하기 위해서는 모범답안, 오답, 부분점수 부여를 위한 세부적인 내용을 채점 기준표로 기술해야 한다. 자동채점에 필요한 구체적인 사항들을 기술하기 위하여 XML 형식으로 정답 템플릿을 정의하였다. 채점에 필요한 내용을 단위 개념으로 정의하고 이를 컴퓨터가 엑세스 가능한 형태의 정답 템플릿을 설계하였다. 정답 템플릿 형식에 맞게 편리하게 템플릿을 작성할 수 있는 작성 도구를 이용하여 학업 성취도평가 각 문항에 대한 채점 기준표를 정답 템플릿으로 작성하여 채점기준표를 작성하는 실험을 수행하였다.

• Journal of Practical Engineering Education
• /
• v.15 no.1
• /
• pp.193-198
• /
• 2023

This paper analyzed the validity of exercise problems for each unit in Python programming education. Practice questions presented for each unit are presented through an online learning system, and each student uploads an answer code and is automatically graded. Data such as students' mid-term exam scores, final exam scores, and practice questions scores for each unit are collected through Python lecture that lasts for one semester. Through the collected data, it is possible to improve the exercise problems for each unit by analyzing the validity of the automatic scoring exercise problems. In this paper, Orange machine learning tool was used to analyze the validity of automatic scoring exercises. The data collected in the Python subject are analyzed and compared comprehensively by total, top, and bottom groups. From the prediction accuracy of the machine learning model that predicts the student's final grade from the Python unit-by-unit practice problem scores, the validity of the automatic scoring exercises for each unit was analyzed.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.606-610
• /
• 2009

We propose a method utilizing BLEU(BiLingual Evaluation Understudy), which is widely used in automatic evaluation of machine translations, for an autonomous assessment of a short essay answer. BLEU evaluates translations with an assumption that the translation by a machine is supposed to be more accurate as it is getting to be more similar to the translation by a human. BLEU scores the translation by comparing the n-grams of translations by a machine and humans. Similarly we score students answers by comparing to multiple reference answers with BLEU. In the experiment, we compute correlation coefficient values between scores of our system and human instructors.

• School Mathematics
• /
• v.16 no.1
• /
• pp.1-17
• /
• 2014

Mathematical creativity in school mathematics is connected with problem solving. The purpose of this study was to analyse elementary students' the mathematical creativity using multiple solution tasks which required to solve a mathematical problem in different ways. For this research, I examined and analyzed the response to four multiple solution tasks according to the evaluation system of mathematical creativity which consisted of the factors of creativity(fluency, flexibility, originality). The finding showed that mathematical creativity was different between students with greater clarity. And mathematical creativity in tasks was different. So I questioned the possibility of analysis of students' the mathematical creativity in mathematical areas. According to the evaluation system of mathematical creativity of this research, mathematical creativity was proportional to the fluency. But the high fluency and flexibility was decreasing originality because it was easy for students to solve multiple solution tasks in the same ways. So, finding of this research can be considered to make the criterion in both originality in rare and mathematical aspects.