• The Journal of The Korea Institute of Intelligent Transport Systems
• /
• v.16 no.5
• /
• pp.109-120
• /
• 2017

It is important to estimate objectively in the driving test. Especially, the driving test is examined by totally driving ability, rule observation and situational judgement. For this, a grading automation system for driving test was presented by using GPS, sensor data and equipment operation informations. This system is composed of vehicle mounted module, automatic grading terminal, data controller, data storage and processing server. The vehicle mounted module gathters sensor data in the car. The terminal performs automatic grading using the received sensor data according the driving test criterion. To overcome the misposition of vehicle in the map due to GPS error, we proposed the automatic grading system by map matching method, path deviation and return algorithm. In the experimental results, it was possible to grade automatically, display the right position of the car, and return to the right path under 10 seconds when the vehicle was out of the shadow region of the GPS. This system can be also applied to the driving education.

• Communications of Mathematical Education
• /
• v.9
• /
• pp.115-152
• /
• 1999

본 연구에서는 새로운 평가 방안으로 소개되는 수행평가의 정의 및 의의, 특징과 수행평가의 여러 가지방법 등을 간략히 살펴보고, 수행평가의 채점방법, 수행평가에 적합하다고 생각되는 문항을 예시한다. 특히, 수행평가의 예시 문항들은 수행평가의 여러 가지 방법에 따라 개발하되, 어떤 한 가지 방법에 의하지 않고 여러 가지 방법으로 평가가 가능한 문항, 학생들의 조작과 생활 속에 관련된 수학을 발견하도록 하는 문항들을 개발 예시하였다.

• The KIPS Transactions:PartB
• /
• v.16B no.2
• /
• pp.173-180
• /
• 2009

The purpose of developing an automated scoring system for English composition is to score English writing tests and to give diagnostic feedback to the test-takers without human's efforts. The system developed through our research detects grammatical errors of a single sentence on morphological, syntactic and semantic stages, respectively, and those errors are calculated into the final score. The error detecting stages are independent from one another, which causes duplicating the identical errors with different labels at different stages. These duplicated errors become a hindering factor to calculating an accurate score. This paper presents a solution to detecting the duplicated errors and improving an accuracy in calculating the final score by eliminating one of the errors.

• Communications of Mathematical Education
• /
• v.26 no.3
• /
• pp.251-271
• /
• 2012

The purpose of this study is: 1) to determine error sources and the effects of each error source, 2) to investigate optimal measuring conditions from holistic and analytic scoring methods, and 3) to compare the value of reliability between Cronbach's alpha and the generalizability coefficient in self-introduction letter and teacher's recommendation letter based on the generalizability theory in identification of mathematical gifted students by observations and nominations. Data of this study were collected from the science education institute for the gifted attached to the university located within in a capital city for the 2011 academic year. Scores form two raters using holistic and analytic scoring methods in both assessment types were used. The results of this study were as follows. First, as to both assessment types, error sources for people were relatively large regardless of scoring methods. However, error sources for raters in holistic scoring methods had a more significant impact than those of analytic scoring methods. Second, to set optimal measuring conditions in the self-introduction letter and teacher's recommendation letter, if we fixed the number of raters into 2 based on holistic scoring methods, at least 5 and 10 content domains were needed, respectively. In addition, the number of items in teacher's recommendation letter should be more than 3 when we fixed the number of content domains into 4, and the number of items in self-introduction letter should be more than 8 when we fixed the number of content domains into 6 using analytic scoring methods. Third, Cronbach's alpha having only a single source of errors was higher than the generalizability coefficient regardless of assessment types and scoring methods. Hence we recommend that generalizability coefficient based on various error sources such as raters, content domains, and items should be considered to keep a satisfactory level of reliability in both assessment types.

• Journal of the Korea Society of Computer and Information
• /
• v.10 no.1 s.33
• /
• pp.209-216
• /
• 2005

Performance assessment has Problems about possibilities of assessment fault by appraisal, fairness, reliability, and validity of grading, ambiguity of grading standard, difficulty about objectivity security etc. This study proposes fuzzy Performance assessment system to solve problem of the conventional performance assessment. This Paper presented an objective and reliable performance assessment method through fuzzy reasoning, design fuzzy membership function and define fuzzy rule analyzing factor that influence in each sacred ground of performance assessment to account principle subject. Also, performance assessment item divides by formation estimation and subject estimation and designed membership function in proposed performance assessment method. Performance assessment result that is worked through fuzzy Performance assessment system can pare down burden about appraisal's fault and provide fair and reliable assessment result through grading that have correct standard and consistency to students.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.606-610
• /
• 2009

We propose a method utilizing BLEU(BiLingual Evaluation Understudy), which is widely used in automatic evaluation of machine translations, for an autonomous assessment of a short essay answer. BLEU evaluates translations with an assumption that the translation by a machine is supposed to be more accurate as it is getting to be more similar to the translation by a human. BLEU scores the translation by comparing the n-grams of translations by a machine and humans. Similarly we score students answers by comparing to multiple reference answers with BLEU. In the experiment, we compute correlation coefficient values between scores of our system and human instructors.

• Journal of KIISE
• /
• v.41 no.11
• /
• pp.911-920
• /
• 2014

In this paper, we introduce an automatic scoring system for middle-school level writing test based on using machine learning techniques. We discuss overall process and features for building an automatic English writing scoring system. A "concept answer" which represents an abstract meaning of text is newly introduced in order to evaluate the elaboration of a student's answer. In this work, multiple machine learning algorithms are adopted for scoring English writings. We suggest a decision process "optimal combination" which optimally combines multiple outputs of machine learning algorithms and generates a final single output in order to improve the performance of the automatic scoring. By experiments with actual test data, we evaluate the performance of overall automated English writing scoring system.

• KIPS Transactions on Software and Data Engineering
• /
• v.3 no.9
• /
• pp.381-388
• /
• 2014

In this paper, we deal with implementation issues of an unknown word classifier for middle-school level English writing test. We define the type of unknown words occurred in English text and discuss the detection process for unknown words. Also, we define the type of swear words occurred in students's English writings, and suggest how to handle this type of words. We implement an unknown word classifier with a swear detection module for developing an automatic English writing scoring system. By experiments with actual test data, we evaluate the accuracy of the unknown word classifier as well as the swear detection module.

• Journal of Gifted/Talented Education
• /
• v.9 no.1
• /
• pp.127-147
• /
• 1999

본 연구는 마인드맵이 아동의 작문수행에 미치는 효과를 연구하기 위해 이루어졌다. 연구 대상자는 초등학교 6학년 학생 78명(2학급)으로, 각 학급을 실험집단과 통제집단에 각각 무선으로 배정하고 사전검사를 실시하였다. 이어서 10차시에 걸친 실험을 실시하고 실험을 마친 다음날 직후검사를 하였다. 실험의 파지효과를 알아보기 위해서는 실험 종류 1주 후에 파지검사를 실시하였다. 본 연구에서 사용된 측정도구는 작문검사(사전검사, 직후검사 및 파지검사)이다. 작문의 채점에 있어서는 2명의 채점자가 분석적 평가 기준에 따라 채점한 것을 합산하여 사용하였다. 분석결과는 다음과 같다. 1) 마인드맵이 아동의 작문수행에 미치는 효과는 긍정적이었다. 2) 마인드맵이 아동의 작문수행에 미치는 효과는 지속적이었다. 이러한 연구결과는 아이디어를 창출하고 아이디어를 조작하며 글을 개정하는 과정에서 마인드맵이 유용한 학습도구로서 이용될 수 있음을 시사해준다. 또한 정규교실에 있는 영재아들에게도 양반구의 기능을 고루 활용하는 마인드맵이 독자적인 학습방법으로 유용하게 활용될 수 있을 것으로 보인다.

• Annual Conference on Human and Language Technology
• /
• 2021.10a
• /
• pp.384-390
• /
• 2021

본 논문은 영어 에세이 자동 평가를 위한 딥러닝 기반의 새로운 평가 방법론을 제안한다. 어휘, 형태소, 구문, 의미 단계로 이루어진 평가 과정을 통해 자동화된 에세이 평가가 가능하다. 제안하는 방법의 객관성과 신뢰성을 검증하기 위하여 사람이 평가한 점수와 각 단계별 점수 사이의 상관관계 분석을 진행하였으며, 그 결과 제안하는 평가 방법이 유의미함을 알 수 있었다.