• Journal of the Korea Society of Computer and Information
• /
• v.19 no.12
• /
• pp.267-274
• /
• 2014

Even though computer based college lecture management system was developed long ago and has been used ever since, developing perfect lecture management is not simple. The main objective of this system is to develop appropriate online lecture supportive management program suitable for college lectures. This system [ADLEMS] mainly focuses on the management of college database lectures, exams, and grades. This system supports management and grading of attendance, reports, quizzes, mid-term, and final exams. Exam management categorizes into multiple choice questions, essay questions, short answer questions, and SQL. Especially for SQL, division analysis was applied when developing grading system for more effective grade management. For essay questions and short answer questions, manual [hand] grading method was used. Every student can verify the grading process in person to alleviate the problems occurring during the grading process.

• Journal of The Korean Association For Science Education
• /
• v.36 no.3
• /
• pp.389-397
• /
• 2016

This study aims to test the efficacy of English-based automated computer scoring models and machine translation to score Korean college students' written responses on natural selection concept items. To this end, I collected 128 pre-service biology teachers' written responses on four-item instrument (total 512 written responses). The machine translation software (i.e., Google Translate) translated both original responses and spell-corrected responses. The presence/absence of five scientific ideas and three $na{\ddot{i}}ve$ ideas in both translated responses were judged by the automated computer scoring models (i.e., EvoGrader). The computer-scored results (4096 predictions) were compared with expert-scored results. The results illustrated that no significant differences in both average scores and statistical results using average scores was found between the computer-scored result and experts-scored result. The Pearson correlation coefficients of composite scores for each student between computer scoring and experts scoring were 0.848 for scientific ideas and 0.776 for $na{\ddot{i}}ve$ ideas. The inter-rater reliability indices (Cohen kappa) between computer scoring and experts scoring for linguistically simple concepts (e.g., variation, competition, and limited resources) were over 0.8. These findings reveal that the English-based automated computer scoring models and machine translation can be a promising method in scoring Korean college students' written responses on natural selection concept items.

• Annual Conference of KIPS
• /
• 2004.05a
• /
• pp.965-968
• /
• 2004

기존의 주관식 문제 채점 보조 시스템은 자연어 처리의 어려움으로 인해 채점의 자동화가 어려워 전자우편 등을 통하여 채점자에게 채점 의뢰를 하는 수준이었다. 본 논문에서는 이러한 문제점을 해결하기 위하여 문제 공간을 벡터 공간으로 정의하고 벡터를 구성하는 각 자질간의 상관관계를 고려한 방법을 적용하였다. 먼저 학습자가 답안을 작성할 때 동의어 사용을 한다는 가정하에 출제자가 여러 개의 모범 답안을 작성하고 이들 답안을 말뭉치에 첨가하여 구성한 다음 형태소 분석기를 통하여 색인을 추출한다. 그리고 학습자가 작성한 답안 역시 색인을 추출한 다음, 이들 색인들을 각 자질로 정의한 벡터를 구성한다. 이렇게 구성된 벡터들을 이용하여 답안들간 유사도 측정을 하고, 유사도 범위에 따라 답안을 자동으로 정답과 오답으로 분류하려는 시스템을 제안한다. 170 문항의 주관식 문제을 제안된 방법으로 실험하여, 기존 모델에 비해 성능과 신뢰성 향상을 이룰 수 있었다.

• The Journal of Korean Association of Computer Education
• /
• v.21 no.6
• /
• pp.83-92
• /
• 2018

The subjective question is appropriate for evaluation of deep thinking, but it is not easy to score. Since, regardless of same scoring criterion, the graders are able to produce different scores, we need the objective automatic evaluation system. However, the system has the problem of Korean analysis and comparison. This paper suggests the Korean syntactic analysis and subjective grading system using the syntactic-semantic tree comparator. This system is the hybrid grading system of word based and syntactic-semantic tree based grading. This system grades the answers on the subjective question using the syntactic-semantic comparator. This proposed system has the good result. This system will be utilized in Korean syntactic-semantic analysis, subjective question grading, and document classification.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2013.07a
• /
• pp.223-224
• /
• 2013

본 논문에서는 모바일 앱을 이용한 스노보드 경기의 채점 시스템 개발을 소개한다. 이 시스템은 오프라인 형식으로 진행하는 기존 채점시스템의 문제점을 극복하기 위하여 심판용 모바일 앱과 전광판 출력을 위한 관리 시스템으로 구성된다. 심판들의 채점상황은 모바일 앱을 통하여 실시간으로 원격 데이터베이스에 적재되고 관리시스템에서 자동 합산 및 점수화되어 전광판으로 해당 점수가 출력되게 된다. 이를 통하여 신속하고 정확한 채점 관리를 수행할 수 있으며 모바일 환경이 지원되는 대부분의 스노보드 경기장에서 활용될 수 있다. 본 연구결과는 국내 다양한 스노보드 경기에 적용하여 동계 스포츠분야의 열악한 정보화 환경을 개선할 수 있음을 보였다.

• Journal of Practical Engineering Education
• /
• v.15 no.1
• /
• pp.193-198
• /
• 2023

This paper analyzed the validity of exercise problems for each unit in Python programming education. Practice questions presented for each unit are presented through an online learning system, and each student uploads an answer code and is automatically graded. Data such as students' mid-term exam scores, final exam scores, and practice questions scores for each unit are collected through Python lecture that lasts for one semester. Through the collected data, it is possible to improve the exercise problems for each unit by analyzing the validity of the automatic scoring exercise problems. In this paper, Orange machine learning tool was used to analyze the validity of automatic scoring exercises. The data collected in the Python subject are analyzed and compared comprehensively by total, top, and bottom groups. From the prediction accuracy of the machine learning model that predicts the student's final grade from the Python unit-by-unit practice problem scores, the validity of the automatic scoring exercises for each unit was analyzed.

• Journal of Korea Multimedia Society
• /
• v.12 no.5
• /
• pp.767-776
• /
• 2009

The purpose of this paper is to design, implement and test the automatic marking system for programming languages using key-words and boolean operations to solve the processing problems of natural languages. There are accurate grammar systems and key-words in programming languages. Using these characteristics, We have designed, programmed, and tested automatic marking system for programming languages through key-words and boolean operations in this paper. We have categorized programming languages into 7 types as the type of answer and when a professor input any key-words, the system make him put conjunction with the special character. It can be logical expressions instantly so that the system easily operates. We asked 10 students who are majoring in computer engineering to take a test on the paper and web to show how well automatic marking system that we have programmed works. Then We requested 3 professors if the subject problems marked objectively. As a result, automatic marking system proved to be appropriate. We have proposed the way of using key-words and boolean operation for prohibiting huge natural language processing in marking of subjective question. It promotes efficiency rate of programming, objectivity and speed through the transferal to the web for marking since the system prohibits marker to include personal opinion on marking and gives feedback quickly

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.11
• /
• pp.127-133
• /
• 2019

SQL is the most common language in data processing. Therefore, most of the colleges offer SQL in their curriculum. In this research, an auto scoring SQL test is proposed for the efficient results of SQL education. The system was treated with algorithms instead of using expensive DBMS(Data Base Management System) for automatic scoring, and satisfactory results were produced. For this system, the test question bank was established out of 'personnel management' and 'academic management'. It provides users with different sets of test each time. Scoring was done by dividing tables into two sections. The one that does not change the table(select) and the other that actually changes the table(update, insert, delete). In the case of a search, the answer and response were executed at first and then the results were compared and processed, the user's answers are evaluated by comparing the table with the correct answer. Modification, insertion, and deletion of table actually changes the data table, so data was restored by using ROLLBACK command. This system was implemented and tested 772 times on the 88 students in Computer Information Division of our college. The results of the implementation show that the average scoring time for a test consisting of 10 questions is 0.052 seconds, and the performance of this system is distinguished considering that multiple responses cannot be processed at the same time by a human grader, we want to develop a problem system that takes into account the difficulty of the problem into account near future.

• The Journal of Korean Association of Computer Education
• /
• v.21 no.6
• /
• pp.105-115
• /
• 2018

The descriptive-type question is appropriate for deep thinking ability evaluation, but it is not easy to grade. Since, even though same grading criterion, the graders produce different scores, we need the objective evaluation system. However, the system needs the Korean analysis. As the descriptive-type answering is described with the compound sentence, the system has to analyze the compound sentence. This paper develops the Korean syntactic-semantic analysis system for compound sentence and evaluates performance of the system. This system selects the modifiee of the word phrase using syntactic-semantic constraint and semantic dictionary. The 93% accurate rate shows that the system is effective. This system will be utilized in descriptive-type grading and Korean processing.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2015.01a
• /
• pp.337-338
• /
• 2015

최근 다양한 모바일 기기를 통한 여러 가지 문제지가 등장하고 있다. 본 논문에서는 여러 종류의 기출문제를 풀고 답을 확인할 수 있는 문제지를 개발하고자 한다. 먼저 로그인 폼을 만들어 회원정보를 담고 여러 가지 문제를 입력하여 문제지를 만들고 문제를 다 풀면 자동으로 채점을 하여 일일이 점수를 계산하는 시간낭비를 줄였다.