• The Journal of Korean Association of Computer Education
• /
• v.17 no.2
• /
• pp.39-51
• /
• 2014

In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.2
• /
• pp.89-100
• /
• 2007

Scoring the constructed responses in large-scale assessments needs great efforts and time to reduce the various types of error in Paper-based training and scoring. For the purpose of eliminating the complexities and problems in Paper and pencil based training and scoring, many of countries including U.S.A and England already have applied online scoring system. There, however, has been few studies to develop the scoring system for the constructed responses items in Korea. The purpose of this study is to develop the basic design of the Internet-based scoring system for the constructed responses. This study suggested the algorithms for assigning scorers to constructed responses, employing methods for monitoring reliability, etc. This system can ensure reliable, quick scoring such as monitor scorer consistency through ongoing reliability checks and assess the quality of scorer decision making through frequent various checking procedures.

• The Journal of Society for e-Business Studies
• /
• v.21 no.1
• /
• pp.105-118
• /
• 2016

Game companies are frequently attacked by attackers while the companies are servicing their own games. This paper analyzes the limit of the Signature detection method, which is a way of detecting hacking modules in online games, and then this paper proposes the Scoring Signature detection scheme to make up for these problems derived from the limits. The Scoring Signature detection scheme enabled us to detect unknown hacking attacks, and this new scheme turned out to have more than twenty times of success than the existing signature detection methods. If we apply this Scoring Signature detection scheme and the existing detection methods at the same time, it seems to minimize the inconvenient situations to collect hacking modules. And also it is expected to greatly reduce the amount of using hacking modules in games which had not been detected yet.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.05a
• /
• pp.450-452
• /
• 2021

Recently, as interest in programming and artificial intelligence has increased, software education has been compulsory from elementary school. In order to achieve this goal of programming education, it is necessary to basically establish a lab environment suitable for students and teachers. However, there is a problem with performance problems caused by old computers in the lab environment of the school, and there is a problem that students must purchase and use the existing online platform while implementing an algorithm contest program in which students access and evaluate their problem-solving ability at the same time. Therefore, in this paper, to solve this problem, we propose a web-based online practice environment and algorithm contest scoring system using React and Spring boot. Through this, it is believed that even in a computer with low specifications, programming can be studied using only a web browser.

• Journal of Distribution Science
• /
• v.19 no.2
• /
• pp.65-75
• /
• 2021

Purpose: During the pandemic, a large number of orders forced online retailers of fresh produce to quickly change their emergency logistics capabilities to meet the needs of ordinary consumers during the pandemic. Our research aims to help online retailers establish an emergency physical distribution framework for fresh produce during disasters to meet consumer needs. Research design and methodology: 160 effective responses were collected from the online response team in Wuhan, China, and exploratory factor analysis was used to determine the emergency logistics capability framework. Twelve experts were invited online to collect their scoring opinions and use the entropy method to determine the importance of emergency logistics capabilities. Results: Our results have identified a total of 17 emergency logistics factors for online retailers, and we found that Transportation route planning and reconstruction capabilities, Emergency plan planning ability, and Supply chain real-time information sharing capability are the most important in the overall framework. Conclusions: This research completely established the physical distribution framework of fresh agricultural products online retailer in emergency situations. It enriches academic resources in the field of emergency distribution and provides a scientific basis for corporate managers to improve their physical distribution capabilities in emergency situations.

• Journal of The Korean Association of Information Education
• /
• v.8 no.2
• /
• pp.251-259
• /
• 2004

Widespread internet service has brought many changes to modern life. Internet installed at school and intra-school computer network presented various education activities such as web-based instruction, immediate evaluation, and management of progress in studying. In this paper an essay question evaluation system for web service is studied for rapid measurement of accomplishment of student. This system provides evaluation of answers consisting a simple sentence and not demanding one word. If an essay question has exactly specified answer sheets and scoring criterion, this system give highly accurate scoring results, which shows nearly the same scoring of a teacher, needs very short time for evaluation, and represents real-time feed back result, so it is expected very high efficiency for the evaluation of an essay question.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.6
• /
• pp.99-106
• /
• 2009

Over recent decades, concept mapping has been used as a valuable Learning and Teaching tool. A number of studies have shown a positive impact on student learning. One of the disadvantages of this technique has been that assessing them or providing feedback to students is time consuming. We aim here to introduce ways of reducing the complexity of using concept map techniques in online activities. Several types of scoring methods for the concept map based assessment have been developed. In this paper, we describe the development of an automatic assessment system that implements those techniques. We contribute a design that uses semantic web technologies for both the management and the scoring of the concept maps.

• Journal of Practical Engineering Education
• /
• v.15 no.1
• /
• pp.193-198
• /
• 2023

This paper analyzed the validity of exercise problems for each unit in Python programming education. Practice questions presented for each unit are presented through an online learning system, and each student uploads an answer code and is automatically graded. Data such as students' mid-term exam scores, final exam scores, and practice questions scores for each unit are collected through Python lecture that lasts for one semester. Through the collected data, it is possible to improve the exercise problems for each unit by analyzing the validity of the automatic scoring exercise problems. In this paper, Orange machine learning tool was used to analyze the validity of automatic scoring exercises. The data collected in the Python subject are analyzed and compared comprehensively by total, top, and bottom groups. From the prediction accuracy of the machine learning model that predicts the student's final grade from the Python unit-by-unit practice problem scores, the validity of the automatic scoring exercises for each unit was analyzed.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.413-414
• /
• 2019

최근 프로그래밍 교육의 중요성이 강조되고 있지만 수업시수 문제로 학교 수업시간만으로는 성과를 거두기는 어렵다. 온라인 채점 시스템은 학생의 코드를 평가하고 피드백을 제공해주기 때문에 자기주도적인 프로그래밍 학습에 도움을 줄 것으로 생각된다. 본 연구에서는 온라인 채점 시스템을 사용해서 C 프로그래밍 기초 학습을 한 학생들을 대상으로 학생들의 제출코드와 피드백을 분석하려고 하며, 학생들의 프로그래밍 학습경험과 학습참여도 등을 조사하여 대상학생을 선정하고, 데이터를 수집하였다. 그리고 대상 학생들의 소스코드 및 피드백을 분석하여 자기주도학습 과정을 분석하고, 문제개선의 기초자료로 활용할 수 있음을 제언한다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.1
• /
• pp.134-139
• /
• 2022

Recently, interest in programming and artificial intelligence is continuously increasing, and software education is being implemented as a mandatory education from elementary school. For efficient programming education, it is basically necessary to build a lab environment suitable for students and teachers, but there are performance problems due to the inadequacy of old computers and network equipment. Therefore, in this paper, we propose a web page-based online practice environment and algorithm competition scoring system using React and Spring boot to solve the problem of the programming practice environment. Through this, it is thought that programming learning can be carried out using only a web browser even on low-spec computers. In addition, since various programming languages can be learned irrespective of the language to be learned, it is considered that the time cost for establishing a practice environment can be reduced.