• 제목/요약/키워드: scoring

검색결과 1,623건 처리시간 0.029초

영작문 자동 채점 시스템 개발 연구 (Development of automated scoring system for English writing)

  • 진경애
    • 영어어문교육
    • /
    • 제13권1호
    • /
    • pp.235-259
    • /
    • 2007
  • The purpose of the present study is to develop a prototype automated scoring system for English writing. The system was developed for scoring writings of Korean middle school students. In order to develop the automated scoring system, following procedures have been applied. First, review and analysis of established automated essay scoring systems in other countries have been accomplished. By doing so, we could get the guidance for development of a new sentence-level automated scoring system for Korean EFL students. Second, knowledge base such as lexicon, grammar and WordNet for natural language processing and error corpus of English writing of Korean middle school students were established. Error corpus was established through the paper and pencil test with 589 third year middle school students. This study provided suggestions for the successful introduction of an automated scoring system in Korea. The automated scoring system developed in this study should be continuously upgraded to improve the accuracy of the scoring system. Also, it is suggested to develop an automated scoring system being able to carry out evaluation of English essay, not only sentence-level evaluation. The system needs to be upgraded for the improved precision, but, it was a successful introduction of an sentence-level automated scoring system for English writing in Korea.

  • PDF

소분자 도킹에서의 평가함수의 개발 동향 (Recent Development of Scoring Functions on Small Molecular Docking)

  • 정환원;조승주
    • 통합자연과학논문집
    • /
    • 제3권1호
    • /
    • pp.49-53
    • /
    • 2010
  • Molecular docking is a critical event which mostly forms Van der waals complex in molecular recognition. Since the majority of developed drugs are small molecules, docking them into proteins has been a prime concern in drug discovery community. Since the binding pose space is too vast to cover completely, many search algorithms such as genetic algorithm, Monte Carlo, simulated annealing, distance geometry have been developed. Proper evaluation of the quality of binding is an essential problem. Scoring functions derived from force fields handle the ligand binding prediction with the use of potential energies and sometimes in combination with solvation and entropy contributions. Knowledge-based scoring functions are based on atom pair potentials derived from structural databases. Forces and potentials are collected from known protein-ligand complexes to get a score for their binding affinities (e.g. PME). Empirical scoring functions are derived from training sets of protein-ligand complexes with determined affinity data. Because non of any single scoring function performs generally better than others, some other approaches have been tried. Although numerous scoring functions have been developed to locate the correct binding poses, it still remains a major hurdle to derive an accurate scoring function for general targets. Recently, consensus scoring functions and target specific scoring functions have been studied to overcome the current limitations.

분수에 대한 교사 지식의 평가 기준 개발 (The Scoring Framework Development for Teacher's Knowledge of Fractions)

  • 이종욱
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제44권2호
    • /
    • pp.215-228
    • /
    • 2005
  • The purpose of this study is to development the scoring framework for teacher knowledge of fractions. This framework is qualified in the content-validity by professional educators' evaluation and in the reliability by correlation coefficient. 2 math educators judged that this framework is composed of appropriate scoring category, scoring criterion, and scoring level. After 2 teachers scored the tasks, correlation coefficient was calculated between evaluators. The coefficient is evaluated high in that it is more than 0.80.

  • PDF

아토피 피부염의 평가방법에 대한 연구 : 비교 분석 및 설립 (A study on the Severity Scoring Systems of Atopic Dermatitis ; Comparision, Analysis and Establishment)

  • 윤화정;윤정원;윤소원;고우신
    • 대한한의학회지
    • /
    • 제23권4호
    • /
    • pp.15-26
    • /
    • 2002
  • There is much confusion in the field of atopic dermatitis (AD) regarding how to best measuredisease severity objectively. Therefore, we aimed to establish a new adequate scoring system for AD, that should be based on comparisonand analysis of various scoring systems. We report as follows. Methods: We searched for data relating to severity scoring systems for atopic dermatitis in Entrez PubMed From 1990 to 2001 Results and Conclusions: 1. Properties of severity scoring systems were validity, reliability, sensitivity of change and ease of use. 2. The essential items of severity scoring systems were extent. intensity and subjective symptoms. 3. The surface extent of the lesion was evaluated by the percentage of involvement of each of 10 areas. 4. The criteria of severity were divided into intensity and subjective symptoms. Intensity items are erythema, papulation, lichenification, oozing, dryness, excoriations, and pigmentation. The subjective symptom is pruritus, evaluated according to sleep loss. 5. The significant items of severity scoring system were symptomsrather than areas. As it were, we assumed extent accounted for around 30% of each total score, with intensity and subjective symptoms representing 70%.

  • PDF

가금콕시듐증 병변과 Lesion Scoring (Poultry Coccidiosis Lesions and Lesion Scoring)

  • Conway, Donal P.
    • 한국가금학회지
    • /
    • 제6권2호
    • /
    • pp.103-108
    • /
    • 1979
  • 1 닭의 콕시듐증 병변을 인식하고 확인하는데는 장의 각기 다른 부위에서 발견되는 콕시듐 원충에 달려있다. 병변에 대한 지식과 원충 확인이 lesion scoring에서 요구되고 있지만. 원충을 확인하는 것이 lesion scoring의 기본목적은 아니다. (중략)

  • PDF

서답형 문항의 인터넷 기반 채점시스템 설계 연구 (A Study on design of The Internet-based scoring system for constructed responses)

  • 조지민;김경훈
    • 컴퓨터교육학회논문지
    • /
    • 제10권2호
    • /
    • pp.89-100
    • /
    • 2007
  • 대규모 집단을 대상으로 시행하는 서답형 문항을 수기 채점 방식으로 채점하는 경우 채점 과정에서 발생하는 채점 오차를 줄이기 위해서는 많은 노력과 시간을 필요로 한다. 이러한 문제점을 해결하기 위해 세계 각국에서는 서답형 문항 채점 시스템을 개발하여 운용하고 있지만, 국내에서는 채점 시스템의 기초적인 연구도 미흡한 실정이다. 본 연구의 목적은 '서답형 문항의 인터넷 기반 채점 시스템' 설계의 기반을 마련하는데 있다. 시스템 설계의 기반 마련을 위한 시스템의 개요와 기본 설계도, 채점자 배정 방법, 채점자 신뢰도 추정에 의한 채점자 오류 검색 알고리즘을 제안하였다. 본 시스템은 실시간으로 채점 신뢰도를 추정하여 채점 오차를 보정할 수 있는 장점이 있다.

  • PDF

기계학습 분류기의 예측확률과 만장일치를 이용한 한국어 서답형 문항 자동채점 시스템 (Automated Scoring System for Korean Short-Answer Questions Using Predictability and Unanimity)

  • 천민아;김창현;김재훈;노은희;성경희;송미영
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제5권11호
    • /
    • pp.527-534
    • /
    • 2016
  • 최근 정보화 사회에서는 단순 암기보다는 문제 해결 능력과 종합적인 사고력을 바탕으로 창의적인 생각을 할 수 있는 인재를 요구한다. 이에 따라 교육과정도 학생들의 종합적인 사고력을 판단할 수 있는 서답형 문항을 늘리는 방향으로 변하고 있다. 그러나 서답형 문항의 경우 채점자의 주관에 의존하여 채점이 진행되기 때문에, 채점 결과의 일관성을 확보하기 어렵다는 단점이 있다. 이런 점을 해결하기 위해 해외에서는 기계학습을 이용한 자동채점 시스템을 채점 도구로 사용하고 있다. 한국어는 영어와 언어학적으로 다른 분류에 속하므로 영어권에서 사용하는 자동채점 시스템을 한국어에 그대로 적용할 수 없다. 따라서 한국어 체계에 맞는 자동채점 시스템의 개발이 필요하다. 본 논문에서는 기계학습 분류기의 예측확률과 만장일치 방법을 사용한 한국어 서답형 문항 자동채점 시스템을 소개하고, 자동채점 시스템을 이용한 채점 결과와 교과 전문가의 채점 결과를 비교하여 자동채점 시스템의 실용성을 검증한다. 본 논문의 실험을 위해 2014년 국가수준 학업성취도 평가의 국어, 사회, 과학 교과의 서답형 문항을 사용했다. 평가 척도로 피어슨 상관계수와 카파계수를 사용했다. 채점자가 개입했을 때와 개입하지 않았을 때의 상관계수 모두 0.7 이상으로 강한 양의 상관관계를 보였다. 이는 자동채점 시스템이 교과 전문가가 채점한 결과와 유사한 방향으로 답안에 점수를 부여한 것이므로 자동채점 시스템을 채점 보조도구로서 충분히 사용할 수 있을 것이다.

Scoring systems for the management of oncological hepato-pancreato-biliary patients

  • Alexander W. Coombs;Chloe Jordan;Sabba A. Hussain;Omar Ghandour
    • 한국간담췌외과학회지
    • /
    • 제26권1호
    • /
    • pp.17-30
    • /
    • 2022
  • Oncological scoring systems in surgery are used as evidence-based decision aids to best support management through assessing prognosis, effectiveness and recurrence. Currently, the use of scoring systems in the hepato-pancreato-biliary (HPB) field is limited as concerns over precision and applicability prevent their widespread clinical implementation. The aim of this review was to discuss clinically useful oncological scoring systems for surgical management of HPB patients. A narrative review was conducted to appraise oncological HPB scoring systems. Original research articles of established and novel scoring systems were searched using Google Scholar, PubMed, Cochrane, and Ovid Medline. Selected models were determined by authors. This review discusses nine scoring systems in cancers of the liver (CLIP, BCLC, ALBI Grade, RETREAT, Fong's score), pancreas (Genç's score, mGPS), and biliary tract (TMHSS, MEGNA). Eight models used exclusively objective measurements to compute their scores while one used a mixture of both subjective and objective inputs. Seven models evaluated their scoring performance in external populations, with reported discriminatory c-statistic ranging from 0.58 to 0.82. Selection of model variables was most frequently determined using a combination of univariate and multivariate analysis. Calibration, another determinant of model accuracy, was poorly reported amongst nine scoring systems. A diverse range of HPB surgical scoring systems may facilitate evidence-based decisions on patient management and treatment. Future scoring systems need to be developed using heterogenous patient cohorts with improved stratification, with future trends integrating machine learning and genetics to improve outcome prediction.

수학적 창의성 검사의 채점 영역별 가중치 분석 (Analysis of weights depending on scoring domains of the mathematical creativity test)

  • 김성연
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제55권2호
    • /
    • pp.147-169
    • /
    • 2016
  • This study analyzes the mathematical creativity test as an illustrative example with scoring domains of fluency, flexibility and originality in order to make suggestions for obtaining maximum reliability based on a composite score depending on combinations of each scoring domain weights. This is done by performing a multivariate generalizability analysis on the test scores, which were allowed to access publicly, of 30 mathematically gifted elementary school students, and therefore error variances, generalizability coefficients, and effective weights have been calculated. The main results were as follows. First, the optimal weights should adjust to .5, .4, and .1 based on the maximum generalizability coefficient even though the original weights in the mathematical creativity test were equal for each scoring domain with fluency, flexibility and originality. Second, the mathematical creativity test using the three scoring domains of fluency, flexibility, and originality showed higher reliability than using one scoring domain such as fluency. These results are limited to the mathematical creativity test used in this study. However, the methodology applied in this study can help determine the optimal weights depending on each scoring domain when the tests constructed in various researchers or educational fields are composed of multiple scoring domains.

보안취약점 중요도 정량 평가 체계 연구 (Quantitative Scoring System on the Importance of Software Vulnerabilities)

  • 안준선;창병모;이은영
    • 정보보호학회논문지
    • /
    • 제25권4호
    • /
    • pp.921-932
    • /
    • 2015
  • 본 논문에서는 소프트웨어 보안취약점의 중요도를 정량적으로 산출할 수 있는 중요도 정량 평가 체계를 제안한다. 제안된 평가 체계는 국내 소프트웨어 이용 환경을 고려한 보안취약점의 파급도, 위험도, 소프트웨어 점유율, 시스템에서의 사용 정도 등을 복합적으로 반영하여 보안취약점에 대한 심각성을 적절히 평가할 수 있는 평가 척도와 이를 기반으로 한 중요도 계산식으로 구성된다. 논문에서는 제안된 소프트웨어 보안취약점 평가 체계를 국내의 보안취약점에 시범적으로 적용하고 그 효용성을 CVSS 및 CWSS 등과 비교, 분석하였으며, 제안된 평가 체계의 활용 방안을 제시하였다.