• Title/Summary/Keyword: scoring method

Search Result 478, Processing Time 0.022 seconds

Automatic Detection of Off-topic Documents using ConceptNet and Essay Prompt in Automated English Essay Scoring (영어 작문 자동채점에서 ConceptNet과 작문 프롬프트를 이용한 주제-이탈 문서의 자동 검출)

  • Lee, Kong Joo;Lee, Gyoung Ho
    • Journal of KIISE
    • /
    • v.42 no.12
    • /
    • pp.1522-1534
    • /
    • 2015
  • This work presents a new method that can predict, without the use of training data, whether an input essay is written on a given topic. ConceptNet is a common-sense knowledge base that is generated automatically from sentences that are extracted from a variety of document types. An essay prompt is the topic that an essay should be written about. The method that is proposed in this paper uses ConceptNet and an essay prompt to decide whether or not an input essay is off-topic. We introduce a way to find the shortest path between two nodes on ConceptNet, as well as a way to calculate the semantic similarity between two nodes. Not only an essay prompt but also a student's essay can be represented by concept nodes in ConceptNet. The semantic similarity between the concepts that represent an essay prompt and the other concepts that represent a student's essay can be used for a calculation to rank "on-topicness" ; if a low ranking is derived, an essay is regarded as off-topic. We used eight different essay prompts and a student-essay collection for the performance evaluation, whereby our proposed method shows a performance that is better than those of the previous studies. As ConceptNet enables the conduction of a simple text inference, our new method looks very promising with respect to the design of an essay prompt for which a simple inference is required.

Subgraph Searching Scheme Based on Path Queries in Distributed Environments (분산 환경에서 경로 질의 기반 서브 그래프 탐색 기법)

  • Kim, Minyoung;Choi, Dojin;Park, Jaeyeol;Kim, Yeondong;Lim, Jongtae;Bok, Kyoungsoo;Choi, Han Suk;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.1
    • /
    • pp.141-151
    • /
    • 2019
  • A network of graph data structure is used in many applications to represent interactions between entities. Recently, as the size of the network to be processed due to the development of the big data technology is getting larger, it becomes more difficult to handle it in one server, and thus the necessity of distributed processing is also increasing. In this paper, we propose a distributed processing system for efficiently performing subgraph and stores. To reduce unnecessary searches, we use statistical information of the data to determine the search order through probabilistic scoring. Since the relationship between the vertex and the degree of the graph network may show different characteristics depending on the type of data, the search order is determined by calculating a score to reduce unnecessary search through a different scoring method for a graph having various distribution characteristics. The graph is sequentially searched in the distributed servers according to the determined order. In order to demonstrate the superiority of the proposed method, performance comparison with the existing method was performed. As a result, the search time is improved by about 3 ~ 10% compared with the existing method.

A Study on Descriptive Assessment of Mathematics in Russia's Unified State Examination (러시아의 국가통합시험에서 수학교과의 서술형 평가 연구)

  • Han, Inki;Shin, Vladimir
    • Journal of Science Education
    • /
    • v.46 no.1
    • /
    • pp.121-149
    • /
    • 2022
  • Descriptive assessment is a meaningful assessment method in relation to problem solving ability, reasoning ability, and communication ability as emphasized in mathematics curriculum. In Korea, as performance assessment has been emphasized since the 7th mathematics curriculum, descriptive assessment is being conducted as a method of performance assessment in schools. However, descriptive assessment has not been introduced in the university scholastic ability test for various reasons. Considering that descriptive assessment is emphasized in the mathematics classroom and has sufficient educational value, a serious discussion on the implementation of descriptive assessment in the university scholastic ability test will be necessary. In this study, we analyzed the descriptive assessment of Russia's unified state examination (USE) in the mathematics, which corresponds to Korea's university scholastic ability test. Through a literature review, we investigated how mathematics examination problems were structured in the USE and which mathematical abilities were required for the examination. In particular, the outer structure of the problems was analyzed focusing on the mathematics problems of the USE 2021, and the scoring method of the descriptive problems was also analyzed. The results of this study are expected to provide a variety of information on the possibility of introducing descriptive assessment in the Korean university scholastic ability tests.

A Study on the Evaluation Method of Comprehension Task in Proverbs for the Elderly (노인용 속담 이해력 과제의 평가 방법에 대한 고찰)

  • Lee, Young-Min;Kim, Jung-Wan
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.4
    • /
    • pp.25-38
    • /
    • 2021
  • Objective : This study aimed to establish an analytic methodology that can objectively evaluate the proverb comprehension levels that vary based on the aging process. Method : This study recruited 70 normal elderly aged ≥ 65 years and performed proverb comprehension tasks using an explanation method. A scoring estimation method was designed on 3 and 5-point scales. The difficulty and discrimination levels were calculated based on the two scales, thereby selecting the final questions and evaluation scale. Results : First, the item discrimination index on the 5-point scale was relatively higher than that on the 3-point scale, and 10 items were finally selected. Second, in terms of proverb comprehension ability, the elderly group aged 70 ~ 84 years showed significantly lower performance than those aged 65 ~ 69 years. Additionally, subjects with ≥ 10 years of education showed significantly higher performance than those with 9 ≤ years of education. Third, the performance of the proverbs comprehension task negatively correlated with the reaction time of the executive function task. Conclusion : Proverb comprehension is a task that can distinctively show a deterioration of brain functions in line with the aging process even among the normal elderly group and therefore, can estimate the difference more effectively with an increase in the score of the evaluation scale.

Study on Applicability of Multi-Criteria Decision Making Technique for Malfunctioning Reservoir Selection (기능저하 저수지 선정을 위한 다기준 의사결정기법 적용성 연구)

  • Shim, Hyun Chul;Choi, Kyung Sook
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.59 no.3
    • /
    • pp.11-19
    • /
    • 2017
  • The decision-making process is the act of finding the best solution among various alternatives through comparison between various criteria based on objectives of the project, evaluation standard, and conditions. However, in practice it is not easy to simply decide the optimum decision, especially for selecting malfunctioning reservoirs because no systematic evaluation criteria or standard assessment process are available. Therefore, this study adopted AHP method, which is a MCDM (multi-criteria decision making technique) to identify the malfunctioning reservoirs for efficient management of reservoirs. Important criteria of the selection of malfunctioning reservoirs and priority weights of each criteria were determined based on results of expert's survey under a stepwise hierarchical approach. The most important factor for the decision of malfunctioning reservoirs was obtained as Reservoir efficiency among the selected criteria including Reservoir efficiency decrease, Disaster Risk, Reservoir efficiency, Available water storage, Future water demand, Resident Needs. The AHP technique was applied on 11 reservoirs in Andong region to verify its applicability. Scoring method was applied for the comparison with the results of AHP method.

An Efficient Functional Analysis Method for Micro-array Data Using Gene Ontology

  • Hong, Dong-Wan;Lee, Jong-Keun;Park, Sung-Soo;Hong, Sang-Kyoon;Yoon, Jee-Hee
    • Journal of Information Processing Systems
    • /
    • v.3 no.1
    • /
    • pp.38-42
    • /
    • 2007
  • Microarray data includes tens of thousands of gene expressions simultaneously, so it can be effectively used in identifying the phenotypes of diseases. However, the retrieval of functional information from a large corpus of gene expression data is still a time-consuming task. In this paper, we propose an efficient method for identifying functional categories of differentially expressed genes from a micro-array experiment by using Gene Ontology (GO). Our method is as follows: (1) The expression data set is first filtered to include only genes with mean expression values that differ by at least 3-fold between the two groups. (2) The genes are then ranked based on the t-statistics. The 100 most highly ranked genes are selected as informative genes. (3) The t-value of each informative gene is imposed as a score on the associated GO terms. High-scoring GO terms are then listed with their associated genes and represent the functional category information of the micro-array experiment. A system called HMDA (Hallym Micro-array Data analysis) is implemented on publicly available micro-array data sets and validated. Our results were also compared with the original analysis.

Methodology for Measuring the Quality of Experience of E-Participation Systems (전자참여시스템의 체감품질 측정방법론)

  • Byun, Dae-Ho
    • Journal of Digital Convergence
    • /
    • v.10 no.1
    • /
    • pp.21-28
    • /
    • 2012
  • E-participation is the term referring to the use of information and communication technologies to political participation by enabling citizens to connect with one another. Because e-participation systems are already constructed and operated, continuous usage is regarded as a major concern for successful e-participation. E-participation systems should guarantee ease of use, user satisfaction, and high quality. In addition, measuring the quality of e-participation systems will provide a useful strategy. This paper suggests a methodology for measuring quality of experience of the e-participation system and computing the quality score. We apply two concepts of usability measurement method and quality of experience that are most suitable. We provide the target of measurement,, the construct of quality of experience, the method of experiment and analysis of data, and the scoring method of quality of experience.

Complement-dependent Cytotoxic Crossmatch for Prevention of Hyperacute Rejection in Canine Renal Allografts (개의 신장 동종 이식에서 초급성 거부반응의 예방을 위한 보체의존성 세포독성 DLA 플래스 I 교차 반응)

  • Ghil Heh Myung;Woo Heung-Myung
    • Journal of Veterinary Clinics
    • /
    • v.22 no.4
    • /
    • pp.322-327
    • /
    • 2005
  • DLA class I complement-dependent cytotoxicity (CDC) cross-match method was established to control hyperacute rejections in organ transplantation. The aim of the present study is to investigate if DLA class 1 CDC corssmatch method is effective to prevent hyperacute rejections in canine renal allografts. Seven mongrel dogs of similar age and weight were used. Erythrocyte crossmatch was first performed and only the negatives were used. Among the same blood types, CDC cross-match was performed. Anti-dog serum, Hank's balanced salt solution(HBSS), and tile self-serum was used as a positive-, a negative-, and all auto-control respectively. After the reaction with class I complement, it was stained with eosin and scored by international cytotoxicity scoring system under inverted phase microscope. According to these results, kidneys oi CDC negatives among same blood types were cross-transplanted to observe the incidence of hyperacute rejections. One of four 1.2 B blood type dogs had autoantibodies. here were negative CDC results among each blood type, and also there were negative results between different blood types. Two pairs with the same blood types and negative CDC results underwent allo-transplantation each other. There were no hyperacute rejections. DLA cross-match method studied in this experiment for canine renal allograft can be effective to prevent hyperacute rejections. it may be applicable for the future studies of histocompatibility testing in canine renal allografts.

A Modified Length-Based Grading Method for Assessing Coronary Artery Calcium Severity on Non-Electrocardiogram-Gated Chest Computed Tomography: A Multiple-Observer Study

  • Suh Young Kim;Young Joo Suh;Na Young Kim;Suji Lee;Kyungsun Nam;Jeongyun Kim;Hwan Kim;Hyunji Lee;Kyunghwa Han;Hwan Seok Yong
    • Korean Journal of Radiology
    • /
    • v.24 no.4
    • /
    • pp.284-293
    • /
    • 2023
  • Objective: To validate a simplified ordinal scoring method, referred to as modified length-based grading, for assessing coronary artery calcium (CAC) severity on non-electrocardiogram (ECG)-gated chest computed tomography (CT). Materials and Methods: This retrospective study enrolled 120 patients (mean age ± standard deviation [SD], 63.1 ± 14.5 years; male, 64) who underwent both non-ECG-gated chest CT and ECG-gated cardiac CT between January 2011 and December 2021. Six radiologists independently assessed CAC severity on chest CT using two scoring methods (visual assessment and modified length-based grading) and categorized the results as none, mild, moderate, or severe. The CAC category on cardiac CT assessed using the Agatston score was used as the reference standard. Agreement among the six observers for CAC category classification was assessed using Fleiss kappa statistics. Agreement between CAC categories on chest CT obtained using either method and the Agatston score categories on cardiac CT was assessed using Cohen's kappa. The time taken to evaluate CAC grading was compared between the observers and two grading methods. Results: For differentiation of the four CAC categories, interobserver agreement was moderate for visual assessment (Fleiss kappa, 0.553 [95% confidence interval {CI}: 0.496-0.610]) and good for modified length-based grading (Fleiss kappa, 0.695 [95% CI: 0.636-0.754]). The modified length-based grading demonstrated better agreement with the reference standard categorization with cardiac CT than visual assessment (Cohen's kappa, 0.565 [95% CI: 0.511-0.619 for visual assessment vs. 0.695 [95% CI: 0.638-0.752] for modified length-based grading). The overall time for evaluating CAC grading was slightly shorter in visual assessment (mean ± SD, 41.8 ± 38.9 s) than in modified length-based grading (43.5 ± 33.2 s) (P < 0.001). Conclusion: The modified length-based grading worked well for evaluating CAC on non-ECG-gated chest CT with better interobserver agreement and agreement with cardiac CT than visual assessment.

Association Between Halitosis and Periodontal Disease Parameters, and Effect of Conscious Sedation on Measurement of Halitosis in Dogs (구취와 치주질환 지표와의 상관성 및 의식하 진정이 구취측정에 미치는 영향에 대한 연구)

  • Ryu, Ji-Won;Kim, Se-Eun;Shim, Kyung-Mi;Kang, Seong-Soo
    • Journal of Veterinary Clinics
    • /
    • v.24 no.4
    • /
    • pp.573-576
    • /
    • 2007
  • The purpose of this study was to evaluate the relationship between periodontal disease and halitosis, and to develop a detail clinical protocol for assessing halitosis in animals. We measured the periodontal disease parameters, the degree of halitosis using organoleptic scale method and the concentration of volatile sulfur compounds(VSC) using portable sulfide monitor($Halimeter^{TM}$). In this study, VSC levels by $Halimeter^{TM}$ were found to be significantly associated with periodontal disease parameters(plaque index, calculus index)(P<0.05). We also found that conscious sedation did not affect the measurement of VSC levels.