• 제목/요약/키워드: Document Evaluation

검색결과 357건 처리시간 0.022초

Use Analysis and Evaluation of MEDLIS(MEDical Library Information System) Document Delivery Service (의학학술지종합정보시스템(MEDLIS)의 원문제공서비스 이용 분석과 평가)

  • Chang, Hye-Rhan;Kim, Jeong-A
    • Journal of the Korean Society for Library and Information Science
    • /
    • 제46권3호
    • /
    • pp.233-250
    • /
    • 2012
  • The purpose of this study is to assess the development, current states, and problems of MEDLIS document delivery service. With the analysis of MEDLIS transaction data from 2001 to 2011, we identified continuous usage decrease, unbalanced contribution by type of institution, high dependence on back issues, use differences among subfields of medicine, relatively low success rate, and various reasons for failure. Based on the results, recommendations for the maintenance of union catalog database, technical support for search capability enhancements, establishment of back issue archiving policy, user training and publicity, and membership expansion are suggested to promote the service.

Automatic Quality Evaluation with Completeness and Succinctness for Text Summarization (완전성과 간결성을 고려한 텍스트 요약 품질의 자동 평가 기법)

  • Ko, Eunjung;Kim, Namgyu
    • Journal of Intelligence and Information Systems
    • /
    • 제24권2호
    • /
    • pp.125-148
    • /
    • 2018
  • Recently, as the demand for big data analysis increases, cases of analyzing unstructured data and using the results are also increasing. Among the various types of unstructured data, text is used as a means of communicating information in almost all fields. In addition, many analysts are interested in the amount of data is very large and relatively easy to collect compared to other unstructured and structured data. Among the various text analysis applications, document classification which classifies documents into predetermined categories, topic modeling which extracts major topics from a large number of documents, sentimental analysis or opinion mining that identifies emotions or opinions contained in texts, and Text Summarization which summarize the main contents from one document or several documents have been actively studied. Especially, the text summarization technique is actively applied in the business through the news summary service, the privacy policy summary service, ect. In addition, much research has been done in academia in accordance with the extraction approach which provides the main elements of the document selectively and the abstraction approach which extracts the elements of the document and composes new sentences by combining them. However, the technique of evaluating the quality of automatically summarized documents has not made much progress compared to the technique of automatic text summarization. Most of existing studies dealing with the quality evaluation of summarization were carried out manual summarization of document, using them as reference documents, and measuring the similarity between the automatic summary and reference document. Specifically, automatic summarization is performed through various techniques from full text, and comparison with reference document, which is an ideal summary document, is performed for measuring the quality of automatic summarization. Reference documents are provided in two major ways, the most common way is manual summarization, in which a person creates an ideal summary by hand. Since this method requires human intervention in the process of preparing the summary, it takes a lot of time and cost to write the summary, and there is a limitation that the evaluation result may be different depending on the subject of the summarizer. Therefore, in order to overcome these limitations, attempts have been made to measure the quality of summary documents without human intervention. On the other hand, as a representative attempt to overcome these limitations, a method has been recently devised to reduce the size of the full text and to measure the similarity of the reduced full text and the automatic summary. In this method, the more frequent term in the full text appears in the summary, the better the quality of the summary. However, since summarization essentially means minimizing a lot of content while minimizing content omissions, it is unreasonable to say that a "good summary" based on only frequency always means a "good summary" in its essential meaning. In order to overcome the limitations of this previous study of summarization evaluation, this study proposes an automatic quality evaluation for text summarization method based on the essential meaning of summarization. Specifically, the concept of succinctness is defined as an element indicating how few duplicated contents among the sentences of the summary, and completeness is defined as an element that indicating how few of the contents are not included in the summary. In this paper, we propose a method for automatic quality evaluation of text summarization based on the concepts of succinctness and completeness. In order to evaluate the practical applicability of the proposed methodology, 29,671 sentences were extracted from TripAdvisor 's hotel reviews, summarized the reviews by each hotel and presented the results of the experiments conducted on evaluation of the quality of summaries in accordance to the proposed methodology. It also provides a way to integrate the completeness and succinctness in the trade-off relationship into the F-Score, and propose a method to perform the optimal summarization by changing the threshold of the sentence similarity.

Analysis of Correlation and Group Difference for Selection of Elementary Fusion Gifted Students (초등융합영재 선발요소의 상관관계 및 그룹 차이 분석)

  • Min, Meekyung;Kim, Kapsu
    • Journal of The Korean Association of Information Education
    • /
    • 제22권4호
    • /
    • pp.491-500
    • /
    • 2018
  • In the era of the Fourth Industrial Revolution, talents should not be subordinated to a particular discipline, but must be able to converge a variety of disciplines. It is important to have a fused thinking because elementary school students are likely to make various changes. Therefore, when selecting elementary gifted students, they are selecting students for fusion gifted students. This study examines the effects of creative problem solving ability, document evaluation, and interview factors on student selection when selecting students for gifted students. The results show that creative problem solving ability has the most influence on selection. In the case of the fifth graders, the creative problem solving ability and the document evaluation influence the selection. In fourth graders, the creative problem solving ability and interview affect the selection. In the case of female students, it was found that creative problem solving ability and document evaluation influenced selection. In addition, there was a gender difference in the evaluation of documents in the gender difference analysis. There is no significant difference between the three groups in the grade-by-grade difference analysis.

Development of Drugs, Devices, and Drug-Device Combinations: Through the Eyes of the Regulator

  • Spyker, Daniel A.
    • Proceedings of the Korean Society of Applied Pharmacology
    • /
    • 한국응용약물학회 1995년도 춘계학술대회
    • /
    • pp.21-27
    • /
    • 1995
  • This document collects Center for Drug Evaluation and Research (CDER) and Center for Devices and Radiological Health (CDRH) guidance documents, citations to the primary literature, and other published and unpublished documents relevant to development and approval of drug/device combinations collected by the CDRH Division of Cardiovascular, Respiratory and Neurological Devices (DCRND). Since the Master Bibliography number represents an accession number, an alphabetical (by author) listing appears at the end of the document, Any citation marked with a, is on file in the DCRND offices, 340B, in the Piccard Building (HFZ-450), 1390 Piccard Avenue, Rockville, MD 20850.

  • PDF

Development and Evaluation of Standard Electronic Documents Based on Conceptual-level Information Models

  • Kim, Hyoung-Do
    • Proceedings of the CALSEC Conference
    • /
    • 한국전자거래학회 2004년도 e-Biz World Conference
    • /
    • pp.332-335
    • /
    • 2004
  • Issues ·Bottom-up v.s. Top-down Development & Evaluation ·Syntax-Directed v.s. Conceptual Modeling -Reusing and Easy understanding -User friendliness and Concrete Rules ·No Aligned Rules and Guidelines for Developing Document Structures from Conceptual Information Models(omitted)

  • PDF

Semantic Document-Retrieval Based on Markov Logic (마코프 논리 기반의 시맨틱 문서 검색)

  • Hwang, Kyu-Baek;Bong, Seong-Yong;Ku, Hyeon-Seo;Paek, Eun-Ok
    • Journal of KIISE:Computing Practices and Letters
    • /
    • 제16권6호
    • /
    • pp.663-667
    • /
    • 2010
  • A simple approach to semantic document-retrieval is to measure document similarity based on the bag-of-words representation, e.g., cosine similarity between two document vectors. However, such a syntactic method hardly considers the semantic similarity between documents, often producing semantically-unsound search results. We circumvent such a problem by combining supervised machine learning techniques with ontology information based on Markov logic. Specifically, Markov logic networks are learned from similarity-tagged documents with an ontology representing the diverse relationship among words. The learned Markov logic networks, the ontology, and the training documents are applied to the semantic document-retrieval task by inferring similarities between a query document and the training documents. Through experimental evaluation on real world question-answering data, the proposed method has been shown to outperform the simple cosine similarity-based approach in terms of retrieval accuracy.

An Implementation of the Report View Generator using Program Performance Log Information (프로그램 성능 평가 로그 정보를 이용한 레포트 뷰 생성기 구현)

  • Cho Yong-Yoon;Yoo Chae-Woo
    • Journal of the Korea Society of Computer and Information
    • /
    • 제10권3호
    • /
    • pp.35-44
    • /
    • 2005
  • A software developer can use a performance evaluation tool to elevate development speed and improve qualify of softwares. But, evaluation results that most performance evaluation tools offer are complicated strings. Therefore, a developer cannot intuitively understand the meanings of the results and must make much times and efforts in analysing the result. In this paper, we propose a report view generator that can transform and provide the text-based performance evaluation results for softwares with various graphic-based views. Our proposed generator consists of a screen generator that creates a structural XML document about the text-based performance evaluation results and a log analyzer that makes various report view through the created XML evaluation document. Because the XML evaluation result document can express the result information structured according to performance evaluation items for resources of softwares, it can have flexibility in offering and integrating the result information for the items. Through the suggested report view generator, developers can intuitively understand and analysis performance evaluation results of embedded software. And they can easily and quickly improve software quality and improve development efficiency of softwares.

  • PDF

Comparison & Analysis of Intrusion Detection System System Protection Profile of NSA and MIC (NSA IDS System PP와 국가기관용 IDS PP 가정사항 비교분석)

  • 김남기;박종오;김지영
    • Convergence Security Journal
    • /
    • 제3권2호
    • /
    • pp.57-65
    • /
    • 2003
  • A protection profile is the required specification document by consumer groups to specify what security purpose they would like to have in their specialized products. A protection profile assumption is the document that specifies consumer environment in the physical, artificial, network perspective and the contents of intended usage which include usage limitation, the value of latent asset, and additional applications for a TOE (Target of Evaluation). In this paper, we compare the assumptions of the NSA IDS PP and the IDS PP for government.

  • PDF

Statistical Techniques for Automatic Indexing and Some Experiments with Korean Documents (자동색인의 통계적기법과 한국어 문헌의 실험)

  • Chung Young Mee;Lee Tae Young
    • Journal of the Korean Society for Library and Information Science
    • /
    • 제9권
    • /
    • pp.99-118
    • /
    • 1982
  • This paper first reviews various techniques proposed for automatic indexing with special emphasis placed on statistical techniques. Frequency-based statistical techniques are categorized into the following three approaches for further investigation on the basis of index term selection criteria: term frequency approach, document frequency approach, and probabilistic approach. In the experimental part of this study, Pao's technique based on the Goffman's transition region formula and Harter's 2-Poisson distribution model with a measure of the potential effectiveness of index term were tested. Experimental document collection consists of 30 agriculture-related documents written in Korean. Pao's technique did not yield good result presumably due to the difference in word usage between Korean and English. However, Harter's model holds some promise for Korean document indexing because the evaluation result from this experiment was similar to that of the Harter's.

  • PDF

A Hangul Document Image Retrieval System Using Rank-based Recognition (웨이브렛 특징과 순위 기반 인식을 이용한 한글 문서 영상 검색 시스템)

  • Lee Duk-Ryong;Kim Woo-Youn;Oh Il-Seok
    • The Journal of the Korea Contents Association
    • /
    • 제5권2호
    • /
    • pp.229-242
    • /
    • 2005
  • We constructed a full-text retrieval system for the scanned Hangul document images. The system consists of three parts; preprocessing, recognition, and retrieval components. The retrieval algorithm uses recognition results up to k-ranks. The algorithm is not only insensitive to the recognition errors, but also has the advantage of user-controllable recall and precision. For the objective performance evaluation, we used the scanned images of the Journal of Korea Information Science Society provided by KISTI. The system was shown to be practical through theevaluationofrecognitionandretrievalrates.

  • PDF