• Journal of the Korean Society for information Management
• /
• v.32 no.3
• /
• pp.277-293
• /
• 2015

This study examined the relative retrieval effectiveness after relevance feedback between two systems (Title/Abstract and Full-text) using four different sets of relevance judgment. Four relevance levels (not relevant, marginally relevant, relevant, highly relevant) are also used, each of which is determined by referees giving a relevance score to documents. This study also investigated how much the average precision was improved after relevance feedback when "marginally relevant" documents are included in the relevant class with the Title/Abstract system, and with the Full-text retrieval system as well. It is found that the Title/Abstract system benefited from relevance feedback with the marginally relevant documents. In case of the Title/Abstract system, the higher percentage of improvement was consistently obtained when including the marginally relevant documents in the relevance class, however the result was vice versa in case of the Full-text retrieval system. It implied that the marginally relevant documents in the relevant class had caused noises in the Full-text retrieval system.

• Proceedings of the Korean Society for Information Management Conference
• /
• 1999.08a
• /
• pp.5-8
• /
• 1999

본 연구는 이용자 지향적인 측면에서 적합문헌평가에 대한 다양한 기준들을 확인하고, 실제 연구자들이 그들의 연구 진행정도에 따라서 적합문헌을 평가하는 기준과 문헌의 적합여부평가에 인식적인 차이를 나타내는지를 밝히는데 그 목적이 있다. 이를 위하여 본 연구에서는 문헌조사연구 방법과 실험연구방법을 병행하여 사용하였다. 먼저 문헌조사 연구를 통하여 본 연구문제의 이론적 배경과 이용자 지향적 적합문헌 평가기준들을 종합적으로 분석하고, 실험에 사용할 평가기준들을 도출하였으며, 실험연구에서는 실제 연구문제를 가지고 있는 5명의 이용자를 무작위로 선정하여 그들의 연구진행 정도에 따른 적합평가기준을 시작(정보입수자각, 관련정보를 수집하는 최초의 단계), 진행(수집정보를 정리하고 초점을 형성, 집필의 시작단계), 완성단계(본격적인 집필과정으로 인용문헌들 결정하는 단계)로 나누어 조사하였다.

• Journal of the Korean Society for Library and Information Science
• /
• v.31 no.2
• /
• pp.177-197
• /
• 1997

The study measured whether two search engines retrieve different Web documents for 6 queries. Two different search engines, Alta Vista in terms of keyword search engines and Yahoo in terms of subject directory engines were measured using as criteria, total number of documents retrieved, total number of relevant documents retrieved, recall and precision ratios. In addition, Alta Vista was suitable for specific and technical terms, while Yahoo was effective for general and plain terms. However, more elaborate research needs to be tested in terms of query characteristics.

• Journal of the Korean Society for information Management
• /
• v.24 no.3
• /
• pp.201-218
• /
• 2007

This study proposes a topic distillation algorithm that ranks the relevant sites selected from retrieved web pages, and evaluates the performance of the algorithm. The algorithm calculates the topic score of a site using its hierarchical structure. The TREC .GOV test collection and a set of TREC-2004 queries for topic distillation task are used for the experiment. The experimental results showed the algorithm returned at least 2 relevant sites in top ten retrieval results. We peformed an in-depth analysis of the relevant sites list provided by TREC-2004 to find out that the definition of topic distillation was not strictly applied in selecting relevant sites. When we re-evaluated the retrieved sites/sub-sites using the revised list of relevant sites, the performance of the proposed algorithm was improved significantly.

• Journal of the Korean Society for information Management
• /
• v.38 no.3
• /
• pp.1-22
• /
• 2021

An online experiment was conducted to test the subject-knowledge view of relevance theory in order to find evidence of a conceptual basis for relevance. Six experts in Library and Information Science (LIS), nine Master's students of LIS, and twelve non-experts judged the relevance of 14 abstracts within and outside of the LIS domain. Consistency among the judges was calculated by joint-probability agreement (PA) and interclass correlation coefficients (ICC). When using PA to analyze the judgements, non-experts had a higher consensus regardless of the task or division of groups. However, ICC calculations found Master's candidates had a higher level of consensus than non-experts within LIS, although the experts did not; and the agreement rates on the non-LIS task for all groups were only poor to moderate. It was only when the groups were analyzed as two groups (experts including Master's candidates and non-experts) that the expected trend of higher consistency among experts in the LIS task was seen.

• Proceedings of the Korean Society for Information Management Conference
• /
• 2005.08a
• /
• pp.235-242
• /
• 2005

이 연구는 현재 문헌정보학 교과과정이 학교도서관 현장에서 요구하는 능력을 갖추는데 적합한가 라는 질문에서 시작하였다. 이 문제에 접근하기 위하여, 먼저 문헌정보학 교과과정에 대한 만족도와 현장 요구 반영도를 조사하였다. 이어, 실제 현장에서 요구하는 지식(Knowledge), 기술(Skill), 태도(Attitude)가 무엇인지를 살펴보았다. 마지막으로, 이러한 현장의 요구를 바탕으로 사서교사를 양성하는데 적합한 교과과정을 제안하였다.

• Journal of the Korean Society for Library and Information Science
• /
• v.30 no.2
• /
• pp.51-86
• /
• 1996

The primary purpose of this study is to verify the difference of behavioural characteristics between the subject specialists and professional searchers in searching full-text databases. The major findings and conclusions from this study are summarized as follows. Analyses of Search questions(the degree of understanding with search questions, the degree of difficulty in selecting terms, and the degree of expectation of search results), search processes(the number of search terms used, the number of Boolean operators and qualifiers used, the number of documents browsed and the search time(the connecting time, time to spend per one output document, time to spend per one relevant output document) and search results(the searching efficiency(the number of relevant documents, the ,recall ratio and the precision ratio), the search cost(the total search cost. the search cost per one output document and the search cost per one relevant output document) and the degree of satisfaction with search results) are significantly different between the subject specialists and professional searchers in searching full-text databases.

• Journal of the Korean Society for Library and Information Science
• /
• v.30 no.1
• /
• pp.49-67
• /
• 1996

The previous study showed a large variation in performance within the queries and suggested that characteristics of queries cotribute to retrieval performance. Three attributes, specificity, complexity and recency were used to analyze the different results within queries. The result showed that subject searching retrieve more relevant documents for a Query with low specificity than a query with high specificity and that queries from the doctoral students' dissertations were specific queries with high specificity.

• Journal of the Korean Society for information Management
• /
• v.13 no.2
• /
• pp.143-163
• /
• 1996

Relevance judgments play a very important role in evaluation of information systems since the degree of success of the information retrieval depends on the relevance judgments. This article reviews the theoretical background of the concept of 'relevance' associated with information retrieval evaluation and tries to identify whether there is any factor that affects relevance judgments. By reviewing previous researches done in the information retrieval evaluation field, four variables have been identified as impacting factors, such as document surrogates presented to judges, the order of presentation, measuring devices of relevance judgments and judges.

• 한국문헌정보학회 학술발표논집
• /
• 2004.04a
• /
• pp.33-59
• /
• 2004

최근 인터넷과 정보통신기술의 발달로 정보검색시스템과 DB의 구축 및 정보서비스가 급격하게 증가하고 있다. 인터넷의 등장과 함께 DB 검색은 도서관이나 정보센터는 물론 일반 국민들에게도 생활화되어 가고 있다. 따라서 늘어나는 DB 중 검색목적이나 필요에 적합한 DB를 선정하여 효율적으로 이용하는 일이 점점 더 중요해지고 있다. 이와 같이 적합한 DB를 선정하여 효율적으로 이용하는 일에는 정보검색시스템이나 DB에 대한 올바른 평가가 전제되어야만 가능한 일이다. (중략)