• Journal of the Korean Society for information Management
• /
• v.31 no.1
• /
• pp.189-206
• /
• 2014

The purposes of this study are to analyze relevance judgement of college students' problem solving process and suggest improvements for information literacy education in higher education. The in-depth interviews were conducted with 9 subjects to identify relevance judgement processes and problems. As a result, the main problems during relevance judgement processes were judgement about content of document aligned with subject's opinion, judgement about reliability of newspaper articles, shortage of relevance judgement time due to deadline of an assignment and judgement of relationship of documents and evaluation result. The recommendations for information literacy education are as follows: objective relevance judgement education, guidance of reliable information source;showing guideline of using reference information by professor and emphasis of engaging in information (4.1 stage of Big 6).

• Science of Emotion and Sensibility
• /
• v.15 no.3
• /
• pp.367-380
• /
• 2012

The purpose of this research was to implement and verify an information retrieval(IR) system based on users' relevance criteria for information search tasks. For this purpose, we implemented an IR system with a dynamic ranking model using users' relevance criteria varying with the types of information search task and evaluated this system through user experiment. 45 participants performed three information search tasks on both IR systems with a static and a dynamic ranking model. Three Information search tasks are fact finding search task, problem solving search task and decision making search task. Participants evaluated top five search results on 7 likert scales of relevance. We observed that the IR system with a dynamic ranking model provided more relevant search results compared to the system with a static ranking model. This research has significance in designing IR system for information search tasks, in testing the validity of user-oriented relevance judgement model by implementing an IR system for actual information search tasks and in relating user research to the improvement of an IR system.

• Science of Emotion and Sensibility
• /
• v.12 no.4
• /
• pp.489-500
• /
• 2009

This research takes a user-centered approach to define relevance, the core concept in information retrieval. The literature on relevance has identified numerous factors affecting such a judgment. We examined the model of user relevance judgment that describes the relationship between user relevance criteria and different types of relevance with information search task. We consider 7 criteria of user relevance-topicality, novelty, reliability, understandability, specificity, richness, and interest-and 3 type of user relevance-cognitive relevance, situational relevance, and affective relevance. Data were collected from a semi-controlled survey and analyzed by a structural equation modeling. As a result, topicality and reliability were found to be the essential relevance criteria in all information retrieval tasks. In the fact search task, topicality, reliability, novelty, richness, and interest were found to be significant. In the problem solving search task, topicality, reliability, understandability, and specificity were found to be significant. In the decision making search task, topicality, reliability, novelty, understandability, richness, specificity, and interest were found to be significant. In addition, the relationships between types of user relevance were determined. This research made theoretical and practical contributions to the field of information retrieval by identifying a definite model of user relevance judgment.

• Journal of Korean Library and Information Science Society
• /
• v.31 no.4
• /
• pp.139-164
• /
• 2000

본 연구는 이용자 지향적 평가의 의의와 타당성을 규명하기 위하여 연구과정에서 개인의 지식과 상황 및 인지적 요인의 변화에 따라 이용자가 인식하는 검색문헌의 적합성을 평가하는 기준들의 변화를 규명하는데 그 목적이 있다. 연구의 방법은 이론가설을 설정하고 이의 검증을 위하여 실제 연구문제를 가지고 있는 5명의 이용자를 대상으로 그들의 연구과정에 따라 적합성을 평가하는 기준들과 그 기준들의 변화양상을 관찰하는 실험을 수행하였다. 실험결과의 분석에는 빈도분석, 상관분석, 일원분산분석이 활용되었다. 그 결과 연구자들은 연구과정에 따라 적합성을 평가하는 기준이 다르게 나타났으며, 평가자에 따라서도 각기 다른 평가기준이 사용되고 있음을 확인할 수 있었다.

• Journal of the Korea Society of Computer and Information
• /
• v.3 no.1
• /
• pp.35-46
• /
• 1998

In the Information Retrieval System. the relevance of retrieved items is determined by the judgement of the user and thus the evaluation of the system efficiency counts on the cognizance of users to some extent. The relevance feedback mechanism provides a device allowing iterative searches during which the query can be modified and refined based on user input from the relevant documents. The feedback system are generally reported to outperform non-feedback systems. The procedures and algorithms to implement the feedback mechanism are surveyed in this paper.

• Journal of the Korean Society for information Management
• /
• v.23 no.2
• /
• pp.97-111
• /
• 2006

The purpose of this study is to investigate what level of difference in precision would be significantly perceived by a human user of an information retrieval system. Not many researches have been conducted with regards to this issue in information retrieval field. Despite the non-significant results, there were several interesting findings in recognizing different levels of precision rates. The correctness of relevance task had little to do with the taken time for the task. In addition, the strong relationship between the subjects' topic familiarity and rate of correct judgments is one of the most interesting results in this study. It turned out that the subjects have more difficulty in a situation they have to judge between the two lists having more non-relevant documents than in a situation they do between the lists haying more relevant documents. Finally, the serious influence from the first top N documents in a list for relevance judgment task has been confirmed.

• Journal of the Korean Society for information Management
• /
• v.32 no.3
• /
• pp.377-396
• /
• 2015

This study proposed a key-frame automatic extraction method for video storyboard surrogates based on users' cognitive responses, EEG signals and discriminant analysis. Using twenty participants, we examined which ERP pattern is suitable for each step, assuming that there are five image recognition and process steps (stimuli attention, stimuli perception, memory retrieval, stimuli/memory comparison, relevance judgement). As a result, we found that each step has a suitable ERP pattern, such as N100, P200, N400, P3b, and P600. Moreover, we also found that the peak amplitude of left parietal lobe (P7) and the latency of FP2 are important variables in distinguishing among relevant, partial, and non-relevant frames. Using these variables, we conducted a discriminant analysis to classify between relevant and non-relevant frames.

• Journal of the Korean Society for Library and Information Science
• /
• v.34 no.2
• /
• pp.117-133
• /
• 2000

This study evaluated two Korean search engines, Korean AltaVista and Naver, using user-based measures by Su(1998). Measures are based on four evaluation criteria: efficiency, precision, validity of the links, user satisfaction. For this study, users conducted searches on two engines with their own search queries and performed relevance judgement. Study results indicate that efficiency, validity of the links, and user' s satisfaction ratios of system features are significantly different between two search engines, although there is no significant difference of precision. This study can be used as a framework for usercentered evaluation and utilized to enhance Korean search engines.

• The Journal of Information Systems
• /
• v.18 no.2
• /
• pp.127-150
• /
• 2009

Although many employees in the logistics/small package express companies are using mobile information systems. there is little research on the individual impacts of adopting mobile information systems in the distribution area. Therefore, this study attempts to develop the research model to evaluate individual impacts on using mobile information systems which are frequently utilized in logistics and small package express companies. In order to propose the research model, we attempt to incorporate technology acceptance model and IS success model to evaluate individual impacts on using mobile information systems. To verify the research model, we collected 225 data from staffs who have mobile IT system in distribution and logistics area. We also verified the validity and reliability by using SEM(structural equation modeling). As a results, we found that system use, cognitive judgement and attitude can be the key variables to improve individual impacts by using mobile information system. We further found that perceived usefulness can be ere of the Imp factors to improve the individual impacts. Based on out findings, we can understand that this research model can provide a deeper understanding of individual impacts of mobile information systems.

• Journal of Korea Port Economic Association
• /
• v.28 no.3
• /
• pp.167-192
• /
• 2012

The purpose of the study aims to analyse the judgement criterion of arrived ship under voyage charterparty with the Merida Case. A ship is an arrived ship if she is in port and either able to proceed immediately to a berth or in such a position that she is at the immediate and effective disposition of the chaterparty. Identification of the specified destination-whether berth or port-impacts on the incidence of loss occasioned by delay in loading or discharging, when the delay is due to the place at which the vessel is obliged by the terms of the charterparty to load or discharge her cargo being occupied by other shipping. The Merida case is an appeal by the charterers from a final Arbitration award of two very experienced arbitrators, dated 20th April, 2009. The arbitrators held that a voyage charterparty, dated 5th February, 2007, of the vessel, The M/V Merida, entered into between charterers and the owners, was a port rather than a berth Charterparty. The Primary relevance of this distinction does to the allocation, as between owners and charterers, of the risk of delay caused by congestion at load and discharge ports. The question of law arising in this appeal is whether the arbitrators were right to conclude that the charterparty was a port and not a berth charterparty. The arbitrators additionary placed some reliance on a post-contractual e-mail from the agents, which suggested that charterers did not dispute the validity of the NOR-and, hence, that this was a port charterparty.