• Science of Emotion and Sensibility
• /
• v.12 no.4
• /
• pp.489-500
• /
• 2009

This research takes a user-centered approach to define relevance, the core concept in information retrieval. The literature on relevance has identified numerous factors affecting such a judgment. We examined the model of user relevance judgment that describes the relationship between user relevance criteria and different types of relevance with information search task. We consider 7 criteria of user relevance-topicality, novelty, reliability, understandability, specificity, richness, and interest-and 3 type of user relevance-cognitive relevance, situational relevance, and affective relevance. Data were collected from a semi-controlled survey and analyzed by a structural equation modeling. As a result, topicality and reliability were found to be the essential relevance criteria in all information retrieval tasks. In the fact search task, topicality, reliability, novelty, richness, and interest were found to be significant. In the problem solving search task, topicality, reliability, understandability, and specificity were found to be significant. In the decision making search task, topicality, reliability, novelty, understandability, richness, specificity, and interest were found to be significant. In addition, the relationships between types of user relevance were determined. This research made theoretical and practical contributions to the field of information retrieval by identifying a definite model of user relevance judgment.

• Journal of the Ergonomics Society of Korea
• /
• v.24 no.2
• /
• pp.25-33
• /
• 2005

In order to minimize a biased view of evaluators in usability test, a multiple evaluation method so called Multi-Centered Usability Evaluation Method(MCUEM) was suggested and structured in this study. To use MCUEM, the existing evaluation methods were re-categorized into 'developer and evaluator-centered', 'evaluator-centered', 'user-centered', 'evaluator and user-centered', and the 'developer, evaluator, and user-centered methods. Furthermore, in order to verify the relevance of MCUEM, the usability of mobile phone was tested in this study. In results, it was found that different evaluation methods generated greatly different results, that showed the risk of using a particular usability method due to different perspectives of evaluators. At the same time, it was found that MCUEM could greatly minimize such biases. Therefore, it was concluded that using MCUEM could help the usability engineer design a test protocol with a minimal risk of bias due to different perspective of evaluators.

• Science of Emotion and Sensibility
• /
• v.15 no.3
• /
• pp.367-380
• /
• 2012

The purpose of this research was to implement and verify an information retrieval(IR) system based on users' relevance criteria for information search tasks. For this purpose, we implemented an IR system with a dynamic ranking model using users' relevance criteria varying with the types of information search task and evaluated this system through user experiment. 45 participants performed three information search tasks on both IR systems with a static and a dynamic ranking model. Three Information search tasks are fact finding search task, problem solving search task and decision making search task. Participants evaluated top five search results on 7 likert scales of relevance. We observed that the IR system with a dynamic ranking model provided more relevant search results compared to the system with a static ranking model. This research has significance in designing IR system for information search tasks, in testing the validity of user-oriented relevance judgement model by implementing an IR system for actual information search tasks and in relating user research to the improvement of an IR system.

• Journal of the Korean Society for Library and Information Science
• /
• v.34 no.2
• /
• pp.117-133
• /
• 2000

This study evaluated two Korean search engines, Korean AltaVista and Naver, using user-based measures by Su(1998). Measures are based on four evaluation criteria: efficiency, precision, validity of the links, user satisfaction. For this study, users conducted searches on two engines with their own search queries and performed relevance judgement. Study results indicate that efficiency, validity of the links, and user' s satisfaction ratios of system features are significantly different between two search engines, although there is no significant difference of precision. This study can be used as a framework for usercentered evaluation and utilized to enhance Korean search engines.

• Informatization Policy
• /
• v.30 no.3
• /
• pp.92-121
• /
• 2023

As music streaming services (MSS) involve various interactions with users during the music consumption process, it is important to understand the user experience and manage the service accordingly. This study developed a user experience model for MSS by theoretically linking the quality characteristics considered important by music service users with the structure of user experience. PLS analysis was then performed using survey data to test the model. As a result, functionality (search, browsing, and personalized recommendation), UI usability, content quality (currentness, sufficiency, relevance), and monetary cost were found to be key experience factors that determine the experience consequence, i.e., user satisfaction. In addition, in a supplementary analysis comparing domestic and global services, differences in user experience were found between the two groups in terms of functionality and content quality. The user experience model of MSS proposed in this study serves as a new foundation for theory-based research in this field and provides meaningful implications for the competitive landscape among music streaming service platforms and for their competitive strategies.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.4
• /
• pp.511-518
• /
• 2009

A lot of methods are proposed to provide services for object informations in distributed domain to satisfy the recent increase of user-centered services. This paper proposed a method called fuzzy drop manager for the service of reliable distribution application domain objects. The proposed system accesses the domain using replica parameter ci,j and access matrix Z, and evaluates the reference relatedness inside the domain using the relatedness, given by the mapping of intra-domain fuzzy relevance, between fuzzy sets. Objects in the domain generated an $\alpha$-level set according to the reference relatedness obtained by applying $\alpha$-level to extend queries. Simulation results showed that the proposed method has better performance than the other methods.

• Journal of Korean Library and Information Science Society
• /
• v.51 no.3
• /
• pp.385-409
• /
• 2020

The purpose of this study is to present the directivity of outcome management through the analysis of public library operations in Seoul. For this purpose, author evaluated the public library policies by linking the 「Metropolitan Comprehensive Library Advancement Plan 2018~2022」 and 「The Third Comprehensive Library Advancement Plan: 2020 implementation plan」 and compiled to draw up the issue of policy development on the awareness of public library services by Seoul citizens. Nest, author analyzed and compared the core infrastructure, collection services, programs and activities of 173 public libraries in 25 local governments. Based on these results, author suggested the directivity of outcome management as follow. All public libraries in Seoul must emphasize the development scope and management methods of the performance indicators. For outcome management, this study emphasized building a strategy planning with the development procedures of performance indicators, categorizing outcome management indicators, developing user-centered indicators, and improving qualitative indicators. As there is a possibility that the quality of services expressed in the output may deteriorate due to the failure of the physical input indicators, it is necessary to strengthen the input and encourage the resolution of the service gap by establishing a performance management system to logically explain the relevance or causal relationship between these indicators.