• Journal of Information Technology Services
• /
• v.16 no.4
• /
• pp.161-176
• /
• 2017

Recently, most of the users can easily get access to a variety of information sources about companies, products, and services through online channels. Therefore, the online user evaluations are becoming the most powerful tool to generate word of mouth. The user's evaluation is provided in two forms, quantitative rating and review text. The rating is then divided into an overall rating and a detailed rating according to various evaluation criteria. However, since it is a burden for the reviewer to complete all required ratings for each evaluation criteria, so most of the sites requested only mandatory inputs for overall rating and optional inputs for other evaluation criteria. In fact, many users input only the ratings for some of the evaluation criteria and the percentage of missed ratings for each criteria is about 40%. As these missed ratings are the missing values in each criteria, the simple average calculation by ignoring the average 40% of the missed ratings can sufficiently distort the actual phenomenon. Therefore, in this study, we propose a methodology to predict the rating for the missed values of each criteria by analyzing user's evaluation information included the overall rating and text review for each criteria. The experiments were conducted on 207,968 evaluations collected from the actual hotel evaluation site. As a result, it was confirmed that the prediction accuracy of the detailed criteria ratings by the proposed methodology was much higher than the existing average-based method.

• Journal of the Ergonomics Society of Korea
• /
• v.29 no.3
• /
• pp.287-296
• /
• 2010

The purpose of this research is to analyze priority of the elderly user interface (UI) evaluation criteria based on user's lifestyle. Since the elderly population will occupy over 20% of the all Korean population in the near future, we need to know older users' needs and information because elderly users will be main customers in the super-aged society. This paper investigated the definition of elderly users and characteristics demographically, socio-economically, and physically/cognitively. A total of 238 questionnaires from older users were analyzed based on a segmentation table for the elderly developed by the previous study. According to factor analysis and cluster analysis, 6 types of lifestyle and 4 groups of the elderly users were classified, respectively. The priority of UI evaluation criteria for large electronic home appliances and mobile products was analyzed by analyses of variance (ANOVAs). The results indicated that the priority of (physical, emotional, and cognitive) UI criteria was significantly different among elderly users' lifestyles for both home appliances and mobile products. Consequently, the results of this study may help the company develop some competitive silver products and give higher satisfaction to the elderly users by suggesting different priority of UI evaluation criteria according to the target elderly group. The results may also contribute to revitalize national economy by significantly increasing senior market shares.

• Proceedings of the ESK Conference
• /
• 1995.04a
• /
• pp.16-22
• /
• 1995

The importance of usability evaluation is increasing in developing a new system and product. The current approaches for usability evaluation are: the comparative evaluation to measure usability, and the iterative user interface design to find usability problems. This paper pressents three types of characteristics and a set of criteria for usability evaluation. The methodology for criteria-based quantitative analysis of user interface usability is investigated with a view to measuring usability. The fuzzy weighted-checklist method with linguistic variables is used for quantitatie analysis. This analysis provides a quantitative measure, which reflects the degree of excellence of user interface usability during the design and development phases.

• Journal of Korean Library and Information Science Society
• /
• v.32 no.4
• /
• pp.197-228
• /
• 2001

The purpose of this study lies in evaluating the quality of Website user interface, with emphasis on the users'perspectives. To the end, we developed an user-oriented evaluation criteria and indicators, and on the basis of these criteria and indicators, conducted a systematic evaluation on the websites of KOSEF's 21 Research Information Centers, which were selected as samples for this study In particular, this study attempted to identify both examples and variables which causes the User group's dissatification on the interface of the sampled websites. Finally suggested are the strategies and methods for improving the quality of user interface in R&D websites.

• Journal of the Ergonomics Society of Korea
• /
• v.24 no.2
• /
• pp.25-33
• /
• 2005

In order to minimize a biased view of evaluators in usability test, a multiple evaluation method so called Multi-Centered Usability Evaluation Method(MCUEM) was suggested and structured in this study. To use MCUEM, the existing evaluation methods were re-categorized into 'developer and evaluator-centered', 'evaluator-centered', 'user-centered', 'evaluator and user-centered', and the 'developer, evaluator, and user-centered methods. Furthermore, in order to verify the relevance of MCUEM, the usability of mobile phone was tested in this study. In results, it was found that different evaluation methods generated greatly different results, that showed the risk of using a particular usability method due to different perspectives of evaluators. At the same time, it was found that MCUEM could greatly minimize such biases. Therefore, it was concluded that using MCUEM could help the usability engineer design a test protocol with a minimal risk of bias due to different perspective of evaluators.

• Korean Institute of Interior Design Journal
• /
• v.23 no.6
• /
• pp.78-86
• /
• 2014

Lighting in indoor space is being changed to system lighting converged with IT technology. Office space lighting with incandescent lamps and fluorescent lamps was completed through overall lighting plan by illumination in most cases, but convergence between LED lighting and IT technology enables the technology of responding to user requirements to be realized. Optical physical quantity suitable for humans and the lighting environment in accordance with user's sensibility, based on space function and user's behavior, would contribute to the improvement of service productivity, energy reduction, and enhancement of emotional satisfaction by providing user optimized lighting solution. Thus, user-customized system lighting guidelines to be applied with integration indicators of optics and sensibility are required. For the design elements required by users, environmental factors, product characteristics, optical characteristics, and sensibility factors are drawn from the design cases for office space and the survey, and the design check list and evaluation indicators are considered to reflect the requirements in the design and requirement indicators to give integrated satisfaction for optics and sensibility are developed. Purpose-centered design method from the user's viewpoint is applied to function-focused design through scenario, and it should be applied flexibly, as the new lightning design method solutions, to the concept design stage of space lighting design and device development. This paper, therefore, presents user-customized guidelines by pursuing the optics and sensibility evaluation and design method combining the requirement conditions and scenario, to be used for lighting content development and design.

• Journal of Internet Computing and Services
• /
• v.3 no.3
• /
• pp.19-29
• /
• 2002

Recently, cyber evaluation systems on the Web-based remote education do not consider the personalized characteristic and propensity of individual students. Especially, in setting of the questions far examination, the traditional simple and general methods for all students group have been used for evaluation. This paper proposes on efficient cyber evaluation system using user profile. First, questions are filtered by using user profile for the personalized characteristic and propensity of individual students, This personalized characteristic and propensity have been disregarded in traditional evaluation systems. And then, filtered questions are set for examination, Therefore, efficiency of the evaluation system is enhanced and students make good results from their study. When user profile is adapted, the setting method of question for examination have combined category-based method with keyword-based method. This make students get the interest and pleasure for questions.

• Smart Media Journal
• /
• v.8 no.3
• /
• pp.70-79
• /
• 2019

Implementing UX design that meets user expectations has become an important variable that determines the prominence of smart home appliances. This study addresses the UX design evaluation issues in mobile application development of smart home appliances. As an experimental research subject, the UX design evaluation contents were set up for the mobile application of , the demand of which is surging recently. The purpose of the research is to explore the significance of the UX design user evaluation method in smart home applications, and to suggest how to achieve the mixing of quantitative and qualitative evaluation methods. The main findings are as follows. First, we found that user evaluation can positively impact the direction of UX design. Secondly, we found that the mixing of 'quantitative' and 'qualitative' methods works complementarily to UX design evaluation. Research implications are as follows. The UX design evaluation process can be performed efficiently as long as we distinguish between the roles of quantitative evaluation and qualitative evaluation. For example, through qualitative evaluation such as 'Honeycomb model', can be identified in terms of 'exploratory', and through qualitative evaluation such as 'in-depth user interview', can be identified in terms of 'assessment' and 'validation'.

• The Journal of Society for e-Business Studies
• /
• v.7 no.1
• /
• pp.19-34
• /
• 2002

The main objective of this research is to find out whether there exist any user interface factors that influence service information management professionals(SIMP)'s business activities on the web. The result of this study shows that there exists a significant level of difference between two groups of office Professionals： SIMP and general office management professionals on user interface factors. We analyzed the past and current research results and focused on four major evaluation categories： (1) web design, (2) structure, (3) navigation, and (4) interaction and identified 26 evaluation items in those categories. The study has been initiated by an intuition that there might be a significant difference in sets of user interface factors that influence SIMP and general office professionals. From the list of Best 100 Web Sites the best 30 information-providing web sites and the best 30 service-providing web sites were carefully chosen by a panel of 10 members for each group. To evaluate 60 web sites, another panel was formed by 30 professionals from each group, and they conducted evaluation in their own work settings. Reliability analysis on user interface factors and T-test to find out any influencing factors on SIMP were performed. As a result of this study, we have recognized that clarity, formation, consciseness, economics, and robustness are the most influencing user interface factors for web designers to concern when they develop web sites for SIMP. The study result can be improved by enhancing reliability of choosing target web sites In investigate and panel members. Also, in the future study it is recommended to investigate influencing factors for office professionals in terms of. age, sex, experience, academic background, etc.

• Journal of the Korean Society for information Management
• /
• v.25 no.3
• /
• pp.99-118
• /
• 2008

As time gees by, the function and role of website become more important. Therefore, it is very critical to evaluate and improve continuously the website to the purpose. Many previous studies show that some website evaluation factors will influence the user satisfaction and revisit to the website. The website evaluation criteria from the previous studies related to the university library website evaluation were classified into five assessment criteria which are design, contents, user interface, reliability, and site management. In the results, some significant suggestions were found out. User satisfaction is seriously affected by user interface, and user's intention to revisit is influenced by contents and reliability, but there may not be a close connection between them. Besides, the evaluation method in this study may be applicable to the new website-improving approach of website administrators and researchers.