• Title/Summary/Keyword: user-centered evaluation

Search Result 127, Processing Time 0.021 seconds

The Structuring Process of Multi‐Centered Usability Evaluation Method (다자 중심적 사용성 평가 방법의 구조화 과정)

  • Kim, Jung-Yong;Lee, Ha-Yeun;Choi, Young-Cheol
    • Journal of the Ergonomics Society of Korea
    • /
    • v.24 no.2
    • /
    • pp.25-33
    • /
    • 2005
  • In order to minimize a biased view of evaluators in usability test, a multiple evaluation method so called Multi-Centered Usability Evaluation Method(MCUEM) was suggested and structured in this study. To use MCUEM, the existing evaluation methods were re-categorized into 'developer and evaluator-centered', 'evaluator-centered', 'user-centered', 'evaluator and user-centered', and the 'developer, evaluator, and user-centered methods. Furthermore, in order to verify the relevance of MCUEM, the usability of mobile phone was tested in this study. In results, it was found that different evaluation methods generated greatly different results, that showed the risk of using a particular usability method due to different perspectives of evaluators. At the same time, it was found that MCUEM could greatly minimize such biases. Therefore, it was concluded that using MCUEM could help the usability engineer design a test protocol with a minimal risk of bias due to different perspective of evaluators.

Usability Test Guidelines for Speech-Oriented Multimodal User Interface (음성기반 멀티모달 사용자 인터페이스의 사용성 평가 방법론)

  • Hong, Ki-Hyung
    • MALSORI
    • /
    • no.67
    • /
    • pp.103-120
    • /
    • 2008
  • Basic components for multimodal interface, such as speech recognition, speech synthesis, gesture recognition, and multimodal fusion, have their own technological limitations. For example, the accuracy of speech recognition decreases for large vocabulary and in noisy environments. In spite of those technological limitations, there are lots of applications in which speech-oriented multimodal user interfaces are very helpful to users. However, in order to expand application areas for speech-oriented multimodal interfaces, we have to develop the interfaces focused on usability. In this paper, we introduce usability and user-centered design methodology in general. There has been much work for evaluating spoken dialogue systems. We give a summary for PARADISE (PARAdigm for Dialogue System Evaluation) and PROMISE (PROcedure for Multimodal Interactive System Evaluation) that are the generalized evaluation frameworks for voice and multimodal user interfaces. Then, we present usability components for speech-oriented multimodal user interfaces and usability testing guidelines that can be used in a user-centered multimodal interface design process.

  • PDF

A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services

  • Lee, Joo-Hwan;Song, Joo-Bong;Yun, Myung-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.31 no.1
    • /
    • pp.63-76
    • /
    • 2012
  • Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.

A Study of Integrated Evaluation of System Lighting and User Centered Guideline Development - Focused on the Lighting Design Method for Office Space - (시스템조명 통합평가 및 사용자 맞춤형 가이드라인 개발 연구 - 사무공간 설계방법을 중심으로 -)

  • Kim, Ju-Hyun;Ko, Jae-Kyu;Cho, Mee-Ryoung
    • Korean Institute of Interior Design Journal
    • /
    • v.23 no.6
    • /
    • pp.78-86
    • /
    • 2014
  • Lighting in indoor space is being changed to system lighting converged with IT technology. Office space lighting with incandescent lamps and fluorescent lamps was completed through overall lighting plan by illumination in most cases, but convergence between LED lighting and IT technology enables the technology of responding to user requirements to be realized. Optical physical quantity suitable for humans and the lighting environment in accordance with user's sensibility, based on space function and user's behavior, would contribute to the improvement of service productivity, energy reduction, and enhancement of emotional satisfaction by providing user optimized lighting solution. Thus, user-customized system lighting guidelines to be applied with integration indicators of optics and sensibility are required. For the design elements required by users, environmental factors, product characteristics, optical characteristics, and sensibility factors are drawn from the design cases for office space and the survey, and the design check list and evaluation indicators are considered to reflect the requirements in the design and requirement indicators to give integrated satisfaction for optics and sensibility are developed. Purpose-centered design method from the user's viewpoint is applied to function-focused design through scenario, and it should be applied flexibly, as the new lightning design method solutions, to the concept design stage of space lighting design and device development. This paper, therefore, presents user-customized guidelines by pursuing the optics and sensibility evaluation and design method combining the requirement conditions and scenario, to be used for lighting content development and design.

Evaluation Criteria for Student-Centered University Education Programs

  • Lim, Hong-Tak
    • International Journal of Contents
    • /
    • v.14 no.3
    • /
    • pp.69-74
    • /
    • 2018
  • A new breed of universities equipped with student-centered education programs and advanced digital technologies is changing the face of higher education. "Flipped learning" is heralded as a new model of education, yet its effect is underexplored. The purpose of this study is to provide evaluation criteria to assess and understand the merit of student-centered education programs and apply them to actual cases. Discussion on the nature of knowledge, its production mechanism and system, and possible contribution of digital technology to user-centered programs are discussed to produce five key criteria; initiative of students, interaction in class, interaction in field, customization of courses, and automated personal service. They are applied to evaluation of Minerva and Ecole 42.

Development of User-centered Fire Safety Evaluation Model for School Buildings (교육시설의 사용자 중심 화재안전수준 평가모형 개발)

  • Park, Sung-Chul;Kim, Jin-Wook
    • Proceedings of the Korean Institute of Building Construction Conference
    • /
    • 2021.11a
    • /
    • pp.238-239
    • /
    • 2021
  • This study presented the development of a user centered school facility fire safety evaluation model that would support fire safety evaluation, which is globally recognized as being important in terms of school safety, to be more efficiently implemented in the school field mainly by students. The study consisted of five steps. First, actual condition survey tools were developed based on the major fire safety evaluation items derived through literature review. Second, the characteristics of domestic school facilities in terms of fire safety were developed using the survey tools. Third, an evaluation model at a level utilizable by students was developed based on the foregoing characteristics. Fourth, the applicability of the model was verified through a trial application of the model to elementary school students. Finally, legal and institutional improvement plans and fire safety education materials were presented through a policy proposal.

  • PDF

Empirical Evaluation of Optimal User-Centered LED Lighting Environments in Residential Bathrooms

  • Lee, Jeongmin;Choi, Kyungah;Suk, Hyeon-Jeong
    • Science of Emotion and Sensibility
    • /
    • v.16 no.3
    • /
    • pp.305-310
    • /
    • 2013
  • This user-centered research aims to empirically evaluate color temperature (K) and illuminance (lx) of residential bathroom lightings to determine the most optimal lighting conditions for productive task performance as well as for satisfying users' emotional needs. Using 3 LED lighting fixtures, 4 types of lighting contexts were investigated; main lighting, task lighting, shower lighting, and bath lighting. Two lightings were installed parallel to the vertical edges of the main bathroom mirror to be used as main and task lighting, while another fixture was installed above the bathtub to be used for shower and bathing. For each lighting context, subjects (N=54) were instructed to perform a few tasks during which time the users were exposed to different lighting conditions with color temperature ranging from 2700 K ~ 6500 K and illuminance ranging from 100 lx ~ 700 lx. Upon completing the given tasks, subjects were asked to evaluate the lighting conditions and their applicability for performing the given tasks. Based on the user evaluations, the most optimal lighting conditions for the different lighting scenarios are as follow: 1) 3500 K ~ 4300 K and 150 lx for main lighting, 2) 3500 K ~ 4300 K and 500 lx ~ 700 lx for task lighting, and 3) 2700 K ~ 3500 K and 100 lx ~ 150 lx for shower/bath lighting. These results can be used to adjust the lighting standards suggested by KS, as well as be utilized by both engineers and designers in designing new types of user-centered bathroom lightings.

  • PDF

An User-Centered Design(UCD) Approach for Ubiquitous Service Evaluation: an Evaluation Metric focus on Human-System Interaction Capability (사용자 중심의 유비쿼터스 서비스 설계 지원을 위한 상호작용성 평가 metric 개발)

  • Lee, Joo-Hwan;Bahn, Sang-Woo;Yun, Myung-Hwan
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.292-297
    • /
    • 2008
  • 유비쿼터스 컴퓨팅 서비스 환경은 사용자와 시스템간의 상호작용성이 매우 중요하며, 이러한 상호작용성을 사용자 중심의 시각에서 평가하기 위한 새로운 평가 기법의 개발이 필요하다. 본 연구는 유비쿼터스 서비스의 특성이 반영된 사용자 중심의 상호작용성 평가 metric 개발을 목표로 한다. 이를 위하여 첫째, 기존의 유비쿼터스 서비스 평가방법론을 검토하여, 유비쿼터스 서비스 평가를 위한 평가 속성을 정의하였으며, 둘째, 대인 서비스 평가기법, 사용성 평가기법, 정신측정학 기반의 평가기법 등의 기존의 서비스 평가방법론의 한계를 극복할 수 있는 사용자중심의 상호작용성 평가 metric 을 개발하였다. 그리고 본 연구에서 제안된 평가 metric 을 u-home 서비스의 평가에 실제로 적용하여 그 유효성을 검증하고 각 지표별 중요도를 구해보았다. 본 연구에서 제안한 상호작용성 평가 metric 은 유비쿼터스 서비스 상호작용성 수준을 평가함으로써 잠재 서비스 사용자들을 분석하고, 제안된 프레임워크의 서비스 개발단계에서의 잠재 서비스 사용자에 대한 요구사항 수렴 및 수준 파악에 유용하게 활용될 수 있다.

  • PDF

A Study of user-centric service model and user satisfaction analysis for information service

  • Kim, Chang-Su;Jung, Hoe-Kyung
    • Journal of information and communication convergence engineering
    • /
    • v.7 no.2
    • /
    • pp.92-97
    • /
    • 2009
  • Lately, influence of information rises and interest about satisfaction estimation of information providing service is risin. According to rapid change in information environment, information-providing service is being changed in various form, in which center development is made in relation to the effort for customer satisfaction intended to enhance user's satisfaction level through providing more convenient and higher service centered on information service user rather than information service provider. Organizations providing information service is also changing their service from traditional one centered on service provider to that for user's satisfaction and service quality, and evaluation of information service quality and measurement of user's satisfaction as the result of using information service are regarded important. In this respect, it is needed to measure user's satisfaction level for environmental factors of information service and analyze what kind of influence they have to enhance user's satisfaction level of information service. Also function and efficiency of information offer service are important. Therefore, interest for satisfaction survey to heighten contents satisfaction of information-providing service, service satisfaction, satisfaction of user of system satisfaction is increased. In this paper, we propose a model of the user satisfaction index for information-providing services and present the user satisfaction index is measured to the model. Also we this study suggest qualitative improvements of information-providing service required for change to user-centric information-providing service through measuring user satisfaction index of ITFIND system and schemes to improve information quality

Development of a Web-based User Experience Certification System based on User-centered System Design Approach (사용자 중심의 웹 기반 제품 사용경험 인증·평가 시스템 개발)

  • Na, Ju Yeoun;Kim, Jihee;Jung, Sungwook;Lee, Dong Hyun;Lee, Cheol;Bahn, Sangwoo
    • The Journal of Society for e-Business Studies
    • /
    • v.24 no.1
    • /
    • pp.29-48
    • /
    • 2019
  • Recently, product design innovation to improve user experience has been perceived as a core element of enterprise competitiveness due to the fierce market competition and decrease of the technological gap between companies, but there is insufficient services to support the product experience evaluation of small and medium-sized companies (SMCs). The aim of this study is to develop a web-based product user experience evaluation and certification system supporting product design practices for SMCs. For system interface design, we conducted systematic functional requirement elicitation methods such as user survey, workflow analysis, user task definition, and function definition. Then main functions, information structure, navigation method, and detailed graphic user interfaces were developed with consideration of user interactions and requirements. In particular, it provides the databases for evaluation efficiency to support the evaluation process above a certain level of performance and efficiency, and knowledge databases to utilize in the evaluation and product design improvement. With help of the developed service platform, It is expected that the service platform would enhance SMCs' product development capability with regard to the user experience evaluation by connecting the consulting firms with SMCs.