• Title/Summary/Keyword: User Experience Evaluation

Search Result 277, Processing Time 0.024 seconds

A Basic Study on User Experience Evaluation Based on User Experience Hierarchy Using ChatGPT 4.0 (챗지피티 4.0을 활용한 사용자 경험 계층 기반 사용자 경험 평가에 관한 기초적 연구)

  • Soomin Han;Jae Wan Park
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.2
    • /
    • pp.493-498
    • /
    • 2024
  • With the rapid advancement of generative artificial intelligence technology, there is growing interest in how to utilize it in practical applications. Additionally, the importance of prompt engineering to generate results that meet user demands is being newly highlighted. Exploring the new possibilities of generative AI can hold significant value. This study aims to utilize ChatGPT 4.0, a leading generative AI, to propose an effective method for evaluating user experience through the analysis of online customer review data. The user experience evaluation method was based on the six-layer elements of user experience: 'functionality', 'reliability', 'usability', 'convenience', 'emotion', and 'significance'. For this study, a literature review was conducted to enhance the understanding of prompt engineering and to grasp the clear concept of the user experience hierarchy. Based on this, prompts were crafted, and experiments for the user experience evaluation method were carried out using the analysis of collected online customer review data. In this study, we reveal that when provided with accurate definitions and descriptions of the classification processes for user experience factors, ChatGPT demonstrated excellent performance in evaluating user experience. However, it was also found that due to time constraints, there were limitations in analyzing large volumes of data. By introducing and proposing a method to utilize ChatGPT 4.0 for user experience evaluation, we expect to contribute to the advancement of the UX field.

Investigating Key User Experience Factors for Virtual Reality Interactions

  • Ahn, Junyoung;Choi, Seungho;Lee, Minjae;Kim, Kyungdoh
    • Journal of the Ergonomics Society of Korea
    • /
    • v.36 no.4
    • /
    • pp.267-280
    • /
    • 2017
  • Objective: The aim of this study is to investigate key user experience factors of interactions for Head Mounted Display (HMD) devices in the Virtual Reality Environment (VRE). Background: Virtual reality interaction research has been conducted steadily, while interaction methods and virtual reality devices have improved. Recently, all of the virtual reality devices are head mounted display based ones. Also, HMD-based interaction types include Remote Controller, Head Tracking, and Hand Gesture. However, there is few study on usability evaluation of virtual reality. Especially, the usability of HMD-based virtual reality was not investigated. Therefore, it is necessary to study the usability of HMD-based virtual reality. Method: HMD-based VR devices released recently have only three interaction types, 'Remote Controller', 'Head Tracking', and 'Hand Gesture'. We search 113 types of research to check the user experience factors or evaluation scales by interaction type. Finally, the key user experience factors or relevant evaluation scales are summarized considering the frequency used in the studies. Results: There are various key user experience factors by each interaction type. First, Remote controller's key user experience factors are 'Ease of learning', 'Ease of use', 'Satisfaction', 'Effectiveness', and 'Efficiency'. Also, Head tracking's key user experience factors are 'Sickness', 'Immersion', 'Intuitiveness', 'Stress', 'Fatigue', and 'Ease of learning'. Finally, Hand gesture's key user experience factors are 'Ease of learning', 'Ease of use', 'Feedback', 'Consistent', 'Simple', 'Natural', 'Efficiency', 'Responsiveness', 'Usefulness', 'Intuitiveness', and 'Adaptability'. Conclusion: We identified key user experience factors for each interaction type through literature review. However, we did not consider objective measures because each study adopted different performance factors. Application: The results of this study can be used when evaluating HMD-based interactions in virtual reality in terms of usability.

A Study on the User Experience Factors for The Knowledge and Information Resource System (지식정보자원시스템의 이용자 경험요인에 관한 연구)

  • Chun, Jung Hyun;Lee, Jee Yeon
    • Journal of the Korean Society for information Management
    • /
    • v.37 no.2
    • /
    • pp.353-379
    • /
    • 2020
  • This study developed a user experience factors for the evaluation of knowledge and information resource system from the user experience perspectives, which is emerging as a new analysis standard in the field of information media and information service research. Based on the analysis criteria selected through literature analysis, 'system perception factor' and 'user experience factor' were derived as factors influencing the use of information systems through an experimental study based on the user experience sampling method. As a result, the user experience factors of final knowledge and information resource system includes nine user experience factors, 55 detailed user experience factors, and 138 system perception factors. This study is significant in that the abstract concept 'user experience' was derived and presented as a practical, concrete, measurable factor through experiments. The derived user experience factors should serve as a basis for measuring user experience perceived by users of the knowledge and information resource system.

Roles and Direction of User Experience Design (UX 디자인 업무 역할 및 방향성에 관한 연구)

  • Pan, Young-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.29 no.4
    • /
    • pp.521-525
    • /
    • 2010
  • UX (User Experience) Design was an interdisciplinary approach in humanities, engineering, science and design. We classified the roles of user experience; requirement analysis which are user research, constraints analysis and direction analysis, concept design, information architecture, physical UI, graphical UI, sound UI, Olfactory UI, prototype, evaluation, launch, localization, and knowledge management/UI DB. User research methods were classified by the relation of designer, user, and product/service. We reviewed three issues of UX design; complexity management, efficiency management, and mapping management.

Development of a Web-based User Experience Certification System based on User-centered System Design Approach (사용자 중심의 웹 기반 제품 사용경험 인증·평가 시스템 개발)

  • Na, Ju Yeoun;Kim, Jihee;Jung, Sungwook;Lee, Dong Hyun;Lee, Cheol;Bahn, Sangwoo
    • The Journal of Society for e-Business Studies
    • /
    • v.24 no.1
    • /
    • pp.29-48
    • /
    • 2019
  • Recently, product design innovation to improve user experience has been perceived as a core element of enterprise competitiveness due to the fierce market competition and decrease of the technological gap between companies, but there is insufficient services to support the product experience evaluation of small and medium-sized companies (SMCs). The aim of this study is to develop a web-based product user experience evaluation and certification system supporting product design practices for SMCs. For system interface design, we conducted systematic functional requirement elicitation methods such as user survey, workflow analysis, user task definition, and function definition. Then main functions, information structure, navigation method, and detailed graphic user interfaces were developed with consideration of user interactions and requirements. In particular, it provides the databases for evaluation efficiency to support the evaluation process above a certain level of performance and efficiency, and knowledge databases to utilize in the evaluation and product design improvement. With help of the developed service platform, It is expected that the service platform would enhance SMCs' product development capability with regard to the user experience evaluation by connecting the consulting firms with SMCs.

User Experience Validation Using the Honeycomb Model in the Requirements Development Stage

  • Kim, Neung-Hoe
    • International journal of advanced smart convergence
    • /
    • v.9 no.3
    • /
    • pp.227-231
    • /
    • 2020
  • Recently, the importance of user experience (UX) has been rapidly increasing. Its utilization is emphasized for development of systems, products, and services. User experience is widely used across industries including services, products, processes, society, and culture. Therefore, if it is unsatisfactory, it is likely to have a direct negative impact on the corresponding system, product, or service. The failure to analyze user experience causes significant damage to the project, which may lead to its failure or redevelopment; it is hence necessary to prioritize the verification of UX in the earliest stages of development. The requirements development stage, which is a preceding stage, is an appropriate stage for the verification of user experience because the identification of user needs is completed and prototypes can be implemented. In this paper, we proposed a systematic requirements development stage; it adds user experience verification activities to the requirements development stage, using the Honeycomb model, which is a widely used tool for verifying the overall UX. User experience verification was added to the existing requirements development activities, which consisted of three steps: model definition and requirements placement, discussions between external and internal stakeholders, and review by internal stakeholders. By easily validating the user experience through this systematic requirements development stage, we expect to minimize the damage to the project due to the failure of the user experience analysis and increase the possibility of success.

Evaluating User Experience of Smart Television Using Emotional Representation Language (감정표현어를 이용한 스마트TV의 사용자경험 평가)

  • Byun, Dae-Ho
    • The Journal of the Korea Contents Association
    • /
    • v.15 no.5
    • /
    • pp.132-141
    • /
    • 2015
  • Smart television(TV) is replacing the traditional television model and the importance of user experience(UX) is rising. User experience evaluates the emotion state of users such as immersion, pleasure, and interest. User experience together with usability is a principle to be considered as for designing a smart television. It contributes to improve user satisfaction and lead to the long-term purchase. User experience is more difficult to measure than usability, because UX evaluation requires to biological and psychological techniques. However, the disadvantages of these physiological and psychological techniques require high experimental costs and the restriction of experimental environment. The objective of this paper is first to review conventional methods regarding UX evaluation and suggests a new method for measuring the UX of smart TV which detects keywords related emotional representation. The text is acquired from purchase postscripts of smart TV in the Internet shopping malls. This method costs less than the questionnaire survey to detect emotion.

A Usability Study On Museum Installations Emphasizing Interaction Design for User Experience (사용자 경험 증진을 위한 과학관 전시물의 사용성 평가)

  • Cho, Myung Eun;Choi, Han Hee;Kim, Mi Jeong
    • Korean Institute of Interior Design Journal
    • /
    • v.22 no.5
    • /
    • pp.302-310
    • /
    • 2013
  • Many museums have recently employed digital technologies in exhibition installations to provide visitors with interactive experiences with the installations, not just audiences. However, most of them have focused on the adoption of new prototypes or technologies, not considering user experiences of those systems carefully. This study developed an evaluation tool for usability of the tangible user interfaces and conducted a usability study on museum installations emphasizing user interaction and experience. The evaluation tool is composed of 5 features of tangible user interfaces such as tangible, interaction, convenience, representation, spatial interaction and social interaction, and 24 items. The museum we investigated is the Gwacheon National Science Museum, where 8 installations, classified 4 categories, were selected for the usability study. We recruited 6 undergraduate students, who were divided into 2 teams, each team having 3 students. Three students in a team manipulated and experience each installation together and reported their evaluation score through the questionnaire and interviews. The results showed that the score of the usability for the category 3, which requires students to move their bodies for the interaction, is the highest one because it features with spatial interaction. Students expressed much interest in the category 4, which utilizes users' other senses, however, the score of the usability is the lowest because the interaction is temporary and repetitive. Most installations are well designed in terms of control constraints, legibility, lower thresholds, participation encouragement, and open to the public, but pooly designed in terms of multiple access points, configurability, accurate movement, ambient media, and full-body interaction.

User Experience Evaluation of Menstrual Cycle Measurement Application Using Text Mining Analysis Techniques (텍스트 마이닝 분석 기법을 활용한 월경주기측정 애플리케이션 사용자 경험 평가)

  • Wookyung Jeong;Donghee Shin
    • Journal of the Korean Society for information Management
    • /
    • v.40 no.4
    • /
    • pp.1-31
    • /
    • 2023
  • This study conducted user experience evaluation by introducing various text mining techniques along with topic modeling techniques for mobile menstrual cycle measurement applications that are closely related to women's health and analyzed the results by combining them with a honeycomb model. To evaluate the user experience revealed in the menstrual cycle measurement application review, 47,117 Korean reviews of the menstrual cycle measurement application were collected. Topic modeling analysis was conducted to confirm the overall discourse on the user experience revealed in the review, and text network analysis was conducted to confirm the specific experience of each topic. In addition, sentimental analysis was conducted to understand the emotional experience of users. Based on this, the development strategy of the menstrual cycle measurement application was presented in terms of accuracy, design, monitoring, data management, and user management. As a result of the study, it was confirmed that the accuracy and monitoring function of the menstrual cycle measurement of the application should be improved, and it was observed that various design attempts were required. In addition, the necessity of supplementing personal information and the user's biometric data management method was also confirmed. By exploring the user experience (UX) of the menstrual cycle measurement application in-depth, this study revealed various factors experienced by users and suggested practical improvements to provide a better experience. It is also significant in that it presents a methodology by combines topic modeling and text network analysis techniques so that researchers can closely grasp vast amounts of review data in the process of evaluating user experiences.

An Empirical Study on the User Experience Model of Music Streaming Service (음악 스트리밍 서비스 사용자 경험 모델에 관한 실증 연구)

  • Lee, Jeonga;Kim, Hyung Jin;Lee, Ho Geun
    • Informatization Policy
    • /
    • v.30 no.3
    • /
    • pp.92-121
    • /
    • 2023
  • As music streaming services (MSS) involve various interactions with users during the music consumption process, it is important to understand the user experience and manage the service accordingly. This study developed a user experience model for MSS by theoretically linking the quality characteristics considered important by music service users with the structure of user experience. PLS analysis was then performed using survey data to test the model. As a result, functionality (search, browsing, and personalized recommendation), UI usability, content quality (currentness, sufficiency, relevance), and monetary cost were found to be key experience factors that determine the experience consequence, i.e., user satisfaction. In addition, in a supplementary analysis comparing domestic and global services, differences in user experience were found between the two groups in terms of functionality and content quality. The user experience model of MSS proposed in this study serves as a new foundation for theory-based research in this field and provides meaningful implications for the competitive landscape among music streaming service platforms and for their competitive strategies.