• Title/Summary/Keyword: Usability score

Search Result 77, Processing Time 0.022 seconds

Development of Safety Activity Application and Usability Evaluation to Improve Risk Perception for Industrial Accident Prevention (산업재해 예방을 위한 위험 지각 증진 안전 활동 어플리케이션 개발 및 사용성 평가)

  • Jong Hyun Lee;Sieun Kim;Eunsol Cho;Kwangsu Moon
    • Journal of the Society of Disaster Information
    • /
    • v.19 no.2
    • /
    • pp.241-253
    • /
    • 2023
  • Purpose: The purpose of this study is to introduce the structure and functions of an application developed for enhancing risk knowledge/perception, called KNOWRISK, and to identify and determine problems and requirements based on the usability evaluation results of the application. Method: The evaluation was conducted using the Mobile App Rating Scale (MARS) with a sample of 43 application users and related experts. Result: The application received a satisfactory evaluation score with an overall average of 4.074 points, and there was no significant difference in evaluation scores between experts and users. The highest score was for ease of use at 4.47, while the lowest score was for cost payment usage at 2.88. Conclusion: The results of this study suggest that efforts to increase risk knowledge and promote safe behavior using a mobile application can be an effective and efficient strategy for preventing industrial accidents and enhancing safety management.

Quantitative Analysis of Construction Site Layout: A Usability Evaluation Study (건설현장배치 수준의 정량적 평가: 사용성평가 방법을 활용하여)

  • Park, Seonghun;Kim, Tae Wan;Son, Bosik
    • Korean Journal of Construction Engineering and Management
    • /
    • v.23 no.5
    • /
    • pp.34-42
    • /
    • 2022
  • Construction site layout is attracting attention as efficient use of construction site space greatly affects the duration and cost of the overall construction. Therefore, there are many studies that automate and optimize construction site layout planning. However, the usability of construction site, which consists of goal variables of the studies, has still been unknown. Therefore, the authors present the evaluation criteria for usability of construction site layout and evaluate the usability of domestic construction sites through user survey. Furthermore, the difference in usability between construction site managers and construction site workers was confirmed. As a result of the survey, domestic construction site layout had a low effectiveness and had the lowest score in the environment category. In addition, construction site workers scored lower overall than construction site managers. Through such usability evaluation results, it contributed to the construction site layout theory by assessing current construction site layout practice and suggesting an improvement direction for automating site layout planning.

Usability Test of Serious Game Robot App for Hospitalized Children (입원 아동 환자를 위한 로봇용 기능성 게임 앱 사용성 평가)

  • Jin, Mei-Ling;Kim, Jeong-Eun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.2
    • /
    • pp.228-234
    • /
    • 2019
  • This study was conducted to evaluate the usability of serious-game apps for robots that are being developed for hospitals to add familiarity to hospital life for hospitalized patients. We conducted a usability test of 10 experts and 12 elementary school students with inpatient experience. The usability evaluation of the developed apps was based on the professional (MARS) evaluation tool and the user (uMARS) evaluation tool. The results of the usability test of the serious game robot app were $3.67{\pm}0.342$ for professionals and $3.68{\pm}0.592$ for children. The expert group obtained the highest score in the aesthetics category, and the user group obtained the highest score in the functionality category. In the subjective comments, the experts pointed out the game layout and the consistency of the style. According to the children, the methods were easy to learn, and the screen movement was mainly described. Both groups received low ratings in terms of engagement through participation. This study will provide useful reference material when the functional game app is actually installed in the robot and the usability test is conducted again after the results obtained in this study are considered.

Financial Analysis of Thai Banks: Effectiveness of Augmented Reality Visualization

  • Tanlamai, Uthai;Jaikengkit, Aim-Orn;Wattanasupachoke, Teerayout
    • Journal of Information Technology Applications and Management
    • /
    • v.24 no.3
    • /
    • pp.51-61
    • /
    • 2017
  • The objective of the study is to examine the acceptance and usability of Augmented Reality (AR) visuals developed for industry analysis of Thai Banks and whether these visuals can outperform the table of numbers in representing financial accounting data. Convenient samples were used and the data were collected with self-assessed questionnaires from 109 users with minimum prior experiences with financial analyses. The results from descriptive statistics indicates that despite having over 80% of respondents with little prior experience in analyzing financial performance of banking industry, the majority of them were able to correctly make prediction (96.4%), identify trend (82.6%) and compare banks' performance (70.6%). Their attitudes and perception towards Bank-AR visuals were above average. Although the overall usability score is average (53%), the respondents rated the Bank-AR visuals to be highly useful and had high intention to use them in the future.

Usability index evaluation system for mobile WAP service (무선인터넷 서비스 사용성 지수 평가 체계)

  • Park, Hwan-Su
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02b
    • /
    • pp.152-157
    • /
    • 2008
  • The customer satisfaction of WAP service greatly relies on the usability of the service due to the limited display size of a mobile phone and limitation in realizing UI (User Interface) for function keys, browser, and OS (operating system) Currently, a number of contents providers develop and deliver varying services, and thus, it is critical to control quality level of UI in consistent standards and manner. This study suggests usability index evaluation system to achieve consistent UI quality control of various WAP services. The system adopts both top-down and bottom-up approaches. The former concerns deriving UI design components and evaluation checklists for the WAP, based on the usability attributes and UI principles. The latter concerns deriving usability-related evaluation checklists from the established UI design features, and then grouping them from the viewpoint of usability principles and attributes. This bidirectional approach has two outstanding advantages: it allows thorough examination of potential elements that can cause usability problems from the standpoint of usability attributes, and also derives specific evaluation elements from the perspective of UI design components that are relevant to the real service environment. The evaluation system constitutes a hierarchical structure by networking usability attributes, UI guideline which indicates usability principles for each attribute, and usability evaluation checklist for each UI component that enables specific evaluation. Especially, each evaluation checklist contains concrete contents and format so that it can be readily marked in O/X. The score is based on the ratio of number of items that received positive answer to the number of total items. This enables a quantitative evaluation of the usability of mobile WAP service. The validity of the proposed evaluation system has been proved through comparative analysis with the real usability problems based on the user test. A software was developed that provides guideline for evaluation objects, criteria and examples for each checklist, and automatically calculates a score. The software was applied to evaluating and improving the real mobile WAP service.

  • PDF

Usability Analysis of Public Libraries' Metaverse Platform (메타버스 내 공공도서관 사용성 분석)

  • JungJo Na;Soyeon Park
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.34 no.2
    • /
    • pp.275-294
    • /
    • 2023
  • This study aims to analyze usability of public libraries' metaverse platform. This study also examines factors that affect usability and immersion of metaverse platform of Gangbuk culture information library, Hanbat library in Daejeon, and Mapo Central library. In order to conduct this study, 60 college students participated in online survey and experiment. There was a statistically significant positive relationship between learnability and usability, and between GUI and immersion in every library. Learnability and usability of Gangbuk culture information library were statistically significantly higher than other libraries. On the other hand, GUI score and immersion of Hanbat library was significantly higher than other libraries. However, given that there were few users connected to metaverse platform, there was no significant difference in interactivity among libraries. This study examines characteristics (including strengths and weaknesses) of metaverse platform of each library. It is expected that the results of this study could contribute to the improvement of usability of public library's metaverse platform.

A Study on the Improvement of Korean Journal Citation Index Service

  • Kim, Suntae
    • International Journal of Knowledge Content Development & Technology
    • /
    • v.11 no.3
    • /
    • pp.63-79
    • /
    • 2021
  • The KJC and KCI services operated by the National Research Foundation of Korea (NRF) need to refer to the global citation index database to set the service direction that researchers want and develop new functions. Therefore, in this study, the usability of Korea's KJC and KCI web databases was evaluated. In addition, FGI verification was performed for a group of experts on KJC and KCI improvement measures derived by academic information experts. The evaluation committee consisted of the researcher group, the society related group, the publisher (academic information distribution organization) group, and the policy-making organization group. A total of 16 experts performed usability evaluation and service improvement proposals for KJC and KCI services. As a result of usability evaluation of KJC and KCI web database using SUS measurement tool, KJC service was evaluated as 73.44, and KCI service was evaluated as good as 64.38. KJC improvement proposals were evaluated positively with 4 points or more for all improvement items, and KCI improvement proposals were positively evaluated with 3.5 points or more for all improvement items. Overall, KJC and KCI error improvements were evaluated with a score of 4 or more, showing strong affirmations. In the future, it is hoped that the improvement proposals and improvements proposed in this study will be applied to the development of KJC and KCI services, so that more quality services will be used by domestic researchers.

Preliminary Assessment Model based on BSC for Evaluating Practical Utilization of 4D CAD System (4D CAD 시스템의 실무적 활용성 평가를 위한 BSC기반의 예비 평가 모델)

  • Kim, HyeonSeung;Moon, HyounSeok;Kang, LeenSeok
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.33 no.5
    • /
    • pp.2069-2079
    • /
    • 2013
  • Recently, BIM(Building Information Modeling) is on the rise as a customized solution for construction environment, but construction companies rarely introduce and apply BIM in the construction site. Due to such issues, the fact that empirical data for evaluating the quantitative effect of BIM application is insufficient might be an another main reason. In the end, construction companies cannot assure investment effect of BIM and therefore don't make an investment actively. To activate BIM application, the evaluation system that quantitatively assess usability of BIM needs to be developed. This study aims to suggest a methodology that evaluates the usability quantitatively according to introduction and operation of BIM by construction companies. Accordingly, this study analyzes applicability of 4D CAD by developing an evaluation index and its model with BSC(Balanced Score Card) for 4D CAD, which have high practical use among BIM techniques, and verifies the usability as the entire evaluation index of BIM. Therefore, it is expected that the developed assessment model will be utilized as the critical decision-making information in order to introduce related techniques by identifying the usability and operational issues of 4D CAD.

Usability of Augmented Reality Picture Book for Young Children (유아를 위한 증강현실 그림책에 대한 사용성 연구)

  • Hyun, Eun-Ja;Choi, Kyoung;Yeon, Hye-Min
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.12
    • /
    • pp.182-189
    • /
    • 2011
  • This study was conducted to evaluate the usability of augmented reality (AR) picture book for young children. The participants of this study were 17 five-year-olds attending to M kindergarten in Korea. The measurement of the usability was conducted by observation and interviews during and after children's AR picture book reading 1) usability test score such as task completed that is, reading the AR picturebook successfully, 2) children's behaviors in the process of reading the book, 3) children's response to the questions asking the level of satisfaction with the AR picture book. The result of study showed that most of children could read the AR successfully adjusting the distance and angle of AR picture book to web-camera's location. And children showed verbal and nonverbal expression such as surprise, joy, questions and frustration in reading the book. Children told that AR picture book is fun and easy to read. This study would provide the implications for the interface development and adult-child book reading of AR picture books.

Development and Usability Evaluation of A Virtual Reality-Based Vestibular Rehabilitation System for Balance Enhancement (균형감각 증진용 가상현실 기반 전정재활 시스템 개발 및 사용성 평가 )

  • Geun-Hong Park;Hyun-Min Lee
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.18 no.4
    • /
    • pp.155-162
    • /
    • 2023
  • PURPOSE: The primary objective of this study was to develop a virtual reality-based vestibular rehabilitation system to enhance balance perception, target rehabilitation specialists, and evaluate its usability. A key goal was establishing a system refinement strategy based on the collected data. METHODS: We conducted a study involving ten adults aged 10 to 29 in Gwangju Metropolitan City to evaluate the usability of a virtual reality-based vestibular rehabilitation system to enhance balance perception. After introducing the product and explaining its use to the participants, balance assessments and training were conducted using computerized dynamic posturography (CDP) (also called the test of balance [TOB]). Subsequently, participants were given a questionnaire to evaluate subjective stability, operability, and satisfaction. Frequency analysis was utilized to determine the frequency of the variable values of the measurement items in the survey for descriptive statistics. RESULTS: We found that the average usability score was 2.587. When broken down by category, stability received an average rating of 2.725, operability scored an average of 2.783, and satisfaction averaged 2.454. These findings suggest that most participants experienced positive sentiments and considerable satisfaction. CONCLUSION: The study successfully developed a virtual reality-based vestibular rehabilitation system, which was an improvement over the previous model and addressed its shortcomings. The results show that users with vestibular impairments are satisfied and more engaged with this system, indicating that additional studies are warranted.