• Journal of Information Science Theory and Practice
• /
• v.8 no.2
• /
• pp.68-78
• /
• 2020

This study is a preliminary study to develop an evaluation framework necessary for evaluating the DataON platform. The first objective is to examine expert perceptions of the level of DataON platform construction. The second objective is to evaluate the importance, stability, and usability of DataON platform features over OpenAIRE features. The third objective is to derive weights from the evaluation perspective for future DataON platform evaluation. The fourth objective is to examine the preferences of experts in each evaluation perspective and to derive unbiased evaluation criteria. This study used a survey method for potential stakeholders of the DataON platform. The survey included 12 professionals with at least 10 years of experience in the field. The 57 overall functions and services were measured at 3.1 out of 5 for importance. Stability was -0.07 point and usability was measured as -0.05 point. The 42 features and services scored 3.04 points in importance. Stability was -0.58 points and usability was -0.51 points. In particular, the stability and usability scores of the 42 functions and services provided as of 2018 were higher than the total functions were, which is attributed to the stable and user-friendly improvement after development. In terms of the weight of the evaluation point, the collection quality has the highest weight of 27%. Interface usability is then weighted 22%. Subsequently, service quality is weighted 19%, and finally system performance efficiency and user feedback solicitation are equally weighted 16%.

• Korea Science and Art Forum
• /
• v.20
• /
• pp.409-419
• /
• 2015

Service Design Platform which has been developing under the sponsorship of the Ministry of Knowledge Economy is aimed at facilitating service design consultancy to carry out service design projects smoothly online. In the development process in order to verify and improve the usability of the platform, heuristic evaluations by usability experts along with usability test done by user participation are required. This study was conducted for the purpose of deriving appropriate evaluation areas and detailed evaluation indices prior to carrying out the heuristic evaluation. For the study, first, the concept of the service design platform was identified and the features of its component were analyzed. Second, based on literature study of standards which are related to usability evaluation indices, usability evaluation areas and indices were analyzed. Third, in order to establish and verify evaluation areas and indices which are appropriate for the evaluation, Delphi survey was conducted and its validity was verified. Through this study, evaluation indices with 4 evaluation areas and 45 detailed items were derived. Derived evaluation indices was made in the form of checklist and will be utilized for heuristic evaluation by usability experts.

• Journal of the Ergonomics Society of Korea
• /
• v.17 no.2
• /
• pp.97-104
• /
• 1998

This study reviews usability of PC communication softwares with different dialogue types of user interface. Usability test was conducted to evaluate usability of 3 PC communition softwares which are currently utilized in Korea. Learnability was adopted as an index of usability evaluation, so learning time, testing time and scores were measured as dependent variables. It is suggested that softwares with mixing dialogue type(menu, icon, command) which were implemented in window systems environment were not superior to that with command dialogue type.

• Journal of the Korea Society of Computer and Information
• /
• v.12 no.6
• /
• pp.59-68
• /
• 2007

The purpose of this paper is to evaluate usability quality through investigating the factors of usability for internet shopping mall websites. For this study, previous studies were investigated and experts' discussions were held. In result, six characters of usability were chosen such as content satisfaction. customer attraction satisfaction, price information satisfaction, public security satisfaction, user interface satisfaction. and process of transaction satisfaction that affect usability of shopping mall websites and the evaluation models of 72 detailed measure factors were established. Since these 72 sub-factors inc)ode the key words of HTML, XML, JSP, and ASP from the target websites. 33 measurable sub-factors in the information were measured through usability evaluation experiment. In addition, a questionnaire about usability measure factors was executed after preferable websites and not preferable websites are selected. After that, we verified the reasonability of usability measure model factors comparing the results of the evaluation experiment with the result of the questionnaire. The time it takes to measure the usability of shopping mall websites can be reduced by using this measurement supporting tool. Also, this tool may be used to estimate the usability during the development of a shopping mall website.

• International Journal of Computer Science & Network Security
• /
• v.23 no.3
• /
• pp.123-129
• /
• 2023

The most effective tutoring method is one-on-one, face-to-face in-person human tutoring. However, due to the limited availability of human tutors, computer-based alternatives have been developed. These software based alternatives are called Intelligent Tutoring Systems (ITS) which are used to tutor students in different domains. Although ITS performance is inferior to that of human teachers, the field is growing and has recently become very popular. User interfaces play key role in usability perspective of ITS. Even though ITS research has advanced, the majority of the work has concentrated on learning sciences while mostly disregarding user interfaces. Because of this, the present ITS includes effective learning modules but a less effective interface design. Usability is one approach to gauge a software's performance, while "ease of use" is one way to assess a software's quality. This paper measures the usability effectiveness of an ITS which is designed to teach Object-Oriented (OO) analysis and design concepts using Unified Modeling Language (UML). Computer Supported Usability Questionnaire (CSUQ) survey was conducted for usability evaluation of UML-ITS. According to participants' responses to the system's usability survey, all responses lie between 1 to 3 scale points which indicate that the participants were satisfied and comfortable with most of the system's interface features.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2001.05a
• /
• pp.109-113
• /
• 2001

The purpose of this paper is to propose an analytical method for evaluating user satisfaction of Internet websites using the structural equation model(SEM). This paper is intended to identify critical evaluation factors of user satisfaction for websites to determine criteria for evaluating the websites, and use the criteria to develop a SEM model for quantitatively evaluation of each factors' effects of user satisfaction. The SEM model used 2 variables of usability and good-looks for the evaluation factors of websites user satisfaction and each factors have 4 sub evaluation criteria, 3 portal sites were evaluated to construct the SEM model, and 155 subjects participated the website evaluation using the walk-through and face-to-face survey method. Analysis results showed that the SEM model was statistically significant for all the 3 websites evaluated. Both the usability and good-looks two factors also showed significant effects to user satisfaction of websites and have positive correlation. The user satisfaction was more effected by the usability factor than good-looks, and the simplification and harmonization were the most critical sub-factors of the usability and good-looks.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.24 no.64
• /
• pp.39-52
• /
• 2001

Usability is playing a more important, role in interactive products or systems (e. g,, information technology Products, computer software) development, and it has become a primary factor in determining the acceptability and consequent success of the products. This study investigates some different techniques and methods to evaluate the usability of the interactive products or system . Various evaluation methods have been tried ranging from formal to informal and empirical techniques. The classification of the usability evaluation methods(UEMs) and comparisons between these evaluation methods are presented. Some issues raised by the UEMs are also discussed. In addition, problems of selecting appropriate usability evaluation methods are discussed.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.20 no.41
• /
• pp.189-196
• /
• 1997

Multimedia systems present information by various media, for example, video, sound, music, animation, movie, etc., in addition to the text which has long been used for conveying the information. But using several media may cause users' confusion and poorly designed user interface often aggravate the situation. Hypermedia systems allow the retrieval and representation of multimedia information using navigation and browsing mechanisms. Typically, there are two major navigation problems in a hypermedia compared to the ordinary user interface: disorientation and cognitive overload. In this study, the multimedia system was studied from the viewpoint of usability. Practical usability evaluation needs cost-effective, low-skill, and low- investment methods. The 'discount usability engineering' method, one of these methods, is based on the use of the following techniques: scenarios, simplified thinking aloud, and heuristic evaluation. The discount usability engineering method was applied to the usability evaluation of multimedia CD-ROM title.

• MALSORI
• /
• no.67
• /
• pp.103-120
• /
• 2008

Basic components for multimodal interface, such as speech recognition, speech synthesis, gesture recognition, and multimodal fusion, have their own technological limitations. For example, the accuracy of speech recognition decreases for large vocabulary and in noisy environments. In spite of those technological limitations, there are lots of applications in which speech-oriented multimodal user interfaces are very helpful to users. However, in order to expand application areas for speech-oriented multimodal interfaces, we have to develop the interfaces focused on usability. In this paper, we introduce usability and user-centered design methodology in general. There has been much work for evaluating spoken dialogue systems. We give a summary for PARADISE (PARAdigm for Dialogue System Evaluation) and PROMISE (PROcedure for Multimodal Interactive System Evaluation) that are the generalized evaluation frameworks for voice and multimodal user interfaces. Then, we present usability components for speech-oriented multimodal user interfaces and usability testing guidelines that can be used in a user-centered multimodal interface design process.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.152-157
• /
• 2008

The customer satisfaction of WAP service greatly relies on the usability of the service due to the limited display size of a mobile phone and limitation in realizing UI (User Interface) for function keys, browser, and OS (operating system) Currently, a number of contents providers develop and deliver varying services, and thus, it is critical to control quality level of UI in consistent standards and manner. This study suggests usability index evaluation system to achieve consistent UI quality control of various WAP services. The system adopts both top-down and bottom-up approaches. The former concerns deriving UI design components and evaluation checklists for the WAP, based on the usability attributes and UI principles. The latter concerns deriving usability-related evaluation checklists from the established UI design features, and then grouping them from the viewpoint of usability principles and attributes. This bidirectional approach has two outstanding advantages: it allows thorough examination of potential elements that can cause usability problems from the standpoint of usability attributes, and also derives specific evaluation elements from the perspective of UI design components that are relevant to the real service environment. The evaluation system constitutes a hierarchical structure by networking usability attributes, UI guideline which indicates usability principles for each attribute, and usability evaluation checklist for each UI component that enables specific evaluation. Especially, each evaluation checklist contains concrete contents and format so that it can be readily marked in O/X. The score is based on the ratio of number of items that received positive answer to the number of total items. This enables a quantitative evaluation of the usability of mobile WAP service. The validity of the proposed evaluation system has been proved through comparative analysis with the real usability problems based on the user test. A software was developed that provides guideline for evaluation objects, criteria and examples for each checklist, and automatically calculates a score. The software was applied to evaluating and improving the real mobile WAP service.