• International Journal of Fuzzy Logic and Intelligent Systems
• /
• 제12권2호
• /
• pp.181-186
• /
• 2012

This paper proposes a method for evaluating web pages by considering implicit user reaction on web pages. Usually users spend more time and make more reactions, such as clicking, dragging and scrolling, while reading interesting pages. Based on this observation, a web page evaluation method by observing implicit user reaction is proposed. The system is designed with Ajax for observing user reactions, and neural networks for learning correlation between user reactions and usefulness of pages. The amounts of each type of user reactions are inputted to neural networks. Also the numbers of characters and images of pages are used as inputs because the amount of users' behaviors has a tendency to increase as the length of pages increase. The experiment is conducted with 113 people and 74 pages. Each page is ranked by users with a questionnaire. The proposed method shows more close ranking results to the user ranks than Google. That is, our system evaluates web pages more closely to users' viewpoint than Google. Although our experiment is limited, our result shows powerful potential of new element for web page evaluation. Some approaches evaluate web pages with their contents and some evaluate web pages with structural attributes, particularly links, of pages. Web page evaluation is for users, so the best evaluation can be done by users themselves. So, user feedback is one of the most important factors for web page evaluation. This paper proposes a new method which reflects user feedbacks on web pages.

• 한국경영과학회지
• /
• 제28권4호
• /
• pp.155-189
• /
• 2003

In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.

• 한국경영정보학회:학술대회논문집
• /
• 한국경영정보학회 2007년도 International Conference
• /
• pp.357-362
• /
• 2007

This study presents a methodology that efficiently evaluates and interprets the end-user computing capability in a total perspective in a computing environment. The evaluation system has an evaluation tool, evaluation method and process, and an interpretation system. The validity and reliability of the developed tool construct was verified by factor and reliability analysis with the application of SPSS software. The application and utilization of the developed system was confirmed by applying it to evaluating the computing competency of 316 workers in an enterprise and presenting its evaluation results. This will contribute to developing a methodology for totally evaluating and interpreting the end-user computing capability and improving their computing capability in industrial fields.

• 대한음성학회지:말소리
• /
• 제67호
• /
• pp.103-120
• /
• 2008

Basic components for multimodal interface, such as speech recognition, speech synthesis, gesture recognition, and multimodal fusion, have their own technological limitations. For example, the accuracy of speech recognition decreases for large vocabulary and in noisy environments. In spite of those technological limitations, there are lots of applications in which speech-oriented multimodal user interfaces are very helpful to users. However, in order to expand application areas for speech-oriented multimodal interfaces, we have to develop the interfaces focused on usability. In this paper, we introduce usability and user-centered design methodology in general. There has been much work for evaluating spoken dialogue systems. We give a summary for PARADISE (PARAdigm for Dialogue System Evaluation) and PROMISE (PROcedure for Multimodal Interactive System Evaluation) that are the generalized evaluation frameworks for voice and multimodal user interfaces. Then, we present usability components for speech-oriented multimodal user interfaces and usability testing guidelines that can be used in a user-centered multimodal interface design process.

• 대한인간공학회지
• /
• 제22권2호
• /
• pp.45-56
• /
• 2003

The purpose of this study is to develop the model including multiple causal relationship between factors to evaluate overall user satisfaction and develop an objective method to quantify the impacts and scores of each qualitative factors on overall user satisfaction using Structural Equation Model(SEM) and also test the feasibility to construct a comprehensive website evaluation model including qualitative and quantitative factors. The SEM model used 2 qualitative factors of usability and esthetic factors for the evaluation factors of user satisfaction and select 4 attributes of each factors using factor analysis. 3 shopping mall sites were evaluated to construct the SEM model, and 155 subjects participated the website evaluation using the walk-through and face-to-face survey method. Analysis results showed that the SEM model was statistically significant for all the 3 websites evaluated. Both the usability and esthetic factors showed significant effects to user satisfaction of websites and have positive correlation. The user satisfaction was more effected by the usability factor than esthetic factors, and the simplification and harmonization were the most critical attributes of the usability and esthetic factors.

• 한국HCI학회:학술대회논문집
• /
• 한국HCI학회 2008년도 학술대회 1부
• /
• pp.528-533
• /
• 2008

웹 페이지의 증가에 따라 문서의 질을 파악하는 것은 매우 중요한 문제가 되었다. 방문횟수와 같은 빈도 측정에 기반한 평가는 문서에 대한 사용자의 반응을 반영하기에 부족하다. 사용자는 문서가 사용자의 의도와 관련이 부족하거나 필요가 없는 경우 이용 시간이 매우 짧아진다는 특성을 보인다. 또한 사용자는 웹 페이지 이용 시 다양한 행위를 통해 페이지를 이용하게 된다. 마우스 포인터의 이동이나 클릭, 페이지 스크롤 등 웹 브라우저에서만 이루어지는 다양한 행위가 존재한다. JavaScript 는 브라우저에서 발생하는 이벤트 정보를 축적할 수 있고, 이렇게 수집된 정보를 사용자가 이용하는 도중에 서버로 전송이 가능하다. 본 논문에서는 사용자의 이용 정보를 수집하여 웹 페이지 이용을 분석하여 페이지 평가에 대한 기준을 제시한다.

• 대한인간공학회:학술대회논문집
• /
• 대한인간공학회 1997년도 추계학술대회논문집
• /
• pp.313-319
• /
• 1997

There is currently a focus on usability of interactive computer software. Previous research in software ergonomics has indicated the importance of evaluating the usability of software user interfaces. Software developers, interface designers or human foctors engineers often confront the task of comparative evaluation among systems, versions or interface designs. This study presents a structured model for comparative evaluation of user interface designs using usability criteria and measures. The proposed model consists of twomain phases : the prescreening phase ad the evaluation phase. The first phase involves expert judgment-based approach with qualitative criteria. The prescreening phase uses absolute measurement analytic hierarchy process to filter possible altermative interfaces to a reasonable subset. The second phase involves user-based approach such as usability testing, with quantitative criteria. The objective of the evaluation phase is to evaluate a subset of altermatives using objective measures. A set of criteria and measures for evaluating the usability of computer software designs is presented. The proposed model provides practitioners with a structured approach to select the best interface based on usability criteria and measures.

• 한국전자거래학회지
• /
• 제24권1호
• /
• pp.29-48
• /
• 2019

최근 기업 간 기술격차 해소로 사용경험 개선을 위한 제품 디자인 혁신이 기업 경쟁력의 핵심 요소로 인식되고 있으나 국내 중소 중견 기업들의 사용경험 평가 지원을 위한 서비스 시스템 개발은 미흡한 실정이다. 본 연구는 국내 중소 중견 제조기업의 차별적인 제품 설계를 지원하기 위한 사용자 관점의 웹 기반 제품 사용경험 인증 평가 시스템 개발을 목표로 한다. 사용자 중심의 웹기반 시스템의 인터페이스 설계를 위해 사용자의 기능적 요구사항을 파악한 후, 이를 바탕으로 사용자 중심의 워크플로우 분석, 사용자별 태스크 정의, 사용자 니즈를 고려한 기능 정의를 수행 하였으며 최종적으로 주요 메뉴를 구성해 시스템을 설계하였다. 본 연구를 통해 개발된 사용경험 인증 평가 시스템은 사용자별 인터랙션을 고려해 설계되었으며, 특히 평가 효율화 데이터베이스를 통해 일정 수준 이상의 사용경험 평가 프로세스 수행을 지원하고, 지식 데이터베이스를 제공하여 평가 설계 및 제품 개선에 활용할 수 있도록 하였다. 본 연구를 통해 개발된 서비스 플랫폼은 사용경험 평가를 수행하는 컨설팅업체와 사용경험 평가에 어려움을 겪고 있는 중소 중견기업을 연결함으로써 기업의 실질적 사용경험 평가를 지원하고 자체적인 제품 개발 역량 제고에 기여할 수 있을 것으로 기대된다.

• Nuclear Engineering and Technology
• /
• 제51권2호
• /
• pp.453-462
• /
• 2019

Mental workload (MWL) is a major consideration for the user interface design in nuclear power plants (NPPs). However, each MWL evaluation method has its advantages and limitations, thus the evaluation and control methods based on multi-index methods are needed. In this study, fuzzy comprehensive evaluation (FCE) theory was adopted for assessment of interface designs in NPP based on operators' MWL. An evaluation index system and membership functions were established, and the weights were given using the combination of the variation coefficient and the entropy method. The results showed that multi-index methods such as performance measures (speed of task and error rate), subjective rating (NASA-TLX) and physiological measure (eye response) can be successfully integrated in FCE for user interface design assessment. The FCE method has a correlation coefficient compared with most of the original evaluation indices. Thus, this method might be applied for developing the tool to quickly and accurately assess the different display interfaces when considering the aspect of the operators' MWL.

• 디지털산업정보학회논문지
• /
• 제10권4호
• /
• pp.127-132
• /
• 2014

Some laws and regulations may require internet service providers to provide services based on the age of users. Age verification in the online environment should be used as a tool to provide service that is appropriate to child based on age. Using the minimum attribute information, processes on age verification provides the proper guidance to the internet services. However, there is a lack of a globally accepted trust framework for age verification process including evaluation factors for age verification information. In this paper the federation model of user attributes were described and evaluation factors for the age verification information were suggested. Also using the suggested evaluation factors, performance evaluation of federation model of user evaluation was performed. To meet the requirements of evaluation factors, framework of federation model should consider the unlinkability pseudonym support, eavesdropping protection and cloning protection.