• Title/Summary/Keyword: Evaluation framework

Search Result 1,580, Processing Time 0.03 seconds

A Comparative Evaluation of User Experience Design on Virtual Reality Indoor Bikes (가상현실 실내자전거에 관한 사용자경험설계의 비교 평가)

  • Kim, Sun-Uk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.1
    • /
    • pp.48-55
    • /
    • 2018
  • A framework has recently been developed to evaluate the user experience (UX) design for a virtual reality (VR) indoor bike. However, no comparative evaluation has been performed for an actual product using this framework. This paper investigates the effectiveness of the framework and identifies some problems when applying it. To validate the framework, we applied the proposed framework to a Korean VR indoor bike (KoVIB) prototype and VirZOOM, a commercial VR bike. The evaluation criteria consist of usability, emotional aspects, user values, and sense of reality. These four criteria were interpreted to evaluate prototypes and include 13, 6, 8, and 16 sub-elements, respectively. The results revealed the strengths and weakness between the Korean prototype and the commercial product, which are valuable for promotion and improvement. The framework helps to identify some problems when applied to real domains. As a result, we recommend a revised framework to compare prototypes with existing VR bikes.

Usability Evaluation Framework for Ubiquitous Computing Device (유비쿼터스 디바이스를 위한 사용성 평가 프레임워크 개발 - 디바이스의 Graphical User Interface 중심으로)

  • Kim, Han-Joon;Choi, Jong-Kyu;Ji, Yong-Gu
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02b
    • /
    • pp.131-135
    • /
    • 2008
  • Nowadays various information devices using electronic technology has been released. And these digital devices will be continuously developed to make a satisfaction of customer's needs. So digital device will support network service using communication technology, so users will use the internet service anywhere, anytime. Also the networked device which is used in ubiquitous computing environment should be evaluated by new evaluation framework. Therefore previous usability evaluation framework need to reflect the characteristics of ubiquitous computing. However most of pervious research about ubiquitous computing was about conceptual issues like rules and characteristics of ubiquitous computing, so the research of usability testing and evaluation method for ubiquitous computing is rarely conducted. This research's purpose is developing the evaluation framework for ubiquitous computing device and usability model for ubiquitous computing. To develop the evaluation framework, we collect the evaluation indexes which have need used in GUI evaluation And we extract evaluation indexes for ubiquitous computing based on literature review.

  • PDF

Result Based Evaluation Model and Its Application to Peace Operation of the ROK Military Contingent to UN Mission (한국군의 UN평화활동에 대한 성과기반 평가모델개발과 적용)

  • KWON, Goosoon
    • International Area Studies Review
    • /
    • v.21 no.1
    • /
    • pp.303-324
    • /
    • 2017
  • Current methods to evaluate the performance of ROK military contingents to UN missions unnecessarily raises the issues of relevance, validity and reliability. Thus, this article aims to suggest how the result based evaluation (RBE) model which is widely adopted in the UN field missions as well as the international development community would be modified and applied to peace operation of the ROK contingent. As a result of the study, the model presents a framework that integrates the planning process and monitoring and evaluation with a logical framework, which entails a cycle of assessment of pre-deployment planning, monitoring and phased evaluation, and post-deployment evaluation. Secondly, according to measurement of RBE benchmarks to the present ROK's monitoring and evaluation system, factors in an evaluation unit and a logical framework approach are unmet or partly met to the benchmarks. In addition, ex-post impact evaluation has been rarely performed. Finally, the policy recommendations for resolution of the aforementioned challenges as well as a joint evaluation unit, participated by experts in a civilian, public, and a military domain are proposed.

Development of Collaboration Framework for Injection Mold Design (사출 금형을 위한 협업 설계 시스템의 개발)

  • 정종훈;이건우
    • Korean Journal of Computational Design and Engineering
    • /
    • v.5 no.1
    • /
    • pp.50-60
    • /
    • 2000
  • XML and CORBA have vast potential to improve software interoperability and to facilitate data exchange across applications and people from various disciplines and vendors. This Paper describes a framework for the integration and validity evaluation of injection mold design problems in a network-oriented design environment, based on In and CORBA. An overview of the framework is provided and an application to a design phase of injection mold is illustrated. The example illustrates how design validities are notified and design directions are provided to the designer during design process.

  • PDF

Program Evaluation using the RE-AIM Framework: A Systematic Review and Application to a Pilot Health Promotion Program for Children (RE-AIM 프레임워크를 이용한 프로그램 평가: 체계적 고찰과 어린이 대상 건강증진 프로그램 평가)

  • Lee, Ji-Eun;Shim, Jae Eun;Kim, Kirang;Kang, Jae-Heon;Hwang, Ji-Yun
    • Korean Journal of Community Nutrition
    • /
    • v.27 no.4
    • /
    • pp.296-308
    • /
    • 2022
  • Objectives: This study aimed to develop evaluation criteria for the elementary-school-based health promotion program using the RE-AIM framework and to examine their feasibility. Methods: Previous evaluation studies on health interventions for elementary-school students using the RE-AIM framework were reviewed systematically to identify appropriate evaluation criteria. A diet and physical activity intervention based on the transtheoretical model was implemented in a pilot study using the "Happy Me" application. The feasibility of using the RE-AIM framework to evaluate it was examined. Results: The review yielded the following evaluation criteria: "reach," the ratio of participants out of the total target population; "efficacy/effectiveness," the difference in outcomes between the intervention and control groups, or between a pre- and post-test; "adoption," the rate of use of the program and participation in the next stage of the program; "implementation," the progress on the program components; "maintenance," the participants' and teachers' intention to continue using the program. The pilot study reached 76.6% of the targeted population. The intake of sugar-sweetened beverages decreased (P < 0.0001), and the duration of walking increased (P < 0.0001). Other indicators could not be evaluated; therefore, potential indicators were suggested. Conclusions: This study produced feasible evaluation criteria for elementary-school-based health promotion using the RE-AIM framework. Nevertheless, the feasibility needs to be validated with a broader range of studies and long-term interventions.

BIM-enabled Quantitative Indicators for Analyzing Building Circulation in Early Phase of Design (설계초기 동선 분석을 위한 BIM기반 정량 평가지표 및 평가체계에 관한 연구)

  • Shin, Jaeyoung;Lee, Jin-Kook
    • Korean Institute of Interior Design Journal
    • /
    • v.25 no.4
    • /
    • pp.147-155
    • /
    • 2016
  • In order to ensure a certain level of the quality of design, standardized evaluation indicators are being used as an objective criterion. Even though the evaluation indicators are quantifiable, limitations such as inefficiency and inconsistency caused by manual task in the evaluation process still have been found. BIM (Building Information Modeling) technology that is commonly adopted in architectural design process provides an environment which enables us to figure out a building model to be interpreted quantitatively with the basis of the building information model. It supports quantitative, consistent, accurate and quick evaluations so as to improve quality of design even in the initial design phase. This paper aims to establish BIM-enabled quantitative indicators and an evaluation framework to analyze building circulation even in early phase of design. The indicators are composed of 4 types (relative distance, accessibility, simplicity, pedestrian friendliness) and 7 sub-types. The evaluation framework is the process to derive Parameterized Path Value (PPV) as weighting on each indicator. For demonstrating the scalability of the suggested evaluation indicators and the framework, the authors implemented an evaluation tool and a case study has been carried out by using an actual building remodel project.

A Knowledge Management Assessment Framework Based on Impact of Investment (투자영향분석을 기반으로 한 지식경영 평가방법론 프레임워크)

  • Kim, Kwan-Young;Kwon, Ohbyung
    • Knowledge Management Research
    • /
    • v.9 no.1
    • /
    • pp.117-128
    • /
    • 2008
  • It is very crucial to establishing an evaluation framework for anayzing the investment effects of IT asset such as knowledge managment systems. However, evaluation by quantitative measures, in spite of its usefulness and reliability, may have weakness in examining wide range of effects of the IT investment. Hence, the purpose of this paper is to propose a novel framework to evaluate the performance in terms of wider range of informatization effects. To do so, knowledge management concepts has been adopted in the evaluation method, and Impact Of Investment(IOI) has been suggested. IOI is used to derive Value Of Investment(VOI) and then ROI.

  • PDF

A Study on Establishing an Ecosystem Service Evaluation System in Response to Climate Change Focusing on Garden Value Evaluation Indicators

  • Yejin Park;Yunmi Park;ChangKeun Park
    • Asian Journal of Innovation and Policy
    • /
    • v.12 no.3
    • /
    • pp.277-303
    • /
    • 2023
  • The importance of ecosystem service such as green spaces has risen due to restrictions on outdoor activities amid the climate crisis and COVID-19. While gardens significantly impact economic development, quality of life, and social well-being, comprehensive studies on their multidimensional values are lacking. This research categorizes garden values into social, cultural, environmental, and health dimensions and proposes an integrated assessment framework that introduces detailed elements and evaluation methods. An empirical assessment of carbon storage index in two Korean gardens, Semiwon and Juknokwon, reveals Semiwon's higher carbon storage per unit area. The proposed framework, emphasizing a quantitative approach, enables cross-national and regional comparisons, contributing to a broader understanding and evaluation of garden values beyond specific facilities.

The Weights Analysis of Evaluation Areas and Items for the Informatization Program by means of the AHP (AHP기법을 이용한 정보화지원사업 평가영역 및 평가항목별 가중치 분석)

  • Kim, Sang-Hoon;Choi, Jeom-Ki
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.32 no.2
    • /
    • pp.123-140
    • /
    • 2007
  • This study focuses on establishing theoretically-reasonable framework of evaluation areas and items for the informatization program and analyzing the weights for each area and item by means of the AHP. To obtain the goal of this research, firstly, based on broadly reviewing previous literature and logical reasoning, the evaluation criteria were Identified and conceptualized, which were 3 evaluation phases, 5 evaluation areas, and 22 evaluation items. Secondly, The data used for calculating the weight values for the evaluation criteria were collected from 48 academic and practical experts in the field of the informatization program promotion using internet survey. Thirdly, the relative weights among evaluation phases, evaluation areas, and its items were derived by AHP analysis. The findings of this study are thought not only to be useful as a practical guideline in performing evaluating the informatization program but also to provide significant basis for constructing the theoretical framework of evaluating method and management of the informatization program.

Design and Implementation of the Evaluation Framework for Decentralized Multimedia Streaming Services

  • Park, Sangsoo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.25 no.9
    • /
    • pp.91-100
    • /
    • 2020
  • This paper presents an evaluation framework for prototyping multimedia streaming services including audio and video in a distributed and/or decentralized storage that can evaluate service quality and performance under various network conditions. The evaluation framework focuses on important indicators which measure and improve service quality by applying decentralized storage to multimedia streaming services that can mimic the scalability of the existing server-client software architecture and the issue of a single point of failure. The integrated framework not only measures performance indicators for evaluating the quality and performance of multimedia streaming on open source based multimedia content streaming services, but also adjusts network quality using network virtualization technology for comprehensive evaluations. The experimental results show that the integrated framework has low overhead in building and operating a decentralized storage with multimedia streaming services on a single host computer which validates the scalability of the developed framework.