• 제목/요약/키워드: Evaluation Metrics

검색결과 505건 처리시간 0.028초

IT 성숙도 모델을 이용한 SLA 평가 지표 선정과 개선에 관한 연구 (A Study on Selection and Improvement of SLA Evaluation Metrics Using IT Maturity Model)

  • 류성열;신성진;김유리
    • 한국IT서비스학회지
    • /
    • 제8권4호
    • /
    • pp.141-150
    • /
    • 2009
  • There are no objective standards for selection and improvement of SLA evaluation metrics for IT service. In this study, we analyze the current IT maturity models for selection and improvement of the metrics and then we derive them according to the maturity levels and propose the redesigned maturity model. To verify whether the model is applicable, we execute a case study based on the D company. We apply the proposed evaluation metrics of the maturity models to the D company and evaluate the metrics. We select a proper level of the D company and an improvement line after measuring evaluation metrics in the maturity level 2. We propose improvement guidelines of evaluation metrics which score is less than the improvement line's and derive SLA evaluation metrics. By using the SLA evaluation metrics for a year, we prove that the way of selection and improvement is useful.

ISO/IEC 9126-2 메트릭을 활용한 소프트웨어 정량적 평가 지표 도출 (Quantitative Evaluation Index Derivation of the Software Based on ISO/IEC 9126-2 Metrics)

  • 조성호;장중순
    • 한국신뢰성학회지:신뢰성응용연구
    • /
    • 제16권2호
    • /
    • pp.134-146
    • /
    • 2016
  • Purpose: Many domestic companies have to make out quantitative evaluation table in their proposal when they conduct the software R&D project. However, most of companies have a difficulty to select the evaluation items and criteria, also to derive a quantitative results. Therefore, we propose a method to derive the quantitative evaluation index by utilizing the ISO/IEC 9126-2. Methods: Analyzing ISO/IEC 9126-2, and we classify the quality metrics as high-classification and sub-classification for Web/App software, Embedded software and Installation software. Next, Conduct the metrics selection survey depending on importance and necessity. Then, carry out the case study. Verify the correspondence between evaluation items and criteria from original suggestion of company and from outcome by utilizing the ISO/IEC 9126-2 quality metrics. Results: It is possible to classify into two metrics, one for common software or one another for only special software. Furthermore, there is quality metrics that is more important and more necessary depending upon characteristics of the software. Conclusion: ISO/IEC 9126-2 quality metrics can be used to make an evaluation items and criteria for quantitative evaluation table of software product.

Evaluation Metrics for Class Hierarchy in Object-Oriented Databases: Concurrency Control Perspectives

  • Jun Woo-Chun
    • 한국멀티미디어학회논문지
    • /
    • 제9권6호
    • /
    • pp.693-699
    • /
    • 2006
  • Object-oriented databases (OODBs) have been adopted for managing non-standard applications such as computer-aided design (CAD), office document management and many multimedia applications. One of the major characteristics of OODBs is class hierarchy where a subclass is allowed to inherit the definitions defined on its superclasses. In this paper, I present the evaluation metrics for class hierarchy quality in OODBs. These metrics are developed to determine if a concurrency control scheme can achieve good performance or not on a given class hierarchy. I first discuss the existing concurrency control schemes for OODBs. Then I provide evaluation metrics based on structural information and access frequency information in class hierarchies. In order to discuss significance of the proposed performance metrics, an analytical model is developed. Analysis results show that the performance metrics are important factor in concurrency control performance. I consider both single inheritance and multiple inheritance. The proposed metrics can be used to provide guidelines on how to design class hierarchy of an OODB for maximizing the performance of concurrency control technique.

  • PDF

SLA 평가 지표 선정과 개선 방안에 관한 사례 연구 (A Case Study on Selection and Improvement of SLA Evaluation Metrics)

  • 신성진;류성열;김유리
    • 정보처리학회논문지D
    • /
    • 제16D권4호
    • /
    • pp.541-548
    • /
    • 2009
  • 최근 기업에서는 SLA를 도입하여 IT 서비스를 수행하고 있다. 하지만 SLA 평가 지표의 선정과 개선에 대한 객관적인 기준이 없기 때문에 IT 서비스의 발전 방안을 제시하기 어렵다. 본 연구에서는 기존의 IT 성숙도 모델에서 사용된 평가 속성을 기반으로 하여 SLA 평가 지표의 선정과 개선을 위한 기준에 맞는 측정 지표를 도출하고 이를 제안한다. 제안한 측정 지표의 적용 가능성을 검증하기 위하여 본 연구에서는 D사에 기반을 둔 사례 연구를 수행하였다. D사의 현황에 맞는 측정 지표를 적용 및 평가 하여 개선 목표선을 지정하고, 개선 목표선 이하의 점수를 가진 측정 지표에 대한 개선 지침을 제시하여 각 측정 지표에 대한 SLA 평가 지표를 도출한다. 도출된 SLA 평가 지표를 D사의 사례에 1년 간 적용하여 지표 선정 및 개선의 방법이 유용함을 입증하였다.

Development of Evaluation System for Defense Informatization Level

  • Sim, Seungbae;Lee, Sangho
    • Journal of Multimedia Information System
    • /
    • 제6권4호
    • /
    • pp.271-282
    • /
    • 2019
  • There is a description that you cannot manage what you do not measure. The Korea Ministry of National Defense (MND) is conducting evaluations in various fields to obtain meaningful effects from IT investments, and views that the evaluation of the defense informatization sector is divided into defense informatization policy evaluation and defense informatization project evaluation. The defense informatization level evaluation can measure the informatization level of MND and the armed forces or organizations. Since the evaluation system being studied to measure the level of defense informatization is composed mainly of qualitative metrics, it is necessary to reconstruct it based on quantitative metrics that can guarantee objectivity. In addition, for managing the level of change by evaluation objects, the evaluation system should be designed with a focus on homeostasis of metrics so that it can be measured periodically. Moreover, metrics need to be promoted in terms of performance against targets. To this end, this study proposes to measure the level of defense informatization by dividing it into defense information network, computer systems, interoperability and standardization, information security, information environment, and information system use, and suggests their metrics.

Development of Performance Evaluation Metrics of Concurrency Control in Object-Oriented Database Systems

  • 전우천;홍석기
    • 인터넷정보학회논문지
    • /
    • 제19권5호
    • /
    • pp.107-113
    • /
    • 2018
  • Object-oriented databases (OODBs) canbe used for many non-traditional database application areas such as computer-aided design, etc. Usually those application areas require advanced modeling power for expressing complicated relationships among data sets. OODBs have more distinguished features than the traditional relational database systems. One of the distinguished characteristics of OODBs is class hierarchy (also called inheritance hierarchy). A class hierarchy in an OODB means that a class can hand down the definitions of the class to the subclass of the class. In other words, a class is allowed to inherit the definitions of the class from the superclass. In this paper, we present performance evaluation metrics for class hierarchy in OODBs from a concurrency control perspective. The proposed performance metrics are developed to determine which concurrency control scheme in OODBs can be used for a given class hierarchy. In this study, in order to develop performance metrics, we use class hierarchy structure (both of single inheritance and multiple inheritance), and data access frequency for each class. The proposed performance metrics will be also used to compare performance evaluation for various concurrency control techniques.

Java 프로그램의 품질평가를 지원하는 메트릭 측정 시스템 (Metrics Measurement System Supporting Quality Evaluation of Java Program)

  • 박옥자;유철중;장옥배
    • 한국정보과학회논문지:컴퓨팅의 실제 및 레터
    • /
    • 제7권2호
    • /
    • pp.151-164
    • /
    • 2001
  • 최근 가장 대표적인 객체지향 언어로 사용되는 Java는 일반적인 애플리케이션뿐만 아니라 인터넷/인트라넷 기반 프로그램 개발, 나아가 컴포넌트 기반 개발에 이르기까지 다양한 분야에서 개발 언어로 사용되고 있다. 따라서 개발된 프로그램의 재사용 및 유지보수 관점에서 프로그램 품잘평가는 보다 중요한 쟁점이 되고 있으므로 기존의 Java 애플리케이션을 포함하여 현재 개발된 프로그램의 품질평가에 필요한 메트릭 측정이 필요하다. 하지만, 이미 제안된 객체지향 소프트에어 메트릭이 현재의 Java 프로그램의 특성에 적합한지에 대한 타당성 검증이 필요하므로 본 논문에서는 기존의 객체지향 메트릭이 Java 프로그램에 적합한지 여부를 결정하기 위해 필요한 메트릭 측정 시스템을 구축하여 Java 프로그램에 적합한 메트릭 제안을 지원하고자 한다. 본 시스템은 Briand가 기존의 객체지향 소프트웨어 메트릭을 수학적으로 정형화시켜 분류한 메트릭을 Java 프로그램에 적용시켜 제안된 메트릭이 프로그램에 타당성 있는지 검증함으써 명확한 품질평가도구 개발을 지원하고자 한다. 본 시스템을 통해 Java 소스 프로그램으로부터 정량적 정보를 보다 빠르고 정확하게 산출함으로써 기존의 객체지향 메트릭에 대한 검증을 비교 및 분석 수행할 수 있으며, 타당성 문제가 있다면 새로운 메트릭의 제안 및 보완을 고려함으로써 Java 프로그램에 적합한 메트릭 확립을 가능하게 할 것이다.

  • PDF

게임의 멀티미디어 데이터 품질평가지표 연구 (A study of Multimedia Data Quality Evaluation Metrics of the Game)

  • 윤선정
    • 한국컴퓨터정보학회논문지
    • /
    • 제18권9호
    • /
    • pp.63-70
    • /
    • 2013
  • 게임의 멀티미디어 데이터는 그 품질에 따라 게임의 몰입에 영향을 준다. 예술적인 품질은 평가기준을 설계하기가 어렵지만 기술적인 관점에서 평가할 수 있는 부분에 대해서는 평가기준을 설계하는 것이 품질의 신뢰성과 객관성을 확보할 수 있다. 그러나 게임의 멀티미디어 데이터에 대한 품질평가 기준은 아직 설계된 것이 없다. 따라서 본 연구에서는 게임의 멀티미디어 데이터에 대한 품질평가 요소를 추출하고, 추출 요소에 대한 신뢰성을 검증하였다. 그리고 각 요소에 대한세부평가내용을 정의하고, 평가지표를 개발하였다. 본 연구의 결과는 고품질의게임 개발에 가이드 역할을 하며 게임산업의 성장에 긍정적인 영향을 줄 것으로 기대한다.

EVALUATION OF PROLIFERATION RESISTANCE USING THE INPRO METHODOLOGY

  • Yang, Myung-Seung;Park, Joo-Hwan;Ko, Won-Il;Song, Kee-Chan;Choi, Kun-Mo;Kim, Jin-Kyoung
    • Nuclear Engineering and Technology
    • /
    • 제39권2호
    • /
    • pp.149-160
    • /
    • 2007
  • The IAEA launched the International Project on Innovative Nuclear Reactors and Fuel Cycles (INPRO) and developed the INPRO Methodology to provide guidelines and to assess the characteristics of a future innovative nuclear energy system in areas such as safety, economics, waste management, and proliferation resistance. The proliferation resistance area of the INPRO Methodology is reviewed here, and modifications for further improvements are proposed. The evaluation metrics including the evaluation parameters, evaluation scales and acceptance limits are developed for a practical application of the methodology to assess the proliferation resistance. The proliferation resistant characteristics of the DUPIC fuel cycle are assessed by applying the modified INPRO Methodology based on the developed evaluation metrics and acceptance criteria. The evaluation procedure and the metrics can be utilized as a reference for an evaluation of the proliferation resistance of a future innovative nuclear energy system.

Utilizing Usability Metrics to Evaluate a Subway Map Design

  • Jung, Kwang Tae
    • 대한인간공학회지
    • /
    • 제36권4호
    • /
    • pp.343-353
    • /
    • 2017
  • Objective: This study aims to evaluate the efficiency of two representative subway map design types, namely a diagram type and a geographical type using physiological metrics, performance metrics, and self-reported metrics, which are representative usability metrics. Background: Subway maps need to be designed in order for users to quickly search and recognize subway line information. Although most cities' subway maps currently use the diagram type designed by Henry Beck, New York City's subway map has recently been changed to the subway map type combined with the geographical type designed by Michael Hertz. However, not many studies on its efficiency are found, and the studies that are available mainly depend on questionnaire surveys or take on a subjective behavioral study type based on experts' experiences. In this regard, evaluation through a more objective method is needed. Method: This study employed usability metrics as a method to evaluate the efficiency of information search targeting the diagram type and geographical type subway maps used mostly as subway maps. To this end, physiological metrics obtained through eye tracking, task completion time, representative metric of task performance, and subjective evaluation metrics were used for the suitability evaluation of subway map designs. Results: In the result of gaze movement distance analysis, no significant difference was shown in the two design types in terms of a process finding a departure station from the starting point and a process finding a transfer station between the departure station and arrival station (destination). However, the gaze movement distance in the process finding the arrival station at the departure station was significantly shorter in the geographical type, rather than in the diagram type. The analysis of task completion time showed a result similar to the gaze movement distance analysis result. Task completion time was significantly shorter in the geographical type, rather than in the diagram type, which is in the process finding the arrival station at the departure station. In other information search processes, no significant difference was shown. As a result of subjective evaluation metrics analysis, no significant difference was revealed in the two design types. Conclusion: An analysis on the two representative subway map design types was carried out via the adoption of usability metrics. As a result, although no significant difference was shown in some information search processes, it was revealed that information search was easier in the geographical type overall. Also, it was found that usability metrics can be effectively used to evaluate the design types of subway maps. Application: The study results can be used to set design direction to offer ease in information search on subway lines. The study also can be used as a method to evaluate a subway map's design type.