• Journal of Information Technology Services
• /
• v.8 no.4
• /
• pp.141-150
• /
• 2009

There are no objective standards for selection and improvement of SLA evaluation metrics for IT service. In this study, we analyze the current IT maturity models for selection and improvement of the metrics and then we derive them according to the maturity levels and propose the redesigned maturity model. To verify whether the model is applicable, we execute a case study based on the D company. We apply the proposed evaluation metrics of the maturity models to the D company and evaluate the metrics. We select a proper level of the D company and an improvement line after measuring evaluation metrics in the maturity level 2. We propose improvement guidelines of evaluation metrics which score is less than the improvement line's and derive SLA evaluation metrics. By using the SLA evaluation metrics for a year, we prove that the way of selection and improvement is useful.

• Journal of Applied Reliability
• /
• v.16 no.2
• /
• pp.134-146
• /
• 2016

Purpose: Many domestic companies have to make out quantitative evaluation table in their proposal when they conduct the software R&D project. However, most of companies have a difficulty to select the evaluation items and criteria, also to derive a quantitative results. Therefore, we propose a method to derive the quantitative evaluation index by utilizing the ISO/IEC 9126-2. Methods: Analyzing ISO/IEC 9126-2, and we classify the quality metrics as high-classification and sub-classification for Web/App software, Embedded software and Installation software. Next, Conduct the metrics selection survey depending on importance and necessity. Then, carry out the case study. Verify the correspondence between evaluation items and criteria from original suggestion of company and from outcome by utilizing the ISO/IEC 9126-2 quality metrics. Results: It is possible to classify into two metrics, one for common software or one another for only special software. Furthermore, there is quality metrics that is more important and more necessary depending upon characteristics of the software. Conclusion: ISO/IEC 9126-2 quality metrics can be used to make an evaluation items and criteria for quantitative evaluation table of software product.

• Journal of Korea Multimedia Society
• /
• v.9 no.6
• /
• pp.693-699
• /
• 2006

Object-oriented databases (OODBs) have been adopted for managing non-standard applications such as computer-aided design (CAD), office document management and many multimedia applications. One of the major characteristics of OODBs is class hierarchy where a subclass is allowed to inherit the definitions defined on its superclasses. In this paper, I present the evaluation metrics for class hierarchy quality in OODBs. These metrics are developed to determine if a concurrency control scheme can achieve good performance or not on a given class hierarchy. I first discuss the existing concurrency control schemes for OODBs. Then I provide evaluation metrics based on structural information and access frequency information in class hierarchies. In order to discuss significance of the proposed performance metrics, an analytical model is developed. Analysis results show that the performance metrics are important factor in concurrency control performance. I consider both single inheritance and multiple inheritance. The proposed metrics can be used to provide guidelines on how to design class hierarchy of an OODB for maximizing the performance of concurrency control technique.

• The KIPS Transactions:PartD
• /
• v.16D no.4
• /
• pp.541-548
• /
• 2009

Many companies have recently apply SLA and execute IT service by using SLA. However, there are no objective standards for selection and improvement of SLA evaluation metrics. We derive and present measurement attributes that are criteria for selection and improvement of SLA evaluation metrics as measurement metrics. We execute a case study based on D company in order to verify whether the measurement metrics are applicable. We apply and evaluate the measurement metrics that are applicable to D company, and then we designate an improvement line. We propose improvement guidelines of the measurement metrics which score is less than the improvement line's and derive SLA evaluation metrics. We prove that the way of selection and improvement is useful by applying SLA evaluation metrics to D company.

• Journal of Multimedia Information System
• /
• v.6 no.4
• /
• pp.271-282
• /
• 2019

There is a description that you cannot manage what you do not measure. The Korea Ministry of National Defense (MND) is conducting evaluations in various fields to obtain meaningful effects from IT investments, and views that the evaluation of the defense informatization sector is divided into defense informatization policy evaluation and defense informatization project evaluation. The defense informatization level evaluation can measure the informatization level of MND and the armed forces or organizations. Since the evaluation system being studied to measure the level of defense informatization is composed mainly of qualitative metrics, it is necessary to reconstruct it based on quantitative metrics that can guarantee objectivity. In addition, for managing the level of change by evaluation objects, the evaluation system should be designed with a focus on homeostasis of metrics so that it can be measured periodically. Moreover, metrics need to be promoted in terms of performance against targets. To this end, this study proposes to measure the level of defense informatization by dividing it into defense information network, computer systems, interoperability and standardization, information security, information environment, and information system use, and suggests their metrics.

• Journal of Internet Computing and Services
• /
• v.19 no.5
• /
• pp.107-113
• /
• 2018

Object-oriented databases (OODBs) canbe used for many non-traditional database application areas such as computer-aided design, etc. Usually those application areas require advanced modeling power for expressing complicated relationships among data sets. OODBs have more distinguished features than the traditional relational database systems. One of the distinguished characteristics of OODBs is class hierarchy (also called inheritance hierarchy). A class hierarchy in an OODB means that a class can hand down the definitions of the class to the subclass of the class. In other words, a class is allowed to inherit the definitions of the class from the superclass. In this paper, we present performance evaluation metrics for class hierarchy in OODBs from a concurrency control perspective. The proposed performance metrics are developed to determine which concurrency control scheme in OODBs can be used for a given class hierarchy. In this study, in order to develop performance metrics, we use class hierarchy structure (both of single inheritance and multiple inheritance), and data access frequency for each class. The proposed performance metrics will be also used to compare performance evaluation for various concurrency control techniques.

• Journal of KIISE:Computing Practices and Letters
• /
• v.7 no.2
• /
• pp.151-164
• /
• 2001

Java, used as the most representative object-oriented language, isil becoming the popular language for Internet/Intranet based program development. Moreover, it is used for development language in a variety of areas such as component based development language. In the view of reuse and maintenance of developed program, quality evaluation of program is becoming a more important issue. So, metrics measurement for quality evaluation of program that is developed at present including existing Java application is necessary. However, it is necessary that whether existing object-oriented software metrics is suitable on Java program is to be validated So, in this paper, we build an automated metrics measurement system that needs to validate on object-oriented software metrics and wish to support metrics measurement that is to determine it. The purpose of this system is to support a precise quality evaluation tool. In this system, we apply the metrics classified by Briand. Briand classified the metrics by formalizing mathematically them to verify feasibility of existing object-oriented software metrics. Using the proposed system, we can make comparison and analysis of validation on existing object-oriented metrics by calculating quantitative information more rapidly from Java source program. If there is any problem in feasibility of the metrics, we can establish a suitable metrics on Java program by considering reiJ,1forcement of the existing metrics or proposing new metrics.

• Journal of the Korea Society of Computer and Information
• /
• v.18 no.9
• /
• pp.63-70
• /
• 2013

The multimedia data of game affects the immersion of the game depending on its quality. It is difficult to design the evaluation criteria of artistic quality of the data. But, in a technical point of view, it is possible to evaluate its quality. Thus, the design of evaluation standard can ensure the reliability and objectivity of quality. However, multimedia data quality evaluation metrics had not yet been designed. Therefore, in this study, we extracted quality evaluation elements of Game Multimedia Data, and verified the reliability of the elements. And we defined detailed evaluation items of each element, developed Multimedia Data Quality Evaluation Metrics. We expect that the results of this study will serve as a guide in the development of high-quality games, have a positive impact on the growth of the game industry.

• Nuclear Engineering and Technology
• /
• v.39 no.2
• /
• pp.149-160
• /
• 2007

The IAEA launched the International Project on Innovative Nuclear Reactors and Fuel Cycles (INPRO) and developed the INPRO Methodology to provide guidelines and to assess the characteristics of a future innovative nuclear energy system in areas such as safety, economics, waste management, and proliferation resistance. The proliferation resistance area of the INPRO Methodology is reviewed here, and modifications for further improvements are proposed. The evaluation metrics including the evaluation parameters, evaluation scales and acceptance limits are developed for a practical application of the methodology to assess the proliferation resistance. The proliferation resistant characteristics of the DUPIC fuel cycle are assessed by applying the modified INPRO Methodology based on the developed evaluation metrics and acceptance criteria. The evaluation procedure and the metrics can be utilized as a reference for an evaluation of the proliferation resistance of a future innovative nuclear energy system.

• Journal of the Ergonomics Society of Korea
• /
• v.36 no.4
• /
• pp.343-353
• /
• 2017

Objective: This study aims to evaluate the efficiency of two representative subway map design types, namely a diagram type and a geographical type using physiological metrics, performance metrics, and self-reported metrics, which are representative usability metrics. Background: Subway maps need to be designed in order for users to quickly search and recognize subway line information. Although most cities' subway maps currently use the diagram type designed by Henry Beck, New York City's subway map has recently been changed to the subway map type combined with the geographical type designed by Michael Hertz. However, not many studies on its efficiency are found, and the studies that are available mainly depend on questionnaire surveys or take on a subjective behavioral study type based on experts' experiences. In this regard, evaluation through a more objective method is needed. Method: This study employed usability metrics as a method to evaluate the efficiency of information search targeting the diagram type and geographical type subway maps used mostly as subway maps. To this end, physiological metrics obtained through eye tracking, task completion time, representative metric of task performance, and subjective evaluation metrics were used for the suitability evaluation of subway map designs. Results: In the result of gaze movement distance analysis, no significant difference was shown in the two design types in terms of a process finding a departure station from the starting point and a process finding a transfer station between the departure station and arrival station (destination). However, the gaze movement distance in the process finding the arrival station at the departure station was significantly shorter in the geographical type, rather than in the diagram type. The analysis of task completion time showed a result similar to the gaze movement distance analysis result. Task completion time was significantly shorter in the geographical type, rather than in the diagram type, which is in the process finding the arrival station at the departure station. In other information search processes, no significant difference was shown. As a result of subjective evaluation metrics analysis, no significant difference was revealed in the two design types. Conclusion: An analysis on the two representative subway map design types was carried out via the adoption of usability metrics. As a result, although no significant difference was shown in some information search processes, it was revealed that information search was easier in the geographical type overall. Also, it was found that usability metrics can be effectively used to evaluate the design types of subway maps. Application: The study results can be used to set design direction to offer ease in information search on subway lines. The study also can be used as a method to evaluate a subway map's design type.