• Journal of Korean Society of Industrial and Systems Engineering
• /
• 제25권5호
• /
• pp.67-74
• /
• 2002

Technology Management and Research & Development(R&D) have been one of the most difficult divisions for measurement and evaluation. In spite of these difficulties, the importance of R&D has been dramatically increased. It is very difficult to manage more efficiently and effectively than any other departments of production, finance, marketing and so on. As criticizing the shortcomings of the traditional evaluation system in making decisions for corporate management which has only been focused on financial indices, so Kaplan & Norton has suggested the Balanced Scorecard(BSC) which can be managed Critical Success Factors(CSF) in accordance with corporate's strategy. The Analytic Network Process(ANP), based on the Analytic Hierarchy Process, allows the decision makers to leap beyond the traditional hierarchy to the interdependent environment of network modeling. Based on BSC, this study has developed the evaluation system for R&D which has used ANP transforming quantitative and qualitative indices to the quantifying scales in evaluating R&D.

• Journal of Information Technology Services
• /
• 제2권1호
• /
• pp.123-133
• /
• 2003

Because of rapid evolution of software technique, numerous software professionals have been concerned with component based development methodologies. However, it is hard to find out a systematic technique for the selection of COTS (Commercial Off The Shelf) component in consumer position. Up to date, the major of component quality evaluation is object-oriented metric based evaluation methodology. But this paper present four step process and evaluation criteria based on MCDM (Multiple Criteria Decision Making) technique for optimal COTS component selection in consumer position. Weconsidered funtionality, efficiency, usability based on ISO/IEC 9126 for quality measurement and executed practical analysis about commercial EJB component in internet. This paper show that the proposed selection technique is applicable to optimal COTS component selection.

• The KIPS Transactions:PartD
• /
• 제12D권7호
• /
• pp.993-1000
• /
• 2005

Recently, software quality evaluation based on ISO/IEC 9126 and ISO/IEC 14598 has been widely accepted in various areas. However, these standards for software quality do not provide practical guidelines to apply the quality model and the evaluation process of software product=5. And the qualify management in most software projects has been conducted by managing defects without applying the standards for software qualify. Thus, we present a quantitative quality evaluation approach of artifacts in the Component Based Development (CBD). Particularly, our evaluation approach allows most of the standard evaluation process and adopts a quantitative quality model which uses the weights of quality characteristics obtained through carefully selected questionnaires for stakeholder and Analytic Hierarchical Process(AHP). Moreover, we have also examined the proposed evaluation approach with applying the checklists for the artifacts of the CBD to a small-scale software project. As a result, we believe that the proposed approach will be helpful for acquiring the high quality software.

• Asian Journal of Innovation and Policy
• /
• 제9권3호
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.

• Journal of KIISE:Computing Practices and Letters
• /
• 제11권2호
• /
• pp.192-207
• /
• 2005

As the evaluation for the information security has been an important issue, numerous security evaluation methods have been proposed. Those security evaluation methods can be categorized into three different aspects in large including product, process and control. In this paper we identify the possible problems that may occur when one-sided security evaluation is conducted that is on the aspect of product, process or control alone, present with the actual example of threat, and propose an approach to resolve each problem. Based on these approaches, we propose the security evaluation model, which incorporates these three aspects of product, process and control.

• Knowledge Management Research
• /
• 제10권2호
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
• /
• pp.616-619
• /
• 1996

This paper presents the configuration methodology of Distributed Control System(DCS)s for process plant and their performance evaluation. Performance evaluation is specified both in terms of operational and installation aspects of system. In order to evaluate performance criteria of operational aspect, a simulation method is proposed. Modeling of system components including process computer, database, process controllers and LANs, etc, is implemented for simulation. Based on these characteristics, different system configurations are evaluated and compared through results about evaluation criteria in order to select the best DCS for particular process. The results, in abbreviated form, of the performance evaluation of DCS controlling a CAL(Continuous Annealing Line) plant of iron process are presented.

• Journal of Information Technology Applications and Management
• /
• 제15권1호
• /
• pp.203-224
• /
• 2008

The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• 제43권2호
• /
• pp.65-71
• /
• 2020

Worldwide plant market keeps maintaining steady growth rate and along with this trend, domestic plant market and its contractors also maintain such growing tendency. However, in spite of its external growth, win-win growth of domestic material industry that occupies the biggest share in plant industry cost portion is extremely marginal in reality. Domestic plant material suppliers are required to increase awareness of domestic material brand by securing quality and reliability of international standard through improvement of design quality superior to that of overseas material suppliers. Improvement of design quality of plant material becomes an essential element, not an option, for survival of domestic plant industry and its suppliers. Under this background, in this study, priority and importance by each evaluation index was analyzed by materializing plant design stage through survey of experts and defining evaluation index by each design stage and based on this analysis result, evaluation index of stage-gate based decision-making process that may improve design quality of plant material was suggested. It is considered that by utilizing evaluation index of stage-gate based decision-making process being suggested in this study, effective and efficient decision-making of project decision-makers would be enabled and it would be contributory to improve design quality of plant material.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• 제13권1호
• /
• pp.87-98
• /
• 2012

The Ministry of Education, Science and Technology has been implementing the government's recognition project regarding the program accrediting organizations in Higher Education. This research is to establish an evaluation model for the government's recognition process of the program accrediting organizations, and develop the evaluation categories, items and indices for the model. The research has set the concept for the government's recognition regarding the program accrediting organizations and designed an evaluation model for such organizations. The evaluation model embraces a preliminary evaluation process, assessing an eligibility of the accrediting organizations for the higher education based on the formalities set forth for the government recognition organization accrediting process. It also includes the main evaluation process, which assess the eligibility based on the evaluation standards stipulated in the associated legislation and regulations. In addition, through in-depth verification processes by experts, this research finalized 2 evaluation domains, 5 evaluation categories, 24 evaluation items and 33 evaluation indices.