• 산업경영시스템학회지
• /
• 제25권5호
• /
• pp.67-74
• /
• 2002

Technology Management and Research & Development(R&D) have been one of the most difficult divisions for measurement and evaluation. In spite of these difficulties, the importance of R&D has been dramatically increased. It is very difficult to manage more efficiently and effectively than any other departments of production, finance, marketing and so on. As criticizing the shortcomings of the traditional evaluation system in making decisions for corporate management which has only been focused on financial indices, so Kaplan & Norton has suggested the Balanced Scorecard(BSC) which can be managed Critical Success Factors(CSF) in accordance with corporate's strategy. The Analytic Network Process(ANP), based on the Analytic Hierarchy Process, allows the decision makers to leap beyond the traditional hierarchy to the interdependent environment of network modeling. Based on BSC, this study has developed the evaluation system for R&D which has used ANP transforming quantitative and qualitative indices to the quantifying scales in evaluating R&D.

• 한국IT서비스학회지
• /
• 제2권1호
• /
• pp.123-133
• /
• 2003

Because of rapid evolution of software technique, numerous software professionals have been concerned with component based development methodologies. However, it is hard to find out a systematic technique for the selection of COTS (Commercial Off The Shelf) component in consumer position. Up to date, the major of component quality evaluation is object-oriented metric based evaluation methodology. But this paper present four step process and evaluation criteria based on MCDM (Multiple Criteria Decision Making) technique for optimal COTS component selection in consumer position. Weconsidered funtionality, efficiency, usability based on ISO/IEC 9126 for quality measurement and executed practical analysis about commercial EJB component in internet. This paper show that the proposed selection technique is applicable to optimal COTS component selection.

• 정보처리학회논문지D
• /
• 제12D권7호
• /
• pp.993-1000
• /
• 2005

최근에 ISO/IEC 9126과 ISO/IEC 14598에 기반한 소프트웨어 품질 평가는 다양한 분야에서 넓게 받아들여지고 있다. 그러나 소프트웨어 품질에 대한 이러한 표준들은 소프트웨어 제품에 대한 품질 모델과 품질 평가 프로세스의 실제적인 활용을 위한 지침을 제공하고 있지 않다. 그리고 대부분의 소프트웨어 사업에서 품질관리는 이러한 표준을 적용하기보다는 결함사항을 관리하는 방식으로 수행되고 있다. 그래서 본 논문에서는 국방 CBD 방법론의 산출물에 대한 정량적 품질 평가 방법을 제시한다. 특히, 본 논문에서 제시된 방법은 대부분의 표준 품질 평가 프로세스를 허용하면서 소프트웨어에 대한 이해관계자들에게 신중하게 작성된 설문서를 제시하여 얻어진 자료를 AHP 기법을 통하여 분석된 품질특성의 중요도를 이용하는 정량적 품질 모델을 적용한다. 또한, 소규모 소프트웨어 사업에서 얻어진 국방 CBD 방법론의 산출물에 대하여 품질평가 점검표를 적용하여 제안된 방법을 시험하였다. 결과적으로 제시된 방법은 고품질 소프트웨어를 획득하는 것이 가능함을 확인할 수 있었다.

• Asian Journal of Innovation and Policy
• /
• 제9권3호
• /
• pp.281-307
• /
• 2020

A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.

• 한국정보과학회논문지:컴퓨팅의 실제 및 레터
• /
• 제11권2호
• /
• pp.192-207
• /
• 2005

정보 보호에 대한 평가가 중요시 되고 있으며 보안 평가 방법론이 제안되었다. 이러한 보안 평가 방법론들은 크게 제품, 프로세스, 통제 중심의 세 가지 관점으로 분류될 수 있다본 논문에서는 제품, 프로세스, 통제 각기 하나의 관점에서 보안 평가할 때에 발생하는 문제점과 위협의 실례를 파악한다. 이 문제점을 해결하기 위하여 제품, 프로세스, 통제의 세 가지 관점을 통합한 보안평가 모델을 제안한다.

• 지식경영연구
• /
• 제10권2호
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1996년도 한국자동제어학술회의논문집(국내학술편); 포항공과대학교, 포항; 24-26 Oct. 1996
• /
• pp.616-619
• /
• 1996

This paper presents the configuration methodology of Distributed Control System(DCS)s for process plant and their performance evaluation. Performance evaluation is specified both in terms of operational and installation aspects of system. In order to evaluate performance criteria of operational aspect, a simulation method is proposed. Modeling of system components including process computer, database, process controllers and LANs, etc, is implemented for simulation. Based on these characteristics, different system configurations are evaluated and compared through results about evaluation criteria in order to select the best DCS for particular process. The results, in abbreviated form, of the performance evaluation of DCS controlling a CAL(Continuous Annealing Line) plant of iron process are presented.

• Journal of Information Technology Applications and Management
• /
• 제15권1호
• /
• pp.203-224
• /
• 2008

The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

• 산업경영시스템학회지
• /
• 제43권2호
• /
• pp.65-71
• /
• 2020

Worldwide plant market keeps maintaining steady growth rate and along with this trend, domestic plant market and its contractors also maintain such growing tendency. However, in spite of its external growth, win-win growth of domestic material industry that occupies the biggest share in plant industry cost portion is extremely marginal in reality. Domestic plant material suppliers are required to increase awareness of domestic material brand by securing quality and reliability of international standard through improvement of design quality superior to that of overseas material suppliers. Improvement of design quality of plant material becomes an essential element, not an option, for survival of domestic plant industry and its suppliers. Under this background, in this study, priority and importance by each evaluation index was analyzed by materializing plant design stage through survey of experts and defining evaluation index by each design stage and based on this analysis result, evaluation index of stage-gate based decision-making process that may improve design quality of plant material was suggested. It is considered that by utilizing evaluation index of stage-gate based decision-making process being suggested in this study, effective and efficient decision-making of project decision-makers would be enabled and it would be contributory to improve design quality of plant material.

• 한국산학기술학회논문지
• /
• 제13권1호
• /
• pp.87-98
• /
• 2012

교육과학기술부는 고등교육 프로그램 평가인증기관에 대한 정부 인정 사업을 추진해왔다. 이에 본 연구는 정부가 프로그램 평가인증기관을 인정하는 평가모형을 설정하고, 평가부문 및 평가항목, 평가지표를 개발하는데 목적이 있다. 이를 위해 본 연구는 프로그램 평가인증기관에 대한 정부인정의 개념을 설정하고, 프로그램 평가인증기관에 대한 정부인정 평가모형을 설계하였다. 평가 모형은 고등교육 프로그램 평가인증기관에 대한 정부인정사업의 절차를 반영하여 정부인정기관으로서의 기본적인 요건에 부합되는지 여부에 대한 적격성 검토를 수행하는 예비평가단계, 법령 및 관련 규정에 제시된 평가영역별 지정기준에 대한 충족 여부를 검증하는 본 평가단계의 과정으로 설정하였다. 아울러 평가영역에 따라 평가부문, 평가항목 및 평가지표들을 개발하였고, 심층적 검증을 위해 평가전문가들의 검토를 거쳐 2개 평가영역, 5개 평가부문, 24개 평가항목 및 33개 평가지표를 확정하였다.