• 한국벤처창업학회:학술대회논문집
• /
• 2009.08a
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• IE interfaces
• /
• v.22 no.3
• /
• pp.192-204
• /
• 2009

Based on the characteristics of 'Korean electric power industry R&D programs', this study proposes a new performance evaluation framework where electric power industry related R&D projects are scrutinized. The abovementioned R&D programs have their own goals and especially they emphasize the effectiveness as well as the efficiency of each subordinate R&D project. Hence, in this framework, a performance evaluation procedure is established and then a mathematical model is developed according to the procedure. The model calculates performance evaluation indices for a set of R&D projects integrating the effectiveness with the efficiency of each R&D project. In a case study with an empirical dataset, statistical significance is tested on the integrated performance evaluation indices of R&D projects regarding organizational types and program categories considered.

• STI Policy Review
• /
• v.4 no.2
• /
• pp.41-54
• /
• 2013

R&D is inherently an uncertain endeavor, yet now more than ever those performing R&D with public funding are called upon to clarify the utility of their research. Calls for public accountability are mounting with the increase in constraints on government budgets due to the recent worldwide economic recession, in response to which both policymakers and researchers pay much more attention to rigorously assessing publicly funded R&D. A key issue complicating R&D evaluation in these circumstances is how to adequately account for the nature and degree of risk involved in a given R&D program or project. This study deliberates on certain issues involving the measurement of ex-ante risk in public R&D evaluation: (i) information asymmetry between R&D sponsors and performers, (ii) ambiguity in the measurement of returns in both prospective and retrospective evaluation, and (iii) the dilemma between measurement error and omitted variable bias for empirical estimation of R&D performance. The study then presents an analysis of hypothetical evaluation results that apply risk-relevant weights to the annual evaluation outcomes of South Korea's national R&D programs funded during 2006~2012. In this counterfactual re-evaluation of public R&D program performance, high-risk R&D programs turn out to receive higher evaluation than non-high-risk programs. The current study suggests that R&D evaluation ignoring ex-ante risk is not only conceptually invalid since R&D activities are intrinsically uncertain endeavors, but unfair as R&D performers are asked to be accountable for the results that were in fact out of their reach.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2001.05a
• /
• pp.369-385
• /
• 2001

A R&D project evaluation method has been applied for the national nuclear R&D projects in a developing-country setting. In the methodology, Saaty's analytic hierarchy process model is used to evaluate and rank of the selected nuclear R&D project which have a wide range of objectives and characteristics. The criteria used for evaluation related specifically to the Korea's evaluation needs and culture, and they are weighted according to their relative importance as perceived by the evaluator of the R&D project. As a real-world case of evaluation, we elicited and reproduced the evaluation process of the nuclear R&D projects which is going under the research process. As the results of the paper suggests, the methodology can be applied to the evaluation of the R&D projects and has much potential.

• Journal of Technology Innovation
• /
• v.15 no.1
• /
• pp.87-113
• /
• 2007

For the realization of the national self-defense, the trend of the defense R&D projects becomes global and diverse with the increase of their budget. Thus, for the effective execution of the budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. This study suggests the applicability of a meta-evaluation model for the realization of the successful defense R&D project evaluation system. This study focused on the development of the meta-evaluation model design which can be applicable to the national defense R&D projects. Using the proposed meta-evaluation model, we propose a technique to enhance the fairness and the reliability of the national defense R&D projects evaluation system.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.14 no.23
• /
• pp.57-64
• /
• 1991

The preliminary, advanced and final evaluation of R&D project is essential in order to reduce loss of resource and opportunity and to minimize uncertainty resulting from optimal selection and efficient progress of R&D project. This thesis examined characteristics of deterministic evaluation, economical evaluation, and OR-approach evaluation as theoretical methodology of evaluation of R&D project applicable to food industry in Korea by using scoring method, one of deterministic evaluations. In addition, this thesis divided the evaluation factors for preliminary evaluation of R&D project into 5 groups and 30 factors on basis of the environment of domestic companies and set up the standard of each evaluation factors and contains marking-selecting way. But, generally, the evaluation model by this thesis, as the conditions of the business company environment are different to each other, contents to be set up evaluation factors, evaluation standard and decision method conforming to each the environment of the business companies with referring to as one standard of evaluation project for selecting R&D project.

• Journal of Korea Technology Innovation Society
• /
• v.1 no.1
• /
• pp.117-124
• /
• 1998

Corporations are pursuing maximum returns from their R&D investment. They are also interested in sound measures to quantify returns. In fact, they use various measures and criteria for measuring returns from the R&D investment. But the fundamental problem is that there is no generic and widely acceptable measures and criteria. To make things more complicated, measures are very powerful and influential to the people in the corporations. Herbert Simon already indicated that people do many things but people usually do their best for the only tasks which are measured. Many researchers, like Chester(1995), are interested in R&D productivity measures and risks because what the company measures really influence R&D people and output. This article present design concepts of the R&D project selection and evaluation system in POSCO(Pohang Iron & Steel Company). This is an output extract from the 6-month joint activities with POSRI(POSCO Research Institute) researchers and POSCO R&D personnel. Process changes, new organizations and new selection and evaluation criteria are developed to improve R&D performance and to enhance technology management of the POSCO. This article covers new selection and evaluation criteria only. We would like to share our experience about how we redesign the selection and evaluation of R&D projects. We also bring insights how we seamlessly integrate 4 different project selection and evaluation steps as a whole. We hope that this case will give you a clue to improve your R&D management.

• Journal of Information Technology Services
• /
• v.12 no.2
• /
• pp.373-386
• /
• 2013

The purpose of this research is to develop a model for efficient service R&D investment in government budgeting process. It is necessary to develop an efficient and effective investment model to improve competitiveness of the service industry and national economy. Various existing types of service R&D classification have been reviewed. And object-oriented service R&D request classification types have been derived. A tentative model for evaluating service R&D requests have been developed through extensive discussions on effective methodologies. The model has been refined and revised by four service budgeting experts. The revised and refined checklists and guidelines have been used for 40 real service R&D requests evaluations. As a result, a full model for service R&D evaluation and budgeting has been proved to be useful. Also, a need for more efficient and concise evaluation model has been raised through this evaluation process. A brief model with only 10 checklists has been developed and its usefulness has been proven by pilot test with 10 real service R&D requests. The results of this study can be used for evaluation of service R&D proposals and effective budgeting of R&D requests for improving global competitiveness. Further research is needed for refining the developed evaluation models.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.14 no.1
• /
• pp.80-84
• /
• 2013

The EU in order to surpass the United States in the world economy have tried several aspects. Economic growth is possible through the technological competitiveness of this industry, and also through the development of industrial technology and employment. Such EU Commission has taken several support policies in order to raise the R & D capabilities. Non-EU member countries, Korea, R & D pipe central incisor see support for the policy proposal evaluation for women is important. The aim of this paper is to analyze the proposal evaluation process of the EU commission for R&D projects. I argue that the EU's methode of proposal evaluation for EU R&D consists of five stages: expert briefings, proposals for individual assessment, consensus and finally a panel evaluation. The main features of the EU's R&D evaluation process for proposals are experts and panel evaluation. The Korean government could select, operate and manage experts for the EU's R&D evaluation. That would lead to a higher rate of success for Korean proposals in the EU.