• STI Policy Review
• /
• v.4 no.2
• /
• pp.41-54
• /
• 2013

R&D is inherently an uncertain endeavor, yet now more than ever those performing R&D with public funding are called upon to clarify the utility of their research. Calls for public accountability are mounting with the increase in constraints on government budgets due to the recent worldwide economic recession, in response to which both policymakers and researchers pay much more attention to rigorously assessing publicly funded R&D. A key issue complicating R&D evaluation in these circumstances is how to adequately account for the nature and degree of risk involved in a given R&D program or project. This study deliberates on certain issues involving the measurement of ex-ante risk in public R&D evaluation: (i) information asymmetry between R&D sponsors and performers, (ii) ambiguity in the measurement of returns in both prospective and retrospective evaluation, and (iii) the dilemma between measurement error and omitted variable bias for empirical estimation of R&D performance. The study then presents an analysis of hypothetical evaluation results that apply risk-relevant weights to the annual evaluation outcomes of South Korea's national R&D programs funded during 2006~2012. In this counterfactual re-evaluation of public R&D program performance, high-risk R&D programs turn out to receive higher evaluation than non-high-risk programs. The current study suggests that R&D evaluation ignoring ex-ante risk is not only conceptually invalid since R&D activities are intrinsically uncertain endeavors, but unfair as R&D performers are asked to be accountable for the results that were in fact out of their reach.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2013.05a
• /
• pp.518-520
• /
• 2013

In these days, national R&D projects are taking major roles to strengthen national competitiveness. In order to produce successful R&D project, the most important point is objective and specialized evaluation. That means an appraisal board composed of experts in each field is necessary. But, it is very difficult to entrust experts, because of the constraints of time, space. In this paper, I describe the remote evaluation system for experts appointment, cost reduction and security enhancement.

• Proceedings of the SAREK Conference
• /
• 2008.11a
• /
• pp.334-339
• /
• 2008

Nowadays national research and development fund is continuously increased. And the evaluation on the feasibility of R&D budget investment was carried out. Through this study it was possible that a business feasibility evaluation of large scale research project. Also the benefit of research project about large scale plant(A plant) is $2.67{\sim}3.76$ times of research funds, and the R&D fund pay-back period is $6{\sim}8$ years. And also there is employment effect as $1,200{\sim}2,200$ every year, and $22,000{\sim}35,000$ within 20 years after research project.

• Proceedings of the Technology Innovation Conference
• /
• 1997.07a
• /
• pp.247-265
• /
• 1997

The objectives of not-for-profit organizations including government supported research institutes are, by definition, to achieve socially desired nonfinancial goals. Current reporting focuses on providing information to meet the needs of users. This information may be provided in the annual research report, financial report, and other reports. An objective of current reporting is to provide users with information that will assist them in evaluating the performance(efficiency and effectiveness) of reporting entity. The evaluation of R&D project's performance requires information not only about the acquition and use of resources, but also about the outputs and outcomes of R&D activities, This study aims to recommend that R&D Service Efforts and Accomplish- mints(SEA) reporting is useful for performance evaluation in national R&D programmes. To achieve this aims, I attempt to develop the R&D SEA measures with reference to the Concepts Statement No. 2 of the Governmental Accounting Standards Board. R&D SEA measures consist of five categories : (1) input measures, (2) outcome measures, (3) output measures, (4) re1a1e efforts to accomplishments, (5) explanatory information.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.3
• /
• pp.299-308
• /
• 2009

In this paper, we have developed an evaluation model of technology green index(TGI) which includes 3 evaluation factors and 13 indicators. Furthermore, as presenting the degree of relative importance among evaluation factors and indicators for all R&D evaluation stages and all green technology areas, and applying the proposed model to 5 defense projects, we have found applicability of the model to evaluation of defense R&D projects. The results of evaluation using this model can be used to monitor the performance of project life cycle and develop R&D investment strategy of green technology using portfolio analysis.

• Journal of Digital Convergence
• /
• v.18 no.9
• /
• pp.323-329
• /
• 2020

There is a system of mandating the allocation of support to small business in certain percentage or more to facilitate technological innovation at small business. Trying to assess small business R&D projects, which receive a budget of three trillion won or more from the government every year, for their possibilities of success, a group of experts perform a technological evaluation with their technologies and their difficulty levels and review closely the possibilities of their commercialization and success. Used in such a review, the Analytic Hierarchy Process technique cannot make an objective judgment of evaluation criteria for evaluation items and guarantee the professionalism and fairness of small business R&D projects due to the inherent ambiguity and uncertainty of the evaluation criteria. This study proposed an R&D evaluation system based on Fuzzy-AHP for small business to provide objective weight for the evaluation items and assess the possibilities of such projects' success. The evaluation criteria were make objective as they were applied as section values based on triangular fuzzy numbers. Weight was assigned and applied according to the management guidelines of supportive projects for small business' technological development so that it could be reflected on actual assessment. The findings of the study will be helpful for reflecting the scoring weight of these evaluation items again when an expert is appointed for a new project and guaranteeing the professionalism and fairness of small business R&D project based on them.

• Journal of Internet Computing and Services
• /
• v.24 no.6
• /
• pp.31-39
• /
• 2023

The purpose of this study is to propose a scientific performance evaluation framework for measuring and managing the overall outcome of complex types of projects that are linked to public demand-based commercialization, such as information system projects and public procurement, in integrated national R&D projects. In the case of integrated national R&D projects that involve multiple research institutes to form a single final product, and in the case of demand-based demonstration and commercialization of the project results, the existing evaluation system that evaluates performance based on the short-term outputs of the detailed tasks comprising the R&D project has limitations in evaluating the mid- and long-term effects and practicality of the integrated research products. (Moreover, as the paradigm of national R&D projects is changing to a mission-oriented one that emphasizes efficiency, there is a need to change the performance evaluation of national R&D projects to focus on the effectiveness and practicality of the results.) In this study, we propose a performance evaluation framework from a structural perspective to evaluate the completeness of each national R&D project from a practical perspective, such as its effectiveness, beyond simple short-term output, by utilizing the Hourglass model. In particular, it presents an integrated performance evaluation framework that links the top-down and bottom-up approaches leading to Tool-System-Service-Effect according to the structure of R&D projects. By applying the proposed detailed evaluation indicators and performance evaluation frame to actual national R&D projects, the validity of the indicators and the effectiveness of the proposed performance evaluation frame were verified, and these results are expected to provide academic, policy, and industrial implications for the performance evaluation system of national R&D projects that emphasize efficiency in the future.

• Journal of Technology Innovation
• /
• v.6 no.2
• /
• pp.208-237
• /
• 1998

We are faced with the crisis of the R&D investment because of the effects of the IMF conditions. Most of the laboratories are going to restructure by the cutting off of money, man power and the reduction of R&D theme. Therefore it is necessary to allocate the R&D resources effectively to R&D projects. The evaluation and the selection of R&D projects have been recognized as the most important process for the allocation of the R&D resources. The result of the KITA(1997) shows that the commercial success rate of the R&D from new-product brain storming is only 5.8%. This study aims to analyze the actual conditions of the cost benefit analysis(CBA) of R&D projects of selected laboratories and to study measure methods of the R&D benefits. The research method of this study reviews the CBA of R&D firstly, and surveys 200 selected high ranking labs of R＆D expenditures. For the comparison of the results between '87 and '97, this survey used the same questionary for each year. As the result of the survey only 27 labs(response rate 13.5%) responded. The result of the '97 survey is as follows : The CBA is used by 44% of responding labs. The economic evaluation method for the R&D project selection is used by 48% of labs and this numbers increased by over 10 percents points compared with the result of '87. The CBA is used for about 40% about each of the budget preparing and the budget analysis, and by 30% of labs to analyze sales and expenditures of the overall period of the project. As the measurement of benefits of R&D projects, 30% of labs responded that it is impossible to measure the benefits, and 20% of labs measured the benefits between sales and expenditures of R&D projects.

• Korean Journal of Construction Engineering and Management
• /
• v.14 no.4
• /
• pp.118-129
• /
• 2013

Due to the recent surge in natural disasters, with rising social concerns, investment on research & development (R&D) project in natural disaster mitigation area is continuously increasing. However, current R&D performance management system of natural disaster mitigation area does not properly reflect characteristics and social ripple effects of R&D projects. It is indicated that mainly due to the current performance index consists of easy-quantification factors and the performance evaluation system adopts simple aggregation method. Therefore, the purpose of this study is to develop new performance evaluation system considering characteristics and social ripple effects of natural disaster mitigation R&D projects. To this ends, this study derived 3-dimensional performance measurement index through literature review and natural disaster mitigation R&D projects analysis. Finally, based on the derived performance measurement index, this study suggested new and effective performance evaluation system for natural disaster mitigation R&D projects.

• Journal of Information Management
• /
• v.39 no.1
• /
• pp.177-198
• /
• 2008

This research focused on the major determinants for the technology roadmap utilization of the R&D project after the adoption of the technology roadmap in the R&D intensive organization. The study was performed based on both theoretical study and qualitative case study approaches. The results of this study are summarized as in cases where the R&D project team has higher organizational capability - specifically, relation and research capability, even more technology roadmap is used. In terms of the needs of times, this study regarding the technology roadmap utilization is anticipated to be a good reference for the R&D-oriented organizations and technology-related studies in coming years.