• Journal of Korea Technology Innovation Society
• /
• v.18 no.4
• /
• pp.539-560
• /
• 2015

Korea has enacted the Performance Evaluation law on the R&D Programs since 2006. This study categorizes program size, program history, sustainability, self-evaluation result as antecedents, and analyze the relationship between the antecedents and Meta-evaluation result, the change rate of appropriations. The result shows that program size, program history, self-evaluation result have significant effect to the Meta-evaluation result. And Meta-evaluation result has significant effect to the change rate of appropriations. This study has implication that the performance evaluation system shows significant effect to the appropriations.

• Proceedings of the Technology Innovation Conference
• /
• 1997.07a
• /
• pp.247-265
• /
• 1997

The objectives of not-for-profit organizations including government supported research institutes are, by definition, to achieve socially desired nonfinancial goals. Current reporting focuses on providing information to meet the needs of users. This information may be provided in the annual research report, financial report, and other reports. An objective of current reporting is to provide users with information that will assist them in evaluating the performance(efficiency and effectiveness) of reporting entity. The evaluation of R&D project's performance requires information not only about the acquition and use of resources, but also about the outputs and outcomes of R&D activities, This study aims to recommend that R&D Service Efforts and Accomplish- mints(SEA) reporting is useful for performance evaluation in national R&D programmes. To achieve this aims, I attempt to develop the R&D SEA measures with reference to the Concepts Statement No. 2 of the Governmental Accounting Standards Board. R&D SEA measures consist of five categories : (1) input measures, (2) outcome measures, (3) output measures, (4) re1a1e efforts to accomplishments, (5) explanatory information.

• Journal of Korea Technology Innovation Society
• /
• v.13 no.4
• /
• pp.794-816
• /
• 2010

To explore the answer on how the evaluators' network affects efficiency of National R&D Program, this paper analyzes the network of evaluators who attended the peer-review committee for National Nuclear R&D Program from 2007 to 2008. The result derived from network analysis was applied to measure the efficiency of programs by Data Envelopment Analysis. The result shows that the weaker network produces higher efficiency as much as the research result itself. Along with the expertise of evaluators themselves, this paper implies that network should be considered as a main item for evaluation.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2012.11a
• /
• pp.1663-1666
• /
• 2012

투자효율성을 중요시하는 R&D 패러다임에 따라, 우리나라 또한 국가R&D사업의 예산조정 및 배분의 기초자료로 활용되고 있는 국가R&D사업 평가결과의 신뢰성 확보를 위해, 2010년도를 기점으로 연구 성과의 양적 질적 우수성을 측정하기 위한 평가지표를 신설 또는 강화하는 등 성과평가체계 개발에 주력하고 있다. 본 연구에서는 2005년 제정된 "국가연구개발사업 등의 성과평가 및 성과관리에 관한 법률"에 따라 시행되고 있는 국가R&D사업 자체평가 평가지표를 이론적으로 검토하고, 평가지표 중 4-1(계획된 성과의 양적 달성도)에 대한 실증분석을 통해 평가기법 상의 문제점을 도출하고, 문제점 보완을 통해 보다 정밀하고 합리적인 정량적 성과평가방안을 제시한다.

• Journal of Korea Technology Innovation Society
• /
• v.17 no.3
• /
• pp.519-539
• /
• 2014

In order to accomplish the successful performance management of the national research and development programs, it is necessary to establish the legal system that provide a institutional foundation and to set up and practice the relative substantial operating system. This paper aims to study the problems and improvement measures of the Performance Management System in National R&D Programs. For this purpose, the development of legal system on the performance management in national R&D programs was surveyed, the problems in existing laws and ordinances on the performance management were analyzed, and lastly the improvement measures on the legal system of the performance management were suggested. The legal system of performance management is being composed of and managed with The Framework Act On Science And Technology that prescribed the national science and technology policy direction, and Act On The Performance Evaluation And Management Of National Research And Development Projects, Etc. that prescribed the basic policies of performance management process and methods, and Regulations On The Management, Etc. Of The National Research And Development Projects that prescribed the concrete methodologies on performance management. Results of the study, it is necessary that the performance management laws and ordinances need improvement of Compatibility, the object and range of performance management system extend more widely to the whole field of national R&D programs in principle, and the performance management process and methods improve reasonably considering the goal and direction of national R&D policy.

• Journal of Internet Computing and Services
• /
• v.24 no.6
• /
• pp.31-39
• /
• 2023

The purpose of this study is to propose a scientific performance evaluation framework for measuring and managing the overall outcome of complex types of projects that are linked to public demand-based commercialization, such as information system projects and public procurement, in integrated national R&D projects. In the case of integrated national R&D projects that involve multiple research institutes to form a single final product, and in the case of demand-based demonstration and commercialization of the project results, the existing evaluation system that evaluates performance based on the short-term outputs of the detailed tasks comprising the R&D project has limitations in evaluating the mid- and long-term effects and practicality of the integrated research products. (Moreover, as the paradigm of national R&D projects is changing to a mission-oriented one that emphasizes efficiency, there is a need to change the performance evaluation of national R&D projects to focus on the effectiveness and practicality of the results.) In this study, we propose a performance evaluation framework from a structural perspective to evaluate the completeness of each national R&D project from a practical perspective, such as its effectiveness, beyond simple short-term output, by utilizing the Hourglass model. In particular, it presents an integrated performance evaluation framework that links the top-down and bottom-up approaches leading to Tool-System-Service-Effect according to the structure of R&D projects. By applying the proposed detailed evaluation indicators and performance evaluation frame to actual national R&D projects, the validity of the indicators and the effectiveness of the proposed performance evaluation frame were verified, and these results are expected to provide academic, policy, and industrial implications for the performance evaluation system of national R&D projects that emphasize efficiency in the future.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2013.10a
• /
• pp.386-392
• /
• 2013

• Journal of Korea Technology Innovation Society
• /
• v.19 no.1
• /
• pp.191-229
• /
• 2016

As Korean national R&D projects have steadily grown in size, the needs of enhancing the efficiency and effectiveness of the national R&D budge spending has been also discussed. Therefore, many efforts have been made to establish performance assessment system to improve the efficiency and effectiveness of the national R&D project. One example of such efforts is the stipulation of connecting the results of performance evaluation ranking of the national R&D projects with the budge allocation of for the coming fiscal year. Unlike the stipulated article in the law/regulation that 'more budge shall be allocated to a project rated over excellent grade and vice versa', however, precedent studies have been casting mixed opinions over to the effectiveness of the connection between assessment results and budge allocation. In this respect, the present study attempted to empirically examine if the laws and institutions related to the results of performance evaluation ranking of the national R&D projects with the budge allocation work properly, using panel regression analysis and quantitative data. In addition, this study investigated into the deterrent factors to the connectivity between the performance results of the national R&D projects and budge allocation and sought for a way to improve the system of performance assessment and enhance the reliability of the results by minimizing the hindrance factors.

• Journal of Technology Innovation
• /
• v.30 no.3
• /
• pp.35-64
• /
• 2022

Currently, The budget expenditure for national R&D has been on the rise, and the quantitative performance in national R&D programs has been increasing accordingly. However, a growth of qualitative performance can not reach to an upward trend of quantitative performance. For a poor qualitative performance such as patent grades and technologies with low efficiency of technology transfer, the performance evaluation centered on "number of cases" is necessary to improve and start to introduce various "qualitative performance indicators". This paper focuses on "Triadic Patent Families" being measurable the overseas competitiveness of patent applied in major countries(the US, Europe and Japan). It analyzes the influencing factors to evaluate the quality of qualitative performance of R&D program. The result of this analysis shows a significant effect on the creating of triadic patent families within factors of R&D scale and project characteristics. This paper is significantly meaningful to expand insufficient triadic patent families to the target of interest rather than early study relatively, and to analyze the influencing factors of the creation of triadic patent families.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2000.05a
• /
• pp.106-122
• /
• 2000

1999년 처음 출범한 연구회체제는 소속 연구기관들의 1999년도 연구실적 및 경영내용에 대한 기관평가를 실시하였다. 기관평가는 짧은 준비기간에도 불구하고 비교적 객관적인 지표체계 및 과학적인 평가방법을 개발하여 평가의 신뢰성과 타당성을 제고하려고 하였다. 그러나 연구회 소속 연구기관들은 기관평가시스템에 대한 재검토 필요성에 대부분이 공감하고 있는 실정이다. 이에 본 연구는 정부출연연구기관의 책임성 확보와 성과지향적인 관리 및 평가체제 구축을 위하여 도입된 기관평가의 목적, 대상, 체계, 기준 및 그 결과 등을 국가연구개발사업 조사·분석·평가와 비교분석하고, 그 개선방안을 제시하고자 한다.