• Journal of the Korea Convergence Society
• /
• v.11 no.4
• /
• pp.1-9
• /
• 2020

This study draws implications by surveying and analyzing performance evaluation cases in Korea and overseas, and analyzes qualitative and quantitative performance evaluation indexes and evaluation models that fit the national R & D performance evaluation system through analysis of patent creation performance data or company status data. Also, in order to apply this to a specific group of companies with excellent exports and technical skills, we will conduct a case study on the performance analysis of patent strategy support projects based on the results of the survey. Although this study has some limitations in developing performance evaluation indicators due to the limited scope of business or business characteristics of the patent strategy support project, the qualitative evaluation system can be reviewed through previous studies and domestic and overseas case studies. Due to the problem of accessing and collecting data related to the performance of the support project, there is a limitation that performance analysis cannot be performed at a sufficient level. Nevertheless, after the completion of R&D support projects and patent strategy support projects, follow-up performance analysis can be performed through follow-up surveys. It is expected to be possible.

• The Journal of Information Systems
• /
• v.19 no.2
• /
• pp.73-95
• /
• 2010

This study shows the scientific and systematic Evaluation Model using factor analysis and AHP methods for the success of defense Information System R&D projects. The evaluation model was divided into 7 evaluation factors such as Developing support, Developing infrastructure, Developing management and test & evaluation, Support factors for strength, Understanding & developing strategy, Developing technology & organization, and Developing performance. And those were composed of totally 24 low level Evaluation index. The Developed Evaluation Model in the paper could be contributed more to objectively and transparently company selection of defense Information System R&D and other defense R&D Projects in the future.

• STI Policy Review
• /
• v.9 no.1
• /
• pp.1-29
• /
• 2018

With the constant growth of R&D investment, it has been increasingly necessary to evaluate the effectiveness of R&D performance and there is a high emphasis on ensuring the accountability and effectiveness of R&D programs. The evaluation of performance of a firm is especially necessary in times of economic downturn to justify R&D investment. However, there is a marked shortage of clear guidelines as to where and how particular metrics are used to measure the output and outcome of R&D activity in firms. Many firms have difficulties in selecting appropriate indicators for their R&D and financial performances. To fill this gap, this article discusses and presents the findings from the literature in such a way that they become useful for researchers or managers who are in charge of measuring the R&D and business performances arising from innovation activities. Finally, based on the findings about metrics of R&D performance, this article proposes the hypothetical framework to investigate the relationship between technology forecasting, strategic technology planning, and business performance. The framework of this article will assist policy makers, universities, research institutes/national laboratories, and companies to enhance their decision making process in technology development.

• Journal of Korea Technology Innovation Society
• /
• v.20 no.2
• /
• pp.271-291
• /
• 2017

This study measures and compares the performance of research and development (R&D) programs in government-funded research institutes (GRIs) in terms of qualitative and quantitative approaches to find out strategic insights for improving performance evaluation policy. In particular, we adopt the evaluation results from the real data of K institute in 2015 for a qualitative evaluation and the results of data envelopment analysis (DEA) for a quantitative evaluation. Comparative analysis of the R&D performance of 14 programs finds that the difference between the evaluation results of qualitative and quantitative approaches is significant. From this finding, we suggest several strategic directions to complement two approaches each other.

• Journal of the Korea Society of Computer and Information
• /
• v.22 no.2
• /
• pp.119-125
• /
• 2017

In this paper, we propose an approach to evaluating the performance of the national R&D investment in IT(Information Technology) areas in terms of paper, patent and commercialization, and seeking ways to improve the efficiency of the national R&D investment. This is because the government has focused the national R&D investment on IT areas for some time. For that purpose, we gather data on investments, papers, patents, and commercializations for the government sponsored R&D projects in IT areas through National Science & Technology Information Service. From which, we summarize the investment and performance in terms of papers, patents, and commercializations for each IT area, evaluate efficiency per R&D investment for each IT area, and compare the efficiencies among IT areas. Finally, we drive implications for efficiency enhancement and strategic R&D budget allocation for each IT area.

• Journal of Korea Technology Innovation Society
• /
• v.21 no.2
• /
• pp.788-817
• /
• 2018

This paper aims to explore the relationship between organizational competencies and performance by analysing perception survey data of R&D management agencies in Korea. The regression analysis results show the perceived performance measured by policy contribution and R&D management efficiency may be enhanced by organizational competencies such as professionalism and efficiency of R&D management specialized agencies. The paper suggests several improvement measures for strengthening professionalism of R&D management agencies in Korea. First, expertise competencies for strategic planning, management, evaluation need to be empowered in the whole process of R&D cycles. Second, in order to stabilize financial resources of R&D management specialized agencies, the existing R&D budget for Planing, Evaluation and Management should be reformed. Third, R&D management specialized agencies need setting up special organizations for managing inter-organizational collaboration with other R&D organizations. And the agencies should employ special experts in each position for strategic planning, management, evaluation, performance and commercialization. Finally, different R&D management procedures of each R&D management specialized agency need to be standardized in order to promote innovative R&D culture.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.32 no.3
• /
• pp.59-70
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as 'Good'. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach's a coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.33 no.2
• /
• pp.89-96
• /
• 2010

This study explores the application of the analytic network process (ANP) approach for the evaluation of R&D projects with heterogeneous objectives. The ANP model in this study produced the final priorities of projects with respect to several performance measures when there are interdependencies between research objectives and performance measures. The paper provides value to practitioners by providing a generic model for R&D project evaluation. The ANP approach is tested against empirical data drawn from fourteen R&D projects under six different objective programs sponsored by the Korean government.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.29 no.3
• /
• pp.41-61
• /
• 2004

The purpose of this paper is to construct $\ulcorner$CIDEAR(Cross Impact-DEA-AR)$\lrcorner$ model which evaluates proposed R&D projects considering cross impact among them and selects proper projects to utilize resources efficiently as well as to maximize efficacy of investments. For this purpose, $\ulcorner$CIDEAR$\lrcorner$ model is designed as the following six steps. $\ulcorner$Decision Theory Evaluation Model$\lrcorner$ is for setting and selecting the evaluation items according to the structured procedure of evaluation system. The priority of items is decided at $\ulcorner$AR Decision Model$\lrcorner$$\ulcorner$Cross Impact Estimation Model$\lrcorner$ is for computing the final probability of success and the result is used to revise the evaluation results of $\ulcorner$Decision Theory Evaluation Model$\lrcorner$. $\ulcorner$Resource Performance Analysis Model$\lrcorner$ classifies the proposed R&D projects on the basis of required resources and expected performance. Consequently, the possibility of bias of project selection can be prevented. $\ulcorner$Priority Oder Decision Model$\lrcorner$ is for computing the efficacy of proposed projects. Finally, $\ulcorner$Efficacy-Efficiency Cause Analysis Model$\lrcorner$ analyzes the structure of efficacy and efficiency of the projects. The major findings and significances of this study are summarized as follows: (1) $\ulcorner$CIDEAR$\lrcorner$ model can deal with the affairs of R&D projects having the characteristics of mutual independence as well as mutual dependence in the point of efficacy and efficiency. Hence, it is possible to evaluate and select R&D projects more accurately. (2) It can be possible to raise the possibility of projects success. R&D manager can use the information for project management because the efficacy-efficiency structure of selected projects can be analyzed. (3) We proved the usefulness of the constructed $\ulcorner$CIDEAR$\lrcorner$ model using an case about twenty-one R&D projects of a leading company of electronic industry in Korea.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2015.05a
• /
• pp.226-240
• /
• 2015

The purpose of this study is to establish a proper evaluation system for R&D performance by analyzing relationships between quantitative results of science& technology and national wealth. We analyzed 193,474 research papers in multi-disciplinary fields from SCOPUS database and explored co-relations between HCP production by section and national wealth. This research found a significant relationship between the number of HCP papers and GDP & GDP per capita by nation. Also, results from this study indicate that top 30 to 40 percent of researches should be reflected in the performance evaluation while these numbers could be flexible in accordance with the direction of national policy. In terms of future research, this study provides basis for designing more effective R&D performance evaluation systems.