• Journal of Technology Innovation
• /
• v.22 no.2
• /
• pp.77-104
• /
• 2014

Government R&D support for SMEs is very important and the R&D budget is also increasing. This study suggests a new method for analyzing a performance of R&D programs and analyzes the performance of R&D programs funded by small & medium business administration using the method. We discuss new measures "efficiency" that means short-term performance and "effectiveness" that means long-term performance. Weights based on the R&D programs' characteristics among the various sub-indicators of two measures were derived, and then the final scores were calculated by combining the weights with the responses on the indicators. Finally, this study tests the mean differences between R&D programs statistically. As a results, efficiency of R&D programs shows a significant difference between the R&D programs, while effectiveness does not. Most of the efficiency scores are low, whereas the effectiveness scores are high. The results explain that the R&D programs are managed inefficiently. However, most SMEs predict a positive impact of government R&D supports on effectiveness in the long term. Government needs to try to improve the efficiency of R&D supports because SMEs cannot expect sustainable performance with no improvement in efficiency.

• Korean Management Science Review
• /
• v.34 no.2
• /
• pp.67-83
• /
• 2017

This paper proposes a R&D project performance measurement model for private firms combining balanced scorecard (BSC) and data envelopment analysis (DEA). The efficiency of R&D projects is measured in terms of each of the three perspectives of BSC by using DEA : the internal process perspective (DEA-P), the customer perspective (DEA-C), and the financial perspective (DEA-F). The performance indicators of the three perspectives of BSC are considered as outputs of the corresponding DEA models. To provide strategic implications for R&D planning, we also propose the R&D project performance matrices composed of two different types of efficiency dimensions. The proposed model is expected to be fruitfully utilized for R&D performance measurement of private firms.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.6
• /
• pp.677-682
• /
• 2018

The relationship-type research and development (R&D) portfolio is a method for selecting core technologies based on their unique purposes and characteristics when the criteria for selecting them are independent. This study presents a relationship-type R&D portfolio method as a way to derive core technologies, and describes the methodology by dividing it into three steps: 1) analyze the relationships between selection criteria and analytical indicators, 2) form a portfolio matrix that best matches each selection criteria, and 3) derive the core technologies. In this study, the relationships between four selection criteria for selecting core technologies and the analytical indicators for identifying the technology level, economics, and the technology itself, are written in a table with HoQ. Based on the relationship table, analytical indicators to be considered were derived to satisfy each selection criterion, and the derived analytical indicators and the selected technologies were constructed with two axes in the portfolio matrix. The satisfied portfolio, P0, that satisfies all four criteria, and the portfolio, P1~P4, that satisfies selection criteria based on the unique characteristics of the four criteria, were constructed, and core technologies derived. The selected core technologies can be utilized in selecting a core area against the future security environment through a process like key word analysis based on the specifications.

• Journal of Technology Innovation
• /
• v.25 no.4
• /
• pp.263-284
• /
• 2017

The purpose of this research is to analyze the performance of national R&D projects and to find out measures to improve the performance indicators, focusing on energy HRD projects. The main analysis target is 86 energy manpower projects supported since 2010. The performance indicators of the energy HRD projects are related to the research capacity, the number of emission workers, industry-university linkage, job creation and so on, and analyzed by using the 11 indicators of human resource performance index called KPI index. As a result of analyzing the attainment level of the proposed target by task, the index with the highest achievement level is the corporation linkage rate, and the index with the lowest achievement level is the participating company employment. As a result of examining the effects of job creation in company - linked activities, it was found that the greater the number of participating companies in the business, the greater the employment creation effect of the number of internships. As a result of the above analysis, the following policy alternatives are proposed. First, it is necessary to consider adding indicators that can express the quality performance of the business and performance indicators that can express actual business linkages. Second, it is necessary to strengthen the management of differentiated performance indicators according to policy performance targets and major target groups. Third, it is necessary to improve information input and accumulation system along with improvement of performance index.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• International Commerce and Information Review
• /
• v.16 no.4
• /
• pp.363-384
• /
• 2014

The adequate measurement of government expenditure efficiency for Energy Technology Development is a difficult empirical issue and the literature on it, particularly when it comes to aggregate and international data. Contribution in this study is threefold: first this study analyze the adequate measurement of government expenditure efficiency on Energy Technology sector of 24 OECD countries and korea. Second this study reconstruct efficiency composite indicators, named "Energy Technology Development Interest level indicator". Third this study assesses the efficiency of government expenditure for Energy Technology Development. The results can be summarized as follow: Korea's government expenditure efficiency for Energy Technology Development is highly ranked among 25 OECD countries based on Energy Technology Development R&D Budgets and Energy Technology Development R&D Budgets per thousand units of GDP indicators. However, Korea's ranking has fallen to 20th. The assessment suggests that government will be have to provide more government expenditure to enhance the efficiency on Energy.

• Journal of the Korean Regional Science Association
• /
• v.9 no.1
• /
• pp.65-78
• /
• 1993

In this study, the significant and enduring concentration of federal R&D spending in metro-scale clusters across the nation is treated as evidence of the operation of a distinct industrial infrastructure defined by the ability of R&D performers to attract external funding and pursue the sophisticated project work demanded. It follows, then, that the agglomerative potential of these R&D concentrations -- performers and their support infrastructures -- requires a search for economic impacts guided by a different stimulative effects attributable to federal R&D spending may be that substantial subnational economic impacts are routinely obscured and diluted by research designs that seek to discover impacts either at the level of nation-scale economic aggregates or on firms or specific industries organized spatially. Therefore, this study proceeds by seeking to link the locational clustering of federal contract R&D spending to more localized economic impacts. It tests a series of models(X-IV) designed to trace federal contract R&D spending flows to economic impacts registered at the level of metro-regional economies. By shifting the focus from funding sources to recipient types and then to sector-specific impacts, the patterns of consistent results become increasingly compelling. In general, these results indicated that federal R&D spending does indeed nurture the development of an important nation-spanning advanced industrial production and R&D infrastructure anchored primarily by two dozed or so metro-regions. However, dominated as it is by a strong defense-industrial orientation, federal contract R&D spending would appear to constitute a relatively inefficient national economic development policy, at least as registered on conventional indicators. Federal contract R&D destined for the support of nondefense/civilian(Model I), nonprofit(Model II), and educational/research(Mode III) R&D agendas is associated with substantially greater regional employment and income impacts than is R&D funding disbursed by the Department of Defense. While federal R&D support from DOD(Model I) and for-profit(Model II) and industrial performer(Model III) contract R&D agendas are associated with positive regional economic impacts, they are substantially smaller than those associated with performers operating outside the defense industrial base. Moreover, evidence that the large-business sector mediates a small business sector(Model VI) justifies closer scrutiny of the relative contribution to economic growth and development made by these two sectors, as well as of the primacy typically accorded employment change as a conventional economic performance indicator. Ultimately, those regions receiving federal R&D spending have experienced measurable employment and income gains as a result. However, whether or not those gains could be improved by changing the composition -- and therefore the primary missions -- of federal R&D spending cannot be decided by merely citing evidence of its economic impacts of the kind reported here. Rather, that decision turns on a prior public choice relating to the trade-offs deemed acceptable between conventional employment and income gains, the strength of a nation's industrial base not reflected in such indicators, and the reigning conception of what constitutes national security -- military might or a competitive civilian economy.

• Journal of Korea Technology Innovation Society
• /
• v.13 no.3
• /
• pp.494-512
• /
• 2010

Recently diversity of research field is emphasized all over the world. Nations with advanced programs in research field keep developing new R&D programs for interdisciplinary studies. These new research atmospheres need objective validity in evaluation process. Peer review is recognized as a best evaluation method for national research and development programs. However, peer review system has restrictive boundary because of its subjectivity of the reviewer. Scientometrics has been developed as an alternative system to peer review. But the effectiveness of quantitative indicators which also has qualitative aspect is rarely analyzed in real program evaluation. In this study, we suggest distribution of marks of peer review and newly developed quantitative review through analyzing deviations between two different reviews in real national R&D program evaluation. Moreover, we could have significant correlation between two review systems in the same case study.

• The Journal of the Korea Contents Association
• /
• v.17 no.11
• /
• pp.331-341
• /
• 2017

As increasing the importance of the R&D strategy planning based on S&T evidence, the S&T DB was conducted to develop appropriate basic research support strategies by collecting 49 multiple-nations' statistics and information, extracting 6446 raw data, categorizing 877 indicators including 208 core indicators. An statistical and knowledge map analysis using the highly cited publication-related indicators was conducted to examine the expansion of DB utilization by demonstrating effectiveness of Korea's basic research. As a result, basic research investment have a strong influence on creating outstanding R&D outcomes and on producing a foundation of various S&T based-growth engines.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.