• Journal of Technology Innovation
• /
• v.22 no.4
• /
• pp.165-198
• /
• 2014

The national R&D performance evaluation system in Korea has been influenced by 'New Public Management' since the 1980s. The 1997 IMF crisis in Korea has necessitated the overhaul of S&T policy strategies in Korea. Reflecting this, effective distribution and utilization of S&T investment and resources has emerged as a crucial policy agenda, while expansionary investment in S&T maintained. During the period of 1999-2005, the R&D evaluation has been more focused on the input side and execution processes than on the results of R&D. Evaluation results were to be reflected in the budgeting of national R&D, but there were some disputes over how to make use of evaluation results between the budgeting ministry and the evaluation agency partly because they were two separate entities. After the advent of the new government(1998-2003) which advocated 'science and technology-oriented society', the national R&D evaluation system has evolved through a new legislation, the Performance Assessment Act, and the establishment of Science & Technology Innovation Agency to build up the unique framework for national R&D evaluation differentiated from the assessment system for general government investment programs. Most recently, due to 'Comprehensive Improvement Plan' in 2013, various components of national R&D evaluation seem to move on a new evolutionary track. For example, different types of evaluation are being developed and tried in accordance with differing evaluation goals, and the individual ministries and the research councils has got more enhanced autonomy and responsibility regarding R&D evaluation. So-called 'tailored' evaluation methods, taking into consideration the characteristics of programs and institutes / organizations to be evaluated, are now being tried. Competences of evaluation experts and agencies has also to be improved and strengthened.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.4
• /
• pp.819-839
• /
• 2009

Proposed increases to the government's R&D budget should be discussed based on merits of meeting efficiency and effectiveness criteria. The evaluation of the national R&D budget and related programs are performed in two areas: a system of R&D budget coordination and allocation, and a system of R&D program performance. This paper mainly focuses on the operational areas of R&D budget evaluation system with a focus on their impact to efficiency and effectiveness. The core view point for a R&D budget evaluation system involves two directions: Firstly, to detail the relationships between the later stage (ex. post) activities such as, program survey, analysis, and program performance evaluation, with the budget evaluation. Secondly, to critically oversee all R&D coordination procedures with a different perspective. Budgeting is generally known as a serial process of policy making, planning and executing. It is highly desirable for the budget to be allocated to, and spent by, specific programs as planned, and that each plan be aligned with a specific policy. As such, a strong relevance between the program structure and budget code system is integral to successful execution. It should be performed using a decision making system which closely examines the link between policy and budget. It is also recommended that systematic relationships be maintained among budget coordination and allocation, performance evaluations of policy and program levels, and program survey and analysis system, and that their operational schedule should be reviewed comprehensively as a one integrated system. The National Science and Technology Council is expected to play a major and practical role as the center of policy planning and should be supported by the objective and unbiased system which covers overall process from policy making to program evaluation. Finally, increased utilization of contents, timely program survey and analysis, and accurate of activity scheduling of budget coordination and allocation, and diligent program performance evaluation all contribute towards a more efficient and effective overall evaluation system.

• The Journal of Information Systems
• /
• v.19 no.2
• /
• pp.73-95
• /
• 2010

This study shows the scientific and systematic Evaluation Model using factor analysis and AHP methods for the success of defense Information System R&D projects. The evaluation model was divided into 7 evaluation factors such as Developing support, Developing infrastructure, Developing management and test & evaluation, Support factors for strength, Understanding & developing strategy, Developing technology & organization, and Developing performance. And those were composed of totally 24 low level Evaluation index. The Developed Evaluation Model in the paper could be contributed more to objectively and transparently company selection of defense Information System R&D and other defense R&D Projects in the future.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.4
• /
• pp.101-110
• /
• 2018

This study aims to objectively measure the efficiency of nanotechnology R&D programs by systematically evaluating the inputs and outputs of nanotechnology R&D activities and to find implications for improving the efficiency of nanotechnology R&D programs. Data on input factors such as R&D investment, R&D manpower, R&D period, and output factors such as paper, patent, and commercialization for R&D projects which started from 2008 or afterwards and ended by 2011 are gathered through National Science and Technology Knowledge Information Service, which are used for efficiency evaluation. In this study, we analyzed R&D efficiency in detailed technology units in depth. The process taken in this study is as follows. First, the basic statistics of input and output factors to compare and analyze R&D investment, R&D manpower, R&D period, paper, patent, and commercialization status by technology unit are analyzed. Next, DEA models are utilized to derive the overall efficiency, pure technology efficiency, and scale efficiency by conducting the efficiency evaluation for each technology unit, from which implications for strategic budget allocation are derived. In addition, partial efficiency evaluation is conducted to identify advantages and disadvantages of each technology unit. In turn, cluster analysis is performed to identify similar technology units, from which implications for efficiency improvement are derived.

• Journal of Technology Innovation
• /
• v.31 no.3
• /
• pp.171-199
• /
• 2023

The purpose of this study was to develop an evaluation tool for selecting new projects for R&D project planning level of K Research Institute. For this purpose, items and questions for R&D project selection evaluation were developed based on the CIPP model and previous studies on selection evaluation and evaluation indicators for research project evaluation, and then two Delphi surveys were conducted. The developed evaluation tool was surveyed by 13 experts to verify contents validity ratio, convergence and consensus. The finally selected evaluation tool for R&D project planning consisted of 21 questions in 8 items, including 5 questions for context evaluation, 2 questions for input evaluation, 8 questions for process evaluation, and 6 questions for product evaluation. The evaluation tool developed will contribute to the solution of problems in the bottom-up planning process and to the improvement of the planning competence of the researchers. It will also contribute to improve the consistency and efficiency of evaluation during the selection process.

• Journal of Korea Technology Innovation Society
• /
• v.4 no.3
• /
• pp.275-290
• /
• 2001

The frameworks for evaluation of national R&D programs reflect their various political and administrative cultures(Gibbons & Georghiou, 1987), and the structure of national R&D system. In this research the core research questions are : what is god evaluation\ulcorner What is being evaluated, by whom, by which criteria, for whom and what purpose\ulcorner In order to examine these general aims and answer these questions, in detail several objectives can be proposed on the process of this research. In this research, the national R&D programs will be considered in terms of the interface between evaluation and the wider policy-making process. The programs for case study are the Alvey program(UK), the Advanced Technology Program (US) and the Framework program(EU) . One of the characteristics of these programs is the well established evaluation systems they have. From the comparative analysis, we can withdraw some useful implication for Korean evaluation practice for national R&D programs. Evaluation system is social process and the way in which it is organized is critical to its outcome.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2008.10a
• /
• pp.700-702
• /
• 2008

A new evaluation method which named 'Security Viewing Angle Factor (SVAF)' was suggested for VIC (Viewing-angle Image Control) technology to quantify a visual hiding performance of LCD. Currently, Contrast Ration (CR) is the general method to evaluate VIC technology. However, CR shows a significant difference when compared with the result of human visual system. Furthermore, a perceptional evaluation method and its conditions were established.

• Journal of Korea Technology Innovation Society
• /
• v.17 no.4
• /
• pp.703-732
• /
• 2014

Meta-evaluation for national R&D programs should be established within the framework of whole R&D system linked with science and technology needs and objectives. The R&D program evaluation system can be understood as a circulation of input, implementation, output, and utilization. In the result of the Delphi survey, which consisted of twenty-four experts (performed in three rounds), twenty-four indices were developed. The meta-evaluation model included sub-items which were important points of view of it as follow (eight items): propriety of planning, sufficiency of information, and propriety of evaluators in evaluation input; appropriateness of method and appropriateness of procedure in evaluation implementation; credibility of output in evaluation output; and usefulness of report and application of evaluation utilization. As the application of the meta-evaluation model, the total mean was lower than 3.0 of the median value of 2.73 (5 point Likert scale). Finally, it was suggested that the feedback of evaluation results should be more enforced to R&D program improvement particularly (evaluation utilization 2.50).

• Journal of Korea Technology Innovation Society
• /
• v.3 no.2
• /
• pp.48-60
• /
• 2000

An effort has been made in this paper to measure the project manager's reaction to R&D project evaluation and present the useful information related to rebuilding an R&D evaluation system. Results of this study show that project manager's reaction is related to the selection of reasonable items for evaluation, the rater's expertise, the project manager's participation in evaluation process and so on. Accordingly, managers of the research institute have to set up the evaluation system after deeply considering these results.

• The Journal of Society for e-Business Studies
• /
• v.13 no.3
• /
• pp.103-119
• /
• 2008

Over the last two decades, national R&D projects have been increased rapidly. The government has tried to improve the success of national R&D projects. But the weakness of the evaluation process for national R&D projects, there remains some problems. In order to solve those problems this study proposed an advanced evaluation process of national R&D projects on the basis of ISO/IEC15288, ISO/IEC12207 and ISO/IEC14598. The evaluation process consists of preparing evaluation, establishing evaluation requirements, specifying evaluation, designing evaluation, executing evaluation and reporting evaluation. The evaluation process is an artifact-oriented process. The results of this study can be used for reforming the evaluation process of national R&D projects.