• Journal of Information Technology Services
• /
• v.14 no.4
• /
• pp.45-60
• /
• 2015

Governments around the world invest in research and development (R&D) for different purposes : national economy, defence, environment, health, etc. as a means of national survival beyond the means of national competitiveness. These are usually programs with high social impact but low short-term economic impact or large scientific programs that are too expensive and risky for private sector investment alone. The Republic of Korea has also shown a very successful model of economic progress and social development through government R&D programs. However, there have been many corruption scandals behind it while selecting awardees for government R&D programs in Korea. So, the Republic of Korea focused on reforming appraisal system for government R&D and began preparation for "Clean Appraisal System" last year. In this study, first we analyzed the related appraisal tasks through the review of laws and administrative rules and typed appraisal tasks according to the flow of the actors and time. Thus securing the information infrastructure and finally we drew the conceptual model of the system according to an open appraisal tasks by introducing an element of the OECD on open government typed appraisal tasks.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• STI Policy Review
• /
• v.4 no.2
• /
• pp.41-54
• /
• 2013

R&D is inherently an uncertain endeavor, yet now more than ever those performing R&D with public funding are called upon to clarify the utility of their research. Calls for public accountability are mounting with the increase in constraints on government budgets due to the recent worldwide economic recession, in response to which both policymakers and researchers pay much more attention to rigorously assessing publicly funded R&D. A key issue complicating R&D evaluation in these circumstances is how to adequately account for the nature and degree of risk involved in a given R&D program or project. This study deliberates on certain issues involving the measurement of ex-ante risk in public R&D evaluation: (i) information asymmetry between R&D sponsors and performers, (ii) ambiguity in the measurement of returns in both prospective and retrospective evaluation, and (iii) the dilemma between measurement error and omitted variable bias for empirical estimation of R&D performance. The study then presents an analysis of hypothetical evaluation results that apply risk-relevant weights to the annual evaluation outcomes of South Korea's national R&D programs funded during 2006~2012. In this counterfactual re-evaluation of public R&D program performance, high-risk R&D programs turn out to receive higher evaluation than non-high-risk programs. The current study suggests that R&D evaluation ignoring ex-ante risk is not only conceptually invalid since R&D activities are intrinsically uncertain endeavors, but unfair as R&D performers are asked to be accountable for the results that were in fact out of their reach.

• Industry Promotion Research
• /
• v.8 no.2
• /
• pp.45-59
• /
• 2023

In response to the increasing global competition for technological supremacy to address climate change, it is crucial to develop workforce development programs in the field of climate technology to accumulate the national technological capabilities. However, these programs are rarely monitored and evaluated, and research related to monitoring and evaluation in the field of climate technology workforce development is limited. Therefore, this study aimed to investigate the impact of workforce development programs in hydrogen energy and policy sectors on students' R&D capabilities and career aspirations in these sectors. The survey and focus group interviews with beneficiaries revealed that individual students' R&D capabilities and career confidence improved, and group-level R&D capabilities were also enhanced, and students felt greater appreciation on the significance of climate technology. The results of this study suggest that the necessary R&D capabilities to train R&D workforce in climate technology have been developed, but more measures are required to promote career development in this field.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.45 no.6
• /
• pp.965-977
• /
• 2021

The study aimed to analyze the functional differences in 3D virtual garment programs and compare body scan data with the corresponding 3D virtual models. We selected 3D virtual garment programs, formed virtual models in a representative size for high-school male cyclists, and analyzed them using the Design-X program. The results were as follows. In the 3D virtual garment programs, the anthropometric items for virtual model forming differed significantly from the standard anthropometric items suggested by Size Korea. Comparing the lower body scan data and virtual models formed by the 3D virtual garment programs, the biggest difference was in the shapes of the waist and hips, i.e., the flatness values of the waist and hips were different for each program in the cross-section view. In the lower body, a data-input-based program was needed for changing the exact measurement position of the waist circumference and hips' shape in detail. If a 3D virtual garment program provides functions for the virtual model's joint angle input and free motion transformation, it is expected to be widely used in the sportswear industry.

• Journal of Korea Technology Innovation Society
• /
• v.8 no.1
• /
• pp.183-208
• /
• 2005

In recent years, national R&D programs tend to become larger and more complicated, which necessitates strengthening the overall coordination of national R&D programs at the inter-ministerial level from the program planning stage. This paper looks into the status and problems of Korea's national R&D programs and proffers ways to improve the current system It highlights the problems shown in the process of the 2004 overall coordination and their rectification. First, various ad-hoc private-led committee brought about inefficiency in decision making process. Therefore, it is necessary to streamline such committees and strengthen the function of the Office of Science and Technology Innovation, Second, in view of the implementation of the overall coordination system, it is necessary to identify the problems in full detail that were raised in the course of the previous year's overall coordination so that new projects can be allotted minimal grades and follow-up activities can be efficiently put into execution. Third, it is necessary to establish standing committees for constant review and efficient utilization that will be devoted to reviewing programs overlapped and their linkage. Fourth, priority of investment regarding the nation's strategic policy direction should be reflected. Fifth, given the lack of performance-based evaluation system, it is necessary to develop macro and micro evaluation indices in conjunction with enacting the tentatively named "Performance-based Law." The overall coordination system of national R&D programs should be supplemented and further developed in relation to the aforementioned problems and their rectification in order to enhance the expertise, fairness, and efficiency of the nation's R&D coordination system.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.70-87
• /
• 2009

This paper studies the efficiency of public sector confronting with increasing oil price, economy crisis and energy-environment problems. In consideration that efficiency of national R&D program has been subjectively evaluated, this paper focuses objective validity by relative efficiency through a comparison among R&D programs in Korea. To implement this study, data published in national reports on R&D programs is used and analyzing method is induced by related books and theories. At the result of Data Envelopment Analysis on the collected data, this paper suggests the way to enhance the efficiency of nuclear R&D program. This study is the first on efficiency of national R&D programs applied DEA methods and is expected to contribute exploring the more efficient way of program management if more sophisticated DEA could be developed and applied.

• Proceedings of the Korea Contents Association Conference
• /
• 2006.11a
• /
• pp.698-701
• /
• 2006

National R&D programs are managed and operated by institutes under different ministries. The R&D information created through these programs are designed and constructed heterogeneously both semantically and structurally. Therefore, integrated collection, analysis and application of the information through the interoperability of information at the national level becomes nearly impossible, and redundant production and operation of R&D information becomes a general problem. The Office of Science and Technology Innovation has started the construction of the National Science and Technology Information System(NTIS), which is based on the interoperability and sharing of R&D information, to resolve these issues. In this paper, we propose a method to construct a system for sharing national R&D information held by different ministries while minimizing the effect on the autonomy of the institutes involved.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.4
• /
• pp.101-110
• /
• 2018

This study aims to objectively measure the efficiency of nanotechnology R&D programs by systematically evaluating the inputs and outputs of nanotechnology R&D activities and to find implications for improving the efficiency of nanotechnology R&D programs. Data on input factors such as R&D investment, R&D manpower, R&D period, and output factors such as paper, patent, and commercialization for R&D projects which started from 2008 or afterwards and ended by 2011 are gathered through National Science and Technology Knowledge Information Service, which are used for efficiency evaluation. In this study, we analyzed R&D efficiency in detailed technology units in depth. The process taken in this study is as follows. First, the basic statistics of input and output factors to compare and analyze R&D investment, R&D manpower, R&D period, paper, patent, and commercialization status by technology unit are analyzed. Next, DEA models are utilized to derive the overall efficiency, pure technology efficiency, and scale efficiency by conducting the efficiency evaluation for each technology unit, from which implications for strategic budget allocation are derived. In addition, partial efficiency evaluation is conducted to identify advantages and disadvantages of each technology unit. In turn, cluster analysis is performed to identify similar technology units, from which implications for efficiency improvement are derived.

• Journal of Korea Technology Innovation Society
• /
• v.9 no.4
• /
• pp.759-775
• /
• 2006

Agricultural R&D Programs of the Ministry of Agriculture and Forest and the Rural Development Administration are important for improving agricultural technology in Korea. However, the roles of these two agencies have been overlapped as the research fields and funds are extended through educational-industrial-governmental-institutional cooperation programs. In this study, we analyzed the performances of two agencies. As a result, these programs of these agencies do not show much difference in the research area. A new direction for improving efficiency and solving problems of programs, with a variety of information about the role of two agencies and activation of agricultural R&D programs, will be provided by this performance analyses.