• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 2006.05a
• /
• pp.1840-1844
• /
• 2006

효과적인 성과지표는 기업 경영의 핵심역량 중의 하나이다. 본 논문에서는 R&D 부서의 성과지표를 수립하는 정량적이고 체계적인 절차를 실제 기업 사례를 통해 제시하고, 각 단계별 성과지표 수립 프로세스와 필요한 방법론을 정의한다. 제안된 방법론은 핵심성공요인 도출, 후보 성과지표 도출, 성과지표 수립, 실행 및 모니터링의 단계를 거쳐 핵심 성과 지표 (Key Performance Indicator)를 수립한다. 성과 지표 수립 단계에서는 성과지표별 가중치 수립을 위해 AHP(Analytical Hierarchy Planning)기법을 사용하였으며, 부서별 효율성을 단일한 지표로 분석하기 위해 실행 단계에서 DEA(Data Envelop Analysis)기법을 사용하였다. 개발된 방법론은 반도체 기업의 R&D 부문 성과 지표 수립 및 평가에 적용되었다.

• The KIPS Transactions:PartD
• /
• v.16D no.4
• /
• pp.541-548
• /
• 2009

Many companies have recently apply SLA and execute IT service by using SLA. However, there are no objective standards for selection and improvement of SLA evaluation metrics. We derive and present measurement attributes that are criteria for selection and improvement of SLA evaluation metrics as measurement metrics. We execute a case study based on D company in order to verify whether the measurement metrics are applicable. We apply and evaluate the measurement metrics that are applicable to D company, and then we designate an improvement line. We propose improvement guidelines of the measurement metrics which score is less than the improvement line's and derive SLA evaluation metrics. We prove that the way of selection and improvement is useful by applying SLA evaluation metrics to D company.

• Proceedings of the Technology Innovation Conference
• /
• 1997.12a
• /
• pp.45-69
• /
• 1997

최근들어 환경변화가 가속화되고 기업의 환경적응성이 중요해짐에 따라 R&D 활동의 평가과정이 학습의 핵심적인 단계로서 새롭게 부각되고 있다. 또한 R&D 활동에서 결과 중심적 접근, 사업부와의 연계 등이 강조되면서 구체적 R&D 성과평가가 연구관리(R&D management)의 중요한 이슈가 되고있다. 그러나 그동안 R&D 성과평가는 R&D 활동 자체가 불확실성을 가지는 특성으로 인하여 체계적 접근이 이루어지지 못하여 왔으며 최근에 들어 R&D 성과평가 부문이 연구관리 및 기술경영분야의 도전적 연구과제가 되고 있다. 본 연구는 이러한 R&D 성과평가를 어떻게 접근할 것인지에 대한 접근방법과 성과 지표의 내용, 성과지표의 선택 및 개발절차, 향후 연구과제를 중심으로 제시한다. 본 연구의 세부내용은 다음과 같다. 첫째, 민간기업 연구개발활동의 성과평가에 적용가능한 평가의 분석틀(framework) 및 관점(perspective)을 제시하였다. 기존 평가모형에 대한 문헌고찰을 바탕으로 종합적, 체계적인 평가분석틀을 도출하고, 측정가능한 성과지표군을 제시하였다. 또한 성과지표들을 다양한 기준에 따라 분류하고 각 분류에 따라 적용가능한 성과지표군을 제시하였다. 둘째, 각 기업별 특성을 고려하고 경영전략과의 연계를 명확히 할 수 있는 구체적인 성과지표를 개발하기 위하여 4단계의 R&D 성과 평가지표 개발절차를 도출하였다. 셋째, 향후연구를 위한 성과평가 연구분야의 주요 연구과제들을 5가지로 정리하여 제시하였다.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.05a
• /
• pp.537-547
• /
• 2017

현재 우리나라의 GDP 대비 R&D 투자 규모는 세계최고의 수준에 이르렀다. 이러한 연구개발 예산의 양적인 확대 및 성장과 함께 상대적으로 연구개발 예산의 효율적 활용이 중요한 과학기술정책 이슈로 부각되고 있다. 본 연구는 정부 R&D사업 유사영역의 효율성 제고를 위한 정책, 전략의 수립 및 실행의 의사결정을 돕는 데이터 기반의 객관적인 지표들을 제시하였다. 그 후 본 연구에서 제시한 효율성 지표들을 NTIS에서 추출한 2015년 정부출연연구기관 R&D 사업 데이터와 연계하여 실질적으로 측정과 사용이 가능한 정량적 지표들만을 따로 선별하였다. 또한 정부 R&D사업 효율성 지표들의 가중치를 측정하기 위하여 계층분석기법(analytic hierarchy process)을 수행하였으며 계층분석기법의 결과로 나온 가중치를 효율성 지표들에 적용하여 과제 우선순위를 도출하였다. 이를 통해 정책의 수립, 실행 및 조정 시 고려해야 할 지표의 우선순위를 설정하여 유사연구영역 관련 정부 R&D 정책수립에서 실행까지의 연계를 강화시키고 국가적으로 한정된 자원의 효율적 사용을 위한 방안을 제시하였다.

• The Journal of Society for e-Business Studies
• /
• v.17 no.2
• /
• pp.165-187
• /
• 2012

Improvements on the incumbent R&D project management structure and performance evaluation criteria in the telecommunication and broadcasting area have been called for. There have been attempts to develop alternative R&D project performance evaluation criteria. In an attempt to develop an alternative measure, this study integrates two different perspectives on R&D projects and various criteria currently being used by many foreign and domestic institutes. As a result, we have developed an alternative R&D project performance evaluation instrument. Then, we have applied the instrument to Korean cases in order to validate it. The new R&D project performance evaluation criteria can contribute to an improvement on the management of R&D projects in the telecommunication and broadcasting area.

• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• Journal of Technology Innovation
• /
• v.20 no.3
• /
• pp.29-55
• /
• 2012

In order to successfully adopt and implement the Balanced Scorecard(BSC), firms need to respond adequately to the rapid changes of today's business environment and consider the growing importance of non financial factors in the business activities such as intangible assets(R&D expenditure, patent, goodwill, etc.). Our primary focus throughout this paper is on developing Key Performance Index(KPI) of BSC for R&D expenditure activities. In this study, we have developed and named PEI(Patent Efficiency Index),which is the KPI for R&D expenditure by focusing on the efficiency of a patent that is the output from the R&D expenditures. Secondarily, we have attempted to address the solution for the current problems of the traditional R&D performance measurement by using our developed PEI and examine the usefulness and effectiveness of the newly developed our PEI. According to the empirical test results, we find that the PEI is positively associated with ROA and Tobin's Q, respectively and show that our developed PEI is more effective and accurate than the traditional R&D performance measurement as a business performance measurement. Furthermore, these findings proves that we can measure and evaluate how efficiently the firms perform the R&D activities and shows that the PEI can be a critical index for evaluating firm's business performance related to the R&D expenditures.

• Korean Journal of Construction Engineering and Management
• /
• v.14 no.4
• /
• pp.118-129
• /
• 2013

Due to the recent surge in natural disasters, with rising social concerns, investment on research & development (R&D) project in natural disaster mitigation area is continuously increasing. However, current R&D performance management system of natural disaster mitigation area does not properly reflect characteristics and social ripple effects of R&D projects. It is indicated that mainly due to the current performance index consists of easy-quantification factors and the performance evaluation system adopts simple aggregation method. Therefore, the purpose of this study is to develop new performance evaluation system considering characteristics and social ripple effects of natural disaster mitigation R&D projects. To this ends, this study derived 3-dimensional performance measurement index through literature review and natural disaster mitigation R&D projects analysis. Finally, based on the derived performance measurement index, this study suggested new and effective performance evaluation system for natural disaster mitigation R&D projects.

• Journal of Korea Water Resources Association
• /
• v.51 no.11
• /
• pp.989-998
• /
• 2018

Connectivity between water source and demand node can be served as a critical system performance indicator of the degree of water distribution network (WDN)' failure severity under abnormal conditions. Graph theory-based approaches have been widely applied to quantify the connectivity due to WDN's graph-like topological feature. However, most previous studies used undirected-unweighted graph theory which is not proper to WDN. In this study, the directed-weighted graph theory was applied for WDN connectivity analyses. We also proposed novel connectivity indicators, Source-to-Node Shortest Pathway (SNSP) and SNSP-Degree (SNSP-D) which is an inverse of the SNSP value, that does not require complicate hydraulic simulation of a WDN of interest. The proposed SNSP-D index was demonstrated in total 42 networks in J City, South Korea in which Pearson Correlation Coefficient (PCC) between the proposed SNSP-D and four other system performance indicators was computed: three resilience indexes and an energy efficiency metric. It was confirmed that a system representative value of the SNSP-D has strong correlation with all resilience and energy efficiency indexes (PCC = 0.87 on average). Especially, PCC was higher than 0.93 with modified resilience index (MRI) and energy efficiency indicator. In addition, a multiple linear regression analysis was performed to identify the system hydraulic characteristic factors that affect the correlation between SNSP-D and other system performance indicators. The proposed SNSP is expected to be served as a useful surrogate measure of resilience and/or energy efficiency indexes in practice.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.12
• /
• pp.491-497
• /
• 2018

This study analyzes the relationship between R&D input and performance using panel data from the defense industry. A research model is established based on the R&D logic model, and the study sample consists of a strongly balanced panel data (n=351) empirically analyzed using panel linear regression. Results identified that defense improvement expenditure has a positive influence on the R&D input, and R&D input positively affected patents using a 5-year time lag. In addition, R&D input positively impacts economic performance, including sales and profit. Hence, the major finding includes R&D inputs have statistically significant effects on economic outcome and the R&D logic model featuring a time-lag.