Browse > Article
http://dx.doi.org/10.11627/jkise.2012.35.4.149

Open Innovation R&D Efficiency Evaluation by Integrated AHP-DEA  

Min, Hyun-Ku (School of Business and Economics Graduate School, Hanyang University)
Kim, Tai-Young (School of Business and Economics, Hanyang University ERICA)
Hwang, Seung-June (School of Business and Economics, Hanyang University ERICA)
Publication Information
Journal of Korean Society of Industrial and Systems Engineering / v.35, no.4, 2012 , pp. 149-161 More about this Journal
Abstract
The current environment of technological and competitive changes influences not only the business R&D environment but also government driven national R&D strategies. Open innovation has now become an important paradigm that is replacing the outdated paradigm of closed innovation. Many companies and nations have been increasing R&D investment because R&D has been considered a driving force for national and corporate competitive advantage. The purpose of this paper is to evaluate and compare the performance of R&D focused on open innovation according to scientific and technological outputs which is based on paper publications, patents and etc. Comparisons should not be only based on the quantity but also on the quality of the output. This paper shows that it is possible to develop DEA models that utilize the Analytical Hierarchical Process in order to transform the qualitative index into a quantitative index. Hence, the relative efficiency for R&D organizations is obtained based on both quantity and quality outputs and subsequently provides comprehensive and realistic methods for decision makers to identify levels of project efficiency.
Keywords
Open Innovation; R&D; AHP-DEA; Scientific and Technological Performance;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Bae, J.T. and Bong, S.H., Development of a performance index in private company R&D activity. Journal of Technology Innovation, 1998, Vol. 12, p 45-69.
2 Banker, R.D., Chanes, A., and Cooper, W.W., Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 1984, Vol. 30, p 1078-1092.   DOI   ScienceOn
3 Berchicci, L., Towards an open R&D system : Internal R&D investment, external knowledge acquisition and innovative performance. Research Policy, 2012, Vol. 42, p 117-127.
4 Bitman, W.R. and Sarif, N., A Conceptual Framework for Ranking R&D Projects. Engineering Management, 2008, Vol. 55, p 267-278.
5 Charnes, A., Cooper, W.W., and Rhodes, E. Measuring the efficiency of decision making units. European Journal of Operational Research, 1978, Vol. 3, p 429-444.
6 Chesbrough, H.W., Open Innovation : the new imperative for creating and profiting from technology. Boston, Massachusetts, USA : Harvard Business school press; 2006.
7 Cho, K.T., Cho, Y.K., and Kang, H.S., Analytic Hierarchy Decision Making of Proceeding Leaders, Seoul, Korea : Donghyun, 2003, p 9-12.
8 Cho, Y.G. and Cho, K.T., Development of an evaluation model in public R&D programmes-conceptual approach. The korean Operations Research and Management Science Society, 2005, p 1045-1051.
9 Choi, J.W., A study on the improvement of management outcomes in the start-up companies using AHP and DEA-Focusing on the tenant companies of business incubator center-. [dissertation]. [Seoul, Korea] : Ky.
10 Choi, T.G., Strategic Design of the Government R&D Management System based on the Analysis of Relationship between R&D Program Types and their Outputs. [dissertation]. [Seoul, Korea] : Konkuk University; 2000.
11 Ho, W., Integrated analytic hierarchy process and its applications-A literature review. European Journal of Operational Research, 2008, Vol. 186, p 211-228.   DOI   ScienceOn
12 Hsu, P.M. and Hsueh, C.C., Measuring realtive efficiency of government-sponsored R&D projects : A three- stage approach. Evaluation and Program Planning, 2009, Vol. 32, p 178-186.   DOI   ScienceOn
13 Jang, H.D. and Lee, J.H., An efficient selection of promising technology using DEA and AHP. Korean Corporation Management Review, 2011, Vol. 6, p 67-85.
14 Kim, M.S. and Jeong, H.J., Countstratgy Post catch-up in Mobile Phone industry. Korea Information Society Development Institute, 2010, Vol. 22, p 1-16.
15 Jyoti, Banwet D.K. and Deshmukh, S.G., Evaluating performance of national R&D organizations using integrated DEA-AHP technique. International Journal of Productivity and Performance Management, 2008, Vol. 57, p 370-386.   DOI   ScienceOn
16 Kim, B.W. and Oh, H.S., An effective R&D performance measurement system : survey of Korean R&D researchers. Omega, 2002, Vol. 30, p 19-31.   DOI   ScienceOn
17 Kim, H.B., Yoon, J.H., Kim, J.S., and Kim, K.S., A Performance Indicator Roadmap Framework for evaluating Government R&D Programs. Proceeding of The Korean Institute of Industrial Engineers Spring Conference, 2009, p 1-9.
18 Kim, M.S., Internet shopping mall evaluation by AHP/ DEA. [dissertation] [Seoul, Korea] : Korea University, 2001.
19 Kim, S.H., Jeong, B.H., and Kim, J.K., Analysis and Application of Decision making. 8th ed. Seoul, Korea : Youngchimunwhasa, 2009, p 379-401.
20 Kim, Y.G., A Direction of Industrial Technology Policy for Open Innovation., Issue paper 2011-11. Seoul, Korea : KIAT, 2011.
21 Lee, D.J., Bae, S.S., and Kang, J.S., Development of R&D project selection model and web-based R&D project selection system using hybrid DEA/AHP model. Journal of the Korean Institute of Industrial Engineers, 2006, Vol. 32.
22 Lee, J.J. and Lee, K.C. The Role of Government and The Strategy of Post Catch-up Science and Technology. Proceedings of Korea Technology Innovation Society Conference, 2010, p 223-239.
23 Lee, K.W., Kim, H.B., and Jang, I.H., Implication and Analysis of Application system and management of Pubic R&D Performance. Korea Institute of Science and Technology Evaluation and Planning, 2012, Vol. 2, p 3-7.
24 Lin, M.I., Lee, Y.D., and Ho, T.N., Applying integrated DEA/AHP to evaluate the economic performance of local governments in China. European Journal of Operational Research, 2011, Vol. 209, p 129-140.   DOI   ScienceOn
25 Park, S.J., Kim, K.H., and Jeong, S.K., The Study on the Analysis of Efficiency of Governmental R&D Programs Regarding to the S&T Outcomes. Journal of Korea Technology Innovation Society, 2010, Vol. 14, p 205-222.
26 Liu, J.S. and Lu, W.-M., DEA and ranking with the network-based approach : a case of R&D performance. Omega, 2010, Vol. 38, p 453-464.   DOI   ScienceOn
27 Management Manual of R&D Performance in Ministry of Education, Science and Technology. Seoul, Korea : Ministry of Education, Science and Technology, National Research Foundation of Korea : 2009, p 50-51.
28 Meng, W., Zhang, D., Qi, L., and Liu, W., Two-level DEA approaches in research evaluation. Omega, 2008, Vol. 36, p 950-957.   DOI   ScienceOn
29 Park, S.M., Khoe, K.I., and Sul, W.S., A Study on Performance Evaluation of Government-Funded R&D Projects with Composite Scores : Focussing on 'Supporting Project on Application Technology Development. Korean Journal.
30 Park, S.M., Analysis of Congruence Between DEA Efficiency Scores and Normalization Indices of R&D Projects, Korean Journal of Business Administration, 2011, Vol. 24, p 1999-2014.
31 Park, S.M., Two-staged DEA/AR-I Performance Evaluation Model for R&D Projects Efficiency Correlation Analysis and Programs Positioning Investigation. Korean Journal of Business Administration, 2010, Vol. 23, p 3285.
32 Rhim, H.S., Yoo, S.C., and Kim, Y.S., A DEA/AHP hybrid model for evaluation and selection of R&D projects. The korean Operations Research and Management Science Society, 1999, Vol. 24, p 1-12.
33 Saaty, T.L., How to Make a Decision : The Analytic Hierarchy Process. European Journal of Operational Research, 1990, Vol. 48, p 9-26.   DOI   ScienceOn
34 Shang, J. and Sueyoshi, T., A Unified Framework for the Selection of a Flexible Manufacturing System. European Journal of Operational Research, 1995, Vol. 85, p 297-315.   DOI   ScienceOn
35 Sohn, S.Y., Yong, G.J., and Hong, K.H., Structural equation model for the evaluation of national funding on R&D project of SMEs in consideration with MBNQA criteria. Evaluation and Program Planning, 2007, Vol. 30, p 10-20.   DOI   ScienceOn
36 Yang, W.M., A study on the selection methodology of R&D projects using DEA/AHP with ordinal factors. [Master's thesis]. [Seoul, Korea] : Kyung Hee University, 2003.
37 Wang, E.C. and Huang, W., Relative efficiency of R&D activities : A cross-country study accounting for environmental factors in the DEA approach. Research Policy, 2007, Vol. 36, p 260-273.   DOI   ScienceOn
38 Wang, Y.M., Liu, J., and Elhag, T.M.S., An integrated AHP-DEA methodology for bridge risk assessment. Computers and Industrial Engineering, 2009, Vol. 54, p 513-525.
39 Yang, T. and Kuo, C., A hierarchical AHP/DEA methodology for the facilities layout design problem. European Journal of Operational Research, 2003, Vol. 147, p 128-136.   DOI   ScienceOn
40 Yim, H., 2010 Technology Level Evaluation Report -95 Focued Science Technology-. 2011-031. Seoul, Korea : KISTEP, 2011.
41 Yun, J.H., Kwon, O.J., Park, J.S., and Jeong, E.S., A Study on the Development and Adaption of Open Innovation Analysis Model. Journal of Korea Technology Innovation Society, 2010, Vol. 13, p 99-123.