Browse > Article
http://dx.doi.org/10.7232/JKIIE.2015.41.5.425

Performance Evaluation of R&D Commercialization : A DEA-Based Three-Stage Model of R&BD Performance  

Jeon, Ikjin (The Graduate School of Public Policy and Information Technology, Seoul National University of Science and Technology)
Lee, Hakyeon (Department of Industrial and Systems Engineering, Seoul National University of Science and Technology)
Publication Information
Journal of Korean Institute of Industrial Engineers / v.41, no.5, 2015 , pp. 425-438 More about this Journal
Abstract
This study proposes a three-stage model of R&BD performance which captures commercialization outcomes as well as conventional R&D performance. The model is composed of three factors : inputs (R&D budgets and researchers), outputs (patents and papers), and outcomes (technical fees, products sales, and cost savings). Three stages are defined for each transformation process between the three factors : efficiency stage from input to output (stage 1), effectiveness stage from output to outcome (stage 2), and productivity stage from input to outcome (stage 3). The performance of each stage is measured by data envelopment analysis (DEA). DEA is a non-parametric efficiency measurement technique that has widely been used in R&D performance measurement. We measure the performance of 171 projects of 6 public R&BD programs managed by Seoul Business Agency using the proposed three-stage model. In order to provide a balanced and holistic view of R&BD performance, the R&BD performance map is also constructed based on performance of efficiency and productivity stages.
Keywords
R&D Performance; R&BD; Commercialization; Data Envelopment Analysis(DEA); Performance Map;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Guan, J. and Chen, K. (2012), Modeling the relative efficiency of national innovation systems, Research Policy, 41(1), 102-115.   DOI
2 Guan, J. and Wang, J. (2004), Evaluation and interpretation of knowledge production efficiency, Scientometrics, 59(1), 131-155.   DOI
3 Hsu, F. M. and Hsueh, C. C. (2009), Measuring relative efficiency of government-sponsored R&D projects : A three-stage approach, Evaluation and Program Planning, 32(2), 178-186.   DOI
4 Jeon, J., Kim, C., and Lee, H. (2011), Measuring efficiency of total productive maintenance(TPM) : a three-stage data envelopment analysis( DEA) approach, Total Quality Management and Business Excellence, 22(8), 911-924.   DOI
5 Keh, H. T. and Chu, S. (2003), Retail productivity and scale economies at the firm level : A DEA approach, Omega, 31(2), 75-82.   DOI
6 Keh, H. T., Chu, S., and Xu, J. (2006), Efficiency, effectiveness and productivity of marketing in services, European Journal of Operational Research, 170(1), 265-276.   DOI
7 Kerssens-van Drongelen, I., Nixon, B., and Pearson, A. (2000), Performance measurement in industrial R&D, International Journal of Management Reviews, 2(2), 111-143.   DOI
8 Kim, Y.-H. and Lim, H.-J. (2013), A Study on the Creative Economy and Diffusion of R&D, Korea Productivity Association, 27(2), 285-307.
9 Kocher, M. G., Luptacik, M., and Sutter, M. (2006), Measuring productivity of research in economics : A cross-country study using DEA, Socio-Economic Planning Sciences, 40(4), 314-332.   DOI
10 Lee, C. and Cho, K. (2014), Efficiency Analysis and Strategic Portfolio Model of National Health Technology R&D Program Using DEA : Focused on Translational Research, Journal of the Korean Institute of Industrial Engineers, 40(2), 172-183.   DOI
11 Lee, D., Bae, S., and Kang, J. (2006), Development of R&D Project Selection Model and Web-based R&D Project Selection System using Hybrid DEA/AHP Model, Journal of the Korean Institute of Industrial Engineers, 32(1), 18-28.
12 Lee, H. and Park, Y. (2005), An international comparison of R&D efficiency : DEA approach, Asian Journal of Technology Innovation, 13(2), 207-221.   DOI
13 Lee, H. and Shin, J. (2014), Measuring journal performance for multidisciplinary research : An efficiency perspective, Journal of Informetrics, 8(1), 77-88.   DOI
14 Lee, H., Park, Y., and Choi, H. (2009), Comparative evaluation of performance of national R&D programs with heterogeneous objectives : A DEA approach, European Journal of Operational Research, 196(3), 847-855.   DOI
15 Linton, J. D., Morabito, J., and Yeomans, J. S. (2007), An extension to a DEA support system used for assessing R&D projects, R&D Management, 37(1), 29-36.
16 Linton, J. D., Walsh, S. T., and Morabito, J. (2002), Analysis, ranking and selection of R&D projects in a portfolio, R&D Management, 32(2), 139-148.   DOI
17 Liu, J. S. and Lu, W. M. (2010), DEA and ranking with the network-based approach : a case of R&D performance, Omega, 38(6), 453-464.   DOI
18 Meng, W., Hu, Z., and Liu, W. (2006), Efficiency evaluation of basic research in China, Scientometrics, 69(1), 85-101.   DOI
19 Park, S. (2014), Identification of DEA Determinant Input-Output Variables, Journal of the Korean Institute of Industrial Engineers, 40(1), 84-99.   DOI
20 Meng, W., Zhang, D., Qi, L., and Liu, W. (2008), Two-level DEA approaches in research evaluation, Omega, 36(6), 950-957.   DOI
21 Revilla, E., Sarkis, J., and Modrego, A. (2003), Evaluating performance of public-private research collaborations : A DEA analysis, Journal of the Operational Research Society, 54(2), 165-174.   DOI
22 Rousseau, S. and Rousseau, R. (1997), Data envelopment analysis as a tool for constructing scientometric indicators, Scientometrics, 40(1), 45-56.   DOI
23 Ruegg, R. and Feller, I. (2003), A toolkit for evaluating public R&D investment models, methods, and findings from ATP's first decade, National Institute of Standards and Technology, Technology Administration, 3-857, US Department of Commerce, Gaithersburg.
24 Sharma, S. and Thomas, V. J. (2008), Inter-country R&D efficiency analysis : An application of data envelopment analysis, Scientometrics, 76(3), 483-501.   DOI
25 Thompson, R. G., Langemeier, L. N., Lee, C. T., Lee, E., and Thrall, R. M.(1990), The role of multiplier bounds in efficiency analysis with application to Kansas farming, Journal of Econometrics, 46(1), 93-108.   DOI
26 Wang, E. C. and Huang, W. (2007), Relative efficiency of R&D activities : A cross-country study accounting for environmental factors in the DEA approach, Research Policy, 36(2), 260-273.   DOI
27 Zhang, A., Zhang, Y., and Zhao, R. (2003), A study of the R&D efficiency and productivity of Chinese firms, Journal of Comparative Economics, 31(3), 444-464.   DOI
28 Bickman, L. (1987), The functions of program theory, New Directions for Program Evaluation, Jossey-Bass, San Francisco, 33, 5-18.
29 Banker, R. D., Charnes, A., and Cooper, W. W. (1984), Some models for estimating technical and scale inefficiency in data envelopment analysis, Management Science, 30(9), 1078-1092.   DOI
30 Banker, R. D., Charnes, A., Cooper, W. W., Swarts, J., and Thomas, D. (1989), An introduction to data envelopment analysis with some of its models and their uses, Research in Governmental and Nonprofit Accounting, 5, 125-163.
31 Bonaccorsi, A. and Daraio, C. (2003), A robust nonparametric approach to the analysis of scientific productivity, Research Evaluation, 12(1), 47-69.   DOI
32 Chun, H. and Lee, H. (2014), Measuring Operational Efficiency of Korean Online Game Companies with DEA Window Analysis, Journal of the Korean Operations Research and Management Science Society, 39(3), 23-40.   DOI
33 Boussofiane, A., Dyson, R. G., and Thanassoulis, E. (1991), Applied data envelopment analysis, European Journal of Operational Research, 52(1), 1-15.   DOI
34 Charnes, A., Cooper, W. W., and Rhodes, E. (1978), Measuring efficiency of decision making units, European Journal of Operational Research, 2(6), 429-444.   DOI
35 Chun, H. and Lee, H. (2013), A DEA-Based Portfolio Model for Performance Management of Online Games, Journal of the Korean Institute of Industrial Engineers, 39(4), 260-270.   DOI   ScienceOn
36 Cooper, W. W., Seiford, L. M., and Tone, K. (2007), Data envelopment analysis : A comprehensive text with models, applications, references and DEA-Solver Software, Second editions, 490, Springer.
37 Eilat, H., Golany, B., and Shtub, A. (2006), Constructing and evaluating balanced portfolios of R&D projects with interactions : A DEA based methodology, European Journal of Operational Research, 172(3), 1018-1039.   DOI
38 Farris, J. A., Groesbeck, R. L., Van-Aken, E. M., and Letens, G. (2006), Evaluating the relative performance of engineering design projects : A case study using data envelopment analysis, IEEE Transactions on Engineering Management, 53(3), 471-482.   DOI
39 Garg, K. C., Gupta, B. M., Jamal, T., Roy, S., and Kumar, S. (2005), Assessment of impact of AICTE funding on R&D and educational development, Scientometrics, 65(2), 151-160.   DOI
40 Georghiou, L. (1999), Socio-economic effects of collaborative R&D-European experiences, Journal of Technology Transfer, 24(1), 69-79.   DOI