Journal of the Korea Institute of Military Science and Technology (한국군사과학기술학회지)

The Korea Institute of Military Science and Technology (한국군사과학기술학회)
권호 표지
DOI QR코드

DOI QR Code

Analyzing the Performance of Defense R&D Projects based on DEA

자료포락분석을 활용한 국방핵심기술 연구개발사업의 성과 분석

  • Lim, Yonghwan (Technology Planning Bureau, Defense Agency for Technology and Quality) ;
  • Jeon, Jeonghwan (Department of Industrial & Systems Engineering/ERI, Gyeongsang National University)
  • 임용환 (국방기술품질원 기술기획본부) ;
  • 전정환 (국립경상대학교 산업시스템공학부)
  • Received : 2018.10.22
  • Accepted : 2019.01.09
  • Published : 2019.02.05
Download PDF
⟨ Previous Next ⟩

Abstract

Demand for performance analysis is increasing for efficient use of limited budgets such as improving investment efficiency and strategic budget allocation in accordance with the continuous increase demand of R&D budget for developing advanced weapon systems in the future battlefields. In accordance with the Act on the Performance Evaluation and Performance Management of the National R&D Projects established in March 2006, the performance analysis has been conducted for the systematic management and utilization of the R&D project performance. It was recognized as a project to achieve self-defense through strengthening the weapons system development capability, however, efficiency evaluation of Defense R&D projects was not much emphasized. Research on the efficiency analysis of defense R&D projects has been conducted in recent years, but most studies focused on corporate efficiency and productivity of defense companies. In this study, we analyzed the three-stage performance of defence R&D projects based on the logical model using the data envelope analysis(DEA) model. We also analyzed performance analysis from various perspectives through R&D type, technology classification and performance model. This study is expected to help defense department improve defense R&D projects and make decision.

Keywords

GSGGBW_2019_v22n1_106_f0001.png 이미지

Fig. 1. 3-Stage DEA model

GSGGBW_2019_v22n1_106_f0002.png 이미지

Fig. 2. Research framework

GSGGBW_2019_v22n1_106_f0003.png 이미지

Fig. 3. Performance model

GSGGBW_2019_v22n1_106_f0004.png 이미지

Fig. 4. Mapping results on performance model

Table 1. Overview of defense R&D projects

GSGGBW_2019_v22n1_106_t0001.png 이미지

Table 2. Previous studies using DEA model

GSGGBW_2019_v22n1_106_t0002.png 이미지

Table 3. Previous studies on the efficiency analysis of defense sector

GSGGBW_2019_v22n1_106_t0003.png 이미지

Table 4. Variables

GSGGBW_2019_v22n1_106_t0004.png 이미지

Table 5. Classification by R&D type

GSGGBW_2019_v22n1_106_t0005.png 이미지

Table 6. Classification by 8-technology sector

GSGGBW_2019_v22n1_106_t0006.png 이미지

Table 7. Statistics of data

GSGGBW_2019_v22n1_106_t0007.png 이미지

Table 8. Results of correlation analysis

GSGGBW_2019_v22n1_106_t0008.png 이미지

Table 9. Analysis results by stages

GSGGBW_2019_v22n1_106_t0009.png 이미지

Table 10. Comparison of statistics by efficient DMUs

GSGGBW_2019_v22n1_106_t0010.png 이미지

Table 11. Spearman correlation analysis results by stages

GSGGBW_2019_v22n1_106_t0011.png 이미지

Table 12. Analysis results by R&D type

GSGGBW_2019_v22n1_106_t0012.png 이미지

Table 13. Analysis results by 8-technology sector

GSGGBW_2019_v22n1_106_t0013.png 이미지

Table 14. Performance by type of R&D according to performance type

GSGGBW_2019_v22n1_106_t0014.png 이미지

Table 15. Performance by 8-technology sector according to performance type

GSGGBW_2019_v22n1_106_t0015.png 이미지

Table 16. Results of Correlation analysis in tobit variables

GSGGBW_2019_v22n1_106_t0016.png 이미지

Table 17. Results of tobit regression analysis

GSGGBW_2019_v22n1_106_t0017.png 이미지

References

  1. S. Park, J. Na, "A Study on the Efficiency Analysis of Defense R&D Project by using DEA Model : Focusing Application and Testing Technology," Korean Association of Industrial Business Administration, Vol. 30, No. 3, pp. 57-84, 2015.
  2. S. Choi, H. Cho, J. Kang, J. Han, B. Kim, Y. Seo, J. Lee, "A Study on the Efficiency Reward and Improvement Patterns for Enhancing National R&D Performance," Seoul : Ministry of Education. University of Seoul, 2011.
  3. H. Lee, S. Yang, "Efficiency Analysis of Defense Technology R&D Project," Korea Technology Innovation Conference Annual Conference, Vol. 23, No. 1, pp. 92-105, Fall, 2014.
  4. Y. Park, "Technology and Management for Engineers," Life and Power Press, Gyeonggi-do, 2011.
  5. M. Park, "Efficiency and Productivity Analysis," Korea Scholarship Information, Gyeonggi-do, 2008.
  6. E. C. Wang and W. Huang, "Relative Efficiency of R&D Activities: A Cross-country Study Accounting for Environmental Factors in the DEA Approach," Research Policy, Vol. 36, No. 2, pp. 260-273. 2007. https://doi.org/10.1016/j.respol.2006.11.004
  7. M. J. Farrell, "The Measurement of Productive Efficiency," Journal of the Royal Statistical Society, Series A, Vol. 120, No. 3, pp. 253-290, 1957. https://doi.org/10.2307/2343100
  8. Charnes, A., Cooper, W. and Rhodes, E., "Measuring the Efficiency of Decision-making Units," European Journal of Operational Research, Vol. 2, No. 6, pp. 429-444, 1978. https://doi.org/10.1016/0377-2217(78)90138-8
  9. Banker, R. D., Chanes, A. and Cooper, W. W., "Some Models for Estimating Technical and Scale Inefficiency in Data Envelopment Analysis," Management Science, Vol. 30, No. 9, pp. 1078-1092, 1984. https://doi.org/10.1287/mnsc.30.9.1078
  10. S. Jung, H. Yu, "Operational Efficiency Analysis of Defense Industry using Fuzzy-DEA," Journal of Korea Association of Defense Indusry Studies, Vol. 18, No. 2, pp. 62-80, 2011.
  11. S. Park, K. Kim, S. Jung, "The Study on the Analysis of Efficiency of Governmental R&D Programs Regarding to the S&T Outcomes," Journal of Korea Technology Innovation Society, Vol. 14, No. 2, pp. 205-222, 2011.
  12. S. Park, S. Hong, "R&D Efficiency and Productivity Analysis by OECD Countries using Non-parametric Methods," Journal of Technology Innovation, Vol. 11, No. 2, pp. 151-174, 2003.
  13. H. Lee, Y. Park, "An International Comparison of R&D Efficiency: DEA Approach," Asian Journal of Technology Innovations, Vol. 13, No. 2, pp. 207- 222, 2005. https://doi.org/10.1080/19761597.2005.9668614
  14. S. Byun and J. Han, "Efficiency Estimations for the Government Driven R&D Projects in IT Industries," Hannam Journal of Law and Technology, Vol. 15, No. 2, pp. 179-206, 2009. https://doi.org/10.32430/ilst.2009.15.2.179
  15. T. Kim, I. Kim, S. Ahn, K. Lee, "A Way to Enhance Efficiency of Nuclear Program in Korean R&D Program by Data Envelopment Analysis," Journal of Korea Technology Innovation Society, Vol. 12, No. 1, pp. 70-87, 2009.
  16. C. Lee, K. Cho, "Efficiency Analysis and Strategic Portfolio Model of National Health Technology R&D Program using DEA : Focused on Translational Research," Journal of the Korean Institute of Industrial Engineers, Vol. 40, No. 2, pp. 172-183, 2014. https://doi.org/10.7232/JKIIE.2014.40.2.172
  17. I. Um, C. Baek, S. Hong, "The Efficiency Analysis of National R&D Program for Drug Development using Range Adjusted Measure," Journal of Korea Technology Innovation Society, Vol. 19, No. 4, pp. 711-735, 2016.
  18. Hsu, F. M. and Hsueh, C. C., "Measuring Relative Efficiency og Government sponsored R&D Projects: A Three-stage Approach," Evaluation and Program Planning, Vol. 32, No. 2, pp. 178-186, 2009. https://doi.org/10.1016/j.evalprogplan.2008.10.005
  19. G. Jeong, "The Efficiency Analysis of European Defense Industry using DEA Model," Master Thesis in Defense, 2005.
  20. S. Hong, J. Seo, S. Shim, "An Analysis of Application Performance of Defense R&D Technologies Acquired by Offset Programs," Journal of Technology Innovation, Vol. 22, No. 2, pp. 1-30, 2014. https://doi.org/10.14383/SIME.2014.22.2.001
  21. H. Lee, "A Study on Analyzing the Efficiency of Defense R&D Projects : DEA Approach," Ph.d Thesis in Konkuk, 2015.
  22. K. Jun, S. Jung, H. Yoo, "Analysis of the Efficiency of Domestic Defense Industries Considering a Return to Scale : Focused on Production Costs and R&D Inputs," Journal of Korea Association of Defense Indusry Studies, Vol. 19, No. 2, pp. 1-19, 2012. https://doi.org/10.22473/kats.2012.19.1.001
  23. S. Hwang, et. al., "Efficiency of National R&D Investment," STEPI Policy Research Vol. 4, pp. 197-218, 2009.
  24. J. Kim, J. Hong, "Global Competitiveness Analysis of National Defense Industry : DEA and Malmquist Production Analysis," Journal of the Korea Academia-Industrial Cooperation Society, Vol. 16, No. 12, pp. 8378-8385, 2015. https://doi.org/10.5762/KAIS.2015.16.12.8378
  25. S. Byun, J. Han, "Efficiency Estimations for the Government Driven R&D Projects in IT Industries," Institute for Law of Science and Technology, Vol. 15, No. 2, pp. 179-206, 2009.
  26. "OECD Science, Technology and Industry Scoreboard," Paris, 2001.
  27. Raggi, A., "Technological Growth in the Italian Economy : Some Indicators Compared," Technovation, Vol. 13, No. 1, pp. 3-15, 1993. https://doi.org/10.1016/0166-4972(93)90010-S
  28. Chen, Y., Shu, Z., F., Hu, F., Meyer, Z., Martin, M., and Bhattacharya, S., "A Patent Based Evaluation of Technological Innovation Capability in Eight Economic Regions in PR China," World Patent Information, Vol. 31, No. 2, pp. 104-110, 2009. https://doi.org/10.1016/j.wpi.2008.06.010
  29. I. Jeon, H. Lee, "Performance Evaluation of R&D Commercialization : A DEA-Based Three-Stage Model of R&BD Performance," Journal of the Korean Institute of Industrial Engineers, Vol. 41, No. 5, pp. 425-438, 2015. https://doi.org/10.7232/JKIIE.2015.41.5.425
  30. Keh, H. T. and Chu, S., "Retail Productivity and Scale Economies at the Firm Level : A DEA Approach," Omega, Vol. 31, No. 2, pp. 75-82, 2003. https://doi.org/10.1016/S0305-0483(02)00097-X
  31. Keh, H. T., Chu, S., and Xu, J., "Efficiency, Effectiveness and Productivity of Marketing in Services," European Journal of Operational Research, Vol. 170, No. 1, pp. 265-276, 2006. https://doi.org/10.1016/j.ejor.2004.04.050
  32. Jeon, J., Kim, C., and Lee, H., "Measuring Efficiency of Total Productive Maintenance : A Three-Stage Data Envelopment Analysis Approach," Total Quality Management and Business Excellence, Vol. 22, No. 8, pp. 911-924, 2011. https://doi.org/10.1080/14783363.2011.593865
  33. S. Lee, T. Kim, H. Lee, "Measuring the Dynamic Efficiency of Government Research Institutes in R&D and Commercialization by DEA Window Analysis," Korean Management Science Review, Vol. 32, No. 4, pp. 193-207, 2015. https://doi.org/10.7737/KMSR.2015.32.4.193
  34. Chun, H. and Lee, H., "A DEA-Based Portfolio Model for Performance Management of Online Games," Journal of the Korean Institute of Industrial Engineers, Vol. 39, No. 4, pp. 260-270, 2013. https://doi.org/10.7232/JKIIE.2013.39.4.260
  35. Cooper, W. W., Seiford, L. M. and Tone, K., "Data Envelopment Analysis : A Comprehensive Text with Models, Applications, References and DEA-Solver Software," Second Edition, New York: Springer, 2007.
  36. Kao, C. and Hwang, S. N., "Efficiency Decomposition in Two-Stage Data Envelopment Analysis : An Application to Non-lifeinsurance Companies in Taiwan," European Journal of Operational Research, Vol. 185, No. 1, pp. 418-429, 2008. https://doi.org/10.1016/j.ejor.2006.11.041