IE interfaces (산업공학)

Korean Institute of Industrial Engineers (대한산업공학회)
권호 표지

Evaluation of R&D Projects in Electric Power Industry with Efficiency and Effectiveness

전력산업 R&D 프로젝트의 효율성 및 효과성 평가

  • Park, Sung-Min (Department of Business Administration, Baekseok University) ;
  • Kim, Heon (Department of Business Administration, Baekseok University) ;
  • Baek, Dong-Hyun (Department of Business Administration, Hanyang University)
  • 박성민 (백석대학교경상학부) ;
  • 김헌 (백석대학교경상학부) ;
  • 백동현 (한양대학교경상대학경영학부)
  • Received : 2009.02.17
  • Accepted : 2009.05.21
  • Published : 2009.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

Based on the characteristics of 'Korean electric power industry R&D programs', this study proposes a new performance evaluation framework where electric power industry related R&D projects are scrutinized. The abovementioned R&D programs have their own goals and especially they emphasize the effectiveness as well as the efficiency of each subordinate R&D project. Hence, in this framework, a performance evaluation procedure is established and then a mathematical model is developed according to the procedure. The model calculates performance evaluation indices for a set of R&D projects integrating the effectiveness with the efficiency of each R&D project. In a case study with an empirical dataset, statistical significance is tested on the integrated performance evaluation indices of R&D projects regarding organizational types and program categories considered.

Keywords

References

  1. Asmilda, M., Paradib, J. C., Reesec, D. N., and Tamb, F. (2007), Measuring Overall Efficiency and EffectivenessUsingDEA,EuropeanJournal ofOperational Research, 178(1), 305-321 https://doi.org/10.1016/j.ejor.2006.01.014
  2. Banker, R. D., Conrad, R. F., and Strauss, R. P. (1986), AComparative Application of Data Envelopment Analysis and Translog Methods : An Illustrative Study of Hospital Production,Management Science, 32(1), 30-44 https://doi.org/10.1287/mnsc.32.1.30
  3. Bessent, A., Bessent,W.,Kennington, J., andReagan, B. (1982), AnApplication of Mathematical Programming to Assess Productivity in the Houston Independent School District,Management Science, 28(12), 1355-1367 https://doi.org/10.1287/mnsc.28.12.1355
  4. Bitman,W. R. and Sharif,N. (2008), A Conceptual Framework for Ranking R&D Projects, IEEE Transactions on EngineeringManagement, 55(2), 267-278
  5. Charnes, A. and Cooper,W.W. (1980), Auditing and Accounting for Program Efficiency andManagement Efficiency in Not-for-profit Entities,Accounting, Organizations and Society, 5(1), 87-107 https://doi.org/10.1016/0361-3682(80)90025-2
  6. Charnes, A., Cooper, W. W. and Rhodes, E. (1981), Evaluating Program and Managerial Efficiency : An Application of Data Envelopment Analysis to Program Follow Through,Management Science, 27(6), 668-697 https://doi.org/10.1287/mnsc.27.6.668
  7. Cho, Y. (2005), Induction of Performance-Oriented Evaluation SystemofNational R&DPrograms,Naragyungje, December, 64-67
  8. Cooper,W.W., Seiford, L. M. and Tone, K. (2007),Data EnvelopmentAnalysis : A Comprehensive Text With Models, Applications, References and DEA-Solver Software, 2nd edn, Springer, New York
  9. Cooper,W.W., Seiford, L.M. and Zhu, J. (2004),Handbook on Data Envelopment Analysis, Springer (Kluwer Academic Publishers), Boston
  10. Farris, J. A., Groesbeck, R. L., Aken, E.M. V. and Letens, G. (2006), Evaluating the Relative Performance of EngineeringDesign Projects: ACase StudyUsing Data Envelopment Analysis, IEEE Transactions on EngineeringManagement, 53(3), 471-482 https://doi.org/10.1109/TEM.2006.878100
  11. Garcia-Sanchez, I. M. (2007), Evaluating the Effectiveness of the Spanish Police Force Through Data Envelopment Analysis, European Journal of Law and Economics, 23(1), 43-57 https://doi.org/10.1007/s10657-007-9004-z
  12. Henriksen, A. D. and Traynor, A. J. (1999), A Practical R&D Project-Selection Scoring Tool, IEEE Transactions on EngineeringManagement, 46(2), 158-170 https://doi.org/10.1109/17.759144
  13. Hsu, F. M. and Hsueh, C. C. (2009), Measuring Relative Efficiency of Government-Sponsored R&D Projects : A Three-Stage Approach, Evaluation and ProgramPlanning, 32(2), 178-186 https://doi.org/10.1016/j.evalprogplan.2008.10.005
  14. Hwang, S. (2006),STEPI PolicyStudy2006-12,Methodology of EconomicAssessment for Classified R&DPrograms, STEPI, Korea
  15. Hwang,Y. andHwang, S. (2005),STEPI PolicyStudy2004-20,AnAssessmentof the PerformanceEvaluation Systemfor Government R&D, STEPI, Korea
  16. Karlaftis, M. G. (2004), A DEA Approach for Evaluating the Efficiency and Effectiveness of Urban Transit Systems, European Journal of Operational Research, 152(2), 354-364 https://doi.org/10.1016/S0377-2217(03)00029-8
  17. Kim, S. andKim, T. (2006), Assessment Framework forMulticriteria Comparison Indicators inVarious Electricity Supply Systems,Journal ofEnergyEngineering, 15(1), 74-81
  18. Ko, Y., Yoon, H., and Lee, J. (2004),KDI Research Report 2004-02 : Performance Management of PublicSector, KDI, Korea
  19. Korea Institute of Science and Technology Information(2008), Law-Enforcement Ordinance-Enforcement Regulations, http://www.ntis.go.kr/ThMain.do, NTIS, Korea
  20. Korea National Statistical Office (2008), e-Narajipyo, http://www.index.go.kr/ egams/default.jsp, NSO, Korea
  21. Korea Research Council for Industrial Science and Technology (2007),A Studyof Establishment of Follow-up Evaluation andMonitoring Systemfor R&D Programs Performance, ISTK, Korea
  22. Korean Electricity Commission (2008),CompetitionInductioninElectricPower Industry, http://www.korec.go.kr/, KOREC, Korea
  23. Lee, H., Park, Y., and Choi, H. (2009), Comparative Evaluation of Performance ofNational R&DProgramsWithHeterogeneousObjectives :ADEAApproach, European Journal of Operational Research, 196(3), 847-855 https://doi.org/10.1016/j.ejor.2008.06.016
  24. McLaughlin, J. A. and Jordan, G. B. (1999), Logic Models : A Tool for Telling Your Program's Performance Story, Evaluation and ProgramPlanning, 22(1), 65-72 https://doi.org/10.1016/S0149-7189(98)00042-1
  25. Ministry of Industry andResource (2006),2006National R&DPrograms Investigation․Analysis․Evaluation: ElectricPower IndustryR&DPrograms,MIR,Korea
  26. Ministry of Industry and Resource (2007),Final Report : 2006 PerformanceAnalysis of ElectricPower IndustryR&DPrograms, MIR, Korea
  27. Ministry of Industry and Resource․Electric Power Technology Evaluation and Planning Center (2007),2007 Internal EvaluationofNational R&DPrograms : ElectricPower IndustryR&DPrograms, MIR․ETEP, Korea
  28. Ministry of Information andCommunication․Institute for Information Technology Advancement (2006),PerformanceAnalysisonInformationandCommunication Promotion Fund(VIII)(Technology Development Investment Projects) , MIC․ IITA & SI Media, Inc., Korea
  29. Ministry of Information andCommunication․Korea Association of Information and Telecommunication (2007),A Study on thePerformanceEvaluationMethod of PublicPolicy for theSmall andMediumSize IT Firms, MIC․KAIT, Korea
  30. Ministry ofKnowledge Economy (2008),Final Report : 2007 ElectricPower Industry R&DPrograms, MKE, Korea
  31. Ministry of Science and Technology․Korea Institute of Science and Technology Evaluation and Planning (2007), A Study of the Methodology for Follow-up Evaluation ofNational R&DPrograms, MST․KISTEP, Korea
  32. Ministry of Science and Technology․Office of Science and Technology Innovation (2008), 2008 Internal Evaluation Manual of National R&D Programs, MST․OSTI, Korea
  33. Ministry of Strategy and Finance (2008),PressRelease: ABudget for EconomicJump withJobCreation :TheEssenceof 2009National Bill of Budget andFund,MOSF, Korea
  34. Minitab^{R}(2005),Minitab^{R} Release14.20 StatGuide, Minitab Inc., State College
  35. Montgomery,D. C. andRunger,G. C. (1999),AppliedStatisticsandProbabilityfor Engineers, 2nd edn, JohnWiley and Sons, New York
  36. Oral, M., Kettani, O. and Lang, P. (1991), A Methodology for Collective Evaluation and Selection of Industrial R&D Projects, Management Science, 37(7), 871-885 https://doi.org/10.1287/mnsc.37.7.871
  37. Park, S., Kim, H., and Baek, D. (2008), Design of DEA/(AR-I, ARGM) Models and Sensitivity Analysis for Performance Evaluation on Governmental Funding Projects for IT Small and Medium-sized Enterprises, Journal of the Korean Instituteof Industrial Engineers, 34(2), 190-204
  38. Parks, R. B. (1983), Technical Efficiency of PublicDecisionMakingUnits,Policy Studies Journal, 12(2), 337-346 https://doi.org/10.1111/j.1541-0072.1983.tb00275.x
  39. Rhim, H., Yoo, S., and Kim, Y. (1999), A DEA/AHP Hybrid Model for Evaluation and Selection of R&D Projects, Journal of the Korean Operations Research andManagement ScienceSociety, 24(4), 1-12
  40. Science and Technology Policy Institute (2008), Final Report : A Study of the Development and Management of the Evaluation Systemfor Performance-Oriented ElectricPower Industry Fund Programs, STEPI, Korea.
  41. Seiford, L. M. and Thrall, R. M. (1990), Recent Development in DEA : The Mathematical Programming Approach to Frontier Analysis, Journal of Econometrics, 46(1-2), 7-38 https://doi.org/10.1016/0304-4076(90)90045-U
  42. Sherman, H. D. and Gold, F. (1985), Bank Branch Operating Efficiency : EvaluationWithData EnvelopmentAnalysis, Journal ofBankingandFinance, 9(2), 297-315
  43. Song, B. (2007), R&DBudget 10 Trillion ‘Won’(Korean CurrencyUnit) and the World 8^{th} R&D Power Nation,Naragyungje, November, 14-16
  44. Wang, K., Wang, C. K., and Hu, C. (2005), Analytic Hierarchy Process with Fuzzy Scoring in EvaluatingMultidisciplinary R&DProjects in China, IEEE Transactions on EngineeringManagement, 52(1), 119-129 https://doi.org/10.1109/TEM.2004.839964
  45. Yu, M. M. and Lin, E. T. J. (2008), Efficiency and Effectiveness in Railway Performance Using a Multi-Activity Network DEA Model, Omega, 36(6), 1005-1017 https://doi.org/10.1016/j.omega.2007.06.003