Browse > Article

The Weights Analysis of Evaluation Areas and Items for the Informatization Program by means of the AHP  

Kim, Sang-Hoon (광운대학교 경영정보학과)
Choi, Jeom-Ki (광운대학교 디지털경영연구소)
Publication Information
Journal of the Korean Operations Research and Management Science Society / v.32, no.2, 2007 , pp. 123-140 More about this Journal
Abstract
This study focuses on establishing theoretically-reasonable framework of evaluation areas and items for the informatization program and analyzing the weights for each area and item by means of the AHP. To obtain the goal of this research, firstly, based on broadly reviewing previous literature and logical reasoning, the evaluation criteria were Identified and conceptualized, which were 3 evaluation phases, 5 evaluation areas, and 22 evaluation items. Secondly, The data used for calculating the weight values for the evaluation criteria were collected from 48 academic and practical experts in the field of the informatization program promotion using internet survey. Thirdly, the relative weights among evaluation phases, evaluation areas, and its items were derived by AHP analysis. The findings of this study are thought not only to be useful as a practical guideline in performing evaluating the informatization program but also to provide significant basis for constructing the theoretical framework of evaluating method and management of the informatization program.
Keywords
informatization Program Evaluation; Evaluation Phases-Areas-Items; Analytic Hierarchy Process (AHP);
Citations & Related Records
연도 인용수 순위
  • Reference
1 김기환, '정보화사업 타당성분석제도의 개선방향 모색 : 공공분야 타당성분석제도들의 비교를 중심으로', 정보화정책, 제12권, 제1호(2005), pp.59-77
2 노미현, 'ERP 시스템의 구현성공과 도입성과에 관한 연구', 중소기업연구, 제26권, 제1호(2004), pp.3-26
3 산업자원부, 중소기업진흥공단, 중소기업 IT화 사업계획, 2002
4 이재남, 김영걸, '정보시스템 아웃소싱의 성공을 위한 인과모형에 관한 연구 : 구조방정식 모형 접근방법', 경영학연구, 제28권, 제3호(1999), pp.799-822
5 이주헌, 고형대, '소프트웨어 프로젝트 관리의 체계', 정보처리학회지, 제1권, 제3호(1994), pp.7-14
6 한국전산원, 정보화사업 사전타당성분석 방법론 연구, 2004
7 Baily, J.E. and S.W. Pearson, 'Development of a Tool for Measuring and Analyzing Computer User Satisfaction,' Management Science, Vol.29, No.5(1983), pp.530-545   DOI   ScienceOn
8 Dick, A.S. and K. Basu, 'Customer Loyalty : Toward an Integrated Conceptual Framework,' Academy of Marketing Science Journal, Vol.22, No.2(1994), pp.99-1l3   DOI
9 Dodd, F,J., H.A. Donegan, and T.B. McMaster, 'A Statistical Approach to Consistency in AHP,' Mathematical Computing Modeling, Vol.18, No.6(1993), pp.19-22
10 Flynn, N., 'Performance Measurement in Public Sector Services,' Policy and Politics, Vol.14, No.3(1986), pp.389-404   DOI
11 Fornell, C., M.D. Johnson, E.W. Anderson, J,S. Cha, and B.E. Bryand, 'The American Customer Satisfaction Index: Nature, Purpose, and Findings,' Journal of Marketing, Vol.60, No.4(1996), pp.7-18   DOI   ScienceOn
12 General Services Administration(GSA), Performance- Based Management: Eight Steps To Develop and Use Information Technology Performance Measures Effectively, 1997
13 Marchand, D.A., W.J. Kettinger and J.D. Rollins, 'Information Orientation: People, Technology and the Bottom Line,' Sloan Management Review, Vol.41, No.4(2000), pp.69-80
14 Ross, J.W, C.M. Beath, and D.L. Goodhue, 'Develop Long-Term Competitiveness Through IT Assets,' Sloan Management Review, Vol.38, No.1(1996), pp.31-42
15 Saaty, T.L., Decison Making with Dependence and Feedback: The Analytic Network Process, RWS Publications, Pittsburgh, 1996
16 Zeithaml, VA, L.L. Berry, and A. Parasuraman, 'The Behavioral Consequences of Service Quality,' Journal of Marketing, Vol.60, No.2(1996), pp.31-46
17 한국전산원, 정보화사업의 경제적 효과분석에 관한 연구, 1999
18 정해용, 김상훈, '공공정보화사업 추진단계별 평가항목 개발 : 문화정보화사업을 중심으로', 정보화정책, 제11권, 제1호(2004), pp.106-125
19 중소기업청, 중소기업정보화지원사업 추진계획, 2005
20 Pitt, L.F., RT. Watson, and C.B. Kavan, 'Service Quality: A Measure of Information Systems Effectiveness,' MIS Quarterly, Vol.19, No.2(1995), pp.173-187   DOI   ScienceOn
21 Hamilton, S. and N.L. Chervany, 'Evaliating Information System Effectiveness-Part : Comparing Evaluation Approaches,' MIS Quarterly, Vol.5, No.3(1981), pp.55-69   DOI   ScienceOn
22 DeLone, W.H. and E.R McLean, 'The DeLone and McLean-Model of Information Systems Success: A Ten-Year Update,' Journal of Management Information Systems, Vol.19, No.4(2003), pp.9-30   DOI
23 Watson, R.T., L.F. Pitt, and C.B. Kavan, 'Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies,' MIS Quarterly, Vol.22, No.1 (1998), pp.61-79   DOI   ScienceOn
24 조근태, 조용곤, 강현수, 계층분석적 의사결정, 동현출판사, 2003
25 Doll, W.J, and G. Torkzadeh, 'A Discrepancy Model of End-User Computing Involvement,' Management Science, Vol.35, No.10(1989), pp.1151-1171   DOI   ScienceOn
26 심상천, 김용겸, 'AHP 기업을 이용한 멀티미디어 저작도구 평가 및 선정에 관한 연구', 경영과학, 제21권, 제2호(2004), pp.191-213
27 안봉근, 주기중, 권해익, '포괄적인 정보시스템 성과평가모형에 관한 연구', 경영과학, 제21권, 제2호(2004), pp.111-122
28 오철호, 정홍원, '정보화사업의 사전평가 모형과 방법론 탐색 : 하나의 가설', 한국정책분석평가학회보, 제12권, 제2호(2002), pp.235-266
29 최영훈, '사전 . 사후평가의 장단점과 통합적 활용방안', 한국정책분석평가학회 2001 추계학술대회 발표논문집, 2001
30 Myers, B.L., L.A. Kappelman, and V.R. Prybutok, 'A Comprehensive Model for Assessing the Quality and Productivity of the information Systems Function: Toward a Theory for information Systems Assessment,' Information Resources management Journal, Vol.10, No.1(1997), pp.6-25   DOI
31 한국전산원, 정보화사업평가편람, 1997
32 한국전산원, 국가정보화평가 발전방안, 1999
33 Grover, V., S.R. Jeong, and A.H. Segars, 'Information Systems Effectiveness : The Construct Space and Pattern of Application,' Information & Management, Vol.31 (1996), pp.177-191   DOI   ScienceOn
34 Scott, J., 'The Measurement of Information Systems Effectiveness: Evaluating a Measuring Instrument,' Proceedings of the 15th International conference on Information Systems, Vancouver, British Columbia, 1994, pp.111-128
35 Stevens, F., F. Lawrenz, and L. Sharp, User-Friendly Handbook for Project Evaluation : Science, Mathematics, Engineering and Technology Education, National Science Foundation, Arlington, 1993
36 Levitt, M. and M. Joyce, The Growth and Efficiency of Public Spending, Cambridge University Press, Cambridge, 1987
37 윤종수, 한경수, 한재민, '조직성숙수준에 따른 BPR의 주요성공요인과 성과간의 관련성 연구', 경영정보학연구, 제7권, 제2호(1997), pp.103-135
38 조성훈, 김태성, 이영찬, 'Compatibility를 이용한 다수 전문가의 가중치 종합화에 관한 연구', 한국경영과학회지, 제23권, 제4호(1998), pp.131-140
39 정승렬, 정성현, 배준범, '리엔지니어링 성공요인의 이원론적 분석', 경영정보학연구, 제11권, 제2호(2001). pp.205-221
40 정보통신정책연구원, 전자정부사업 성과평가모델 연구, 2003
41 DeLone, W.H. and E.R. McLean, 'Information Systems Success : The Quest for the Dependent Variable,' Information Systems Research, Vol.3, No.1(1992), pp.60-95   DOI
42 Saaty, T.L., The AHP : Planning, Priority Setting, Resource Allocation, McGraw-Hill, New York, 1980
43 장경서, 서길수, 이문봉, 'ERP 시스템 구현 핵심성공요인에 관한 탐색적 연구.' Information Systems Review, 제2권, 제2호(2000), pp.255-281
44 Bakos, J.Y. and C.F. Kemerer, 'Recent Applications of Economic Theory in Informations Technology Research,' Decision Support Systems, Vol.8(1992), pp.365-386   DOI   ScienceOn
45 Ives, B. and M.H. Olson, 'User Involvement and MIS Success: A Review Research,' Management Science, Vol.30, No.5(1984), pp.586-603   DOI   ScienceOn
46 Kettinger, W.J. and C.C. Lee, 'Perceived Service Quality and User Satisfaction with the Information Services Function,' Decision Sciences, Vol. 25, No.5-6(1994), pp.727-766
47 정보화추진위원회, 국가정보화 평가시행계획, 2005
48 Pinto, J,K. and D.P. Slevin, 'Critical Factors in Successful Project Implementation,' IEEE Transactions on Engineering Management, Vol.EM-34, No.1(1987), pp.22-27   DOI
49 Saaty, T.L., 'Priority Setting in complex problems,' IEEE Transactions on Engineering Management, Vol.EM-30, No.3(1983), pp.140-155   DOI
50 이종호, 주상호, 'ERP 시스템 도입요인과 성과변수에 관한 연구', 생산성논집(구생산성연구), 제16권, 제2호(2002), pp.95-116
51 한국개발연구원, 다기준분석 방안 연구, 2000
52 Dobbins, J,H. and R.G. Donnely, 'Summary Research Report on Critical Success Factors in Federal Government Program Management,' Acquisition Review Quarterly, Vol.5, No.1(1995), pp.61-82
53 김희철, 이대용, 'ERP 시스템 주성공요인에 따른 도입특성에 대한 연구', 한국정보전략학회 1999 추계공동학술대회 논문집, (1999), pp.345-353
54 이상천, 홍정완, '정보화 효과지표의 업종별 분석', 산업공학, 제14권, 제4호(2001), pp.421-428
55 Field, R, 'When Bad Things Happen to Good Project,' CIO, Vol.15(1997), pp.55-62
56 Jurison, J., 'Software Project Management : The Manager's View,' Communications of AIS, Vol.2, No.17(1999), pp.3-12
57 Heatley, J., R. Agarwal and M. Tanniru, 'An Evaluation of an Innovative Information Technology-the Case of Carrier EXPERT,' Journal of Strategic Information Systems, Vol.4, No.3(1995), pp.255-277   DOI   ScienceOn
58 양재진, 정명주, 정진우, '공공정보화사업의 사전평가 모형 구상 : 예산과의 연계와 사업 실효성 확보방안을 중심으로', 정보화정책, 제10권 제3호(2003), pp.156-177
59 김준한, '중앙정부의 정보화 평가체계 정립', 한국행정학보, 제36권, 제4호(2002), pp.1-20
60 Swiss, J.E., 'Performance Monitoring Systems,' in Accountability for Performance, David Ammons(ed.), ICMA, Washington, D.C., 1995
61 한국개발연구원, 공공부문의 성과관리, 2004
62 NTIA(National Telecommunications and Information Administration), Technology Opportunities Program, 2001