Browse > Article

An Empirical Study on Development of IS Evaluation Indices : In Case of Public Sectors  

정해용 (나사렛대학교 경영정보학)
김상훈 (광운대학교 경영정보학과)
Publication Information
Abstract
In this research, the comprehensive evaluation model of IS(information systems) for public sectors is theoretically constructed through reviewing and integrating previous IS evaluation-related research. This model is hypothesized to consist of five sectors(System Sector, User Sector, Organization and Management Sector, Resource Management Sector and Strategic Contribution Sector), ten evaluation items belonging to these five evaluation sectors, and sixty two evaluation indices for these ten evaluation items. The results of empirical analyses to test the validity of the research model show that the evaluation sectors turn out to be the same ones as proposed in the hypothetical model. The evaluation items(System Quality, Information Quality, Service Quality) in System Sector proves to be consistent with the hypothetical model. However, in case of User Sector, two evaluation items(Perceived Usefulness and User Satisfaction) which are included in the hypothetical model are found to be merged into one item(User Satisfaction). And, it is shown that four evaluation items such as the Efficiency of Internal Process, Customer Satisfaction, Organizational Innovation, and the Degree of Informatization competence improvement are included in Organization and Management Sector, differently from the research model in which the items, Organizational innovation and the Degree of Informatization competence improvement, are not divided. As a final result, sixty two evaluation indices that comprise all the evaluation items belonging to five sectors are found to be reduced to fifty seven ones through factor analyses, criterion-related validity tests and reliability analyses.
Keywords
IS Evaluation Indices; Public Sector; Strategic Contribution; Resource Management;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 The Impactof Office Automation on the Organization : Some Implications for Research and Practice /
[ Olson,M.H.;H.C.Lucas ] / Communications of the ACM
2 Creating A Balanced IS Measurement Program /
[ Edberg,Dana.T. ] / Information Systems Research   ScienceOn
3 Cost/Unilization : A Measure of System Performance /
[ Borovits,I.;P.Ein-Dor ] / Communications of the ACM   ScienceOn
4 /
[ Anthony,R.N. ] / Planning and Control Systems : A Framework for Analysis
5 /
[ Borovits,I.;S.Neumann ] / Computer Systems Performance Evaluation
6 Information systems success revisited /
[ DeLone,W.H.;E.R.McLean ] / System Sciences, 2002. HICSS. Proceedings of the 35th Annual Hawaii International Conference on
7 Organizational Context, User Involvement, and The Usefulness of Information Systems /
[ Franz,C.R.;D.Robey ] / Decision Sciences
8 Pragmatic Perspectives on the Measurement of Information Systems Service Quality /
[ Kettinger,W.J.;C.C.Lee ] / MIS Quarterly   ScienceOn
9 An Exploratory Contingency Model of User Participation and MIS Use /
[ Eunhong,Kim;Lee,Jinjoo ] / Information and Management   ScienceOn
10 Impacts of Information Technology Investment on Organizational Performance /
[ Mahwood,M.A.;G.J.Mann ] / Journal of MIS
11 /
[ Paul Arveson ] / Translating Performance Metrics from the Private to the Public Sector
12 A Respecification and Extension of the DeLone and McLean Model of IS Success /
[ Seddon,P.B. ] / Information Systems Research   ScienceOn
13 Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology /
[ Davis,F.D. ] / MIS Quarterly   ScienceOn
14 /
[ 한국전산원 ] / 정보화사업평가편람
15 Service Quality : A Measure of Information Systems Effectiveness /
[ Pitt,L.F.;R.T.Watson;C.B.Kavan ] / MIS Quarterly   ScienceOn
16 Business Stategy Orientation, Information Systems Strategic Orientation, and Strategic Alignment /
[ Chan,Yolande,E.;S.L.Huff;D.W.Barclay;D,C,Copeland ] / Information Systems Research   ScienceOn
17 Information Technology Governance through the Balanced Scorecard /
[ Grembergen,W.V.;Snall;Ronald ] / Information Technology Evaluation Methods and Management
18 /
[ 한국전산원 ] / 정보화사업 평가방법론 연구
19 /
[ 한국전산원 ] / 공공부문 정보화사업 평가를 위한 BSC 모형
20 Performance Evaluation and the Management of Information Services /
[ Lucas,H.C.,Jr. ] / Data Base
21 Measuring Information Systems Performance : Experience with the Management by Results System at Security Pacific Bank /
[ Singleton,C.E.;E.R.McLean;E.R.Altman ] / MIS Quarterly   ScienceOn
22 Evaluating Information System Effectiveness. Part I. Comparing Evaluation Approaches /
[ Hamilton,S.;N.L.Chervany ] / MIS Quarterly   ScienceOn
23 Time Files When You're Having Fun : Cognitive Absorption and Beliefs about Information Technology Usage /
[ Agarwel,R.;E.Karahanna ] / MIS Quarterly   ScienceOn
24 A Study of the Implementation Process /
[ Ginzberg,M. ] / TIMS Studies in Management Science
25 /
[ Wiseman,C. ] / Strategic Information Systems
26 Development of an Instrument to Measure User Satisfaction with Management Information Systems /
[ Jenkins,A.M.;J.A.Ricketts ] / Working Paper, Dept. of Operations and Systems Management, Indiana University
27 Balanced Scorecard : Measures That Drive Performance /
[ Kaplan,R.S.;D.P.Norton ] / Harvard Business Review
28 IT Performance Measurement /
[ Steyaert.J. ] / A Discussion Paper on Measurement Practices
29 Empirical Evidence for a Descriptive Model of Implementation /
[ Lucas,H.C.,Jr. ] / MIS Quarterly   ScienceOn
30 Information Systems Success : The Quest for the Dependent Variable /
[ DeLone,W.H.;E.R.McLean ] / Information Systems Research
31 /
[ 채서일 ] / 사회과학조사방법론(2판)
32 Global Measures of Information Services Quality : A Cross-National Study of Hong Kong, Korea, the Netherlands and the U.S.A /
[ Kettinger,W.J.;C.C.Lee;S.Lee ] / Proceedings of Decision Sciences Institute
33 Measuring Information Systems Service Quality : Concerns for a Complete Canvas /
[ Pitt,L.F.;R.T.Watson;C.B.Kavan ] / MIS Quarterly   ScienceOn
34 /
[ Shannon,Claude E.;Weaver ] / Warren The Mathematical Theory of Communication
35 Evaluating Information system Effectiveness. Part II. Comparing Evaluator Viewpoints /
[ HAmilton,S.;N.L.Chervany ] / MIS Quarterly   ScienceOn
36 Top Management Support, External Expertise nad Information Systems Implementation in Small Businesses /
[ Thong,James Y.L.;Yap,Chee-Sing;K.S.Raman ] / Information Systems Research   ScienceOn
37 Measuring Information Systems Service Quality : Lessons From Two Longitudinal Case Studies /
[ Watson,R.T.;L.F.Pitt;C.B.Kavan ] / MIS Quarterly   ScienceOn
38 Productivity, Business Profitability, and Consumer Surplus : Three Measures of Information Technology Value /
[ Hitt,Lorin;Brynjolfsson,Erik ] / MIS Quarterly
39 A comparative evaluation of the impact of eletronic and voice mail on organizational communication /
[ Adams,D.A.;P.A.Todd;R.R.Nelson ] / Information & management   ScienceOn
40 A Short-Form Measure of User Information Satisfation : A Psychometric Evaluation and Notes on Use /
[ Baroudi,J.J.;W.J.Orlikowski ] / Journal of MIS
41 A User Behavior Toward his MIS /
[ Maish,A.M. ] / MIS Quarterly   ScienceOn
42 A Comfirmatory Factor Analysis of the User Information Satisfaction Instrument /
[ Doll,W.J.;T.S.Raghunathan;J.S.Lim;Y.P.Gupta ] / Information Systems Research   ScienceOn
43 /
[ Strassmann,Paul A ] / The Business Value of Computers
44 Key Prescriptions for strategic Information Systems Planning /
[ Lederer,Albert L.;Sethi,Vijay ] / Journal of MIS
45 Measuring the Linkage Between Business and Information Technology Objectives /
[ Reich,Blaise H.;Benbasat,Izak ] / MIS Quarterly   ScienceOn
46 The Measurement of User Information Satisfaction /
[ Ives,B.M.H.Olson;J.J.Baroudi ] / Communications of the ACM   ScienceOn
47 SERVQUAL : A Multiple-Item Scale for Measuring Cnsumer Perceptions of Service Quality /
[ Parasuraman,A.;V.A.Zeithaml;L.L.Berry ] / Jorunal of Retailing
48 Integrating the Balanced Scorecard and Software Measurement Frameworks /
[ Eickelmann,N. ] / Information Technology Evaluation Methods and Management
49 Perceived Service Quality and User Satisfaction with the Information Services Function /
[ Kettinger,W.J.;C.C.Lee ] / Decision Sciences
50 The Measurement of End-User Computing Satisfation /
[ Doll,W.C.;G.Torkzadeh ] / MIS Quarterly   ScienceOn
51 The Process and Product of System Design /
[ Boland,R.J. ] / Management Science   ScienceOn
52 Measuring Information Output : A Communication Systems Approach /
[ Mason,Richard O. ] / Information & Management
53 /
[ Porter,M,E, ] / Competitive Strategy
54 Management Information Systems : Appreciation and Involvement /
[ Swanson,E.B. ] / Management Science
55 Integration and Effectiveness of Marketing Information Systems /
[ Saaksjarve,M.V.T.;J.M.Talvinen ] / European Journal of Marketing   ScienceOn
56 정보시스템 진단과 감리 /
[ 김현수 ] / 법영사
57 The DeLone and McLean Model of Information Systems Success : A TEn-Year Update /
[ DeLone,W.H.;E.R.McLean ] / Journal of Management Information Systems
58 /
[ Kaplan,R.S.;D.P.Norton ] / Translating Strategy into Action - Te Balanced Scorecard
59 Information Systems Evaluation : Navigating Through the Problem Domain /
[ Irani,Zahir ] / Information & Management   ScienceOn
60 Measuring Information System Service Quality : SERVQUAL from the Other Side /
[ Jianh,J.J.;G.Klein;C.L.Carr ] / MIS Quarterly   ScienceOn
61 A Comprehensive Model for Assessing the Quality and Productivity of the Information Systems Function : Toward a Theory for Information Systems Assessment /
[ Myers,B.L.;L.A.Kappelman;V.R.Prybutok ] / Information Resource Management Journal
62 The Keys to Executive Information Systems Success /
[ Rainer,R.K.;H.J.Watson ] / Journal of Management Information Systems
63 Performance Appraisal-Part 1 /
[ Sutton,R.H.R.L.Mathis ] / Journal of Systems Management
64 Develop Long-Trem Competitiveness Through IT Assets /
[ Ross,Jeanne W.;Beath;Mathis;Cynthia;Goodhue,L.Dale ] / Sloan Management Review
65 The Productivity Paradox of Information /
[ Brynjolfsson,E. ] / Communications of the ACM
66 MIS 성과에 대한 평가모형 /
[ 김상훈;이진주 ] / 경영과학의 응용   과학기술학회마을
67 Information technology and the management difference : A fusion map /
[ Keen,P.G.W. ] / IBM Systems Journal
68 A Conceptural Model of Service Quality and its Implications for Future Research /
[ Parasuraman,A.;V.A.Zeithaml;L.L.Berry ] / Journal of Marketing   ScienceOn
69 Development of Measures to Assess the Extent to which an Information Technology Application Provides Competitive Advantage /
[ Sethi,Vijay;W.R.King ] / Management Science   ScienceOn
70 /
[ Walton,R. ] / Up and Running : Integrating Information Technology and The Organization
71 EDP Effectiveness Evaluation /
[ Hurtado,C.D. ] / Journal of Systems Management
72 MIS 평가의 계층적 접근방법 /
[ 정문상 ] / 한국과학기술원 테크노경영대학원,박사학위논문
73 A Multiple Criteria Approach for Evaluating Information Systems /
[ Chandler,J.S. ] / MIS Quarterly   ScienceOn
74 Perceived Usefulness and Information : A Psychometric Examination /
[ Larker,Davis F.;V.Parker Lessig ] / Decision Science
75 Development of A Tool for Measuring and Analyzing Computer User Satisfaction /
[ Baily,J.E.;S.W.Pearson ] / Management Science
76 Cost-Benefit Analysis in Information Systems Development and Operation /
[ King,J.L.;E.L.Schrems ] / Computing Surveys   ScienceOn
77 Measuring Performance of the Information Systems Function /
[ Saunders,C.S.;J.W.Jones ] / Journal of MIS
78 Evaluating Management Information Systems /
[ King,W.R.;J.R.Rodriguez ] / MIS Quarterly   ScienceOn
79 Using a Balanced Scorecard Framework to Leverage the Value Delivered by IS /
[ Meyerson,Bram ] / Information Technology Evaluation Methods and Management
80 /
[ Chandler,A. ] / Strategy and Structure
81 A Framework for Assessing the Relationship Between Information Technology Investments nad Firm Performance /
[ Sircar,S.;Turnbow,L.Joe;B.Bordoloi ] / Journal of Management Information Systems