A Model to Measure the Success of a Web-based Information System at a Government Agency - the Chungwadae Case

공공기관 업무관리시스템 성과평가 모형 개발에 관한 연구: 청와대 업무관리시스템(e지원시스템)을 중심으로

  • Published : 2008.03.31

Abstract

Introduction The e-government is concerned with using Internet and Web technologies to exchange information and services with citizens, businesses and other related organizations, and it centers on three functions, namely informational, interactive, and transactional [UN, 2001]. Many developed countries like the U.S. have been actively involved in e-government projects, since they enable both more effective public services for citizens and more efficient internal operations. Korea is among these leading countries that are planning to leverage computer and communication technologies to provide for integration of work processes and information as well as convenient access to information and services. For this reason, evaluating e-government projects is becoming a crucial issue for both researchers and policy-makers. However, most research to date has primarily focused on a model of success of an e-government system designed for citizens, overlooking internal systems specifically created for employees working in a public organization. This paper is intended to propose a model to measure the success of a Web-based information system designed for use by internal users at Chungwadae, the executive branch of Korea's central government. The paper is also aimed at applying the model to the assessment of the present system being used at Chungwadae in comparison with the preceding system. Evaluating an e-Government System The most widely cited model of information systems success today is that of DeLone and McLean[1992, 2003, 2004]. The original model states that the success of an information system can be measured using six dimensions, including system quality, information quality, use, user satisfaction, individual impact, and organizational impact. Although the ultimate success of an information system may be reflected in the impact that the system has upon individuals as well as an organization, aspects of using the system such as system use and user satisfaction can play an important role in determining the system success, because the system would be a sheer failure if users don't like and use the system. As a response to criticisms given by numerous researchers, the authors adapted their model to fit the emerging Web-based environment. The revised model[DeLone and McLean, 2003] they offered included an additional quality dimension, namely service quality, and combined individual and organizational impacts into net benefits which can also influence user satisfaction. The e-government system success model can be built around this updated model. Our model incorporates information quality, system quality, and service quality as in the DeLone and McLean model. However, the 'system use' dimension has been replaced by perceived usefulness, as suggested by Seddon[1998]. In addition, because the e-government systems that this paper focuses on are internal public systems used in government agencies, the 'net benefits' dimension has been replaced by perceived work efficiency. Based on the proposed model, a total of nine hypotheses have been formulated which we tested using an empirical analysis. Methods A questionnaire form has been created with items that are designed to examine the relationships among the variables in the model. The questionnaire has been handed over, in person, to 65 members of Chungwadae staff who are now actively using the E-Support System, the present information system created to support internal work at Chungwadae. We made arrangements to meet with each individual who agreed to participate in our survey, and helped to fill out the survey form with explanations. Of the 65 copies that were delivered, only 33 were returned, and 30 responses of these have been adopted for our analysis, since three were not valid. The extremely small sample size was due to the limited number of staff members who had adequate experience required of this study. Results We gathered data from the questionnaire survey and analyzed them using a regression analysis to test the hypotheses. As shown in the table below, the results indicated that all three dimensions of an information system’s quality are positively related to user satisfaction. However, information quality and system quality were found to be positively related to perceived usefulness, while service quality was not. In addition, perceived usefulness is not positively related to user satisfaction, implying that a user may find a system useful, but may not be satisfied with it. Finally, user satisfaction and perceived usefulness both are positively related to perceived work efficiency. This suggests that workers' positive experience with the system is important to guarantee favorable work efficiency. Conclusions We conclude that the proposed model proved useful in measuring the success of an internal information system used by a government agency. To demonstrate the applicability and usefulness of the model in the paper, we applied the model to the assessment of the present internal system used at Chungwadae in comparison with the preceding system. The results showed that the present system outperforms the preceding one in a statistically significant way. Future research will have to focus on applying the model to Korea's governmental agencies other than Chungwadae and examine whether it proves applicable in different types of governmental organizations.

Keywords

References

  1. 김무곤, 장하용, "공공기관 웹사이트의 평가모형 개발을 위한 연구 : 정부부처 홈페이지 사례분석을 중심으로," 사이버커뮤니케이션 학보, 제1권, 제7호, 2001, pp. 38-71
  2. 변대화, 전홍대, "전자정부 웹사이트의 유용성 평가," 정보화정책, 제12권, 제1호, 2005년 봄, pp. 21-43
  3. 복병학, 이재우, 시스템 통합의 핵심기술. 서울: 대청, 1999
  4. 변대호, "대한민국 전자정부 웹사이트의 유용성 평가," Information Systems Review, 2005, 제7권, 제1호, pp. 1-20
  5. 변대호, 전홍대, "전자정부 웹사이트의 유용성 평가," 정보화정책, 2005, 제12권, 제1호, pp. 21-43
  6. 성도경, 장영철, "행정서비스의 고객지향성 평가," 한국행정학보, Vol. 39, No. 2, 2005년 여름, pp. 207-232
  7. 오강탁, 이연우, "참여정부 전자정부 수준진 단과 정책적 함의: 전자정부 발전모형 관점에서," 정보화정책, 제12권, 제3호, 2005년 가을, pp. 104-120
  8. 정보통신정책연구원, 전자정부사업 성과평가모델 연구, 2003
  9. 전자정부홍보관cited, 2006년 4월 10일(http://guide.egov.go.kr/05_vision/vision01.html)
  10. 한국웹사이트평가개발원, 웹사이트 평가결 과 요약보고서(특별, 광역시청), 2003
  11. 한국전산원, 정보화 평가 연구 2000년 연구 개발 결과
  12. Hong, Ilyoo, "In Search for Website Metrics for Measuring the Impacts of a Website," Workshop on Information Systems Research & Development (WISRD 2003), Lake Arrowhead, CA. March 2003, pp. 28-30
  13. D'Ambra, J. and Rice, R.E., "Emerging factors in user evaluation of the World Wide Web," Information and Management, Vol. 38, No. 2, 2001, pp. 373-384 https://doi.org/10.1016/S0378-7206(00)00077-X
  14. DeLone, W.H. and McLean, E.R., "Information System Success: The Quest for the Dependent Variable," Information Systems Research, Vol. 3, No. 1, March 1992, pp. 60-95 https://doi.org/10.1287/isre.3.1.60
  15. OECD, E-Government Flagship Report-The E-Government Imperative, 2002
  16. D'Ambra, J. and Rice, R.E., "Emerging factors in user evaluation of the World Wide Web," Information and Management, Vol. 38, No. 2, 2001, pp. 373-384, 2000 https://doi.org/10.1016/S0378-7206(00)00077-X
  17. DeLone, W.H. and McLean, E.R., "Information System Success: The Quest for the Dependent Variable," Information Systems Research, Vol. 3, No. 1, March 1992, pp. 60-95 https://doi.org/10.1287/isre.3.1.60
  18. DeLone, W.H. and McLean, E.R., "DeLone and McLean model of information systems success: A ten-year update," Journal of Management Information Systems, Vol. 19, No. 4, 2003, pp. 9-30 https://doi.org/10.1080/07421222.2003.11045748
  19. DeLone, W.H. and McLean, E.R., "Measuring e-Commerce Success: Applying the DeLone and McLean Information Systems Success Model," International Journal of Electronic Commerce, Vol. 9, No. 1, 2004, pp. 31-47
  20. Iwaarden, J.C. and Wiele, T.V., "Applying SERVEQUAL to Websites: an exploratory study," International Journal of Quality & Reliability Management, Vol. 20, No. 8, 2003, pp. 919-935 https://doi.org/10.1108/02656710310493634
  21. McGill, T. and Hobbs, V., "User Developed Applications and Information System Success: A Test of DeLone and McLean's Model," Information Resources Management Journal, Vol. 16, No. 1, Jan-Mar 2003, pp. 24-45 https://doi.org/10.4018/irmj.2003010103
  22. Mollar, A. and Licker, P.S., "E-commerce Systems Success: An Attempt to Extend and Respecify the DeLone and McLean Model for IS Success," Journal of Electronic Commerce Research, Vol. 2, No. 4, 2001, pp. 131-141
  23. Peppers, D. and M. Rogers, Enterprise One to One: Tools for Competing in the Interactive Age, New York: Currency Doubleday, 1997
  24. Pitt, D., Watson, R.T. and Kavan, R.T., "Service Quality: A Measure of Information systems effectiveness," MIS Quarterly, Vol. 19, No. 2, 1995, pp. 173-188 https://doi.org/10.2307/249687
  25. Seddon, P.B., "A Respecification and Extension of the DeLone and Mclean Model of IS Success," Information Systems Research, Vol. 8, No. 3, 1997, pp. 240-253 https://doi.org/10.1287/isre.8.3.240
  26. Wescott, C.G., "E-government in Asia-Pacific region," Asian Journal of political Science, Vol. 9, No. 2, 2001, pp. 1-24
  27. Zwass, V., "Electronic Commerce: Structures and issues," International Journal of Electronic Commerce, Vol. 1, No. 1, fall 1996, pp. 3-23