Browse > Article

Evaluating Performance Efficiency of Information Systems Function in A System Integration Corporation  

Kim, Hyo-Youl ((주) beTRUSTed Korea)
Han, In-Goo (한국과학기술원 테크노경영대학원)
Shin, Taek-Soo (한국과학기술원 테크노경영연구소)
Publication Information
Asia pacific journal of information systems / v.12, no.3, 2002 , pp. 1-20 More about this Journal
Abstract
For the last decade, some leading groups of corporations in Korea have integrated and managed their Information Systems(IS) functions. Each group established a separate System Management(SM) company to manage the IS and tried to get a synergy effect from the integration. These attempts, however, were not initiated by any one company. Rather they were group efforts. Moreover, the previous measuring tools evaluated IS with the scope of technical performance or quantitative user satisfaction using an absolute scale. Obscure criteria were used in an attempt to present improvements in IS function which were qualitatively weak. This study evaluates whether integration has been efficient and successful. For this purpose, we evaluate the performance efficiency of IS functions with Data Envelopment Analysis(DEA) methodology. In comparison with prior methods, DEA presents the rate of relative efficiency, the efficiency frontier for improving inefficiency, the degree of improvement(slack), and the guideline to construct any benchmark(reference set). For our DEA evaluation, this study selected a leading group of 23 companies in Korea. Our experimental results are as follows. First, efficiency was rated low on average. It also demonstrates that the motivation of performance efficiency of IS functions is deficient. Second, the result of the test to find the existence of economy of scale and scope shows that the growth of an organization and industrial characteristics do not affect IS performance efficiency from the perspective of user satisfaction. Finally, the comparison with other evaluation approaches informs us that DEA can be a complementary evaluation method which supports other measuring tools.
Keywords
Citations & Related Records
연도 인용수 순위
  • Reference
1 Berger, A and Humphrey, D., 'The Dominance of Inefficiencies over Scale and Product Mix Economies in Banking,' Journal of Monetary Economics, Vol. 28,1991, pp. 117-148   DOI   ScienceOn
2 Bessent, A, Bessent, W., Kennington, J., and Reagan, B., 'An Application of Mathematical Programming to Access Productivity in the Huston Independent School District,' Management Science, Vol. 28, No. 12, 1982, pp. 1355-1367   DOI   ScienceOn
3 Broadbent, M., Weill, P., and Neo, B.S., 'Strategic Context and Patterns of IT Infrastructure Capability,' Journal of Strategic Information Systems, Vol. 8, 1999, pp. 157-187   DOI   ScienceOn
4 Chames, A, Cooper, W.W., and Rhodes, E., 'Measuring the Efficiency of Decision Making Units,' European Journal of Operational Research, Vol. 2, No.6, 1978, pp. 429-444   DOI   ScienceOn
5 Kim, H.Y., 'Economies of Scale and Economies of Scope in Multiproduct Financial Institutions: Further Evidence from Credit Unions,' Journal of Money, Credit and Banking, Vol. 18, No.2, 1986, pp. 220-226   DOI   ScienceOn
6 Premier 100, Computerworld, 1989-1995
7 Farrell, M.J., 'The Measurement of Productive Efficiency,' Journal of Royal Statistical Society, Series A 120,1957,pp. 253-281
8 Fried, J.O., Lovell, C.A.K., and Van den Eeckaut, P., 'Evaluating the Performance of United States Credit Unions,' Journal of Banking and Finance, VoI. 17, 1993, pp. 251-265   DOI   ScienceOn
9 Burgress, J.F. Jr. and Wilson, P.W., 'Hospital Ownership and Technical Inefficiency,' Management Science, Vol. 41, No. 1, 1996, pp. 110-123
10 Athanassopoulos, AD., 'Service Quality and Operating Efficiency Synergies for Management Control in the Provision of Financial Services: Evidence from Greek Bank Branches,' European Journal of Operational Research, Vol. 87, 1997, pp. 300-313
11 Jiang, J.J., Sobol, M.G., and Klein, G., 'Performance Ratings and Importance of Performance Measures for IS Staff: The Different Perceptions of IS Users and IS Staff,' IEEE Transactions on Engineering Management, Vol. 47, No.4, 2000, pp. 424-434   DOI   ScienceOn
12 Goodhue, D.L., 'Understanding User Evaluations of Information Systems,' Management Science, Vol. 41, No. 12, 1995, pp. 1827-1844   DOI   ScienceOn
13 Pitt., L.F., Watson, R.T. and Kavan, C.B., 'Service Quality: A Measure of Information Effectiveness,' MIS Quarterly, June 1995, pp. 173-187   DOI   ScienceOn
14 Ahn, T., Efficiency and Related Issues in Higher Education: A Data Envelopment Analysis Approach, PhD Dissertation, The University of Texas at Austin, 1987
15 Chames, A., Cooper, W.W., Lewin, A.Y., and Seiford, L.M., Data Envelopment Analysis: Theory, Methodology, and Application, Kluwer Academic Publishers, 1994
16 DeLane, W.H and McLean, E.R, 'Information Systems Success:The Quest for The Dependent Variable,' Information Systems Research, Vol. 3, No.1, 1992, pp. 60-95   DOI
17 Hayes, W.L., Statistics, New York: Holt, Rinehart, and Winston Publishing, 1981
18 Seddon, P. and Yip, S., 'An Empirical Evaluation of User Information Satisfaction Measures for use with General Ledger Accounting Software,' Journal of Information System, Spring 1992, pp. 75-92
19 Sherman, HD., 'Hospital Efficiency Measurement and Evaluation,' Medical Care, Vol. 22, No. 10, 1984, pp. 922-938   DOI   PUBMED   ScienceOn
20 Schaffnit, C, Rosen, D., and Paradi, J.C, 'Best Practice Analysis of Bank Branches: an Application of Data Envelopment Analysis in a Large Canadian Bank,' European Journal of Operational Research, Vol. 98, No. 2, 1997, pp. 269-289   DOI   ScienceOn
21 Saunders, C.S. and Jones, J.W., 'Measuring Performance of the Information Systems Function,' Journal of Management Information Systems, Vol. 8, No.4, 1992, pp. 62-82
22 Ferrari, D., Computer System Performance Evaluation, Prentice-Hall, 1978
23 Ahn, T., 'DEA as a Performance Evaluation Method of Bank Branches Test and Comparison,' Korean Management Review, Vol. 21, No. 1, 1991, pp. 71-102
24 Mahmood, M.A. and Mann, G.J., 'Impact of Information Technology Investment: An Empirical Assessment,' Journal of Accounting, Management and Information Technology, Vol. 3, No.1, 1993, pp.   DOI   ScienceOn
25 Arnold, V.L., Bardhan, I.R., Cooper, W.W., and Kumbhakar, S.C., 'New Uses of Data Envelopment Analysis (DEA) and Statistical Regressions for Production Function Estimation and Efficiency Evaluation-with Illustrative Applications to Public Schools in Texas,' Annals of Operations Research, Vol. 66, 1996, pp. 255-277   DOI   ScienceOn
26 Bessent, A, Bessent, W., and Walland, E., 'Determining the Comparative Efficiency of Schools Through Data Envelopment Analysis,' Educational Administration Quarterly, Vol. 16, No.2, 1980, pp. 57-75   DOI
27 Sherman, HD. and Gold, F., 'Bank Branch Operating Efficiency: Evaluation with Data Envelopment Analysis,' Journal of Banking and Finance, Vol. 9, No.2, 1985, pp. 298-315