Asia pacific journal of information systems

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지

A Study on the Effects of BSC System Acceptance Factors on the Intention for Continuous Use

BSC 시스템 수용요인이 지속적 사용의도에 미치는 영향에 관한 연구

  • Kwon, Oh-Jun (Occupational Safety and Health Research Institute, KOSHA) ;
  • Seo, Hyun-Sik (Graduate School of Business, Dankook University) ;
  • Oh, Jay-In (School of Business, Dankook University)
  • Published : 2009.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study is to make an empirical analysis on the factors affecting the intention for the continuous use of the BSC system, which has been recently spread in the public sector. Because the object of acceptance is the performance management system based on BSC (Balanced Scorecard) implemented in the form of information systems, this study proposes a research model by applying TAM (Technology Acceptance Model). Independent variables are factors affecting the acceptance of BSC system such as training, communication, IS support, CEO support and personal innovativeness, and we examine their effects on the dependent variable, namely, intention on continuous use via mediating variables: perceived usefulness and perceived ease of use. A questionnaire survey was conducted with public institutions(firms) that had introduced and were operating the BSC system; 264 valid questionnaires are adopted. Collected data are analyzed using SPSS 16.0 and AMOS 7.0. Results of reliability test show that all analyzed data are reliable. In validity test, one item regarding communication was excluded; 9 latent variables and 34 observed variables are used in the final analysis. Based on the results of the hypothesis test through path analysis using a structural equation model, 10 out of 16 hypotheses are accepted. Factors affecting perceived usefulness are training and IS(Information System) support. The analysis results indicate that perceived ease of use is mainly affected by IS support, CEO support, and personal innovativeness among the factors related to the acceptance of the BSC system. This suggests that, contrary to the expectation that the BSC system may be used without difficulty, the management's active support is required in order to attain expected improvement in productivity and work efficiency. This was also pointed out in case studies on the construction of the BSC system in public sectors. On the other hand, perceived ease of use is found to affect perceived usefulness. This supports the results of previous researches on TAM. Perceived ease of use and perceived usefulness are found to affect the attitude towards the use of the system. The intention on continuous use is affected more by perceived usefulness than by the attitude towards the use of system. This result supports the results of previous researches on TAM, showing that the BSC system is utilized substantially in worksites. This study is considered meaningful in that it was actually performed on users at public institutions(firms) that had introduced the BSC system and that it empirically tested hypotheses on the acceptance of the BSC system by applying TAM to the research model.

Keywords

References

  1. Ko, M.H. and Kwon, S.D., "A Study on the Effects of User Participation on Stickiness and Continued Use on Internet Community," The Journal of MIS Research, Vol. 18, No. 2, 2008, pp. 41-72
  2. Kwahk, K.Y. and Ji, S.Y., "Examining the Moderating Effect of Involvement in the Internet Purchase Decision Process," The Journal of MIS Research, Vol. 18, No. 2, June 2008, pp. 15-40
  3. Kim, S.R., Park, J.H., and Seo, Y.M., "The Success Factors of BSC Operation for an Effective Strategy Implementation," Entrue Journal of Information Technology, Vol. 4, No. 2, 2005, pp. 35-44
  4. Kim, S.K., Lee, C.D., and Shin, S.H., "Building a BSC Management System: The Induction, Building and Success Factors of the Balanced Scorecard," Management Education Review, Vol. 10, No. 1, 2006, pp. 65-80
  5. Kim, C.S., Park, I.S., and Lee, J.W., "A Study on the Evaluation and Application of BSC Performance Management Solution," Proceedings of the 2003 Spring Conference on KMIS, pp. 833-840
  6. Moon, H.G., "An Empirical Study on the Factors Influencing the Acceptance of Digital Home Services," Graduate School(Ph. D.) Dankook University, 2005
  7. Seo, K.H., Cheon, H.M., and Byeon, J.S., "The Critical Factors on BSC Implementing Project," Proceedings of the 2006 Spring Conference on KMIS, pp. 975-984
  8. Suh, C.K. and Seong, S.J., "Individual Characteristics Affecting User's Intention to Use Internet Shopping Mall," The Journal of MIS Research, Vol. 14, No. 3, 2004, pp. 1-22
  9. Shin, S.H., Oh, J.I., and Kim, Y.C., "An Empirical Study on the Effect of the BSC Application on the Organizational Performance in the Public Sector," KMIS International Conference Proceedings, 2007, pp. 739-744
  10. Lee, S.H. and Lee, H.G., "A Study on Effects of Knowledge Transfer Processes on IS Development Project Performance," Journal of Knowledge Studies, Vol. 5, No. 1, 2007, pp. 97-138
  11. Lee, Y.M., Suh, E.H., and Hong, J.U., " A Study on Development of Measurement Indices for ASP in Korea Using BSC," Proceedings of the 2005 Summer Associated Conference on Management, 2005, pp. 1-7
  12. Lee, J.H., Lim, J.H., and Kang, S.J., "The Case Study on Strategic Performance Management : The Ministry of Information and Communication," The Case Study of BSC in the Public Sector-NIA, 2007, pp. 59-86
  13. Lee, C.K., "An Analysis of the Performance Management Tool's Effect on the Public/Private Organizational Performance: Focused on the BSC System as a Performance Management Tool," Korean journal of policy analysis and evaluation, Vol. 17, No. 3, 2007, pp. 55-86
  14. Agarwal, R. and Prasad, J., "The role of innovation characteristics and perceived voluntariness in the acceptance of information technologies," Decision Sciences, Vol. 28, No. 3, 1997, pp. 557-582 https://doi.org/10.1111/j.1540-5915.1997.tb01322.x
  15. Agarwal, R. and Karahanna, E., "Time flies when you’re having fun: cognitive absorption and beliefs about Information Technology Usage," MIS Quarterly, Vol. 24, No. 4, 2000, pp. 665-694 https://doi.org/10.2307/3250951
  16. Ajzen, I., "The Theory of Planned Behavior," Organizational Behavior and Human Decision Processes, Vol. 50, No. 2, 1991, pp. 179-211 https://doi.org/10.1016/0749-5978(91)90020-T
  17. Alexandros Papalexandris, George Ioannou and Gregory P. Prastacos, "Implementing the BSC in Greece: a Softeware firms experience," Long Range Planning, 2004, pp. 351-366
  18. Amoako-Gyampah, K. and Salam, A.F., "An extension of the technology acceptance model in an ERP implementation Environment," Information and Management, Vol. 41, No.6, 2004, pp. 731-745 https://doi.org/10.1016/j.im.2003.08.010
  19. Anderson, E.W., Fornell, C., and Lehmann, D.R., "Customer Satisfaction, Market Share, and Profitability: Findings from Sweden," Journal of Marketing, Vol. 58, No. 3, 1994, pp. 53-66 https://doi.org/10.2307/1252310
  20. Bain and Company, Management Tools and Trends, 2005
  21. Banker, R.D., Chang, H., and Pizzini, M.J., "The balanced scorecard: judgmental effects of performance measures linked to strategy," The accounting Review, No. 79, No. 1, 2004, pp. 1-23 https://doi.org/10.2308/accr.2004.79.1.1
  22. Bernard Wong-On-Wing, Lan Guo, Wei Li, Dan Yang, "Reducing Conflicts in Balanced Scorecard Evaluations," Accounting, Organizations, and Society, Vol. 32, 2007, pp. 363-377 https://doi.org/10.1016/j.aos.2006.05.001
  23. Boudreau, M.C., Gefen, D., and Straub, D.W., "Validation in Information Systems Research: A State-of-the-Art Assessment," MIS Quarterly, Vol. 25, No. 1, 2001, pp. 1-16 https://doi.org/10.2307/3250956
  24. Cagwin, D. and Bouwman, M.J., "The association between activity-based costing and improvement in financial performance," Management Accounting Research, Vol. 13, 2002, pp. 1-39
  25. Carter, F.J., Jambulingham, T., Gupta, V.K. and Melone, N., "Technological innovations: a framework for communicating diffusion effects," Information and Management, Vol. 38, No.5, 2001, pp. 277-287 https://doi.org/10.1016/S0378-7206(00)00065-3
  26. Cavalluzzo, K.S and Ittner, C.D., "Implementing performance measurement innovations: evidence from government," Accounting, Organizations and Society, Vol. 29, 2004, pp. 243-267 https://doi.org/10.1016/S0361-3682(03)00013-8
  27. Chand Donald, George Hachey, James Hunton, Vincent Owhoso and Sri Vasudevan, "A balanced scorecard based framework for assessing the strategic impacts of ERP systems," Computers in Industry, Vol. 56, 2005, pp. 558-572 https://doi.org/10.1016/j.compind.2005.02.011
  28. Chen, Chun-Der, Yi-Wen Fana and Cheng-Kiang Farn, "Predicting electronic toll collection service adoption: An integration of the technology acceptance model and the theory of planned behavior," Transportation Research Part C, No. 15, 2007, pp. 300-311
  29. Compeau, D.R. and Higgins, C.A., "Computer Self-Efficacy: Development of a Measure and Initial Test," MIS Quarterly, Vol. 19, No. 2, 1995, pp. 189-211 https://doi.org/10.2307/249688
  30. Cooper, R.B. and Zmud, R.W., "Information technology implementation research: a technological diffusion approach," Management Science, Vol. 36, No. 2, 1990, pp. 123-139 https://doi.org/10.1287/mnsc.36.2.123
  31. Davis, F.D., Bagozzi, R.P., and Warshaw, P.R., "Extrinsic and Intrinsic Motivation to Use Computers in the Workplace," Journal of Applied Social Psychology, Vol. 22, No. 14, 1992, pp. 1111-1132 https://doi.org/10.1111/j.1559-1816.1992.tb00945.x
  32. Davis, F.D., "Perceived Usefulness, Perceived Ease of Use, and User-Acceptance of Information Technology," MIS Quarterly, Vol. 13, No. 3, 1989, pp. 319-340 https://doi.org/10.2307/249008
  33. Davis, F.D., Bagozzi, R.P., and Warshaw, P.R., "User Acceptance of computer technology: A comparison of two theoretical models," Management Science, Vol. 35, No. 8, 1989, pp. 982-1003 https://doi.org/10.1287/mnsc.35.8.982
  34. Davis, S. and Albright, T., "An investigation of the effect of balanced scorecard implementation on financial performance," Management Accounting Research, Vol. 15, No. 2, 2004, pp. 135-153 https://doi.org/10.1016/j.mar.2003.11.001
  35. Eccles, R.G., "The Performance Measurement Manifesto," Harvard Business Review, Vol. 69, No. 1, 1991, pp. 131-137
  36. Fornell, C. and Larcker, D.F., "Evaluating Structural Equation Models with Unobservable Variables and Measurement Error," Journal of Marketing Research, No. 18, 1981, pp. 39-50 https://doi.org/10.2307/3151312
  37. Fu, Jen-Ruei., Cheng-Kiang Farn and Wen-Pin Chao, "Acceptance of electronic tax filing: A study of taxpayer intentions," Information and Management, Vol. 43, No. 1, 2006, pp. 109-126 https://doi.org/10.1016/j.im.2005.04.001
  38. Gefen, D., Straub, D., and Boudreau, M., "Structural equation modeling and regression: Guidelines for research practice," Communications of AIS, Vol. 4, 2000, pp. 1-80
  39. Grover, V. and Goslar, M.D., "The initiation, adoption, and implementation of telecommunications technologies in U.S. organizations," Journal of Management information systems, Vol. 10, No. 1, 1993, pp. 141-163 https://doi.org/10.1080/07421222.1993.11517994
  40. Hair, J.E. Jr., Anderson, R.E., Tatham, R.L., and Black, W.C., Multivariate Data Analysis, Fifth Edition, Prentice-Hall International, Inc., 1998
  41. Hartwick, J. and Barki, H., "Explaining the role of user participation in information system use," Management Science, Vol. 40, No. 4, 1994, pp. 440-465 https://doi.org/10.1287/mnsc.40.4.440
  42. Hayduk, L.A., Structural Equation Modeling with LISREL: Essentials and Advances, Baltimore: Johns Hopkins University Press., 1987
  43. Heijden, H., "User acceptance of hedonic information systems," MIS Quarterly, Vol. 28, No. 4, 2004, pp. 695-704 https://doi.org/10.2307/25148660
  44. Hendircks, K., Menor, L., and Wiedman, C., "The Balanced Scorecard: To adopt or not to adopt?," Ivey Business Journal, November/ December, 2004, pp. 1-7
  45. Hoelter, J.W., "The analysis of covariance structures: goodness-of-fit indices," Sociological Methods and Research, Vol. 11, 1983, pp. 325-344 https://doi.org/10.1177/0049124183011003003
  46. Hoque, Zahirul and James, W., "Linking Balanced Scorecard Measures to Size and Market Factors: Impact on Organizational Performance," Journal of Management Accounting Research, Vol. 12, 2000, pp. 1-17 https://doi.org/10.2308/jmar.2000.12.1.1
  47. Hu, L. and Bentler, P.M., "Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives," Structural Equation Modeling, Vol. 6, No. 1, 1999, pp. 1-55 https://doi.org/10.1080/10705519909540118
  48. Hu, P.J.H., Clark, T.H.K., and Ma, W.W., "Examining technology acceptance by school teachers: a longitudinal study," Information and Management, Vol. 41, No. 2, 2003, pp. 227-241 https://doi.org/10.1016/S0378-7206(03)00050-8
  49. Hung Shin-Yuan and Chang Chia-Ming, "User acceptance of WAP services: test of competing theories," Computer Standards and Interfaces, Vol. 27, 2005, pp. 359-370 https://doi.org/10.1016/j.csi.2004.10.004
  50. Hunton, J.E. and Beeler, J.D., "Effects of user participation in systems development: a longitudinal field experiment," MIS Quarterly, Vol. 21, No. 4, 1997, pp. 359-383 https://doi.org/10.2307/249719
  51. Igbaria, M., Zinatelli, N., Cragg, P., and Cavaye, A.L.M., "Personal computing acceptance factors in small firms: a structural equation model," MIS Quarterly, Vol. 21, No. 3,1997, pp. 279-305 https://doi.org/10.2307/249498
  52. Islam Majidul and Franz W. Kellermanns, "Firm-and Individual-Level Determinants of Balanced Scorecard Usage," Canadian Accounting Perspectives, Vol. 5, No. 2, 2006, pp. 181-207 https://doi.org/10.1506/74LJ-CMWM-FUAD-NMUT
  53. Ittner, C.D. and Larcker, D.F., "Innovations in performance measurement: trends and research implications," Journal of Management Accounting Research, Vol. 10, 1998, pp. 205-238
  54. Ittner, C.D. and Larcker, D.F., "Quality Strategy, Strategic Control Systems, and Organizational Performance," Accounting, Organizations and Society, Vol. 22, No. 3, 1997, pp. 293-314 https://doi.org/10.1016/S0361-3682(96)00035-9
  55. James J. Jiang, Gary Klein, Richard Discenza, "Perception differences of software success: provider and user views of system metrics," The Journal of Systems and Software, Vol. 63, 2002, pp. 17-27 https://doi.org/10.1016/S0164-1212(01)00135-2
  56. Kaplan, R.S. and Norton, D.P., "The balanced Scorecard Measure that Drive Performance," Harvard Business Review, January-February, 1992, pp. 71-79
  57. Kaplan, R.S. and Norton, D.P., "Putting the Balanced Scorecard to work," Harvard Business Review, Vol. 63, No. 3, 1993, pp. 134–142
  58. Kaplan, R.S. and Norton, D.P., The Balanced Scorecard: Translating Strategy into Action, Harvard Business School Press, 1996
  59. Karahanna, E. and Straub, D.W., "The psychological origins of perceived usefulness and ease of use," Information and Management, Vol. 35, No. 4, 1999, pp. 237-250 https://doi.org/10.1016/S0378-7206(98)00096-2
  60. Kishore, J., Patnaik, L., Mani, V., and Agrawal, V., "Genetic Programming Based Pattern Classification with Feature Space Partitioning," Information Sciences, Vol. 131, No. 4, 2001, pp. 65-86 https://doi.org/10.1016/S0020-0255(00)00081-5
  61. Klein, K.J. and Sorra, J.S., "The challenge of innovation implementation," Academy of Management Review, Vol. 21, No. 4, 1996, pp. 1055-1080 https://doi.org/10.2307/259164
  62. Kloot, L. and Martin, J., "Strategic performance management: A balanced approach to performance management issues in local government," Management Accounting Research, Vol. 11, No. 2, 2000, pp. 231-251 https://doi.org/10.1006/mare.2000.0130
  63. Kremers, M. and Van Dissel, H., "ERP system migrations: a provider versus a customer's perspective," Communications of the ACM, Vol. 43, No. 4, 2000, pp. 53-56 https://doi.org/10.1145/332051.332072
  64. Kydd, C.T., "Understanding the information content of MIS management tools," MIS Quarterly Vol. 13, No. 3, 1989, pp. 276–290
  65. Martinsons, M., Robert Davison and Dennis Tse, "The Balanced ScoreCard: a foundation for the strategic management of information systems," Decision Support Systems, 1999, pp. 71-88
  66. Mun, Y., Yi, D.J., Jackson, Jae S. Park, and Janice Probst, "Understanding information technology acceptance by individual professionals: Toward an integrative view," Information and Management, No. 43, No. 3, 2006, pp. 350-363 https://doi.org/10.1016/j.im.2005.08.006
  67. Nelson, R.R. and Cheney, P.H., "Training End Users: An Exploratory Study," Management Information Systems Quarterly, Vol. 11, No. 4, 1987, pp. 547-559 https://doi.org/10.2307/248985
  68. Niven, Paul R., Balanced Scorecard-Maximizing Performance and Maintaining Results, John Wiley and Sons, 2002, pp. 39-70
  69. Niven, Paul R., Balanced Scorecard Diagnostics-Maintaining Maximum Performance, John Wiley and Sons, 2005, pp. 41-62.
  70. O'Cass, A. and Fenech, T., "Web retailing adoption: exploring the nature of internet users Web retailing behaviour," Journal of Retailing and Consumer Services, Vol. 10, 2003, pp. 81-94 https://doi.org/10.1016/S0969-6989(02)00004-8
  71. Olve, N.G, Roy, J. and Wetter, M., Performance Drivers: a Practical Guide to Using the Balanced Scorecard, John Wiley and Sons, 1999
  72. Pandey, I.M., "Balanced Scorecard: Myth and Reality," The Journal for Decision Makers(VIKALPA), Vol. 30, No. 1, 2005, pp. 51-66
  73. Paul Jen-Hwa Hu, Theodore H.K. Clark, and Will W. Ma, "Examining technology acceptance by school teachers: a longitudinal study," Information and Management, No. 41, 2003, pp. 227-241 https://doi.org/10.1016/S0378-7206(03)00050-8
  74. Richardson, S., "The Key elements of Balanced Scorecard success," Ivey Business Journal, November/December, 2004, pp. 7-9
  75. Schneiderman, A. M., "Why balanced scorecards fail," Journal of Strategic Performance Management, January 1999, pp. 6-11
  76. Shin-Yuan Hung, Chia-Ming Chang and Ting-Jing Yu, "Determinants of user acceptance of the e-Government services: The case of online tax filing and payment system," Government Information Quarterly, Vol. 23, No. 1, 2006, pp. 97-122 https://doi.org/10.1016/j.giq.2005.11.005
  77. Stewart, T., "The status of Communication Today," Strategic Communication Management, Vol. 3, No. 2, 1999, pp. 21-25
  78. Straub, D., Boudreau, M., and Gefen, D., "Validation Guidelines for IS positivist Research," Communications of the Association for Information Systems, Vol. 13, 2004, pp. 380-427
  79. Taylor, S. and Todd, P.A., "Understanding Information Technology Usage: A Test of Competing Models," Information Systems Research, Vol. 6, No. 2, 1995, pp. 144-174 https://doi.org/10.1287/isre.6.2.144
  80. Venkatech, V. and Davis, F.D., "A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies," Management Science, Vol. 46, No. 2, 2000, pp. 186-204 https://doi.org/10.1287/mnsc.46.2.186.11926
  81. Venkatesh, V., Morris, M.G., Davis, G.B., and Davis, F.D., "User Acceptance of Information Technology: Toward a Unified View," MIS Quarterly, Vol. 27, No. 3, 2003, pp. 425-478 https://doi.org/10.2307/30036540