Browse > Article

A Study on the Effects of BSC System Acceptance Factors on the Intention for Continuous Use  

Kwon, Oh-Jun (Occupational Safety and Health Research Institute, KOSHA)
Seo, Hyun-Sik (Graduate School of Business, Dankook University)
Oh, Jay-In (School of Business, Dankook University)
Publication Information
Asia pacific journal of information systems / v.19, no.3, 2009 , pp. 151-179 More about this Journal
Abstract
The purpose of this study is to make an empirical analysis on the factors affecting the intention for the continuous use of the BSC system, which has been recently spread in the public sector. Because the object of acceptance is the performance management system based on BSC (Balanced Scorecard) implemented in the form of information systems, this study proposes a research model by applying TAM (Technology Acceptance Model). Independent variables are factors affecting the acceptance of BSC system such as training, communication, IS support, CEO support and personal innovativeness, and we examine their effects on the dependent variable, namely, intention on continuous use via mediating variables: perceived usefulness and perceived ease of use. A questionnaire survey was conducted with public institutions(firms) that had introduced and were operating the BSC system; 264 valid questionnaires are adopted. Collected data are analyzed using SPSS 16.0 and AMOS 7.0. Results of reliability test show that all analyzed data are reliable. In validity test, one item regarding communication was excluded; 9 latent variables and 34 observed variables are used in the final analysis. Based on the results of the hypothesis test through path analysis using a structural equation model, 10 out of 16 hypotheses are accepted. Factors affecting perceived usefulness are training and IS(Information System) support. The analysis results indicate that perceived ease of use is mainly affected by IS support, CEO support, and personal innovativeness among the factors related to the acceptance of the BSC system. This suggests that, contrary to the expectation that the BSC system may be used without difficulty, the management's active support is required in order to attain expected improvement in productivity and work efficiency. This was also pointed out in case studies on the construction of the BSC system in public sectors. On the other hand, perceived ease of use is found to affect perceived usefulness. This supports the results of previous researches on TAM. Perceived ease of use and perceived usefulness are found to affect the attitude towards the use of the system. The intention on continuous use is affected more by perceived usefulness than by the attitude towards the use of system. This result supports the results of previous researches on TAM, showing that the BSC system is utilized substantially in worksites. This study is considered meaningful in that it was actually performed on users at public institutions(firms) that had introduced the BSC system and that it empirically tested hypotheses on the acceptance of the BSC system by applying TAM to the research model.
Keywords
BSC; BSC System; TAM; Acceptance of BSC; Intention on Continuous Use; Public Sector;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 Lee, S.H. and Lee, H.G., "A Study on Effects of Knowledge Transfer Processes on IS Development Project Performance," Journal of Knowledge Studies, Vol. 5, No. 1, 2007, pp. 97-138
2 Lee, J.H., Lim, J.H., and Kang, S.J., "The Case Study on Strategic Performance Management : The Ministry of Information and Communication," The Case Study of BSC in the Public Sector-NIA, 2007, pp. 59-86
3 Lee, C.K., "An Analysis of the Performance Management Tool's Effect on the Public/Private Organizational Performance: Focused on the BSC System as a Performance Management Tool," Korean journal of policy analysis and evaluation, Vol. 17, No. 3, 2007, pp. 55-86
4 Agarwal, R. and Karahanna, E., "Time flies when you’re having fun: cognitive absorption and beliefs about Information Technology Usage," MIS Quarterly, Vol. 24, No. 4, 2000, pp. 665-694   DOI   ScienceOn
5 Alexandros Papalexandris, George Ioannou and Gregory P. Prastacos, "Implementing the BSC in Greece: a Softeware firms experience," Long Range Planning, 2004, pp. 351-366
6 Carter, F.J., Jambulingham, T., Gupta, V.K. and Melone, N., "Technological innovations: a framework for communicating diffusion effects," Information and Management, Vol. 38, No.5, 2001, pp. 277-287   DOI   ScienceOn
7 Chen, Chun-Der, Yi-Wen Fana and Cheng-Kiang Farn, "Predicting electronic toll collection service adoption: An integration of the technology acceptance model and the theory of planned behavior," Transportation Research Part C, No. 15, 2007, pp. 300-311
8 Davis, S. and Albright, T., "An investigation of the effect of balanced scorecard implementation on financial performance," Management Accounting Research, Vol. 15, No. 2, 2004, pp. 135-153   DOI   ScienceOn
9 Eccles, R.G., "The Performance Measurement Manifesto," Harvard Business Review, Vol. 69, No. 1, 1991, pp. 131-137   PUBMED
10 Hartwick, J. and Barki, H., "Explaining the role of user participation in information system use," Management Science, Vol. 40, No. 4, 1994, pp. 440-465   DOI   ScienceOn
11 Kaplan, R.S. and Norton, D.P., "The balanced Scorecard Measure that Drive Performance," Harvard Business Review, January-February, 1992, pp. 71-79   PUBMED
12 Kaplan, R.S. and Norton, D.P., "Putting the Balanced Scorecard to work," Harvard Business Review, Vol. 63, No. 3, 1993, pp. 134–142
13 Kaplan, R.S. and Norton, D.P., The Balanced Scorecard: Translating Strategy into Action, Harvard Business School Press, 1996
14 Klein, K.J. and Sorra, J.S., "The challenge of innovation implementation," Academy of Management Review, Vol. 21, No. 4, 1996, pp. 1055-1080   DOI   ScienceOn
15 Kydd, C.T., "Understanding the information content of MIS management tools," MIS Quarterly Vol. 13, No. 3, 1989, pp. 276–290
16 Mun, Y., Yi, D.J., Jackson, Jae S. Park, and Janice Probst, "Understanding information technology acceptance by individual professionals: Toward an integrative view," Information and Management, No. 43, No. 3, 2006, pp. 350-363   DOI   ScienceOn
17 Taylor, S. and Todd, P.A., "Understanding Information Technology Usage: A Test of Competing Models," Information Systems Research, Vol. 6, No. 2, 1995, pp. 144-174   DOI   ScienceOn
18 Karahanna, E. and Straub, D.W., "The psychological origins of perceived usefulness and ease of use," Information and Management, Vol. 35, No. 4, 1999, pp. 237-250   DOI   ScienceOn
19 Moon, H.G., "An Empirical Study on the Factors Influencing the Acceptance of Digital Home Services," Graduate School(Ph. D.) Dankook University, 2005
20 Hayduk, L.A., Structural Equation Modeling with LISREL: Essentials and Advances, Baltimore: Johns Hopkins University Press., 1987
21 Niven, Paul R., Balanced Scorecard Diagnostics-Maintaining Maximum Performance, John Wiley and Sons, 2005, pp. 41-62.
22 Olve, N.G, Roy, J. and Wetter, M., Performance Drivers: a Practical Guide to Using the Balanced Scorecard, John Wiley and Sons, 1999
23 Venkatesh, V., Morris, M.G., Davis, G.B., and Davis, F.D., "User Acceptance of Information Technology: Toward a Unified View," MIS Quarterly, Vol. 27, No. 3, 2003, pp. 425-478   DOI
24 Kishore, J., Patnaik, L., Mani, V., and Agrawal, V., "Genetic Programming Based Pattern Classification with Feature Space Partitioning," Information Sciences, Vol. 131, No. 4, 2001, pp. 65-86   DOI   ScienceOn
25 Seo, K.H., Cheon, H.M., and Byeon, J.S., "The Critical Factors on BSC Implementing Project," Proceedings of the 2006 Spring Conference on KMIS, pp. 975-984
26 Cagwin, D. and Bouwman, M.J., "The association between activity-based costing and improvement in financial performance," Management Accounting Research, Vol. 13, 2002, pp. 1-39
27 Hu, P.J.H., Clark, T.H.K., and Ma, W.W., "Examining technology acceptance by school teachers: a longitudinal study," Information and Management, Vol. 41, No. 2, 2003, pp. 227-241   DOI   ScienceOn
28 Paul Jen-Hwa Hu, Theodore H.K. Clark, and Will W. Ma, "Examining technology acceptance by school teachers: a longitudinal study," Information and Management, No. 41, 2003, pp. 227-241   DOI   ScienceOn
29 Venkatech, V. and Davis, F.D., "A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies," Management Science, Vol. 46, No. 2, 2000, pp. 186-204   DOI   ScienceOn
30 Ajzen, I., "The Theory of Planned Behavior," Organizational Behavior and Human Decision Processes, Vol. 50, No. 2, 1991, pp. 179-211   DOI
31 Martinsons, M., Robert Davison and Dennis Tse, "The Balanced ScoreCard: a foundation for the strategic management of information systems," Decision Support Systems, 1999, pp. 71-88
32 Hu, L. and Bentler, P.M., "Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives," Structural Equation Modeling, Vol. 6, No. 1, 1999, pp. 1-55   DOI   ScienceOn
33 Anderson, E.W., Fornell, C., and Lehmann, D.R., "Customer Satisfaction, Market Share, and Profitability: Findings from Sweden," Journal of Marketing, Vol. 58, No. 3, 1994, pp. 53-66   DOI   ScienceOn
34 Boudreau, M.C., Gefen, D., and Straub, D.W., "Validation in Information Systems Research: A State-of-the-Art Assessment," MIS Quarterly, Vol. 25, No. 1, 2001, pp. 1-16   DOI   ScienceOn
35 Compeau, D.R. and Higgins, C.A., "Computer Self-Efficacy: Development of a Measure and Initial Test," MIS Quarterly, Vol. 19, No. 2, 1995, pp. 189-211   DOI   ScienceOn
36 Kloot, L. and Martin, J., "Strategic performance management: A balanced approach to performance management issues in local government," Management Accounting Research, Vol. 11, No. 2, 2000, pp. 231-251   DOI   ScienceOn
37 Gefen, D., Straub, D., and Boudreau, M., "Structural equation modeling and regression: Guidelines for research practice," Communications of AIS, Vol. 4, 2000, pp. 1-80
38 Kwahk, K.Y. and Ji, S.Y., "Examining the Moderating Effect of Involvement in the Internet Purchase Decision Process," The Journal of MIS Research, Vol. 18, No. 2, June 2008, pp. 15-40   과학기술학회마을
39 Cooper, R.B. and Zmud, R.W., "Information technology implementation research: a technological diffusion approach," Management Science, Vol. 36, No. 2, 1990, pp. 123-139   DOI   ScienceOn
40 Suh, C.K. and Seong, S.J., "Individual Characteristics Affecting User's Intention to Use Internet Shopping Mall," The Journal of MIS Research, Vol. 14, No. 3, 2004, pp. 1-22
41 Heijden, H., "User acceptance of hedonic information systems," MIS Quarterly, Vol. 28, No. 4, 2004, pp. 695-704   DOI
42 Fornell, C. and Larcker, D.F., "Evaluating Structural Equation Models with Unobservable Variables and Measurement Error," Journal of Marketing Research, No. 18, 1981, pp. 39-50   DOI   ScienceOn
43 Nelson, R.R. and Cheney, P.H., "Training End Users: An Exploratory Study," Management Information Systems Quarterly, Vol. 11, No. 4, 1987, pp. 547-559   DOI   ScienceOn
44 Davis, F.D., Bagozzi, R.P., and Warshaw, P.R., "User Acceptance of computer technology: A comparison of two theoretical models," Management Science, Vol. 35, No. 8, 1989, pp. 982-1003   DOI   ScienceOn
45 Hung Shin-Yuan and Chang Chia-Ming, "User acceptance of WAP services: test of competing theories," Computer Standards and Interfaces, Vol. 27, 2005, pp. 359-370   DOI   ScienceOn
46 Pandey, I.M., "Balanced Scorecard: Myth and Reality," The Journal for Decision Makers(VIKALPA), Vol. 30, No. 1, 2005, pp. 51-66
47 Kim, C.S., Park, I.S., and Lee, J.W., "A Study on the Evaluation and Application of BSC Performance Management Solution," Proceedings of the 2003 Spring Conference on KMIS, pp. 833-840
48 Bain and Company, Management Tools and Trends, 2005
49 Islam Majidul and Franz W. Kellermanns, "Firm-and Individual-Level Determinants of Balanced Scorecard Usage," Canadian Accounting Perspectives, Vol. 5, No. 2, 2006, pp. 181-207   DOI
50 Lee, Y.M., Suh, E.H., and Hong, J.U., " A Study on Development of Measurement Indices for ASP in Korea Using BSC," Proceedings of the 2005 Summer Associated Conference on Management, 2005, pp. 1-7
51 Kremers, M. and Van Dissel, H., "ERP system migrations: a provider versus a customer's perspective," Communications of the ACM, Vol. 43, No. 4, 2000, pp. 53-56   DOI   ScienceOn
52 Niven, Paul R., Balanced Scorecard-Maximizing Performance and Maintaining Results, John Wiley and Sons, 2002, pp. 39-70
53 Richardson, S., "The Key elements of Balanced Scorecard success," Ivey Business Journal, November/December, 2004, pp. 7-9
54 Cavalluzzo, K.S and Ittner, C.D., "Implementing performance measurement innovations: evidence from government," Accounting, Organizations and Society, Vol. 29, 2004, pp. 243-267   DOI   ScienceOn
55 Ko, M.H. and Kwon, S.D., "A Study on the Effects of User Participation on Stickiness and Continued Use on Internet Community," The Journal of MIS Research, Vol. 18, No. 2, 2008, pp. 41-72   과학기술학회마을
56 Hair, J.E. Jr., Anderson, R.E., Tatham, R.L., and Black, W.C., Multivariate Data Analysis, Fifth Edition, Prentice-Hall International, Inc., 1998
57 Schneiderman, A. M., "Why balanced scorecards fail," Journal of Strategic Performance Management, January 1999, pp. 6-11
58 Shin-Yuan Hung, Chia-Ming Chang and Ting-Jing Yu, "Determinants of user acceptance of the e-Government services: The case of online tax filing and payment system," Government Information Quarterly, Vol. 23, No. 1, 2006, pp. 97-122   DOI   ScienceOn
59 Hunton, J.E. and Beeler, J.D., "Effects of user participation in systems development: a longitudinal field experiment," MIS Quarterly, Vol. 21, No. 4, 1997, pp. 359-383   DOI   ScienceOn
60 Igbaria, M., Zinatelli, N., Cragg, P., and Cavaye, A.L.M., "Personal computing acceptance factors in small firms: a structural equation model," MIS Quarterly, Vol. 21, No. 3,1997, pp. 279-305   DOI   ScienceOn
61 Straub, D., Boudreau, M., and Gefen, D., "Validation Guidelines for IS positivist Research," Communications of the Association for Information Systems, Vol. 13, 2004, pp. 380-427
62 Ittner, C.D. and Larcker, D.F., "Quality Strategy, Strategic Control Systems, and Organizational Performance," Accounting, Organizations and Society, Vol. 22, No. 3, 1997, pp. 293-314   DOI   ScienceOn
63 Kim, S.K., Lee, C.D., and Shin, S.H., "Building a BSC Management System: The Induction, Building and Success Factors of the Balanced Scorecard," Management Education Review, Vol. 10, No. 1, 2006, pp. 65-80
64 Bernard Wong-On-Wing, Lan Guo, Wei Li, Dan Yang, "Reducing Conflicts in Balanced Scorecard Evaluations," Accounting, Organizations, and Society, Vol. 32, 2007, pp. 363-377   DOI   ScienceOn
65 Hoque, Zahirul and James, W., "Linking Balanced Scorecard Measures to Size and Market Factors: Impact on Organizational Performance," Journal of Management Accounting Research, Vol. 12, 2000, pp. 1-17   DOI   ScienceOn
66 Hendircks, K., Menor, L., and Wiedman, C., "The Balanced Scorecard: To adopt or not to adopt?," Ivey Business Journal, November/ December, 2004, pp. 1-7
67 Hoelter, J.W., "The analysis of covariance structures: goodness-of-fit indices," Sociological Methods and Research, Vol. 11, 1983, pp. 325-344   DOI
68 Ittner, C.D. and Larcker, D.F., "Innovations in performance measurement: trends and research implications," Journal of Management Accounting Research, Vol. 10, 1998, pp. 205-238
69 Davis, F.D., "Perceived Usefulness, Perceived Ease of Use, and User-Acceptance of Information Technology," MIS Quarterly, Vol. 13, No. 3, 1989, pp. 319-340   DOI   ScienceOn
70 Grover, V. and Goslar, M.D., "The initiation, adoption, and implementation of telecommunications technologies in U.S. organizations," Journal of Management information systems, Vol. 10, No. 1, 1993, pp. 141-163   DOI
71 Chand Donald, George Hachey, James Hunton, Vincent Owhoso and Sri Vasudevan, "A balanced scorecard based framework for assessing the strategic impacts of ERP systems," Computers in Industry, Vol. 56, 2005, pp. 558-572   DOI   ScienceOn
72 Kim, S.R., Park, J.H., and Seo, Y.M., "The Success Factors of BSC Operation for an Effective Strategy Implementation," Entrue Journal of Information Technology, Vol. 4, No. 2, 2005, pp. 35-44
73 Shin, S.H., Oh, J.I., and Kim, Y.C., "An Empirical Study on the Effect of the BSC Application on the Organizational Performance in the Public Sector," KMIS International Conference Proceedings, 2007, pp. 739-744
74 Amoako-Gyampah, K. and Salam, A.F., "An extension of the technology acceptance model in an ERP implementation Environment," Information and Management, Vol. 41, No.6, 2004, pp. 731-745   DOI   ScienceOn
75 Banker, R.D., Chang, H., and Pizzini, M.J., "The balanced scorecard: judgmental effects of performance measures linked to strategy," The accounting Review, No. 79, No. 1, 2004, pp. 1-23   DOI   ScienceOn
76 O'Cass, A. and Fenech, T., "Web retailing adoption: exploring the nature of internet users Web retailing behaviour," Journal of Retailing and Consumer Services, Vol. 10, 2003, pp. 81-94   DOI   ScienceOn
77 Davis, F.D., Bagozzi, R.P., and Warshaw, P.R., "Extrinsic and Intrinsic Motivation to Use Computers in the Workplace," Journal of Applied Social Psychology, Vol. 22, No. 14, 1992, pp. 1111-1132   DOI
78 Fu, Jen-Ruei., Cheng-Kiang Farn and Wen-Pin Chao, "Acceptance of electronic tax filing: A study of taxpayer intentions," Information and Management, Vol. 43, No. 1, 2006, pp. 109-126   DOI   ScienceOn
79 James J. Jiang, Gary Klein, Richard Discenza, "Perception differences of software success: provider and user views of system metrics," The Journal of Systems and Software, Vol. 63, 2002, pp. 17-27   DOI   ScienceOn
80 Agarwal, R. and Prasad, J., "The role of innovation characteristics and perceived voluntariness in the acceptance of information technologies," Decision Sciences, Vol. 28, No. 3, 1997, pp. 557-582   DOI   ScienceOn
81 Stewart, T., "The status of Communication Today," Strategic Communication Management, Vol. 3, No. 2, 1999, pp. 21-25