Browse > Article

Development of the Performance Measurement Model of Electronic Medical Record System - Focused on Balanced Score Card -  

Lee, Kyung Hee (Seoul Medical Center)
Kim, Young Hoon (Dept. of Healthcare Management, Graduate School, Eulji University)
Boo, Yoo Kyung (Dept. of Healthcare Management, Graduate School, Eulji University)
Publication Information
Korea Journal of Hospital Management / v.21, no.4, 2016 , pp. 1-12 More about this Journal
Abstract
The purpose of this study are suggest to performance measurement model of Electronic Medical Record(EMR) and Key Performance Index(KPI). For data collection, 665 questionnaires were distributed to medical record administrators and insurance reviewers at 31 hospitals, and 580 questionnaires were collected(collection rate: 87.2%). Regarding methodology, Critical Success Factor(CSF) and index of the information system were derived based on previous studies, and these were set as performance measurement factors of EMR system. The performance measurement factors were constructed by perspective using BSC, and analysis on causal relationship between factors was conducted. A model of causal relationship was established, and performance measurement model of EMR system was proposed through model validation. Analysis on causal relationship between performance management factors revealed that utility cognition of the learning & growth perspective factor had causal relationship with job efficiency(${\beta}=0.20$) and decision support(${\beta}=0.66$) of the internal process perspective factors, and security had causal relationship with system satisfaction(${\beta}=0.31$) of the customer perspective factor. System quality had causal relationship with job efficiency(${\beta}=0.66$) and decision support(${\beta}=0.76$) of the internal process perspective factors, all of which were statistically significant(P<0.01). Job efficiency of the internal process perspective had causal relationship with system satisfaction(${\beta}=0.43$), and decision support had causal relationship with decision support satisfaction(${\beta}=0.91$) and job satisfaction (${\beta}=0.74$), all of which were statistically significant(P<0.01). System satisfaction of the customer perspective had causal relationship with job satisfaction(${\beta}=0.12$), job satisfaction had causal relationship with cost reduction(${\beta}=0.53$) of the financial perspective, and decision support satisfaction had causal relationship with productivity improvement(${\beta}=0.40$)of the financial perspective(P<0.01). Also, cost reduction of the financial perspective had causal relationship with productivity improvement(${\beta}=0.37$), all which were statistically significant(P<0.05). Suitability index verification of the performance measurement model whose causal relationship was found to be statistically significant revealed that $X^2/df=2.875$, RMR=0.036, GFI=0.831, AGFI=0.810, CFI=0.887, NFI=0.838, IFI=0.888, RMSEA=0.057, PNFI=0.781, and PCFI=0.827, all of which were in suitable levels. In conclusion, the performance measurement indices of EMR system include utility cognition, security, and system quality of the learning & growth perspective, decision support and job efficiency of the internal process perspective, system satisfaction, decision support satisfaction, and job satisfaction of the customer perspective, and productivity improvement and cost reduction of the financial perspective. In this study, it is expected that the performance measurement indices and model of EMR system which are suggested by the author, will be a measurement tool available for system performance measurement of EMR system in medical institutions.
Keywords
Electronic Medical Record(EMR); Balanced Score Card(BSC); Key Performance Index(KPI); Performance measurement model;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Kim TS. A Study on Hospital Information Systems Influenced by the Characteristics of Organizations and Information Systems, Daehan Academy of Management Information Systems 2006;19:105-128.
2 Lee J, Shin T, Lim J. A PLS Path Modeling Approach on the Cause-and-Effect Relationships among BSC Critical Success Factors for IT Organizations. The Korea Society of Management Information Systems 2007;17(4):208-227.
3 Choi KS. The End-User Toward Explorative /Exploitive Use and End-User Performance in Hospital Information System [dissertation]. Department of Management Information Systems Graduate School of Chosun University 2013.
4 William H. DeLone and Ephraim R. McLean. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. In: International Journal of Electronic Commerce 2003;19(4):9-30.
5 I-Chiu Chang, Yi-Chang Li. Electonic medical record quality and its impact on user satisfaction-Healthcare provider's point of view. In: Journal of Government Information Quargerly 2012;29:235-242.   DOI
6 Jack J. Baroudi and Wanda J. Orlikowski. Ashort form measure of user information satisfaction. In: Journal of MIS 1987.
7 Boonchai Kijsanayotin, Supasit Pannarrunothai, Stuart M. Speedie. Factors influencing health information technology adoption in Thailand's community health centers: Applying the UTAUT model. In: nternational journal of informations, 2008;7(8):404-416.
8 Stacie Petter, William Delone, Ephraim McLean. Measuring information system success: models, dimensions, measures, and interrelationships. European journal of information systems 2008; 17:236-263.   DOI
9 Jeffrey S. McCullough, Michelle Casey. The Effect of Health Information Technology on Quality in U.S Hospital. In: Health Affairs 2010;29(4).
10 Peter A. Salzarulo, Kurt M. Bretthauer. The impact of variablilty and Patient Information on Health Care System Performance. In: Production and operations management 2011;20(6): 848-859.   DOI
11 Carrie Anna McGinn, Sonya Grenier, Julie Duplante, Nicola Show, Claude Sicotte, Luc Mathieu et al. Comparison of user groups' perspectives of barriers and facilitators to implementing electronic health records: a systematic review. In: BMC Medicine 2011;9:46.   DOI
12 Indah Mohd Amin, Surya Sumarni Hussein. Assessing user satisfaction of using hospital information system in malaysia. International Conference on Social Science and Humanity 2011;l(5).
13 Mark Thouin, James J. Hoffman. The Effect of Information technology investment on firm-level performance in the health care industry. In: Health Care Management Review 2008;33(1): 60-69.   DOI
14 F.Bravi, D.Gibertoni, A. Marcon, C. Sicotte, E. Minvielle, P. Rucci. Hospital network performance: A survey of hospital starkholders' perspectives. In: Journal of Health Policy 2012.
15 Eiman AI-Jafar. Exploring Patient Satisfaction Before and After Electronic Health Record Implementation: The Kuwait Experience. In: Journal of Health Information Management 2013;1(12).
16 Xiaodong Deng, William J.Doll, Anthony R. Hendrickson, Joseph A.Scazzero. A multi-group analysis of structural invariance: an illustration using the technology acceptance model. In: Information & Management 2005;42:745-759.   DOI
17 Vincent S. Lai, Honglei Li. Technology acceptance model for internet banking: an invariance analysis. Information & Management 2005;42:373-386.   DOI
18 Raafat Saade, Bouchaib Bahli. The impact of cognitive absorption on perceived usefulness and perceived ease of use in on-line learning: an extention of the technology acceptance model. In: Information & Management 2005;42:317-327.   DOI
19 Girosi, F., Fonkych,K., Bigelow, J. Technical Executive Summary in Support of "Can Electronic Medical Record Systems Transform Healthcare?" and "Promoting Health Information Technology". RAND Health 2005.
20 Neil S. Fleming. Exploring Financial and Non-Financial Costs and Benefits of Health Informaion Technology. In: The agency healthcare Research and Qualit 2009;9.
21 Troy R. Mills. Electronic Medical Record Systems in Critical Access Hospitals. Perspectives in Health Information Management 2010.
22 Van Gembergen. Measuring and improving corporate information technology through the balanced scored. In: UFSIA 2000.
23 Pankaj Setia, Monika Setia, Ranjani Krishnan. The Effects of the Assimilation and Use of IT Applications on Financial Performance in Healthcare Organizations 2011;12:274-298.
24 Steven R. Eastaugh. Health informartion technology Impact on Productivity. J Health Care Finance 2012;39(2):64-81.
25 Maris Martinsons, Robert Davison, Dennis Tse. The balanced scorecard: a foundation for the strategic mansgement of information systems. In: Decision Support Systems 1999;25:71-88.   DOI
26 Wim Van Grembergen, The Balanced Scored and IT Governance, In: Journal of Past issue 2000;2.
27 Chae. YM, Gwak EA. Management Issues for Hosptal Information Systems in Korea. Healthcare Informatics Research 2005;NOv(4):323-336.
28 Kathleen E. Voelker, Jonathon S. Rakich, and G. Richard F. The Balanced Scorecard in Healthcare Organizations: A performance Measurement and Strategic Planning Methodology. In: Research and Perspectives on Healthcare 2001;79(3).
29 William N. Zelman, George H.Pink, and Catherine B.Matthias. Use of the Balanced Scorecard in Health Care. In: Journal of health Care Finance 2003;29(4).
30 Kim. S. Economic analysis of hospital information system by information economics approach. Seoul: Yonsei University 2010.
31 Noh MJ, Kim DY, An Effect of the Innovative Characteristics of the Electronic Medical Record on the Satisfaction, Trust, and Loyalty. Korea Association of Business Eduacation 2012;27(4): 87-109.
32 David F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 1989;13(3):319-339.   DOI
33 Park CS, Lee HW, Go SH. A Case Study on the Hospital Information Systems Usability. Information systems review 2008;10(3):289-311.
34 Chae. YM, Parkk CB, Kang SH, Kim HS, Kim HH. Performance evaluation of information system for tertiary University Hospital. Healthcare Informatics Research 2011.
35 Lee KA, Lee JH. A Study on the Value of Web Sites: With a Modified Technology Acceptance Model. Information System Review 2001;3(1).
36 Im HJ, Sim JT, Lee SS. The Study on Impact of Introduction Characteristics Factor of EMR System on Perceived Usefulness and Ease of Use and Behavioral Intention to Use. Journal of the Korea industrial information systems society 2009; 14(2).
37 Lee DH. Analysis and Design of Appropriate Hospital Affair Process on HIS, Korea Knowledge information Technology society 2008;8.