• Journal of Information Technology Applications and Management
• /
• v.15 no.1
• /
• pp.203-224
• /
• 2008

The purpose of this study is to investigate the evaluation perspectives of IT business value and empirically analyze the differences of evaluation perspectives between ex ante evaluation and post implementation evaluation, and among various information system types. 4 evaluation perspectives which have been used in the previous studies and in the field of industry practices are financial, customer, internal process, and growth, which are based on the BSC model. Data of 98 information systems have been collected from 89 companies including manufacturers, banks, insurances, and stock trading companies. As results of multi-way MANOVA test, 3 out of 8 hypothesis have been accepted statistically. While the order of importance of 4 perspectives in ex ante evaluation is customer, financial, internal process, and growth, the order of post implementation evaluation appears to be much different : that is, internal process, customer, financial, and growth. These findings provide insights for both IT practitioners and researchers.

• Journal of Korea Technology Innovation Society
• /
• v.8 no.3
• /
• pp.1087-1116
• /
• 2005

This research examines performance evaluatees' opinions regarding the institutional performance evaluation systems of Government S&T Research Institutes (GRI). Research methodology is as follows: first, four perspectives of Kaplan & Norton (1992) Balanced Scorecard Model are revised into six perspectives suitable to GRI's characteristics. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI evaluation groups to be compared under the same evaluation measures. Third, GRI's evaluatees are asked to allocate ideal weights on the performance measures. The evaluatees' weights are compared with the weights of current performance measures, and the characteristics of evaluatees' opinions about current performance evaluation systems are analyzed. Results are as follows; first, six perspectives for Korean GRIs are financial, long-term outcome, short-term outcome, strategic direction, project management, human resources perspectives. second, GRI evaluation systems put the most weights on the long- and short-term outcome perspectives and the least weights on the financial perspective. This result complies with theoretical model: in performance evaluation of GRIs, the customer perspective is the most important one while the financial perspective is the least important one. Third, evaluatees think that the long-term outcome perspective of the Basic-technology GRI group and the short-term outcome perspective of the Applied-technology GRI Group needs more weight. Fourth, it is found that the current systems have more weights on the project management and strategic direction perspectives than evaluatees think. The possible explanation of this result would be that since the measures of these perspectives are relatively easier to set up than those of other perspectives, the current systems contains larger number of measures and, accordingly more weights.

• Journal of Korea Society of Industrial Information Systems
• /
• v.11 no.2
• /
• pp.86-97
• /
• 2006

From the mid 1990's, the scale of IS had been growing, which resulted in increasing number of failure projects. As a result, the measurement of IS performance was a growing concern. Moreover, the need for research on the relation between IT investment and performance that isfd the concern of CEOs has been raised. In this study, the correlation between the IS functionality and investment was discovered based on the IS success model suggested by DeLone & McLean(1992), a business information system evaluation model by Lee Kuk Hie(1992), a balanced score card by Kaplan & Norton(1992). As a result of the LISREL analysis, the investment in the IS has a positive impact on the quality of both information systems and information. In turn, the quality of both information systems and information have a positive impact on the end-user satisfaction, the end-user satisfaction on the financial performance, customer satisfaction, and internal business processes. This study showed that sufficient investment in IS improved business performance

• Korea Journal of Hospital Management
• /
• v.21 no.4
• /
• pp.1-12
• /
• 2016

The purpose of this study are suggest to performance measurement model of Electronic Medical Record(EMR) and Key Performance Index(KPI). For data collection, 665 questionnaires were distributed to medical record administrators and insurance reviewers at 31 hospitals, and 580 questionnaires were collected(collection rate: 87.2%). Regarding methodology, Critical Success Factor(CSF) and index of the information system were derived based on previous studies, and these were set as performance measurement factors of EMR system. The performance measurement factors were constructed by perspective using BSC, and analysis on causal relationship between factors was conducted. A model of causal relationship was established, and performance measurement model of EMR system was proposed through model validation. Analysis on causal relationship between performance management factors revealed that utility cognition of the learning & growth perspective factor had causal relationship with job efficiency(${\beta}=0.20$) and decision support(${\beta}=0.66$) of the internal process perspective factors, and security had causal relationship with system satisfaction(${\beta}=0.31$) of the customer perspective factor. System quality had causal relationship with job efficiency(${\beta}=0.66$) and decision support(${\beta}=0.76$) of the internal process perspective factors, all of which were statistically significant(P<0.01). Job efficiency of the internal process perspective had causal relationship with system satisfaction(${\beta}=0.43$), and decision support had causal relationship with decision support satisfaction(${\beta}=0.91$) and job satisfaction (${\beta}=0.74$), all of which were statistically significant(P<0.01). System satisfaction of the customer perspective had causal relationship with job satisfaction(${\beta}=0.12$), job satisfaction had causal relationship with cost reduction(${\beta}=0.53$) of the financial perspective, and decision support satisfaction had causal relationship with productivity improvement(${\beta}=0.40$)of the financial perspective(P<0.01). Also, cost reduction of the financial perspective had causal relationship with productivity improvement(${\beta}=0.37$), all which were statistically significant(P<0.05). Suitability index verification of the performance measurement model whose causal relationship was found to be statistically significant revealed that $X^2/df=2.875$, RMR=0.036, GFI=0.831, AGFI=0.810, CFI=0.887, NFI=0.838, IFI=0.888, RMSEA=0.057, PNFI=0.781, and PCFI=0.827, all of which were in suitable levels. In conclusion, the performance measurement indices of EMR system include utility cognition, security, and system quality of the learning & growth perspective, decision support and job efficiency of the internal process perspective, system satisfaction, decision support satisfaction, and job satisfaction of the customer perspective, and productivity improvement and cost reduction of the financial perspective. In this study, it is expected that the performance measurement indices and model of EMR system which are suggested by the author, will be a measurement tool available for system performance measurement of EMR system in medical institutions.

• Information Systems Review
• /
• v.11 no.3
• /
• pp.63-82
• /
• 2009

In B2B e-Commerce(Business to Business Electronic Commerce) market, many companies use B2B e-Commerce Guarantee Service. Guarantee service raised the stability of collect debts for seller, and made purchase fund for buyer. The purpose of this study is development of KPI (Key Performance Index) for measuring performance and improving service quality. Through analysis for 'B2B e-Commerce Guarantee Intermediary Service based on RFID', the study developed KPI and made the case. The study suggests KPI of B2B e-Commerce Guarantee Intermediary Service based on RFID by IT BSC(Balanced Scorecard) model. The process of developing KPI is 4 phase. First phase is connection between service goal and KPI, second phase is make a KPI pool, third phase is development of standard for valuating and selecting index, the last phase is defining and applying of index. This study suggests the standard of measuring performance in B2B e-commerce Guarantee Service and guidelines on revitalization of service in B2B e-commerce industry and the other industry.

• IE interfaces
• /
• v.17 no.3
• /
• pp.338-348
• /
• 2004

OECD countries including Korea positively adopt performance-based budget systems which convert an input-centered system to an output-centered system to solve two baffling problems: public expense retrenchment and efficiency recovery of government management. Output management of IT project propelled in public sector becomes a prominent figure influenced by these keynote of policy. However, it is placed in difficult circumstances to develop a performance index and the methodology to cover characteristics of IT project, measuring the goal achievement of business and the customer contentment according to the phases of business progress. Existing studies of IT project accomplishment measurement have been fulfilled on the subject of business targeting on IT technology application, administrative information network business and national base of information network construction. Most of the studies have been executed using BSC or AHP to reflect synthetically business specifics of IT project from a methodological point of view. In this study, we propose a structural equation model (SEM) to develop a performance index which measures the outcome of IT project according to the phases of business progress, avoiding a simple presentation of project outcome or conceptual frame. The proposed SEM is applied to the survey results of "IT support project for Small and medium business". Based on the fitted model, we apply ACSI concept to develop an Information Technologization Success Index (ITSI). This index allows us comparison of several IT vendors as well as feedback information for further improvement.

• International Journal of Advanced Culture Technology
• /
• v.11 no.1
• /
• pp.171-180
• /
• 2023

This study is to develop a performance analysis model for SMEs.Based on similar performance indicators through previous studies, performance indicators for SMEs were rewritten.Through the Korean Journal Citation Index (KCI), 75 related data were classified and a comprehensive SME performance analysis model was developed.Performance analysis was divided into two axes and classified into tables.The horizontal axis is the spatial performance range, which is divided into three areas: performance management by department/function, integrated performance management for the entire organization, and governance performance management requiring policy feedback. The vertical axis is subdivided into short-term, mid-term, and long-term by time and growth stage, and is divided into three parts: technical performance according to technological input, economic performance as organizational performance, and social performance for policy utilization. Then, performance indicators were mapped to each column. As a result of the survey, 28% of technical performance was analyzed as a result of frequency analysis, and performance indicators were organized into five categories: IT, R&D, certification, patent, and innovation. Economic performance was divided into 29%, BSC, HRD, logistics, production quality management, financial support, asset management, etc. 6 categories, social performance 43%, ESG, marketing, export, policy support, consulting, cooperation, etc. 7 categories.Limitations of the study include the narrowness of the survey that derived only performance indicators despite being a meta-analysis, and the performance model was mapped and classified according to growth stage and support period.however Insufficiency of validity due to lack of evidence, performance indicators were developed, but there were limitations in utilization for practical use.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.2
• /
• pp.157-167
• /
• 2021

Despite the importance of information technology, research on information-oriented performance management and performance management methods are very insufficient. In this paper, the SSU-ITPM model, a company-wide informatization performance evaluation and management model that reflects the characteristics of the shipbuilding and marine industry with high cooperative and process complexity, was presented. This model consisted of informatization planning and project management, informatization field utilization evaluation, informatization utilization quality evaluation, informatization user satisfaction evaluation, and informatization effect achievement evaluation. In addition, through the application of Company D, the feasibility of practical application of the model was confirmed. This study is expected to provide a practical reference model for informatization performance management of ETO plant-based companies such as the shipbuilding and offshore sector.

• Journal of the military operations research society of Korea
• /
• v.2 no.1
• /
• pp.185-194
• /
• 1976

A terminal response time analysis for a general class of terminals-to-computer subsystem is presented in this paper. On the point of the front view, it should be considered for R.O.K. Military Defense to set up the communication network in order to facilitate for the currency of the information and the data communication system. The model used to study is based on the advanced data communications system in which terminals are connected to Terminal Control Units(TCU) that are in turn connected to local Front-End Processor(FEP). The line control procedures used to interface a TCU and an FEP may be half-duplex Binary Synchronous Communication(BSC), half-duplex Synchronous Data Link Control(SDLC), or full-duplex SLDC. This paper will contribute to facilitate the initial phase of system design and configuration for the Military Defense Communication Network System in future.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.25 no.3
• /
• pp.137-154
• /
• 2000

This paper suggests a balanced scorecard (BSC) framework for measuring and evaluating the performance of knowledge workers in professional service firms(PSFs) which are typical knowldege-based organizations. As a strategic learning system, the balanced scorecard allows business leaders to drive and modify their business strategies based on the balanced measurement of key performance indicators(KPIs), which are basically divided into four domains such as financial achievement, customer orientation, internal business process, and innovation and learning. Conducting a focused case study on performance evaluation of knowledge workers from a balanced viewpoint, we could evaluate their competency and potential in more comprehensive manner. We also employ the analytic hierarchy process (AHP) approach for derive relative weights of key performance indicators and link it to a spreadsheet model for rating the individual performance of knowledge workers in a systematic way.