• Journal of Information Technology Services
• /
• v.6 no.1
• /
• pp.101-126
• /
• 2007

This study aims to construct the integrative performance evaluation model of informatization programs. In order to achieve the purpose of research, first of all, the three major theoretical paradigms (technical/functional, economic/financial, and interpretive/alternative paradigms) are comparatively analyzed concerning their philosophical and methodological perspectives. Also, a number of important studies and research model in the area of IS (Information Systems) evaluation are critically reviewed. And then actual problems and limitations on the process of implementing IS performance evaluation are sought through investigating domestic and foreign practices. Based upon theoretical and practical review of informatization evaluation and logical reasoning, the components of ideal performance evaluation scheme for informatization program are derived, and the integrative performance evaluation model which can comprehensively represent the relationship among the components is conceptually proposed. For researchers, this study provides the theoretical basis for reasonably deriving the performance variables of informatization programs and empirically validating the performance of managing informatization programs. And in real world, the results of this study are very likely to contribute to presenting the practical guideline for desirably implementing performance evaluation of informatization programs.

• The Journal of Society for e-Business Studies
• /
• v.25 no.2
• /
• pp.29-48
• /
• 2020

For the visualization of outcome is relatively limited in informatization filed especially, systematic and quantifiable performance management of IT projects and policies is needed. Thus, the government developed its informatization evaluation system and has reinforced it. And Ministry of National Defense (MND) continues to strive for the settlement of the informatization performance evaluation system as well. According to Defense Informatization Law which was legislated in 2011, informatization policies should be assessed annually through informatization policy evaluation system in terms of their enforcement and outcome. However, informatization policy evaluation has not carried out since its pilot enforcement just after the legislation of the law. Hence, we conducted informatization policy evaluation aimed at performance investigation of 31 policies in '14~'18 Defense Informatization Master Plan. We sophisticated the current informatization policy system and we provide guidelines and tools to support the development of performance goal and indicators for each of the policies. Then, the policies were assessed by the evaluation committee we organized for our study, and we analyzed the problems we tackled in the whole process of evaluation and provided proposals for effectiveness enhancement of defense informatization evaluation system. The proposals will be meaningful for performance management in defense informatization sector and in public informatization sector as well.

• Journal of Multimedia Information System
• /
• v.6 no.4
• /
• pp.271-282
• /
• 2019

There is a description that you cannot manage what you do not measure. The Korea Ministry of National Defense (MND) is conducting evaluations in various fields to obtain meaningful effects from IT investments, and views that the evaluation of the defense informatization sector is divided into defense informatization policy evaluation and defense informatization project evaluation. The defense informatization level evaluation can measure the informatization level of MND and the armed forces or organizations. Since the evaluation system being studied to measure the level of defense informatization is composed mainly of qualitative metrics, it is necessary to reconstruct it based on quantitative metrics that can guarantee objectivity. In addition, for managing the level of change by evaluation objects, the evaluation system should be designed with a focus on homeostasis of metrics so that it can be measured periodically. Moreover, metrics need to be promoted in terms of performance against targets. To this end, this study proposes to measure the level of defense informatization by dividing it into defense information network, computer systems, interoperability and standardization, information security, information environment, and information system use, and suggests their metrics.

• Journal of Multimedia Information System
• /
• v.5 no.4
• /
• pp.291-297
• /
• 2018

Performance measurement is not an easy task. However, it is necessary to measure the expected value of the informatization project to be invested, to help the successful progress of the informatization project, and to confirm the result of the informatization project. This study describes the evaluation systems of the defense informatization project in Korea used after the end of the informatization project (post-implementation evaluation stage). In the post-implementation evaluation stage of proposed system, the informatization project is evaluated in terms of performance achievement, project plan compliance, project management, and economic validity. For each element, this study suggests metrics and practical measurement method. With metrics and their method, it can be evaluated which project is better than others. Moreover, the lessons learned can be developed. Under scarce budget condition, defense organizations can make better performance from IT project with the evaluation system suggested in this study.

• Journal of Multimedia Information System
• /
• v.7 no.1
• /
• pp.73-86
• /
• 2020

The well-known sentence, "You can't manage what you don't measure" suggests the importance of measurement. The Ministry of National Defense (MND) in Korea is measuring the effort of informatization for various dimensions such as validity, adequacy, and effectiveness using the MND evaluation system to obtain positive and significant effects from informatization. MND views the defense informatization domain as divided into the defense informatization policy, the defense informatization project, and the defense informatization level, which can measure the informatization capability of the MND and the armed forces or organizations. Furthermore, it feels there is some limitation, such as those related to ambiguity and reliability, present in the system. To overcome the limitations in the existing system to evaluate the defense informatization policy, this study proposes a revised evaluation framework for the policy of defense informatization, its indicators, and measurement methods.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.2
• /
• pp.157-167
• /
• 2021

Despite the importance of information technology, research on information-oriented performance management and performance management methods are very insufficient. In this paper, the SSU-ITPM model, a company-wide informatization performance evaluation and management model that reflects the characteristics of the shipbuilding and marine industry with high cooperative and process complexity, was presented. This model consisted of informatization planning and project management, informatization field utilization evaluation, informatization utilization quality evaluation, informatization user satisfaction evaluation, and informatization effect achievement evaluation. In addition, through the application of Company D, the feasibility of practical application of the model was confirmed. This study is expected to provide a practical reference model for informatization performance management of ETO plant-based companies such as the shipbuilding and offshore sector.

• IE interfaces
• /
• v.14 no.4
• /
• pp.421-428
• /
• 2001

The economic effects of informatization are differently occurred according to industry types. Thus an evaluation methodology which reflects the industry type characteristics of informatization is needed. In this paper, we develop and analyze the indices for evaluating economic effects through informatization according to industry types, such as manufacturing, construction, financial services and marketing services. The factors related to performance of enterprise informatization can be defined as cost factors, effect factors, risk factors and influence factors. Effect factors are defined as quantitative or qualitative performance of informatization and classified into operational effect factors and strategic effect factors. The influence factor is defined as characteristics of informatization for industry types, that is, value chain of business and business products or services. Economic effect indices are classified according to the activity of business value chain. Economic effects indices of this research can be expected to play a role of general and standardized factors for economic evaluation of industry informatization.

• Journal of Information Technology Services
• /
• v.14 no.4
• /
• pp.105-120
• /
• 2015

Enterprise should determine the adoption and utilization of information systems would be a great help to increase management performance. So, it maintains continually the budget and the investment for informatization. However, there is a limit to clarify whether the investment in informatization is contributed to create business opportunities through corporate competitiveness certainty or not. We tend to recognize the information system as a simple means to support common business rather than being used to achieve the company's business performance and to remain competitive. It is not an easy problem for the quantitative evaluation and analysis on the effect of intangible, such as management performance measurement by introducing computerization project. Informatization level evaluation model for the harsh business environment, specifically the Small and Medium Enterprise is lacking. In this paper, we proposed the audit evaluation model of an Small and Medium Enterprise informatization level based on system quality, information quality, user satisfaction, and IT business contribution. The proposed audit evaluation model was evaluated in the information system users, and verified the suitability throughout the survey of the audit professionals.

• Journal of Information Technology Applications and Management
• /
• v.13 no.3
• /
• pp.145-179
• /
• 2006

The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

• Journal of Digital Convergence
• /
• v.2 no.1
• /
• pp.127-143
• /
• 2004

Small and Medium Enterprises(SME's) Informatization is the essential element for the competitive advantage. But SME's lack of IS specialist, Informatization Mind, IS implementation's funds etc. This study suggest Framework and Key Performance Indicator(KPI) which is will be able to diagnose a BPR & Information system of SME's Informatization and developed A Web-based Evaluation System for BPR & Information Systemsn(WESBI). WESBI help efficiently SME's Informatization implementation and WESBI' data which is accumulated provide guideline in the policy development a SME's Informatization.