• 한국IT서비스학회지
• /
• 제6권1호
• /
• pp.101-126
• /
• 2007

This study aims to construct the integrative performance evaluation model of informatization programs. In order to achieve the purpose of research, first of all, the three major theoretical paradigms (technical/functional, economic/financial, and interpretive/alternative paradigms) are comparatively analyzed concerning their philosophical and methodological perspectives. Also, a number of important studies and research model in the area of IS (Information Systems) evaluation are critically reviewed. And then actual problems and limitations on the process of implementing IS performance evaluation are sought through investigating domestic and foreign practices. Based upon theoretical and practical review of informatization evaluation and logical reasoning, the components of ideal performance evaluation scheme for informatization program are derived, and the integrative performance evaluation model which can comprehensively represent the relationship among the components is conceptually proposed. For researchers, this study provides the theoretical basis for reasonably deriving the performance variables of informatization programs and empirically validating the performance of managing informatization programs. And in real world, the results of this study are very likely to contribute to presenting the practical guideline for desirably implementing performance evaluation of informatization programs.

• 한국전자거래학회지
• /
• 제25권2호
• /
• pp.29-48
• /
• 2020

정보화 분야는 상대적으로 투자 성과를 가시화하기 제한되는 특성을 가진 바, 정보화 추진 성과에 대한 보다 정량적이고 체계적인 검증 노력이 요구된다. 이에 정부에서는 정보화평가 제도를 지속적으로 확대하고 강화시켜왔으며, 국방부에서도 이러한 정부 기조에 맞추어 정보화평가 제도를 발전시켜왔다. 이러한 배경 하에 2011년 제정된 국방정보화법에서는 정책평가 제도를 통하여 국방정보화정책에 대한 시행 여부를 점검하고 그 성과를 관리하도록 명시하고 있다. 하지만 국방정보화 정책평가는 법제화 직후 한 차례 시범평가 실시 이후 시행되지 못하고 있어 제도의 정상적 운영과 더불어, 평가제도 개선 노력이 필요한 상태이다. 이에 본 연구에서는 국방정보화 정책평가 제도의 안착과 지속적인 발전을 위하여 '14~'28 국방정보화기본계획서상의 31개 정책에 대한 평가를 실시하였다. 이를 위해 국방정보화평가 수행을 위한 평가 제도를 개선하여 제반여건을 정비하였고, 현재 부재한 정책별 성과목표와 지표를 수립할 수 있도록 지원도구를 개발하였다. 그리고 평가단을 구성하여 정책별 평가를 수행하고, 정책평가 수행과정에서의 문제점과 시사점을 분석함으로써 국방정보화 정책평가제도의 실효성 제고를 위한 정책제언을 제시하였다. 본 연구의 정책평가 수행과정과 제시한 정책제언은 국방정보화 분야 뿐 아니라 공공분야 정보화 추진 정책에 대한 성과 관리 측면에서 유의미한 사례연구가 될 것으로 판단된다.

• Journal of Multimedia Information System
• /
• 제6권4호
• /
• pp.271-282
• /
• 2019

There is a description that you cannot manage what you do not measure. The Korea Ministry of National Defense (MND) is conducting evaluations in various fields to obtain meaningful effects from IT investments, and views that the evaluation of the defense informatization sector is divided into defense informatization policy evaluation and defense informatization project evaluation. The defense informatization level evaluation can measure the informatization level of MND and the armed forces or organizations. Since the evaluation system being studied to measure the level of defense informatization is composed mainly of qualitative metrics, it is necessary to reconstruct it based on quantitative metrics that can guarantee objectivity. In addition, for managing the level of change by evaluation objects, the evaluation system should be designed with a focus on homeostasis of metrics so that it can be measured periodically. Moreover, metrics need to be promoted in terms of performance against targets. To this end, this study proposes to measure the level of defense informatization by dividing it into defense information network, computer systems, interoperability and standardization, information security, information environment, and information system use, and suggests their metrics.

• Journal of Multimedia Information System
• /
• 제5권4호
• /
• pp.291-297
• /
• 2018

Performance measurement is not an easy task. However, it is necessary to measure the expected value of the informatization project to be invested, to help the successful progress of the informatization project, and to confirm the result of the informatization project. This study describes the evaluation systems of the defense informatization project in Korea used after the end of the informatization project (post-implementation evaluation stage). In the post-implementation evaluation stage of proposed system, the informatization project is evaluated in terms of performance achievement, project plan compliance, project management, and economic validity. For each element, this study suggests metrics and practical measurement method. With metrics and their method, it can be evaluated which project is better than others. Moreover, the lessons learned can be developed. Under scarce budget condition, defense organizations can make better performance from IT project with the evaluation system suggested in this study.

• Journal of Multimedia Information System
• /
• 제7권1호
• /
• pp.73-86
• /
• 2020

The well-known sentence, "You can't manage what you don't measure" suggests the importance of measurement. The Ministry of National Defense (MND) in Korea is measuring the effort of informatization for various dimensions such as validity, adequacy, and effectiveness using the MND evaluation system to obtain positive and significant effects from informatization. MND views the defense informatization domain as divided into the defense informatization policy, the defense informatization project, and the defense informatization level, which can measure the informatization capability of the MND and the armed forces or organizations. Furthermore, it feels there is some limitation, such as those related to ambiguity and reliability, present in the system. To overcome the limitations in the existing system to evaluate the defense informatization policy, this study proposes a revised evaluation framework for the policy of defense informatization, its indicators, and measurement methods.

• 한국인터넷방송통신학회논문지
• /
• 제21권2호
• /
• pp.157-167
• /
• 2021

정보기술의 중요성에도 불구하고 정보화 성과 관리 연구와 성과 관리 방법은 매우 미흡하다. 본 논문에서는 협업과 공정상의 복잡도가 높은 조선해양산업의 특성을 반영한 전사적 정보화 성과 평가 및 관리 모형인 SSU-ITPM 모형을 제시하였다. 본 모형은 정보화 기획 및 사업관리, 정보화 현업 활용 평가, 정보화 활용 품질 평가, 정보화 사용자 만족도 평가, 정보화 효과 달성 평가로 구성하였다. 또한 D사 적용 사례를 통해 해당 모형의 실무적 활용 타당성을 확인하였다. 본 연구는 조선해양 분야와 같은 ETO 플랜트 기반 기업의 정보화 성과관리에 실무적 참조 모형을 제공할 것으로 사료된다.

• 산업공학
• /
• 제14권4호
• /
• pp.421-428
• /
• 2001

The economic effects of informatization are differently occurred according to industry types. Thus an evaluation methodology which reflects the industry type characteristics of informatization is needed. In this paper, we develop and analyze the indices for evaluating economic effects through informatization according to industry types, such as manufacturing, construction, financial services and marketing services. The factors related to performance of enterprise informatization can be defined as cost factors, effect factors, risk factors and influence factors. Effect factors are defined as quantitative or qualitative performance of informatization and classified into operational effect factors and strategic effect factors. The influence factor is defined as characteristics of informatization for industry types, that is, value chain of business and business products or services. Economic effect indices are classified according to the activity of business value chain. Economic effects indices of this research can be expected to play a role of general and standardized factors for economic evaluation of industry informatization.

• 한국IT서비스학회지
• /
• 제14권4호
• /
• pp.105-120
• /
• 2015

Enterprise should determine the adoption and utilization of information systems would be a great help to increase management performance. So, it maintains continually the budget and the investment for informatization. However, there is a limit to clarify whether the investment in informatization is contributed to create business opportunities through corporate competitiveness certainty or not. We tend to recognize the information system as a simple means to support common business rather than being used to achieve the company's business performance and to remain competitive. It is not an easy problem for the quantitative evaluation and analysis on the effect of intangible, such as management performance measurement by introducing computerization project. Informatization level evaluation model for the harsh business environment, specifically the Small and Medium Enterprise is lacking. In this paper, we proposed the audit evaluation model of an Small and Medium Enterprise informatization level based on system quality, information quality, user satisfaction, and IT business contribution. The proposed audit evaluation model was evaluated in the information system users, and verified the suitability throughout the survey of the audit professionals.

• Journal of Information Technology Applications and Management
• /
• 제13권3호
• /
• pp.145-179
• /
• 2006

The measurement of informatization program effectiveness continues to be a central concern of both academics and practitioners. However, most studies of it have been inclined too heavily toward testing validity and reliability of evaluation measure to strengthen the theoretical rigor. Drawbacks of this approach have been pointed out as being unsuitable for evaluating the effectiveness of informatization program due to lack of practical relevance. The paper comprises four sections to solve the problem. 1) Through literature review of theoretical conceptual models in IS effectiveness and the domestic and foreign cases on informatization program, we establish the evaluation framework which consists of evaluation phases, 6 evaluation areas, and 22 evaluation items, and developed evaluation measures of each items. 2) Different researchers have addressed different aspects of attribute of measure. With comparing them to each other, 3 mutually exclusive criteria on coincidence analysis(usability of measurement. reliability of measurement. and validity of content) are identified. 3) Data are gathered from respondents in informatizaiton program-related organizations such as policy agency, management agency, support agency, and recipient agency. 4) The degree of coincidence of each evaluation measure are analyzed by course of an coincidence analysis procedure, which includes the reliability test, arithmetical test, and criteria validity test. The academic implication of this study is that researchers can gain an insight into the coincidence analysis to approach the problem of deciding on an indicator of performance for informatization program. There is also practical implication for applying the potential means of improving the practical relevance of conducting evaluating the informatization program.

• 디지털융복합연구
• /
• 제2권1호
• /
• pp.127-143
• /
• 2004

Small and Medium Enterprises(SME's) Informatization is the essential element for the competitive advantage. But SME's lack of IS specialist, Informatization Mind, IS implementation's funds etc. This study suggest Framework and Key Performance Indicator(KPI) which is will be able to diagnose a BPR & Information system of SME's Informatization and developed A Web-based Evaluation System for BPR & Information Systemsn(WESBI). WESBI help efficiently SME's Informatization implementation and WESBI' data which is accumulated provide guideline in the policy development a SME's Informatization.