• Journal of Information Technology Services
• /
• v.20 no.1
• /
• pp.11-27
• /
• 2021

The defense IT master plan is the plan for promoting defense informatization and is established by the Ministry of National Defense every five years. In addition, an implementation plan has been established in accordance with the master plan every year to promote the informatization project. However, since there is no systematic methodology to check and analyze the master plan comprehensively, it is difficult to judge whether the goals suggested in the master plan are achieved, and continuous monitoring of the project is limited. This study proposes a concept and framework for defense IT investment management and proposes a methodology for examining and analyzing the progress of the defense IT plan by referring to the U.S. Department of Defense's IT Plan and the performance management structure of the national IT master plan. As a methodology for managing defense IT investment, we propose an IT investment management code system from the perspective of an IT portfolio and verify its applicability through case studies. The results of this study are expected to improve the defense IT performance management system and improve the efficiency and effectiveness of the defense IT project.

• Journal of the Korea Society of Computer and Information
• /
• v.9 no.1
• /
• pp.111-121
• /
• 2004

This paper presents the methods of evaluating validity and effectiveness of informatization budget investment for e-Government, through the preliminary evaluation. the progress evaluation and the Post evaluation of the investment, and a quantitative evaluation model which improves conformance of IT ROI (Return On Investment) using the evaluation results. the right evaluation targets of informatization investment for the development project to GDOC(Government electronic Document Distribution Center), and KPIs(Key Performance Indexes) which is enable to evaluate objectively effectiveness in the preliminary and the post evaluation phases are developed, and according to using the quantitative evaluation model . improved effectiveness evaluation results for each index in the point of view of usage and innovation are come out.

• Information Systems Review
• /
• v.8 no.3
• /
• pp.225-243
• /
• 2006

Recently mother company-driven informatization projects have been widely launched for the suppliers. Setting up a proprietary evaluation system for the level of informatization of the suppliers, a mother company provides both financial and consulting supports for the suppliers in order to enhance the utilization level of the ERP(Enterprise Resource Planning) system. With the utilization level enhanced, the whole collaboration network will create a competitive advantage to win over global competition. This paper investigates critical success factors for ERP operational performances through a Samsung Electronics case study. The result of the case study may provide valuable feedback to the strategic decision making and fundamental insights for these collaboration efforts.

• Journal of Information Technology Services
• /
• v.11 no.1
• /
• pp.109-123
• /
• 2012

There are many evaluation models to measure the informatization level of an organization and information system project in the ministry of National Defense of Korea. A information system has to keep up with the environment change as well as the advanced recent information technology (IT). Therefore, the evaluation of an information system project to enhance the performance of the information system should be different from the existing evaluation methods. This study suggests an evaluation case of information system projects to enhance the performance of an information system. In order to achieve the objective of this study, the following steps are taken. First, it reviews the background and the scope of the project to enhance the performance of the Defense Material Information System (DMIS). And it sets up the evaluation logic and develops performance indexes. Then it applies these newly developed performance indexes to the information system project and measures the performance. From this study, we found that both the diffusion and the experience accumulation by its continuous use are significant factors in such evaluations.

• Journal of Information Technology Applications and Management
• /
• v.16 no.4
• /
• pp.205-222
• /
• 2009

Considering time-lag in the performance evaluation of information system (IS) investment is important because its effect reveals after certain period of time passed. Particularly it is more in the systems of e-government informatization projects which the amount of investment and the scale of business are huge. Many methods to solve this issue have been proposed such as system dynamics methods, simulations, structural equations etc. However, it is still difficult and unsolved problem because collecting practical data for time-lag analysis is very hard. In this paper, we analyze IS time-lag effect through factor analysis using the accumulated practical operational DB data. For the performance evaluation of the G4C system, the representative e-government web portal, we selected eleven factors reflecting time passing in G4C DB data. With these factors this paper conduct time-lag analysis in four view points. First, we conducted 'Stabilizing of G4C system' and got a result that IS is needed about three years for the stabilization. Second, we conducted 'Utilization of G4C system' and got a result that the utilization reaches appropriate level after in three years later after the introduction of G4C system. Third, we conducted 'Cost reduction effect' and got a result that cost reduction is stable in the third year after the introduction of G4C system. Lastly, we conducted 'System maturity effect' and got a result that the system reaches to the quality level that users expect after third to fourth years. According to the results of this research, we found that performance of IS improv continuously not immediately, and it needs three or four years of time-lag.

• Information Systems Review
• /
• v.10 no.2
• /
• pp.269-289
• /
• 2008

It is very difficult problem to estimate and evaluate the performance of e-government system which scope and size are large and its effectiveness can not be seen shortly but reveals after several years. It is because the previous offline processes can not be transformed to online ones fully and shortly. For such e-transformation cases, the performance evaluation model should be adjusted and modified gradually as time passes. This paper propose new EEM(E-transformation Evaluation Model) model and methodology to evaluate G2B system that is one of large e-government project. EEM model can derive monetary value of e-transformatized business process areas(online areas). It also estimate the expected effect of offline area that is not yet transformed to online. EEM model consists of standard model, verification model and estimation model with some variables such as evaluation year, evaluation area and data type. By using survey data and database data together it can validate the correctness of the model and derive the effect of the system introduction. This paper also propose EEM evaluation methodology consisting of 5 stages and 10 sub processes to evaluate online and offline effect efficiently. To show the usefulness of this study, we evaluate the performance of Korea G2B system named KONEPS which is famous as a successful e-government case in the world by using the proposed model and methodology. The proposed model and methodology can be applied to different similar areas including e-government projects and large scale information system introduction in private sectors. This study can be also used for establishing appropriate policies about e-government project and informatization issues.

• 한국IT서비스학회:학술대회논문집
• /
• 2006.05a
• /
• pp.583-592
• /
• 2006

본 연구에서는 정보화지원사업에 대한 성과평가를 위해 도출된 각 평가항목의 측정지표들을 실제로 평가업무에 적용함에 있어서 그 사용의 용의성 및 신뢰성, 그리고 내용적인 적합성이 어느 정도 확보되어 있는지를 검증하는 일련의 부합성 분석절차를 개발${\cdot}$확립하였다.

• Knowledge Management Research
• /
• v.9 no.1
• /
• pp.117-128
• /
• 2008

It is very crucial to establishing an evaluation framework for anayzing the investment effects of IT asset such as knowledge managment systems. However, evaluation by quantitative measures, in spite of its usefulness and reliability, may have weakness in examining wide range of effects of the IT investment. Hence, the purpose of this paper is to propose a novel framework to evaluate the performance in terms of wider range of informatization effects. To do so, knowledge management concepts has been adopted in the evaluation method, and Impact Of Investment(IOI) has been suggested. IOI is used to derive Value Of Investment(VOI) and then ROI.

• Journal of Information Processing Systems
• /
• v.18 no.4
• /
• pp.500-509
• /
• 2022

With the rapid development of educational informatization, teaching methods become diversified characteristics, but a large number of information data restrict the evaluation on teaching subject and object in terms of the effect of English education. Therefore, this study adopts the concept of incremental learning and eigenvalue interval algorithm to improve the weighted decision tree, and builds an English education effect evaluation model based on association rules. According to the results, the average accuracy of information classification of the improved decision tree algorithm is 96.18%, the classification error rate can be as low as 0.02%, and the anti-fitting performance is good. The classification error rate between the improved decision tree algorithm and the original decision tree does not exceed 1%. The proposed educational evaluation method can effectively provide early warning of academic situation analysis, and improve the teachers' professional skills in an accelerated manner and perfect the education system.

• Informatization Policy
• /
• v.30 no.1
• /
• pp.23-40
• /
• 2023

Currently, the Ministry of Strategy and Finance operates performance evaluation of the IT projects of the central government. Recently, with the advent of the Digital New Deal and the Digital Platform Government, the budget for IT projects has significantly increased, leading to a higher level of interest in their performance. In this study, performance-related characteristics were selected through previous research, and an empirical analysis was conducted to examine whether there are actual differences in the performance of IT projects given respective characteristics. As a result of the analysis, new projects and others performed by departments or offices had a statistically significant positive effect on each final evaluation score. In contrast, IT support as well as fund-based projects had a statistically significant negative effect on each final evaluation score. This study suggests that when evaluating the performance of IT projects in the future, it is important to consider the unique characteristics of each project, as these may contribute to respective differences in performance.