• Journal of Information Technology Services
• /
• v.6 no.1
• /
• pp.65-81
• /
• 2007

Recently, the affiliates of the Ministry of Information and Communication have been conducting a performance evaluation study on IT policy projects, based on the performance evaluation model of the U.S. Office of Management and Budgets, with regard to investment in computerization. The performance evaluation model for the policy project could provide the objective information required for the planning, development, and operation of the policy project. However, the performance of the most policy project is likely to be evaluated using the subjective evaluation criteria of evaluators. Therefore, this case study evaluates the relative efficiency using DEA (Data Envelopment Analysis) in order to improve the performance evaluation method of the digital pioneer' project implemented by the Korea IT Industry Promotion Agency. The improvement value of inefficient Decision Making Units (DMUs) was measured by a static efficiency analysis. The measured value will suggest a objective viewpoint of the performance between DMUs to evaluators. In doing so, it will show an appropriate direction for the policy project to be evaluated successfully.

• Journal of Digital Convergence
• /
• v.9 no.6
• /
• pp.165-172
• /
• 2011

In this paper, we introduce an integrated performance evaluation model defined by the three indices (evaluation index for each evaluation stage, performance viewpoint, and performance type) and analyze the utilization and satisfaction of the seven public u-IT services implemented from 2008 to 2009 using the proposed model. From the performance results of the public u-IT services, it was found out that most of the research goals initially set by the public u-IT service support projects were satisfied. Furthermore, we suggest improvement directions and promotion strategies of future projects.

• Journal of KIISE:Computer Systems and Theory
• /
• v.34 no.7
• /
• pp.282-287
• /
• 2007

Information society is dramatically developing in the various areas of finance, trade, medical service, energy, and education using information system. Evaluation for risk analysis should be done before security management for information system and security risk analysis is the best method to safely prevent it from occurrence, solving weaknesses of information security service. In this paper, Modeling it did the evaluation-base CBD function it will be able to establish the evaluation plan of optimum. Evaluation-based CBD(case-based reasoning) functions manages a security risk analysis evaluation at project unit. it evaluate the evaluation instance for beginning of history degree of existing. It seeks the evaluation instance which is similar and Result security risk analysis evaluation of optimum about under using planning.

• The Journal of Society for e-Business Studies
• /
• v.14 no.2
• /
• pp.23-39
• /
• 2009

Increasing number of business and technology expansion has sparked a growing interest in IT service business evaluation. However, it is not an easy task to come up with a fair and objective evaluation of IT service business due to the difficulties involved in the definition performance assets (marketing, human resources etc.) and knowledge assets with respect to its industry. Several public organizations in Korea are developing a "standardized evaluation protocol" based on qualitative method. But the standard evaluation protocol does not provide suitable guidelines on how to construct and evaluate the key index of IT service business. The main objective of this study is in the development of a systematic approach for the evaluation of IT service business competitiveness by emphasizing the qualitative and quantitative index to be evaluated in the framework. Application of the developed framework and guideline format showed that the used of the framework in this study provided relatively more efficient evaluation results in IT service industry.

• Convergence Security Journal
• /
• v.6 no.4
• /
• pp.133-140
• /
• 2006

For the verification of the security level against a IT product development environment, we should analyze the vulnerability and the various threatening factors which exists in the IT product development environment. Also we need the evaluation criteria and tools for the evaluation and improvement of the level of information security. For that, we need evaluation indices and the standard it will be able to improve the evaluation methodology in the actual IT product development environment which will reach it will be able to apply must be researched. In this study, our aims are the development of verification tools for the security level of IT product development environment.

• Journal of Information Technology Services
• /
• v.7 no.3
• /
• pp.175-198
• /
• 2008

The wide spread of the Internet has become a momentum to promote informatization, and thus individuals, organizations, and government bodies are competitively participating in this kind of new wave. Informatization enables us not only to circulate and utilize information without any limitation but also to maximize users' benefits and convenience. On the other hand, it brings about negative effects-security incidents such as cyber terror, Internet fraud and technology leakage, etc. Evaluation on security level should precede over all the others in order to minimize damage by security incidents since it diagnoses current status on security as it is and can be used as a guideline for appropriate security management. In this study, evaluation domains, items and indicators of information security to evaluate information security are theoretically developed on the basis of critically reviewing the major existing research. And then the coincidence level(content validity, ease and reliability of evaluation) of each evaluation indicators are empirically analyzed through performing the field study of 83 information security experts.

• Journal of Multimedia Information System
• /
• v.5 no.4
• /
• pp.291-297
• /
• 2018

Performance measurement is not an easy task. However, it is necessary to measure the expected value of the informatization project to be invested, to help the successful progress of the informatization project, and to confirm the result of the informatization project. This study describes the evaluation systems of the defense informatization project in Korea used after the end of the informatization project (post-implementation evaluation stage). In the post-implementation evaluation stage of proposed system, the informatization project is evaluated in terms of performance achievement, project plan compliance, project management, and economic validity. For each element, this study suggests metrics and practical measurement method. With metrics and their method, it can be evaluated which project is better than others. Moreover, the lessons learned can be developed. Under scarce budget condition, defense organizations can make better performance from IT project with the evaluation system suggested in this study.

• Proceedings of the Technology Innovation Conference
• /
• 1999.12a
• /
• pp.216-239
• /
• 1999

Korean government has planned a large scale multidepartment-participated national R&D program to advance and improve her science and technology and the quality of life In the level of advanced(especially G-7) countries in the forthcoming 21st century. It is called as "Highly Advanced National projects" or "G7 projects", which was initiated in 1991 with 18 sub-programs to date. It has planned to be continued until 2001 with its total fund of 4, 591 billion Won, comprised of 2, 033 billion Won from the public sector and 2, 558 billion Won from the private sector. Evaluation activities, the country has carried out to date, for national R&D programs including HAN projects are focused mainly on the assessment of scientific and technological results to decide that a specific program should be continued, terminated, or modified. Thus, it is necessary for national R&D programs to be evaluated socioeconomically for the purpose of assessing the nationwide economic and social impact from the program. Socioeconomic evaluation would be told how and where the program contributed to the society, and what the socioeconomic impacts are resulted from the program. It would be useful for the means of (ⅰ) fulfillment of public accountability to legitimate the program and to reveal the expenditure of pubic fund, and (ⅱ) managemental and strategical learning to give information necessary to improve the making. program and policy decision making, The objectives of the study are to develop the methodology of modeling the socioeconomic evaluation, and build up the practical socioeconomic evaluation model of the HAN projects including scientific and technological effects. Since the HAN projects consists of 18 subprograms, it is difficult In evaluate all the subprograms simultaneously. Despite, each program is being performed under the category of HAN projects, so the common socioeconomic issues are existing, The followings are main results of the study. First, the hierarchical structure of the socioeconomic evaluation are constructed; Evaluation Perspective, Evaluation Bounds, and Evaluation Aspect. Second, based on the goals of the HAN projects, the evaluation perspectives are established as (ⅰ) the strengthening of industrial competitiveness, (ⅱ) the enhancement of national scientific and technological capability, (ⅲ) the improvement of quality of life. Third, the evaluation bounds for each evaluation objective are defined to specify the affected area. Finally, the evaluation aspects for each evaluation bounds are formulated containing essential elements describing the evaluation bounds.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.41 no.1
• /
• pp.1-10
• /
• 2018

Current evaluation practices for IT projects suffer from several problems, which include the difficulty of self-explanation for the evaluation results and the improperly scaled scoring system. This study aims to develop a methodology of opinion mining to extract key factors for the causal relationship analysis and to assess the feasibility of quantifying evaluation scores from text comments using opinion mining based on big data analysis. The research has been performed on the domain of publicly procured IT proposal evaluations, which are managed by the National Procurement Service. Around 10,000 sets of comments and evaluation scores have been gathered, most of which are in the form of digital data but some in paper documents. Thus, more refined form of text has been prepared using various tools. From them, keywords for factors and polarity indicators have been extracted, and experts on this domain have selected some of them as the key factors and indicators. Also, those keywords have been grouped into into dimensions. Causal relationship between keyword or dimension factors and evaluation scores were analyzed based on the two research models-a keyword-based model and a dimension-based model, using the correlation analysis and the regression analysis. The results show that keyword factors such as planning, strategy, technology and PM mostly affects the evaluation result and that the keywords are more appropriate forms of factors for causal relationship analysis than the dimensions. Also, it can be asserted from the analysis that evaluation scores can be composed or calculated from the unstructured text comments using opinion mining, when a comprehensive dictionary of polarity for Korean language can be provided. This study may contribute to the area of big data-based evaluation methodology and opinion mining for IT proposal evaluation, leading to a more reliable and effective IT proposal evaluation method.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 2008.10a
• /
• pp.487-491
• /
• 2008

An informatization is recognized as core factors to reinforce business competitiveness such as formation of a new business relation, prior occupation of the strategic superiority and being a step ahead from the purpose to improve only the whole efficiency of enterprise. But existed evaluation framework has focused on the visible aspect of all the conditions to create the input and output. In previous studies, it's hard to know that how IT affect business value creation. Therefore, this study presents the evaluation of IT structure and IT competency as drivers and inhibitors of informatization and suggests new IT evaluation framework which can estimate IT competency. The new IT Evaluation Framework was verified through survey with experts.