• Journal of Information Technology Services
• /
• v.18 no.2
• /
• pp.37-54
• /
• 2019

The purpose of this study is to present an evaluation model to measure the clarification level of stakeholder requirements of public sector software projects in the Republic of Korea. We tried to grasp the quality of proposal request through evaluation model. It also examines the impact of the level of stakeholder requirements on the level of system requirements. To do this, we analyzed existing research models and related standards related to business requirements and stakeholder requirements, and constructed evaluation models for the system operation concept documents in the ISO/IEC/IEEE 29148. The system operation concept document is a document prepared by organizing the requirements of stakeholders in the organization and sharing the intention of the organization. The evaluation model proposed in this study focuses on evaluating whether the contents related to the system operation concept are faithfully written in the request for proposal. The evaluation items consisted of three items: 'organization status', 'desired changes', and 'operational constraints'. The sample extracted 217 RFPs in the national procurement system. As a result of the analysis, the evaluation model proved to be valid and the internal consistency was maintained. The level of system operation concept was very low, and it was also found to affect the quality of system requirements. It is more important to clearly write stakeholders' requirements than the functional requirements. we propose a news classification methods for sentiment analysis that is effective for bankruptcy prediction model.

• Journal of Information Technology Services
• /
• v.6 no.1
• /
• pp.65-81
• /
• 2007

Recently, the affiliates of the Ministry of Information and Communication have been conducting a performance evaluation study on IT policy projects, based on the performance evaluation model of the U.S. Office of Management and Budgets, with regard to investment in computerization. The performance evaluation model for the policy project could provide the objective information required for the planning, development, and operation of the policy project. However, the performance of the most policy project is likely to be evaluated using the subjective evaluation criteria of evaluators. Therefore, this case study evaluates the relative efficiency using DEA (Data Envelopment Analysis) in order to improve the performance evaluation method of the digital pioneer' project implemented by the Korea IT Industry Promotion Agency. The improvement value of inefficient Decision Making Units (DMUs) was measured by a static efficiency analysis. The measured value will suggest a objective viewpoint of the performance between DMUs to evaluators. In doing so, it will show an appropriate direction for the policy project to be evaluated successfully.

• Journal of Information Technology Services
• /
• v.12 no.3
• /
• pp.405-420
• /
• 2013

The purpose of this paper is to develop an evaluation model for e-government system in Korea which is one of world best practices of e-government systems. We have presented a method to perform an efficiency analysis of each e-government service which in a component of e-government system in Korea and to establish a benchmark target for each e-government service. To do this, the output-oriented DEA(Data Envelopment Analysis) CCR model was performed for the selected 12 e-government public services of Korean e-government system in this paper. As a result of DEA analysis, first the internet civil appeal support service, the employment comprehensive information service, and the company support information service were evaluated as the efficient solutions among the 12 e-government public services. Second the remaining 9 e-government public services were evaluated as the inefficient information services which should be improved in terms of their service levels. Finally the benchmark targets for the inefficient e-government services were suggested to improve those inefficient systems through DEA analysis.

• Journal of Information Technology Services
• /
• v.12 no.2
• /
• pp.373-386
• /
• 2013

The purpose of this research is to develop a model for efficient service R&D investment in government budgeting process. It is necessary to develop an efficient and effective investment model to improve competitiveness of the service industry and national economy. Various existing types of service R&D classification have been reviewed. And object-oriented service R&D request classification types have been derived. A tentative model for evaluating service R&D requests have been developed through extensive discussions on effective methodologies. The model has been refined and revised by four service budgeting experts. The revised and refined checklists and guidelines have been used for 40 real service R&D requests evaluations. As a result, a full model for service R&D evaluation and budgeting has been proved to be useful. Also, a need for more efficient and concise evaluation model has been raised through this evaluation process. A brief model with only 10 checklists has been developed and its usefulness has been proven by pilot test with 10 real service R&D requests. The results of this study can be used for evaluation of service R&D proposals and effective budgeting of R&D requests for improving global competitiveness. Further research is needed for refining the developed evaluation models.

• Journal of Information Technology Services
• /
• v.14 no.2
• /
• pp.87-109
• /
• 2015

The IT outsourcing industry has been widespread for decades since the growth of the system integration industry stagnates and companies need to curtail expenses and improve the quality of IT services. According to previous studies on the success factors of the IT outsourcing, its transition phase is significant because of continuity of business and the handover of knowledge. Since a transition phase consists of several projects, but its goal is different from general projects, it needs special and professional management. Therefore, recent IT outsourcing business starts to introduce PMO (project management offices), of which success strongly depends on the competencies of the PMO. However, there are only few studies on which competencies of the PMO are important. In this paper, we suggest an evaluation model of transition PMO competencies derived using the repertory grid technique and the analytic hierarchy process. Additionally, we compare the differences between the views of several stakeholders on the importance of the competencies.

• Journal of Information Technology Services
• /
• v.16 no.1
• /
• pp.83-98
• /
• 2017

Broadcasting telecommunication convergence service means a service where broadcasting and telecommunication converge. Recently with the advancement of technology, broadcasting telecommunication convergence service has been evolving to provide multimedia contents through various devices including wired and wireless network environment. Up to now, IPTV and smartphone-based convergence services have been dominant, but more developed and evolved technology and media will appear in the future. In order to derive the next generation broadcasting telecommunication convergence service supporting model, this study derives an evaluation model of broadcasting telecommunication convergence service and presents a case of evaluation of 30 demonstration projects supported by the Korean government from 2010 to 2014. In this study, we derive an evaluation model and evaluate the demonstration projects by reflecting the position of the main stake holders of service such as users, experts, and related organizational institutions, away from the existing simple service evaluation method. Expert questionnaire used AHP (Analytic Hierarchy Process) method, and the evaluation results were divided into upper and lower groups to provide key implications by a gap analysis. From this analysis this study suggests guidelines for next generation broadcasting telecommunication service support projects. The next generation broadcasting convergence service business should be based on open platform type in terms of service type. In terms of service media, it should be centered on open devices such as smart phones and smart TVs. In terms of types of business responsibilities, it should be led by public organizations and it is necessary to increase the fund matching ratio by at least 62% when the private sector participates.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.24 no.3
• /
• pp.13-26
• /
• 1999

Recently, information technology and information system(IS) are rapidly diffused throughout the world. In the global competitive environment, the success of IS becomes the important one among the critical success factors(CSF) of the firm. For achieving it, the firm must continually involve itself in the quality evaluation and improvement of IS. The quality concept was changed into the customer-oriented quality one. There is no exception to the quality of IS. In the past, IS quality was determined by the IS developer or IS department offering service. Now it is evaluated by the user of IS service, and then the customer-oriented user satisfaction becomes an important issue. The purpose of this study is to develope the total quality evaluation model of IS through TQM approach. First, all success factors of the domestic IS are extracted from the foreign and domestic literatures of IS success factors contained the technical and behavioral aspects. And the extracted factors are classified with evaluation levels for quality evaluation and developed into a total quality evaluation model. Finally the model usefulness is analyzed.

• Journal of Information Technology Services
• /
• v.12 no.4
• /
• pp.77-90
• /
• 2013

As Cyber threats are rising, the scope of information Security (IS) is extending from technical protection of a single information system to organizational comprehensive IS capability. The ministry of National Defense (MND) has established the IS evaluation for defense organization in 'the Directive for Defense Informatization Affairs.' However, no information about an evaluation method, process and organization is provided. We surveyed information security management system (ISMS) and related best practices in public sector and other countries, and analysed the military information security affairs. Thus, this paper recommends the IS evaluation method and process. The trial IS evaluation is in progress this year and the MND will expand this IS evaluation to the entire organization.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.1
• /
• pp.63-76
• /
• 2012

Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.

• Journal of Information Technology Services
• /
• v.10 no.3
• /
• pp.95-112
• /
• 2011

This paper proposes a new registry model for systematically referencing standards in e-Business field. We have many systems that provide standards and additional information. However, there are several problems such as inefficient standard information, dependency on a standard type, high standard information acquisition cost, no relations between standard information, and so on. In this paper, a new registry model and its prototype implementation are described. The proposed model is defined based on ISO/IEC 11179-Metadata registries, which is one of the international standards for interoperability between data. The proposed model provides an integrated- systematic standard information support, and also considers technology stack and business processes for e-Business systems. This paper develops a prototype for the proposed model and implementation result. Finally, to show the contribution of our proposal, this paper shows the comparative evaluation between previous systems and our proposal with various comparative items.