• Journal of Multimedia Information System
• /
• v.6 no.4
• /
• pp.271-282
• /
• 2019

There is a description that you cannot manage what you do not measure. The Korea Ministry of National Defense (MND) is conducting evaluations in various fields to obtain meaningful effects from IT investments, and views that the evaluation of the defense informatization sector is divided into defense informatization policy evaluation and defense informatization project evaluation. The defense informatization level evaluation can measure the informatization level of MND and the armed forces or organizations. Since the evaluation system being studied to measure the level of defense informatization is composed mainly of qualitative metrics, it is necessary to reconstruct it based on quantitative metrics that can guarantee objectivity. In addition, for managing the level of change by evaluation objects, the evaluation system should be designed with a focus on homeostasis of metrics so that it can be measured periodically. Moreover, metrics need to be promoted in terms of performance against targets. To this end, this study proposes to measure the level of defense informatization by dividing it into defense information network, computer systems, interoperability and standardization, information security, information environment, and information system use, and suggests their metrics.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.32 no.1
• /
• pp.147-156
• /
• 2009

The introduction and application of IT(Information Technology) to a company has become to be viewed as a key factor for the business competitiveness and improved productivity. This study presents an approach to evaluation of a company's informatization level, which is especially appropriate for small and medium enterprises. The proposed evaluation method, based on the traditional questionnaire approaches, considers the various characteristics of the company, e.g., types of business, characteristics of customers, and locations of supply chains etc. A web-based system was developed to enable users to obtain the evaluation results from the evaluation method. The system also provides a function to produce valuable strategies for informatization by utilizing the case base which will be cumulated by repetitive evaluation requests. Finally, a real case was analyzed in order to verify the practicality of the evaluation system.

• Journal of Information Technology Services
• /
• v.18 no.2
• /
• pp.37-54
• /
• 2019

The purpose of this study is to present an evaluation model to measure the clarification level of stakeholder requirements of public sector software projects in the Republic of Korea. We tried to grasp the quality of proposal request through evaluation model. It also examines the impact of the level of stakeholder requirements on the level of system requirements. To do this, we analyzed existing research models and related standards related to business requirements and stakeholder requirements, and constructed evaluation models for the system operation concept documents in the ISO/IEC/IEEE 29148. The system operation concept document is a document prepared by organizing the requirements of stakeholders in the organization and sharing the intention of the organization. The evaluation model proposed in this study focuses on evaluating whether the contents related to the system operation concept are faithfully written in the request for proposal. The evaluation items consisted of three items: 'organization status', 'desired changes', and 'operational constraints'. The sample extracted 217 RFPs in the national procurement system. As a result of the analysis, the evaluation model proved to be valid and the internal consistency was maintained. The level of system operation concept was very low, and it was also found to affect the quality of system requirements. It is more important to clearly write stakeholders' requirements than the functional requirements. we propose a news classification methods for sentiment analysis that is effective for bankruptcy prediction model.

• Journal of Korean Society of Rural Planning
• /
• v.12 no.2 s.31
• /
• pp.65-73
• /
• 2006

This study attempts to develop an interim evaluation system for the Integrated Rural Village Cluster Development Project(IRVCDP) which can secure its identity and sustainability, and induce its early settlement, and to derive plans for its steady progress. The evaluation system consists of three levels. The highest-order level is evaluation purposes, which describe IRVCDP's goals. They are expansion of income bases(EIB), improvement of living environments(ILE), strengthening of regional capabilities(SRC) and constructing effective project operation system(CEPOS). The second level is evaluation items, which each characterize the relevant evaluation purposes. The last level is evaluation indices, which observe achievement f3r evaluation purposes. 22 evaluation indices are selected to satisfy the purposes of this study through a brainstorming process and a survey on opinions of experts for those evaluation purposes and evaluation items which are derived from analyzing the IRVCDP's properties. The relative importance of the evaluation indices selected are determined through the AHP analysis. The most intriguing result from the AHP analysis is that strengthening of regional capabilities is found to be the most important one among evaluation purposes. It can be said that this result is parallel to a ultimate goal of the IRVCDP.

• Journal of Fisheries and Marine Sciences Education
• /
• v.26 no.1
• /
• pp.81-97
• /
• 2014

The purpose of this study is to analyze the level of interest in the achievement evaluation system, under the assumption that the teacher is an important element of curriculum. For this study, surveys targeting the 150 middle school teachers from 6 schools in Pusan was conducted. A questionnaire based CBAM model was used as research tools. For data analysis, mean of relative strength by teacher's level of interest was calculated. And MANOVA was used to investigate the difference among level of interest according to teachers' background such as sex, age, career, job position, and the grade they taught. The results of the analysis are summarized as follows. First, the middle school teachers' overall interest for achievement evaluation system is low. Teachers showed a typical pattern appeared in the early stages of change. They have little interest in the achievement evaluation system. And they should try to fix and change the achievement evaluation system rather than cooperate it. Second, as a result of this analysis of the difference according to teachers' background, no significant differences were found in most of the variables. Significant differences were found only in age, career, and job position from step 0. In running the post hoc, teachers who have less careers, lower positions, and younger ages had less interest in achievement evaluation system.

• Journal of Applied Reliability
• /
• v.15 no.2
• /
• pp.108-123
• /
• 2015

Test and Evaluation (T&E) have been verifying the level of it's technological skill and the needed operational status of the development weapons. If the overall spectrum of test and evaluation is fulfilled substantially in the production & deployment, the needed level of the weapon system will be enhanced and also the reliability status will become higher considerably. We can know currently these issues through the mass media and all kinds of the news regarding the defense industry and programs. And so this article have studied the method of enhancing reliability of the test and evaluation, the 6 variables were selected through the discussion of the professional group. The the test and evaluation group needs consistently the professional training systems. After DT&E, we have to the event to verify the technical level of the development systems. We have to take the high level of the kinds of the environmental test. Scientific methods like system engineering will be adapted in process of the test and evaluation. The number of suitable test prototype in the test and evaluation is analysed more systematically. And we need to establish the standardization of the test and evaluation. If 6 variables are well analysed and adapted in the working field, the reliability of the test and evaluation will be considerably, the defense industry will take the chance to develope the future-oriented.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 2000.04a
• /
• pp.445-448
• /
• 2000

Researches about an evaluation system for military officers have been studied because it is one of the most important elements for managing units and improving combat power. This paper proposes an evaluation system that enhance justice of evaluation, accomplish a distintion among evaluating elements and improve synergy effects between higher level officers and lower level officers. The evaluation system in this study not only suggests evaluating items and methods but also determines the final evaluation ranking among the evaluated that have their own evaluation criteria, items and duties using the median rank method used in statistics.

• Journal of Institute of Control, Robotics and Systems
• /
• v.20 no.2
• /
• pp.112-119
• /
• 2014

A force support system is composed of capital components such as combat equipments, supplies and so on to enable constant fighting power capability. Private technology level evaluation is on the rise as an important spin-on method in force support systems, which requires 92% of total munitions requirements, to obtain superior private technology. The evaluation of the private sector technology level on Korean force support systems has been conducted for the first time as follows: this research chose 38 items to be acquired within 2-3 years and grouped either identical or similar technology among those 38 items. A technology evaluating method was established based on the analysis of domestic and foreign technology level evaluations. Evaluation was performed by a Delphi survey from 180 private and military experts. To obtain an objective index and raise political availability, a technology system map and standard document were developed and applied to all 38 items.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.209-217
• /
• 2023

In this study, the evaluation items related to the effectiveness evaluation of the LVC (Live, Virtual, Constructive) training system of the Air Force were derived and the weights of each item were analyzed. The LVC training system evaluation items for AHP (Analytic Hierarchy Process) analysis were divided into three layers, and according to the level, 3 items were derived at level 1, 11 items at level 2, and 33 items at level 3. For weight analysis of evaluation items, an AHP-based pairwise comparison questionnaire was conducted for Air Force experts related to the LVC training system. As a result of the survey, related items such as (1) Achievement of education and training goals (53.8%), (1.2) Large-scale mission and operational performance (25.5%), and (1.2.1) Teamwork among training participants (19.4%) was highly rated. Also, it was confirmed that the weights of evaluation items were not different for each expert group, that is, the priority for importance was evaluated in the same order between the policy department and the working department. Through these analysis results, it will be possible to use them as evaluation criteria for new LVC-related projects of the Air Force and selection of introduction systems.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.14 no.6
• /
• pp.1031-1036
• /
• 2011

In this paper, we have proposed a methodology which can test and evaluate on system level in development phase of command guided missile system. Test and evaluation play a significant role in the development of weapon system, providing the means for determining to what extent the weapon system satisfies its requirements, whether it functions normally in the operational environment. In case of command guided missile having seeker, the missile communications link provides data to allow the missile to fly an efficient trajectory toward target. Therefore, it is very important to test and evaluate for data link between missile and radar on whole system aspect. we introduce the concept and devices for system level test and evaluation of command guided missile system.