• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 1999.04a
• /
• pp.414-414
• /
• 1999

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.46 no.4
• /
• pp.229-237
• /
• 2023

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.22 no.1
• /
• pp.106-123
• /
• 2019

Demand for performance analysis is increasing for efficient use of limited budgets such as improving investment efficiency and strategic budget allocation in accordance with the continuous increase demand of R&D budget for developing advanced weapon systems in the future battlefields. In accordance with the Act on the Performance Evaluation and Performance Management of the National R&D Projects established in March 2006, the performance analysis has been conducted for the systematic management and utilization of the R&D project performance. It was recognized as a project to achieve self-defense through strengthening the weapons system development capability, however, efficiency evaluation of Defense R&D projects was not much emphasized. Research on the efficiency analysis of defense R&D projects has been conducted in recent years, but most studies focused on corporate efficiency and productivity of defense companies. In this study, we analyzed the three-stage performance of defence R&D projects based on the logical model using the data envelope analysis(DEA) model. We also analyzed performance analysis from various perspectives through R&D type, technology classification and performance model. This study is expected to help defense department improve defense R&D projects and make decision.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.45 no.3
• /
• pp.31-39
• /
• 2022

The Army, Navy, and Air Force are currently making various efforts to apply defense IoT technology by reflecting the characteristics of each military. However, there are concerns that comprehensive collection, management, and analysis may be limited because each military has no overlapping system or guaranteed interoperability of data, and there are inefficient aspects in terms of using and investing a limited defense budget. In this study, evaluation items and priorities for pilot projects were selected by applying Delphi technique and AHP method to determine which projects are preferentially effective when commonly applied in terms of Army, Navy, and Air force. As a result of the analysis, the project basis and driving force, project feasibility, performance and ripple effect, redundancy and connection were identified in the order of IoT-based small detachment units and unmanned base construction, intelligent smart unit, smart ground ammunition depot, and smart training management system. According to the comprehensive results reflecting the weights of each evaluation item, the fact that small detachment units and unmanned base construction project are recognized as the first project to be applied to the Army, Navy, and Air Force is a valid approach to be effective while each military is burdened with personnel management because of the reduction of manpower. Through the research results, it is expected that the direction of application to the policy of the defense IoT project can be confirmed in terms of efficient use of limited budgets.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.3
• /
• pp.299-308
• /
• 2009

In this paper, we have developed an evaluation model of technology green index(TGI) which includes 3 evaluation factors and 13 indicators. Furthermore, as presenting the degree of relative importance among evaluation factors and indicators for all R&D evaluation stages and all green technology areas, and applying the proposed model to 5 defense projects, we have found applicability of the model to evaluation of defense R&D projects. The results of evaluation using this model can be used to monitor the performance of project life cycle and develop R&D investment strategy of green technology using portfolio analysis.

• Journal of Technology Innovation
• /
• v.15 no.2
• /
• pp.123-152
• /
• 2007

The striking characteristic of the contemporary global security environment is that the nature of threats has become diverse and complex. For example, transnational and non-military threats including terrorism and proliferation of weapon of mass destruction has increased. In this security environment, Advanced countries funnel their investments for defense budgets into the assurance of key force capability and R&D of cutting-edge core technologies, in consideration of future battlefield environments so as to get an edge on not only defense science and technology but also intelligence capabilities. As shown by past practices of the korea's defense acquisition, the ministry of national defense has tried to enhance its force capabilities in the short-term by purchasing foreign weapon systems rather than by investing in domestic R&D. Accordingly, the technological gaps between the korea and advanced countries were widened due to both insufficient investment in development of domestic technologies and avoidance of technological transfer by advanced countries. Thus, for the effective execution of the R&D budget and the successful performance of the projects, the importance of selection, management and evaluation of the R&D projects is emphasized. So, The objective of this study is that the analysis of the proposal-selection evaluation system for the realization of the successful defense core technology R&D projects. This study focused on the improvement of the proposal-selection evaluation model which can be applicable to the national defense core R&D projects. Using the improved proposal-selection evaluation system, we propose a model to enhance the reliability of the national defense core technology R&D project evaluation system.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.27 no.2
• /
• pp.203-212
• /
• 2024

This paper describes the establishment of defense systems test works architecture model for the efficient operation of an expanded test organization and the provision of standardized test services after the integration of proving grounds in ADD. The system engineering vee model is applied to the defense system test works to define the project management model and the unit-test management model. In order to establish the defense systems test works architecture model, the process flow of test works, artifacts by life cycle, and interrelations between regulations and test works are explained, and Integrated Test Information System for implementation of architecture model is discussed. Through the defense systems test works architecture model presented in this study, it will contribute to quickly responding to the test requirements of complex and diverse defense systems, efficiently managing projects, and providing standardized test services.

• Journal of the Korean Society of Systems Engineering
• /
• v.14 no.2
• /
• pp.1-7
• /
• 2018

The research and development stage can improve the goal level of the project through systematic operation and management of systems engineering. The test evaluation tasks in the R&D process have a lot of connections with the system engineering in terms of requirement management, and the methodology for deriving the requirements when establishing the test evaluation items has been consistently required. In this paper, we propose the process of effectively establishing and using QFD (Quality Function Deployment), a tool to manage customer requirement, and drawing up HOQ (House of Quality) in the search and exploratory development stage of the self - propelled mortar project.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.17 no.1
• /
• pp.64-70
• /
• 2014

So far, the existing guideline called "Proposal Evaluation and Negotiation Guidelines for Weapon Systems (PE&NG)" has been employed even when choosing a development firm for the newly-adapted defense acquisition system, "Advanced Concept Technology Development(ACTD)". However, in that PE&NG ignores distinctive characteristics associated with ACTD programs, it is inappropriate. This study aims to propose an appropriate evaluation index which could be used to select the most suitable development company for the successful ACTD project. For this, Delphi techniques were used to collect extensive opinions of the hands-on workers. These opinion were consistently given but never gathered previously. The newly proposed index has a similar direction and range to the existing ones with its contents a little modified and simplified. Yet, it is more capable of evaluating candidates' proposals.

• Journal of the military operations research society of Korea
• /
• v.36 no.3
• /
• pp.1-13
• /
• 2010

DEA method has been widely applied on civilian and defense side for efficiency analysis of organizations and programs(project). For many years Defense Industry, military hospital and military construction parts have been analyzed by using DEA method. In this paper we review and propose a method of warship evaluation through DEA method. The evaluation method proposed above can provide plenty of proper information for ROC decision, AOA and source selection on weapon acquisition.