• Knowledge Management Research
• /
• v.10 no.2
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 한국벤처창업학회:학술대회논문집
• /
• 2009.08a
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.32 no.3
• /
• pp.59-70
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as 'Good'. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach's a coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.9 no.1 s.24
• /
• pp.41-49
• /
• 2006

A systems engineering is an interdisciplinary engineering management process that evolves and verifies an integrated, life-cycle balanced set of system solutions that satisfy customer needs. This work describes analysis of. the defense R & D programs applied systems engineering approach. FA-18E/F and NSSN defense acquisition programs are adopted for the case study. Those two programs is performed by IPPD, which is one of the systems engineering management techniques. From the analysis results, implementation considerations of domestic defense R & D programs are presented.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.10 no.8
• /
• pp.2088-2102
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result gained 74.3 points out of 100, so it was evaluated as 'Good'. T- test and one-way ANOVA were used to identify the difference between groups. As a result of difference analysis between groups, some evaluation items showed difference within significance level. From this analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D performances.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.12 no.3
• /
• pp.290-298
• /
• 2009

This paper proposes a novel process which can develop the system requirements in defense R&D programs. As the weapon systems become more complicated, the success and effectiveness of R&D outcome heavily depend on the application and tailoring of systems engineering process and methods. And, the accuracy and quality of system requirements are essential prerequisite to leverage the systems engineering process. To produce the artifacts of systems engineering such as OCD, ORD, and the systems requirements, the system user can write out requirement document using the proposed implementation process and templates without expending heavy work loads.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.13 no.5
• /
• pp.808-817
• /
• 2010

This paper proposes a novel appoach which can assess the system technical maturity for use in Defense R&D Program reviews. As the weapon systems become more complicated, the success and effectiveness of R&D outcome heavily depend on the application and tailoring of systems engineering process and methods. It is a difficult task to assess the system readiness level(SRL) of the system being developed. A system-focused approach for managing weapon systems development and making effective and efficient decisions during the development lifecycle is critical to ensure the success of the program. The proposed weighted average SRL can facilitate the system technical maturity assessment without expending heavy work load.

• Journal of the Korean Society of Systems Engineering
• /
• v.3 no.1
• /
• pp.9-15
• /
• 2007

An EA(Evolutionary Acquisition) strategy is based on the systems engineering. It is a preferred approach to provide operationally useful capabilities to the warfighter much more quickly than single-step to full capability strategy. Recently, DoD is trying to apply the acquisition process based on the systems engineering. In spite of these trends, efforts of domestic defense acquisition society to this strategy are insufficient. Although an EA strategy has many benefits, there are many constraints to apply it. This study analyzes these constraints and presents applications of the EA strategy to defense R&D programs.

• IE interfaces
• /
• v.21 no.1
• /
• pp.96-108
• /
• 2008

This paper proposes the systematic design approach for developing the evaluation indicators that evaluate the candidate proposals in the national defense core-technology R&D projects. To improve the validity and fairness of the evaluation indicators, the existing evaluation process in a military and a public sector are surveyed and also the existing evaluation system of the core-technology R&D programs for the national defense is analysed and discussed. A new system for the evaluation indicators is designed by using the axiomatic design, factor analysis and the analytic hierarchy process. It is expected that the proposed evaluation indicators contribute to enhance the fairness and the reliability of the evaluation process for the proposal of the national defense core-technology R&D projects.

• Journal of the Korea Institute of Military Science and Technology
• /
• v.8 no.1 s.20
• /
• pp.62-68
• /
• 2005

In this paper, we review the general technique of Earned Value Management System(EVMS) which is the integrated management for cost, schedule and performance, and suggest an application of the integrated management of cost and schedule in the research and development(R&D) programs for defense acquisition.