• 지식경영연구
• /
• 제10권2호
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 한국벤처창업학회:학술대회논문집
• /
• 한국벤처창업학회 2009년도 통합학술대회
• /
• pp.5-24
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D Programs.

• 산업경영시스템학회지
• /
• 제32권3호
• /
• pp.59-70
• /
• 2009

This study is the result of meta evaluation for the self evaluation of defense R&D programs in Korea by using meta evaluating indicators. The overall meta evaluation result of defense R&D programs gained 74.3 points out of 100, so it was evaluated as 'Good'. But it demonstrated that further improvement for overall system of defense R&D programs evaluation is required. And especially, it demonstrated that more alternatives are necessary in order to improve the utilizations and the feedbacks of evaluation results. The evaluation context component gained 80.2 points out of 100, so it was evaluated as 'Very Good'. The evaluation input component gained 73.1 points out of 100, so it was evaluated as 'Good'. The evaluation process component gained 74.8 points out of 100, so it was evaluated as 'Good'. And the evaluation outcome component gained 69.0 points out of 100, so it was evaluated as 'Good'. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adopting the result of experts who performed evaluations for defense R&D programs in recent years. The reliability of components and items was verified by Cronbach's a coefficient. It was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. From the analysis, it is attempted to identify possible problems and to find out the ways of improvements related to the self evaluation system of defense R&D programs. The ultimate objective of this study is to manage the programs effectively and improve the reliability and the objectiveness of the defense R&D programs.

• 한국군사과학기술학회지
• /
• 제9권1호
• /
• pp.41-49
• /
• 2006

A systems engineering is an interdisciplinary engineering management process that evolves and verifies an integrated, life-cycle balanced set of system solutions that satisfy customer needs. This work describes analysis of. the defense R & D programs applied systems engineering approach. FA-18E/F and NSSN defense acquisition programs are adopted for the case study. Those two programs is performed by IPPD, which is one of the systems engineering management techniques. From the analysis results, implementation considerations of domestic defense R & D programs are presented.

• 한국산학기술학회논문지
• /
• 제10권8호
• /
• pp.2088-2102
• /
• 2009

본 논문은 국방연구개발사업 자체평가시스템에 대한 메타평가 실증분석을 통하여 자체평가시스템 개선 및 제도발전을 도모하고, 국방예산의 비효율성을 예방하며, 연구 성과를 효율적으로 관리하기 위한 것이다. 국방연구개발 사업에 대한 메타평가결과 전체적인 총점은 74.3점을 획득하여 '보통' 수준으로 나타났다. 그리고 집단 간 차이분석을 실시한 결과 일부 평가항목에서 유의미한 차이점이 나타났다. 향후에도 본 연구결과를 토대로 국방연구개발사업 자체평가 시스템 전반에 대한 개선방안이 지속적으로 고려되어야 할 것이며, 특히, 평가결과의 활용성 및 환류성 증진 방안도 함께 모색되어야 할 것이다.

• 한국군사과학기술학회지
• /
• 제12권3호
• /
• pp.290-298
• /
• 2009

This paper proposes a novel process which can develop the system requirements in defense R&D programs. As the weapon systems become more complicated, the success and effectiveness of R&D outcome heavily depend on the application and tailoring of systems engineering process and methods. And, the accuracy and quality of system requirements are essential prerequisite to leverage the systems engineering process. To produce the artifacts of systems engineering such as OCD, ORD, and the systems requirements, the system user can write out requirement document using the proposed implementation process and templates without expending heavy work loads.

• 한국군사과학기술학회지
• /
• 제13권5호
• /
• pp.808-817
• /
• 2010

This paper proposes a novel appoach which can assess the system technical maturity for use in Defense R&D Program reviews. As the weapon systems become more complicated, the success and effectiveness of R&D outcome heavily depend on the application and tailoring of systems engineering process and methods. It is a difficult task to assess the system readiness level(SRL) of the system being developed. A system-focused approach for managing weapon systems development and making effective and efficient decisions during the development lifecycle is critical to ensure the success of the program. The proposed weighted average SRL can facilitate the system technical maturity assessment without expending heavy work load.

• 시스템엔지니어링학술지
• /
• 제3권1호
• /
• pp.9-15
• /
• 2007

An EA(Evolutionary Acquisition) strategy is based on the systems engineering. It is a preferred approach to provide operationally useful capabilities to the warfighter much more quickly than single-step to full capability strategy. Recently, DoD is trying to apply the acquisition process based on the systems engineering. In spite of these trends, efforts of domestic defense acquisition society to this strategy are insufficient. Although an EA strategy has many benefits, there are many constraints to apply it. This study analyzes these constraints and presents applications of the EA strategy to defense R&D programs.

• 산업공학
• /
• 제21권1호
• /
• pp.96-108
• /
• 2008

This paper proposes the systematic design approach for developing the evaluation indicators that evaluate the candidate proposals in the national defense core-technology R&D projects. To improve the validity and fairness of the evaluation indicators, the existing evaluation process in a military and a public sector are surveyed and also the existing evaluation system of the core-technology R&D programs for the national defense is analysed and discussed. A new system for the evaluation indicators is designed by using the axiomatic design, factor analysis and the analytic hierarchy process. It is expected that the proposed evaluation indicators contribute to enhance the fairness and the reliability of the evaluation process for the proposal of the national defense core-technology R&D projects.

• 한국군사과학기술학회지
• /
• 제8권1호
• /
• pp.62-68
• /
• 2005

In this paper, we review the general technique of Earned Value Management System(EVMS) which is the integrated management for cost, schedule and performance, and suggest an application of the integrated management of cost and schedule in the research and development(R&D) programs for defense acquisition.