• 기술혁신학회지
• /
• 제8권spc1호
• /
• pp.451-475
• /
• 2005

This paper focuses to find out and analyse the influence of evaluation and image of government technology development programs on the outcome. A comprehensive survey of domestic technology-intensive industry was carried out. Through the results of this survey, we can understand and find out the impotance of the image and evaluation of the programs taken by the firms. We could find out, however, that the output of the technology development of the enerprises is one thing and outcome in the level of society is another, especially as for the influences of evaluation on the performances. In this regard, we could draw several policy implications as well as discussions.

• 한국군사과학기술학회지
• /
• 제14권1호
• /
• pp.84-91
• /
• 2011

The Systems Interoperability Test and Evaluation System(SITES) is an T&E support tool for both information system and weapon system. The SITES was developed by reference to the Level of Information Systems Interoperability(LISI) in US. We use the tool via MND Broad convergence Network(BCN) in order to assess information system's interoperability. Nowadays, there are many ongoing researches on expanding assessment capability into weapon systems. As part of those research topics, this paper analyze the characteristics of tactical data-link messages which is the way to exchange the information among the weapon systems, and reflect that characteristics in interoperability level assessment.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제11권6호
• /
• pp.3273-3308
• /
• 2017

Building appropriate trust evaluation models is an important research issue for security guarantee in social networks. Most of the existing works usually consider the trust values at the current time slot, and model trust as the stochastic variable. However, in fact, trust evolves over time, and trust is a stochastic process. In this paper, we propose a novel time-variant stochastic trust evaluation (TSTE) model, which models trust over time and captures trust evolution by a stochastic process. Based on the proposed model, we derive the time-variant bound of untrustworthy probability, which provides stochastic trust guarantee. On one hand, the time-variant trust level of each node can be measured by our model. Meanwhile, by tolerating nodes with relatively poor performance, our model can effectively improve the node resource utilization rate. Numerical simulations are conducted to verify the accuracy and consistency of the analytical bounds on distinguishing misbehaved nodes from normal ones. Moreover, simulation results on social network dataset show the tradeoff between trust level and resource utilization rate, and verify that the successful transmission rate can be improved by our model.

• 조명전기설비학회논문지
• /
• 제22권12호
• /
• pp.115-121
• /
• 2008

현재 추진되고 있는 무선통신을 기반으로 하는 열차제어시스템 개발 프로젝트에서는 상호운영성 및 상호교환성을 고려하는 하부시스템의 개발을 목표로 하고 있다. 이 프로젝트는 상위 시스템 수준의 설계보다는 주로 하부시스템의 설계에 집중되어 있다. 시스템에 대한 시험평가는 시스템 사양에 대한 만족 여부를 확인하는 것이며, 이에 따라 시스템 수준으로 통합된 시스템 사양서가 필요하다. 본 연구에서는 시스템 사양서가 마련되지 않은 하부시스템의 설계단계에서 최상위 시스템 수준의 시험평가에 대한 방안을 제시하였다.

• 대한산업공학회지
• /
• 제41권2호
• /
• pp.144-149
• /
• 2015

In this study, the effective technology readiness assessment (TRA) method for system development project is suggested. We analyze the domestic and foreign TRA practice and derive the new idea to resolve the problems found from the analysis. Domestic and foreign organizations develop and use checklist for the precise TRA, but the checklist has some problems in type of questions and analysis of assessment. TRA method using the original TRL definition or the checklist should be selected depending on the project characteristic. Questions of the checklist should be classified into critical or non-critical according to their importance. Finally, Test and evaluation master plan (TEMP) in system engineering process can provide an obvious criteria to assess technology readiness level (TRL) of critical technology elements (CTE) composing the system.

• 해양환경안전학회:학술대회논문집
• /
• 해양환경안전학회 2018년도 공동국제학술발표회
• /
• pp.42-42
• /
• 2018

• 한국IT서비스학회지
• /
• 제8권4호
• /
• pp.141-150
• /
• 2009

There are no objective standards for selection and improvement of SLA evaluation metrics for IT service. In this study, we analyze the current IT maturity models for selection and improvement of the metrics and then we derive them according to the maturity levels and propose the redesigned maturity model. To verify whether the model is applicable, we execute a case study based on the D company. We apply the proposed evaluation metrics of the maturity models to the D company and evaluate the metrics. We select a proper level of the D company and an improvement line after measuring evaluation metrics in the maturity level 2. We propose improvement guidelines of evaluation metrics which score is less than the improvement line's and derive SLA evaluation metrics. By using the SLA evaluation metrics for a year, we prove that the way of selection and improvement is useful.

• 한국국방기술학회 논문지
• /
• 제5권2호
• /
• pp.23-30
• /
• 2023

TRA(Technology Readiness Assessment)는 현재의 국내 기술수준을 정량적으로 평가하여 국내 연구개발 가능성에 대한 판단과 위험관리를 위한 핵심도구로 활용되고 있다. 하지만 현재의 TRA는 하드웨어 중심의 TRL(Technology Readiness Level)을 활용하기 때문에 개별기술의 독립적 평가에는 적합하나 체계관점의 평가에는 한계가 있다. 또한 체크리스트 방식의 평가는 주관적 평가 개입 가능성이 크다. 본 연구는 체계공학의 시스템통합 관점에서 TRA 절차와 기준을 재정의하여 개선된 TRA 프레임워크를 제안한다. 현재의 TRL과 TRA가 가진 한계를 극복하고 좀더 쉽고 직관적인 평가가 가능한 프레임워크 개발에 중점을 두었다. 제안 프레임워크는 HW, SW 및 인터페이스 관점에서 TE(Technology Element)와 CTE(Critical Technology Element)를 구분하고 TRL을 재정의 한다. TRA는 위 3가지 관점에서 재정의된 TRL에 따라 수행되고 위험관리를 고려하여 가장 낮은 평가결과를 시스템 수준의 성숙도로 활용한다. 제안된 CTE 선정방법은 주요 ROC(Required Operational Capability)의 정량목표, 개발난이도 및 COTS(Common Off The Shelf) 기술의 적용여부를 활용하여 평가자 주관의 개입을 최소화 한다. 본 프레임워크는 TSS(Target Surveillance System) 체계의 Case Study를 통해 실효성을 확인하였다. 본 연구를 시작으로 프레임워크 차원의 연구가 활성화 되어 TRA 제도 개선에 기여하길 바란다.

• 품질경영학회지
• /
• 제50권2호
• /
• pp.183-197
• /
• 2022

Purpose: The purpose of this study is to develop a quantitative evaluation model for the defense quality management system and suggest institutionalization plans. To this end, another existing evaluation model was reviewed and analyzed to develop a quantitative evaluation model applicable to military institutions. Methods: In this study, in order to establish a DQMS quantitative evaluation model, a military product quality level survey model and a defense quality model operated in the defense field were analyzed. In addition, evaluation models and indicators were analyzed by investigating evaluation models operated by other institutions and private sectors. Results: As a result of the study, the total score of the DQMS model was 1,000 points, 600 points for maturity level indicators and 400 points for operation performance indicators, and the evaluation items consisted of 7 major categories and 25 middle categories. The maturity level index 600 points are 70 points for organizational situation, 60 points for leadership, 40 points for planning, 100 points for support, 180 points for operation, 90 points for performance evaluation, and 60 points for improvement. Conclusion: It will be easy to quantify and evaluate the operating level of DQMS certified companies through the application of the DQMS quantitative evaluation model and evaluation criteria presented in this study. As a result, it will be possible to grasp the level of quality management system and the areas of improvement, and the overall level of improvement can be expected by inducing voluntary improvement activities through sharing of best practices and identifying improvement cases.

• 한국정보시스템학회지:정보시스템연구
• /
• 제13권2호
• /
• pp.225-240
• /
• 2004

The most critical problem of MIS evaluation is the lack of the systematic framework to cover various factors and viewpoints. To solve this problem, this study takes the multi-level and contingent approach to performance evaluation, composed of three levels: evaluating the contribution of MIS to an organization [strategy level]; evaluating the activities of MIS department or MIS function as an organizational sub-function through the overall MIS lifecycle [function level]; and evaluating the quality or productivity of the application systems as MIS outputs [system level]. Ideal MIS evaluation should include all three levels of the hierarchy with balanced importance. However, MIS evaluationcanbedividedintothreetypes,suchasstrategy-oriented, function-oriented and system-oriented evaluation, depending on the focus and emphasis of evaluation. The usage pattern of each evaluation type is analyzed according to contingent variables of MIS evaluation such as MIS maturity, information intensity and firm size, and top management's intent. It is also found that the firms of higher MIS maturity and top management's intent use the strategy-oriented evaluation type, and the firms with strategy-oriented evaluation type show a higher MIS performance. Further, MIS maturity and top management's intent show contingent effects between evaluation type and MIS performance. Some managerial implications can be drawn based on the results of the study. First, strategy-oriented evaluation of MIS is more important as many firms more often use information technology as a strategic weapon. Second, MIS performance varies with evaluation type. Therefore, the design of MIS evaluation framework should be done carefully in the strategic and managerial contexts. Third, firms are recommend to use a different evaluation type according to organizational characteristics such as MIS maturity and information intensity.