• 기술혁신연구
• /
• 제14권3호
• /
• pp.117-154
• /
• 2006

This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

• 한국사회복지학
• /
• 제45권
• /
• pp.126-155
• /
• 2001

It has been 5 years since evaluation systems were introduced to the social welfare field in Korea. More than half of social welfare agencies (617 out of 1,267) were evaluated in the past two years. Most areas of the agencies were the target of an extensive evaluation in 2000. As "the Evaluation Era" has come, problems were raised especially regarding the Accreditation system of the Ministry of Health and Social Welfare. More specifically, the problems were related to operation and management of the evaluation systems including the issue of evaluators' objectivity and fairness. In addition, evaluation costs have been too high to the government. The evaluation systems of OECD nations including the United States were quite different. These nations have used the Performance Measurement in order to secure the objectivity and the fairness. Although the quantity of information was limited compared to that of the Accreditation system, these nations have taken the lead in the governmental evaluation. In this context, this study compared social welfare evaluation systems between Korea and the United States. It presented the current status and problems of the Accreditation system of the Ministry of Health and Social Welfare, discussed the American Performance Measurement and its limitations, and compared the strengths and weaknesses of the two evaluation systems. In addition, this study suggested the strategies of Korean evaluation systems in the long term as well as in the short term.

• 정보보호학회논문지
• /
• 제12권3호
• /
• pp.61-76
• /
• 2002

정보보호 기술의 운용에 있어서 기반기술로 작용하는 PKI 시스템의 신뢰성 확보를 위해서는 PKI 시스템에 대한평가가 반드시 필요하나, 국제적으로 아직까지 체계적인 평가 및 인증체계가 갖춰지지 않은 것이 사실이다. 국내의 경우에도 침입차단시스템과 침입탐지시스템에 대한 평가 및 인증은 이루어지고 있으나, PKI 시스템 평가에 대한 연구는 미비한 실정이다. 이에 따라 본 논문에서는 국내 PKI 시스템에 적용할 수 있는 PKI 시스템 평가기준을 제안하고자 한다. 평가기준은 최근 정보보호 시스템 평가에 있어서 국제적인 조류에 맞춰 국제 공통 평가기준(CC)와 호환가능성을 고려하고, 현재 진행되고 있는 국내 평가제도를 고려하여 작성하였다.

• Journal of Information Science Theory and Practice
• /
• 제3권4호
• /
• pp.19-34
• /
• 2015

Evaluation of retrieval systems is mostly limited to laboratory settings and rarely considers changes of performance over time. This article presents an evaluation of retrieval systems for internal Web site search systems between the years 2006 and 2011. A holistic evaluation methodology for real Web sites was developed which includes tests for functionality, search quality, and user interaction. Among other sites, one set of 20 Web site search systems was evaluated three times in different years and no substantial improvement could be shown. It is surprising that the communication between site and user still leads to very poor results in many cases. Overall, the quality of these search systems could be improved, and several areas for improvement are apparent from our evaluation. For a comparison, Google’s site search function was also tested with the same tasks.

• 한국군사과학기술학회지
• /
• 제12권4호
• /
• pp.424-436
• /
• 2009

In the modern warfield, as the defense systems has been digitalized, intelligent, and working with network, the importance of interoperability among the systems has been also increasing. KMND(Korean Ministry of National Defense) has developed and used the SITES(Systems Interoperability Test & Evaluation System) based on Korean LISI(Levels of Information Systems Interoperability). SITES had been developed in order to evaluate the interoperability among information systems from the viewpoint of technical attributes. In this paper, we propose the extended interoperability evaluation model which can be applied not only the information systems, but also the weapon systems. Moreover, the extended interoperability evaluation model also includes the consideration of non-technical attributes.

• International Journal of Safety
• /
• 제11권1호
• /
• pp.26-32
• /
• 2012

This paper introduces a feasibility evaluation method for prognosis systems based on an empirical model in nuclear power plants. By exploiting the dynamical signature characterized by abnormal phenomena, the prognosis technique can be applied to detect the plant abnormal states prior to an unexpected plant trip. Early $operator^{\circ}{\emptyset}s$ awareness can extend available time for operation action; therefore, unexpected plant trip and time-consuming maintenance can be reduced. For the practical application in nuclear power plant, it is important not only to enhance the advantages of prognosis systems, but also to quantify the negative impact in prognosis, e.g., uncertainty. In order to apply these prognosis systems to real nuclear power plants, it is necessary to conduct a feasibility evaluation; the evaluation consists of 4 steps (: the development of an evaluation method, the development of selection criteria for the abnormal state, acquisition and signal processing, and an evaluation experiment). In this paper, we introduce the feasibility evaluation method and propose further study points for applying prognosis systems from KHNP's experiences in testing some prognosis technologies available in the market.

• 한국컴퓨터정보학회:학술대회논문집
• /
• 한국컴퓨터정보학회 2014년도 제50차 하계학술대회논문집 22권2호
• /
• pp.97-98
• /
• 2014

Lots of investment projects of new development and redevelopment for information systems have been not taken care of in the field of administration and evaluation, for these information systems projects have unique characteristics such as technology sensitiveness, network effectiveness, embeddedness, and externality. In fact, quantitative and qualitative evaluation of investments in information systems projects are not sufficient. It is critically important to generally evaluate benefits of development or operation cost, urgency, external effects, and so on. In addition, the efficient monitoring and effective analysis of information systems are surely needed for beneficient results of investment in information systems. We propose an economics evaluation model for information systems projects.

• 한국멀티미디어학회논문지
• /
• 제13권4호
• /
• pp.487-495
• /
• 2010

바이오인식 (Biometrics) 시스템의 사용이 보편화 되면서 그들의 성능에 대해서 보다 정확하고 안정된 평가를 제공하는 방법이 요구된다. 다양한 바이오 인식 기술 중에서 얼굴인식 기술이 널리 사용되고 있으며 안정적인 얼굴인식 시스템의 개발을 위한 지표를 마련하고 얼굴인식 시스템이 제공해야 하는 성능에 대한 기준을 제시하기 위해서 얼굴인식 시스템의 성능을 평가해야 할 필요성이 커지게 되었다. 하지만 얼굴인식 시스템의 성능에 영향을 미치는 요소들이 매우 다양하고 복잡하기 때문에 얼굴인식 시스템의 성능을 평가하는 것은 어려운 일이다. 그렇기 때문에 이러한 환경요소에 대해서 개별적으로 평가하는 것보다 종합적으로 얼굴인식 시스템의 활용 시나리오를 기반으로 평가하는 것이 보다 효율적이고 효과적이다. 이 논문에서는 얼굴인식 시스템에 영향을 미치는 환경변수들을 분석하고 그 환경변수들을 고려하는 얼굴인식 시스템에 대한 평가방법을 제안하는 것을 목적으로 한다. 특별히 환경변수들을 개별적으로 평가하는 것이 아니고 그들의 조합을 고려하는 시나리오를 기반으로 평가하는 방법을 제안한다. 또한 일반적인 환경을 가정하는 시나리오 예시를 통해서 얼굴인식 시스템을 종합적인 환경변수를 고려하여 평가하는 것을 보여주었다.

• 대한전기학회논문지:전력기술부문A
• /
• 제49권4호
• /
• pp.152-160
• /
• 2000

This paper presents an efficient evaluation method on the role of new energy storage systems, especially the secondary Battery Energy Storage (BES) systems, in the case where they are interconnected with the power distribution systems. It is important to perform the economic evaluation for the new energy storage systems in a synthetical and quantitative manner, because they are very costly in the early stage of their development and commercialization. In this paper, the multiple functions of BES systems, which are operated at distribution systems, such as load levelling, effective utilization of power distribution systems and uninterruptible power supply at the emergency conditions are classified and analyzed. And then the quantitative evaluation methods of the multiple functions for BES systems are proposed using the mathematical modelling.

• 한국콘크리트학회:학술대회논문집
• /
• 한국콘크리트학회 2000년도 가을 학술발표회 논문집(II)
• /
• pp.1291-1296
• /
• 2000

A basis for the direct use of data from nondestructive evaluation methods in bridge management systems is presented. Bridge management systems use integer-valued condition ratings to recognize conditions of bridge elements, to model progression of deterioration, and to determine repair needs. Data from nondestructive evaluation methods can inform management systems on the extent of damage, on the initiation of deterioration processes, and on the exposure of bridge elements to aggressive agents. In addition, data obtained through nondestructive evaluation methods allow the formation of models of specific deterioration process. The use of these data in bridge management systems requires redefinition of condition ratings together with the creation of procedures for automated interpretation of data. By these action, nondestructive evaluation methods are directly used to assign condition ratings, and condition ratings are made into terse form of NDE data that are compatible with present day bridge management systems. This paper reports work in progress to strategic use of nondestructive evaluation methods in bridge management system.