• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 2004.05a
• /
• pp.560-563
• /
• 2004

기술개발이 국가경쟁력 제고의 중요한 수단으로 인식됨에 따라 국가차원에서의 연구개발이 적극적으로 추진하고 있다. 우리나라의 경우도 예외가 아니어서, 1990년대 이후 우리 정부는 국가연구개발사업을 높이기 위해 연구 평가제도를 꾸준히 정비하여 왔다. 그러나 아직까지도 연구평가와 관련하여 여러 가지의 개선요구가 연구자들로부터 제기되고 있다. 이러한 현상이 나타나는 이유는 근본적으로 연구평가가 공급자 위주로 이루어지면서 미래지향적이고 효율적인 접근이 이루어지지 못하였다는 데에서 그 원인을 찾을 수 있다. 본 연구에서는 현재 여러 정부부처에서 연구평가를 시행하면서 연구과제의 선정단계와 중간평가단계에서 사용되고 있는 지표가 정책 목표에 합목적적이고 국가연구개발사업의 실질적인 성과를 제고할 수 있도록 구성되어 있는가를 살펴보았다. 연구의 성격에 따라 학술기초 연구사업, 원천기술 연구사업, 그리고 산업기술 개발사업을 분류된 사업그룹별로 연구의 특성을 반영하는 준거 틀과 실제로 사용하고 있는 지표를 비교하였다. 그 결과 아래와 같은 세 가지 유형의 문제점이 도출되었다. 첫째는 연구 성격이나 연구 활동의 수행 단계에 맞지 않는 불필요한 지표들이 활용되고 있는 경우이다. 여기에는 연구수행단계 또는 연구 성격을 감안하여 볼 때 꼭 필요하지 않은 지표임에도 불구하고 채택이 되고 있거나, 하나의 평가지표로 충분히 점검이 가능한데에도 불구하고 유사한 여러 가지의 지표들이 사용되는 경우를 포함하고 있다. 둘째는 지표의 구성에 있어 연구사업의 성공요인을 반영하지 못하고 있는 경우이다. 여기에는 특정한 연구수행단계의 성과를 평가하는데 필요한 지표들이 제외되어 있거나, 연구의 특성에 대한 고려가 이루어지지 않은 상태로 불필요하거나 반복적인 지표가 채택되는 경우를 포함하고 있다. 셋째는 추상적이며 측정이 어려운 지표를 채택하고 있는 경우이다. 여기에는 지표에 대한 정확한 정의가 이루어져 있지 않아 피 평가자가 불필요하거나 과다한 평가 자료를 준비해야 하거나 평가자로 하여금 평가 시 혼돈을 유발할 가능성이 있거나, 또는 상위개념의 평가항목과 하위개념의 평가항목이 혼재되어 구분이 모호한 경우를 포함하고 있다.

• The Journal of the Korea Contents Association
• /
• v.20 no.10
• /
• pp.45-56
• /
• 2020

This study is about the scale to evaluate the data of the countermeasures in the 'simulation based government exercise' (tentative name). The criteria and weighting of the scale is a standard for evaluating the data of each agency input. This maintains the objectivity and consistency of the evaluation, which complements the subjective evaluation of the observer. Therefore, the criteria should accommodate the purpose of the government exercise evaluation, the possibility of measurement in the simulation environment, the objectivity, no-duplication and causality between criteria, and the grade applying the evaluation results, and the weighting should be set. In this study, three major criteria of timeliness, accuracy, and appropriateness is set up for the evaluation scale and it consists of sub-criteria classified into three classes below respectively and the concept of it was defined. The weighting was calculated by AHP analysis considering the hierarchical structure of it. When this evaluation scale is applied to the 'simulation based government exercise' in the future, it will be possible to secure consistency and objectivity of the evaluation of measures by integrating the quantified evaluation into the observation evaluation and to conduct AAR by scientific techniques.

• The KIPS Transactions:PartD
• /
• v.16D no.3
• /
• pp.395-406
• /
• 2009

Korean government has operated EA by the act on efficient introduction of information system and operation, etc. But the evaluation system for EA and the criteria don't prepare well. Particularly, There is no model for EA performance measurement and the way is insufficient. In this study, we derived 8 areas and 17 criteria for the performance evaluation based on the Performance Reference Model of U.S FEA and Korea. And we also derived 8 areas and 10 criteria for it based on the OMB EA Assessment Framework and the EA maturity model in Korea. We propose the performance evaluation model of the five areas that consists of the business performance, customer performance, process, human resource and the technology for EA performance evaluation. To verify the model, we applied the model to three organizations and evaluated EA performance. In addition, we compared the performance result with the performance evaluation area of EA maturity model of Korea to verify the result. We also analyzed the criteria of the proposed performance evaluation model with the current EA maturity model and Performance Reference Model of Korea. As a result of the evaluation, we verified of the proposed performance evaluation model, too.

• Korean Journal of Social Welfare Studies
• /
• v.43 no.2
• /
• pp.5-29
• /
• 2012

Previous performance evaluation focusing on objective data of service agency has the limitations that did not reflect user-centered evaluation. With the expansion of voucher service, importance of perspective of service user such as satisfaction index is increasing. As voucher service has been delivered by the financial burden of government and user, we need the performance evaluation system that reflects the both performance indices to meet the accountability of two stake-holders. So this study focuses on deriving integrated evaluation system developing systems what mixed objective and subjective performance. Data used in this study is collected form 70 social service agencies that deliver voucher service and 1445 service users. Using General Satisfaction Index and Efficiency Index by DEA, this study analysed the correlation between efficiency and satisfaction index, and integrated performance evaluation model is constructed through portfolio map. This study has the following implication. This study theoretically explains the relation of objective performance and subjective performance and gives practical guidance in performance evaluation criterion and interpretation of performance.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2009.05a
• /
• pp.1729-1733
• /
• 2009

유역에서의 수자원관리에 큰 과제로 대두되고 있는 댐의 탁수문제에 대한 종합적인 대책 마련을 위해서 국내 댐 유역의 탁수발생의 가능성과 탁수 발생시 피해 가능성에 대한 체계적인 검토가 이루어져야 한다. 본 연구에서는 댐의 탁수문제에 대한 종합적인 대책을 마련하기 위해 댐 유역의 탁수 위험도를 평가할 수 있는 방법을 개발하였다. 종합적인 탁수 위험성을 평가하기 위해서 탁수 평가지표를 개발하였고, 이를 통해서 5개 댐 유역에 대한 시범평가를 실시하였다. 탁수 위험도 평가를 위해서 평가 분야를 탁수 취약성과 탁수 피해성, 탁수 영향의 3가지 분야로 구분하여 계층화된 형태로 종합지표화하였고, AHP기법을 적용하여 평가분야와 세부평가지표에 대한 가중치를 결정하였다. 시범평가 결과 5개댐 중 실제 탁수발생 현상은 일부 댐에서만 높게 나타나고 있으나, 대부분의 댐들이 탁수발생 잠재성이 높은 것으로 확인되었다. 평가 대상 댐 중에서는 임하댐과 소양댐 순으로 종합적인 탁수위험도가 높은 것으로 나타났다. 탁수 평가 지표를 개발하기 위하여, 기존의 국내외의 조사결과 등을 토대로 90여개의 탁수관련 인자들을 탁수발생 잠재성, 과거 탁수 발생 여부, 탁수 영향 등의 3가지 분야로 분류하여 최종적으로 7가지의 세부평가항목(강우지표, 유역지질, 토사유출량, 최고탁도, 고탁도 지속기간, 용수이용량, 호소생태기능)을 결정하였다. 7가지의 지표들은 탁수와의 상관성을 고려하여 표준화시켰고, 세부 평가항목들의 가중합이 종합적인 평가지표가 되도록 하였다. 댐의 탁수 위험성에 대한 평가는 댐유역의 종합적인 탁수 위험도 평가와 분야별 평가, 댐별 세부항목 평가로 구분하여 이루어졌다. 시범평가는 국내의 주요 5개 수계별로 1개의 댐을 선정하여 이루어졌다. 추가적으로 AHP의 적용시 생길 수 있는 지표의 중복성과 상호연계성, 평가자의 편향 등으로 인한 문제들을 어떻게 해결하여야 하는지에 대해서도 검토하였다.

• Journal of Korea Society of Industrial Information Systems
• /
• v.16 no.4
• /
• pp.127-137
• /
• 2011

This studies shows that Balanced Score-Card(BSC) affects corporate performance and performance measurement systems affect corporate performance, depending on whether they are customer-oriented or finance-oriented. The results of the study are as followings; First, utilization of BSC are significant relationships with performance assessment system. Second, performance assessment system are significant relationships with corporate performance. Third, utilization of Balanced Score-Card(BSC) affects corporate performance.

• Proceedings of the KAIS Fall Conference
• /
• 2012.05a
• /
• pp.419-422
• /
• 2012

본 연구는 기술개발지원사업의 선정 평가지표를 개발하고, 사례에 적용하여 그 타당성을 파악하고 있다. 개발된 선정평가지표의 기업선정순위와 기존 선정평가지표의 기업선정순위를 비교하여 성과를 낸 기업의 순위를 어떤 선정평가지표가 더 정확히 유추해 냈는지를 확인하고 있다. BSC 및 AHP기법을 이용하여 기술개발지원사업 선정평가지표를 개발하였다.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• The Journal of the Korea Contents Association
• /
• v.13 no.2
• /
• pp.431-439
• /
• 2013

The purpose of this study is to analyze the apartment investment performance including the risk and to verify the presence or absence of regional characteristics. This study made an analysis on the apartment investment performance by dividing it into long and short-term basis. Data collection period is 10 years from 2002 to 2012 and target area includes Gangnam and Gangbuk (southern and northern area of Seoul) and 6 metropolitan cities. For evaluating the investment performance, this study used the earning rate of 5 year 1st class national housing bond as the risk-free rate of return and 1~2 year interest rate of fixed deposit for calculating lease profit. The results of study are as follows, Treynor's Index was used in long investment performance evaluation because of regional characters non-existing in Seoul and Incheon whereas Jensen's Index was used in evaluating because of regional characters existing in 5 metropolitan cities. And Jensen's Index was used in short-term evaluation of all districts as existing regional characters in all districts. Short-term performance considering regional characteristics yielded different results of simple evaluation. Therefore, in case of simple rate of return to evaluate the performance, the recognition of that can be distorted.

• Journal of Practical Engineering Education
• /
• v.5 no.2
• /
• pp.123-127
• /
• 2013

Youth employment academy program focuses on resolving the job mismatch of youth unemployment through industry oriented human resource development for which company oriented capacity building program for graduate-to-be and graduate is supported. One of the major characteristics of this program is to use the M-to-M model with common skills for companies of same type of business. The operation organization in youth employment academy is supposed to be evaluated by the final employment rate after 1 year and 6 months since start of the program. So performance indicator for the operation organization was developed which means a kind of mid-term evaluation. In this research, the validity of the performance indicator is discussed. The correlations between the performance indicator and the performance evaluation, between the performance evaluation and the final employment rate, and between the performance indicator and the final employment rate are analyzed.