• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.137-164
• /
• 2009

As a means to address the modes of developing institutional evaluation system aimed at improving performances of GRIs, this study looked into the influential relations where institutional evaluation system has an impact on receptivity of evaluation outcomes and performances of institutes optimize their performances. After making analysis, it was confirmed that the National Research Council for Economics, Humanities and Social Sciences' institutional evaluation system for GRIs had a positive (+) influence on performances of research institutes, and receptivity of evaluation outcomes is related to performances of research institutes. In addition, it was also confirmed that institutes with high performances, in general, have high level of receptivity of evaluation outcomes along with positive recognition of institutional evaluation system. However, weaknesses of the Council's institutional evaluation system for GRIs resulted in low level of receptivity amongst GRIs, and thus there is limitation on the government and the Council in the active utilization of evaluation outcomes. Finally, it addressed the limitations and areas for improvement in relation to research outcomes.

• Journal of Convergence for Information Technology
• /
• v.9 no.8
• /
• pp.123-133
• /
• 2019

This research empirically investigated halo effect in evaluating culture and art performance program. We diagnosed halo effect by using correlation analysis, factor analysis, and regression model on results and scores of fifteen evaluation indicators within three categories for the 107 Local Representative Performance Art Festivals in 2014 and 2015. The results indicates strong possibility of halo effect in culture and art performance evaluation. The correlation coefficients between evaluation indicators is higher than 0.5 and factor structure does not match with evaluation categories in both years. Scores in categories and standard deviations also are also significantly correlated with each other. The results implies that more sophisticated standard, diversification of evaluator, education, and meta-anlysis are need to control halo effect.

• Journal of Korea Technology Innovation Society
• /
• v.20 no.2
• /
• pp.271-291
• /
• 2017

This study measures and compares the performance of research and development (R&D) programs in government-funded research institutes (GRIs) in terms of qualitative and quantitative approaches to find out strategic insights for improving performance evaluation policy. In particular, we adopt the evaluation results from the real data of K institute in 2015 for a qualitative evaluation and the results of data envelopment analysis (DEA) for a quantitative evaluation. Comparative analysis of the R&D performance of 14 programs finds that the difference between the evaluation results of qualitative and quantitative approaches is significant. From this finding, we suggest several strategic directions to complement two approaches each other.

• Proceedings of the KAIS Fall Conference
• /
• 2007.05a
• /
• pp.25-27
• /
• 2007

본 논문에서는 공공기관이 자체적으로 보유하고 있는 특허기술의 이전 및 사업화를 활성화하기 위하여 개발된 선별평가모델에 대한 타당성을 검토하고 공공기관이 보유하고 있는 1,166개의 특허기술을 공공기관과 평가전문기관이 각각 평가하여, 공공기관의 자체평가결과와 전문평가기관의 선별평가결과를 비교함으로써 공공기관의 자체평가능력을 제고하기 위한 방안을 수립한다. 선별평가점수와 자체평가점수의 차이를 분석한 결과 상용화가능성 항목은 차이의 평균(0.092)은 작으나 차이의 표준편차가 커서 공공기관과 평가기관의 견해 차이가 큰 것으로 분석되었다.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.11a
• /
• pp.173-185
• /
• 2017

본 논문에서는 해양 및 수산 분야의 투자용 기술력평가모형 개발을 위하여 민간 VC투자 활성화를 위한 평가기법 선행조사를 수행하며, 국내 관련 전문기관 등의 기술투자 관련 기술력평가 모형개발과 활용수준 등을 조사하고, 해외 관련 전문기관의 기술평가모형 현황에 대한 조사·분석을 수행하였다. 또한 투자용 기술력평가 모형의 용도와 방향 설정을 위하여 국내 기술투자 관련 전문가 그룹을 활용하여 기술공급자와 수요자 관점에서의 견해를 반영한 투자모형의 용도와 방향설정을 제시하였다. 결과적으로 기술투자 목적의 평가요인을 도출하고, 기술투자자 입장의 평가결과 유효성 검증을 통해 평가결과의 실무적 활용성을 제고시키고자 한다. 기술보증기금에서 개발한 기존의 투자용 기술력평가 모형이 많은 타 기관에 파급되어 운영되고 있지만, 활용수준이 미미한 점을 검토하여 VC의 투자의사결정 요소에 관한 연구결과를 기반으로 해양수산분야 투자용 기술력평가 신규모형을 설계하였다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2008.05a
• /
• pp.65-68
• /
• 2008

본 논문은 영한 과학기술 논문 자동번역 시스템을 대상으로 이루어진 수동 평가와 자동 평가 사이의 상관 관계를 밝힘으로써 수동 평가와 자동 평가 중에 한쪽의 방법에 의해서 평가가 이루어지더라도 다른 쪽의 수치를 파악할 수 있도록 하는데 목표가 있다. 본 논문에서 수행한 수동 평가는 5 인의 전문 번역가가 5 회에 걸쳐 평가한 결과이며, 자동 평가는 영어 원문 1,000 문장에 대한 8 인이 번역한 8,000 문장의 정답문(References)과 자동번역 결과를 어절 단위와 형태소 단위로 N-gram 비교를 통해 평가된 결과이다. 본 논문에서 도출된 식은 사용하는 평가 집합과 대상 번역 시스템 별로 자동 평가와 수동 평가 간의 상관 계수를 만들어내고 수동 번역률을 구하는 식을 동일하게 적용한다면 시스템의 자동 평가 결과로부터 성능을 직관적으로 해석하는데 상당히 도움이 될 것이다.

• Communications of Mathematical Education
• /
• v.21 no.2 s.30
• /
• pp.331-345
• /
• 2007

This research is aimed to inquiry retention types of middle school students about results of evaluation in school mathematics, For this purpose, we selected evaluation time, problem types, evaluation score, evaluation factors as important factors which influence to students' retention types. Then we classified students' retention types about results of evaluation in school mathematics. From this results, we selected two students as participants, and collected data through depth interviews of them. In depth interviews, we focused on 'what is the core factor influenced to students' evaluation', 'how the core factors reappear in the future'. Through this process, we analyzed middle school students' retention types about results of evaluation in school mathematics.

• Journal of Korea Technology Innovation Society
• /
• v.12 no.1
• /
• pp.113-136
• /
• 2009

The purpose of this study is to develop meta evaluating indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process, evaluation output. And fifty two indicators were developed for this meta evaluation. Basic model of meta evaluation was derived from the literature review and brain storming. And this meta evaluation model was determined by adapting the result of experts who performed evaluations for Defense R&D Programs in recent years. Factor Analysis method was used to verify the validity of meta evaluation model. The survey of fifty three members turned out that Cronbach' ${\alpha}$ was over 0.6 in evaluation components and items. And the reliability of evaluation context was 0.877, that of evaluation input was 0.755, that of evaluation process was 0.755, that of evaluation output was 0.755 respectively. Analytic Hierarchy Process (AHP) method was used in assigning the evaluation weight. The survey of twenty two members showed that the Consistency Ratio was 0.09 in evaluation components and items.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2008.05a
• /
• pp.460-464
• /
• 2008

본 연구에서는 하천환경의 현재 상태를 진단할 수 있는 하천환경평가기법을 제시하고, 수원천을 평가하였다. 이를 위해 윤세의(2007)가 제시한 도시하천평가기법의 53개 평가항목 중 설문조사의 결과를 이용하여 중요도가 높은 하천환경 관련 항목을 선별하고, 이를 하천환경평가기법의 평가항목으로 사용하였다. 평가항목은 총 27개이고, 평가결과는 총괄지수, 특성지수, 부문지수, 항목지수와 평가등급으로 나타내었다. 수원천의 조사구간은 광교저수지 하류부에서 세류대교까지 약 6.0 km이었고, 총 39개의 구간에 대하여 하천환경평가기법과 도시하천평가기법의 평가지수를 비교하였다. 하천환경평가를 적용한 결과 수원천의 총괄지수는 $2.57{\sim}3.86$으로 나타났고, 하천특성 지수는 $2.20{\sim}2.95$, 생태환경 특성지수는 $1.91{\sim}4.02$로 나타났다. 또한 두 가지 평가기법에 대한 총괄지수와 특성지수의 평균등급은 동일하게 계산되었고, 부문지수 평균등급은 수로, 하상 등의 부문에서 등급변동이 나타났지만 2개 등급 이상의 차이를 보이지 않았다. 이러한 평가결과를 통해 도시하천 평가기법으로부터 파생된 하천환경평가기법의 적용가능성은 확인하였다. 앞으로 많은 대상하천을 선정, 평가를 실시하고, 하천의 연속성과 평가인자들 간의 연계성 등을 반영하는 부분에 대한 연구가 더 필요하다.

• The Journal of Korean Institute for Practical Engineering Education
• /
• v.4 no.1
• /
• pp.7-12
• /
• 2012

There are two ways in general for evaluating the accomplishments used by the universities, one is relative evaluation, the other is absolute evaluation. Recently, Korean universities have had the problem with score inflation due to absolute evaluation. The advantage of relative evaluation compared with absolute evaluation is for us to distinguish one's academic accomplishments from others. However, relative evaluation would lead to over-competition. Through this paper, I tired to analyze how cooperative learning influences the academic accomplishments under relative evaluation. Cooperative learning in the relative evaluation of student accomplishments conducted were divided into three groups. And analyzed a result and following presented about the research which in necessary.