• Journal of Korea Technology Innovation Society
• /
• v.11 no.3
• /
• pp.376-399
• /
• 2008

Science and technology (S&T) is one of the most important elements in a nation's competitiveness. In an effort to strengthen their national competitiveness, all countries are focusing on upgrading the level of eir S&T. With these factors in mind, Korea has increased its support of national research and development (R&D). In recent years, this added support has resulted in an increased interest in the effectiveness of R&D. We have made continuous efforts to enhance the accountability and effectiveness of R&D by strengthening performance evaluation and considering R&D evaluation results during the budget review (appropriation) process. In order to change to a performance based system, we need to develop objective and scientific indicators to measure and evaluate the quality of the research performance of R&D programs. One of the primary research outcomes is publications. The impact factor of publications is widely used to evaluate overall journal quality and the quality of the papers published therein. However, the use of impact factors has been criticised because they can vary greatly when works from different subject areas are compared. In order to overcome this limitation, we have developed three kinds of qualitative indicators, which are functions of the impact factor. Two of these qualitative indicators, Modified Rank Normalized Impact Factor and Ordinal Rank Normalized Impact Factor, are based on order statistics (rank) for all journals from a specific specialty. The third qualitative indicator, Relative Field Impact Factor, uses the average impact factor of all journals within a subject category. We also suggest a quantitative indicator, Percentage of Contribution. In this study, we suggest 4 indicators and use them to evaluate the performance of outcomes from three R&D programs supported by the Ministry of Education, Science & Technology. We also perform a simulation study to verify the effectiveness of the proposed indicators. It can be shown that the proposed Ordinal Rank Normalized Impact Factor is the most reliable and effective indicator for comparing research performance across subject categories. However, we recommend using previous indicators in combination with the proposed indicators in this study for the research evaluation of R&D programs.

• Journal of Engineering Education Research
• /
• v.13 no.1
• /
• pp.62-69
• /
• 2010

Program learning outcome is widely used for assessing and improving program quality. There are various methodologies that can measure program quality and improve program learning outcomes. In this paper, we used formative approach in Capstone design course, since it is the most effective in terms of improving program learning outcomes due to the course's intrinsic nature. To integrate a formative approach into Capstone design course, we develop a feedback structure which is a key element in formative approach and define several sub phases that manage feedback structures and their own evaluation criteria. As a result, we observed a noticeable improvement for students performance in capstone design course.

• The Journal of Information Technology
• /
• v.6 no.3
• /
• pp.75-85
• /
• 2003

It is highly required to evaluate the economic value of technology in many decision making of the technology management area, for example, technology acquisition, transfer, and investments. Also evaluating the performance of R&D objectively is very important subject in the public side. So, developing the objective technology evaluation system has much usefulness in practice. In many studies, the patent information has been suggested to the valid measurement for evaluation of technology. The purpose of this study is to explore the validity of patent information as a measurement of technology evaluation.

• Journal of the Korean Society for information Management
• /
• v.27 no.1
• /
• pp.249-267
• /
• 2010

The h-index is a new tool for measuring research outputs based on citation and many variants of h-index have been proposed to improve the weaknesses of h-index. The h-index and its variants can be applied to institutional evaluation in three different ways. We worked out 447 practical cases of professors from 10 business schools and examined h-index and its variants. And then we compared three evaluation methods of research institution based on the h-index and its variants.

• Journal of Digital Convergence
• /
• v.17 no.3
• /
• pp.139-152
• /
• 2019

In the fourth industrial revolution and the era of convergence and integration, on the situation that the internal colleges are needed active change included in the improvement of educational quality, I tested it on the purpose of empirical analysis with SPSS v.18 how colleges' efforts on the first periodic Organization Evaluation And Accreditation System(OEAAS) affects on the Perceived Management Performances on the perspective of BSC. As the test result, the Degree of Awareness of Colleges' Efforts on the OEAAS affects on just Colleges' Learning and on Growth. The Degree Propriety of Preparation of the OEAAS affects on Customer Performance, on Internal Process Performance, and, on Finance Performance. And the Degree of Satisfaction of Internal Assessment affects on all of BSC 4 performances. The results of this research could be used on making the management idea of colleges' performance on the OEAAS. In the future, it would be needed advanced researches which are able to make relatedness to the expanse of management performance with the OEAAS.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2012.05a
• /
• pp.512-515
• /
• 2012

최근의 재해 발생은 하천에 의한 범람, 제방의 붕괴 등에 의한 피해발생보다는 일정지역에 국한적으로 내수배제 불량, 토사유출, 산사태 등으로 인한 피해의 발생이 증가하고 있다. 특히나 도시지역과 신규개발지역을 중심으로 집중호우로 인한 토사유출 등으로 인한 배수로 막힘, 산사태등의 2차적인 피해가 증가하고 있는 추세이다. 2011년의 서울의 우면산 산사태 등과 같은 도시중심에서의 피해와 강원도 등의 신규개발지역에서의 토사로 인해 2차, 3차 피해는 국지적이고 예측이 불가능한 곳에서 발생되고 있다. 이러한 토사유출, 산사태에 의한 예측기법은 최근의 정보기술의 발달로 인해 보다 다양한 방법의 접근들이 시도되고 있으며, 이에 대한 정량적인 평가기법들이 개발되고 적용되고 있다. 본 연구에서는 산지지형의 소규모 개발지의 토사재해의 위험성을 평가하기 위하여 GIS 기술을 이용한 사면의 안정성과 산사태 위험성을 평가하는 대표적인 방법으로 Pack et al. (1998)이 제안한 수리적 무한사면 안정모델과 결합하여 사면안정분석을 위해 개발된 SINMAP을 이용하여 소규모 개발지역의 토석류 해석과 사면의 안정성 검토 그리고 범용토양공식을 이용하여 토사유출량을 산정하여 개발지역내 사면 및 토사재해의 위험성을 평가하였다. GIS를 이용한 지형적 특성에 따른 사면의 위험성과 토사유출량 해석 결과를 이용하여 소규모 개발지역의 토사재해의 위험성을 정량적이고 다각적으로 평가하여 재해발생에 따른 위험성을 노출하고 이에 대한 대책 수립에 도움이 될 것으로 판단된다.

• The Journal of the Convergence on Culture Technology
• /
• v.8 no.6
• /
• pp.553-560
• /
• 2022

The research of course-embedded learning evaluation method, which can be used to measure the competency of learners by evaluation of learning outcomes, has been performed for competency-based education in the university. In this paper, we propose an learning evaluation and adaptive feedback model based on learning outcomes, learning subjects, learning concepts graph, and an evaluation matrix. Firstly, we define the layered learning outcomes, a graph of learning subjects and concepts, and two association matric. Secondly, we define algorithms to calculate the level of learning achievement and the learning feedback to learners. We applied the proposed method to a specific course, "Java Programing", to validate the effectiveness of our method. The experimental results show that our proposed method can be useful to measure the learning achievement of learners and provide adaptive feedbacks to them.

• Korean Journal of Social Welfare Studies
• /
• v.48 no.2
• /
• pp.97-119
• /
• 2017

The current study aims to validate Employment Hope Scale (EHS), a dimension of Psychological Self-Sufficiency (PSS) scale, among self-sufficiency program participants in South Korea. Self-sufficiency has been understood primarily from an economic perspective in both policies and studies, with which the process participants changes has been ignored and neglected. This study suggests psychological approach to self-sufficiency programs for the paradigm shift to 'client-centered' practice. In this regard, this study tests the validity of EHS using exploratory factor analsysi (EFA) and confirmatory factor analysis (CFA) in South Korea, developed from a bottom-up client-centered approach and found a 4-factor 17-item structure as Korean EHS(K-EHS). The study results indicate that the K-EHS can be used as a valid supplementary process evaluation tool for self-sufficiency programs.

• Journal of Korea Technology Innovation Society
• /
• v.19 no.4
• /
• pp.768-798
• /
• 2016

This study started from the awareness of the issue if the citation index newly introduced to evaluate the quality of papers satisfies the proper timing matter, which is a component of performance indicators for the evaluation of government-funded R&D institutes. Accordingly, the study will propose improvement ways to shift the previous evaluation system to quality evaluation for mission-oriented R&D institutes by analysing and using the periodical characteristics such as citation half-life and immediacy index of papers. As a result, it turned out that the speed of academic change is getting faster in proportion to the dependency on the technological development but that the citation speed in the field of public technology is relatively slower and the speed of knowledge transfer in the fields related to industry is faster. In addition, the citation index among the R&D fields showed no differences, and the minimum period for citation index measurement with validity should be over 6 years. The problems of evaluation for mission-oriented R&D institutes were deducted based on the technical and statistical analysis results of the temporal characteristic of citation necessary for quality evaluation of performance among R&D fields. To solve the problems, policy alternatives for object and valid quality evaluation were proposed from the points of evaluation period and evaluation criteria.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.14 no.8
• /
• pp.3732-3738
• /
• 2013

This study was conducted to compare the evaluation scores among different evaluation agents-tutor, peer and self evaluation. It also aimed to identify the correlations among the evaluation agents and each agent's influencing factors that can have impact on PBL evaluation. 105 nursing students who had PBL methods in their learning had 3 different tutor, peer and self evaluation consecutively with the PBL Effectiveness Evaluation Tool. Self evaluation score was higher than both tutor and peer evaluation for 3 different evaluation. There was a significant correlation between tutor evaluation and peer evaluation. 'Problem solving ability' for tutor evaluation and 'Cooperative learning ability' for peer evaluation and self evaluation were the influencing factors.