• Proceedings of the Technology Innovation Conference
• /
• 2009.02a
• /
• pp.413-433
• /
• 2009

질적인 측면을 충분히 감안하지 못한 양적 성과분석은 연구개발 과제의 성과를 제대로 반영하지 못하는 문제점을 안고 있다. 따라서 양적 성과와 질적 성과를 함께 종합적으로 고려할 수 있는 종합적인 성과분석지수를 개발할 필요가 있다. 본 연구에서는 주성분 분석과 동일 가중치를 부여하는 방식을 이용하여, 특허 출원 건수, SCI 게재논문 건수, 기술이전 건수라는 3가지 양적 성과지표와 이에 대응되는 특허 심사청구 항수, 논문게재 학술지의 IT, 총 연구비 대비기술료 비중의 3가지 질적 성과지표를 성과지표로 고려하면서 성과분석지수를 개발하고자 하였다. 주성분 분석의 적용 결과 특허 출원 건수(0.2160), SCI 논문게재 건수(0.1510), 기술이전 건수(0.1564), 특허 심사청구 항수(0.2257), 논문게재 학술지의 IF(0.2218), 기술료 비중(0.0291)의 가중치를 얻을 수 있었다. 이 6가지 평가지표는 종합평가지수라는 하나의 틀로 결합되어 개별 과제의 성과를 평가하는 데 활용될 수 있다. 더 나아가 양적 성과지표와 질적 성과지표로 구분하여 평가할 수 있다. 가중치 결정 방법에 따라 평가결과가 크게 달라지지는 않았지만, 가중치 결정 방법과 상관없이 양적 성과지표 평가결과와 질적 성과지표 평가결과는 크게 달랐다. 한 가지 흥미로운 점은 과제평가등급과의 상관관계를 따져보았더니 질적 성과지표와 과제등급과의 상관관계가 양적 성과지표와 과제등급과의 상관관계보다 더 크다는 것이다. 따라서 성과분석에 있어서 질적 성과지표를 반영한 질적 성과분석이 반드시 수행될 필요가 있다. 앞으로 특허 인용도 등 보다 다양한 질적 변수를 확보하여 성과분석지수를 보완할 필요가 있을 것이다.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2017.05a
• /
• pp.103-113
• /
• 2017

SCI(E)논문은 국가연구개발사업으로부터 도출되는 대표적 1차 산출 성과이며, R&D활동의 흐름을 파악할 수 있는 가장 중요한 지표 중 하나이다. 우리나라는 1980년대 50위권에 머물렀던 SCI(E)논문수가 1990년대를 거치면서 비약적으로 확대되었고, 최근 양적 규모 면에서는 세계 12위 수준을 유지할 만큼 괄목한 만한 성장을 이루었다. 최근 이러한 양적 확대 속에서, 논문의 질적 수준이 정체되고 있다는 문제점이 종종 거론되고 있다. 따라서 우리나라의 SCI(E)논문 성과가 가지는 질적 수준을 평가하기 위해 다양한 노력이 있어 왔다. 대표적인 SCI(E)논문의 질적 지표로 논문 피인용횟수와 저널 영향력지수가 있다. 그러나 이러한 지표는 학문 분야간 인용 특성을 반영하지 못하므로, 국내 연구자 사이에서도 다양한 순위보정영향력지수를 개발하고자 하는 시도가 있어 왔다. 본 논문에서는 그간 개발된 순위보정영향력지수를 추가적으로 보완하여, 보다 의미 있는 지표를 도출하고자 하였으며, 해당 지표를 국가연구개발사업 SCI(E)논문 성과에 적용하여 우리나라 SCI(E)논문 성과의 질적 수준을 검토하였다.

• 대학교육
• /
• s.148
• /
• pp.53-61
• /
• 2007

지금까지 대학교육의 질적인 측면을 평가하려는 다양한 지표 개발이 있었다. 교육의 성과를 간접적으로 평가하는 지표들이 대표적인 사례다. 하지만 지표들이 질적인 측면을 제대로 평가하지 못한다는 한계점을 드러내왔다. 이를 볼 때 커리큘럼 평가는 해당 분야의 전문가들을 대상으로 한 동료평가 방식으로 진행하는 것이 타당하며 통계상의 오류를 방지하기 위한 보완이 뒤따라야 할 것이다.

• Journal of Technology Innovation
• /
• v.30 no.3
• /
• pp.35-64
• /
• 2022

Currently, The budget expenditure for national R&D has been on the rise, and the quantitative performance in national R&D programs has been increasing accordingly. However, a growth of qualitative performance can not reach to an upward trend of quantitative performance. For a poor qualitative performance such as patent grades and technologies with low efficiency of technology transfer, the performance evaluation centered on "number of cases" is necessary to improve and start to introduce various "qualitative performance indicators". This paper focuses on "Triadic Patent Families" being measurable the overseas competitiveness of patent applied in major countries(the US, Europe and Japan). It analyzes the influencing factors to evaluate the quality of qualitative performance of R&D program. The result of this analysis shows a significant effect on the creating of triadic patent families within factors of R&D scale and project characteristics. This paper is significantly meaningful to expand insufficient triadic patent families to the target of interest rather than early study relatively, and to analyze the influencing factors of the creation of triadic patent families.

• Journal of the Korean Society for information Management
• /
• v.26 no.3
• /
• pp.377-394
• /
• 2009

There are some limitations in the existing bibliometric methods to satisfy the various requests of the interest parties including researchers, managers, policy makers to identify 1) which research group or researcher is the key player, and the overall trends of the particular technological sub-fields, 2) which research groups, institutions or countries mainly use their research outputs, 3) what are the spin-offs from research outputs to some scientific and technological fields, 4) in which levels they are when comparing their quantitative and qualitative research outputs to those of other competitive institutions. It is essential to develop new informetric indicators and methodologies in order to satisfy stakeholder's various demands and to strengthen qualitative analysis in measuring research performance. This study suggested informetric indicators such as article quality index, citation impact index, international cooperation index, excellent article production index and methodologies including citation analysis, text mining.

• Education of Primary School Mathematics
• /
• v.26 no.1
• /
• pp.29-43
• /
• 2023

The purpose of this study was to synthesize intervention studies, which utilized single case experimental design, on teaching mathematical word problems for elementary school students with disabilities and evaluate each of their methodological rigor. The researchers reviewed all studies from 2000 to 2022 that involved teaching mathematical word problems to individuals with disabilities. A total of 12 studies was included for a final analysis. Most of the interventions were delivered by researchers for about 30-40 minutes per session to elementary school students with disabilities. Schema-based instruction, cognitive-metacognitive strategy, and technology-based instruction were used as intervention methods, and explicit instruction was mostly used in conjunction with them. On the other hand, the researchers found that none of research articles met quality indicators for single case experimental design according to Cook et al. (2015). Limitation and directions for future research were also discussed.

• Korean Journal of Child Studies
• /
• v.26 no.1
• /
• pp.183-202
• /
• 2005

This study performed intensive indicators based on a model of economics of education. Trends of childcare in Korea were obtained by producing values developed with statistical data. Results showed that such simple initial indicator values as numbers of children, institutions and teachers have improved. However, intensive indicator values that take demographic and economic conditions into consideration have not reached the same rate of progress as the initial indicator values. In other words, qualitative growth remains at an unsatisfactory level in comparison to quantitative growth and to qualitative growth in members of the Organization for Economics Cooperation and Development (OECD).Thus, financial investment by the government should be expanded in order to reach the desired level of high quality in daycare for children.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2013.10a
• /
• pp.386-392
• /
• 2013

• Journal of Technology Innovation
• /
• v.21 no.1
• /
• pp.85-108
• /
• 2013

This paper introduces a new qualitative measurement indicator, Relatively Rank-normalized Impact Factor ($R^2nIF$) that can overcome drawbacks of the existing research performance measures. With the help of this innovative indicator, this study analyzes and compares the quality of research papers across countries and National Science Indicators (NSI) standard academic fields. The development of an improved bibliometric indicator for evaluating the quality of research papers and disentangling the "international" dimension of research performance will be of interest to academics and practitioners alike.

• Journal of Korea Technology Innovation Society
• /
• v.21 no.3
• /
• pp.1127-1154
• /
• 2018

This paper aims to contribute to estimating the value of a patent by explaining the unobservable attributes of patent quality using observable patent citation indices. The paper first constructs patent citation data and identifies firm, university, and research institute among assignees, and then tries to explain attributes of patent quality using backward citation indices. Backward citation indices carrying information about technological sources which a given patent is based on turn out to be good predictors of forward citation indices carrying information about attributes of patent quality. Finding the functional relationships between attributes of patent quality and backward citations will lead to the improved estimation and prediction of patent value. It is found out that backward citation indices are strongly correlated the technological diversity of a patent. The paper also suggests that with whom an organization chooses to collaborate affects the attributes of patent quality.