• Journal of Information Processing Systems
• /
• v.14 no.4
• /
• pp.916-925
• /
• 2018

The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting the citation quality to some extent. However, these frequency-based indicators are usually carried out based on the assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of the citing objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, we review various citation quality-based evaluation indicators, and categorize them considering the algorithms being applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.

• Journal of the Korean Society for information Management
• /
• v.28 no.2
• /
• pp.79-96
• /
• 2011

Despite the widespread use, critics claim that citation analysis has serious limitations in evaluating the research performance of scholars. First, conventional citation analysis methods yield one-dimensional and sometimes misleading evaluation as a result of not taking into account differences in citation quality, not filtering out citation noise such as self-citations, and not considering non-numeric aspects of citations such as language, culture, and time. Second, the citation database coverage of today is disjoint and incomplete, which can result in conflicting quality assessment outcomes across different data sources. This paper discuss the findings from a citation analysis study that measured the impact of scholarly publications based on the data mined from Web of Science, Scopus, and Google Scholar, and briefly describes a work-in-progress prototype system called CiteSearch, which is designed to overcome the weaknesses of existing citation analysis methods with a robust citation-based quality assessment approach.

• Journal of Korea Technology Innovation Society
• /
• v.21 no.3
• /
• pp.1127-1154
• /
• 2018

This paper aims to contribute to estimating the value of a patent by explaining the unobservable attributes of patent quality using observable patent citation indices. The paper first constructs patent citation data and identifies firm, university, and research institute among assignees, and then tries to explain attributes of patent quality using backward citation indices. Backward citation indices carrying information about technological sources which a given patent is based on turn out to be good predictors of forward citation indices carrying information about attributes of patent quality. Finding the functional relationships between attributes of patent quality and backward citations will lead to the improved estimation and prediction of patent value. It is found out that backward citation indices are strongly correlated the technological diversity of a patent. The paper also suggests that with whom an organization chooses to collaborate affects the attributes of patent quality.

• Journal of Korea Technology Innovation Society
• /
• v.19 no.4
• /
• pp.768-798
• /
• 2016

This study started from the awareness of the issue if the citation index newly introduced to evaluate the quality of papers satisfies the proper timing matter, which is a component of performance indicators for the evaluation of government-funded R&D institutes. Accordingly, the study will propose improvement ways to shift the previous evaluation system to quality evaluation for mission-oriented R&D institutes by analysing and using the periodical characteristics such as citation half-life and immediacy index of papers. As a result, it turned out that the speed of academic change is getting faster in proportion to the dependency on the technological development but that the citation speed in the field of public technology is relatively slower and the speed of knowledge transfer in the fields related to industry is faster. In addition, the citation index among the R&D fields showed no differences, and the minimum period for citation index measurement with validity should be over 6 years. The problems of evaluation for mission-oriented R&D institutes were deducted based on the technical and statistical analysis results of the temporal characteristic of citation necessary for quality evaluation of performance among R&D fields. To solve the problems, policy alternatives for object and valid quality evaluation were proposed from the points of evaluation period and evaluation criteria.

• Journal of the Korean Society for information Management
• /
• v.23 no.1 s.59
• /
• pp.221-241
• /
• 2006

This research suggested a new patent index based on patent citation technique using cited information, For this purpose, comparison research on library and patent information related citation database providing citation index was done. The information quality and meaning on the impact factor of JCR and the technology factor of CHI were reinterpreted. The former emphasizes the quality of continuous publication using relative citation frequency. The latter only emphasizes the information itself because it assesses the quality of patent characteristics. To overcome these difficulties, the latter re-authorized a relative quality to the organization possessing the patent using technology impact factor. Three new patent index were proposed on the basis of cited information to complement this. However, the comparative object was limited to American patent information that presented cited information of patent applied cases, and the comparison and research of domestic patent information could not be done.

• Journal of Korean Library and Information Science Society
• /
• v.47 no.2
• /
• pp.287-304
• /
• 2016

This paper introduces a new bibliometric measure called Quality Factor, which assesses multiple facets of faculty research performance. The computation of Quality factor is based on a combination of publication count, citation count, h-index, and Impact Factor. In order to analyze the relationship between Quality Factor and other bibliometric measures (publication count, citation count, h-index, g-index, Impact Factor), the study collected publication data of 189 Korean Library and Information Science professors from 2001 to 2014 to produce the rankings of the faculty by each bibliometric measure and computed Spearman's rank correlations between the rankings. The overall results showed Quality Factor to be correlated to citation-driven measures (citation count, h-index, g-index), but the scatterplot as well as rank-interval analysis showed Quality Factor to be distinctive and more discriminating than other measures.

• Proceedings of the Korea Technology Innovation Society Conference
• /
• 2016.05a
• /
• pp.404-430
• /
• 2016

This study started from the awareness of the issue if the citation index newly introduced to evaluate the quality of papers satisfies the proper timing matter, which is a component of performance indicators for the evaluation of government-funded R&D institutes. Accordingly, the study will propose improvement ways to shift the previous evaluation system to quality evaluation for mission-oriented R&D institutes by analysing and using the periodical characteristics such as citation half-life and immediacy index of papers. As a result, it turned out that the speed of academic change is getting faster in proportion to the dependency on the technological development but that the citation speed in the field of public technology is relatively slower and the speed of knowledge transfer in the fields related to industry is faster. In addition, the citation index among the R&D fields showed no differences, and the minimum period for citation index measurement with validity should be over 6 years. The problems of evaluation for mission-oriented R&D institutes were deducted based on the technical and statistical analysis results of the temporal characteristic of citation necessary for quality evaluation of performance among R&D fields. To solve the problems, policy alternatives for object and valid quality evaluation were proposed from the points of evaluation period, evaluation criteria, and evaluation management.

• Journal of Technology Innovation
• /
• v.27 no.4
• /
• pp.1-19
• /
• 2019

This study presents a new method to evaluate patents by public R&D program using patent citation network analysis. I used forward citation, degree centrality, betweenness centrality and page rank as the dependent variables which represents the quality of patents. I used primary independent variable as a dummy of public R&D program and controlled patents characteristics, applicant characteristics, technological characteristics and year effect. The empirical result shows that the patents of public R&D program is superior to other patents in regard to the number of forward citation, the degree centrality, the betweenness centrality and the page rank. This empirical result implies that patents of public R&D program directly and effectively connects technologies. Also patents from public R&D program connects important technologies.

• Korean Journal of Clinical Pharmacy
• /
• v.22 no.2
• /
• pp.131-136
• /
• 2012

Objective: This study evaluated and compared the adherence to the CONSORT for quality of reports on the randomized controlled trials (RCT) abstracts by four major Korean Science Citation Index (SCI) journals and The New England Journal of Medicine (NEJM). Methods: A descriptive analysis of published RCT abstracts in Korean SCI journals and NEJM from 2007/01 to 2011/06 was conducted by two reviewers, independently extracting data from a PubMed search. A modification of CONSORT for abstract was used including 16 checklist items. Reporting of checklist items for individual group was conducted to compare adherence patterns between two groups. Results: We identified the potential 57 RCT abstracts from Korean SCI and 50 from NEJM meeting our inclusion criteria; among them, three abstracts from Korean SCI and one from NEJM were excluded. Among total 16 checklist items based on CONSORT statement, Korean SCI journals and NEJM were statistically equivalent in 4 items; Korean journals were better in three items and NEJM were in nine. The methodological quality domains were inadequately reported in both journals: allocation concealment about 1.9% and 4.0%, and blinding 44.4% and 40.8%. In general, The CONSORT adherence of NEJM was better than that of Korean SCI in the method and result domain (p < 0.0001). Conclusions: The quality of NEJM reporting of RCT abstracts was better than that of Korean SCI, in general. This study on adherence of RCT reports from Korean SCI journals and NEJM abstracts to the CONSORT statement reveals that there is a need for improvement, especially Korean SCI. Further investigation on the quality of RCT reports and ways to improve reporting quality is required.

• Journal of Korean Society for Quality Management
• /
• v.44 no.1
• /
• pp.109-120
• /
• 2016

Purpose: This study developed a method of determining priorities for evaluating and revising defense standards. Methods: The proposed data integration and refinement methods are used to obtain component reliability information and to determine the frequency of component citation based on Pareto analysis. Based on the reliability information and the frequency of cited components, the target components for quality improvement can be determined and improved using various methods, such as engineering changes, special meetings, additional training, and revising the maintenance manual. Results: Based on the proposed process, we identified components that need to be improved in order to enhance the quality and reliability. Conclusion: Our process will improve the quality and reliability of weapon systems. The proposed process can be adopted for various weapon systems to enhance their quality and reliability, and to reduce military spending.