Journal of Information Science Theory and Practice

Korea Institute of Science and Technology Information (한국과학기술정보연구원 과학기술정보센터)
권호 표지
DOI QR코드

DOI QR Code

Quantifying Quality: Research Performance Evaluation in Korean Universities

  • Yang, Kiduk (Department of Library and Information Science, Kyungpook National University) ;
  • Lee, Hyekyung (Department of Library and Information Science, Kyungpook National University)
  • Received : 2018.09.06
  • Accepted : 2018.09.14
  • Published : 2018.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Research performance evaluation in Korean universities follows strict guidelines that specify scoring systems for publication venue categories and formulas for co-authorship credit allocation. To find out how the standards differ across universities and how they differ from bibliometric research evaluation measures, this study analyzed 25 standards from major Korean universities and rankings produced by applying standards and bibliometric measures such as publication and citation counts, normalized impact score, and h-index to the publication data of 195 tenure-track professors of library and information science departments in 35 Korean universities. The study also introduced a novel impact score normalization method to refine the methodology from prior studies. The results showed the university standards to be mostly similar to one another but quite different from citation-driven measures, which suggests the standards are not quite successful in quantifying the quality of research as originally intended.

Keywords

References

  1. Adkins, D., & Budd, J. (2006). Scholarly productivity of U.S. LIS faculty. Library & Information Science Research, 28, 374-389. https://doi.org/10.1016/j.lisr.2006.03.021
  2. Budd, J. M., & Seavey, C.A. (1996). Productivity of U.S. library and information science faculty: The Hayes study revisited. Library Quarterly, 66(1), 1-20. https://doi.org/10.1086/602842
  3. Cronin, B., & Meho, L. I. (2006). Using the h-index to rank influential information scientists. Journal of the American Society for Information Science and Technology, 57(9), 1275-1278. https://doi.org/10.1002/asi.20354
  4. Drott, M. C. (1995). Reexamining the role of conference papers in scholarly communication. Journal of the American Society for Information Science, 46(4), 299-305. https://doi.org/10.1002/(SICI)1097-4571(199505)46:4<299::AID-ASI6>3.0.CO;2-0
  5. Hayes, R. M. (1983). Citation statistics as a measure of faculty research productivity. Journal of Education for Librarianship, 23(3), 151-172.
  6. Lee, H., & Yang, K. (2015). Comparative analysis of Korean universities' co-author credit allocation standards on journal publications. Journal of Korean Library and Information Science Society, 46(4), 191-205. https://doi.org/10.16981/kliss.46.201512.191
  7. Lee, H., & Yang, K. (2017). Comparative analysis of Korean universities' journal publication research performance evaluation standard. Journal of Korean Library and Information Science Society, 48(2), 295-322. https://doi.org/10.16981/kliss.48.2.201706.295
  8. Lee, J., & Yang, K. (2015). Co-authorship credit allocation methods in the assessment of citation impact of chemistry faculty. Journal of the Korean Society for Library and Information Science, 49(3), 273-289. https://doi.org/10.4275/KSLIS.2015.49.3.273
  9. Lisee, C., Lariviere V., & Archambault, E. (2008). Conference proceedings as a source of scientific information: A bibliometric analysis. Journal of the American Society for Information Science and Technology, 59(11), 1776-1784. https://doi.org/10.1002/asi.20888
  10. Yang, K., & Lee, J. (2012). Analysis of publication patterns in Korean library and information science research. Scientometrics, 93(2), 233-251. https://doi.org/10.1007/s11192-012-0663-3
  11. Yang, K., & Lee, J. (2013). Bibliometric approach to research assessment: Publication count, citation count, & author rank. Journal of Information Science Theory and Practice, 1(1), 27-41. https://doi.org/10.1633/JISTaP.2013.1.1.2