• Journal of the Korean Society for Library and Information Science
• /
• v.46 no.2
• /
• pp.245-260
• /
• 2012

This study aims to analyze the change in the correlation between the index values and qualitative quantitative evaluation elements by applying 'the decile of total number of articles' instead of the average annual number of articles in Kor-Factor2, and to evaluate the distinction ability between registered journals and register nominee journals of the KCI. The correlation between the index values and qualitative quantitative evaluation elements was analyzed by calculating the correlation coefficient between the index values and the evaluation elements, and then the correlation was compared with that of Kor-Factor2. To evaluate the distinction ability, we carried out independent samples t-test on the mean difference between index values of register nominee journal group and registered journal group and compared the mean difference with that of Kor-Factor2, IF and journal h-index. As a result, we found that the modified index applying the decile of total number of articles was effective in improving the balance among the correlation between the index values and qualitative quantitative evaluation elements compared to Kor-Factor2, and the new index appeared to be superior to other indexes on distinction ability of the journal's registration condition in the KCI.

• Journal of Information Science Theory and Practice
• /
• v.6 no.3
• /
• pp.45-60
• /
• 2018

Research performance evaluation in Korean universities follows strict guidelines that specify scoring systems for publication venue categories and formulas for co-authorship credit allocation. To find out how the standards differ across universities and how they differ from bibliometric research evaluation measures, this study analyzed 25 standards from major Korean universities and rankings produced by applying standards and bibliometric measures such as publication and citation counts, normalized impact score, and h-index to the publication data of 195 tenure-track professors of library and information science departments in 35 Korean universities. The study also introduced a novel impact score normalization method to refine the methodology from prior studies. The results showed the university standards to be mostly similar to one another but quite different from citation-driven measures, which suggests the standards are not quite successful in quantifying the quality of research as originally intended.

• Journal of Korean Library and Information Science Society
• /
• v.48 no.2
• /
• pp.295-322
• /
• 2017

As a first step in developing a more effective and robust approach to faculty research performance assessment, this study analyzed the existing faculty research assessment methods by comparing Korean universities' research evaluation standards, National Research Foundation of Korea's (KRF) standard for assessing research proposals, and various bibliometric measures. The study data included research evaluation standards of KRF along with 27 Korean universities with Library and Information Science (LIS) department, and the publication data of 183 LIS faculties in Korean universities from 2001 to 2015, which consisted of 3,863 papers 16,978 citations. After the comparative analysis of research evaluation standards, the study examined the rankings of institutions and faculty produced by applying the collected standards and bibliometric metrics to the publication data. The study showed that Korean university standards for research evaluation, which aim to consider both productivity and impact of faculty research, differ from similar bibliometric measures such as h-index, and the difference could significantly impact the assessment of faculty research performance.

• Journal of the Korean Society for Library and Information Science
• /
• v.38 no.4
• /
• pp.271-289
• /
• 2004

In this study, we analyze out citing and cited references among researchers, using KSCI (Korean Science Citation Index) database that is developed by KISTI. we generate and analyze that impact factor and immediate index with same method in JCR's. KSCI's impact factor and immediate index compared to JCR's, and with this basis, this study propose the need of development KSCI database and present new service model for evaluate of domestic journals.

• Journal of the Korean Society for information Management
• /
• v.34 no.3
• /
• pp.209-228
• /
• 2017

This study suggests a new Hirsch-type composite index, 'transposed g-index' with a different viewpoint on h-index and g-index. From this new point of view, the axes of the graph describing the h-index and g-index are transposed so that the horizontal axis corresponds to the citation frequency threshold and the vertical axis corresponds to the number of documents. Based on this transposed graph, a new indicator transposed g-index is suggested and applied to library and information science researchers' outcomes in Korean Citation Index database. The results show that this new index has more discriminating power than h-index and g-index, and is more sensitive to differences in quantitative aspects than quality of research. It is expected that the transposed g-index will be helpful for the multifaceted evaluation of the research outcome because it has differentiating characteristics that distinguish consistent researchers who continue to study from those who do not.

• Journal of the Korean Society for Library and Information Science
• /
• v.9
• /
• pp.99-118
• /
• 1982

This paper first reviews various techniques proposed for automatic indexing with special emphasis placed on statistical techniques. Frequency-based statistical techniques are categorized into the following three approaches for further investigation on the basis of index term selection criteria: term frequency approach, document frequency approach, and probabilistic approach. In the experimental part of this study, Pao's technique based on the Goffman's transition region formula and Harter's 2-Poisson distribution model with a measure of the potential effectiveness of index term were tested. Experimental document collection consists of 30 agriculture-related documents written in Korean. Pao's technique did not yield good result presumably due to the difference in word usage between Korean and English. However, Harter's model holds some promise for Korean document indexing because the evaluation result from this experiment was similar to that of the Harter's.

• Journal of Korean Library and Information Science Society
• /
• v.31 no.1
• /
• pp.87-114
• /
• 2000

The purpose of this study is offering appropriate system and training program to helf the system designer and the trainer in addition to analyze information use behavior about the web search tools and evaluate the estimated system by user groups. The results of the study are as follows $\circledS1$ It is desirable to consider age than other demographic variables in the case of web search tool. $\circledS2$ It is desirable to design Directory Search Tool in the case of web search tool which serves the student user group. $\circledS3$ An Intelligent Search Tool is more appropriate for the students who are using keyword search tool than any other tools. $\circledS4$ A discussion about standard classification of the web information should be accomplished soon because users feel confused in using web search tools due t o absence of standard mode of classification about classified item. $\circledS5$ Librarians need the cognition about data on internet s a source of information and need positive service and user training program about these information because student users hardly get help from librarians or library orientation for learning method to use web search tool. $\circledS6$ Internet use experience and years of computer use had effect on their use ability when using web search tool, whereas computer use experience, library use experience and Online Public Access Catalogs (OPAC) use experience had no effect on it. Especially, OPAC use experience had no effect on use ability of web search tool of student user group because student user groups had no information about internet and web search tool and they did not recognized the difference about search method between web search tool and OPAC. $\circledS7$In the case of web search tool, it si important to index the increasing web resource automatically by a searching robot. But in the case of student users, web search tool is much more needed to index by index expert due to the absence of ability about selecting and combining keyword.

• Journal of Korean Library and Information Science Society
• /
• v.40 no.3
• /
• pp.367-387
• /
• 2009

The similar bibliographic retrieval system follows whether it selects a thing of the extracted index term and or not the difference in which the similar document retrieval system There be many in the search result is generated. In this research, the method minimally making the error of the selection of the extracted candidate index term is provided In this research, the word information in which it is adjacent by using candidate index terms extracted from the similar literature and the keyword topic information were used. And by using the related author information and the reranking method of the search result, the similar bibliographic system in which an accuracy is high was developed. In this paper, we conducted experiments for similar bibliographic retrieval system on a collection of Korean journal articles of science and technology arena. The performance of similar bibliographic retrieval system was proved through an experiment and user evaluation.

• International Journal of Knowledge Content Development & Technology
• /
• v.11 no.3
• /
• pp.63-79
• /
• 2021

The KJC and KCI services operated by the National Research Foundation of Korea (NRF) need to refer to the global citation index database to set the service direction that researchers want and develop new functions. Therefore, in this study, the usability of Korea's KJC and KCI web databases was evaluated. In addition, FGI verification was performed for a group of experts on KJC and KCI improvement measures derived by academic information experts. The evaluation committee consisted of the researcher group, the society related group, the publisher (academic information distribution organization) group, and the policy-making organization group. A total of 16 experts performed usability evaluation and service improvement proposals for KJC and KCI services. As a result of usability evaluation of KJC and KCI web database using SUS measurement tool, KJC service was evaluated as 73.44, and KCI service was evaluated as good as 64.38. KJC improvement proposals were evaluated positively with 4 points or more for all improvement items, and KCI improvement proposals were positively evaluated with 3.5 points or more for all improvement items. Overall, KJC and KCI error improvements were evaluated with a score of 4 or more, showing strong affirmations. In the future, it is hoped that the improvement proposals and improvements proposed in this study will be applied to the development of KJC and KCI services, so that more quality services will be used by domestic researchers.

• Journal of the Korean Society for Library and Information Science
• /
• v.54 no.2
• /
• pp.399-417
• /
• 2020

In this study, we tried to analyze the relative importance of features for various functions provided by Discovery. We identified a total of 36 assessment items in five categories including contents, search function, serendipity, interactivity, and ease of use based on literature review. In order to objectively evaluate the relative importance of each evaluation element, an AHP technique was adopted. As a result, 'Easy of use' received the highest weighted value among the five categories, followed by 'contents', 'search function', 'interactivity', and 'serendipity'. In addition, among all the 36 assessment items, 'Quality of data for central index' had higher weighted value. These findings can be used as basic data to adopt a discovery tool for libraries.