• Journal of the Korean Society for Library and Information Science
• /
• v.56 no.4
• /
• pp.309-333
• /
• 2022

A survey was conducted to analyze the perceptions related to research performance evaluation from 2,618 professors. The survey is to find out the perception about two parts. One is a survey of professors' perceptions about the faculty performance evaluation, which is currently being conducted at each university. The other is that we analyzed the perception of the introduction of qualitative performance evaluation indicators, an alternative to the quantitative performance evaluation. As a result, we confirmed followings. Quantitative research performance evaluation is carried out in most universities. Research performance evaluation is not appropriate for a department or research field. And an extension of the evaluation period is required. Quantitative evaluation have a negative impact on the academic community. Quantitative evaluation needs to be improved. As regard to the introduction of the qualitative evaluation, we confirmed that professors perceived that qualitative evaluation is necessary to evaluate research performance, and they also have negative opinions about introduction of qualitative evaluation.

• Journal of Korean Library and Information Science Society
• /
• v.53 no.4
• /
• pp.211-232
• /
• 2022

Research performance evaluation has been based heavily on quantitative criteria. Various limitations however were revealed and the demand for excellence in research quality was growing and the importance of qualitative evaluation factors was increasing as well. The study investigates and introduces cases for improving research evaluation that have appeared around the world since 2010. To extract qualitative factors that can be introduced in research achievement evaluation in Korea this study investigated and organized the performance evaluation cases of foreign universities and proposed the introduction of the evaluation method in Korea. Qualitative evaluation factors were extracted by analyzing achievement evaluation documents evaluation procedures and evaluation standards of top 10 universities around the world. As a results this study proposes the use of various performance evaluation documents mulch-faceted evaluation and multi-level performance evaluation process and various qualitative performance evaluation standards. In traditional bibliometrics, while the degree of citation was measured when generating research evaluation indicators, future indicators may reflect recommendation scores as indicators, or include industrial connectivity and utilization in education / industry. It is hoped that the performance evaluation method will be balanced through this paper and ultimately the professor's research achievement evaluation will be a process that can help individuals grow into excellent researchers and develop the research environment.

• Journal of Korea Technology Innovation Society
• /
• v.20 no.2
• /
• pp.271-291
• /
• 2017

This study measures and compares the performance of research and development (R&D) programs in government-funded research institutes (GRIs) in terms of qualitative and quantitative approaches to find out strategic insights for improving performance evaluation policy. In particular, we adopt the evaluation results from the real data of K institute in 2015 for a qualitative evaluation and the results of data envelopment analysis (DEA) for a quantitative evaluation. Comparative analysis of the R&D performance of 14 programs finds that the difference between the evaluation results of qualitative and quantitative approaches is significant. From this finding, we suggest several strategic directions to complement two approaches each other.

• The Journal of Fisheries Business Administration
• /
• v.42 no.3
• /
• pp.15-29
• /
• 2011

The Fish Stock Rebuilding Plan (FSRP) is evaluated as one of the most effective fisheries policies domestically and internationally. FSRP is a comprehensive fisheries policy, including target stock size, rebuilding period, application of management measures, and participation of fishermen. The performance outcomes of FSRPs have been partially evaluated for recommendation for stock rebuilding in Korea, while they are fully evaluated in other countries that have implemented FSRPs. The performance evaluation system for FSRP is very needed to enhance its effectiveness as one of fisheries policies. That is, the system where problems can be reconsidered, achieving targets can be evaluated, and the plan can be modified should be implemented. This study classified the performance evaluation of FSRP into the economic evaluation as a quantitative analysis and the policy evaluation as a qualitative analysis. In the economic evaluation, the sustainability of fishery resources, the stability of fishing business, the efficiency of fishery production, and efficient utilization of fishery resources can be considered. As analytical methods for the economic evaluation, the bioeconomic model, efficiency estimation model, the dynamic MEY model can be utilized. The qualitative evaluation is to assess the qualitative performances of FSRPs, including interviews and surveys with fishermen and fisheries experts. In the survey, many different items can be included by evaluation factors which are related to policies such as timeliness, transparency, effectiveness, etc. In addition, the study suggested the performance evaluation system and procedures for objective and efficient evaluation of FSRPs. In order to practically apply the developed performance evaluation model, the pilot project is needed. That is, from the application of pilot project, detailed research methods, effective procedures, and evaluation factors can be investigated.

• Journal of Hydrogen and New Energy
• /
• v.33 no.3
• /
• pp.232-239
• /
• 2022

This study performed qualitative and quantitative risk assessment of equipment for evaluating the protocol of hydrogen refueling stations and suggested measures to improve safety. Hazard and operability study was performed for qualitative risk assessment, and Hy-KoRAM was used for quantitative risk assessment. Through a qualitative risk assessment, additional ventilation devices were installed, simultaneous venting of the storage container was prohibited, and the number of repeated refilling of the evaluation equipment was identified to manage the number of fillings of the container. Through quantitative risk assessment, the area around the device was set as a restricted area when evaluating the station, and measures were suggested to reduce the frequency of accidents.

• Journal of the Korea Convergence Society
• /
• v.11 no.4
• /
• pp.1-9
• /
• 2020

This study draws implications by surveying and analyzing performance evaluation cases in Korea and overseas, and analyzes qualitative and quantitative performance evaluation indexes and evaluation models that fit the national R & D performance evaluation system through analysis of patent creation performance data or company status data. Also, in order to apply this to a specific group of companies with excellent exports and technical skills, we will conduct a case study on the performance analysis of patent strategy support projects based on the results of the survey. Although this study has some limitations in developing performance evaluation indicators due to the limited scope of business or business characteristics of the patent strategy support project, the qualitative evaluation system can be reviewed through previous studies and domestic and overseas case studies. Due to the problem of accessing and collecting data related to the performance of the support project, there is a limitation that performance analysis cannot be performed at a sufficient level. Nevertheless, after the completion of R&D support projects and patent strategy support projects, follow-up performance analysis can be performed through follow-up surveys. It is expected to be possible.

• Journal of Convergence for Information Technology
• /
• v.10 no.3
• /
• pp.48-57
• /
• 2020

This study focuses on the development of simple qualitative indicators for evaluating and selecting innovation leading companies that challenge National Award. Another purpose of this study is to complement the aspect in which the innovative or value of the companies' products, technologies, and services is only quantitatively evaluated. Existing evaluation indicators of national award have too many evaluation items and were not suitable for innovation-based company evaluation. The research approach is to select category for developing qualitative indicators based on previous studies and TF discussion. From the input-process-output-outcome point of view, we have set up an indicator system as a series of flows. Finally, five categories such as creativity, system excellence, customer value, performance, and ripple effects are selected as qualitative indicator. For these selected indicators, conceptual definitions and the main points of evaluation are described. And the system level evaluation and the ADLI approach are presented for reference. The appendix also includes examples of qualitative and quantitative evaluation of real companies using these indicators. However, this study implies the possibility that the evaluation results may vary depending on the level and perspective of the evaluator. We hoped that detailed research on candidate indicators that can be used as qualitative indicators and research on the development of mixed indicators(qualitative and quantitative) will continue in the future.

• Journal of the Korean Society for Railway
• /
• v.10 no.4
• /
• pp.420-430
• /
• 2007

It is reported that many users of the subways in Seoul are not currently satisfied with the subway services. The cause of the dissatisfaction is that the qualitative items and indexes are not considered properly, and also does not diversify the evaluation items to follow the change of subway environment. Therefore in this study the evaluation items and indexes that can reflect of the subway users' characteristics are examined and synthesized. Then the characteristics of service are analyzed for the senior subway system users and junior subway system users that are classified with the cluster analysis. The result of the study is that the majority of users on subway are not satisfied the qualitative items which are safety, kindness, comfortableness, convenience excepting for punctuality and accessibility. So, if the service of subway users improve, the qualitative items is needed to consider with quantitative items.

• Journal of Technology Innovation
• /
• v.30 no.3
• /
• pp.35-64
• /
• 2022

Currently, The budget expenditure for national R&D has been on the rise, and the quantitative performance in national R&D programs has been increasing accordingly. However, a growth of qualitative performance can not reach to an upward trend of quantitative performance. For a poor qualitative performance such as patent grades and technologies with low efficiency of technology transfer, the performance evaluation centered on "number of cases" is necessary to improve and start to introduce various "qualitative performance indicators". This paper focuses on "Triadic Patent Families" being measurable the overseas competitiveness of patent applied in major countries(the US, Europe and Japan). It analyzes the influencing factors to evaluate the quality of qualitative performance of R&D program. The result of this analysis shows a significant effect on the creating of triadic patent families within factors of R&D scale and project characteristics. This paper is significantly meaningful to expand insufficient triadic patent families to the target of interest rather than early study relatively, and to analyze the influencing factors of the creation of triadic patent families.

• Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
• /
• 2006.11a
• /
• pp.277-280
• /
• 2006

Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision-making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. However, the objectives of maximising the degree of technical performance, maximising the safety levels and minimising the costs incurred are usually in conflict, and the evaluation of the technical performance, safety and costs is always associated with uncertainties, especially for a novel system at the initial concept design stage. In this paper, a design-decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. It is a Multiple Attribute Decision-Making (MADM) or Multiple Criteria Decision Making (MCDM) framework, which provides a juxtaposition of cost, safety and technical performance of a system during evaluation to assist decision makers in selecting the winning design/procurement proposal that best satisfies the requirement in hand. An illustrative example is used to demonstrate the application of the proposed framework.