• Title/Summary/Keyword: Research Performance Evaluation

Search Result 5,254, Processing Time 0.041 seconds

A Study on the Evaluation Model of Government-funded Research Institutes Using AHP (AHP를 이용한 정부출연연구소 평가 모형 연구)

  • Son, Eun Il;Baek, Chang Hwa
    • Journal of Korean Society for Quality Management
    • /
    • v.50 no.4
    • /
    • pp.665-677
    • /
    • 2022
  • Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

Relevance Analysis of Performance Evaluation Systems of Government S&T Research Groups (출연연구기관의 연구회 단위 기관평가제도의 적합성 분석)

  • Nam, Yeong-Ho;Kim, Byeong-Tae
    • Journal of Technology Innovation
    • /
    • v.14 no.3
    • /
    • pp.117-154
    • /
    • 2006
  • This research examines performance evaluatees' opinions regarding the current institutional performance evaluation systems of Government S&T Research Institutes (GRIs). Under the current evaluation systems, twenty GRIs are grouped into three Research Groups and each Group has its own evaluation systems. One problem of the current institutional evaluation systems is that the systems cannot reflect individual GRIs' characteristics. The following methods are used. First, based on four perspectives of Kaplan & Norton(1992)'s Balanced Scorecard(BSC) model, six perspectives appropriate to GRUs' characteristics are derived. Second, experts classify current performance evaluation measures into the six perspectives. This enables different evaluation systems of three GRI Research Groups to be compared under the same evaluation measures. Third, GRIs' evaluatees are asked to allocate appropriate weights on the performance measures. Evaluatees' weights of a GRI are compared with average weights of the related Group. Finally in every BSC's perspective, GRIs that have extraordinarily over-scored or under-scored weights are analyzed in terms of GRIs' missions, customers, capability of human resources, etc. In the Basic Research Group, the Korea Basic Science Institute is deviated in the financial perspective and the strategic direction perspectives. In the Public Research Group, Korea Institute of Construction Technology is significantly different from other GRIs in three perspectives. Five out of eight GRIs in the Industrial Research Group, GRIs are significantly different each other in several perspectives. It could be concluded that the current institutional evaluation systems are least appropriate in measuring performance of the GRIs of the Industrial Research Group.

  • PDF

A Study on Faculty Perception of Research Performance Evaluation (연구업적 평가에 관한 대학 교수 인식 연구)

  • Yong Hwan, Kim;Ji Hei, Kang;Jongwook, Lee;Younghee, Noh
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.56 no.4
    • /
    • pp.309-333
    • /
    • 2022
  • A survey was conducted to analyze the perceptions related to research performance evaluation from 2,618 professors. The survey is to find out the perception about two parts. One is a survey of professors' perceptions about the faculty performance evaluation, which is currently being conducted at each university. The other is that we analyzed the perception of the introduction of qualitative performance evaluation indicators, an alternative to the quantitative performance evaluation. As a result, we confirmed followings. Quantitative research performance evaluation is carried out in most universities. Research performance evaluation is not appropriate for a department or research field. And an extension of the evaluation period is required. Quantitative evaluation have a negative impact on the academic community. Quantitative evaluation needs to be improved. As regard to the introduction of the qualitative evaluation, we confirmed that professors perceived that qualitative evaluation is necessary to evaluate research performance, and they also have negative opinions about introduction of qualitative evaluation.

A Study on the Development and Application of Performance Evaluation Model for Defense Standard Improvement Projects (국방규격 개선사업의 성과평가모형 개발 및 적용방안 연구)

  • Lee, Min Cheol;Kim, Young Hyun;Ahn, Young Jun;Kim, Jun Su
    • Journal of Korean Society for Quality Management
    • /
    • v.51 no.2
    • /
    • pp.185-202
    • /
    • 2023
  • Purpose: The purpose of this study is to identify key performance evaluation items and factors that are effective and practical for project management of defense standard standard improvement projects, and to develop a quantitative performance evaluation model. Methods: For the development of a performance evaluation model for defense standard improvement projects, we analyzed past major project performance and derived evaluation items and factors. To increase the objectivity and efficiency of project evaluation, we developed an evaluation index that enables relative evaluation of evaluation targets, and calculated the main importance of evaluation items using the Analytic Hierarchy Process (AHP) method based on the main opinions of expert groups. Results: The study resulted in the identification of main performance items for defense standard improvement projects, which were classified into defense standard conformity review performance and defense standard improvement performance items. We also simplified the evaluation model by integrating various evaluation items into similar evaluation factors. Additionally, we developed a quantitative evaluation index that enables relative evaluation of the targets and verified the objectivity and validity of the suggested performance evaluation model by reevaluating it using performance data from past commissioned professional institutions Conclusion: Developing a quantitative evaluation model for defense standard improvement projects is expected to provide a means of measuring the effectiveness of the project, and to be used as a tool to determine the appropriateness and effectiveness of medium and long-term project plans.

A Study on Improvements of Research Performance Evaluation for Enhancing the Soundness of Academic Activities (학술 활동 건전성 제고를 위한 연구업적평가 개선에 관한 연구)

  • Younghee, Noh;Ji Hei, Kang;Yong Hwan, Kim;Jeong-Mo, Yang;Jongwook, Lee
    • Journal of the Korean BIBLIA Society for library and Information Science
    • /
    • v.33 no.4
    • /
    • pp.93-114
    • /
    • 2022
  • This study aims to propose the ways to improve the research performance evaluation to support the establishment of a sound research culture. For the study, we analyzed the cases of domestic and foreign research performance evaluation, and a survey and an interview were conducted for faculty and research performance evaluation officials, respectively. In the study, the direction of establishing the principle of research performance evaluation, the method of categorizing the type of research performance, the method and procedure of research performance evaluation, and necessary documents were proposed. First, eight principles were suggested to be considered in evaluating research achievements to ensure the validity, reliability, and transparency of the evaluation while supplementing the limitations of quantitative evaluation. Second, the main types of research achievements were categorized into journal articles, books, and presentations at academic conferences. Third, as a research achievement evaluation method, a hybrid evaluation using quantitative and qualitative and multiple measurement indicators was proposed. Fourth, a total of 11 steps (required 7 steps) were presented as a procedure for research achievement evaluation. Fifth, publications, evaluation documents, and committee chair's reports were proposed as major documents for research achievement evaluation. The research achievement evaluation improvement plan presented in this study should be flexibly applied in consideration of the characteristics of the academic and research fields and universities.

A Study on The Improvement for Professor Research Achievement Evaluation Applying a Case Study of Foreign Universities (외국대학 사례 조사를 통한 교수 연구업적평가 개선방안에 관한 연구)

  • Ji Hei Kang;Jongwook Lee;Yong Hwan Kim;Younghee Noh
    • Journal of Korean Library and Information Science Society
    • /
    • v.53 no.4
    • /
    • pp.211-232
    • /
    • 2022
  • Research performance evaluation has been based heavily on quantitative criteria. Various limitations however were revealed and the demand for excellence in research quality was growing and the importance of qualitative evaluation factors was increasing as well. The study investigates and introduces cases for improving research evaluation that have appeared around the world since 2010. To extract qualitative factors that can be introduced in research achievement evaluation in Korea this study investigated and organized the performance evaluation cases of foreign universities and proposed the introduction of the evaluation method in Korea. Qualitative evaluation factors were extracted by analyzing achievement evaluation documents evaluation procedures and evaluation standards of top 10 universities around the world. As a results this study proposes the use of various performance evaluation documents mulch-faceted evaluation and multi-level performance evaluation process and various qualitative performance evaluation standards. In traditional bibliometrics, while the degree of citation was measured when generating research evaluation indicators, future indicators may reflect recommendation scores as indicators, or include industrial connectivity and utilization in education / industry. It is hoped that the performance evaluation method will be balanced through this paper and ultimately the professor's research achievement evaluation will be a process that can help individuals grow into excellent researchers and develop the research environment.

Structural Relationship between Salesperson's Perceived Evaluation Fairness and Job Performance in the Financial Market (금융시장에서 영업사원의 지각된 평가 공정성과 직무성과 간의 구조적 관계)

  • Lee, Jun-Seop;Kim, Ji-Young;Lee, Han-Geun
    • Journal of Distribution Science
    • /
    • v.14 no.12
    • /
    • pp.141-151
    • /
    • 2016
  • Purpose - Salesperson perceptions of the fairness and accuracy of a performance evaluation system were examined by managerial and professional employees of large organization. The performance evaluation process is central to many personal decisions such as attitude for job and sales performance. This study investigates the relationship between perceived evaluation fairness, job satisfaction, organizational commitment, and sales performance. The main purpose of this study is to develop and empirically test a comprehensive model of salespersons' perceived evaluation fairness on sales performance. For this purpose, we identified the structural relationship between perceived evaluation fairness, job satisfaction, organizational commitment, and sales performance. Also we investigate the mediating effects on job satisfaction and organizational commitment between perceived evaluation fairness and sales performance. Research design, data, and methodology - To empirically test these relationships, data were collected by in-depth interviews from sales managers and questionnaire surveys from 300 salespersons who work for sales area (credit card company, insurance company). Demographically, the overall sample was 91.6% female, 77.9% 30s and 40s, and 34% college educated, with an average tenure with their present organizations of 4 years. The questionnaire was composed of total 20 items dealing with frequency, quality, and consequences of perceived evaluation fairness, job satisfaction, organizational commitment, and sales performance. To test the research hypotheses, collected data analyzed by confirmatory factor analysis (CFA) and structure equation model (SEM). Results - Through extensive and rigorous literature review process of related literature(Perceived evaluation fairness, Job satisfaction, Organizational commitment, Sales performance), research model and research hypothesis was set up. This study obtains the following research results. First, perceived evaluation fairness has a positive effect on job satisfaction, whereas the effects of perceived evaluation fairness on organizational commitment and sales performance did not show statistically significant result. Second, job satisfaction and organizational commitment have complete mediating roles to the relationship between perceived evaluation fairness and organizational commitment, and relationship between perceived evaluation fairness and sales performance. Conclusions - Based on the results, salespersons' perceived evaluation fairness is one of the key independent variable for making high job satisfaction, organizational commitment, and sales performance. Finally the theoretical, managerial implication and research limitations are mentioned in the discussion.

A Simple Procedure of Seismic Performance Evaluation for Unreinforced Masonry Buildings in Korea

  • Kim, Taewan
    • Architectural research
    • /
    • v.15 no.3
    • /
    • pp.159-166
    • /
    • 2013
  • This study was aimed at analyzing the three-step seismic performance evaluation procedure of Korea Infrastructure Safety Cooperation and proposing a new procedure suitable for unreinforced masonry buildings in Korea. For the study, it was investigated the performance evaluation results of five example URM buildings. First of all, it was found that the performance evaluation procedure for the URM buildings should be different from that for the other structural systems. As a result, a simple procedure of seismic performance evaluation was proposed, which includes elimination of elastic and inelastic push-over analysis and reduction of performance levels and evaluation steps. With the simple procedure, the URM buildings could be evaluated more easily than the other structures. It would be expected that the procedure can provide structural engineers with a simple and easy way to evaluate the seismic performance of the Korean URM buildings. Nevertheless, the procedure must be revised continuously by reflecting new research products for the URM buildings in Korea.

Designing a Hydro-Structural Ship Model to Experimentally Measure its Vertical Bending and Torsional Vibrations

  • Houtani, Hidetaka;Komoriyama, Yusuke;Matsui, Sadaoki;Oka, Masayoshi;Sawada, Hiroshi;Tanaka, Yoshiteru;Tanizawa, Katsuji
    • Journal of Advanced Research in Ocean Engineering
    • /
    • v.4 no.4
    • /
    • pp.174-184
    • /
    • 2018
  • We herein propose a new design procedure of a flexible container ship model where the vertical bending and torsional vibration modes are similar to its prototype. To achieve similarity in torsional vibration mode shapes, the height of the shear center of the model must be located below the bottom hull, similar to an actual container ship with large opening decks. Therefore, we designed a ship model by imparting appropriate stiffness to the hull, using urethane foam without a backbone. We built a container ship model according to this design strategy and validated its dynamic elastic properties using a decay test. We measured wave-induced structural vibrations and present the results of tank experiments in regular and freak waves.

Development of Evaluation Items and Measurement Indices for Knowledge Management Performance of Government-funded Research Institutes (정부출연연구소의 지식관리 성과 평가항목 및 측정지표 개발)

  • Jung, Taik-Yeong;Kim, Sang-Hoon;Park, Il-Kyu;Kim, Chang-Kyu
    • Journal of Information Technology Services
    • /
    • v.10 no.4
    • /
    • pp.171-189
    • /
    • 2011
  • KAs information and knowledge are increasingly becoming more important in the knowledge-driven society, knowledge management, as a very important management paradigm, is securing firm position in private and public sectors. Complying with this paradigm, government-funded research institutes in science-technology sector are actively utilizing knowledge management by employing knowledge management system and evaluating its applications' performance. The purpose of this study is to develop evaluation items and measurement indices to rationally measure knowledge management performance of the government-funded research institutes and to verify the feasibility of applying these evaluation items and indices. To achieve this research goal, the evaluation model of knowledge management performance was constructed by reviewing and integrating the existing studies, and subsequently, evaluation areas, evaluation items, measurement indices were derived from this evaluation model. Also, the feasibility analysis on the evaluation items and measurement indices was performed by means of FGI(Focus Group Interview) with the knowledge management experts belonging to Korean government-funded institutions in science-technology sector. The implications of this study are as follows : in theoretical perspective, this study has proposed a criterion frame to evaluate knowledge management performance, and has rationally drawn evaluation items and measurement indices from the criterion frame. And in practical perspective, this study has improved the validity and practicality of the measurement indices, which can lead to more reasonable and easier evaluation of knowledge management performance of the government-funded research institutes.