• Title/Summary/Keyword: Evaluation indicators

Search Result 1,505, Processing Time 0.028 seconds

A Study on the Evaluation Model of Government-funded Research Institutes Using AHP (AHP를 이용한 정부출연연구소 평가 모형 연구)

  • Son, Eun Il;Baek, Chang Hwa
    • Journal of Korean Society for Quality Management
    • /
    • v.50 no.4
    • /
    • pp.665-677
    • /
    • 2022
  • Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

A Study on the Evaluating Indicators of the Level of Deterioration in High-rise and high-density Apartments (고층고밀 아파트단지의 노후도 평가지표 개발)

  • Cho, Sung-Heui;Lee, Tae-Kyung
    • Journal of the Korean housing association
    • /
    • v.20 no.4
    • /
    • pp.131-142
    • /
    • 2009
  • High-rise and high-density apartment complexes have been built and supplied on a large scale in the 1st period of the New Town project in metropolitan areas since the late 1980s. Now It has become necessary to improve those apartment complexes, which have serious deterioration problems for aging more than about 20 years accompanying simultaneity and a large scale. The purpose of this research is to develop the evaluating indicators to measure the level of deterioration of apartments inclusively and practically in order to regenerate apartments as sustainable residential environments. This study is composed of the following four parts; (a) establishing the conceptual model of evaluation of apartment deterioration, (b) selecting evaluation items, (c) constituting evaluation measurement, and(d)weighting evaluation indicators. First, deterioration of apartments was conceptualized by physical. social, and economical aspects in terms of sustainable development and proposed the conceptual model of hierarchy structure of evaluation of apartment deterioration by literature reviews. Second, evaluating items were selected based on literature reviews of existing indicators and preceding studies about apartments of Korea and foreign countries. The evaluating indicators were identified as a total of 77 evaluating items which were composed of three dimensions and 9 attributes on the basis of the conceptual model. They cover comprehensive scope of the apartment such as unit, building, complex, and site. Third, as the measurement, the 5 point ordinal scale measure was suggested. The evaluating measurement including measure standards, measure methods, and measure contents were developed by each evaluating items. Lastly, the weighting of evaluating indicators was analyzed by AHP method conducted by survey on the expert group. Items were identified as high contributors or low contributors. The weighting of these items could suggest several evaluations according to the situation. The evaluation of the level of deterioration can be done by both total evaluation and a specific field of evaluation. In addition, it is easy to grasp deteriorated attributes or dimensions by providing a radar and bar chart showing evaluation results. These evaluating indicators could be a useful tool to grasp actual methods for the regeneration of apartments.

Development and Application of Service Quality Indicators in Nursing Homes: Structure-Process Evaluation (노인요양시설의 서비스 질 평가 지표 개발 및 적용: 구조-과정 측면의 질 평가)

  • Kim, Moon-Sil;Lee, Seung-Hee
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.14 no.2
    • /
    • pp.131-143
    • /
    • 2008
  • Purpose: The aim of this study was to develop service quality indicators to evaluate structure and process of the nursing home service. Method: On the basis of literature review and analysis of existing quality indicators, the researcher made a preliminary service quality indicators and verified content validity twice. The final service quality indicators were applied in 30 nursing homes. Results: Preliminarily, 3 domains, 24 sub-domains, and 156 indicators were generated. Through two content validity testings, the indicators scoring over .80 CVI for each testing were adopted and modified by discussion with a panel of experts. The final indicators consisted of 3 domains, 15 sub-domains, and 128 indicators. These indicators were applied in 30 nursing homes. The result showed that they were easily applicable and suitable for a evaluation of service quality in nursing home. Conclusion: This 'service quality indicators in nursing home' was verified by the content validity. This tool will be able to be used for evaluation and improvement of nursing home service quality. However, repeated researches are needed for further validity and reliability.

  • PDF

A Study on Development of Evaluation Indicators for Measuring Educational Value of Libraries (도서관의 교육적 가치 측정을 위한 평가지표 개발에 관한 연구)

  • Noh, Younghee
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.51 no.4
    • /
    • pp.5-34
    • /
    • 2017
  • The purpose of this research is to develop evaluation indicators for evaluating the educational value of libraries and, for this, frist of all, preliminary evaluation indicators were derived by analyzing comprehensively about 60 domestic and overseas papers which researched on the value of libraries. On the basis of the derived preliminary evaluation indicators, 10 experts were selected and the final evaluation indicators were developed by conducting Delphi survey three times. The final evaluation indicators are composed of five evaluation areas, which are the divided areas of the educational value of libraries, such as the literacy improvement, supporting of learning and education, research supporting and provision of information resources, improvement of educational environment and quality of education, strengthen competence, 13 evaluation items, and 62 evaluation indicators. In the future, it seems that researches to measure the educational value of libraries based on this will have to be conducted.

Research on Development of Social Value Evaluation Indicators for Public Libraries (공공도서관의 사회적 가치 평가지표 개발에 관한 연구)

  • Noh, Younghee
    • Journal of the Korean Society for information Management
    • /
    • v.34 no.2
    • /
    • pp.181-214
    • /
    • 2017
  • The purpose of this research is to develop evaluation indicators for evaluating the social value of libraries and, for this, first of all, preliminary evaluation indicators were derived by analyzing comprehensively about 60 domestic and overseas papers which researched on the value of libraries. On the basis of the derived preliminary evaluation indicators, 11 experts were selected and the final evaluation indicators were developed by conducting Delphi survey three times. The final evaluation indicators are composed of five evaluation areas, which are the divided areas of the social value of libraries, such as the development of local communities, the linkage of local communities, the improvement of local residents' life quality, the equalization of local residents, and the information services necessary for local communities, 13 evaluation items, and 64 evaluation indicators. In the future, it seems that researches to measure the social value of libraries based on this will have to be conducted.

Analysis of Academic Evaluation Indicators Based on Citation Quality

  • Zhang, Mingyue;Shi, Jin;Wang, Jin;Liu, Chang
    • Journal of Information Processing Systems
    • /
    • v.14 no.4
    • /
    • pp.916-925
    • /
    • 2018
  • The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting the citation quality to some extent. However, these frequency-based indicators are usually carried out based on the assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of the citing objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, we review various citation quality-based evaluation indicators, and categorize them considering the algorithms being applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.

A Study on the Improvement of Evaluation Indicators of School Libraries in Korea (학교도서관 평가지표 개선방안에 관한 연구)

  • Kim, Sung-Jun
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.45 no.3
    • /
    • pp.5-26
    • /
    • 2011
  • The purpose of this study is to develop the evaluation indicators of school libraries in Korea. To do this, the indicators were extracted from an analysis of seven foregoing studies. The draft of evaluation indicators was made after reviewing the validity of each indicator according to the criteria: quantifiability, objectivity and possibility of obtaining evaluation materials. The feasibility of the standards and measures used by the Committee on Library and Information Policy was examined to improve the validity of new indicators. To decide the distribution of marks for evaluations, the opinions of teacher librarians and professionals on the importance of indicators was surveyed, the evaluation indicators used by the Committee on Library and Information Policy were analyzed, and an intensive review was done by professionals. A draft of an evaluation index with thirty indicators in six categories is proposed.

The Current State of and Barriers to Quality Measurement, and Quality Managers' Reported Evaluation on Quality Indicators in Korea (국내 질 향상부서 중심의 질 지표 측정 현황, 장애요인과 평가)

  • Hwang Jee-In
    • Health Policy and Management
    • /
    • v.15 no.4
    • /
    • pp.26-45
    • /
    • 2005
  • The purposes of this study were to Identify the .level of measurement on quality Indicators and evaluate the existing indicators in order to determine the priority of quality indicators' application in Korean general hospitals. A survey was conducted using a questionnaire. The subjects were quality managers working at general hospital having over 300 beds. The criteria were relevance, reliability, precision, impact, application, and preference to evaluate quality indicators. According to these six criteria, each indicator was evaluated on a five point scale(5: excellent, 1: poor). The response rate was $40.4\%$. The hospitals have monitored the average of 3.8 indicators(median 4). The indicators such as return to operating room, unplanned readmission, cancellation of booked operations, death, hospital infection, cesarean section rate, volume per disease or procedure, readmission, re-operation, blood transfusion, and post-procedural complications were frequently measured. The top ten quality indicators in the evaluation by its relevance, validity, reliability, impact, preference and application were decubitus ulcer, clean wound infection, fall, unplanned return to operation room, transfusion reactions, foreign body left In during procedure, unplanned readmission, wound infection after contaminated surgery, postoperative hemorrhage/hematoma, and cesarean section rate in order. The high priority quality indicators frequently measured could be used as primary national indicators. Standardized guidelines about monitoring indicators and the utilization will preliminarily be needed to compare and reuse the data for various purposes and improve the quality of care continuously.

Development of Indicators for Dredging Evaluation and Form on Erosion Control Dam Using the Delphi Technique and AHP Analysis (델파이 기법과 AHP를 이용한 중력식 사방댐 준설 평가지표 및 조사야장 개발)

  • Seo, Junpyo;Lee, Changwoo;Woo, Choongshik;Lee, Heonho
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.17 no.6
    • /
    • pp.1-15
    • /
    • 2014
  • A dredging on erosion control dam has been enforced without evaluation the factors that affect the dredging. In addition, there is the negative effect much more than positive effect by dredging on erosion control dam. Therefore, this study was carried out to develop evaluation indicators and to suggest fieldbook in order to determine whether sand deposits at erosion control dam should be dredged up or not. The most important six evaluation indicators that can decide to dredge up at erosion control dam were obtained from three round delphi technique and were selected in the following order: the current sand deposit ratio(0.339), existence of cultivated land and house downstream(0.276), the slope of streambed(0.162), the amount of movable soil and gravel(0.118), the history of any disasters(0.063), the basin area(0.043). The weighted score for each evaluation indicator were acquired from AHP analysis with respect to the degree of importance and then the modified weighted score for actual measurements were classified as three categories: large(2.53), medium(1.60) and small(1.01). Based on delphi technique, erosion control dam dredging evaluation fieldbook introduced the four evaluation indicators out of the total six evaluation indicators and two low effected evaluation indicators were excluded. This results showed that the values for reliability analysis and consistency ratio were acceptable.

Evaluating the Comfort Experience of a Head-Mounted Display with the Delphi Methodology

  • Lee, Doyeon;Chang, Byeng-hee;Park, Jiseob
    • Journal of Internet Computing and Services
    • /
    • v.21 no.6
    • /
    • pp.81-94
    • /
    • 2020
  • This study developed evaluation indicators for the comfort experience of virtual reality (VR) headsets by classifying, defining, and weighting cybersickness-causing factors using the Delphi research method and analytic hierarchical process (AHP) approach. Four surveys were conducted with 20 experts on VR motion sickness. The expert surveys involved the 1) classification and definition of cybersickness-causing dimensions, classification of sub-factors for each dimension, and selection of evaluation indicators, 2) self-reassessment of the results of each step, 3) validity revaluation, and 4) final weighting calculation. Based on the surveys, the evaluation indicators for the comfort experience of VR headsets were classified into eight sub-factors: field of view (FoV)-device FoV, latency-device latency, framerate-device framerate, V-sync-device V-sync, rig-camera angle view, rig-no-parallax point, resolution-device resolution, and resolution-pixels per inch (PPI). A total of six dimensions and eight sub-factors were identified; sub-factor-based evaluation indicators were also developed.