• 품질경영학회지
• /
• 제50권4호
• /
• pp.665-677
• /
• 2022

Purpose: The purpose of this study is to analyze the current status and investigate relevant indicators so that R&D performance evaluation suitable for government-funded research institutes can proceed. A suitable performance evaluation model was presented based on the surveyed indicators. Based on the presented performance evaluation model, the importance was analyzed to calculate the weight for each indicator of the performance evaluation model. Methods: The method applied in this study presented a performance evaluation model based on the organizational performance evaluation cases of advanced overseas countries. By using the AHP(Analytic Hierarchy Process) technique, the weight of each indicator of the performance evaluation model was studied. Results: As a result of examining the indicators necessary for the evaluation model, focusing on overseas cases, 13 evaluation items were derived. A weight was calculated for the importance of the study results. And the scientific/technical research results showed the highest excellence. Conclusion: Key indicators of performance evaluation suitable for government-funded research institutes were derived and presented through detailed modeling in three stages. A realistic model that can objectively evaluate the performance of government-funded research institutes was proposed using the AHP technique.

• 농촌계획
• /
• 제20권3호
• /
• pp.121-130
• /
• 2014

This study aimed at setting up the evaluation indicators system by rural village types to identify systematically the multi-valuedness embedded in rural villages. AHP(Analytic Hierarchy Process) was used for evaluating the relative importance weight evaluation of each indicator and quantitative analysis of rural village through computer works. The importance weight of evaluation indicators was converted into the score on the basis of maximum 1,000 point to increase the practicality. As a result, characteristics of 5 rural village types(Basic life-supporting, Agricultural promotion, Marketing/processing oriented, Urban-rural communication, Life-style choice types) differed in score of classified indicators. Also, These results are expected to be possible to quantitatively evaluate characteristics by rural village types.

• 대한간호학회지
• /
• 제40권1호
• /
• pp.69-77
• /
• 2010

This methodological research was designed to develop performance evaluation key indicators (PEKIs) for management by objectives (MBO) and to estimate their weights for hospital nurses. Methods: The PEKIs were developed by selecting preliminary indicators from a literature review, examining content validity and identifying their level of importance. Data were collected from November 14, 2007 to February 18, 2008. Data set for importance of indicators was obtained from 464 nurses and weights of PEKIs domain was from 453 nurses, who worked for at least 2 yr in one of three hospitals. Data were analyzed using $X^2$-test, factor analysis, and the Analytical Hierarchy Process. Results: Based upon Content Validity Index of .8 or above, 61 indicators were selected from the 100 preliminary indicators. Finally, 40 PEKIs were developed from the 61 indicators, and categorized into 10 domains. The highest weight of the 10 domains was customer satisfaction, which was followed by patient education, direct nursing care, profit increase, safety management, improvement of nursing quality, completeness of nursing records, enhancing competence of nurses, indirect nursing care, and cost reduction, in that order. Conclusion: PEKIs and their weights can be utilized for impartial evaluation and MBO for hospital nurses. Further research to verify PEKIs would lead to successful implementation of MBO.

• 지식경영연구
• /
• 제10권2호
• /
• pp.65-84
• /
• 2009

The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach's ${\alpha}$ coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.

• 인간식물환경학회지
• /
• 제24권3호
• /
• pp.245-256
• /
• 2021

Background and objective: The vitalization of urban agriculture has increased various forms of experience-based education using school gardens, which raised the importance of school gardens in terms of value as well as the need to develop an implementation system for education-based agricultural experience service using school gardens. Thus, we reset the evaluation indicators from the previous study to establish objective evaluation indicators that enable quantitative comparison of school garden education services. Methods: Analytic hierarchy process (AHP) and direct question (DQ) surveys were conducted on 20 experts from October 12 to 19, 2020 after establishing the purpose and subjects of evaluation, and then the weights were calculated using the Expert Choice 2010 program. Results: First, we analyzed the problems of the previous indicators by categorizing the performance indicators and comparing and verifying them with six requirements of valuation. Then, we added 'welfare values' and established sub-indicators accordingly. The importance of value indicator in AHP was in the order of education values (0.544), health values (0.182), welfare values (0.164), environmental values (0.062), and economic values (0.049). The importance of environmental and economic values was relatively low, less than 0.1. The importance of sub-indicators was highest in cultivating character (0.144), followed by enhancing ecological sensitivity (0.141) > promoting mental health (0.134) > cultivating agricultural literacy (0.120) > improving social skills (0.104). And mitigating climate change in environmental values was lowest (0.009). Increase in income was the lowest (0.036). This can be regarded as the expression of change to increase the educational effect based on collective life and the connotative meaning of 'school'. In the case of DQ, the AHP weight and order were the same, but the environmental and economic values were relatively low, and the result was different from AHP weight. For sub-indicators, the importance in DQ was highest in promoting mental health (0.136), followed by promoting physical health (0.085), ]cultivating character (0.082), social integration (0.072), and enhancing ecological sensitivity (0.071). After reviewing related experts, we came up with 5 evaluation indicators and 16 sub-indicators for school garden education service, which are objective evaluation indicators that enable quantitative comparison. Conclusion: In the future, we will validate the socioeconomic values of school garden education services and contribute to revitalizing school gardens by establishing policy alternatives for effective operation and management of school gardens.

• 한국주거학회논문집
• /
• 제28권2호
• /
• pp.47-56
• /
• 2017

Sustainable development is one of the important concept of the 21st century. Especially, Social sustainability is an important factor in today's society with the weakened community, and is needed exploring social sustainability in the residential environment as a container of human life. The purpose of this study was to develop the evaluation indicators and evaluation system of social sustainability in residential environment. In order to develop evaluation indicators first, the delphi expert survey was conducted to assess the adequacy of selected the evaluation indicators in previous studies. Second, expert survey using the method of AHP was progressed in order to analyze importance and weight of evaluation indicators and was analyzed using Expert Choice. The findings of this study are as followings; the evaluation system was composed of locality, communality and organisms. The communality is the most important. The locality was composed of historical and cultural, reflection of regional identity and homogeneous of regions. Reflection of local identity is the most important in locality area. The communality was composed of social integration environment, community activities and the community space. The community activities are the most important in communality area. The organism was composed of employment, self-sufficiency, welfare, population, safety and housing. Safety is the most important in the organism area.

• Journal of Information Science Theory and Practice
• /
• 제4권1호
• /
• pp.21-29
• /
• 2016

Given the difference in research performance in various scientific fields, this study aims to weight and valuate current indicators used for evaluation of scientific productions (publications), in order to adjust these indicators in comparison to each other and make possible a more precise evaluation of scientific productions. This is a scientometrics study using documentary, evaluative, and survey techniques. The statistical population consisted of 106 top Iranian researchers, scientists, and scientific and research managers. Then their research résumé information was gathered and analyzed based on research questions. In order to compare values, the data gathered from research production performance of the population was weighted using Shannon entropy method. Also, the weights of each scientific production importance according to expert opinions (extracted from other works) was analyzed and after adjustment the final weight of each scientific production was determined. A pairwise matrix was used in order to determine the ratios. According to the results, in the area of engineering sciences, patents (0.142) in the area of science, international articles (0.074) in the area of humanities and social sciences, books (0.174), and in the area of medical sciences, international articles (0.111) had the highest weight compared to other information formats. By dividing the weights for each type of publication, the value of each scientific production compared to other scientific productions in the same field and productions of other fields was calculated. Validation of the results in the studied population resulted in very high credibility for all investigated indicators in all four fields. By using these values and normalized ratios of publication indicators it is possible to achieve precise and adjusted results, making it possible to feasibly use these results in realistic policy making.

• 환경영향평가
• /
• 제10권1호
• /
• pp.59-71
• /
• 2001

This study aims to propose a determinant model to select a method on calculating weight of each indicator for environmental evaluation. According to analyzing and comparing with three types of methods for calculating weights which are usually used to evaluate environment with indicators, the weights which were obtained by each type were all different from each other. This means that a differential weighting method must be applied to each of environmental evaluation studies. Therefore, a determinant model is required to determine weight-calculating methods. Three types of weighting methods, such as weighting by importance degree, weighting by eigen-value and weighting by analytic hierarchy process, were compared. Under the necessity, a determinant model was drawn for selecting a compatible method to calculate weights of indicators in environmental evaluation.

• 한국환경과학회지
• /
• 제22권4호
• /
• pp.397-406
• /
• 2013

With the methodology of AHP, this paper focuses on communication activities and their constituents in city parks, selecting 11 constituents, natural or artificial, and establishes an evaluation model on the basis of the analysis of the characteristics of tourists' communication activities in order to obtain the weight and order of importance of the constituents of communication activities space. First-grade indicators influence weight and the order of the constituents of communication activities space are: artificial constituents (0.6614) > natural constituents (0.3386). The weight and order of five secondary indicators attached to natural constituents: private space (0.1538) > shade tree (0.0955) > gentle slope mound (0.0474) > beautiful waterscape (0.0270) > sunshine lawn (0.0149); the weight and order of six secondary indicators attached to artificial constituents: field boundary (0.2865) > Leisure chairs (0.1843) > resting areas (0.0795) > appropriate square (0.0533) > tree-lined road (0.0352) > landscape sketch (0.0227).Using modern decision analysis methodology to research the relationship of environment constituent elements has great theoretical and practical significance for the scientific design and construction of suitable environment for human needs.

• Nuclear Engineering and Technology
• /
• 제46권1호
• /
• pp.81-92
• /
• 2014

This study suggests 5 evaluation criteria (safety and technology, environmental impact, economic feasibility, social factors, and institutional factors) and 24 evaluation indicators for a NFC (nuclear fuel cycle) derived using factor analysis. To do so, a survey using 1 on 1 interview was given to nuclear energy experts and local residents who live near nuclear power plants. In addition, by conducting a factor analysis, homogeneous evaluation indicators were grouped with the same evaluation criteria, and unnecessary evaluation criteria and evaluation indicators were dropped out. As a result of analyzing the weight of evaluation criteria with the sample of nuclear power experts and the general public, both sides recognized safety as the most important evaluation criterion, and the social factors such as public acceptance appeared to be ranked as more important evaluation criteria by the nuclear energy experts than the general public.