• Journal of Korean Society for Quality Management
• /
• v.41 no.4
• /
• pp.709-724
• /
• 2013

Purpose: The purpose of this study is to examine five evaluation models constructed by different normalization and aggregation methods in terms of the volatility of rankings and rank reversals. We also explore how the volatility of rankings of the five models changes and how often the rank reversals occur when the outliers are removed. Methods: We used data published in the Complete University Guide 2014. Two universities with missing values were excluded from the data. The university rankings were derived by using the five models, and then each model's volatility of rankings was measured. The box-plot was used to detect outliers. Results: Model 1 has the lowest volatility among the five models whether or not the outliers are included. Model 5 has the lowest number of rank reversals. Model 3, which has been used by many institutions, appears to be in the middle among the five in terms of the volatility and the rank reversals. Conclusion: The university rankings vary from one evaluation model to another depending on what normalization and aggregation methods are used. No single model exhibits clear superiority over others in both the volatility and the rank reversal. The findings of this study are expected to provide a stepping stone toward a superior model which is both reliable and robust.

• Journal of the Korea Safety Management & Science
• /
• v.6 no.4
• /
• pp.107-122
• /
• 2004

This study aims to examine the usefulness on the Evaluation Process for the Feasibility & Priority of A Certain Public Projects. and the Methodology used AHP(Analytic Hierarchy Process) which used pairwise comparisons of the alternatives and criteria for solving discrete alternative multicriteria decision problems. In this paper, we present a similar phenomenon, rank reversal problem, when we apply the AHP to group decision making process. The problem is identified by an example problem in that the previous rank order of Public Projects choices. we also present three different methods to prevent the undesirable characteristic of the original AHP in appling to Decision Making Process.

• Journal of the Korea Safety Management & Science
• /
• v.10 no.2
• /
• pp.211-216
• /
• 2008

Using this model, SN ratio of taguchi method for each of subjective factors as well as values of weights are used in this comprehensive positioning method for product. A example is presented to illustrate the model and to show a rank reversal when compared to a model that eliminates the highest and lowest customers' values allocating the weights and the subjective factors.

• Journal of the Korea Safety Management & Science
• /
• v.1 no.1
• /
• pp.91-100
• /
• 1999

We propose a decision model to incorporates the values assigned by a group of experts on different factors in selecting robots. Using this model, SN ratio of taguchi method for each of subjective factors as well as values of weights are used in this comprehensive method for robot selection. A numerical example is presented to illustrate the model and to show a rank reversal when compared to a model that does not eliminate extreme values and eliminates the highest and lowest experts' values allocating the weights and the subjective factors.

• Proceedings of the Safety Management and Science Conference
• /
• 1999.11a
• /
• pp.537-540
• /
• 1999

We propose a decision model to incorporates the values assigned by a group of experts on different factors in selecting robots. Using this model, SN ratio of taguchi method for each of subjective factors as well as values of weights are used in this comprehensive method for robot selection. A numerical example is presented to illustrate the model and to show a rank reversal when compared to a model that does not eliminate extreme values and eliminates the highest and lowest experts' values allocating the weights and the subjective factors.

• Journal of Korea Water Resources Association
• /
• v.50 no.2
• /
• pp.121-128
• /
• 2017

In this study, robustness index and uncertainty analysis were proposed to quantify the risk inherent in the process of climate change vulnerability assessment. The water supply vulnerability for six metropolitan cities (Busan, Daegu, Incheon, Gwangju, Daejeon, and Ulsan), except for Seoul, were prioritized using TOPSIS, a kind of multi-criteria decision making method. The robustness index was used to analyze the possibility of rank reversal and the uncertainty analysis was introduced to derive the minimum changed weights of the criteria that determine the rank reversal between any paired cities. As a result, Incheon and Daegu were found to be very vulnerable and Daegu and Busan were derived to be very sensitive. Although Daegu was relatively vulnerable against the other cities, it can be largely improved by developing and performing various climate change adaptation measures because it is more sensitive. This study can be used as a preliminary assessment for establishing and planning climate change adaptation measure.

• Journal of the Korean Operations Research and Management Science Society
• /
• v.19 no.3
• /
• pp.53-62
• /
• 1994

Complex decision-making problems are often characterized by multicriteria phenomena and fuzziness inherent in the structure of information and therefore suitable scientific solution methods. Especially, when similar dependent criteria are introduced, the problems become more complex. This paper presents a fuzzy intersectional dependence relation model for this kind of multicriteria decision-making problems. The model we propose is based on the fuzzy relation from fuzzy systems theory. In ths case of introducing similar dependent criteria, the rank reversal by distortion of weights is hard to occur by our proposed method. A numerical example is presented to illustrate the use of the model.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.24 no.1
• /
• pp.42-54
• /
• 1996

Many of urban parks which have been designated for urban planning regulation are not well developed because the priority of investment is inferior to that of other public facilities. Park development is an urgent urban policy and it is hard to decide priority among parks. Therefore, it is necessary to evaluate the priority of park development. Thus the Analytic Hierarchy Process has been introduced because it is suitable for achieving objectivity by collecting the professional opinions. The goals of park development are evaluated by AHP method and the priorities among goals are conservation of natural environment, satisfying the residents' residents' needs, population density, regional pollution, land acquisition cost, ratio of greeneries and facilities within park areas. Priority of park development is decided by the standardization of each individual inventory data and considering of the professional opinions. Among the multi-attribute judgement methods, AHP method may be the most widely used. Despite the critical evaluations of the AHP, such as limitation of the nine-point scale and the rank reversal problem, application of AHP to decide the priority of park development is suitable for actual circumstances.

• Management Science and Financial Engineering
• /
• v.16 no.1
• /
• pp.17-46
• /
• 2010

This paper studies six different AHP (Analytic Hierarchy Process) approaches and suggests that the features of the approaches are classified by application circumstances in order to contribute to the applicability and quality usage of the AHP. Our study investigates the hierarchical principles and characteristics of the AHP, and historical debates on the AHP evaluation in which the six approaches have been involved. One of six approaches is an ANP (Analytic Network Process) application that is directly connected to AHP usage. The application differences among the six approaches are validated with a plain example. Then, the four circumstances of AHP applications are classified by two dimensions: the first dimension is whether or not the importance (weights) of criteria is independent of restrictively setting alternatives, and the second dimension is whether or not preference (priorities) of alternatives is independent of adding alternative(s) to or removing alternative(s) from the considering set of alternatives. Then featuring way of weighting criteria is classified. We suggest the distinguishing manners and describe the implications of the AHP application. Finally, we discuss rank reversal and multiplicative AHP.

• Journal of Korean Society for Quality Management
• /
• v.33 no.1
• /
• pp.64-72
• /
• 2005

The ever increasing demand for enhanced competitiveness of engineered products requires "designing-in-quality" strategies that can effectively and efficiently incorporate concepts of uncertainty and quality into design. Multi-attribute utility function is commonly used to represent the decision-maker's preference on multiple design attributes under conditions of uncertainty and risk. One of the major issues in implementing this approach concerns the generation of appropriate utility function, especially in a complex engineering design environment. Typically, the decision maker's preference is revealed through lottery questions rather than being structured on the deductive reasoning to reflect the nonlinear tradeoffs among the attributes. The use of such intuitive procedures can lead to inexact preference information that may result in inaccuracy and rank reversal problems. This paper presents an alternative procedure based on the pair-wise comparisons between design alternatives towards a consistent preference presentation in assessing multiplicative utility function. The effectiveness of the overall procedures is tested with the aid of an injection-molding process design for a capacitor can and the results are discussed.