Decision Support
A new method for elicitation of criteria weights in additive models: Flexible and interactive tradeoff

https://doi.org/10.1016/j.ejor.2015.08.058Get rights and content

Highlights

  • FITradeoff (Flexible and Interactive Tradeoff) is a new elicitation MCDM method.

  • FITradeoff uses the tradeoff procedure for eliciting weights of an additive model.

  • FITradeoff uses the concept of flexible elicitation and has been built into a DSS.

  • The nature of information required is cognitively easier for the DM to grasp.

  • FITradeoff also reduces the amount of information required from the DM.

Abstract

This paper proposes the Flexible and Interactive Tradeoff (FITradeoff) method, for eliciting scaling constants or weights of criteria. The FITradeoff uses partial information about decision maker (DM) preferences to determine the most preferred in a specified set of alternatives, according to an additive model in MAVT (Multi-Attribute Value Theory) scope. This method uses the concept of flexible elicitation for improving the applicability of the traditional tradeoff elicitation procedure. FITradeoff offers two main benefits: the information required from the DM is reduced and the DM does not have to make adjustments for the indifference between two consequences (trade-off), which is a critical issue on the traditional tradeoff procedure. It is easier for the DM to make comparisons of consequences (or outcomes) based on strict preference rather than on indifference. The method is built into a decision support system and applied to two cases on supplier selection, already published in the literature.

Introduction

One of the most relevant issues in using a multicriteria decision model is probably that of evaluating the weights of criteria (or attributes) in the aggregation procedure. This is particularly relevant for aggregation using an additive model. In practice, this aggregation procedure is the most commonly found in a multicriteria decision model (Spliet & Tervonen, 2014), for instance when selecting suppliers (Xia & Wu, 2007), or planning of metro extension lines (Hurson & Siskos, 2014). The additive model can be applied under some basic assumptions covered by many earlier studies (Fishburn, 1967, Keeney, 1972, Keeney, 1992, Keeney and Raiffa, 1976). Stewart´s survey on multicriteria methods shows some useful characteristics for an additive model (Stewart, 1992). A more recent survey considers eliciting the weights of criteria as a central issue (Riabacke, Danielson, & Ekenberg, 2012). Eisenführ, Weber, and Langer (2010) give a broad overview on weights elicitation procedures for additive models.

Previous studies on experimental analysis (Borcherding et al., 1991, Weber and Borcherding, 1993) on the main elicitation procedures for additive models have identified some major difficulties and challenges. The results of these studies prompted our research and led to the original achievement proposals to overcome those issues that this article sets out. First of all, it has long been held that the tradeoff elicitation procedure (Keeney, 1992, Keeney and Raiffa, 1976) has a strong axiomatic foundation (Weber & Borcherding, 1993). Nevertheless, experimental studies have shown that inconsistencies have been found when applying this procedure (Weber & Borcherding, 1993).

The method proposed in this paper contributes to overcoming some of these inconsistencies. This paper proposes a flexible elicitation procedure, which collects information from the DM, and evaluates this information. The main difference from previous studies is related to the elicitation process. In flexible elicitation, incomplete or imprecise information, a priori, is not assumed. Whether the DM is or is not able to give complete information, this is evaluated in the elicitation process itself, in a flexible way. For this reason, right from the start, the flexible process seeks complete information, based on the tradeoff elicitation procedure. However, at any point further on, it may consider incomplete information in either of the following two situations: when a unique solution is found or when the DM is not able to give additional information.

The method is built into a DSS (decision support system), which uses a flexible elicitation concept that requires less effort from the DM (Decision Maker). Before presenting the method proposed and its DSS, a brief review of the related literature is presented. In order to illustrate how the method named FITradeoff (Flexible and Interactive Tradeoff) works, the DSS is used on two applications dealing with supplier selection problems (Barla, 2003, Xia and Wu, 2007).

Section snippets

Literature related to the additive model and the elicitation of weights

As previously stated, eliciting a criterion weight (ki) is probably the main concern of an additive model with regard to aggregating the value functions vi(xi) over the consequences xi for all criteria i (i = 1,…, n), which is represented (Fishburn, 1967, Keeney, 1972, Keeney, 1992, Keeney and Raiffa, 1976) in (1), usually assuming the normalization in (2). v(x)=i=1nkivi(xi).i=1nki=1andki0.

In many studies the use of the term scaling constant for ki is preferred to weight, considering that

FITradeoff: flexible and interactive tradeoff elicitation method

Before introducing FITradeoff, a brief, mostly qualitative, description of its logic and the rationale for using this process is presented, including a few related issues from previous studies. Then, basic aspects are presented of the procedure for eliciting weights employing tradeoffs (Keeney, 1992, Keeney and Raiffa, 1976), since this is the basis for FITradeoff.

FITradeoff method applied to supplier selection problems

Supplier selection is amongst the main problems studied in the management literature, in which many supplier selection multicriteria models may be found. As stated by Xia and Wu (2007), supplier selection is a multi-criteria decision making problem, which includes qualitative and quantitative criteria. Supplier selection is one of the most important issues in competitive strategies and in many situations a supplier selection problem is found to be associated with other related problems, such

Conclusions

This paper presents an elicitation method for implementing a multicriteria additive model, using the concept of flexible elicitation in order to improve the applicability of the classical tradeoff elicitation procedure. The method is built into a decision support system (DSS), which can be obtained upon request from the authors. It has been discussed and illustrated how the proposed method improved the elicitation process, compared with the classical tradeoff procedure, requiring less

Role of the funding source

This work had partial support from CNPq (the Brazilian Research Council). The CNPq was not involved in the study or in writing this paper.

Acknowledgments

The authors would like to acknowledge the Editor and the anonymous reviewers for their insightful and positive critique of a previous version of this paper in which they identified its potential and for making valuable suggestions by means of which they encouraged the authors to improve its presentation.

References (54)

  • JiménezA. et al.

    A decision support system for multiattribute utility evaluation based on imprecise assignments

    Decision Support Systems

    (2003)
  • KirkwoodC.W. et al.

    The effectiveness of partial information about attribute weights for ranking alternatives in multiattribute decision making

    Organizational Behavior and Human Decision Processes

    (1993)
  • MármolA.M. et al.

    Sequencial incorporation of imprecise information of multiple criteria decision processes

    European Journal of Operational Research

    (2002)
  • MustajokiJ.

    Effects of imprecise weighting in hierarchical preference programming

    European Journal of Operational Research

    (2012)
  • PoyhonenM. et al.

    On the convergence of multiattribute weighting methods

    European Journal of Operational Research

    (2001)
  • SaloA. et al.

    Rank inclusion in criteria hierarchies

    European Journal of Operational Research

    (2005)
  • SplietR. et al.

    Preference inference with general additive value models and holistic pair-wise statements

    European Journal of Operational Research

    (2014)
  • StewartT.J.

    A critical survey on the status of multiple criteria decision making theory and practice

    Omega

    (1992)
  • WeberM. et al.

    Behavioral infuences on weight judgments in multiattribute decision making

    European Journal of Operational Research

    (1993)
  • WeberM.

    Decision making with incomplete information

    European Journal of Operational Research

    (1987)
  • XiaW. et al.

    Supplier selection with multiple criteria in volume discount environments

    Omega

    (2007)
  • YangW.-E. et al.

    Multi-criteria semantic dominance: a linguistic decision aiding technique based on incomplete preference information

    European Journal of Operational Research

    (2013)
  • Bana e CostaC. et al.

    On the Mathematical Foundation of MACBETH

  • BarlaS.B.

    A case study of supplier selection for lean supply by using a mathematical model

    Logistics Information Management

    (2003)
  • BarronF.H. et al.

    Decision quality using ranked attribute weights

    Management Science

    (1996)
  • BarronF.H.

    Selecting a best multiattribute alternative with partial information about attribute weights

    Acta Psychologica

    (1992)
  • BorcherdingK. et al.

    Comparison of weighting judgments in multiattribute utility measurement

    Management Science

    (1991)
  • Cited by (191)

    • A multicriteria model for assessing maturity in industry 4.0 context

      2024, Journal of Industrial Information Integration
    • Preference change in stakeholder group-decision processes in the public sector: Extent, causes and implications

      2023, European Journal of Operational Research
      Citation Excerpt :

      We also propose that interactive, flexible elicitation deserves more attention. This could include eliciting some (fast and frugal) preference data from stakeholders (e.g., de Almeida et al., 2016) and making rough predictions for outcomes of alternatives, followed by preliminary sensitivity analyses. Results could then inform where next activities are best invested: making more precise predictions or using better methods to elicit stakeholder preferences.

    • Barriers and drivers of sustainable construction: a systematic literature review

      2024, International Journal of Services and Operations Management
    View all citing articles on Scopus
    View full text