Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 402

The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.

How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy

Open access
Cinelli, Marco, Kadziński, Miłosz, Gonzalez, Michael, Słowiński, Roman·2020·Omega

Abstract

Decision making is a complex task that involves a multitude of perspectives, constraints, and variables. Multiple Criteria Decision Analysis (MCDA) is a process that has been used for several decades to support decision making. It includes a series of steps that systematically help Decision Maker(s) (DM(s)) and stakeholders in structuring a decision making problem, identifying their preferences, and building a decision recommendation consistent with those preferences. Over the last decades, many studies have demonstrated the conduct of the MCDA process and how to select an MCDA method. Until now, there has not been a review of these studies, nor a proposal of a unified and comprehensive high-level representation of the MCDA process characteristics (i.e., features), which is the goal of this paper. We introduce a review of the research that defines how to conduct the MCDA process, compares MCDA methods, and presents Decision Support Systems (DSSs) to recommend a relevant MCDA method or a subset of methods. We then synthesize this research into a taxonomy of characteristics of the MCDA process, grouped into three main phases, (i) problem formulation, (ii) construction of the decision recommendation, and (iii) qualitative features and technical support. Each of these phases includes a subset of the 10 characteristics that helps the analyst implementing the MCDA process, while also being aware of the implication of these choices at each step. By showing how decision making can be split into manageable and justifiable steps, we reduce the risk of overwhelming the analyst, as well as the DMs/stakeholders during the MCDA process. A questioning strategy is also proposed to demonstrate how to apply the taxonomy to map MCDA methods and select the most relevant one(s) using real case studies. Additionally, we show how the DSSs for MCDA method recommendation can be grouped into three main clusters. This proposal can enhance a traceable and categorizable development of such systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.omega.2020.102261

Cites

98 of 98 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 98 references

Research works printed but not linked: 70

  1. Aires, 2018, The rank reversal problem in multi-criteria decision making: a literature review, Pesquisa Operacional, 38, 331, 10.1590/0101-7438.2018.038.02.0331 · doi:10.1590/0101-7438.2018.038.02.0331
  2. Angilella, 2018, Robust sustainable development assessment with composite indices aggregating interacting dimensions: The hierarchical-SMAA-Choquet integral approach, Knowledge-Based Syst, 158, 136, 10.1016/j.knosys.2018.05.041 · DOI
  3. Barrager, 2016, A new engineering profession is emerging: decision coach, IEEE Eng Manag Rev, 44, 33, 10.1109/EMR.2016.2568765 · doi:10.1109/emr.2016.2568765
  4. Bertola, 2019, A multi-criteria decision framework to support measurement-system design for bridge load testing, Adva Eng Inform, 39, 186, 10.1016/j.aei.2019.01.004 · doi:10.1016/j.aei.2019.01.004
  5. Bottero, 2013, A Choquet integral-based approach for assessing the sustainability of a new waste incinerator, Int J Multicrite Decis Mak, 3, 157
  6. Bouyssou, 2006, Aggregation-Overture. Pages 117-168
  7. Bouyssou, 2006, Numbers and Preferences. Pages 67-116
  8. Branke, 2016, Using Choquet integral as preference model in interactive evolutionary multiobjective optimization, Euro J Oper Res, 250, 884, 10.1016/j.ejor.2015.10.027 · doi:10.1016/j.ejor.2015.10.027
  9. Carrino, 2017, The Role of Normalisation in Building Composite Indicators. Rationale and Consequences of Different Strategies, Applied to Social Inclusion. Pages 251-289
  10. Celik, 2009, Establishing an international MBA program for shipping executives: managing OR/MS foundation towards a unique curriculum design. Pages 459-463
  11. Celik, 2009, Fuzzy axiomatic design extension for managing model selection paradigm in decision science, Expert Syst Appl, 36, 6477, 10.1016/j.eswa.2008.07.038 · doi:10.1016/j.eswa.2008.07.038
  12. Celik, 2009, Analytical modelling of shipping business processes based on MCDM methods, Maritime Policy Manag, 36, 469, 10.1080/03088830903346038 · doi:10.1080/03088830903346038
  13. Cicek, 2010, Multiple attribute decision-making solution to material selection problem based on modified fuzzy axiomatic design-model selection interface algorithm, Mater Des, 31, 2129, 10.1016/j.matdes.2009.11.016 · doi:10.1016/j.matdes.2009.11.016
  14. Cicek, 2010, An integrated decision aid extension to material selection problem, Mater Des, 31, 4398, 10.1016/j.matdes.2010.04.044 · doi:10.1016/j.matdes.2010.04.044
  15. Corrente, 2017, Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions, Ann Oper Res, 251, 117, 10.1007/s10479-015-1898-1 · doi:10.1007/s10479-015-1898-1
  16. Corrente, 2013, Robust ordinal regression in preference learning and ranking, Mach Learn, 93, 381, 10.1007/s10994-013-5365-4 · doi:10.1007/s10994-013-5365-4
  17. Dias, 2015, Multi-criteria environmental sustainability assessment with an additive model. Pages 450-470
  18. Dias, 2002, Exploring the Consequences of Imprecise Information in Choice Problems Using ELECTRE. Pages 175-193
  19. Dias, 2018, Elicitation: state of the Art and Science. Pages 1-14
  20. Ferretti, 2014, Decision making and cultural heritage: an application of the Multi-Attribute Value Theory for the reuse of historical buildings, J Cult Herit, 15, 644, 10.1016/j.culher.2013.12.007 · doi:10.1016/j.culher.2013.12.007
  21. Ferretti, 2015, An integrated framework to assess complex cultural and natural heritage systems with Multi-Attribute Value Theory, J Cult Herit, 16, 688, 10.1016/j.culher.2015.01.007 · doi:10.1016/j.culher.2015.01.007
  22. Figueira, 2009, A note on the paper, “Ranking irregularities when evaluating alternatives by using some ELECTRE methods”, by Wang and Triantaphyllou, Omega (2008), Omega, 37, 731, 10.1016/j.omega.2008.05.001 · doi:10.1016/j.omega.2008.05.001
  23. Figueira, 2016, ELECTRE Methods. Pages 155-185
  24. French, 1993, A manifesto for the new MCDA era, J Multi-Criter Decis Analy, 2, 125, 10.1002/mcda.4020020302 · doi:10.1002/mcda.4020020302
  25. Gasser, 2019, Indices under the spotlight: an Approach to Unveil and Manage the Implicit Trade-offs between Indicators. Pages 3445-3452
  26. Gershon, 1983, An Algorithm for Choosing of a Multiobjective Technique. Pages 53-62
  27. Granata, 2017, Tentative Reflections on Construction of Assessment Models for Buildings’ Sustainability Certification. Pages 501-515
  28. Greco, 2004, Axiomatic characterization of a general utility function and its particular cases in terms of conjoint measurement and rough-set decision rules, Eur J Oper Res, 158, 271, 10.1016/j.ejor.2003.06.004 · doi:10.1016/j.ejor.2003.06.004
  29. Greco, 2016, Decision Rule Approach. Pages 497-552
  30. Hanne, 2001, Critical Discourse on the MCDM Methodology and the Meta Decision Problem in MCDM. Pages 15-45
  31. Havranek, 2019, Multi-criteria decision analysis for environmental remediation: benefits, challenges, and recommended practices, Remed J, 29, 93, 10.1002/rem.21589 · doi:10.1002/rem.21589
  32. Kadziński, 2016, Integrated framework for preference modeling and robustness analysis for outranking-based multiple criteria sorting with ELECTRE and PROMETHEE, Inf Sci (Ny), 352
  33. Kadziński, 2020, Preference disaggregation for multiple criteria sorting with partial monotonicity constraints: application to exposure management of nanomaterials, Int J Approx Reason, 117, 60, 10.1016/j.ijar.2019.11.007 · doi:10.1016/j.ijar.2019.11.007
  34. Kadziński, 2013, DIS-CARD: a new method of multiple criteria sorting to classes with desired cardinality, J Glob Optim, 56, 1143, 10.1007/s10898-012-9945-9 · doi:10.1007/s10898-012-9945-9
  35. Kornyshova, 2007, MCDM techniques selection approaches: state of the Art. Pages 22-29
  36. Lahdelma, 2010, Stochastic Multicriteria Acceptability Analysis (SMAA). Pages 285-315
  37. Maggino, 2017, Dealing with Syntheses in a System of Indicators. Pages 115-137
  38. Mazziotta, 2017, Synthesis of Indicators: the Composite Indicators Approach. Pages 159-191
  39. Montibeller, 2020, A critical analysis of multi-criteria models for the prioritisation of health threats, Eur J Oper Res, 281, 87, 10.1016/j.ejor.2019.08.018 · doi:10.1016/j.ejor.2019.08.018
  40. Mousseau, 2006, Dealing with inconsistent judgments in multiple criteria sorting models, 4OR, 4, 145, 10.1007/s10288-005-0076-8 · doi:10.1007/s10288-005-0076-8
  41. Mousseau, 2004, Valued outranking relations in ELECTRE providing manageable disaggregation procedures, Eur J Oper Res, 156, 467, 10.1016/S0377-2217(03)00120-6 · doi:10.1016/s0377-2217(03)00120-6
  42. Mousseau, 2003, Resolving inconsistencies among constraints on the parameters of an MCDA model, Eur J Oper Res, 147, 72, 10.1016/S0377-2217(02)00233-3 · doi:10.1016/s0377-2217(02)00233-3
  43. Mulliner, 2013, An assessment of sustainable housing affordability using a multiple criteria decision making method, Omega, 41, 270, 10.1016/j.omega.2012.05.002 · doi:10.1016/j.omega.2012.05.002
  44. Munda, 2008, The Issue of Consistency: basic Discrete Multi-Criteria "Methods". Pages 85-109
  45. Munda, 2008, The Issue of Consistency: basic Methodological Concepts. Pages 57-84
  46. Ozernoy, 1987, A Framework for choosing the most appropriate discrete alternative multiple criteria decision-making method in decision support systems and expert systems. Pages 56-64
  47. Podinovski, 2010, Set choice problems with incomplete information about the preferences of the decision maker, Eur J Oper Res, 207, 371, 10.1016/j.ejor.2010.04.010 · doi:10.1016/j.ejor.2010.04.010
  48. Poh, 1998, A knowledge-based guidance system for multi-attribute decision making, Artif Intell Eng, 12, 315, 10.1016/S0954-1810(97)10001-2 · doi:10.1016/s0954-1810(97)10001-2
  49. Rhee, 2008, Evaluation of decision support systems. Pages 313-327
  50. Roland, 2012, Rank reversal as a source of uncertainty and manipulation in the promethee ii ranking. a first investigation. Pages 338-346
  51. Roy, 2016, Paradigms and Challenges. Pages 19-39
  52. Roy, 2014, Discriminating thresholds as a tool to cope with imperfect knowledge in multiple criteria decision aiding: theoretical results and practical issues, Omega, 43, 9, 10.1016/j.omega.2013.05.003 · doi:10.1016/j.omega.2013.05.003
  53. Roy, 2008, Handling effects of reinforced preference and counter-veto in credibility of outranking, Eur J Oper Res, 188, 185, 10.1016/j.ejor.2007.04.005 · doi:10.1016/j.ejor.2007.04.005
  54. Roy, 2013, Questions guiding the choice of a multicriteria decision aiding method, EURO J Deci Proces, 1, 69, 10.1007/s40070-013-0004-7 · doi:10.1007/s40070-013-0004-7
  55. Roy, 1992, Multicriteria programming of water supply systems for countryside, Water Resour Bull, 28, 13, 10.1111/j.1752-1688.1992.tb03151.x · doi:10.1111/j.1752-1688.1992.tb03151.x
  56. Seppälä, 2001, Decision analysis frameworks for life-cycle impact assessment, J Ind Ecol, 5, 45, 10.1162/10881980160084033 · doi:10.1162/10881980160084033
  57. Sironen, 2014, Variation of preference inconsistency when applying ratio and interval scale pairwise comparisons, J Multi-Criter Decis Analy, 21, 183, 10.1002/mcda.1500 · doi:10.1002/mcda.1500
  58. Słowiński, 2009, Rough sets in decision making. Pages 7753-7787
  59. Słowiński, 2014, Rough-set-based decision support. Pages 557-609
  60. Tecle, 1992, Selecting a multicriterion decision making technique for watershed resources management, J Am Water Resour Assoc, 28, 129, 10.1111/j.1752-1688.1992.tb03159.x · doi:10.1111/j.1752-1688.1992.tb03159.x
  61. Teghem, 1989, An interactive decision support system for multicriteria decision aid, Math Comput Model, 12, 1311, 10.1016/0895-7177(89)90370-1 · doi:10.1016/0895-7177(89)90370-1
  62. Tsoukiàs, 2002, From Concordance / Discordance to the Modelling of Positive and Negative Reasons in Decision Aiding. Pages 147-174
  63. Ulengin, 2001, An Artificial Neural Network Approach to Multicriteria Model Selection. Pages 101-110
  64. Volkart, 2016, Interdisciplinary assessment of renewable, nuclear and fossil power generation with and without carbon capture and storage in view of the new Swiss energy policy, Int J Greenhouse Gas Control, 54, 1, 10.1016/j.ijggc.2016.08.023 · doi:10.1016/j.ijggc.2016.08.023
  65. Wang, 2006, An approach to avoiding rank reversal in AHP, Decis Support Syst, 42, 1474, 10.1016/j.dss.2005.12.002 · doi:10.1016/j.dss.2005.12.002
  66. Watrobski, 2015, Knowledge management in MCDA domain. Pages 1445-1450
  67. Wątróbski, 2016, Guideline for MCDA method selection in production management area. Pages 119-138
  68. Wątróbski, 2016, An Ontology-Based Knowledge Representation of MCDA Methods. Pages 54-64
  69. Wątróbski, 2019, Generalised framework for multi-criteria method selection, Omega, 86, 107, 10.1016/j.omega.2018.07.004 · doi:10.1016/j.omega.2018.07.004
  70. Weistroffer, 2016, Multiple Criteria Decision Analysis Software. Pages 1301-1341

Metadata

Authors
Cinelli, M., Kadziński, M., Gonzalez, M., & Słowiński, R.
Venue
Omega
Publisher
Elsevier BV
Published
2020-10
Volume
96
Pages
102261
ISSN
0305-0483 (ISSN-L)
OpenAlex
W3021341554
Cited by
402
References
98
FWCI
28.68
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
  • H2020 Marie Skłodowska-Curie Actions (743553)
  • Narodowe Centrum Nauki (DEC-2019/34/E/HS4/00045)
  • Horizon 2020

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy. https://app.cochat.ai/papers/10.1016/j.omega.2020.102261
The paper
Cinelli, M., Kadziński, M., Gonzalez, M., & Słowiński, R. (2020). How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy. Omega. https://doi.org/10.1016/j.omega.2020.102261

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.