The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Analysis of the potentials of multi criteria decision analysis methods to conduct sustainability assessment
Open accessAbstract
Sustainability assessments require the management of a wide variety of information types, parameters and uncertainties. Multi criteria decision analysis (MCDA) has been regarded as a suitable set of methods to perform sustainability evaluations as a result of its flexibility and the possibility of facilitating the dialogue between stakeholders, analysts and scientists. However, it has been reported that researchers do not usually properly define the reasons for choosing a certain MCDA method instead of another. Familiarity and affinity with a certain approach seem to be the drivers for the choice of a certain procedure. This review paper presents the performance of five MCDA methods (i.e. MAUT, AHP, PROMETHEE, ELECTRE and DRSA) in respect to ten crucial criteria that sustainability assessments tools should satisfy, among which are a life cycle perspective, thresholds and uncertainty management, software support and ease of use. The review shows that MAUT and AHP are fairly simple to understand and have good software support, but they are cognitively demanding for the decision makers, and can only embrace a weak sustainability perspective as trade-offs are the norm. Mixed information and uncertainty can be managed by all the methods, while robust results can only be obtained with MAUT. ELECTRE, PROMETHEE and DRSA are non-compensatory approaches which consent to use a strong sustainability concept, accept a variety of thresholds, but suffer from rank reversal. DRSA is less demanding in terms of preference elicitation, is very easy to understand and provides a straightforward set of decision rules expressed in the form of elementary “if … then …” conditions. Dedicated software is available for all the approaches with a medium to wide range of results capability representation. DRSA emerges as the easiest method, followed by AHP, PROMETHEE and MAUT, while ELECTRE is regarded as fairly difficult. Overall, the analysis has shown that most of the requirements are satisfied by the MCDA methods (although to different extents) with the exclusion of management of mixed data types and adoption of life cycle perspective which are covered by all the considered approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Analytic Hierarchy Process
SAATY, T. L., & KEARNS, K. P. (1985) · Analytical Planning · doi:10.1016/b978-0-08-032599-6.50008-8 · Cited by 15,357
Brundtland, G. H. (1991) · Earth and Us · doi:10.1016/b978-0-7506-1049-0.50009-5 · Cited by 12,174
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Tsoukias, A., Keeney, R. L., & Raiffa, H. (1994) · The Journal of the Operational Research Society · doi:10.2307/2584151 · Cited by 8,370
Multiple Criteria Decision Analysis: State of the Art Surveys
Figueira, J., Greco, S., & Ehrogott, M. (2005) · International Series in Operations Research & Management Science · doi:10.1007/b100605 · Cited by 4,491
Multiple Criteria Decision Analysis: An Integrated Approach
Belton, V., & Stewart, T. J. (2001) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,724
How to select and how to rank projects: The Promethee method
Brans, J. P., Vincke, P., & Mareschal, B. (1986) · European Journal of Operational Research · doi:10.1016/0377-2217(86)90044-5 · Cited by 2,692
Review on multi-criteria decision analysis aid in sustainable energy decision-making
Wang, J.-J., Jing, Y.-Y., Zhang, C.-F., & Zhao, J.-H. (2009) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2009.06.021 · Cited by 2,346
Decisions with Multiple Objectives: Preferences and Value Tradeoffs.
Smith, A. F. M., Keeney, R. L., & Raiffa, H. (1977) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2345300 · Cited by 2,305
An overview of sustainability assessment methodologies
Singh, R. K., Murty, H. R., Gupta, S. K., & Dikshit, A. K. (2009) · Ecological Indicators · doi:10.1016/j.ecolind.2008.05.011 · Cited by 2,069
The outranking approach and the foundations of electre methods
Roy, B. (1991) · Theory and Decision · doi:10.1007/bf00134132 · Cited by 1,865
Decisions with Multiple Objectives: Preferences and Value Trade-Offs
Keeney, R. L., Raiffa, H., & Rajala, D. W. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310245 · Cited by 1,782
PROMETHEE: A comprehensive literature review on methodologies and applications
Behzadian, M., Kazemzadeh, R. B., Albadvi, A., & Aghdasi, M. (2010) · European Journal of Operational Research · doi:10.1016/j.ejor.2009.01.021 · Cited by 1,686
Rough sets theory for multicriteria decision analysis
Greco, S., Matarazzo, B., & Slowinski, R. (2001) · European Journal of Operational Research · doi:10.1016/s0377-2217(00)00167-3 · Cited by 1,637
Categorising tools for sustainability assessment
Ness, B., Urbel-Piirsalu, E., Anderberg, S., & Olsson, L. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2006.07.023 · Cited by 1,407
Multi-criteria decision analysis in environmental sciences: Ten years of applications and trends
Huang, I. B., Keisler, J., & Linkov, I. (2011) · Science of The Total Environment · doi:10.1016/j.scitotenv.2011.06.022 · Cited by 1,282
Multicriteria Methodology for Decision Aiding
French, S. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600981 · Cited by 1,280
Remarks on the Analytic Hierarchy Process
Dyer, J. S. (1990) · Management Science · doi:10.1287/mnsc.36.3.249 · Cited by 1,130
Conceptualising sustainability assessment
Pope, J., Annandale, D., & Morrison-Saunders, A. (2004) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2004.03.001 · Cited by 1,092
Ghosh, A., Mal, P., & Majumdar, A. (2019) · Advanced Optimization and Decision-Making Techniques in Textile Manufacturing · doi:10.1201/9780429504419-2 · Cited by 1,016
An Exposition of the AHP in Reply to the Paper “Remarks on the Analytic Hierarchy Process”
Saaty, T. L. (1990) · Management Science · doi:10.1287/mnsc.36.3.259 · Cited by 857
Mendoza, G. A., & Martins, H. (2006) · Forest Ecology and Management · doi:10.1016/j.foreco.2006.03.023 · Cited by 819
Encyclopedia of Complexity and Systems Science
(2020) · Springer eBooks · doi:10.1007/978-3-642-27737-5 · Cited by 750
Ranking irregularities when evaluating alternatives by using some ELECTRE methods
Wang, X., & Triantaphyllou, E. (2008) · Omega · doi:10.1016/j.omega.2005.12.003 · Cited by 616
Sustainability assessment: basic components of a practical approach
Gibson, R. B. (2006) · Impact Assessment and Project Appraisal · doi:10.3152/147154606781765147 · Cited by 533
Social Multi-Criteria Evaluation for a Sustainable Economy
Munda, G. (2008) · Springer eBooks · doi:10.1007/978-3-540-73703-2 · Cited by 514
van der Werf, H. M. G., & Petit, J. (2002) · Agriculture, Ecosystems & Environment · doi:10.1016/s0167-8809(01)00354-1 · Cited by 498
Saaty, T. L. (2016) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-1-4939-3094-4_10 · Cited by 472
Multi-Criteria Decision Analysis: Environmental Applications and Case Studies
Linkov, I., & Moberg, E. (2011) · Medical Entomology and Zoology · Cited by 434
Sustainability assessment: the state of the art
Bond, A., Morrison-Saunders, A., & Pope, J. (2012) · Impact Assessment and Project Appraisal · doi:10.1080/14615517.2012.661974 · Cited by 428
A critical review of reductionist approaches for assessing the progress towards sustainability
Gasparatos, A., El-Haram, M., & Horner, M. (2008) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2007.09.002 · Cited by 416
Multiplicative Utility Functions
Keeney, R. L. (1974) · Operations Research · doi:10.1287/opre.22.1.22 · Cited by 405
An Overview of ELECTRE Methods and their Recent Extensions
Figueira, J. R., Greco, S., Roy, B., & Słowiński, R. (2013) · Journal of Multi-Criteria Decision Analysis · doi:10.1002/mcda.1482 · Cited by 396
Sala, S., Farioli, F., & Zamagni, A. (2013) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-012-0508-6 · Cited by 295
Multiple Criteria Decision Analysis and Sustainable Development
Munda, G. (2006) · International Series in Operations Research & Management Science · doi:10.1007/0-387-23081-5_23 · Cited by 272
Decisions with Multiple Objectives: Preferences and Value Tradeoffs
Tsoukias, A. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.175 · Cited by 272
Maut — Multiattribute Utility Theory
Dyer, J. S. (2006) · International Series in Operations Research & Management Science · doi:10.1007/0-387-23081-5_7 · Cited by 269
Agri-Environmental Indicators to Assess Cropping and Farming Systems. A Review
Bockstaller, C., Guichard, L., Makowski, D., Aveline, A., Girardin, P., & Plantureux, S. (2008) · Agronomy for Sustainable Development · doi:10.1051/agro:2007052 · Cited by 266
Aggregating sustainability indicators: Beyond the weighted sum
Rowley, H. V., Peters, G. M., Lundie, S., & Moore, S. J. (2012) · Journal of Environmental Management · doi:10.1016/j.jenvman.2012.05.004 · Cited by 260
Selecting an Appropriate Multi-Criteria Decision Analysis Technique for Renewable Energy Planning
Polatidis, H., Haralambopoulos, D. A., Munda, G., & Vreeker, R. (2006) · Energy Sources Part B Economics Planning and Policy · doi:10.1080/009083190881607 · Cited by 258
Choosing the most appropriate sustainability assessment tool
Gasparatos, A., & Scolobig, A. (2012) · Ecological Economics · doi:10.1016/j.ecolecon.2012.05.005 · Cited by 246
The Use of Rough Sets and Fuzzy Sets in MCDM
Greco, S., Matarazzo, B., & Slowinski, R. (1999) · International Series in Operations Research & Management Science · doi:10.1007/978-1-4615-5025-9_14 · Cited by 245
Multi Criteria Analysis for bioenergy systems assessments
Buchholz, T., Rametsteiner, E., Volk, T. A., & Luzadis, V. A. (2009) · Energy Policy · doi:10.1016/j.enpol.2008.09.054 · Cited by 238
Life cycle sustainability assessment in the context of sustainability science progress (part 2)
Sala, S., Farioli, F., & Zamagni, A. (2013) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-012-0509-5 · Cited by 233
Alternatives for Environmental Valuation
Getzner, M., Spash, C., & Stagl, S. (2004) · Routledge eBooks · doi:10.4324/9780203412879 · Cited by 206
Comparison of methods to assess the sustainability of agricultural systems. A review
Bockstaller, C., Guichard, L., Keichinger, O., Girardin, P., Galan, M.-B., & Gaillard, G. (2009) · Agronomy for Sustainable Development · doi:10.1051/agro:2008058 · Cited by 204
A note on the use of PROMETHEE multicriteria methods
De Keyser, W., & Peeters, P. (1996) · European Journal of Operational Research · doi:10.1016/0377-2217(94)00307-6 · Cited by 202
Review of combined approaches and multi-criteria analysis for corporate environmental evaluation
Herva, M., & Roca, E. (2013) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2012.07.058 · Cited by 196
A New Rough Set Approach to Evaluation of Bankruptcy Risk
Greco, S., Benedetto Matarazzo, A., & Słowiński, R. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5495-0_8 · Cited by 190
Sadok, W., Angevin, F., Bergez, J.-É., Bockstaller, C., Colomb, B., Guichard, L., Reau, R., & Doré, T. (2008) · Agronomy for Sustainable Development · doi:10.1051/agro:2007043 · Cited by 187
Development of sustainable assessment criteria for building materials selection
Akadiri, P. O., & Olomolaiye, P. O. (2012) · Engineering, Construction and Architectural Management · doi:10.1108/09699981211277568 · Cited by 182
Khalili, N. R., & Duecker, S. (2013) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2012.10.044 · Cited by 171
Greco, S., Matarazzo, B., & Słowiński, R. (2006) · Springer eBooks · doi:10.1007/0-387-23081-5_13 · Cited by 169
Téno, J. F. L., & Mareschal, B. (1998) · European Journal of Operational Research · doi:10.1016/s0377-2217(98)00074-5 · Cited by 163
(2005) · Joint Research Centre (European Commission) · Cited by 136
Słowiński, R., Greco, S., & Benedetto Matarazzo, A. (2009) · Springer eBooks · doi:10.1007/978-0-387-30440-3_460 · Cited by 134
A FRAMEWORK FOR TOOL SELECTION AND USE IN INTEGRATED ASSESSMENT FOR SUSTAINABLE DEVELOPMENT
de Ridder, W., Turnpenny, J. R., Nilsson, M., & von Raggamby, A. (2007) · Journal of Environmental Assessment Policy and Management · doi:10.1142/s1464333207002883 · Cited by 128
Convertino, M., Baker, K., Vogel, J. T., Lu, C., Suedel, B. C., & Linkov, I. (2012) · Ecological Indicators · doi:10.1016/j.ecolind.2012.10.005 · Cited by 121
Operational Tools in the Management of Financial Risks
Zopounidis, C. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5495-0 · Cited by 120
Valuation and the environment: theory, method and practice.
O’Connor, M., & Spash, C. L. (1999) · Cited by 102
Rank reversal in the PROMETHEE II method: Some new results
Mareschal, B., Smet, Y. D., & Nemery, P. (2008) · doi:10.1109/ieem.2008.4738012 · Cited by 102
An illustrative example of the use of multiattribute utility theory for water resource planning
Keeney, R. L., & Wood, E. F. (1977) · Water Resources Research · doi:10.1029/wr013i004p00705 · Cited by 100
Assessing the quality of different MCDA methods
Montis, A. D. (2004) · Routledge eBooks · doi:10.4324/9780203412879-14 · Cited by 93
Sustainable nanotechnology: Defining, measuring and teaching
Subramanian, V., Semenzin, E., Hristozov, D. R., Marcomini, A., & Linkov, I. (2014) · Nano Today · doi:10.1016/j.nantod.2014.01.001 · Cited by 60
Aid for aggregating the impacts in Life Cycle assessment
Benoit, V., & Rousseaux, P. (2003) · The International Journal of Life Cycle Assessment · doi:10.1007/bf02978430 · Cited by 52
Cinelli, M., Coles, S. R., Jørgensen, A., Zamagni, A., Fernando, C., & Kirwan, K. (2013) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-013-0573-5 · Cited by 37
Self-citationSustainable Cities and Military Installations
Linkov, I. (2013) · NATO science for peace and security series. C, Environmental security · doi:10.1007/978-94-007-7161-1 · Cited by 32
Sustainable Urban Systems: A Review of How Sustainability Indicators Inform Decisions
Tatham, E. K., Eisenberg, D. A., & Linkov, I. (2013) · NATO science for peace and security series. C, Environmental security · doi:10.1007/978-94-007-7161-1_1 · Cited by 22
Augusto, M., Figueira, J. R., Lisboa, J. V., & Yasin, M. M. (2005) · European Business Review · doi:10.1108/09555340510587995 · Cited by 19
Cinelli, M., Coles, S. R., & Kirwan, K. (2013) · LCM 2013 · Cited by 10
Self-citation
Cited by
A new tool for the evaluation of the analytical procedure: Green Analytical Procedure Index
Płotka-Wasylka, J. (2018) · Talanta · doi:10.1016/j.talanta.2018.01.013 · Cited by 2,328
Biorefineries in circular bioeconomy: A comprehensive review
Ubando, A. T., Felix, C. B., & Chen, W.-H. (2020) · Bioresource Technology · doi:10.1016/j.biortech.2019.122585 · Cited by 850
Hu, X., & Xu, H. (2018) · Ecological Indicators · doi:10.1016/j.ecolind.2018.02.006 · Cited by 533
Pagani, R. N., Kovaleski, J. L., & Resende, L. M. (2015) · Scientometrics · doi:10.1007/s11192-015-1744-x · Cited by 461
Multi-criteria decision-making for flood risk management: A survey of the current state of the art
de Brito, M. M., & Evers, M. (2016) · Natural Hazards and Earth System Sciences · doi:10.5194/nhess-16-1019-2016 · Cited by 435
Metadata
- Authors
- Cinelli, M., Coles, S. R., & Kirwan, K.
- Venue
- Ecological Indicators
- Publisher
- Elsevier BV
- Published
- 2014-11
- Volume
- 46
- Pages
- 138-148
- ISSN
- 1470-160X (ISSN-L)
- OpenAlex
- W1986805676
- Cited by
- 864
- References
- 69
- FWCI
- 58.73
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.