The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
A Review of Taxonomies of Explainable Artificial Intelligence (XAI) Methods
Open accessAbstract
The recent surge in publications related to explainable artificial intelligence (XAI) has led to an almost insurmountable wall if one wants to get started or stay up to date with XAI. For this reason, articles and reviews that present taxonomies of XAI methods seem to be a welcomed way to get an overview of the field. Building on this idea, there is currently a trend of producing such taxonomies, leading to several competing approaches to construct them. In this paper, we will review recent approaches to constructing taxonomies of XAI methods and discuss general challenges concerning them as well as their individual advantages and limitations. Our review is intended to help scholars be aware of challenges current taxonomies face. As we will argue, when charting the field of XAI, it may not be sufficient to rely on one of the approaches we found. To amend this problem, we will propose and discuss three possible solutions: a new taxonomy that incorporates the reviewed ones, a database of XAI methods, and a decision tree to help choose fitting methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 4×
“This prompted Cynthia Rudin to write a paper in which she pleads for an end to the use of opaque models in high-stakes situations [62]: all we can do to explain such models is to apply post-hoc explainability methods that suffer from the problem just described.”
BackgroundMethodInfluentialBarredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“Preventing discrimination [24, 41, 74], increasing trustworthiness [37, 41, 46], allocating responsibility [13, 41, 59], and generally, promoting human well-being [27, 46] is, in principle, possible with explainability – as long as researchers from different disciplines can come together to work on it.”
BackgroundOn Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Dung, P. M. (1995) · Artificial Intelligence · doi:10.1016/0004-3702(94)00041-x · Cited by 4,270
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 2×
“These models are so complex that they are black boxes for humans, even eluding the understanding of experts [18].”
BackgroundA Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Causability and explainability of artificial intelligence in medicine
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842
Ananny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“However, just because something is transparent, this does not mean that it is understandable [5].”
BackgroundCan we open the black box of AI?
Castelvecchi, D. (2016) · Nature · doi:10.1038/538020a · Cited by 1,773
Sanity Checks for Saliency Maps
Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., & Kim, B. (2018) · arXiv · doi:10.48550/arxiv.1810.03292 · Cited by 1,294
The accuracy, fairness, and limits of predicting recidivism
Dressel, J., & Farid, H. (2018) · Science Advances · doi:10.1126/sciadv.aao5580 · Cited by 1,071
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061
Explainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Explainable artificial intelligence: an analytical review
Angelov, P. P., Soares, E. A., Jiang, R., Arnold, N. I., & Atkinson, P. M. (2021) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1424 · Cited by 843
Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103655 · Cited by 811
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
The epistemology of a rule-based expert system —a framework for explanation
Clancey, W. J. (1983) · Artificial Intelligence · doi:10.1016/0004-3702(83)90008-5 · Cited by 712
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652 · cited 10×
“Solely for the year 2021, we are aware of six papers that present some form of taxonomy of explainability methods: [6, 14, 44, 49, 54, 72].”
BackgroundMethodInfluentialSelf-citationA Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · cited 2×
“The taxonomies proposed in [30, 31, 44, 65, 72] adhere to this approach.”
Evaluating the quality of machine learning explanations: a survey on methods and metrics
Zhou, J., Gandomi, A. H., Chen, F., & Holzinger, A. (2021) · Electronics · doi:10.3390/electronics10050593 · Cited by 606 · cited 1×
“As a research discipline, XAI has grown exponentially in recent years, with annual publications easily exceeding several hundreds [10, 75].”
BackgroundTowards Explainable Artificial Intelligence
Samek, W., & Müller, K.-R. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_1 · Cited by 580
Conversational processes and causal explanation.
Hilton, D. J. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.1.65 · Cited by 456
A systematic review and taxonomy of explanations in decision support and recommender systems
Nunes, I., & Jannach, D. (2017) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-017-9195-0 · Cited by 395
Using arguments for making and explaining decisions
Amgoud, L., & Prade, H. (2009) · Artificial Intelligence · doi:10.1016/j.artint.2008.11.006 · Cited by 349
Explaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286
Explainability fact sheets: a framework for systematic assessment of explainable approaches
Sokol, K., & Flach, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372870 · Cited by 264
Prototype selection for interpretable classification
Bien, J., & Tibshirani, R. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas495 · Cited by 245
The Pragmatic Turn in Explainable Artificial Intelligence (XAI)
Páez, A. (2019) · Minds and Machines · doi:10.1007/s11023-019-09502-w · Cited by 230
Miller, T., Howe, P., & Sonenberg, L. (2017) · arXiv · doi:10.48550/arxiv.1712.00547 · Cited by 218
Explanatory Pluralism and Heuristic Identity Theory
McCauley, R. N., & Bechtel, W. (2001) · Theory & Psychology · doi:10.1177/0959354301116002 · Cited by 215
Classification of Explainable Artificial Intelligence Methods through Their Output Formats
Vilone, G., & Longo, L. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3030032 · Cited by 215
Mathews, S. M. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-22868-2_90 · Cited by 214
Perturbation-based methods for explaining deep neural networks: A survey
Ivanovs, M., Kadikis, R., & Ozols, K. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.06.030 · Cited by 204
Contrastive explanation: a structural-model approach
Miller, T. (2021) · The Knowledge Engineering Review · doi:10.1017/s0269888921000102 · Cited by 186
Exploring Explainability: A Definition, a Model, and a Knowledge Catalogue
Chazette, L., Brunotte, W., & Speith, T. (2021) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re51729.2021.00025 · Cited by 181
Self-citationExplainability as a Non-Functional Requirement
Köhl, M. A., Baum, K. L., Langer, M., Oster, D., Speith, T., & Bohlender, D. (2019) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00046 · Cited by 156
Self-citationEffects of Explanations on Applicant Reactions: A meta‐analytic review
Truxillo, D. M., Bodner, T., Bertolino, M., Bauer, T. N., & Yonce, C. A. (2009) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2009.00478.x · Cited by 155
Explanation and trust: what to tell the user in security and AI?
Pieters, W. (2011) · Ethics and Information Technology · doi:10.1007/s10676-010-9253-3 · Cited by 153 · cited 1×
“Preventing discrimination [24, 41, 74], increasing trustworthiness [37, 41, 46], allocating responsibility [13, 41, 59], and generally, promoting human well-being [27, 46] is, in principle, possible with explainability – as long as researchers from different disciplines can come together to work on it.”
BackgroundArtificial intelligence explainability: the technical and ethical dimensions
McDermid, J. A., Jia, Y., Porter, Z., & Habli, I. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0363 · Cited by 136 · cited 4×
“Solely for the year 2021, we are aware of six papers that present some form of taxonomy of explainability methods: [6, 14, 44, 49, 54, 72].”
BackgroundMethodInfluentialTo trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods
Amparore, E. G., Perotti, A., & Bajardi, P. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.479 · Cited by 121
Langer, M., König, C. J., & Fitili, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.11.036 · Cited by 119
From Responsibility to Reason-Giving Explainable Artificial Intelligence
Baum, K., Mantel, S., Schmidt, E., & Speith, T. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00510-w · Cited by 103 · cited 1×
“Preventing discrimination [24, 41, 74], increasing trustworthiness [37, 41, 46], allocating responsibility [13, 41, 59], and generally, promoting human well-being [27, 46] is, in principle, possible with explainability – as long as researchers from different disciplines can come together to work on it.”
BackgroundSelf-citationA Survey of Explainable AI Terminology
Clinciu, M., & Hastie, H. (2019) · doi:10.18653/v1/w19-8403 · Cited by 88
Towards Explainability for AI Fairness
Zhou, J. J., Chen, F., & Holzinger, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_18 · Cited by 81
Langer, M., Baum, K. L., König, C. J., Hähne, V., Oster, D., & Speith, T. (2021) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12325 · Cited by 69
Self-citationOn the Relation of Trust and Explainability: Why to Engineer for Trustworthiness
Kastner, L., Langer, M., Lazar, V., Schomacker, A., Speith, T., & Sterz, S. (2021) · 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00031 · Cited by 61
Self-citationArya, V., Bellamy, R., Chen, P., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3375667 · Cited by 58
Contrastive and counterfactual reasoning in causal judgment.
McGill, A. L., & Klein, J. G. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.64.6.897 · Cited by 56
Principles of Explainable Artificial Intelligence
Guidotti, R., Monreale, A., Pedreschi, D., & Giannotti, F. (2021) · Springer eBooks · doi:10.1007/978-3-030-76409-8_2 · Cited by 52
Ruben, D. (2015) · Routledge eBooks · doi:10.4324/9781315634739 · Cited by 47
Explainability Auditing for Intelligent Systems: A Rationale for Multi-Disciplinary Perspectives
Langer, M., Baum, K. L., Hartmann, K., Hessel, S., Speith, T., & Wahl, J. (2021) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00030 · Cited by 45
Self-citationLearning from Artificial Intelligence's Previous Awakenings: The History of Expert Systems
Brock, D. C. (2018) · AI Magazine · doi:10.1609/aimag.v39i3.2809 · Cited by 41
Quo Vadis, Explainability? – A Research Roadmap for Explainability Engineering
Brunotte, W., Chazette, L., Klös, V., & Speith, T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98464-9_3 · Cited by 38
Self-citationMachine Learning and AI for Healthcare: Big Data for Improved Health Outcomes
Panesar, A. (2019) · Cited by 35
Integrating mechanistic explanations through epistemic perspectives
Kästner, L. (2018) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2018.01.011 · Cited by 32
Gijsbers, V. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00032 · Cited by 23
Towards Perspicuity Requirements
Sterz, S., Baum, K. L., Lauber-Rönsberg, A., & Hermanns, H. (2021) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00029 · Cited by 22
Towards a Framework Combining Machine Ethics and Machine Explainability
Baum, K. L., Hermanns, H., & Speith, T. (2019) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.286.4 · Cited by 19
Self-citationRequirements Engineering: Foundation for Software Quality
Vincenzo Gervasi, A. V., Gervasi, V., & Vogelsang, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-98464-9 · Cited by 16
Panesar, A. (2019) · Apress eBooks · doi:10.1007/978-1-4842-3799-1_6 · Cited by 10
Towards a Taxonomy for Explainable AI in Computational Pathology
Müller, H., Kargl, M., Plass, M., Kipperer, B., Brčić, L., Regitnig, P., Geißler, C., Küster, T., Zerbe, N., & Holzinger, A. (2021) · Springer eBooks · doi:10.1007/978-3-030-72188-6_15 · Cited by 9
Finkbeiner, B., & Kleinberg, S. (2019) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.286.0 · Cited by 6
Research works printed but not linked: 10
- 10.5555/3306127.3331806 · doi:10.5555/3306127.3331806
- Kevin Baum, Holger Hermanns, and Timo Speith. 2018. From Machine Ethics to Machine Explainability and Back. In International Symposium on Artificial Intelligence and Mathematics (Fort Lauderdale, Florida, USA) (ISAIM 2018). International Symposium on Artificial Intelligence and Mathematics, Fort Lauderdale, FL, USA, 1–8. https://isaim2018.cs.ou.edu/papers/ISAIM2018_Ethics_Baum_etal.pdf
- 10.3389/fdata.2021.688969 · DOI · Paper page
- Leilani H. Gilpin, Cecilia Testart, Nathaniel Fruchter, and Julius Adebayo. 2019. Explaining Explanations to Society. In Proceedings of the NeurIPS 2018 Workshop on Ethical, Social and Governance Issues in AI (Montréal, Québec, Canada), Chloé Bakalar, Sarah Bird, Tiberio Caetano, Edward Felten, Dario Garcia-Garcia, Isabel Kloumann, Finn Lattimore, Sendhil Mullainathan, and D. Sculley (Eds.). 1–6. arXiv:1901.06560 · arXiv
- 10.1007/s13194-022-00457-x · doi:10.1007/s13194-022-00457-x
- Been Kim, Oluwasanmi Koyejo, and Rajiv Khanna. 2016. Examples are not enough, learn to criticize! Criticism for Interpretability. In Advances in Neural Information Processing Systems 29 (Barcelona, Spain), Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.). Curran Associates, Inc., New York, NY, USA, 2280–2288. https://proceedings.neurips.cc/paper/2016/hash/5680522b8e2bb01943234bce7bf84534-Abstract.html
- Scott M. Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems 30 (Long Beach, California, USA) (NIPS 2017), Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). Curran Associates, Inc., New York, NY, USA, 4765–4774. https://proceedings.neurips.cc/paper/2017/hash/8a20a8621978632d76c43dfd28b67767-Abstract.html
- 10.5555/3305890.3306006 · doi:10.5555/3305890.3306006
- 10.24963/ijcai.2017/765 · doi:10.24963/ijcai.2017/765
- 10.5555/3305890.3306024 · doi:10.5555/3305890.3306024
Cited by
Explainable AI for Healthcare 5.0: Opportunities and Challenges
Saraswat, D., Bhattacharya, P., Verma, A., Prasad, V. K., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3197671 · Cited by 523
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F. (2022) · IEEE Access · doi:10.1109/access.2022.3204051 · Cited by 450
A., S., & R., S. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100230 · Cited by 432
Explainable artificial intelligence (XAI) in finance: a systematic literature review
Černevičienė, J., & Kabašinskas, A. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10854-8 · Cited by 289
Nwakanma, C. I., Ahakonye, L. A. C., Njoku, J. N., Odirichukwu, J. C., Okolie, S. A., Uzondu, C., Ndubuisi Nweke, C. C., & Kim, D.-S. (2023) · Applied Sciences · doi:10.3390/app13031252 · Cited by 202
Metadata
- Authors
- Speith, T.
- Venue
- 2022 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2022-06-20
- Pages
- 2239-2250
- OpenAlex
- W4283159491
- Cited by
- 337
- References
- 69
- FWCI
- 41.04
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- Funders
- Volkswagen Foundation (AZ 98514)
- Deutsche Forschungsgemeinschaft (389792660)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.