Counterfactuals and causability in explainable artificial intelligence: Theory, algorithms, and applications

A Unified Approach to Interpreting Model Predictions

Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707

"Why Should I Trust You?": Explaining the Predictions of Any Classifier

Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555

Untitled work

(1988) · Cited by 16,582

Visualizing and understanding convolutional networks

Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839

Causality : Models , Reasoning , and Inference

Bentler, P., Heslenfeld, D., Molenaar, P., & Mcdonald, R. (2002) · Choice Reviews Online · doi:10.5860/choice.47-3771 · Cited by 13,039

Causality: Models, Reasoning, and Inference

Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653

A Value for n-person Games

Shapley, L. (1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446.003 · Cited by 10,698

Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561

From local explanations to global understanding with explainable AI for trees

Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-019-0138-9 · Cited by 10,551

Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI

Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423

A Treatise of Human Nature

Hume, D. A. (1739) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620409.040 · Cited by 9,910

Dissecting racial bias in an algorithm used to manage the health of populations

Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×

Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)

Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294

The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.

Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427

Explanation in artificial intelligence: Insights from the social sciences

Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302

Untitled work

(2018) · Cited by 3,510

Towards A Rigorous Science of Interpretable Machine Learning

Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121

Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy

Doyle, T. (2017) · The Information Society · doi:10.1080/01972243.2017.1354593 · Cited by 3,111

Semantics derived automatically from language corpora contain human-like biases

Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887

Learning Important Features Through Propagating Activation Differences

Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761

Building machines that learn and think like people

Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550

Explaining Explanations: An Overview of Interpretability of Machine Learning

Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507

Untitled work

(2016) · Cited by 2,334

Explaining prediction models and individual predictions with feature contributions

Štrumbelj, E., & Kononenko, I. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-013-0679-x · Cited by 2,286

Definitions, methods, and applications in interpretable machine learning

Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167

Anchors: High-Precision Model-Agnostic Explanations

Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 4×

European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”

Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics 2016

Murray, I., & Graham, M. M. (2016) · Cited by 2,115

Causation

Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,917

Causability and explainability of artificial intelligence in medicine

Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1312 · Cited by 1,885

Machine Learning Interpretability: A Survey on Methods and Metrics

Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842

Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study

Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

Bolukbasi, T., Chang, K.-W., Zou, J., Saligrama, V., & Kalai, A. (2016) · arXiv · doi:10.48550/arxiv.1607.06520 · Cited by 1,615

The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI

Shin, D. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102551 · Cited by 1,548

Explaining machine learning classifiers through diverse counterfactual explanations

Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233

Toward safer highways, application of XGBoost and SHAP for real-time accident detection and feature analysis

Parsa, A. B., Movahedi, A., Taghipour, H., Derrible, S., & Mohammadian, A. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.105405 · Cited by 1,088

Word embeddings quantify 100 years of gender and ethnic stereotypes

Garg, N., Schiebinger, L., Jurafsky, D., & Zou, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1720347115 · Cited by 1,065

Counterfactual explanations without opening the black box: automated decisions and the GDPR

Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061

Unmasking Clever Hans predictors and assessing what machines really learn

Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K.-R. (2019) · Nature Communications · doi:10.1038/s41467-019-08987-4 · Cited by 1,047

Cognitive biases associated with medical decisions: a systematic review

Saposnik, G., Redelmeier, D., Ruff, C. C., & Tobler, P. N. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0377-1 · Cited by 1,001

Interactive machine learning for health informatics: when do we need the human-in-the-loop?

Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906

Causes and Explanations: A Structural-Model Approach. Part I: Causes

Halpern, J. Y., & Pearl, J. (2005) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axi147 · Cited by 829

The master algorithm: how the quest for the ultimate learning machine will remake our world

(2016) · Choice Reviews Online · doi:10.5860/choice.194685 · Cited by 810

Elements of Causal Inference: Foundations and Learning Algorithms

Peters, J., Janzing, D., & Schölkopf, B. (2017) · OAPEN (The OAPEN Foundation) · Cited by 789

A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems

Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785

Deep neural networks are more accurate than humans at detecting sexual orientation from facial images.

Wang, Y., & Kosinski, M. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000098 · Cited by 766 · cited 1×

Bias and Debias in Recommender System: A Survey and Future Directions

Chen, J., Dong, H., Wang, X., Feng, F., Wang, M., & He, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3564284 · Cited by 741

Computational rationality: A converging paradigm for intelligence in brains, minds, and machines

Gershman, S. J., Horvitz, E., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aac6076 · Cited by 722

Is Attention Interpretable?

Serrano, S., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1282 · Cited by 690

The seven tools of causal inference, with reflections on machine learning

Pearl, J. (2019) · Communications of the ACM · doi:10.1145/3241036 · Cited by 659

What do we need to build explainable AI systems for the medical domain?

Holzinger, A., Biemann, C., Pattichis, C. S., & Kell, D. B. (2017) · arXiv · doi:10.48550/arxiv.1712.09923 · Cited by 636

A Survey of Methods for Explaining Black Box Models

Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629

Evaluating the quality of machine learning explanations: a survey on methods and metrics

Zhou, J., Gandomi, A. H., Chen, F., & Holzinger, A. (2021) · Electronics · doi:10.3390/electronics10050593 · Cited by 606

Improving the accuracy of medical diagnosis with causal machine learning

Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598

The What-If Tool: Interactive Probing of Machine Learning Models

Wexler, J., Pushkarna, M., Bolukbasi, T., WATTENBERG, M. P., Viégas, F. B., & Wilson, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934619 · Cited by 597

Unmasking Clever Hans predictors and assessing what machines really learn

Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., & Müller, K. (2019) · RePEc: Research Papers in Economics · Cited by 580

Untitled work

(2016) · neural information processing systems · Cited by 556

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence

Gao, L., Zhu, X., Song, J., Zhao, Z., & Shen, H. T. (2019) · doi:10.24963/ijcai.2019 · Cited by 538

Metrics for explainable AI: challenges and prospects

Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.04608 · Cited by 518

Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey

Das, A., & Rad, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11371 · Cited by 504

Causal Interpretations of Black-Box Models

Zhao, Q., & Hastie, T. J. (2019) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2019.1624293 · Cited by 490

Causal inference and counterfactual prediction in machine learning for actionable healthcare

Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459

Interpretable Counterfactual Explanations Guided by Prototypes

Looveren, A. V., & Klaise, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86520-7_40 · Cited by 448

A historical perspective of explainable Artificial Intelligence

Confalonieri, R., Çoba, L., Wagner, B., & Besold, T. R. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1391 · Cited by 431

Measuring the Quality of Explanations: The System Causability Scale (SCS): Comparing Human and Machine Explanations

Holzinger, A., Carrington, A., & Müller, H. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00636-z · Cited by 406

Evaluating XAI: A comparison of rule-based and example-based explanations

van der Waa, J., Nieuwburg, E., Cremers, A., & Neerincx, M. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103404 · Cited by 393

Elements of causal inference: foundations and learning algorithms

Shanmugam, R. (2018) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2018.1505197 · Cited by 392

Sensor data quality: a systematic review

Teh, H. Y., Kempa-Liehr, A. W., & Wang, K. I.-K. (2020) · Journal of Big Data · doi:10.1186/s40537-020-0285-1 · Cited by 377

A Survey of Contrastive and Counterfactual Explanation Generation Methods for Explainable Artificial Intelligence

Stepin, I., Alonso, J. M., Catala, A., & Pereira-Farina, M. (2021) · IEEE Access · doi:10.1109/access.2021.3051315 · Cited by 376

Avoiding Discrimination through Causal Reasoning

Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., & Schölkopf, B. (2017) · arXiv · doi:10.48550/arxiv.1706.02744 · Cited by 358

Towards multi-modal causability with graph neural networks enabling information fusion for explainable ai

Holzinger, A., Malle, B., Saranti, A., & Pfeifer, B. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.01.008 · Cited by 352

What Does Explainable AI Really Mean? A New Conceptualization of Perspectives

Doran, D., Schulz, S., & Besold, T. R. (2017) · arXiv · doi:10.48550/arxiv.1710.00794 · Cited by 333

Local Rule-Based Explanations of Black Box Decision SystemsPreprint

Guidotti, R., Monreale, A., Ruggieri, S., Pedreschi, D., Turini, F., & Giannotti, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.10820 · Cited by 323

FACE: Feasible and Actionable Counterfactual Explanations

Poyiadzi, R., Sokol, K., Santos-Rodriguez, R., De Bie, T., & Flach, P. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375850 · Cited by 317

On the Robustness of Interpretability Methods

Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310

From Machine Learning to Explainable AI

Holzinger, A. (2018) · 2018 World Symposium on Digital Intelligence for Systems and Machines (DISA) · doi:10.1109/disa.2018.8490530 · Cited by 306

Counterfactuals in Explainable Artificial Intelligence (XAI): Evidence from Human Reasoning

Byrne, R. M. J. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/876 · Cited by 285

Explainability fact sheets

Sokol, K., & Flach, P. A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372870 · Cited by 278

Multi-Objective Counterfactual Explanations

Dandl, S., Molnar, C., Binder, M., & Bischl, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58112-1_31 · Cited by 271

Faithful and Customizable Explanations of Black Box Models

Lakkaraju, H., Kamar, E. S., Caruana, R., & Leskovec, J. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314229 · Cited by 268

Explaining Data-Driven Document Classifications1

Martens, D., & Provost, F. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.04 · Cited by 264

Naive causality: a mental model theory of causal meaning and reasoning

Goldvarg, E., & Johnson‐Laird, P. N. (2001) · Cognitive Science · doi:10.1016/s0364-0213(01)00046-5 · Cited by 261

The hidden assumptions behind counterfactual explanations and principal reasons

Barocas, S., Selbst, A. D., & Raghavan, M. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372830 · Cited by 253

Evolutionary Fuzzy Systems for Explainable Artificial Intelligence: Why, When, What for, and Where to?

Fernández, A., Herrera, F., Cordón, Ó., del Jesús, M. J., & Marcelloni, F. (2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2881645 · Cited by 246

Fatty acid biomarkers of dairy fat consumption and incidence of type 2 diabetes: A pooled analysis of prospective cohort studies

Imamura, F., Fretts, A. M., Marklund, M., Korat, A. V. A., Yang, W.-S., Lankinen, M. A., Qureshi, W., Helmer, C., Chen, T. A., Wong, K., et al. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002670 · Cited by 244

Causes and Explanations: A Structural-Model Approach. Part II: Explanations

Halpern, J. Y., & Pearl, J. (2005) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axi148 · Cited by 242

Interactive machine learning: experimental evidence for the human in the algorithmic loop

Holzinger, A., Plass, M., Kickmeier-Rust, M., Holzinger, K., Crişan, G. C., Pintea, C.-M., & Palade, V. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1361-5 · Cited by 235

The Pragmatic Turn in Explainable Artificial Intelligence (XAI)

Páez, A. (2019) · Minds and Machines · doi:10.1007/s11023-019-09502-w · Cited by 229

CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models

Sharma, S., Henderson, J., & Ghosh, J. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375812 · Cited by 226

Counterfactual Explanations for Machine Learning: A Review.Preprint

Verma, S., Dickerson, J. P., & Hines, K. (2020) · arXiv (Cornell University) · Cited by 223

Efficient Search for Diverse Coherent Explanations

Russell, C. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287569 · Cited by 218

Model-Agnostic Counterfactual Explanations for Consequential DecisionsPreprint

Karimi, A.-H., Barthe, G., Balle, B., & Valera, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11190 · Cited by 212

Causation and Explanation

Psillos, S. (2014) · Routledge eBooks · doi:10.4324/9781315710716 · Cited by 211

Multimodal medical image fusion algorithm in the era of big data

Tan, W., Tiwari, P., Pandey, H. M., Moreira, C., & Jaiswal, A. K. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05173-2 · Cited by 210

Interpretability in healthcare: A comparative study of local machine learning interpretability techniques

Elshawi, R., Sherif, Y., Al-Mallah, M. H., & Sakr, S. (2020) · Computational Intelligence · doi:10.1111/coin.12410 · Cited by 209

Disentangling consumer recommendations: Explaining and predicting airline recommendations based on online reviews

Siering, M., Deokar, A. V., & Janze, C. (2018) · Decision Support Systems · doi:10.1016/j.dss.2018.01.002 · Cited by 200

The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanations

Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., & Detyniecki, M. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/388 · Cited by 194

Explainability of a Machine Learning Granting Scoring Model in Peer-to-Peer Lending

Garzón, M. J. A., Arroyo, J., Caparrini, A., & Vargas, M. J. S. (2020) · IEEE Access · doi:10.1109/access.2020.2984412 · Cited by 192

The ergodicity problem in economics

Peters, O. (2019) · Nature Physics · doi:10.1038/s41567-019-0732-0 · Cited by 190

Transparency and accountability in AI decision support: Explaining and visualizing convolutional neural networks for text information

Kim, B., Park, J., & Suh, J. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113302 · Cited by 182

Learning Model-Agnostic Counterfactual Explanations for Tabular Data

Pawelczyk, M., Broelemann, K., & Kasneci, G. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380087 · Cited by 167

Pretense, Counterfactuals, and Bayesian Causal Models: Why What Is Not Real Really Matters

Weisberg, D. S., & Gopnik, A. (2013) · Cognitive Science · doi:10.1111/cogs.12069 · Cited by 166

Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)

Keane, M. T., & Smyth, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58342-2_11 · Cited by 158

Comparison-Based Inverse Classification for Interpretability in Machine Learning

Laugel, T., Lesot, M., Marsala, C., Renard, X., & Detyniecki, M. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-91473-2_9 · Cited by 151

Cognitive Processes in Counterfactual Thinking about what Might Have Been

Byrne, R. M. J. (1997) · ˜The œPsychology of learning and motivation/˜The œpsychology of learning and motivation · doi:10.1016/s0079-7421(08)60501-0 · Cited by 146

DECE: Decision Explorer with Counterfactual Explanations for Machine Learning Models

Cheng, F., Ming, Y., & Qu, H. (2020) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2020.3030342 · Cited by 137

Eye-Tracking Causality

Gerstenberg, T., Peterson, M., Goodman, N. D., Lagnado, D. A., & Tenenbaum, J. B. (2017) · Psychological Science · doi:10.1177/0956797617713053 · Cited by 135

Measurable Counterfactual Local Explanations for Any Classifier

Adam, W., & Artur, D. G. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200387 · Cited by 115

On Counterfactual Explanations under Predictive MultiplicityPreprint

Pawelczyk, M., Broelemann, K., & Kasneci, G. (2020) · Conference on Uncertainty in Artificial Intelligence · doi:10.48550/arxiv.2006.13132 · Cited by 106

Algorithmic recourse under imperfect causal knowledge: a probabilistic approachPreprint

Karimi, A.-H., von Kügelgen, J., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06831 · Cited by 100

Principles and Practice of Explainable Machine Learning

Belle, V., & Papantonis, I. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.688969 · Cited by 99

Causation and Explanation

Psillos, S. (2003) · McGill-Queen's University Press eBooks · doi:10.1515/9780773583955 · Cited by 98

Interpretability via Model ExtractionPreprint

Bastani, O., Kim, C., & Bastani, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.09773 · Cited by 93

ViCE: visual counterfactual explanations for machine learning models

Gomez, O., Holter, S., Yuan, J., & Bertini, E. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377536 · Cited by 91

PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems

Ghazimatin, A., Balalau, O., Saha Roy, R., & Weikum, G. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371824 · Cited by 88

Explainable AI and Multi-Modal Causability in Medicine

Holzinger, A. (2021) · i-com · doi:10.1515/icom-2020-0024 · Cited by 87

Towards Explainable Process Predictions for Industry 4.0 in the DFKI-Smart-Lego-Factory

Rehse, J.-R., Mehdiyev, N., & Fettke, P. (2019) · Künstliche Intell. · doi:10.1007/s13218-019-00586-1 · Cited by 83

Do People Experience Cognitive Biases while Searching for Information?

Lau, A. Y. S., & Coiera, E. W. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2411 · Cited by 82

The Pragmatic Turn in Explainable Artificial Intelligence (XAI)

Páez, A. (2019) · PhilPapers (PhilPapers Foundation) · Cited by 80

Interpretability in HealthCare A Comparative Study of Local Machine Learning Interpretability Techniques

Shawi, R. E., Sherif, Y., Al-Mallah, M. H., & Sakr, S. (2019) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2019.00065 · Cited by 80

A comparison of instance-level counterfactual explanation algorithms for behavioral and textual data: SEDC, LIME-C and SHAP-C

Ramon, Y., Martens, D., Provost, F., & Evgeniou, T. (2020) · Advances in Data Analysis and Classification · doi:10.1007/s11634-020-00418-3 · Cited by 79

Causality Learning: A New Perspective for Interpretable Machine LearningPreprint

Xu, G., Duong, T. D., Li, Q., Liu, S., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16789 · Cited by 79

Interpretable Credit Application Predictions With Counterfactual ExplanationsPreprint

McGrath, R., Costabello, L., Van, C. L., Sweeney, P., Kamiab, F., Shen, Z., & Lécué, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.05245 · Cited by 78

A model explanation system

Turner, R. (2016) · Machine learning for signal processing ... · doi:10.1109/mlsp.2016.7738872 · Cited by 77

Generating Counterfactual and Contrastive Explanations using SHAPPreprint

Rathi, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09293 · Cited by 76

Black Box Explanation by Learning Image Exemplars in the Latent Feature Space

Guidotti, R., Monreale, A., Matwin, S., & Pedreschi, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46150-8_12 · Cited by 76

LINDA-BN: An interpretable probabilistic approach for demystifying black-box predictive models

Moreira, C., Chou, Y.-L., Velmurugan, M., Ouyang, C., Sindhgatta, R., & Bruza, P. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113561 · Cited by 76

A survey of algorithmic recourse: definitions, formulations, solutions, and prospectsPreprint

Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04050 · Cited by 74

Explainable Deep-Fake Detection Using Visual Interpretability Methods

Malolan, B., Parekh, A., & Kazi, F. (2020) · 2020 3rd International Conference on Information and Computer Technologies (ICICT) · doi:10.1109/icict50521.2020.00051 · Cited by 70

Trends in Interactive Knowledge Discovery for Personalized Medicine: Cognitive Science meets Machine Learning

Holzinger, A. (2014) · Cited by 65

What is "intelligent" in intelligent user interfaces?

Völkel, S. T., Schneegass, C., Eiband, M., & Buschek, D. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377500 · Cited by 61

Shapley Flow: A Graph-based Approach to Interpreting Model PredictionsPreprint

Wang, J., Wiens, J., & Lundberg, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.14592 · Cited by 53

Outcome-Explorer: A Causality Guided Interactive Visual Interface for Interpretable Algorithmic Decision Making

Hoque, M. N., & Mueller, K. D. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3102051 · Cited by 51

Measuring Narrative Believability: Development and Validation of the Narrative Believability Scale (NBS-12)

Yale, R. N. (2013) · Journal of Communication · doi:10.1111/jcom.12035 · Cited by 49

Why does my model fail?

Lučić, A., Haned, H., & de Rijke, M. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372824 · Cited by 46

TreeView: Peeking into Deep Neural Networks Via Feature-Space PartitioningPreprint

Thiagarajan, J. J., Kailkhura, B., Sattigeri, P., & Ramamurthy, K. N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07429 · Cited by 44

Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable RecoursesPreprint

Rawal, K., & Lakkaraju, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07165 · Cited by 42

Exploring Interpretable Predictive Models for Business Processes

Sindhgatta, R., Moreira, C., Ouyang, C., & Barros, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58666-9_15 · Cited by 41

Evaluating Fidelity of Explainable Methods for Predictive Process Analytics

Velmurugan, M., Ouyang, C., Moreira, C., & Sindhgatta, R. (2021) · Lecture notes in business information processing · doi:10.1007/978-3-030-79108-7_8 · Cited by 39

How causal information affects decisions

Zheng, M., Marsh, J. K., Nickerson, J. V., & Kleinberg, S. (2020) · Cognitive Research Principles and Implications · doi:10.1186/s41235-020-0206-z · Cited by 38

Unjustified Classification Regions and Counterfactual Explanations in Machine Learning

Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., & Detyniecki, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-46147-8_3 · Cited by 28

FLAME: A Fast Large-scale Almost Matching Exactly Approach to Causal InferencePreprint

Wang, T., Morucci, M., Awan, M. U., Liu, Y., Roy, S., Rudin, C. D., & Volfovsky, A. (2021) · arXiv (Cornell University) · Cited by 27

Hybrid Predictive Models: When an Interpretable Model Collaborates with a Black-box ModelPreprint

Wang, T., & Lin, Q. (2021) · arXiv (Cornell University) · Cited by 26

Exploring Interpretability for Predictive Process Analytics

Sindhgatta, R., Ouyang, C., & Moreira, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-65310-1_31 · Cited by 25

Cognitive Prerequisites: The Special Case of Counterfactual Reasoning

Pereira, L. M., & Lopes, A. B. (2020) · Studies in applied philosophy, epistemology and rational ethics · doi:10.1007/978-3-030-39630-5_14 · Cited by 11

Why should you trust my interpretation? Understanding uncertainty in LIME predictions.Preprint

Tan, H. F., Song, K., Udell, M., Sun, Y., & Zhang, Y. (2019) · arXiv (Cornell University) · Cited by 10

Interpretable Almost-Exact Matching for Causal Inference.

Dieng, A., Liu, Y., Roy, S., Rudin, C. D., & Volfovsky, A. (2019) · PubMed · Cited by 8

To serve humanity

Vardi, M. Y. (2019) · Communications of the ACM · doi:10.1145/3338092 · Cited by 8

Almost-Matching-Exactly for Treatment Effect Estimation under Network InterferencePreprint

Awan, M. U., Morucci, M., Orlandi, V., Roy, S., Rudin, C. D., & Volfovsky, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00964 · Cited by 6

Case-Based Reasoning Research and Development

(2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86957-1 · Cited by 6

Counterfactual reasoning as a key for explaining adaptive behavior in a changing environment

Paik, J., Zhang, Y., & Pirolli, P. L. T. (2014) · Biologically Inspired Cognitive Architectures · doi:10.1016/j.bica.2014.11.004 · Cited by 5

Evaluating Explainable Methods for Predictive Process Analytics: A Functionally-Grounded ApproachPreprint

Velmurugan, M., Ouyang, C., Moreira, C., & Sindhgatta, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.04218 · Cited by 5

Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence

Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495

Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence

Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762

A systematic review of trustworthy and explainable artificial intelligence in healthcare: Assessment of quality, bias risk, and data fusion

Albahri, A. S., Duhaim, A. M., Fadhel, M. A., Alnoor, A., Baqer, N. S., Alzubaidi, L., Albahri, O. S., Alamoodi, A. H., Bai, J., Salhi, A., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.03.008 · Cited by 716

A Review of Explainable Artificial Intelligence in Healthcare

Sadeghi, Z., Alizadehsani, R., CIFCI, M. A., Kausar, S., Rehman, R., Mahanta, P., Bora, P. K., Almasri, A., Alkhawaldeh, R. S., Hussain, S., et al. (2024) · Computers and Electrical Engineering · doi:10.1016/j.compeleceng.2024.109370 · Cited by 598

Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions

Longo, L., Brcic, M., Cabitza, F., Choi, J., Confalonieri, R., Ser, J. D., Guidotti, R., Hayashi, Y., Herrera, F., Holzinger, A., et al. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102301 · Cited by 626

Cognitive Processes in Counterfactual Thinking about what Might Have Been

Byrne, R. M. J. (1997) · ˜The œPsychology of learning and motivation/˜The œpsychology of learning and motivation · doi:10.1016/s0079-7421(08)60501-0 · Cited by 146

Counterfactual Explanations in Explainable AI: A Tutorial

Wang, C., Li, X., Han, H., Wang, S., Wang, L., Cao, C. C., & Chen, L. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3470797 · Cited by 16

A Survey of the Various Methodologies Towards making Artificial Intelligence More ExplainablePreprint

Dasgupta, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.02291

CUBE: Causal Intervention-Based Counterfactual Explanation for Prediction Models

Shao, X., Wang, H., Chen, X., Zhu, X., & Zhang, Y. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3322126 · Cited by 11

Counterfactual Explanations for Machine Learning: A Review.Preprint

Verma, S., Dickerson, J. P., & Hines, K. (2020) · arXiv (Cornell University) · Cited by 223