The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Flagged first, then by citations
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 301–400 of 1,051
General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models
Molnar, C., König, G., Herbinger, J., Freiesleben, T., Dandl, S., Scholbeck, C. A., Casalicchio, G., Grosse-Wentrup, M., & Bischl, B. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_4 · Cited by 211
Love, P. E. D., Fang, W., Matthews, J., Porter, S. R., Luo, H., & Ding, L. (2023) · Advanced Engineering Informatics · doi:10.1016/j.aei.2023.102024 · Cited by 214
Steiger, M., Bharucha, T. J., Venkatagiri, S., Riedl, M. J., & Lease, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445092 · Cited by 222
Degas, A., Islam, M. R., Hurter, C., Barua, S., Rahman, H., Poudel, M., Ruscio, D., Ahmed, M. U., Begum, S., Rahman, M. A., et al. (2022) · Applied Sciences · doi:10.3390/app12031295 · Cited by 168
Explainable Artificial Intelligence (XAI) in Auditing: A Framework and Research Needs
Zhang, C., Cho, S., & Vasarhelyi, M. A. (2021) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2022.100572 · Cited by 251
Explainable Artificial Intelligence by Genetic Programming: A Survey
Mei, Y., Chen, Q., Lensen, A., Xue, B., & Zhang, M. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3225509 · Cited by 182
Waardenburg, L., Huysman, M., & Sergeeva, A. V. (2022) · Organization Science · doi:10.1287/orsc.2021.1544 · Cited by 165
van de Merwe, K., Mallam, S., & Nazir, S. (2022) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208221077804 · Cited by 172
Interpretable and explainable machine learning: A methods‐centric overview with concrete examples
Marcinkevičs, R., & Vogt, J. E. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1493 · Cited by 210
van Os, H. J. A., Ramos, L. A., Hilbert, A., van Leeuwen, M., van Walderveen, M. A. A., Kruyt, N. D., Dippel, D. W. J., Steyerberg, E. W., van der Schaaf, I. C., Lingsma, H. F., et al. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00784 · Cited by 166
Explainable Deep Reinforcement Learning: State of the Art and Challenges
Vouros, G. A. (2022) · ACM Computing Surveys · doi:10.1145/3527448 · Cited by 198
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163
Applying deep learning to the newsvendor problem
Oroojlooyjadid, A., Snyder, L., & Takáč, M. (2019) · IISE Transactions · doi:10.1080/24725854.2019.1632502 · Cited by 181
How Explainability Contributes to Trust in AI
Ferrario, A., & Loi, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533202 · Cited by 163
Xu, Q., Xie, W., Liao, B., Hu, C., Qin, L., Yang, Z., Xiong, H., Yi, L., Zhou, Y., & Luo, A. (2023) · Journal of Healthcare Engineering · doi:10.1155/2023/9919269 · Cited by 162
ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases
Stock, P., & Cissé, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01231-1_31 · Cited by 185
Hamon, R., Junklewitz, H., Sanchez, I., Malgieri, G., & Hert, P. D. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3129960 · Cited by 177
Applications of Deep Learning to Neuro-Imaging Techniques
Zhu, G., Jiang, B., Tong, L., Xie, Y., Zaharchuk, G., & Wintermark, M. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00869 · Cited by 162
Keane, M. T., Kenny, E. M., Delaney, E. D., & Smyth, B. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/609 · Cited by 203
Calabrese, M., Cimmino, M., Fiume, F., Manfrin, M., Romeo, L., Ceccacci, S., Paolanti, M., Toscano, G., Ciandrini, G., Carrotta, A., et al. (2020) · Information · doi:10.3390/info11040202 · Cited by 158
Neural Machine Reading Comprehension: Methods and Trends
Liu, S., Zhang, X., Zhang, S., Wang, H., & Zhang, W. (2019) · Applied Sciences · doi:10.3390/app9183698 · Cited by 160
Capturing the Style of Fake News
Przybyła, P. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5386 · Cited by 164
Algorithm Supported Induction for Building Theory: How Can We Use Prediction Models to Theorize?
Shrestha, Y. R., He, V. F., Puranam, P., & von Krogh, G. (2020) · Organization Science · doi:10.1287/orsc.2020.1382 · Cited by 171
Meli, R., Morris, G. M., & Biggin, P. C. (2022) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2022.885983 · Cited by 176
Programmatically Interpretable Reinforcement LearningPreprint
Verma, A., Murali, V., Singh, R., Kohli, P., & Chaudhuri, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02477 · Cited by 178
Bastings, J., & Filippova, K. (2020) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2020.blackboxnlp-1.14 · Cited by 202
Dunsin, D., Ghanem, M. C., Ouazzane, K., & Vassilev, V. (2024) · Forensic Science International Digital Investigation · doi:10.1016/j.fsidi.2023.301675 · Cited by 230
Gade, K., Geyik, S. C., Kenthapadi, K., Mithal, V., & Taly, A. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3332281 · Cited by 171
Xie, F., Yuan, H., Ning, Y., Ong, M. E. H., Feng, M., Hsu, W., Chakraborty, B., & Liu, N. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103980 · Cited by 176
Explainable Artificial Intelligence for Neuroscience: Behavioral Neurostimulation
Fellous, J., Sapiro, G., Rossi, A. F., Mayberg, H., & Ferrante, M. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01346 · Cited by 165
Classification of Explainable Artificial Intelligence Methods through Their Output Formats
Vilone, G., & Longo, L. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3030032 · Cited by 182
Ethical Dimensions of Visualization Research
Correll, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300418 · Cited by 150
Machine learning for nanoplasmonics
Masson, J., Biggins, J. S., & Ringe, E. (2023) · Nature Nanotechnology · doi:10.1038/s41565-022-01284-0 · Cited by 155
Ethical machines: The human-centric use of artificial intelligence
Lepri, B., Oliver, N., & Pentland, A. (2021) · iScience · doi:10.1016/j.isci.2021.102249 · Cited by 149
An Empirical Study of Model-Agnostic Techniques for Defect Prediction Models
Jiarpakdee, J., Tantithamthavorn, C. K., Dam, H. K., & Grundy, J. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2982385 · Cited by 148
Keane, M. T., & Smyth, B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58342-2_11 · Cited by 158
Chakraborty, D., Başağaoğlu, H., & Winterle, J. R. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114498 · Cited by 150
Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond
Nasir, S., Khan, R. A., & Bai, S. (2024) · IEEE Access · doi:10.1109/access.2024.3369912 · Cited by 152
Using Machine Learning to Predict Complications in Pregnancy: A Systematic Review
Bertini, A., Salas, R., Chabert, S., Sobrevía, L., & Pardo, F. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2021.780389 · Cited by 167
Manning, L., Brewer, S., Craigon, P. J., Frey, J. G., Gutiérrez, A., Jacobs, N. J., Kanza, S., Munday, S., Sacks, J., & Pearson, S. (2022) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2022.04.025 · Cited by 161
Learning the PE Header, Malware Detection with Minimal Domain Knowledge
Raff, E., Sylvester, J., & Nicholas, C. (2017) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3128572.3140442 · Cited by 154
A Yolo-Based Model for Breast Cancer Detection in Mammograms
Prinzi, F., Insalaco, M., Orlando, A. A. M., Gaglio, S., & Vitabile, S. (2023) · Cognitive Computation · doi:10.1007/s12559-023-10189-6 · Cited by 160
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
“First, we overview related work on explainable AI (XAI), focusing on XAI for ML models—what is sometimes referred to as interpretability in the ML literature [26, 53].”
BackgroundA Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging
Gulum, M. A., Trombley, C. M., & Kantardzic, M. M. (2021) · Applied Sciences · doi:10.3390/app11104573 · Cited by 152
Multimodal Video Sentiment Analysis Using Deep Learning Approaches, a Survey
Abdu, S. A., Yousef, A. H., & Salem, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.06.003 · Cited by 154
Explaining deep neural networks: A survey on the global interpretation methods
Saleem, R., Yuan, B., Kurugöllü, F., Anjum, A., & Liu, L. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.129 · Cited by 168
Deep Learning for Automatic Vision-Based Recognition of Industrial Surface Defects: A Survey
Prunella, M., Scardigno, R. M., Buongiorno, D., Brunetti, A., Longo, N., Carli, R., Dotoli, M., & Bevilacqua, V. (2023) · IEEE Access · doi:10.1109/access.2023.3271748 · Cited by 174
Understanding artificial intelligence ethics and safetyPreprint
Leslie, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.05684 · Cited by 308
It's complicated: the relationship between user trust, model accuracy and explanations in AI
Papenmeier, A., Kern, D., Englebienne, G., & Seifert, C. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3495013 · Cited by 144
XAI Framework for Cardiovascular Disease Prediction Using Classification Techniques
Guleria, P., Srinivasu, P. N., Ahmed, S., Almusallam, N., & Alarfaj, F. K. (2022) · Electronics · doi:10.3390/electronics11244086 · Cited by 157
Toward Explainable Artificial Intelligence for Precision Pathology
Klauschen, F., Dippel, J., Keyl, P., Jurmeister, P. S., Bockmayr, M. L., Möck, A., Buchstab, O., Alber, M., Ruff, L., Montavon, G., et al. (2023) · Annual Review of Pathology Mechanisms of Disease · doi:10.1146/annurev-pathmechdis-051222-113147 · Cited by 164
Quantum-inspired multimodal fusion for video sentiment analysis
Li, Q., Gkoumas, D., Lioma, C., & Melucci, M. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.08.006 · Cited by 143
Model agnostic generation of counterfactual explanations for molecules
Wellawatte, G. P., Seshadri, A., & White, A. D. (2022) · Chemical Science · doi:10.1039/d1sc05259d · Cited by 143
Piryonesi, S. M., & El-Diraby, T. E. (2021) · Journal of Infrastructure Systems · doi:10.1061/(asce)is.1943-555x.0000602 · Cited by 143
AI methods in materials design, discovery and manufacturing: A review
Papadimitriou, I., Gialampoukidis, I., Vrochidis, S., & Kompatsiaris, I. Y. (2024) · Computational Materials Science · doi:10.1016/j.commatsci.2024.112793 · Cited by 156
Exploring Two-Dimensional Materials Thermodynamic Stability via Machine Learning
Schleder, G. R., Acosta, C. M., & Fazzio, A. (2019) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.9b14530 · Cited by 142
Exploding the myths: An introduction to artificial neural networks for prediction and forecasting
Maier, H. R., Galelli, S., Razavi, S., Castelletti, A. F., Rizzoli, A. E., Athanasiadis, I. N., Sànchez–Marrè, M., Acutis, M., Wu, W., & Humphrey, G. B. (2023) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2023.105776 · Cited by 160
Scanpath modeling and classification with hidden Markov models
Coutrot, A., Hsiao, J. H., & Chan, A. B. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0876-8 · Cited by 150
Explainable software analytics
Dam, H. K., Tran, T., & Ghose, A. (2018) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3183399.3183424 · Cited by 158
Kraus, M., & Feuerriegel, S. (2019) · Decision Support Systems · doi:10.1016/j.dss.2019.113100 · Cited by 152
Ye, H., Jiang, X., Luo, Z., & Chao, W. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1168 · Cited by 159
Critical appraisal of artificial intelligence-based prediction models for cardiovascular disease
van Smeden, M., Heinze, G., CALSTER, B. V., Asselbergs, F. W., Vardas, P. E., Bruining, N., de Jaegere, P. P. T., Moore, J. H., Denaxas, S., Boulesteix, A., et al. (2022) · European Heart Journal · doi:10.1093/eurheartj/ehac238 · Cited by 155
Mohale, V. Z., & Obagbuwa, I. C. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1526221 · Cited by 181
Exploring Interpretable LSTM Neural Networks over Multi-Variable DataPreprint
Guo, T., Lin, T., & Antulov-Fantulin, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12034 · Cited by 154
I Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI
Chromik, M., Eiband, M., Buchner, F., Krüger, A., & Butz, A. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450644 · Cited by 144
Learning to Faithfully Rationalize by Construction
Jain, S., Wiegreffe, S., Pinter, Y., & Wallace, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.409 · Cited by 181
Implementing machine learning in medicine
Verma, A. A., Murray, J., Greiner, R., Cohen, J., Shojania, K. G., Ghassemi, M., Straus, S. E., Pou-Prom, C., & Mamdani, M. (2021) · Canadian Medical Association Journal · doi:10.1503/cmaj.202434 · Cited by 154
Automatic sleep staging of EEG signals: recent development, challenges, and future directions
Phan, H., & Mikkelsen, K. B. (2022) · Physiological Measurement · doi:10.1088/1361-6579/ac6049 · Cited by 161
DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning
Tian, Q., Bilgiç, B., Fan, Q., Liao, C., Ngamsombat, C., Hu, Y., Witzel, T., Setsompop, K., Polimeni, J. R., & Huang, S. Y. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117017 · Cited by 137
Contemporary Symbolic Regression Methods and their Relative Performance
Cava, W. L., Orzechowski, P., Burlacu, B., de França, F. O., Virgolin, M., Jin, Y., Kommenda, M., & Moore, J. H. (2021) · PubMed · doi:10.48550/arxiv.2107.14351 · Cited by 257
Four Principles of Explainable Artificial Intelligence
Phillips, P. J., Hahn, C. A., Fontana, P. C., Broniatowski, D. A., & Przybocki, M. A. (2020) · doi:10.6028/nist.ir.8312-draft · Cited by 136
Improving Model-Based Genetic Programming for Symbolic Regression of Small Expressions
Virgolin, M., Alderliesten, T., Witteveen, C., & Bosman, P. A. N. (2020) · Evolutionary Computation · doi:10.1162/evco_a_00278 · Cited by 136
Artificial intelligence explainability: the technical and ethical dimensions
McDermid, J. A., Jia, Y., Porter, Z., & Habli, I. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0363 · Cited by 136
Langer, M., & König, C. J. (2021) · Human Resource Management Review · doi:10.1016/j.hrmr.2021.100881 · Cited by 179
Using machine learning as a surrogate model for agent-based simulations
Angione, C., Silverman, E., & Yaneske, E. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263150 · Cited by 160
A comprehensive review on financial explainable AI
Yeo, W. J., van der Heever, W., Mao, R., Cambria, E., Satapathy, R., & Mengaldo, G. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11077-7 · Cited by 218
Explainable Artificial Intelligence for Tabular Data: A Survey
Sahakyan, M., Aung, Z., & Rahwan, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116481 · Cited by 135
“According to Lipton’s taxonomy [15], there are three notions of model transparency: • Simulatability , reflecting the degree to which the user can contemplate the model in its entirety; FIGURE 1: A map of the references covered in the survey.”
BackgroundThe explainability paradox: Challenges for xAI in digital pathology
Evans, T., Retzlaff, C. O., Geißler, C., Kargl, M., Plass, M., Müller, H., Kiehl, T.-R., Zerbe, N., & Holzinger, A. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.03.009 · Cited by 135
Interpretable Machine Learning: A brief survey from the predictive maintenance perspective
Vollert, S., Atzmueller, M., & Theissler, A. (2021) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa45728.2021.9613467 · Cited by 145
Applying Deep Learning to Medical Imaging: A Review
Zhang, H. H., & Qie, Y. (2023) · Applied Sciences · doi:10.3390/app131810521 · Cited by 160
Eight Things to Know about Large Language Models
Bowman, S. R. (2024) · Critical AI · doi:10.1215/2834703x-11556011 · Cited by 305
Can we do better explanations? A proposal of user-centered explainable AI
Ribera, M., & Lapedriza, À. (2019) · IUI Workshops · Cited by 134
Abdullah, T. A. A., Zahid, M. S. M., & Ali, W. (2021) · Symmetry · doi:10.3390/sym13122439 · Cited by 154
Baur, L., Ditschuneit, K., Schambach, M., Kaymakci, C., Wollmann, T., & Sauer, A. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100358 · Cited by 152
Toward Explainable Deep Neural Network Based Anomaly Detection
Amarasinghe, K., Kenney, K., & Manic, M. (2018) · Conference on Human System Interactions · doi:10.1109/hsi.2018.8430788 · Cited by 136
The Impact of Feature Importance Methods on the Interpretation of Defect Classifiers
Rajbahadur, G. K., Wang, S., Oliva, G. A., Kamei, Y., & Hassan, A. E. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3056941 · Cited by 141
AI Anxiety: a comprehensive analysis of psychological factors and interventions
Kim, J. J. H., Soh, J. Y., Kadkol, S., Solomon, I., Yeh, H., Srivatsa, A. V., Nahass, G. R., Choi, J. Y., Lee, S., Nyugen, T., et al. (2025) · AI and Ethics · doi:10.1007/s43681-025-00686-9 · Cited by 181
Predicting the mechanical response of oligocrystals with deep learning
Frankel, A., Jones, R. E., Alleman, C. N., & Templeton, J. A. (2019) · Computational Materials Science · doi:10.1016/j.commatsci.2019.109099 · Cited by 133
A Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139
Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
Benjamin, J. J., Berger, A., Merrill, N., & Pierce, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445481 · Cited by 130
Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research
Vaughan, J. W. (2018) · Journal of Machine Learning Research · Cited by 131
Evaluation of post-hoc interpretability methods in time-series classification
Turbé, H., Bjelogrlic, M., Lovis, C., & Mengaldo, G. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00620-w · Cited by 130
How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review
Bertrand, A., Belloum, R., Eagan, J. R., & Maxwell, W. (2022) · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3514094.3534164 · Cited by 129
Fairness in Machine Learning: A Survey
Caton, S., & Haas, C. (2020) · arXiv · doi:10.48550/arxiv.2010.04053 · Cited by 646
Towards Faithful Model Explanation in NLP: A Survey
Lyu, Q., Apidianaki, M., & Callison-Burch, C. (2024) · Computational Linguistics · doi:10.1162/coli_a_00511 · Cited by 196
Co-design of human-centered, explainable AI for clinical decision support
Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3587271 · Cited by 127
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models
Dalvi, F., Durrani, N., Sajjad, H., Belinkov, Y., Bau, A., & Glass, J. R. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016309 · Cited by 18
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2021) · Philosophical studies series · doi:10.1007/978-3-030-81907-1_10 · Cited by 202
Yuan, B., Shen, C., Luna, A., Korkut, A., Marks, D. S., Ingraham, J., & Sander, C. (2020) · Cell Systems · doi:10.1016/j.cels.2020.11.013 · Cited by 125
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
