The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Flagged first, then by citations
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 401–500 of 1,051
A Review on Interpretable and Explainable Artificial Intelligence in Hydroclimatic Applications
Başağaoğlu, H., Chakraborty, D., do Lago, C. A. F., Gutierrez, L., Şahinli, M. A., Giacomoni, M. H., Furl, C. V., Mirchi, A., Moriasi, D. N., & Şengör, S. S. (2022) · Water · doi:10.3390/w14081230 · Cited by 135
Graziani, M., Dutkiewicz, L., Calvaresi, D., Amorim, J. P., Yordanova, K., Vered, M., Nair, R. S., Abreu, P. H., Blanke, T., Pulignano, V., et al. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10256-8 · Cited by 152
Parycek, P., Schmid, V., & Novak, A.-S. (2023) · Journal of the Knowledge Economy · doi:10.1007/s13132-023-01433-3 · Cited by 131
Li, S., Li, T., Sun, C., Yan, R., & Chen, X. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.05.027 · Cited by 125
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications
Ortigossa, E. S., Gonçalves, T., & Nonato, L. G. (2024) · IEEE Access · doi:10.1109/access.2024.3409843 · Cited by 124
Interpretable and Steerable Sequence Learning via Prototypes
Ming, Y., Xu, P., Qu, H., & Ren, L. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330908 · Cited by 134
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
Reviewing the Need for Explainable Artificial Intelligence (xAI)
Gerlings, J., Shollo, A., & Constantiou, I. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.156 · Cited by 165
Identifying and Controlling Important Neurons in Neural Machine TranslationPreprint
Bau, A., Belinkov, Y., Sajjad, H., Durrani, N., Dalvi, F., & Glass, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01157 · Cited by 162
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks
Räuker, T., Ho, A., Casper, S., & Hadfield-Menell, D. (2023) · 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml54575.2023.00039 · Cited by 122
On generating trustworthy counterfactual explanations
Del Ser, J., Barredo-Arrieta, A., Díaz-Rodríguez, N., Herrera, F., Saranti, A., & Holzinger, A. (2024) · Information Sciences · doi:10.1016/j.ins.2023.119898 · Cited by 122
Wani, S. U. D., Khan, N. A., Thakur, G. S., Gautam, S. P., Ali, M., Alam, P., Alshehri, S., Ghoneim, M. M., & Shakeel, F. (2022) · Healthcare · doi:10.3390/healthcare10040608 · Cited by 131
Plant Genotype to Phenotype Prediction Using Machine Learning
Danilevicz, M. F., Gill, M., Anderson, R., Batley, J., Bennamoun, M., Bayer, P. E., & Edwards, D. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.822173 · Cited by 133
Bernardini, M., Romeo, L., Misericordia, P., & Frontoni, E. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2899218 · Cited by 126
Disentangling Disentanglement in Variational AutoencodersPreprint
Mathieu, É., Rainforth, T., Siddharth, N., & Teh, Y. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02833 · Cited by 145
Bayesian networks for interpretable machine learning and optimization
Mihaljević, B., Bielza, C., & Larrañaga, P. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.138 · Cited by 123
Toward autonomous laboratories: Convergence of artificial intelligence and experimental automation
Xie, Y., Sattari, K., Zhang, C., & Lin, J. (2022) · Progress in Materials Science · doi:10.1016/j.pmatsci.2022.101043 · Cited by 129
Multi-Objective Hyperparameter Optimization in Machine Learning—An Overview
Karl, F., Pielok, T., Moosbauer, J., Pfisterer, F., Coors, S., Binder, M., Schneider, L., Thomas, J., Richter, J., Lang, M., et al. (2023) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3610536 · Cited by 160
Human-Centered Explainable AI (XAI): From Algorithms to User Experiences
Liao, Q. V., & Varshney, K. R. (2021) · arXiv · doi:10.48550/arxiv.2110.10790 · Cited by 120
Mottini, C., Napolitano, F., Li, Z., Gao, X., & Cardone, L. (2019) · Seminars in Cancer Biology · doi:10.1016/j.semcancer.2019.09.023 · Cited by 125
Interactive machine teaching: a human-centered approach to building machine-learned models
Ramos, G., Meek, C., Simard, P., Suh, J., & Ghorashi, S. (2020) · Human-Computer Interaction · doi:10.1080/07370024.2020.1734931 · Cited by 134
“Let me explain!”: exploring the potential of virtual agents in explainable AI interaction design
Weitz, K., Schiller, D., Schlagowski, R., Huber, T., & André, E. (2020) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-020-00332-0 · Cited by 140
Algorithms and Decision-Making in the Public Sector
Levy, K. E. C., Chasalow, K. E., & Riley, S. (2021) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-041221-023808 · Cited by 165
Machine learning of material properties: Predictive and interpretable multilinear models
Allen, A. E. A., & Tkatchenko, A. (2022) · Science Advances · doi:10.1126/sciadv.abm7185 · Cited by 133
Interpretable Anomaly Detection with DIFFI: Depth-based feature importance of Isolation Forest
Carletti, M., Terzi, M., & Susto, G. A. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105730 · Cited by 118
Chugunova, M., & Sele, D. (2022) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2022.101897 · Cited by 118
McCoy, L. G., Brenna, C. T. A., Chen, S. S., Vold, K., & Das, S. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.11.001 · Cited by 118
Artificial Intelligence for Law Enforcement: Challenges and Opportunities
Raaijmakers, S. A. (2019) · IEEE Security & Privacy · doi:10.1109/msec.2019.2925649 · Cited by 118
Interpretable heartbeat classification using local model-agnostic explanations on ECGs
Neves, I., Folgado, D., Santos, S., Barandas, M., Campagner, A., Ronzio, L., Cabitza, F., & Gamboa, H. F. S. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104393 · Cited by 118
Human-Centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Watkins, E. A., Manger, C., Daumé III, H., Riener, A., & Riedl, M. O. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503727 · Cited by 117
Suresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445088 · Cited by 117
Wang, S., Wang, Q., & Zhao, J. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102701 · Cited by 127
Stakeholders in Explainable AI
Preece, A., Harborne, D., Braines, D., Tomsett, R., & Chakraborty, S. (2018) · arXiv · doi:10.48550/arxiv.1810.00184 · Cited by 117
Explainability as a Non-Functional Requirement
Köhl, M. A., Baum, K. L., Langer, M., Oster, D., Speith, T., & Bohlender, D. (2019) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00046 · Cited by 132
The black box problem revisited. Real and imaginary challenges for automated legal decision making
Brożek, B., Furman, M., Jakubiec, M., & Kucharzyk, B. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09356-9 · Cited by 177
Wang, H., Hou, Y., He, Y., Wen, C., Girón-Palomares, B., Duan, Y.-X., Gao, B., Vavilov, V. P., & Wang, Y. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3293863 · Cited by 116
Khalil, M., AlSayed, A., Liu, Y., & Vanrolleghem, P. A. (2023) · Water Research · doi:10.1016/j.watres.2023.120667 · Cited by 116
Zhang, Q., & Wang, T. (2024) · Remote Sensing · doi:10.3390/rs16081344 · Cited by 136
Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey
Rojat, T., Puget, R., Filliat, D., Del Ser, J., Gelin, R., & Díaz-Rodríguez, N. (2021) · arXiv · doi:10.48550/arxiv.2104.00950 · Cited by 116
Applying Deep Learning to Audit Procedures: An Illustrative Framework
Sun, T. (2019) · Accounting Horizons · doi:10.2308/acch-52455 · Cited by 134
Cognitive Psychology for Deep Neural Networks: A Shape Bias Case StudyPreprint
Ritter, S., Barrett, D. G. T., Santoro, A., & Botvinick, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08606 · Cited by 140
Machine learning in cardiac CT: Basic concepts and contemporary data
Singh, G., Alaref, S. J., van Assen, M., Kim, T. S., van Rosendael, A., Kolli, K. K., Dwivedi, A., Maliakal, G., Pandey, M. K., Wang, J., et al. (2018) · Journal of cardiovascular computed tomography · doi:10.1016/j.jcct.2018.04.010 · Cited by 113
Improving the Interpretability of Deep Neural Networks with Knowledge Distillation
Liu, X., Wang, X., & Matwin, S. (2018) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2018.00132 · Cited by 120
Human Evaluation of Models Built for Interpretability
Lage, I., Chen, E., He, J., Narayanan, M., Kim, B., Gershman, S. J., & Doshi‐Velez, F. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5280 · Cited by 114
Confalonieri, R., Weyde, T., Besold, T. R., & Martı́n, F. M. D. P. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103471 · Cited by 112
Review of interpretable machine learning for process industries
Carter, A., Imtiaz, S. A., & Naterer, G. F. (2022) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2022.12.018 · Cited by 122
Advancements in Imaging Sensors and AI for Plant Stress Detection: A Systematic Literature Review
Walsh, J., Mangina, E., & Negrão, S. (2024) · Plant Phenomics · doi:10.34133/plantphenomics.0153 · Cited by 121
Houssein, E. H., Gamal, A. M., Younis, E. M. G., & Mohamed, E. (2025) · Cluster Computing · doi:10.1007/s10586-025-05281-5 · Cited by 148
How can I choose an explainer?: An Application-grounded Evaluation of Post-hoc Explanations
Jesus, S., Belém, C., Balayan, V., Bento, J., Saleiro, P., Bizarro, P., & Gama, J. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445941 · Cited by 112
D’Urso, F., & Broccolo, F. (2024) · Applied Sciences · doi:10.3390/app14198627 · Cited by 112
Pereira, S., Meier, R., McKinley, R., Wiest, R., Alves, V., Silva, C. A., & Reyes, M. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.12.009 · Cited by 113
SHAP Value-Based Feature Importance Analysis for Short-Term Load Forecasting
Lee, Y.-G., Oh, J.-Y., Kim, D.-S., & Kim, G. (2022) · Journal of Electrical Engineering and Technology · doi:10.1007/s42835-022-01161-9 · Cited by 123
Wang, S., Mo, B., & Zhao, J. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.01.012 · Cited by 126
The Robust Manifold Defense: Adversarial Training using Generative ModelsPreprint
Jalal, A., Ilyas, A., Daskalakis, C., & Dimakis, A. G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.09196 · Cited by 155
Designing a feature selection method based on explainable artificial intelligence
Zacharias, J., von Zahn, M., Chen, J., & Hinz, O. (2022) · Electronic Markets · doi:10.1007/s12525-022-00608-1 · Cited by 109
NILE : Natural Language Inference with Faithful Natural Language Explanations
Kumar, S., & Talukdar, P. P. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.771 · Cited by 139
LEA 3: Factor models in population genetics and ecological genomics with R
Gain, C., & François, O. (2021) · Molecular Ecology Resources · doi:10.1111/1755-0998.13366 · Cited by 112
Salas, P., la Fuente, R. A. D., Astroza, S., & Carrasco, J. A. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116253 · Cited by 117
A Perspective on Explanations of Molecular Prediction Models
Wellawatte, G. P., Gandhi, H. A., Seshadri, A., & White, A. D. (2023) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.2c01235 · Cited by 119
IEEE P7001: A Proposed Standard on Transparency
Winfield, A. F. T., Booth, S., Dennis, L. A., Egawa, T., Hastie, H., Jacobs, N. J., Muttram, R. I., Olszewska, J. I., Rajabiyazdi, F., Theodorou, A. A., et al. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.665729 · Cited by 110
Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems
Nourani, M., Roy, C., Block, J. E., Honeycutt, D. R., Rahman, T., Ragan, E., & Gogate, V. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450639 · Cited by 107
Operationalizing Human-Centered Perspectives in Explainable AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Mara, M., Streit, M., Wachter, S., Riener, A., & Riedl, M. O. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3441342 · Cited by 121
Acquisition of chess knowledge in AlphaZero
McGrath, T., Kapishnikov, A., Tomašev, N., Pearce, A., Wattenberg, M., Hassabis, D., Kim, B., Paquet, U., & Kramnik, V. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2206625119 · Cited by 166
One-Class Classification: A SurveyPreprint
Perera, P., Oza, P., & Patel, V. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03064 · Cited by 168
Explainable Active Learning (XAL): Toward AI Explanations as Interfaces for Machine Teachers
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432934 · Cited by 106
Algorithmic Fairness in Mortgage Lending: from Absolute Conditions to Relational Trade-offs
Lee, M. S. A., & Floridi, L. (2021) · Minds and Machines · doi:10.1007/s11023-020-09529-4 · Cited by 106
Ultra-Strong Machine Learning: comprehensibility of programs learned with ILP
Muggleton, S., Schmid, U., Zeller, C., Tamaddoni‐Nezhad, A., & Besold, T. R. (2018) · Machine Learning · doi:10.1007/s10994-018-5707-3 · Cited by 116
Explainable artificial intelligence and machine learning: A reality rooted perspective
Emmert‐Streib, F., Yli-Harja, O. P., & Dehmer, M. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1368 · Cited by 119
Advanced EEG-based learning approaches to predict schizophrenia: Promises and pitfalls
Barros, C., Silva, C. A., & Pinheiro, A. P. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102039 · Cited by 109
Beyond generalization: a theory of robustness in machine learning
Freiesleben, T., & Grote, T. (2023) · Synthese · doi:10.1007/s11229-023-04334-9 · Cited by 106
Extract interpretability-accuracy balanced rules from artificial neural networks: A review
He, C., Ma, M., & Wang, P. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.036 · Cited by 104
Instance-Based Counterfactual Explanations for Time Series Classification
Delaney, E. D., Greene, D., & Keane, M. T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86957-1_3 · Cited by 109
Deep learning-based breast cancer grading and survival analysis on whole-slide histopathology images
Wetstein, S. C., de Jong, V. M. T., Stathonikos, N., Opdam, M., Dackus, G. M. H. E., Pluim, J. P. W., van Diest, P. J., & Veta, M. (2022) · Scientific Reports · doi:10.1038/s41598-022-19112-9 · Cited by 110
Detecting Statistical Interactions from Neural Network WeightsPreprint
Tsang, M., Cheng, D., & Liu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04977 · Cited by 161
Silva, A., Schrum, M., Hedlund-Botti, E., Gopalan, N., & Gombolay, M. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2101698 · Cited by 104
Boyle, R. T., Jollans, L., Rueda‐Delgado, L. M., Rizzo, R., Yener, G., McMorrow, J. P., Knight, S. P., Carey, D., Robertson, I. H., Emek‐Savaş, D. D., et al. (2020) · Brain Imaging and Behavior · doi:10.1007/s11682-020-00260-3 · Cited by 115
Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions
Han, X., Wallace, B., & Tsvetkov, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.492 · Cited by 164
Adler, D. A., Ben‐Zeev, D., Tseng, V. W.-S., Kane, J. M., Brian, R., Campbell, A. T., Hauser, M., Scherer, E. A., & Choudhury, T. (2020) · JMIR mhealth and uhealth · doi:10.2196/19962 · Cited by 107
On Generating Plausible Counterfactual and Semi-Factual Explanations for Deep Learning
Kenny, E. M., & Keane, M. T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17377 · Cited by 108
From Responsibility to Reason-Giving Explainable Artificial Intelligence
Baum, K., Mantel, S., Schmidt, E., & Speith, T. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00510-w · Cited by 103
Suresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 103
Manfren, M., James, P. A. B., & Tronchin, L. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112686 · Cited by 102
Building more accurate decision trees with the additive tree
Luna, J. M., Gennatas, E. D., Ungar, L., Eaton, E., Diffenderfer, E. S., Jensen, S. T., Simone, C. B., Friedman, J. H., Solberg, T. D., & Valdés, G. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816748116 · Cited by 101
Aligning Superhuman AI with Human Behavior
McIlroy-Young, R., Sen, S., Kleinberg, J. M., & Anderson, A. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403219 · Cited by 137
Condran, S., Bewong, M., Islam, M. Z., Maphosa, L., & Zheng, L. (2022) · IEEE Access · doi:10.1109/access.2022.3188649 · Cited by 99
Principles and Practice of Explainable Machine Learning
Belle, V., & Papantonis, I. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.688969 · Cited by 99
Explainability and causability in digital pathology
Plass, M., Kargl, M., Kiehl, T., Regitnig, P., Geißler, C., Evans, T., Zerbe, N., Carvalho, R., Holzinger, A., & Müller, H. (2023) · The Journal of Pathology Clinical Research · doi:10.1002/cjp2.322 · Cited by 99
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103
Meddage, D. P. P., Ekanayake, I. U., Weerasuriya, A. U., Lewangamage, C., Tse, K. T., Miyanawala, T. P., & Ramanayaka, C. E. (2022) · Journal of Wind Engineering and Industrial Aerodynamics · doi:10.1016/j.jweia.2022.105027 · Cited by 103
Survey on Explainable AI: Techniques, challenges and open issues
Abusitta, A., Li, M. Q., & Fung, B. C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124710 · Cited by 98
Protecting consumers from collusive prices due to AI
Calvano, E., Calzolari, G., Denicolò, V., Harrington, J. E., & Pastorello, S. (2020) · Science · doi:10.1126/science.abe3796 · Cited by 98
Predicting MCI Status From Multimodal Language Data Using Cascaded Classifiers
Fraser, K., Fors, K. L., Eckerström, M., Öhman, F., & Kokkinakis, D. (2019) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2019.00205 · Cited by 99
Rechkemmer, A., & Yin, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501967 · Cited by 97
Explainable Artificial Intelligence Approaches: A SurveyPreprint
Islam, S. R., Eberle, W., Ghafoor, S., & Ahmed, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09429 · Cited by 168
Concept attribution: explaining cnn decisions to physicians
M., G., V., A., S., M.-M., & H., M. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103865 · Cited by 95
Coloring Molecules with Explainable Artificial Intelligence for Preclinical Relevance Assessment
Jiménez-Luna, J., Skalic, M., Weskamp, N., & Schneider, G. (2021) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c01344 · Cited by 96
COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96
A Survey on Neuromarketing Using EEG Signals
Khurana, V., Gahalawat, M., Kumar, P., Roy, P. P., Dogra, D. P., Scheme, E., & Soleymani, M. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3065200 · Cited by 105
A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images
Messina, P., Pino, P., Parra, D., Soto, Á., Besa, C., Uribe, S. A., Andía, M. E., Cristián Tejos, N., Prieto, C., & Daniel Capurro, N. (2022) · ACM Computing Surveys · doi:10.1145/3522747 · Cited by 111
ISeeU: Visually interpretable deep learning for mortality prediction inside the ICU
Caicedo-Torres, W., & Gutiérrez, J. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103269 · Cited by 99
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
