The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Flagged first, then by citations
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 601–700 of 1,051
Ramon, Y., Martens, D., Provost, F., & Evgeniou, T. (2020) · Advances in Data Analysis and Classification · doi:10.1007/s11634-020-00418-3 · Cited by 79
A Survey of Explainable AI Terminology
Clinciu, M., & Hastie, H. (2019) · doi:10.18653/v1/w19-8403 · Cited by 88
A Survey of Human‐Centered Evaluations in Human‐Centered Machine Learning
Sperrle, F., El‐Assady, M., Guo, G., Borgo, R., Chau, D. H., Endert, A., & Keim, D. A. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14329 · Cited by 93
Lundberg, H., Mowla, N. I., Abedin, S. F., Thar, K., Mahmood, A., Gidlund, M., & Raza, S. (2022) · IEEE Access · doi:10.1109/access.2022.3208573 · Cited by 91
How do we assess the trustworthiness of AI? Introducing the trustworthiness assessment model (TrAM)
Schlicker, N., Baum, K. L., Uhde, A., Sterz, S., Hirsch, M. C., & Langer, M. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108671 · Cited by 106
NBDT: Neural-Backed Decision TreesPreprint
Wan, A., Dunlap, L., Ho, D., Yin, J., Lee, S., Jin, H., Petryk, S., Bargal, S. A., & Gonzalez, J. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.00221 · Cited by 137
Lee, M. H., & Chew, C. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610218 · Cited by 78
Mehdiyev, N., & Fettke, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-64949-4_1 · Cited by 78
Transparency as design publicity: explaining and justifying inscrutable algorithms
Loi, M., Ferrario, A., & Viganò, E. (2021) · Ethics and Information Technology · doi:10.1007/s10676-020-09564-w · Cited by 79
Transparency in Fair Machine Learning: the Case of Explainable Recommender Systems
Abdollahi, B., & Nasraoui, O. (2018) · Human-computer interaction series · doi:10.1007/978-3-319-90403-0_2 · Cited by 78
Modern Machine Learning as a Benchmark for Fitting Neural Responses
Benjamin, A. S., Fernandes, H. L., Tomlinson, T., Ramkumar, P., Versteeg, C., Chowdhury, R. H., Miller, L. E., & Kording, K. P. (2018) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2018.00056 · Cited by 82
Chalkidis, I., Fergadiotis, M., Tsarapatsanis, D., Aletras, N., Androutsopoulos, I., & Malakasiotis, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.22 · Cited by 78
Figueroa, K. C., Song, B., Sunny, S. P., Li, S., Gurushanth, K., Mendonca, P., Mukhia, N., Patrick, S., Gurudath, S., Raghavan, S., et al. (2022) · Journal of Biomedical Optics · doi:10.1117/1.jbo.27.1.015001 · Cited by 84
Explainability in music recommender systems
Afchar, D., Melchiorre, A. B., Schedl, M., Hennequin, R., Epure, E. V., & Moussallam, M. (2022) · AI Magazine · doi:10.1002/aaai.12056 · Cited by 100
Interpretability and Explainability: A Machine Learning Zoo Mini-tourPreprint
Marcinkevičs, R., & Vogt, J. E. (2020) · arXiv (Cornell University) · doi:10.3929/ethz-b-000454597 · Cited by 179
Effects of Explanations in AI-Assisted Decision Making: Principles and Comparisons
Wang, X., & Yin, M. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3519266 · Cited by 74
Han, Y., Pereira, F. C., Ben-Akiva, M. E., & Zegras, P. C. (2022) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2022.07.001 · Cited by 125
Interpretable machine learning methods for predictions in systems biology from omics data
Sidak, D., Schwarzerová, J., Weckwerth, W., & Waldherr, S. (2022) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2022.926623 · Cited by 81
Nazat, S., Li, L., & Abdallah, M. (2024) · IEEE Access · doi:10.1109/access.2024.3383431 · Cited by 86
Generating Counterfactual and Contrastive Explanations using SHAPPreprint
Rathi, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09293 · Cited by 76
Risk assessment tools and data-driven approaches for predicting and preventing suicidal behavior
Velupillai, S., Hadlaczky, G., Baca-Garcia, E., Gorrell, G. M., Werbeloff, N., Nguyen, D., Patel, R., Leightley, D., Downs, J., Hotopf, M., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00036 · Cited by 76
Carneiro, G., Zorron Cheng Tao Pu, L., Singh, R., & Burt, A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101653 · Cited by 76
Schultebraucks, K., Choi, K. W., Galatzer‐Levy, I. R., & Bonanno, G. A. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0228 · Cited by 78
LINDA-BN: An interpretable probabilistic approach for demystifying black-box predictive models
Moreira, C., Chou, Y.-L., Velmurugan, M., Ouyang, C., Sindhgatta, R., & Bruza, P. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113561 · Cited by 76
Evaluation Methods and Measures for Causal Learning Algorithms
Cheng, L., Guo, R., Moraffah, R., Sheth, P., Candan, K. S., & Liu, H. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3150264 · Cited by 88
State of the Art of Visual Analytics for eXplainable Deep Learning
Rosa, B. L., Blasilli, G., Bourqui, R., Auber, D., Santucci, G., Capobianco, R., Bertini, E., Giot, R., & Angelini, M. (2023) · Computer Graphics Forum · doi:10.1111/cgf.14733 · Cited by 94
Chen, G., Yuan, J., Zhang, Y., Zhu, H., Huang, R., Wang, F., & Li, W. (2024) · IEEE Access · doi:10.1109/access.2024.3430010 · Cited by 87
Algorithmic Recourse: from Counterfactual Explanations to Interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2020) · arXiv · doi:10.48550/arxiv.2002.06278 · Cited by 76
Mapping the multiscale structure of biological systems
Schaffer, L. V., & Ideker, T. (2021) · Cell Systems · doi:10.1016/j.cels.2021.05.012 · Cited by 75
Aligning Faithful Interpretations with their Social Attribution
Jacovi, A., & Goldberg, Y. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00367 · Cited by 85
Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
Lima, G., Grgić-Hlača, N., & Cha, M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445260 · Cited by 91
The Role of Explainability in Assuring Safety of Machine Learning in Healthcare
Jia, Y., McDermid, J. A., Lawton, T., & Habli, I. (2022) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2022.3171314 · Cited by 93
Modulation spectral features for speech emotion recognition using deep neural networks
Singh, P., Sahidullah, M., & Saha, G. (2022) · Speech Communication · doi:10.1016/j.specom.2022.11.005 · Cited by 80
Palar, P. S., Zuhal, L. R., & Shimoyama, K. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.109045 · Cited by 78
A survey of algorithmic recourse: definitions, formulations, solutions, and prospectsPreprint
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04050 · Cited by 74
Explaining machine learning reveals policy challenges
Coyle, D., & Weller, A. (2020) · Science · doi:10.1126/science.aba9647 · Cited by 74
On the Linguistic Representational Power of Neural Machine Translation Models
Belinkov, Y., Durrani, N., Dalvi, F., Sajjad, H., & Glass, J. R. (2020) · Computational Linguistics · doi:10.1162/coli_a_00367 · Cited by 77
Gao, J., Chen, M., Li, Y., Gao, Y.-C., Li, Y., Cai, S., & Wang, J. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.629630 · Cited by 74
Interpretability in the medical field: A systematic mapping and review study
Hakkoum, H., Abnane, I., & Idri, A. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.108391 · Cited by 82
Raab, D., Theissler, A., & Spiliopoulou, M. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07809-x · Cited by 84
Long short-term memory models of water quality in inland water environments
Pyo, J., Pachepsky, Y. A., Kim, S., Abbas, A., Kim, M., Kwon, Y. S., Ligaray, M. V., & Cho, K. H. (2023) · Water Research X · doi:10.1016/j.wroa.2023.100207 · Cited by 79
Ahmed, U., Zheng, J., Almogren, A., Sadiq, M., Rehman, A. U., Sadiq, M. T., & Choi, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-81151-1 · Cited by 91
Comprehensive review of recent developments in visual object detection based on deep learning
Edozie, E., Shuaibu, A. N., John, U. K., & Sadiq, B. O. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11284-w · Cited by 100
Explainable machine learning for public policy: Use cases, gaps, and research directions
Amarasinghe, K., Rodolfa, K. T., Lamba, H., & Ghani, R. (2023) · Data & Policy · doi:10.1017/dap.2023.2 · Cited by 73
Abstractive text summarization: State of the art, challenges, and improvements
Shakil, H., Farooq, A., & Kalita, J. K. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128255 · Cited by 100
HIVE: Evaluating the Human Interpretability of Visual Explanations
Kim, S. S. Y., Meister, N., Ramaswamy, V. V., Fong, R., & Russakovsky, O. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19775-8_17 · Cited by 72
Leading with AI in critical care nursing: challenges, opportunities, and the human factor
Hassan, E. A., & El-Ashry, A. M. (2024) · BMC Nursing · doi:10.1186/s12912-024-02363-4 · Cited by 72
The explanation game: a formal framework for interpretable machine learning
Watson, D., & Floridi, L. (2020) · Synthese · doi:10.1007/s11229-020-02629-9 · Cited by 81
Explanation Ontology: A Model of Explanations for User-Centered AI
Chari, S., Seneviratne, O. W., Gruen, D. M., Foreman, M. A., Das, A. K., & McGuinness, D. L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62466-8_15 · Cited by 72
Banegas‐Luna, A. J., Peña-García, J. J., Iftene, A., Guadagni, F., Ferroni, P., Scarpato, N., Zanzotto, F. M., Bueno-Crespo, A., & Pérez‐Sánchez, H. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22094394 · Cited by 77
Shallow and deep learning classifiers in medical image analysis
Prinzi, F., Currieri, T., Gaglio, S., & Vitabile, S. (2024) · European Radiology Experimental · doi:10.1186/s41747-024-00428-2 · Cited by 84
Khan, F. S., Mazhar, S. S., Mazhar, K., AlSaleh, D., & Mazhar, A. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11215-9 · Cited by 128
AI system engineering key challenges and lessons learned
Fischer, L., Ehrlinger, L., Geist, V., Ramler, R., Sobiezky, F., Zellinger, W., Brunner, D., Kumar, M., & Moser, B. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make3010004 · Cited by 71
“An important aspect is its mathematical rigidity, which avoids the accusation of quasi-scientificity (see Reference [130]).”
BackgroundHow We Do Things With Words: Analyzing Text as Social and Cultural Data
Nguyen, D., Liakata, M., DeDeo, S., Eisenstein, J., Mimno, D., Tromble, R., & Winters, J. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00062 · Cited by 136
Differentiable Reasoning on Large Knowledge Bases and Natural Language
Minervini, P., Bošnjak, M., Rocktäschel, T., Riedel, S., & Grefenstette, E. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5962 · Cited by 71
Data Management for Machine Learning: A Survey
Chai, C., Wang, J., Luo, Y., Niu, Z., & Li, G. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3148237 · Cited by 85
Sensible AI: Re-imagining Interpretability and Explainability using Sensemaking Theory
Kaur, H., Adar, E., Gilbert, É., & Lampe, C. A. C. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533135 · Cited by 88
Yang, M., Huang, Y., Xu, C., Liu, C., & Dai, B. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.124631 · Cited by 73
From Vulnerability to Defense: The Role of Large Language Models in Enhancing Cybersecurity
Kasri, W., Himeur, Y., Alkhazaleh, H. A., Tarapiah, S., Atalla, S., Mansoor, W., & Al-Ahmad, H. (2025) · Computation · doi:10.3390/computation13020030 · Cited by 87
IMPROVED EXPLAINABILITY OF CAPSULE NETWORKS: RELEVANCE PATH BY AGREEMENT
Shahroudnejad, A., Afshar, P., Plataniotis, K. N., & Mohammadi, A. (2018) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2018.8646474 · Cited by 75
SIRUS: Stable and Interpretable RUle Set for classification
Bénard, C., Gérard Biau, A., da Veiga, S., & Scornet, E. (2021) · Electronic Journal of Statistics · doi:10.1214/20-ejs1792 · Cited by 80
Energy Consumption Forecasting in Korea Using Machine Learning Algorithms
Shin, S.-Y., & Woo, H. (2022) · Energies · doi:10.3390/en15134880 · Cited by 77
Wagan, S. A., Koo, J., Siddiqui, I. F., Attique, M., Shin, D. R., & Qureshi, N. M. F. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.09.005 · Cited by 80
SoK: Explainable Machine Learning for Computer Security Applications
Nadeem, A., Vos, D., Cao, C., Pajola, L., Dieck, S., Baumgartner, R., & Verwer, S. (2023) · IEEE European Symposium on Security and Privacy · doi:10.1109/eurosp57164.2023.00022 · Cited by 79
Quantifying Model Complexity via Functional Decomposition for Better Post-hoc Interpretability
Molnar, C., Casalicchio, G., & Bischl, B. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-43823-4_17 · Cited by 83
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms
An, P., Holstein, K., d'Anjou, B., Eggen, B., & Bakker, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376277 · Cited by 69
“For example, a system that presents high-level interpretations should also offer insight into how its interpretations were made [74, 134], or enable teachers to view relevant, less-interpreted data, to check alignment between the system’s interpretation and their own [5, 51, 74].”
BackgroundA Survey on Deep Learning for Steering Angle Prediction in Autonomous Vehicles
Gidado, U. M., Chiroma, H., Aljojo, N., Abubakar, S., Popoola, S. I., & Al-Garadi, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.3017883 · Cited by 67
Learning to See: Convolutional Neural Networks for the Analysis of Social Science Data
Torres, M., & Cantú, F. (2021) · Political Analysis · doi:10.1017/pan.2021.9 · Cited by 71
Recommender Systems: An Explainable AI Perspective
Vultureanu‐Albişi, A., & Bădică, C. (2021) · International Conference on Innovations in Intelligent Systems and Applications (INISTA) · doi:10.1109/inista52262.2021.9548125 · Cited by 70
Maskew, M., Sharpey-Schafer, K., Voux, L. D., Crompton, T., Bor, J. H., Rennick, M., Chirowodza, A., Miot, J., Molefi, S., Onaga, C., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-16062-0 · Cited by 72
Incorporating soil knowledge into machine‐learning prediction of soil properties from soil spectra
Ma, Y., Minasny, B., Demattê, J. A. M., & McBratney, A. B. (2023) · European Journal of Soil Science · doi:10.1111/ejss.13438 · Cited by 69
Explaining A Black-box By Using A Deep Variational Information Bottleneck Approach
Bang, S., Xie, P., Lee, H., Wu, W., & Xing, E. P. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17358 · Cited by 73
The Promise and Peril of Human Evaluation for Model InterpretabilityPreprint
Herman, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07414 · Cited by 69
"Why Should You Trust My Explanation?" Understanding Uncertainty in LIME Explanations
Zhang, Y., Song, K., Sun, Y., Tan, S., & Udell, M. (2019) · arXiv · doi:10.48550/arxiv.1904.12991 · Cited by 68
Explaining sentiment analysis results on social media texts through visualization
Jain, R., Kumar, A., Nayyar, A., Dewan, K., Garg, R., Raman, S., & Ganguly, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14432-y · Cited by 68
CoCoX: Generating Conceptual and Counterfactual Explanations via Fault-Lines
Akula, A., Wang, S., & Zhu, S. C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5643 · Cited by 71
Building and Interpreting Deep Similarity Models
Eberle, O., Büttner, J., Kräutli, F., Müller, K., Valleriani, M., & Montavon, G. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3020738 · Cited by 74
Wang, N., Guo, Z., Shang, D., & Li, K. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.123178 · Cited by 68
Training data influence analysis and estimation: a survey
Hammoudeh, Z., & Lowd, D. (2024) · Machine Learning · doi:10.1007/s10994-023-06495-7 · Cited by 136
Explainable Artificial Intelligence in Neuroimaging of Alzheimer’s Disease
Taiyeb Khosroshahi, M., Morsali, S., Gharakhanlou, S., Motamedi, A., Hassanbaghlou, S., Vahedi, H., Pedrammehr, S., Kabir, H. M. D., & Jafarizadeh, A. (2025) · Diagnostics · doi:10.3390/diagnostics15050612 · Cited by 68
Toward Interpretable Machine Learning: Transparent Deep Neural Networks and BeyondPreprint
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Müller, K. (2020) · arXiv (Cornell University) · Cited by 70
Neural forecasting: Introduction and literature overview.Preprint
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, B., Maddix, D. C., Türkmen, A. C., Gasthaus, J. A., Bohlke‐Schneider, M., Salinas, D., Stella, L., et al. (2020) · arXiv (Cornell University) · Cited by 69
Evolutionary Learning of Interpretable Decision Trees
Custode, L. L., & Iacca, G. (2023) · IEEE Access · doi:10.1109/access.2023.3236260 · Cited by 82
Wang, L., Hu, Z., Wan, X., Hua, W., Li, H., Yang, Q., & Wang, W. (2022) · Advanced Energy Materials · doi:10.1002/aenm.202200340 · Cited by 68
The regulatory gap in digital health and alternative pathways to bridge it
Iqbal, J. D., & Biller‐Andorno, N. (2022) · Health Policy and Technology · doi:10.1016/j.hlpt.2022.100663 · Cited by 67
Yue, B., & Li, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1277861 · Cited by 72
Interpretable Machine Learning for Discovery: Statistical Challenges and Opportunities
Allen, G. I., Gan, L., & Zheng, L. (2023) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-040120-030919 · Cited by 84
AIGC-empowered smart manufacturing: Prospects and challenges
Leng, J., Zheng, K., Li, R. C., Chen, C., Wang, B., Liu, Q., Chen, X., & Shen, W. (2025) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2025.103076 · Cited by 74
Deo, R. C. (2020) · Circulation · doi:10.1161/circulationaha.120.050583 · Cited by 78
Nordic Human-Computer Interaction Conference
(2022) · doi:10.1145/3546155 · Cited by 67
Mohamed, E., Sirlantzis, K., & Howells, G. (2022) · Displays · doi:10.1016/j.displa.2022.102239 · Cited by 67
Drobnič, F., Kos, A., & Pustišek, M. (2020) · Electronics · doi:10.3390/electronics9050761 · Cited by 66
Tal, A. S., Kuflik, T., & Kliger, D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2095705 · Cited by 73
A Survey on Attention Mechanisms for Medical Applications: are we Moving Toward Better Algorithms?
Gonçalves, T., Rio-Torto, I., Teixeira, L. F., & Cardoso, J. S. (2022) · IEEE Access · doi:10.1109/access.2022.3206449 · Cited by 83
Harfouche, A., Quinio, B., Saba, M., & Saba, P. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10352-8 · Cited by 55
Property Inference for Deep Neural Networks
Gopinath, D., Converse, H., Păsăreanu, C. S., & Taly, A. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00079 · Cited by 66
A Slow Algorithm Improves Users' Assessments of the Algorithm's Accuracy
Park, J. S., Barber, R., Kirlik, A., & Karahalios, K. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359204 · Cited by 65
Translating AI to Clinical Practice: Overcoming Data Shift with Explainability
Choi, Y., Yu, W., Nagarajan, M. B., Teng, P., Goldin, J. G., Raman, S. S., Enzmann, D. R., Kim, G. H. J., & Brown, M. S. (2023) · RadioGraphics · doi:10.1148/rg.220105 · Cited by 65
Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603203 · Cited by 67
Bostrom, A., Demuth, J. L., Wirz, C. D., Cains, M. G., Schumacher, A., Madlambayan, D., Bansal, A. S., Bearth, A., Chase, R. J., Crosman, K. M., et al. (2023) · Risk Analysis · doi:10.1111/risa.14245 · Cited by 81
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
