The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Flagged first, then by citations
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 501–600 of 1,051
Incorporating Priors with Feature Attribution on Text Classification
Liu, F., & Avci, B. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1631 · Cited by 120
The politics of deceptive borders: ‘biomarkers of deceit’ and the case of iBorderCtrl
Sánchez‐Monedero, J., & Dencik, L. (2020) · Information Communication & Society · doi:10.1080/1369118x.2020.1792530 · Cited by 110
Model interpretability of financial fraud detection by group SHAP
Lin, K., & Gao, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118354 · Cited by 100
Public attitudes value interpretability but prioritize accuracy in Artificial Intelligence
Nußberger, A.-M., Luo, L., Celis, L. E., & Crockett, M. J. (2022) · Nature Communications · doi:10.1038/s41467-022-33417-3 · Cited by 105
Fraser, A. G., Biasin, E., Bijnens, B. H., Bruining, N., Caiani, E. G., Cobbaert, K., Davies, R. H., Gilbert, S., Hovestadt, L., Kamenjašević, E., et al. (2023) · Expert Review of Medical Devices · doi:10.1080/17434440.2023.2184685 · Cited by 116
Li, S., Li, T., Sun, C., Chen, X., & Yan, R. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3282599 · Cited by 95
Futia, G., & Vetrò, A. (2020) · Information · doi:10.3390/info11020122 · Cited by 94
Kalakoti, R., Bahsi, H., & Nõmm, S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3360626 · Cited by 93
Jha, A., K. Aicher, J., R. Gazzara, M., Singh, D., & Barash, Y. (2020) · Genome Biology · doi:10.1186/s13059-020-02055-7 · Cited by 93
Prognostics and Health Management of Industrial Assets: Current Progress and Road Ahead
Biggio, L., & Kastanis, I. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.578613 · Cited by 114
Mothilal, R. K., Mahajan, D., Tan, C., & Sharma, A. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462597 · Cited by 103
Kino, S., Hsu, Y., Shiba, K., Chien, Y.-S., Mita, C., Kawachi, I. I., & Daoud, A. (2021) · SSM - Population Health · doi:10.1016/j.ssmph.2021.100836 · Cited by 103
Explainable Embodied Agents Through Social Cues
Wallkötter, S., Tulli, S., Castellano, G., Paiva, A., & Chétouani, M. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3457188 · Cited by 100
A pipeline and comparative study of 12 machine learning models for text classification
Occhipinti, A., Rogers, L., & Angione, C. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117193 · Cited by 104
Predicting Heart Diseases Using Machine Learning and Different Data Classification Techniques
El-Sofany, H. F. (2024) · IEEE Access · doi:10.1109/access.2024.3437181 · Cited by 93
Hind, M., Wei, D., Campbell, M. S., Codella, N., Dhurandhar, A., Mojsilović, A., Ramamurthy, K. N., & Varshney, K. R. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314273 · Cited by 129
Illuminating the Black Box: Interpreting Deep Neural Network Models for Psychiatric Research
Sheu, Y.-H. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.551299 · Cited by 101
How We Do Things With Words: Analyzing Text as Social and Cultural Data
Nguyen, D., Liakata, M., DeDeo, S., Eisenstein, J., Mimno, D., Tromble, R., Winters, J., Processing, S. N. L., & Processing, N. L. (2020) · Utrecht University Repository (Utrecht University) · Cited by 92
The fundamental principles of reproducibility
Gundersen, O. E. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0210 · Cited by 121
Feature importance in machine learning models: A fuzzy information fusion approach
Rengasamy, D., Mase, J. M., Kumar, A., Rothwell, B. C., Torres, M. T., Alexander, M. R., Winkler, D. A., & Figueredo, G. P. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.053 · Cited by 97
Thalpage, N. S. (2023) · Journal of Digital Art & Humanities · doi:10.33847/2712-8148.4.1_4 · Cited by 103
Explainable $k$-Means and $k$-Medians ClusteringPreprint
Dasgupta, S., Frost, N., Moshkovitz, M., & Rashtchian, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12538 · Cited by 95
AI, Opacity, and Personal Autonomy
Vaassen, B. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00577-5 · Cited by 94
To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods
Amparore, E. G., Perotti, A., & Bajardi, P. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.479 · Cited by 103
Explainable Artificial Intelligence (XAI) in Insurance
Owens, E., Sheehan, B., Mullins, M., Cunneen, M., Ressel, J., & Castignani, G. (2022) · Risks · doi:10.3390/risks10120230 · Cited by 135
Tian, X., Pavur, R., Han, H., & Zhang, L. (2022) · Business Process Management Journal · doi:10.1108/bpmj-08-2022-0389 · Cited by 109
Explainable deep learning in plant phenotyping
Mostafa, S., Mondal, D., Panjvani, K., Kochian, L. V., & Stavness, I. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1203546 · Cited by 99
A systematic review on automated clinical depression diagnosis
Mao, K., Wu, Y., & Chen, J. (2023) · npj Mental Health Research · doi:10.1038/s44184-023-00040-z · Cited by 106
Branda, F., & Scarpa, F. (2024) · Antibiotics · doi:10.3390/antibiotics13060502 · Cited by 104
A review of explainable artificial intelligence in smart manufacturing
Madathil, A. P., Luo, X., Liu, Q., Walker, C. T., Madarkar, R., & Qin, Y. (2025) · International Journal of Production Research · doi:10.1080/00207543.2025.2513574 · Cited by 121
Explainable Artificial Intelligence: a Systematic Review
Vilone, G., & Longo, L. (2020) · arXiv · doi:10.48550/arxiv.2006.00093 · Cited by 269
Kumar, V., Roche, C. P., Overman, S. S., Simovitch, R. W., Flurin, P.-H., Wright, T. W., Zuckerman, J. D., Routman, H. D., & Teredesai, A. M. (2020) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001263 · Cited by 91
Understanding More About Human and Machine Attention in Deep Neural Networks
Lai, Q., Khan, S. H., Nie, Y., Sun, H., Shen, J., & Shao, L. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3007321 · Cited by 102
Kim, T., Sharda, S., Zhou, X., & Pendyala, R. M. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102786 · Cited by 93
On the integration of symbolic and sub-symbolic techniques for XAI: A survey
Calegari, R., Ciatto, G., & Omicini, A. (2020) · Intelligenza Artificiale · doi:10.3233/ia-190036 · Cited by 90
Pan, I., Mason, L. R., & Matar, O. K. (2021) · Chemical Engineering Science · doi:10.1016/j.ces.2021.117271 · Cited by 98
Jacobs, A. S., Beltiukov, R., Willinger, W., Ferreira, R. A., Gupta, A. K., & Granville, L. Z. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560609 · Cited by 102
Podda, M., Bacciu, D., Micheli, A., Bellù, R., Placidi, G., & Gagliardi, L. (2018) · Scientific Reports · doi:10.1038/s41598-018-31920-6 · Cited by 76
Going deep into schizophrenia with artificial intelligence
Cortes-Briones, J., Tapia, N. I., D’Souza, D. C., & Estévez, P. A. (2021) · Schizophrenia Research · doi:10.1016/j.schres.2021.05.018 · Cited by 102
Potrawa, T., & Tetereva, A. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.027 · Cited by 96
Interpretable deep learning approach for tool wear monitoring in high-speed milling
Guo, H., Zhang, Y., & Zhu, K. (2022) · Computers in Industry · doi:10.1016/j.compind.2022.103638 · Cited by 93
Cabitza, F., Campagner, A., Malgieri, G., Natali, C., Schneeberger, D., Stoeger, K., & Holzinger, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118888 · Cited by 89
Analyzing Employee Attrition Using Explainable AI for Strategic HR Decision-Making
Díaz, G. M., Galán-Hernández, J. J., & Salvador, J. L. G. (2023) · Mathematics · doi:10.3390/math11224677 · Cited by 128
Counterfactual Explanations for Multivariate Time Series
Ates, E., Aksar, B., Leung, V. J., & Coskun, A. K. (2021) · 2021 International Conference on Applied Artificial Intelligence (ICAPAI) · doi:10.1109/icapai49758.2021.9462056 · Cited by 88
A Workflow for Visual Diagnostics of Binary Classifiers using Instance-Level Explanations
Krause, J., Dasgupta, A., Swartz, J. L., Aphinyanaphongs, Y., & Bertini, E. (2017) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585720 · Cited by 87
Explaining Therapy Predictions with Layer-Wise Relevance Propagation in Neural Networks
Yang, Y., Volker Tresp, C., Wunderle, M., & Fasching, P. A. (2018) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2018.00025 · Cited by 88
Explicit Bias Discovery in Visual Question Answering Models
Manjunatha, V., Saini, N., & Davis, L. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00979 · Cited by 89
Explainable image classification with evidence counterfactual
Vermeire, T., Brughmans, D., Goethals, S., Oliveira, R., & Martens, D. (2022) · Pattern Analysis and Applications · doi:10.1007/s10044-021-01055-y · Cited by 102
Opening the Black Box: A systematic review on explainable artificial intelligence in remote sensing
Höhl, A., Obadić, I., Fernández‐Torres, M., Najjar, H., Oliveira, D. A. B., Akata, Z., Dengel, A. R., & Zhu, X. X. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3467001 · Cited by 116
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models
Shi, Y., Siddharth, N., Paige, B., & Torr, P. H. S. (2019) · arXiv · doi:10.48550/arxiv.1911.03393 · Cited by 186
“This aspect is important from the perspective of downstream tasks, where better decomposed representations (Lipton, 2018; Mathieu et al., 2019) are more amenable for use on a wider variety of tasks.”
BackgroundVisual interpretability in 3D brain tumor segmentation network
Saleem, H. A., Shahid, A. R., & Raza, B. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104410 · Cited by 92
Kempt, H., & Nagel, S. K. (2022) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107440 · Cited by 87
Making Sense of Machine Learning: A Review of Interpretation Techniques and Their Applications
Tursunalieva, A., Alexander, D. L., Dunne, R. A., Li, J., Riera, L., & Zhao, Y. (2024) · Applied Sciences · doi:10.3390/app14020496 · Cited by 102
Generating Hierarchical Explanations on Text Classification via Feature Interaction Detection
Chen, H., Zheng, G., & Ji, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.494 · Cited by 101
Interpretable clinical prediction via attention-based neural network
Chen, P., Dong, W., Wang, J.-L., Lü, X., Kaymak, U., & Huang, Z. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1110-7 · Cited by 90
Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI
Ehsan, U., Saha, K., Choudhury, M. D., & Riedl, M. O. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579467 · Cited by 113
Diffusion model-driven smart design and manufacturing: Prospects and challenges
Leng, J., Su, X., Liu, Z., Zhou, L., Chen, C., Guo, X., Wang, Y., Wang, R., Zhang, C., Liu, Q., et al. (2025) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2025.07.011 · Cited by 94
(2017) · arXiv (Cornell University) · Cited by 86
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and ChallengesPreprint
Ashmore, R., Călinescu, R., & Paterson, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.04223 · Cited by 86
Why ‘open’ AI systems are actually closed, and why this matters
Widder, D. G., Whittaker, M., & West, S. M. (2024) · Nature · doi:10.1038/s41586-024-08141-1 · Cited by 86
Kumar, V., Roche, C. P., Overman, S. S., Simovitch, R. W., Flurin, P.-H., Wright, T. W., Zuckerman, J. D., Routman, H. D., & Teredesai, A. M. (2020) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2020.07.042 · Cited by 87
The European Legal Framework for Medical AI
Schneeberger, D., Stöger, K., & Holzinger, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-57321-8_12 · Cited by 85
ResLogit: A residual neural network logit model for data-driven choice modelling
Wong, M., & Farooq, B. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103050 · Cited by 85
Keane, M. T., & Kenny, E. M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-29249-2_11 · Cited by 84
Machine learning: novel bioinformatics approaches for combating antimicrobial resistance
Maćešić, N., Polubriaginof, F. C. G., & Tatonetti, N. P. (2017) · Current Opinion in Infectious Diseases · doi:10.1097/qco.0000000000000406 · Cited by 91
Morphological Convolutional Neural Network Architecture for Digit Recognition
Mellouli, D., Hamdani, T. M., Medina, J., Ayed, M. B., & Alimi, A. M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2890334 · Cited by 86
Towards Explainable Process Predictions for Industry 4.0 in the DFKI-Smart-Lego-Factory
Rehse, J.-R., Mehdiyev, N., & Fettke, P. (2019) · Künstliche Intell. · doi:10.1007/s13218-019-00586-1 · Cited by 83
SPINE: SParse Interpretable Neural Embeddings
Subramanian, A., Pruthi, D., Jhamtani, H., Berg-Kirkpatrick, T., & Hovy, E. H. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.11935 · Cited by 83
Kenny, E. M., & Keane, M. T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/376 · Cited by 87
Xie, J., Huang, J., Zeng, C., Jiang, S., & Podlich, N. (2020) · Geosciences · doi:10.3390/geosciences10110425 · Cited by 98
Grouped feature importance and combined features effect plot
Au, Q., Herbinger, J., Stachl, C., Bischl, B., & Casalicchio, G. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00840-5 · Cited by 98
Explainable deep learning in healthcare: A methodological survey from an attribution view
Jin, D., Sergeeva, E., Weng, W., Chauhan, G., & Szolovits, P. (2022) · WIREs Mechanisms of Disease · doi:10.1002/wsbm.1548 · Cited by 98
Varieties of AI Explanations Under the Law. From the GDPR to the AIA, and Beyond
Hacker, P., & Passoth, J.-H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_17 · Cited by 96
Kim, D., Song, Y., Kim, S., Lee, S., Wu, Y., Shin, J., & Lee, D. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122343 · Cited by 99
Fairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 100
Erasmus, A., Brunet, T. D. P., & Fisher, E. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00435-2 · Cited by 92
Examining the effect of explanation on satisfaction and trust in AI diagnostic systems
Alam, L., & Mueller, S. T. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01542-6 · Cited by 89
Who needs explanation and when? Juggling explainable AI and user epistemic uncertainty
Jiang, J., Kahai, S. S., & Yang, M. H. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102839 · Cited by 92
Goodwin, N. L., Nilsson, S. R. O., Choong, J. J., & Golden, S. A. (2022) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2022.102544 · Cited by 85
Prabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecasting
Arsenault, P.-D., Wang, S., & Patenaude, J.-M. (2025) · ACM Computing Surveys · doi:10.1145/3729531 · Cited by 120
Evaluating Reinforcement Learning Algorithms in Observational Health SettingsPreprint
Gottesman, O., Johansson, F., Meier, J., Dent, J., Lee, D., Srinivasan, S., Zhang, L., Ding, Y., Wihl, D., Peng, X., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12298 · Cited by 82
On cognitive preferences and the plausibility of rule-based models
Fürnkranz, J., Kliegr, T., & Paulheim, H. (2019) · Machine Learning · doi:10.1007/s10994-019-05856-5 · Cited by 96
NLProlog: Reasoning with Weak Unification for Question Answering in Natural Language
Weber, L., Minervini, P., Münchmeyer, J., Leser, U., & Rocktäschel, T. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1618 · Cited by 97
Learning With Interpretable Structure From Gated RNN
Hou, B., & Zhou, Z. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2967051 · Cited by 108
Riveiro, M., & Thill, S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103507 · Cited by 93
Ciravegna, G., Barbiero, P., Giannini, F., Gori, M., Lió, P., Maggini, M., & Melacci, S. (2022) · Artificial Intelligence · doi:10.1016/j.artint.2022.103822 · Cited by 109
Explainable AI, But Explainable to Whom? An Exploratory Case Study of xAI in Healthcare
Gerlings, J., Jensen, M. S., & Shollo, A. (2021) · Intelligent systems reference library · doi:10.1007/978-3-030-83620-7_7 · Cited by 95
Machine learning for optical fiber communication systems: An introduction and overview
Nevin, J. W., Nallaperuma, S., Shevchenko, N. A., Li, X., Faruk, M. S., & Savory, S. J. (2021) · APL Photonics · doi:10.1063/5.0070838 · Cited by 89
Arafa, D. A., Moustafa, H. E.-D., Eldin, A. A., & Ali, H. A. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-11925-0 · Cited by 92
Explainable AI: A review of applications to neuroimaging data
Farahani, F. V., Fiok, K., Lahijanian, B., Karwowski, W., & Douglas, P. K. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.906290 · Cited by 87
Deploying AI on Edge: Advancement and Challenges in Edge Intelligence
Wang, T., Guo, J., Zhang, B., Yang, G., & Li, D. (2025) · Mathematics · doi:10.3390/math13111878 · Cited by 98
L-Shapley and C-Shapley: Efficient Model Interpretation for Structured DataPreprint
Chen, J., Song, L., Wainwright, M. J., & Jordan, M. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.02610 · Cited by 141
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIPreprint
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.07487 · Cited by 81
dalex: Responsible Machine Learning with Interactive Explainability and Fairness in PythonPreprint
Baniecki, H., Kretowicz, W., Piątyszek, P., Wisniewski, J., & Biecek, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.14406 · Cited by 105
Is Automated Topic Model Evaluation Broken?: The Incoherence of CoherencePreprint
Hoyle, A., Goel, P., Peskov, D., Hian-Cheong, A., Boyd-Graber, J. L., & Resnik, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02173 · Cited by 93
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Ojewale, V., Steed, R., Vecchione, B., Birhane, A., & Raji, I. D. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713301 · Cited by 81
The Pragmatic Turn in Explainable Artificial Intelligence (XAI)
Páez, A. (2019) · PhilPapers (PhilPapers Foundation) · Cited by 80
"Ignorance and Prejudice" in Software Fairness
Zhang, J. M., & Harman, M. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse43902.2021.00129 · Cited by 88
Black-box assisted medical decisions: AI power vs. ethical physician care
Chan, B. (2023) · Medicine Health Care and Philosophy · doi:10.1007/s11019-023-10153-z · Cited by 90
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
