The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
The cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 201–300 of 1,051
Li, F., Ruijs, N., & Lü, Y. (2022) · AI · doi:10.3390/ai4010003 · Cited by 284
Causal interpretability for machine learning-problems, methods and evaluation
Moraffah, R., Karami, M., Guo, R., Raglin, A., & Liu, H. (2020) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3400051.3400058 · Cited by 238
Explainable Reinforcement Learning: A Survey and Comparative Review
Milani, S., Topin, N., Veloso, M., & Fang, F. (2023) · ACM Computing Surveys · doi:10.1145/3616864 · Cited by 347
Interpretable Machine Learning
Boehmke, B., & Greenwell, B. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9780367816377-16 · Cited by 276
Fernández, A., Herrera, F., Cordón, Ó., del Jesús, M. J., & Marcelloni, F. (2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2881645 · Cited by 246
Ferrario, A., Loi, M., & Viganò, E. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00378-3 · Cited by 286
Hydrological concept formation inside long short-term memory (LSTM) networks
Lees, T., Reece, S., Kratzert, F., Klotz, D., Gauch, M., de Bruijn, J., Sahu, R. K., Greve, P., Slater, L. J., & Dadson, S. (2022) · Hydrology and earth system sciences · doi:10.5194/hess-26-3079-2022 · Cited by 267
Hatherley, J. J. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105935 · Cited by 232
Wang, F., Wang, Y., Zhang, K., Hu, M., Weng, Q., & Zhang, H. J. (2021) · Environmental Research · doi:10.1016/j.envres.2021.111660 · Cited by 237
Lipton, Z. C., & Steinhardt, J. (2019) · Queue · doi:10.1145/3317287.3328534 · Cited by 231
Self-citationExplainability of Deep Vision-Based Autonomous Driving Systems: Review and Challenges
Zablocki, É., Ben-Younes, H., Pérez, P., & Cord, M. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01657-x · Cited by 227
Explainability in human–agent systems
Rosenfeld, A., & Richardson, A. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09408-y · Cited by 249
Hohman, F., Head, A., Caruana, R., DeLine, R. A., & Drucker, S. M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300809 · Cited by 252
Ghaffarian, S., Taghikhah, F. R., & Maier, H. R. (2023) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2023.104123 · Cited by 269
Defining the undefinable: the black box problem in healthcare artificial intelligence
Wadden, J. J. (2022) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107529 · Cited by 224
Passi, S., & Jackson, S. J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274405 · Cited by 225
Learning Molecular Representations for Medicinal Chemistry
Chuang, K. V., Gunsalus, L. M., & Keiser, M. J. (2020) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.0c00385 · Cited by 232
Explainability as a non-functional requirement: challenges and recommendations
Chazette, L., & Schneider, K. A. (2020) · Requirements Engineering · doi:10.1007/s00766-020-00333-1 · Cited by 248
Against Interpretability: a Critical Examination of the Interpretability Problem in Machine Learning
Krishnan, M. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00372-9 · Cited by 221
Hohman, F., Park, H., Robinson, C., & Chau, D. H. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934659 · Cited by 232
Human factors in model interpretability: Industry practices, challenges, and needs
Hong, S. R., Hullman, J., & Bertini, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392878 · Cited by 219
Investigating Explainability of Generative AI for Code through Scenario-based Design
Sun, J., Liao, Q. V., Muller, M., Agarwal, M., Houde, S., Talamadupula, K., & Weisz, J. D. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511119 · Cited by 219
“A full review of XAI techniques is beyond the scope of this paper and can be found in many recent survey papers [1, 29, 55, 56].”
BackgroundNaser, M. Z. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103821 · Cited by 228
Antibody structure prediction using interpretable deep learning
Ruffolo, J. A., Sulam, J., & Gray, J. J. (2022) · Patterns · doi:10.1016/j.patter.2021.100406 · Cited by 216
MODE: automated neural network model debugging via state differential analysis and input selection
Ma, S., Liu, Y., Lee, W., Zhang, X., & Grama, A. Y. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236082 · Cited by 217
Holzinger, A., Dehmer, M., Emmert‐Streib, F., Cucchiara, R., Augenstein, I., Ser, J. D., Samek, W., Jurišica, I., & Díaz-Rodríguez, N. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.10.007 · Cited by 223
Beyond Sparsity: Tree Regularization of Deep Models for Interpretability
Wu, M., Hughes, M., Parbhoo, S., Zazzi, M., Roth, V., & Doshi-Velez, F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11501 · Cited by 213
Mienye, I. D., Obaido, G., Jere, N., Mienye, E., Aruleba, K., Emmanuel, I. D., & Ogbuokiri, B. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101587 · Cited by 212
Adversarial Examples: Attacks and Defenses for Deep LearningPreprint
Yuan, X., He, P. L., Zhu, Q., & Li, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07107 · Cited by 212
Kenny, E. M., Ford, C., Quinn, M., & Keane, M. T. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103459 · Cited by 211
Post-hoc Interpretability for Neural NLP: A Survey
Madsen, A., Reddy, S., & Chandar, S. (2022) · ACM Computing Surveys · doi:10.1145/3546577 · Cited by 283
Epigenetic ageing clocks: statistical methods and emerging computational challenges
Teschendorff, A. E., & Horvath, S. (2025) · Nature Reviews Genetics · doi:10.1038/s41576-024-00807-w · Cited by 226
Automated rationale generation: a technique for explainable AI and its effects on human perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. O. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302316 · Cited by 210
Disentangled Graph Convolutional Networks
Ma, J., Cui, P., Kuang, K., Wang, X., & Zhu, W. (2019) · International Conference on Machine Learning · Cited by 216
A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
Bharati, S., Mondal, M. R. H., & Podder, P. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266418 · Cited by 251
Automated and interpretable patient ECG profiles for disease detection, tracking, and discovery
Tison, G. H., Zhang, J., Delling, F. N., & Deo, R. C. (2019) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005289 · Cited by 208
Nasarian, E., Alizadehsani, R., Acharya, U. R., & Tsui, K.-L. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102412 · Cited by 207
Gehrmann, S., Dernoncourt, F., Li, Y., Carlson, E. T., Wu, J. T.-Y., Welt, J. A., Foote, J., Moseley, E. T., Grant, D. W., Tyler, P. D., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192360 · Cited by 256
A Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204
Interpretable machine learning
Chen, V., Li, J., Kim, J. S., Plumb, G., & Talwalkar, A. (2022) · Communications of the ACM · doi:10.1145/3546036 · Cited by 218
Human and AI Ensembles: When Can They Work?
Choudhary, V., Marchetti, A., Shrestha, Y. R., & Puranam, P. (2021) · Journal of Management · doi:10.1177/01492063231194968 · Cited by 243
The Challenges of Machine Learning: A Critical Review
Barbierato, E., & Gatti, A. (2024) · Electronics · doi:10.3390/electronics13020416 · Cited by 217
Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning
Mascharka, D., Tran, P., Soklaski, R., & Majumdar, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00519 · Cited by 203
Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly Detection
Brown, A., Tuor, A. R., Hutchinson, B., & Nichols, N. (2018) · Proceedings of the First Workshop on Machine Learning for Computing Systems · doi:10.1145/3217871.3217872 · Cited by 225
iForest: Interpreting Random Forests via Visual Analytics
Zhao, X., Wu, Y., Lee, D. L., & Cui, W. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864475 · Cited by 204
Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation MethodsPreprint
Slack, D., Hilgard, S., Jia, E., Singh, S., & Lakkaraju, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02508 · Cited by 203
Challenges and frontiers in abusive content detection
Vidgen, B., Harris, A., Nguyen, D., Tromble, R., Hale, S. A., & Margetts, H. Z. (2019) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w19-3509 · Cited by 217
Vorm, E. S., & Combs, D. J. Y. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2070107 · Cited by 232
Leichtmann, B., Humer, C., Hinterreiter, A., Streit, M., & Mara, M. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107539 · Cited by 200
An attention based deep learning model of clinical events in the intensive care unit
Kaji, D. A., Zech, J. R., Kim, J., Cho, S. K.-W., Dangayach, N. S., Costa, A. B., & Oermann, E. K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211057 · Cited by 205
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · doi:10.1561/9781680836592 · Cited by 215
Esposito, E. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/14189.001.0001 · Cited by 222
Toward Edge-Based Deep Learning in Industrial Internet of Things
Liang, F., Yu, W., Liu, X., GRIFFITH, D. W. T., & Golmie, N. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2963635 · Cited by 209
Explainable AI for Time Series Classification: A Review, Taxonomy and Research Directions
Theissler, A., Spinnato, F., Schlegel, U., & Guidotti, R. (2022) · IEEE Access · doi:10.1109/access.2022.3207765 · Cited by 245
Explainable AI for Bioinformatics: Methods, Tools and Applications
Karim, M. R., Islam, T., Shajalal, M., Beyan, O., Lange, C., Cochez, M., Rebholz‐Schuhmann, D., & Decker, S. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad236 · Cited by 220
Transparency: Motivations and Challenges
Weller, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_2 · Cited by 198
Application of Artificial Intelligence for the Diagnosis and Treatment of Liver Diseases
Ahn, J. C., Connell, A., Simonetto, D. A., Hughes, C., & Shah, V. H. (2020) · Hepatology · doi:10.1002/hep.31603 · Cited by 201
A review of some techniques for inclusion of domain-knowledge into deep neural networks
Dash, T., Chitlangia, S., Ahuja, A., & Srinivasan, A. (2022) · Scientific Reports · doi:10.1038/s41598-021-04590-0 · Cited by 196
“Understanding models constructed by deep neural networks is an area of intense research activity, and good summaries exist elsewhere [3; 4 ] .”
Precision medicine in stroke: towards personalized outcome predictions using artificial intelligence
Bonkhoff, A. K., & Grefkes, C. (2021) · Brain · doi:10.1093/brain/awab439 · Cited by 216
The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanations
Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., & Detyniecki, M. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/388 · Cited by 194
The role of shared mental models in human-AI teams: a theoretical review
Andrews, R. W., Lilly, J. M., Srivastava, D., & Feigh, K. M. (2022) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2022.2061080 · Cited by 231
A Survey of Explainable Artificial Intelligence for Smart Cities
Javed, A. R., Ahmed, W., Pandya, S., Maddikunta, P. K. R., Alazab, M., & Gadekallu, T. R. (2023) · Electronics · doi:10.3390/electronics12041020 · Cited by 217
Transparency in Complex Computational Systems
Creel, K. (2020) · Philosophy of Science · doi:10.1086/709729 · Cited by 223
Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making
Rastogi, C., Zhang, Y., Wei, D., Varshney, K. R., Dhurandhar, A., & Tomsett, R. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512930 · Cited by 216
Fan, C., Yan, D., Xiao, F., Li, A., An, J., & Kang, X. (2020) · Building Simulation · doi:10.1007/s12273-020-0723-1 · Cited by 201
Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanoma
Chanda, T., Hauser, K., Hobelsberger, S., Bucher, T.-C., Garcia, C. N., Wies, C., Kittler, H., Tschandl, P., Navarrete‐Dechent, C., Podlipnik, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-023-43095-4 · Cited by 211
Elshawi, R., Sherif, Y., Al-Mallah, M. H., & Sakr, S. (2020) · Computational Intelligence · doi:10.1111/coin.12410 · Cited by 209
Advancing Computational Toxicology by Interpretable Machine Learning
Jia, X., Wang, T., & Zhu, H. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c00653 · Cited by 199
Ryo, M., Angelov, B., Mammola, S., Kass, J. M., Benito, B. M., & Hartig, F. (2020) · Ecography · doi:10.1111/ecog.05360 · Cited by 200
A systematic review of personal thermal comfort models
Martins, L. A., Soebarto, V. I., & Williamson, T. (2021) · Building and Environment · doi:10.1016/j.buildenv.2021.108502 · Cited by 205
Explainable AI under Contract and Tort Law: Legal Incentives and Technical Challenges
Hacker, P., Krestel, R., Grundmann, S., & Naumann, F. (2020) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09260-6 · Cited by 204
Rapid Trust Calibration through Interpretable and Uncertainty-Aware AI
Tomsett, R., Preece, A., Braines, D., Cerutti, F., Chakraborty, S., Srivastava, M., Pearson, G., & Kaplan, L. (2020) · Patterns · doi:10.1016/j.patter.2020.100049 · Cited by 186
Model-Agnostic Counterfactual Explanations for Consequential DecisionsPreprint
Karimi, A.-H., Barthe, G., Balle, B., & Valera, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11190 · Cited by 212
A causal framework for explaining the predictions of black-box sequence-to-sequence models
Alvarez-Melis, D., & Jaakkola, T. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1042 · Cited by 210
Clinical concept extraction: A methodology review
Fu, S., Chen, D. J., He, H., Liu, S., Moon, S., Peterson, K. J., Shen, F., Wang, L., Wang, Y., Wen, A., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103526 · Cited by 190
Roadmap on Machine learning in electronic structure
Kulik, H. J., Hammerschmidt, T., Schmidt, J., Botti, S., Marques, M. A. L., Boley, M., Scheffler, M., Todorović, M., Rinke, P., Oses, C., et al. (2022) · Electronic Structure · doi:10.1088/2516-1075/ac572f · Cited by 197
Kim, B., Park, J., & Suh, J. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113302 · Cited by 182
A literature review on applications of explainable artificial intelligence (XAI)
Kalasampath, K., Spoorthi, K. N., Sajeev, S., Kuppa, S. S., Ajay, K., & Maruthamuthu, A. (2025) · IEEE Access · doi:10.1109/access.2025.3546681 · Cited by 180
From explainable to interactive AI: A literature review on current trends in human-AI interaction
Raees, M., Meijerink, I., Lykourentzou, I., Khan, V.-J., & Papangelis, K. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103301 · Cited by 180
Ma, J., Fong, S. H., Luo, Y., Bakkenist, C. J., Shen, J. P., Mourragui, S., Wessels, L. F. A., Hafner, M., Sharan, R., Peng, J., et al. (2021) · Nature Cancer · doi:10.1038/s43018-020-00169-2 · Cited by 180
Modeling Missing Data in Clinical Time Series with RNNsPreprint
Lipton, Z. C., Kale, D. C., & Wetzel, R. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04130 · Cited by 216
Self-citationAsatiani, A., Malo, P., Nagbøl, P. R., Penttinen, E., Rinta-Kahila, T., & Salovaara, A. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00664 · Cited by 223
Zhao, S. H., Li, J., Chen, C., Yan, B., Tao, J., & Chen, G. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.128244 · Cited by 178
Challenges and opportunities for artificial intelligence in auditing: Evidence from the field
Kokina, J., Blanchette, S., Davenport, T. H., & Pachamanova, D. (2025) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100734 · Cited by 375
Comparing Automatic and Human Evaluation of Local Explanations for Text Classification
Nguyen, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1097 · Cited by 175
An explainable AI decision-support-system to automate loan underwriting
Sachan, S., Yang, J., Xu, D., Benavides, D. E., & Li, Y. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.113100 · Cited by 185
Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and Visions
Longo, L., Goebel, R. G., Lécué, F., Kieseberg, P., & Holzinger, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-57321-8_1 · Cited by 193
Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset
Meng, C., Trinh, L., Xu, N., Enouen, J., & Liu, Y. (2022) · Scientific Reports · doi:10.1038/s41598-022-11012-2 · Cited by 213
Ryo, M. (2022) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2022.11.003 · Cited by 203
Alhakeem, Z. M., Jebur, Y. M., Henedy, S. N., Imran, H., Bernardo, L. F. A., & Hussein, H. M. (2022) · Materials · doi:10.3390/ma15217432 · Cited by 175
Machine Learning for Perovskite Solar Cells and Component Materials: Key Technologies and Prospects
Liu, Y., Tan, X., Liang, J., Han, H., Xiang, P., & Yan, W. (2023) · Advanced Functional Materials · doi:10.1002/adfm.202214271 · Cited by 174
Predictive maintenance using tree-based classification techniques: A case of railway switches
Bukhsh, Z. A., Saeed, A., Stipanović, I., & Dorée, A. G. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.02.001 · Cited by 189
From Blackbox to Explainable AI in Healthcare: Existing Tools and Case Studies
Srinivasu, P. N., Sandhya, N., Jhaveri, R. H., & Raut, R. (2022) · Mobile Information Systems · doi:10.1155/2022/8167821 · Cited by 199
Allgaier, J., Mulansky, L., Draelos, R. L., & Pryss, R. C. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102616 · Cited by 201
Pre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2023) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 238
Singhal, A., Neveditsin, N., Tanveer, H., & Mago, V. (2024) · JMIR Medical Informatics · doi:10.2196/50048 · Cited by 172
Explainable AI Over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions
Jagatheesaperumal, S. K., Pham, Q., Ruby, R., Yang, Z., Xu, C., & Zhang, Z. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3215676 · Cited by 198
Explainability of a Machine Learning Granting Scoring Model in Peer-to-Peer Lending
Garzón, M. J. A., Arroyo, J., Caparrini, A., & Vargas, M. J. S. (2020) · IEEE Access · doi:10.1109/access.2020.2984412 · Cited by 192
TensorFuzz: Debugging Neural Networks with Coverage-Guided FuzzingPreprint
Odena, A., & Goodfellow, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10875 · Cited by 197
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
