The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.
Open accessAbstract
Supervised machine-learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world?
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Newer methodologies have the danger of becoming more complex and less interpretable, even when sophisticated interpretation technique are used11.”
From Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. (2020) · cites this paper as [11]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While this expansion of the field has yielded a rich body of methodological work, recently, the community has begun to highlight the shortfalls such as the lack of consistent language and definitions, the lack of clearly defined explainability goals, and desiderata; and the lack of consensus on metrics and methods of evaluating the quality of explanations (Doshi-Velez and Kim, 2017; Lipton, 2018;”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For her, as for other people who are not AI specialists, it may be better to employ natural language, narrative, explanation by example, visualisations, and so forth (Barredo Arrieta et al., 2020;Borrego-Díaz & Galán-Páez, 2022;Lipton, 2018).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“According to Lipton [121], a model is transparent if its intrinsic structure satisfies at least one of the following three requirements:”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [121]
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately, scarce contributions have attempted to define such goals from a conceptual perspective [5, 13, 24, 30].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“However, it misses to consider other purposes motivating the need for interpretable AI models, such as causality, transferability, informativeness, fairness and confidence [5, 24, 25, 26].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [5]
The cited source says what the claim attributes to it.
In the citing paper
“Therefore, post-hoc explanation techniques are employed to explain existing models (Došilović et al., 2018; Lipton, 2018).”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“As explainability is not a monolithic concept and can play different roles in different applications (Lipton, 2018; Molnar, 2019), this process requires extensive domain/application-specific efforts.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“Too great an emphasis on making explanations psychologically fitting risks making it easier for bad actors to deceive and manipulate end-users (Baron, 2023;Lipton, 2018, pp. 21-22).”
From Hidden Risks: Artificial Intelligence and Hermeneutic Harm (2025) · cites this paper as Lipton, 2018
The cited source says what the claim attributes to it.
In the citing paper
“While providing individuals with grounds to contest individual decisions is often cited as a central motivation of the field of explainable artificial intelligence (XAI) (Ribeiro, Singh, and Guestrin 2016;Lipton 2018;Adadi and Berrada 2018;Molnar 2020), only very few technical works address contestability in greater detail (Mansi, Karusala, and Riedl 2025).”
From Explainable AI Isn't Enough! Rethinking Algorithmic Contestability (2026) · cites this paper as Lipton 2018
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability and explainability methods promoted by popular tools vary widely in their goals [120] and, like many 'snake oil' AI products [18, 59, 91], may encourage false confidence in their users [118].”
From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [120]
The cited source says what the claim attributes to it.
In the citing paper
“In interpretable AI research, the motivations and methods employed are often described as”
From Open Problems in Mechanistic Interpretability (2025) · cites this paper as Lipton, 2018
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“With the availability of more datasets, there is an increased benefit that allows more complex functions to be approximated for future developments in XAI [21,167].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [167]
Experimental — accuracy not yet measuredIn the citing paper
“Clinical tasks are often complex and it is impossible to incorporate and evaluate all desirable properties (e.g. legality, ethicality, and robustness) in a model using standard predictive performance evaluation metrics (e.g. area under the receiver-operating curve) [12].”
In the citing paper
“Researchers do not specify what terms mean, use the same term for different meanings, or refer to the same notion by different terms.”
In the citing paper
“Lipton [12] points out that these terms are often ill-defined in the existing literature.”
In the citing paper
“These explanations have the potential to present plausible but misleading explanations [12, 75].”
In the citing paper
“However, it is important to note that ML models are not designed to identify causal relationships but rather association relationships 116 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“Hence, trust in ML models is strongly related to their interpretability, which has thus become a focus of active research in the ML community 116,132 .”
From Machine learning in concrete science: applications, challenges, and best practices (2022) · cites this paper as [116]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [88]
In the citing paper
“Lipton [147], however, notes that even white-box models might not be interpretable anymore when their size exceed the limited capacity of human cognition”
From From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI (2023) · cites this paper as [147]
In the citing paper
“We also considered the ethical implications of AI in preserving privacy and the necessity for transparency, oversight, and continuous evaluation of AI systems [52][53][54].”
From Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023) · cites this paper as [52]
In the citing paper
“XAI can be used to help us evaluate if predictions are biased and defend algorithmic decisions as being fair and ethical [18,19,46,66].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Although, giving explanations can increase understanding of and trust in a system [19,46,64], simple explanations can hide undesirable attributes of the system and may mislead users into coming to dangerous or unfounded conclusions that could ultimately be unethical [21].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Additionally, XAI can help to shed some light onto causality [18,46,67] although, there is a recognized need to go beyond causality/correlation to true “causability” [3].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“However, linear models, for example, are not strictly more interpretable than, for example, neural networks, especially when high-dimensional or heavily engineered features are used.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“On the other hand, there are some studies supporting that XAI is not always necessary [46,134,135].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton [46] argues that the short-term goal of building trust with doctors by developing transparent models might clash with the longer-term goal of improving health care.”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [46]
In the citing paper
“Lipton (2018) [31] and Gunning et al. (2019) [32] highlight that for AI to be effectively integrated into clinical practice, it must provide clear and interpretable explanations of its outputs.”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as Lipton (2018) [31]
In the citing paper
“However, at this level of abstraction, explainability may be difficult to reach even to computer scientists and engineers (Lipton 2018).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“The proposed approach to algorithmic transparency deviates from the existing body of literature on explainable artificial intelligence (xAI), where the concept of transparency focuses on the explanation of the inner workings of algorithms or the interpretability of their individual outcomes (Lipton 2018; Ribeiro et al. 2016).”
From Transparency as design publicity: explaining and justifying inscrutable algorithms (2021) · cites this paper as Lipton 2018
In the citing paper
“This suggests a disconnect between organizational realities and current research, which undermines advancements [197,287].”
From Fairness in machine learning: A survey (2024) · cites this paper as [197]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2008) · Journal of Machine Learning Research · Cited by 33,051
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Fair prediction with disparate impact: a study of bias in recidivism prediction instruments
Chouldechova, A. (2017) · Big Data · doi:10.1089/big.2016.0047 · Cited by 2,159
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 2×
“Few would suggest that a human could contemplate a thousand parameters at once, but most could simulate a linear model with 20 parameters.”
Background(2009) · Cited by 1,900
Flagged first, then by citations
Research works printed but not linked: 9
- Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). Athey S. Imbens G. W. 2015 Machine-learning methods https://arxiv.org/abs/1504.01132v1 (see also ref. 7). · arXiv
- Caruana R., 1999, Proceedings of the American Medical Informatics Association (AMIA) Symposium: 212-215
- Chang J., 2009, Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS), 288-296
- Doshi-Velez F., 2015, Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference, 2575-2581
- Kim B., 2014, Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), 2, 1952
- Lipton Z. C., 2016, Proceedings of Machine Learning for Healthcare.
- Mikolov T., 2013, Proceedings of the 26th International Conference on Neural Information Processing Systems (NIPS), 2
- Ridgeway G., 1998, Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining: 101-104
- 10.5555/3045390.3045601 · DOI
Cited by
Sorted by citations
Items 701–800 of 1,051
Wang, P., Wang, P., Tansey, K. J., Liu, J., Delaney, B., & Quan, W. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109758 · Cited by 71
LIRME: Locally Interpretable Ranking Model Explanation
Verma, M., & Ganguly, D. (2019) · Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3331184.3331377 · Cited by 64
Topic Model or Topic Twaddle? Re-evaluating Semantic Interpretability Measures
Doogan, C., & Buntine, W. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.300 · Cited by 64
Akula, A., Wang, K., Liu, C., Saba-Sadiya, S., Lu, H., Todorović, S., Chai, J. Y., & Zhu, S. C. (2021) · iScience · doi:10.1016/j.isci.2021.103581 · Cited by 72
Explainable AI reveals new hydroclimatic insights for ecosystem-centric groundwater management
Chakraborty, D., Başağaoğlu, H., Gutierrez, L., & Mirchi, A. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac2fde · Cited by 65
XEM: An explainable-by-design ensemble method for multivariate time series classification
Fauvel, K., Fromont, É., Masson, V., Faverdin, P., & Termier, A. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00823-6 · Cited by 77
Integrating scientific knowledge into machine learning using interactive decision trees
Sarailidis, G., Wagener, T., & Pianosi, F. (2022) · Computers & Geosciences · doi:10.1016/j.cageo.2022.105248 · Cited by 68
A cognitive approach to human–AI complementarity in dynamic decision-making
González, C., & Heidari, H. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00499-x · Cited by 73
AI support for ethical decision-making around resuscitation: proceed with care
Biller-Andorno, N., Ferrario, A., Joebges, S., Krones, T., Massini, F., Barth, P., Arampatzis, G., & Krauthammer, M. (2022) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106786 · Cited by 67
An Interpretable Deep Learning Model for Automatic Sound Classification
Zinemanas, P., Rocamora, M., Miron, M., Font, F., & Serra, X. (2021) · Electronics · doi:10.3390/electronics10070850 · Cited by 74
Ploug, T., Sundby, A., Moeslund, T. B., & Holm, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26611 · Cited by 70
Wang, S.-H., & Yao, Y. (2023) · Resources Conservation and Recycling · doi:10.1016/j.resconrec.2022.106847 · Cited by 69
Putting Psychology to the Test: Rethinking Model Evaluation Through Benchmarking and Prediction
Rocca, R., & Yarkoni, T. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211026864 · Cited by 61
Zytek, A., Liu, D., Vaithianathan, R., & Veeramachaneni, K. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114864 · Cited by 62
Improving reference prioritisation with PICO recognition.
Brockmeier, A. J., Ju, M., Przybyła, P., & Ananiadou, S. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0992-8 · Cited by 62
How Interpretable and Trustworthy are GAMs?
Chang, C.-H., Tan, S., Lengerich, B., Goldenberg, A., & Caruana, R. (2021) · Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining · doi:10.1145/3447548.3467453 · Cited by 66
Kalatian, A., & Farooq, B. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102962 · Cited by 62
The Challenges of Leveraging Threat Intelligence to Stop Data Breaches
Ibrahim, A. S., Thiruvady, D., Schneider, J.-G., & Abdelrazek, M. (2020) · Frontiers in Computer Science · doi:10.3389/fcomp.2020.00036 · Cited by 67
Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension
Sood, E., Tannert, S., Frassinelli, D., Bulling, A., & Vu, N. T. (2020) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.2 · Cited by 66
Martins, T., de Almeida, A., Cardoso, E., & Nunes, L. (2023) · IEEE Access · doi:10.1109/access.2023.3347028 · Cited by 75
Qian, J., Qian, L., Pu, N., Bi, Y., Wilhelms, A., & Norra, S. (2024) · Environmental Science & Technology · doi:10.1021/acs.est.3c03906 · Cited by 65
Huang, G., Li, Y., Jameel, S., Long, Y., & Papanastasiou, G. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.05.004 · Cited by 81
Shaban, O. S., & Omoush, A. (2025) · Sustainability · doi:10.3390/su17093818 · Cited by 62
Khan, N., Ahmad, K., Tamimi, A. A., Alani, M. M., Bermak, A., & Khalil, I. M. (2025) · Information · doi:10.3390/info16121036 · Cited by 121
Interpretability of Machine Learning Solutions in Public Healthcare: The CRISP-ML Approach
Kolyshkina, I., & Simoff, S. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.660206 · Cited by 60
“Some state-of-the-art overviews, such as Doshi-Velez and Kim (2017) and Gilpin et al. (2019) related to interpretability, as well as more method-focused papers, like Lipton (2018) and Molnar et al. (2019), tend to use interpretability and explainability interchangeably.”
BackgroundEthical Considerations for Artificial Intelligence in Medical Imaging: Deployment and Governance
Herington, J., McCradden, M. D., Creel, K., Boellaard, R., Jones, E. C., Jha, A. K., Rahmim, A., Scott, P. J. H., Sunderland, J. J., Wahl, R. L., et al. (2023) · Journal of Nuclear Medicine · doi:10.2967/jnumed.123.266110 · Cited by 61
Te’eni, D., Yahav, I., Zagalsky, A., Schwartz, D. G., Silverman, G., Cohen, D., Mann, Y., & Lewinsky, D. (2023) · Management Science · doi:10.1287/mnsc.2022.03518 · Cited by 73
Cechinel, M. A. P., Neves, J., Fuck, J. V. R., de Andrade, R. C., Spogis, N., Riella, H. G., Padoin, N., & Soares, C. (2024) · Journal of Water Process Engineering · doi:10.1016/j.jwpe.2023.104758 · Cited by 63
Rony, J., Belharbi, S., Dolz, J., Ayed, I. B., McCaffrey, L. M., & Granger, É. (2023) · The Journal of Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2023-5g54 · Cited by 83
Boggust, A., Carter, B., & Satyanarayan, A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511122 · Cited by 75
Automated Evaluation of Writing – 50 Years and Counting
Klebanov, B. B., & Madnani, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.697 · Cited by 60
Survey of Explainable Machine Learning with Visual and Granular Methods Beyond Quasi-Explanations
Kovalerchuk, B., Ahmad, M. A., & Teredesai, A. M. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-64949-4_8 · Cited by 63
Theory-based residual neural networks: A synergy of discrete choice models and deep neural networks
Wang, S., Mo, B., & Zhao, J. (2021) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2021.03.002 · Cited by 64
The quest of parsimonious XAI: A human-agent architecture for explanation formulation
Mualla, Y., Tchappi, I., Kampik, T., Najjar, A., Calvaresi, D., Abbas‐Turki, A., Galland, S., & Nicolle, C. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103573 · Cited by 66
Do Explanations Increase the Effectiveness of AI-Crowd Generated Fake News Warnings?
Epstein, Z., Foppiani, N., Hilgard, S., Sharma, S., Glassman, E. L., & Rand, D. G. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19283 · Cited by 66
Explainability and white box in drug discovery
Kırboğa, K. K., Abbasi, S. W., & Küçüksille, E. U. (2023) · Chemical Biology & Drug Design · doi:10.1111/cbdd.14262 · Cited by 62
Nascita, A., Aceto, G., Ciuonzo, D., Montieri, A., Persico, V., & Pescapè, A. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3504955 · Cited by 79
Why Attentions May Not Be Interpretable?
Bai, B., Liang, J., Zhang, G., Li, H., Bai, K., & Wang, F. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467307 · Cited by 66
Some critical and ethical perspectives on the empirical turn of AI interpretability
John-Mathews, J.-M. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121209 · Cited by 67
The Thick Machine: Anthropological AI between explanation and explication
Munk, A. K., Olesen, A. G., & Jacomy, M. (2022) · Big Data & Society · doi:10.1177/20539517211069891 · Cited by 59
On Tackling Explanation Redundancy in Decision Trees
Izza, Y., Ignatiev, A., & Marques-Silva, J. P. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13575 · Cited by 74
Amini, M., Bagheri, A., & Delen, D. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108720 · Cited by 64
Niri, M. F., Aslansefat, K., Haghi, S., Hashemian, M., Daub, R., & Marco, J. (2023) · Energies · doi:10.3390/en16176360 · Cited by 62
Khan, A., Ali, A., Khan, J., Ullah, F., & Faheem, M. (2025) · IEEE Access · doi:10.1109/access.2025.3544625 · Cited by 59
Random Forest-Based Machine Failure Prediction: A Performance Comparison
Yang, Y., & Wang, H. (2025) · Applied Sciences · doi:10.3390/app15168841 · Cited by 84
Olawade, D. B., Fidelis, S. C., Marinze, S., Egbon, E., Osunmakinde, A., & Osborne, A. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106141 · Cited by 78
Explaining Black-box Android Malware Detection
Melis, M., Maiorca, D., Biggio, B., Giacinto, G., & Roli, F. (2018) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553598 · Cited by 59
On Tractable Representations of Binary Neural Networks
Shi, W., Shih, A., Darwiche, A. Y., & Choi, A. (2020) · Principles of Knowledge Representation and Reasoning · doi:10.24963/kr.2020/91 · Cited by 58
The Intriguing Relation Between Counterfactual Explanations and Adversarial Examples
Freiesleben, T. (2021) · Minds and Machines · doi:10.1007/s11023-021-09580-9 · Cited by 76
Philosophy of science at sea: Clarifying the interpretability of machine learning
Beisbart, C., & Räz, T. (2022) · Philosophy Compass · doi:10.1111/phc3.12830 · Cited by 66
Suri, J. S., Agarwal, S., Chabert, G. L., Carriero, A., Paschè, A., Danna, P. S. C., Saba, L., Mehmedović, A., Faa, G., Singh, I. M., et al. (2022) · Diagnostics · doi:10.3390/diagnostics12061482 · Cited by 58
Predictable Effects of Visual Salience in Experimental Decisions and Games
Li, X., & Camerer, C. F. (2022) · The Quarterly Journal of Economics · doi:10.1093/qje/qjac025 · Cited by 72
Wang, A., Kapoor, S., Barocas, S., & Narayanan, A. (2023) · ACM Journal on Responsible Computing · doi:10.1145/3636509 · Cited by 82
Yan, Z., Kamanmalek, S., & Alamdari, N. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.169253 · Cited by 56
Cyber-security: Identity deception detection on social media platforms
van der Walt, E., Eloff, J. H. P., & Grobler, J. (2018) · Computers & Security · doi:10.1016/j.cose.2018.05.015 · Cited by 63
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference
Gehrmann, S., Strobelt, H., Kruger, R., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934595 · Cited by 67
Theory In, Theory Out: The Uses of Social Theory in Machine Learning for Social Science
Radford, J., & Joseph, K. (2020) · Frontiers in Big Data · doi:10.3389/fdata.2020.00018 · Cited by 58
How model accuracy and explanation fidelity influence user trustPreprint
Papenmeier, A., Englebienne, G., & Seifert, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.12652 · Cited by 139
Exploring the effects of human-centered AI explanations on trust and reliance
Scharowski, N., Perrig, S. A. C., Svab, M., Opwis, K., & Brühlmann, F. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1151150 · Cited by 57
Automating epistemology: how AI reconfigures truth, authority, and verification
Shin, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02560-y · Cited by 57
Human Attention Maps for Text Classification: Do Humans and Neural Networks Focus on the Same Words?
Şen, C., Hartvigsen, T., Yin, B., Kong, X., & Rundensteiner, E. A. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.419 · Cited by 57
Zhu, S., Ohsaki, M., & Guo, X. (2020) · Engineering Structures · doi:10.1016/j.engstruct.2020.111374 · Cited by 57
Elul, Y., Rosenberg, A. A., Schuster, A., Bronstein, A. M., & Yaniv, Y. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2020620118 · Cited by 61
Gharagoz, M. M., Noureldin, M., & Kim, J. (2025) · Engineering Structures · doi:10.1016/j.engstruct.2025.119621 · Cited by 57
Taffese, W. Z., Hilloulin, B., Zaccardi, Y. V., Marani, A., Nehdi, M. L., Hanif, M. U., Kamath, M., Nunes, S. C. B., von Greve‐Dierfeld, S., & Kanellopoulos, A. (2025) · Materials and Structures · doi:10.1617/s11527-025-02664-3 · Cited by 64
On quantitative aspects of model interpretabilityPreprint
Nguyen, A.-P., & Martínez, M. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07584 · Cited by 140
Veale, M., Van Kleek, M., & Binns, R. (2018) · doi:10.31235/osf.io/8kvf4 · Cited by 60
Chen, X., Li, C., Bernards, M. T., Shi, Y., Shao, Q., & He, Y. (2021) · Molecular Systems Design & Engineering · doi:10.1039/d0me00161a · Cited by 56
Machine Learning Approach to Simulate Soil CO2 Fluxes under Cropping Systems
Adjuik, T. A., & Davis, S. C. (2022) · Agronomy · doi:10.3390/agronomy12010197 · Cited by 56
Corporate governance performance ratings with machine learning
Svanberg, J., Ardeshiri, T., Samsten, I., Öhman, P., Neidermeyer, P. E., Rana, T., Semenova, N., & Danielson, M. (2022) · Intelligent systems in accounting, finance and management/Intelligent systems in accounting, finance & management · doi:10.1002/isaf.1505 · Cited by 71
Automated opioid risk scores: a case for machine learning-induced epistemic injustice in healthcare
Pozzi, G. (2023) · Ethics and Information Technology · doi:10.1007/s10676-023-09676-z · Cited by 64
Explainable AI (XAI) and its Applications in Building Trust and Understanding in AI Decision Making
Tiwari, R. (2023) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem17592 · Cited by 56
Employees’ Appraisals and Trust of Artificial Intelligences’ Transparency and Opacity
Yu, L., Li, Y., & Fan, F. (2023) · Behavioral Sciences · doi:10.3390/bs13040344 · Cited by 69
Data Preprocessing and Feature Engineering for Data Mining: Techniques, Tools, and Best Practices
Koukaras, P., & Tjortjis, C. (2025) · AI · doi:10.3390/ai6100257 · Cited by 96
Fleming, R. W., & Storrs, K. R. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.07.004 · Cited by 54
FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging
Guo, H., Rajani, N. F., Hase, P., Bansal, M., & Xiong, C. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.808 · Cited by 115
Energy Efficiency Office. Building Technologies Office USDOE Office of Energy Efficiency and Renewable Energy (EERE), Roth, A., USDOE Office of Energy Efficiency and Renewable Energy (EERE), & Reyna, J. (2019) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/1580329 · Cited by 55
Teach Me to Explain: A Review of Datasets for Explainable NLP.Preprint
Wiegreffe, S., & Marasović, A. (2021) · arXiv (Cornell University) · Cited by 57
Ethically Responsible Machine Learning in Fintech
Rizinski, M., Peshov, H., Mishev, K., Chitkushev, L. T., Vodenska, I., & Trajanov, D. (2022) · IEEE Access · doi:10.1109/access.2022.3202889 · Cited by 75
A review of explainable AI in the satellite data, deep machine learning, and human poverty domain
Hall, O., Ohlsson, M., & Rognvaldsson, T. S. (2022) · Patterns · doi:10.1016/j.patter.2022.100600 · Cited by 70
Machine Learning Approaches to Predict Asthma Exacerbations: A Narrative Review
Molfino, N. A., Turcatel, G., & Riskin, D. J. (2023) · Advances in Therapy · doi:10.1007/s12325-023-02743-3 · Cited by 62
Wang, S., Mo, B., Zheng, Y., Hess, S., & Zhao, J. (2024) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2024.103061 · Cited by 88
The Role of Causality in Explainable Artificial Intelligence
Carloni, G., Berti, A., & Colantonio, S. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70015 · Cited by 99
Interpretable deep learning for two-prong jet classification with jet spectra
Chakraborty, A., Lim, S. H., & Nojiri, M. M. (2019) · Journal of High Energy Physics · doi:10.1007/jhep07(2019)135 · Cited by 55
CNM: An Interpretable Complex-valued Network for Matching
Li, Q., Wang, B., & Melucci, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1420 · Cited by 56
Towards Better Interpretability in Deep Q-Networks
Annasamy, R. M., & Sycara, K. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014561 · Cited by 7
Fourth paradigm GIScience? Prospects for automated discovery and explanation from data
GAHEGAN, M. N. (2019) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2019.1652304 · Cited by 55
Evaluating Explanations: How Much Do Explanations from the Teacher Aid Students?
Pruthi, D., Bansal, R., Dhingra, B., Soares, L. B., Collins, M., Lipton, Z. C., Neubig, G., & Cohen, W. W. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00465 · Cited by 60
Self-citationXAI Handbook: Towards a Unified Framework for Explainable AI
Palacio, S., Lucieri, A., Munir, M., Ahmed, S., Hees, J., & Dengel, A. R. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00420 · Cited by 60
Dencik, L., & Sanchez-Monedero, J. (2022) · Internet Policy Review · doi:10.14763/2022.1.1615 · Cited by 55
de Laat, P. B. (2022) · Ethics and Information Technology · doi:10.1007/s10676-022-09642-1 · Cited by 61
Chang, H., Xu, Y., Chen, S., & He, Z. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.156009 · Cited by 54
Interpretable Passive Multi-Modal Sensor Fusion for Human Identification and Activity Recognition
Yuan, L., Andrews, J., Mu, H., Vakil, A., Ewing, R. L., Blasch, E., & Li, J. (2022) · Sensors · doi:10.3390/s22155787 · Cited by 54
Harfouche, A. L., Nakhle, F., Harfouche, A., Sardella, O. G., Dart, E., & Jacobson, D. (2022) · Trends in Plant Science · doi:10.1016/j.tplants.2022.08.021 · Cited by 56
Deep Learning Opacity in Scientific Discovery
Duede, E. (2023) · Philosophy of Science · doi:10.1017/psa.2023.8 · Cited by 54
Gaczek, P., Leszczyński, G., & Mouakher, A. (2023) · Industrial Marketing Management · doi:10.1016/j.indmarman.2023.09.007 · Cited by 68
Selective Explanations: Leveraging Human Input to Align Explainable AI
Lai, V. W.-M., Zhang, Y., Chen, C., Liao, Q. V., & Tan, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610206 · Cited by 75
Explainable reinforcement learning (XRL): a systematic literature review and taxonomy
Bekkemoen, Y. (2023) · Machine Learning · doi:10.1007/s10994-023-06479-7 · Cited by 74
A Giant with Feet of Clay: On the Validity of the Data that Feed Machine Learning in Medicine
Cabitza, F., Ciucci, D., & Rasoini, R. (2018) · Lecture notes in information systems and organisation · doi:10.1007/978-3-319-90503-7_10 · Cited by 63
Explaining Explanation, Part 4: A Deep Dive on Deep Nets
Hoffman, R. R., Miller, T., Mueller, S. T., Klein, G. A., & Clancey, W. J. (2018) · IEEE Intelligent Systems · doi:10.1109/mis.2018.033001421 · Cited by 57
Metadata
- Authors
- Lipton, Z. C.
- Affiliations
- Carnegie Mellon University (US)
- Corresponding author
- Lipton, Zachary C.
- ORCID
- Lipton, Zachary C.
- Venue
- Queue
- Published
- 2018-06
- Volume
- 16
- Issue
- 3
- Pages
- 31-57
- ISSN
- 0001-0782 (ISSN-L)
- 1542-7730
- 1542-7749
- OpenAlex
- W2439568532
- Cited by
- 5,427
- References
- 25
- Citations by year
- 2026: 803 · 2025: 918 · 2024: 633 · 2023: 657 · 2022: 575 · 2021: 664 · 2020: 521 · 2019: 395 · 2018: 190
- FWCI
- 249.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Communications of the ACM (publishedVersion)
- Queue (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- model interpretability, explainable AI, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
