The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index, and 1 are not checked yet.
Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead
Open accessAbstract
Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to explain black box models, rather than creating models that are interpretable in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward - it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“A central challenge in this domain is navigating the well-documented trade-off between model accuracy and inherent interpretability [6].”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [6]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source doesn’t support the claim as written.
In the citing paper
“However, this remarkable capability comes with a fundamental trade-off: as models become more powerful, they simultaneously become more opaque, creating what researchers term the interpretability–performance paradox [5].”
From Beyond Post hoc Explanations: A Comprehensive Framework for Accountable AI in Medical Imaging Through Transparency, Interpretability, and Explainability (2025) · cites this paper as [5]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Rudin takes this further, saying that post-hoc explanations “must be wrong”; that they are by definition not completely faithful to the original model and must be less accurate with respect to the primary task.”
From The false hope of current approaches to explainable artificial intelligence in health care (2021) · cites this paper as [35]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For instance, this work has demonstrated that simple interpretable models (with two and respectively three features) can perform as well as the widely used criminal justice COMPAS algorithm, which instead draws on 137 features.”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Rudin 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While Artificial Intelligence (AI) promises significant enhancements for Clinical Decision Support Systems (CDSSs), the opacity of many AI models remains a major barrier to clinical adoption, primarily due to interpretability and trust challenges.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [6]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, as with cognitive offloading, there is a potential risk that over-reliance on AI for decision-making could diminish human capacity for critical thinking (Rudin, 2019).”
From The impact of digital technology, social media, and artificial intelligence on cognitive functions: a review (2023) · cites this paper as Rudin, 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Many research groups have tackled early prediction of AKI using electronic health records (EHR) data [8–11], but no model so far explains the rationale behind specific predictions despite a clear need for explainable and actionable predictions [6, 12].”
From Machine learning model for early prediction of acute kidney injury (AKI) in pediatric critical care (2021) · cites this paper as [12]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This goes against the move towards transparency and open science, and makes it hard to uncover the origin of, or gaps in, chatbots' knowledge 10 .”
From ChatGPT: five priorities for research (2023) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As users of these systems have grown beyond ML experts and the research community, the need to better interpret and understand them has grown as well, particularly in the context of high-stakes decisions that affect individuals ' health or wellbeing (Lakkaraju et al., 2016; Lipton, 2018; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Rudin, 2019
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Against this background, research into explainability/interpretability 1 of ML models has experienced rapid expansion and innovation in recent years, with a focus on method development.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Rudin, 2019
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“XAI often is a technique used to support methods, and keywords are often not mentioned in the title or body of papers (Rudin (2019)).”
From Explainable artificial intelligence (XAI) in deep learning-based medical image analysis (2022) · cites this paper as Rudin (2019)
The cited source says what the claim attributes to it.
In the citing paper
“Black-box models, despite their high predictive performance, often lack the necessary transparency [76].”
From Deepfake Media Forensics: Status and Future Challenges (2025) · cites this paper as [76]
The cited source says what the claim attributes to it.
In the citing paper
“While “black‐box” algorithms raise complex opaqueness and interpretability challenges, simpler interpretable ML algorithms do not, but have generally also been regarded as less powerful (Guidotti et al. 2019; see however, Rudin 2019).”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Rudin 2019
The cited source says what the claim attributes to it.
In the citing paper
“Rudin [6], for example, argues that opaque models should be avoided in high-stakes settings such as medicine, where interpretability and trustworthiness are at least as important as predictive accuracy.”
From Explainable AI for Clinical Decision Support Systems: Literature Review, Key Gaps, and Research Synthesis (2025) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“However, it is important to note that this trade-off does not always occur, in which case a more interpretable model is generally preferred (i.e. explainable modelling) [76].”
The cited source says what the claim attributes to it.
In the citing paper
“a substantial computer science literature now advocates either post hoc explanation techniques or the outright substitution of interpretable models in high-stakes settings (Rudin, 2019).”
From Auditing the Black Box: Rethinking Audit Assurance and Professional Liability in the Age of Artificial Intelligence (2026) · cites this paper as Rudin, 2019
The cited source says what the claim attributes to it.
In the citing paper
“Interpretability is therefore not a stylistic preference in forensic work but a condition of testimonial usefulness, which is an applied vindication of Rudin's (2019) argument for interpretable models in high-stakes settings.”
From Auditing the Black Box: Rethinking Audit Assurance and Professional Liability in the Age of Artificial Intelligence (2026) · cites this paper as Rudin's (2019)
The cited source says what the claim attributes to it.
In the citing paper
“As perfectly stated in [347], it is not necessarily true that models that are more complex are inherently more accurate.”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [347]
The cited source says what the claim attributes to it.
In the citing paper
“What is more, even when applicable, the legal requirements are ambiguous as to what is required (i.e., “meaningful information about the logic involved”) and risk compromising the value that can be derived from this information: “Because the definition of what constitutes a viable explanation is unclear, even strong regulations such as “right to explanation” can be undermined with less‐than‐satisf”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Rudin 2019
The cited source says what the claim attributes to it.
In the citing paper
“Inherently therefore, explanation models are not fully faithful representations of the original model, but are rather “approximations” thereof, which necessarily simultaneously reduces their explanatory potential (Rudin 2019).”
From Accountable Artificial Intelligence: Holding Algorithms to Account (2021) · cites this paper as Rudin 2019
The cited source says what the claim attributes to it.
In the citing paper
“First, modern AI systems are often black-box models for which humans cannot see how or why the model made a prediction [54].”
From Improving Human-AI Collaboration With Descriptions of AI Behavior (2023) · cites this paper as [54]
The cited source says what the claim attributes to it.
In the citing paper
“However, post-hoc explanations are approximations to the underlying model rather than exact representations [65].”
From Toward generalizable and interpretable machine learning models in healthcare: Insights from ICU outcome predictions (2026) · cites this paper as [65]
The cited source says what the claim attributes to it.
In the citing paper
“The challenge remains to provide higher-level explainability that aligns with human cognitive processes [Rudin, 2019].”
From Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challenges (2025) · cites this paper as Rudin, 2019
The cited source says what the claim attributes to it.
In the citing paper
“Inherently interpretable ML models are designed such that an end user could understand its decisionmaking process (Lakkaraju et al., 2016; Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Rudin, 2019
The cited source says what the claim attributes to it.
In the citing paper
“Interpretable models often rely on carefully curated representations of data with meaningful input features (Rudin, 2019), often through discretization or binary encoding (Caruana et al., 2015; Lakkaraju et al., 2016; Ustun and Rudin, 2019).”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Rudin, 2019
The cited source says what the claim attributes to it.
In the citing paper
“as black-box ML models are often too complex to be explained entirely, post hoc methods typically derive an approximate explanation (Gilpin et al., 2018; Rudin, 2019), which makes ensuring the fidelity of the explanations to the model a key challenge in this work.”
From Explainable machine learning for public policy: Use cases, gaps, and research directions (2023) · cites this paper as Rudin, 2019
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While largerscale evaluations are desirable, prior work (Rudin, 2019; Wiegreffe et al., 2021) has shown that even small samples, when selected for conceptual diversity and difficulty, yield robust insights into model behavior.”
From GIER: Gap-Driven Self-Refinement for Large Language Models (2025) · cites this paper as Rudin, 2019
Experimental — accuracy not yet measuredIn the citing paper
“With regards to methodology, explainability can either be an inherent characteristic of an algorithm or can be approximated by other methods [2].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [2]
In the citing paper
“An important point to note here is that explainability has many facets and, unfortunately, the terminology of explainability is not well defined. Other terms such as interpretability and/or transparency are often used synonymously [2, 3].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [2]
In the citing paper
“Importantly, however, inherent explainability will, in general, be more accurate than methods that only approximate explainability [2].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [2]
In the citing paper
“While the work of Rudin et al. is important to raise attention to the shortcomings of approximating explainability methods, it is likely that some approximating methods, in contrast to the notion of [2], have value given the complex nature of explaining machine learning models.”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [2]
In the citing paper
“However, caution would be recommended since ML explainability can be inaccurate or non-meaningful due to the underlying mathematical assumptions13.”
From Mitigating bias in machine learning for medicine (2021) · cites this paper as [13]
In the citing paper
“The prototype networks are comparatively difficult to train than regular deep neural networks because of the scarcity of available techniques for their training [110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [110]
In the citing paper
“As the field is still in its infancy, there is no consensus on the definition of the terms interpretability and explainability in this context, and recently various definitions have been proposed for these terms [9,88,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [110]
In the citing paper
“This can instill a false sense of confidence in the model which can be detrimental for troubleshooting and model deployment in clinical practice [110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [110]
In the citing paper
“Post-hoc interpretability methods are only approximations and do not accurately depict the correct model behavior and therefore compromise trust in the explanations [5,110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [110]
In the citing paper
“It depends on the researcher's ability to discover the patterns in an interpretable way while at the same time allowing for flexibility to fit the data accurately [110].”
From Transparency of deep neural networks for medical image analysis: A review of interpretability methods (2022) · cites this paper as [110]
In the citing paper
“For tabular data, SHAP values can rank the importance of different clinical factors and show whether a prognosis was driven primarily by tumor size, patient age, or biomarker status [162,163,164,165].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [162]
In the citing paper
“To this end, explainability is an often-cited challenge for”
From Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions (2024) · cites this paper as [203]
In the citing paper
“Interpretable models use a small set of features with a low complexity of interaction between them.”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [33]
In the citing paper
“Rudin [33] argues that for high-stakes decisions, people should avoid using black-box models altogether, and instead should use interpretable models.”
From Explainable AI is Dead, Long Live Explainable AI!: Hypothesis-driven Decision Support using Evaluative AI (2023) · cites this paper as [33]
In the citing paper
“Counterfactual explanations are normally considered contrastive by nature and therefore present a source of valuable complementary information to a given automatic prediction [52].”
From A Survey of Contrastive and Counterfactual Explanation Generation Methods for Explainable Artificial Intelligence (2021) · cites this paper as [52]
In the citing paper
“In this data-rich environment, tax administrations enjoy conditions that are very favourable to the use of AI technologies: 31 (i) the volume of data is so great that its direct examination is not feasible through human labour; 32 and (ii) the large amounts of data mean that any”
From Towards eXplainable Artificial Intelligence (XAI) in Tax Law: The Need for a Minimum Legal Standard (2022) · cites this paper as [31]
In the citing paper
“Lastly, the opacity of most current AI models is one of the most popular topics of contemporary AI research (Rudin 2019).”
From Trustworthy artificial intelligence (2021) · cites this paper as Rudin 2019
In the citing paper
“The literature supports this finding, emphasizing the importance of explainable AI in healthcare to ensure transparency and trustworthiness [30].”
From Leading with AI in critical care nursing: challenges, opportunities, and the human factor (2024) · cites this paper as [30]
In the citing paper
“The absence of any link to a factual knowledge source that can help LLMs reason on their generation introduce what is known as the “black box” effect (Rudin, 2019).”
From A review of the explainability and safety of conversational agents for mental health to identify avenues for improvement (2023) · cites this paper as Rudin, 2019
In the citing paper
“Such neglect of detail is necessary to provide explanations that are understandable for human agents, and, so the worry goes, there is a real risk that the omitted details are in fact crucial to the true causal story of how the decision was in fact produced”
From AI, Opacity, and Personal Autonomy (2022) · cites this paper as Rudin, 2019
In the citing paper
“Even with a multiscale model, the translation of genotype to phenotype can be complex, and the use of standard “black-box” machine learning algorithms prevents a straightforward biological interpretation (Rudin, 2019).”
From Mapping the multiscale structure of biological systems (2021) · cites this paper as Rudin, 2019
In the citing paper
“AI technology is widely known to be difficult to explain and understand; AI has long been criticized for inexplicable “black box algorithms,” and calls to demystify these algorithms have created an entire category of explainable AI [37,38].”
From Reimagining Core Entrustable Professional Activities for Undergraduate Medical Education in the Era of Artificial Intelligence (2023) · cites this paper as [38]
In the citing paper
“The reviewed studies suggest an inherent trade-off between model complexity, input representation, and explainability in clinical audio-based AI systems [32].”
From Explainable and Interpretable AI for Voice and Speech Analysis in Clinical Care: Systematic Review (2026) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,563
Domain-Adversarial Training of Neural Networks
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318
(1996) · Cited by 4,738
Definitions, methods, and applications in interpretable machine learning
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,800
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 1×
“[34], who noticed that their neural network was picking up on the word “portable” within an x-ray image, representing the type of x-ray equipment rather than the medical content of the image.”
BackgroundThe Magical Mystery Four: How Is Working Memory Capacity Limited, and Why?
Cowan, N. (2010) · Current Directions in Psychological Science · doi:10.1177/0963721409359277 · Cited by 1,255
Research works printed but not linked: 4
- Kodratoff, Y. The comprehensibility manifesto. KDD Nugget Newsletter https://www.kdnuggets.com/news/94/n9.txt (1994).
- Quinlan, J. R. C4. 5: Programs for Machine Learning Vol. 1 (Morgan Kaufmann, 1993).
- Angelino, E., Larus-Stone, N., Alabi, D., Seltzer, M. & Rudin, C. Certifiably optimal rule lists for categorical data. J. Mach. Learn. Res. 19, 1–79 (2018).
- Hu, X. (S.), Rudin, C. & Seltzer, M. Optimal sparse decision trees. Preprint at https://arxiv.org/abs/1904.12847 (2019). · arXiv
Cited by
Sorted by citations
Items 201–300 of 1,082
Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?
Hase, P., & Bansal, M. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.491 · Cited by 254
Transparency, auditability, and explainability of machine learning models in credit scoring
Bücker, M., Szepannek, G., Gosiewska, A., & Biecek, P. (2021) · Journal of the Operational Research Society · doi:10.1080/01605682.2021.1922098 · Cited by 254
The hidden assumptions behind counterfactual explanations and principal reasons
Barocas, S., Selbst, A. D., & Raghavan, M. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372830 · Cited by 253
Beware explanations from AI in health care
Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2021) · Science · doi:10.1126/science.abg1834 · Cited by 252
A machine learning framework to improve effluent quality control in wastewater treatment plants
Wang, D., Thunéll, S., Lindberg, U., Jiang, L., Trygg, J., Tysklind, M., & Souihi, N. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.147138 · Cited by 252
Amann, J., Vetter, D., Blomberg, S. N., Christensen, H. C., Coffee, M., Gerke, S., Gilbert, T. K., Hagendorff, T., Holm, S., Livne, M., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000016 · Cited by 251
“Due to these limitations in current techniques for generating explanations, some experts suggest the use of inherently transparent models such as regression, decision trees, or rule lists [45,50].”
BackgroundMachine learning enables interpretable discovery of innovative polymers for gas separation membranes
Yang, J., Tao, L., He, J., McCutcheon, J. R., & Li, Y. (2022) · Science Advances · doi:10.1126/sciadv.abn9545 · Cited by 251
Explainable Artificial Intelligence (XAI) in Auditing: A Framework and Research Needs
Zhang, C., Cho, S., & Vasarhelyi, M. A. (2021) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2022.100572 · Cited by 251
An explainable AI (XAI) model for landslide susceptibility modeling
Pradhan, B., Dikshit, A., Lee, S., & Kim, H. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110324 · Cited by 248
Machine learning and clinical epigenetics: a review of challenges for diagnosis and classification
Rauschert, S., Raubenheimer, K., Melton, P. E., & Huang, R. (2020) · Clinical Epigenetics · doi:10.1186/s13148-020-00842-4 · Cited by 248
Explainable AI for Time Series Classification: A Review, Taxonomy and Research Directions
Theissler, A., Spinnato, F., Schlegel, U., & Guidotti, R. (2022) · IEEE Access · doi:10.1109/access.2022.3207765 · Cited by 245
REFORMS: Consensus-based Recommendations for Machine-learning-based Science
Kapoor, S., Cantrell, E. M., Peng, K., Pham, T. H., Bail, C. A., Gundersen, O. E., Hofman, J. M., Hullman, J. R., Lones, M. A., Malik, M. M., et al. (2024) · Science Advances · doi:10.1126/sciadv.adk3452 · Cited by 255
Towards A Rigorous Evaluation Of XAI Methods On Time Series
Schlegel, U., Arnout, H., El‐Assady, M., Oelke, D., & Keim, D. A. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00516 · Cited by 243
Deep learning for drug response prediction in cancer
Baptista, D., Ferreira, P. G., & Rocha, M. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbz171 · Cited by 243
Causal machine learning for healthcare and precision medicine
Sanchez, P., Voisey, J. P., Xia, T., Watson, H. I., O’Neil, A. Q., & Tsaftaris, S. A. (2022) · Royal Society Open Science · doi:10.1098/rsos.220638 · Cited by 243
"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanations
Lakkaraju, H., & Bastani, O. (2020) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3375627.3375833 · Cited by 241
The three ghosts of medical AI: Can the black-box present deliver?
Quinn, T. P., Jacobs, S., Senadeera, M., Le, V., & Coghlan, S. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102158 · Cited by 246
Marey, A., Arjmand, P., alerab, A. D. S., Eslami, M. J., Saad, A. M., Sanchez, N., & Umair, M. (2024) · The Egyptian Journal of Radiology and Nuclear Medicine · doi:10.1186/s43055-024-01356-2 · Cited by 243
A survey of contextual optimization methods for decision-making under uncertainty
Sadana, U., Chenreddy, A. R., Delage, E., Forel, A., Frejinger, E., & Vidal, T. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.03.020 · Cited by 238
Machine Learning for Financial Risk Management: A Survey
Mashrur, A., Luo, W., Zaidi, N. A., & Robles‐Kelly, A. (2020) · IEEE Access · doi:10.1109/access.2020.3036322 · Cited by 236
Adversarial attacks and defenses in explainable artificial intelligence: A survey
Baniecki, H., & Biecek, P. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102303 · Cited by 234
Neuro-symbolic artificial intelligence: a survey
Bhuyan, B. P., Ramdane-Chérif, A., Tomar, R., & Singh, T. P. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09960-z · Cited by 234
Machine learning model for early prediction of acute kidney injury (AKI) in pediatric critical care
Dong, J., Feng, T., Thapa-Chhetry, B., Cho, B. G., Shum, T., Inwald, D. P., Newth, C. J. L., & Vaidya, V. U. (2021) · Critical Care · doi:10.1186/s13054-021-03724-0 · Cited by 233
“Many research groups have tackled early prediction of AKI using electronic health records (EHR) data [8–11], but no model so far explains the rationale behind specific predictions despite a clear need for explainable and actionable predictions [6, 12].”
BackgroundLo Piano, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0501-9 · Cited by 229
“Rudin (2019) argued that the community of algorithm developers should go beyond explaining black-box models by developing interpretable models in the fi rst place.”
BackgroundMethodResultInfluentialPost-hoc vs ante-hoc explanations: xAI design guidelines for data scientists
Retzlaff, C. O., Angerschmid, A., Saranti, A., Schneeberger, D. M., Röttger, R., Müller, H., & Holzinger, A. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101243 · Cited by 229
Naser, M. Z. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103821 · Cited by 228
Kong, J., Lee, H., Kim, D., Han, S. K., Ha, D., Shin, K., & Kim, S. (2020) · Nature Communications · doi:10.1038/s41467-020-19313-8 · Cited by 225
Defining the undefinable: the black box problem in healthcare artificial intelligence
Wadden, J. J. (2022) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107529 · Cited by 224
Big data in IBD: big progress for clinical practice
Seyed Tabib, N. S., Madgwick, M., Sudhakar, P., Verstockt, B., Korcsmaros, T., & Vermeire, S. (2020) · Gut · doi:10.1136/gutjnl-2019-320065 · Cited by 223
Asatiani, A., Malo, P., Nagbøl, P. R., Penttinen, E., Rinta-Kahila, T., & Salovaara, A. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00664 · Cited by 223
Loughran, T., & McDonald, B. (2020) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109023000716 · Cited by 221
Deep learning, explained: Fundamentals, explainability, and bridgeability to process-based modelling
Razavi, S. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105159 · Cited by 221
Schmitt, M. (2023) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2023.100520 · Cited by 220
Ten years of generative adversarial nets (GANs): a survey of the state-of-the-art
Chakraborty, T., S, U. R. K., Naik, S. M., Panja, M., & Manvitha, B. (2024) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ad1f77 · Cited by 229
Chicco, D., Sichenze, A., & Jurman, G. (2025) · BioData Mining · doi:10.1186/s13040-025-00465-6 · Cited by 231
Cascella, M., Semeraro, F., Montomoli, J., Bellini, V., Piazza, O., & Bignami, E. (2024) · Journal of Medical Systems · doi:10.1007/s10916-024-02045-3 · Cited by 219
Meehan, A. J., Lewis, S. J., Fazel, S., Fusar-Poli, P., Steyerberg, E. W., Stahl, D., & Danese, A. (2022) · Molecular Psychiatry · doi:10.1038/s41380-022-01528-4 · Cited by 219
Interpretable machine learning
Chen, V., Li, J., Kim, J. S., Plumb, G., & Talwalkar, A. (2022) · Communications of the ACM · doi:10.1145/3546036 · Cited by 218
Challenges and frontiers in abusive content detection
Vidgen, B., Harris, A., Nguyen, D., Tromble, R., Hale, S. A., & Margetts, H. Z. (2019) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w19-3509 · Cited by 217
A Survey of Explainable Artificial Intelligence for Smart Cities
Javed, A. R., Ahmed, W., Pandya, S., Maddikunta, P. K. R., Alazab, M., & Gadekallu, T. R. (2023) · Electronics · doi:10.3390/electronics12041020 · Cited by 217
Improving aircraft performance using machine learning: A review
Clainche, S. L., Ferrer, E., Gibson, S., Cross, E. J., Parente, A., & Vinuesa, R. (2023) · Aerospace Science and Technology · doi:10.1016/j.ast.2023.108354 · Cited by 216
Hermann, E. (2022) · New Media & Society · doi:10.1177/14614448211022702 · Cited by 214
Mienye, I. D., Obaido, G., Jere, N., Mienye, E., Aruleba, K., Emmanuel, I. D., & Ogbuokiri, B. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101587 · Cited by 212
Artificial Intelligence and Machine Learning in Arrhythmias and Cardiac Electrophysiology
Feeny, A. K., Chung, M. K., Madabhushi, A., Attia, Z. I., Čikeš, M., Firouznia, M., Friedman, P. A., Kalscheur, M. M., Kapa, S., Narayan, S. M., et al. (2020) · Circulation Arrhythmia and Electrophysiology · doi:10.1161/circep.119.007952 · Cited by 215
A comprehensive review on financial explainable AI
Yeo, W. J., van der Heever, W., Mao, R., Cambria, E., Satapathy, R., & Mengaldo, G. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11077-7 · Cited by 218
Model-Agnostic Counterfactual Explanations for Consequential DecisionsPreprint
Karimi, A.-H., Barthe, G., Balle, B., & Valera, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11190 · Cited by 212
General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models
Molnar, C., König, G., Herbinger, J., Freiesleben, T., Dandl, S., Scholbeck, C. A., Casalicchio, G., Grosse-Wentrup, M., & Bischl, B. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_4 · Cited by 211
Singh, A., Kanaujia, A., Singh, V. K., & Vinuesa, R. (2024) · Sustainable Development · doi:10.1002/sd.2706 · Cited by 211
Goodwin, N. L., Choong, J. J., Hwang, S., Pitts, K. M., Bloom, L., Islam, A., Zhang, Y. Y., Szelenyi, E. R., Tong, X., Newman, E. L., et al. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01649-9 · Cited by 211
Pushing the frontiers in climate modelling and analysis with machine learning
Eyring, V., Collins, W. D., Gentine, P., Barnes, E. A., Barreiro, M., Beucler, T., Bocquet, M., Bretherton, C. S., Christensen, H. M., Dagon, K., et al. (2024) · Nature Climate Change · doi:10.1038/s41558-024-02095-y · Cited by 211
Interpretable and explainable machine learning: A methods‐centric overview with concrete examples
Marcinkevičs, R., & Vogt, J. E. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1493 · Cited by 210
Kute, D. V., Pradhan, B., Shukla, N., & Alamri, A. (2021) · IEEE Access · doi:10.1109/access.2021.3086230 · Cited by 209
Wu, Z., Wang, J., Du, H., Jiang, D., Kang, Y., Li, D., Pan, P., Deng, Y., Cao, D., Hsieh, C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-38192-3 · Cited by 209
How Interpretable Machine Learning Can Benefit Process Understanding in the Geosciences
Jiang, S., Sweet, L., Blougouras, G., Brenning, A., Li, W., Reichstein, M., Denzler, J., Shangguan, W., Yu, G., Huang, F., et al. (2024) · Earth s Future · doi:10.1029/2024ef004540 · Cited by 209
Machine learning and artificial intelligence in physiologically based pharmacokinetic modeling
Chou, W., & Lin, Z. (2022) · Toxicological Sciences · doi:10.1093/toxsci/kfac101 · Cited by 208
Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanoma
Chanda, T., Hauser, K., Hobelsberger, S., Bucher, T.-C., Garcia, C. N., Wies, C., Kittler, H., Tschandl, P., Navarrete‐Dechent, C., Podlipnik, S., et al. (2024) · Nature Communications · doi:10.1038/s41467-023-43095-4 · Cited by 211
Nasarian, E., Alizadehsani, R., Acharya, U. R., & Tsui, K.-L. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102412 · Cited by 207
Hamamoto, R., Suvarna, K., Yamada, M., Kobayashi, K., Shinkai, N., Miyake, M., Takahashi, M., Jinnai, S., Shimoyama, R., Sakai, A., et al. (2020) · Cancers · doi:10.3390/cancers12123532 · Cited by 207
Schramowski, P., Stammer, W., Teso, S., Brugger, A., Herbert, F., Shao, X., Luigs, H.-G., Mahlein, A.-K., & Kersting, K. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0212-3 · Cited by 207
On the failings of Shapley values for explainability
Huang, X., & Marques-Silva, J. P. (2024) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2023.109112 · Cited by 206
Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review
Kuznietsov, A., Gyevnár, B., Wang, C., Peters, S., & Albrecht, S. V. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3474469 · Cited by 206
A systematic review of personal thermal comfort models
Martins, L. A., Soebarto, V. I., & Williamson, T. (2021) · Building and Environment · doi:10.1016/j.buildenv.2021.108502 · Cited by 205
A Review on Explainability in Multimodal Deep Neural Nets
Joshi, G., Walambe, R., & Kotecha, K. (2021) · IEEE Access · doi:10.1109/access.2021.3070212 · Cited by 204
Explainable AI under Contract and Tort Law: Legal Incentives and Technical Challenges
Hacker, P., Krestel, R., Grundmann, S., & Naumann, F. (2020) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09260-6 · Cited by 204
Srivastava, A. K., Safaei, N., Khaki, S., Lopez, G., Zeng, W., Ewert, F. A., Gaiser, T., & Rahimi, J. (2022) · Scientific Reports · doi:10.1038/s41598-022-06249-w · Cited by 203
Ryo, M. (2022) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2022.11.003 · Cited by 203
Explainable Deep Learning Methods in Medical Image Classification: A Survey
Patrício, C., Neves, J. C., & Teixeira, L. F. (2023) · ACM Computing Surveys · doi:10.1145/3625287 · Cited by 207
Organisciak, P., Acar, S., Dumas, D., & Berthiaume, K. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101356 · Cited by 202
Yang, Y., Panagopoulou, A., Zhou, S., Jin, D., Callison-Burch, C., & Yatskar, M. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01839 · Cited by 202
Allgaier, J., Mulansky, L., Draelos, R. L., & Pryss, R. C. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102616 · Cited by 201
Ryo, M., Angelov, B., Mammola, S., Kass, J. M., Benito, B. M., & Hartig, F. (2020) · Ecography · doi:10.1111/ecog.05360 · Cited by 200
Bridging observations, theory and numerical simulation of the ocean using machine learning
Sonnewald, M., Lguensat, R., Jones, D. C., Dueben, P. D., Brajard, J., & Balaji, V. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac0eb0 · Cited by 200
Guidelines and evaluation of clinical explainable AI in medical image analysis
Jin, W., Li, X., Fatehi, M., & Hamarneh, G. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102684 · Cited by 199
Alslaity, A., & Orji, R. (2022) · Behaviour and Information Technology · doi:10.1080/0144929x.2022.2156387 · Cited by 199
Innovative Materials Science via Machine Learning
Gao, C., Min, X., Fang, M., Tao, T., Zheng, X., Liu, Y., Wu, X., & Huang, Z. (2022) · Advanced Functional Materials · doi:10.1002/adfm.202108044 · Cited by 198
Transparency: Motivations and Challenges
Weller, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_2 · Cited by 198
Trauma-Informed Computing: Towards Safer Technology Experiences for All
Chen, J. X., McDonald, A., Zou, Y., Tseng, E., Roundy, K., Tamersoy, A., Schaub, F., Ristenpart, T., & Dell, N. L. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517475 · Cited by 201
Ash, E., & Hansen, S. (2023) · Annual Review of Economics · doi:10.1146/annurev-economics-082222-074352 · Cited by 197
Advancing Computational Toxicology by Interpretable Machine Learning
Jia, X., Wang, T., & Zhu, H. (2023) · Environmental Science & Technology · doi:10.1021/acs.est.3c00653 · Cited by 199
Artificial Intelligence in Oncology: Current Landscape, Challenges, and Future Directions
Lotter, W., Hassett, M. J., Schultz, N., Kehl, K. L., Van Allen, E. M., & Cerami, E. (2024) · Cancer Discovery · doi:10.1158/2159-8290.cd-23-1199 · Cited by 196
"The human body is a black box": supporting clinical decision-making with deep learning
Sendak, M., Elish, M. C., Gao, M., Futoma, J., Ratliff, W., Nichols, M., Bedoya, A., Balu, S., & O'Brien, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372827 · Cited by 196
Preserving data privacy in machine learning systems
Mestari, S. Z. E., Lenzini, G., & Demirci, H. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103605 · Cited by 195
The Dangers of Post-hoc Interpretability: Unjustified Counterfactual Explanations
Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., & Detyniecki, M. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/388 · Cited by 194
Explainable artificial intelligence in skin cancer recognition: A systematic review
Hauser, K., Kurz, A., Haggenmüller, S., Maron, R. C., Kalle, C. V., Utikal, J. S., Meier, F. E., Hobelsberger, S., Gellrich, F. F., Sergon, M., et al. (2022) · European Journal of Cancer · doi:10.1016/j.ejca.2022.02.025 · Cited by 193
Prediction and Design of Nanozymes using Explainable Machine Learning
Wei, Y., Wu, J., Wu, Y., Liu, H., Meng, F., Liu, Q., Midgley, A. C., Zhang, X., Qi, T., Kang, H., et al. (2022) · Advanced Materials · doi:10.1002/adma.202201736 · Cited by 192
Topological data analysis in biomedicine: A review
Skaf, Y., & Laubenbacher, R. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104082 · Cited by 192
Challenges with developing and deploying AI models and applications in industrial systems
Sinha, S. R., & Lee, Y. M. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00151-2 · Cited by 192
Machine learning in precision diabetes care and cardiovascular risk prediction
Oikonomou, E. K., & Khera, R. (2023) · Cardiovascular Diabetology · doi:10.1186/s12933-023-01985-3 · Cited by 190
Machine learning in marine ecology: an overview of techniques and applications
Rubbens, P., Brodie, S. J., Cordier, T., Barcellos, D. D., Devos, P., Fernandes, J. A., Fincham, J. I., Gomes, A., Handegard, N. O., Howell, K. L., et al. (2023) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsad100 · Cited by 189
Emerging Applications of Machine Learning in Food Safety
Deng, X., Cao, S., & Horn, A. L. (2021) · Annual Review of Food Science and Technology · doi:10.1146/annurev-food-071720-024112 · Cited by 188
Zihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187
Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology
Studer, S., Bui, T. B., Drescher, C., Hanuschkin, A., Winkler, L., Peters, S., & Müller, K. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3020020 · Cited by 396
Sokol, K., & Flach, P. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00637-y · Cited by 186
Rapid Trust Calibration through Interpretable and Uncertainty-Aware AI
Tomsett, R., Preece, A., Braines, D., Cerutti, F., Chakraborty, S., Srivastava, M., Pearson, G., & Kaplan, L. (2020) · Patterns · doi:10.1016/j.patter.2020.100049 · Cited by 186
Evaluation and Mitigation of Racial Bias in Clinical Machine Learning Models: Scoping Review
Huang, J., Galal, G., Etemadi, M., & Vaidyanathan, M. (2022) · JMIR Medical Informatics · doi:10.2196/36388 · Cited by 186
Perez-Cerrolaza, J., Abella, J., Borg, M., Donzella, C., Cerquides, J., Cazorla, F. J., Englund, C., Tauber, M., Nikolakopoulos, G., & Flores, J. L. (2024) · ACM Computing Surveys · doi:10.1145/3626314 · Cited by 185
Squires, M., Tao, X., Elangovan, S., Gururajan, R., Zhou, X., Acharya, U. R., & Li, Y. (2023) · Brain Informatics · doi:10.1186/s40708-023-00188-6 · Cited by 188
Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415234 · Cited by 183
Explainable AI: current status and future directionsPreprint
Gohel, P., Singh, P., & Mohanty, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.07045 · Cited by 183
Explainable Artificial Intelligence by Genetic Programming: A Survey
Mei, Y., Chen, Q., Lensen, A., Xue, B., & Zhang, M. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3225509 · Cited by 182
Metadata
- Authors
- Rudin, C.
- Affiliations
- Duke University (US)
- Corresponding author
- Rudin, Cynthia
- ORCID
- Rudin, Cynthia
- Venue
- Nature Machine Intelligence
- Published
- 2019-05-13
- Volume
- 1
- Issue
- 5
- Pages
- 206-215
- ISSN
- 2522-5839 (ISSN-L)
- PMC
- PMC9122117
- OpenAlex
- W2945976633
- Cited by
- 10,561
- References
- 50
- Citations by year
- 2026: 2997 · 2025: 2162 · 2024: 1555 · 2023: 1293 · 2022: 1094 · 2021: 914 · 2020: 461 · 2019: 72
- FWCI
- 289.88
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Nature Machine Intelligence (publishedVersion)
- arXiv (Cornell University) (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation
- Laura and John Arnold Foundation
- National Institutes of Health
- Defense Advanced Research Projects Agency
- National Institute of Biomedical Imaging and Bioengineering (R01EB025021)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- black-box models, explainable AI, model interpretability, high-stakes decision making, criminal justice, health care, algorithmic harms, computer vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
