The mythos of model interpretability
Lipton, Zachary C.·2018·Communications of the ACM
DOI 10.1145/3233231
Cited by (1,043)
Items 201–300 of 1,043
- Interpretable Machine LearningBrad Boehmke, Brandon Greenwell · 2019 · Chapman & Hall/CRC eBooks
- Evolutionary Fuzzy Systems for Explainable Artificial Intelligence: Why, When, What for, and Where to?Alberto Fernández, Francisco Herrera, Óscar Cordón, María José del Jesús, Francesco Marcelloni · 2019 · IEEE Computational Intelligence Magazine
- In AI We Trust Incrementally: a Multi-layer Model of Trust to Analyze Human-Artificial Intelligence InteractionsAndrea Ferrario, Michele Loi, Eleonora Viganò · 2019 · Philosophy & Technology
- Hydrological concept formation inside long short-term memory (LSTM) networksThomas Lees, Steven Reece, Frederik Kratzert, Daniel Klotz, Martin Gauch, Jens de Bruijn, Reetik Kumar Sahu, Peter Greve, Louise J. Slater, Simon Dadson · 2022 · Hydrology and earth system sciences
- Limits of trust in medical AIJoshua James Hatherley · 2020 · Journal of Medical Ethics
- Spatial heterogeneity modeling of water quality based on random forest regression and model interpretationFeier Wang, Yixu Wang, Kai Zhang, Ming Hu, Qin Weng, Huichun Judy Zhang · 2021 · Environmental Research
- Troubling Trends in Machine Learning Scholarship: Some ML papers suffer from flaws that could mislead the public and stymie future research.Lipton, Zachary C., Steinhardt, Jacob · 2019 · Queue
- Explainability of Deep Vision-Based Autonomous Driving Systems: Review and ChallengesZablocki, Éloi, Ben-Younes, Hédi, Pérez, Patrick, Cord, Matthieu · 2022 · International Journal of Computer Vision
- Explainability in human–agent systemsAvi Rosenfeld, Ariella Richardson · 2019 · Autonomous Agents and Multi-Agent Systems
- GamutFred Hohman, Andrew Head, Rich Caruana, Robert A DeLine, Steven M. Drucker · 2019 · CHI Conference on Human Factors in Computing Systems
- Explainable artificial intelligence in disaster risk management: Achievements and prospective futuresSaman Ghaffarian, Firouzeh Rosa Taghikhah, Holger Robert Maier · 2023 · International Journal of Disaster Risk Reduction
- Defining the undefinable: the black box problem in healthcare artificial intelligenceWadden, Jordan Joseph · 2022 · Journal of Medical Ethics
- Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science ProjectsPassi, Samir, Jackson, Steven J. · 2018 · Proceedings of the ACM on Human-Computer Interaction
- Learning Molecular Representations for Medicinal ChemistryKangway V. Chuang, Laura M. Gunsalus, Michael J. Keiser · 2020 · Journal of Medicinal Chemistry
- Explainability as a non-functional requirement: challenges and recommendationsLarissa Chazette, Kurt A. Schneider · 2020 · Requirements Engineering
- Against Interpretability: a Critical Examination of the Interpretability Problem in Machine LearningMaya Krishnan · 2019 · Philosophy & Technology
- Summit: Scaling Deep Learning Interpretability by Visualizing Activation and Attribution SummarizationsFred Hohman, Haekyu Park, Caleb Robinson, Duen Horng Chau · 2019 · IEEE Transactions on Visualization and Computer Graphics
- Human factors in model interpretability: Industry practices, challenges, and needsHong, Sungsoo Ray, Hullman, Jessica, Bertini, Enrico · 2020 · Proceedings of the ACM on Human-Computer Interaction
- An engineer's guide to eXplainable Artificial Intelligence and Interpretable Machine Learning: Navigating causality, forced goodness, and the false perception of inferenceMohannad Zeyad Naser · 2021 · Automation in Construction
- Antibody structure prediction using interpretable deep learningRuffolo, Jeffrey A., Sulam, Jeremias, Gray, Jeffrey J. · 2022 · Patterns
- Investigating Explainability of Generative AI for Code through Scenario-based DesignSun, Jiao, Liao, Q. Vera, Muller, Michael, Agarwal, Mayank, Houde, Stephanie, Talamadupula, Kartik, Weisz, Justin D. · 2022 · 27th International Conference on Intelligent User Interfaces
- MODE: automated neural network model debugging via state differential analysis and input selectionShiqing Ma, Yingqi Liu, Wen‐Chuan Lee, Xiangyu Zhang, Ananth Y. Grama · 2018 · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE)
- Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligenceAndreas Holzinger, Matthias Dehmer, Frank Emmert‐Streib, Rita Cucchiara, Isabelle Augenstein, Javier Del Ser, Wojciech Samek, Igor Jurišica, Natalia Díaz-Rodríguez · 2021 · Information Fusion
- Beyond Sparsity: Tree Regularization of Deep Models for InterpretabilityWu, Mike, Hughes, Michael, Parbhoo, Sonali, Zazzi, Maurizio, Roth, Volker, Doshi-Velez, Finale · 2018 · Proceedings of the AAAI Conference on Artificial Intelligence
- A Survey of Explainable Artificial Intelligence in Healthcare: Concepts, Applications, and ChallengesMienye, Ibomoiye Domor, Obaido, George, Jere, Nobert, Mienye, Ebikella, Aruleba, Kehinde, Emmanuel, Ikiomoye Douglas, Ogbuokiri, Blessing · 2024 · Informatics in Medicine Unlocked
- Adversarial Examples: Attacks and Defenses for Deep LearningXiaoyong Yuan, Pan Li He, Qile Zhu, Xiaolin Li · 2017 · arXiv (Cornell University)
- General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning ModelsMolnar, Christoph, König, Gunnar, Herbinger, Julia, Freiesleben, Timo, Dandl, Susanne, Scholbeck, Christian A., Casalicchio, Giuseppe, Grosse-Wentrup, Moritz, Bischl, Bernd · 2022 · Lecture Notes in Computer Science
- Explaining black-box classifiers using post-hoc explanations-by-example: The effect of explanations and error-rates in XAI user studiesKenny, Eoin M., Ford, Courtney, Quinn, Molly, Keane, Mark T. · 2021 · Artificial Intelligence
- Post-hoc Interpretability for Neural NLP: A SurveyAndreas Madsen, Siva Reddy, Sarath Chandar · 2022 · ACM Computing Surveys
- Epigenetic ageing clocks: statistical methods and emerging computational challengesAndrew Erich Teschendorff, Steve Horvath · 2025 · Nature Reviews Genetics
- Automated rationale generation: a technique for explainable AI and its effects on human perceptionsEhsan, Upol, Tambwekar, Pradyumna, Chan, Larry, Harrison, Brent, Riedl, Mark O. · 2019 · Proceedings of the 24th International Conference on Intelligent User Interfaces
- Disentangled Graph Convolutional NetworksJianxin Ma, Peng Cui, Kun Kuang, Xin Wang, Wenwu Zhu · 2019 · International Conference on Machine Learning
- A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?Subrato Bharati, Md. Rubaiyat Hossain Mondal, Prajoy Podder · 2023 · IEEE Transactions on Artificial Intelligence
- Automated and interpretable patient ECG profiles for disease detection, tracking, and discoveryTison, Geoffrey H., Zhang, Jeffrey, Delling, Francesca N., Deo, Rahul C. · 2019 · Circulation: Cardiovascular Quality and Outcomes
- Designing interpretable ML system to enhance trust in healthcare: A systematic review to proposed responsible clinician-AI-collaboration frameworkNasarian, Elham, Alizadehsani, Roohallah, Acharya, U.Rajendra, Tsui, Kwok-Leung · 2024 · Information Fusion
- Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narrativesSebastian Gehrmann, Franck Dernoncourt, Yeran Li, Eric T. Carlson, Joy Tzung-Yu Wu, Jonathan A. Welt, John Foote, Edward T. Moseley, David W. Grant, Patrick D. Tyler et al. · 2018 · PLoS ONE
- A Review on Explainability in Multimodal Deep Neural NetsJoshi, Gargi, Walambe, Rahee, Kotecha, Ketan · 2021 · IEEE Access
- Interpretable machine learningValerie Chen, Jeffrey Li, Joon Sik Kim, Gregory Plumb, Ameet Talwalkar · 2022 · Communications of the ACM
- Human and AI Ensembles: When Can They Work?Vivek Choudhary, Arianna Marchetti, Yash Raj Shrestha, Phanish Puranam · 2021 · Journal of Management
- The Challenges of Machine Learning: A Critical ReviewEnrico Barbierato, Alice Gatti · 2024 · Electronics
- Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual ReasoningMascharka, David, Tran, Philip, Soklaski, Ryan, Majumdar, Arjun · 2018 · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Recurrent Neural Network Attention Mechanisms for Interpretable System Log Anomaly DetectionAndy Brown, Aaron R. Tuor, Brian Hutchinson, Nicole Nichols · 2018 · Proceedings of the First Workshop on Machine Learning for Computing Systems
- iForest: Interpreting Random Forests via Visual AnalyticsXun Zhao, Yanhong Wu, Dik Lun Lee, Weiwei Cui · 2018 · IEEE Transactions on Visualization and Computer Graphics
- Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation MethodsDylan Slack, Sophie Hilgard, Emily Jia, Sameer Singh, Himabindu Lakkaraju · 2019 · arXiv (Cornell University)
- Challenges and frontiers in abusive content detectionBertie Vidgen, Alex Harris, Dong Nguyen, Rebekah Tromble, Scott A. Hale, Helen Zerlina Margetts · 2019 · Workshop on Abusive Language Online (ALW)
- Integrating Transparency, Trust, and Acceptance: The Intelligent Systems Technology Acceptance Model (ISTAM)Eric S. Vorm, David J. Y. Combs · 2022 · International Journal of Human-Computer Interaction
- An attention based deep learning model of clinical events in the intensive care unitDeepak A. Kaji, John R. Zech, Jun Kim, Samuel Kang-Wook Cho, Neha Subhash Dangayach, Anthony Beardsworth Costa, Eric Karl Oermann · 2019 · PLoS ONE
- Explainable Recommendation: A Survey and New PerspectivesYongfeng Zhang, Xu Chen · 2020
- Artificial CommunicationElena Esposito · 2022 · The MIT Press eBooks
- Toward Edge-Based Deep Learning in Industrial Internet of ThingsFan Liang, Wei Yu, Xing Liu, DAVID W. T. GRIFFITH, Nada Golmie · 2020 · IEEE Internet of Things Journal
- Explainable AI for Time Series Classification: A Review, Taxonomy and Research DirectionsAndreas Theissler, Francesco Spinnato, Udo Schlegel, Riccardo Guidotti · 2022 · IEEE Access
- Explainable AI for Bioinformatics: Methods, Tools and ApplicationsMd. Rezaul Karim, Tanhim Islam, Md Shajalal, Oya Beyan, Christoph Lange, Michael Cochez, Dietrich Rebholz‐Schuhmann, Stefan Decker · 2023 · Briefings in Bioinformatics
- Transparency: Motivations and ChallengesWeller, Adrian · 2019 · Lecture Notes in Computer Science
- Application of Artificial Intelligence for the Diagnosis and Treatment of Liver DiseasesJoseph C. Ahn, Alistair Connell, Douglas Alano Simonetto, Cían Hughes, Vijay H. Shah · 2020 · Hepatology
- A review of some techniques for inclusion of domain-knowledge into deep neural networksDash, Tirtharaj, Chitlangia, Sharad, Ahuja, Aditya, Srinivasan, Ashwin · 2022 · Scientific Reports
- Precision medicine in stroke: towards personalized outcome predictions using artificial intelligenceAnna Katharina Bonkhoff, Christian Grefkes · 2021 · Brain
- Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision taskLeichtmann, Benedikt, Humer, Christina, Hinterreiter, Andreas, Streit, Marc, Mara, Martina · 2023 · Computers in Human Behavior
- The Dangers of Post-hoc Interpretability: Unjustified Counterfactual ExplanationsLaugel, Thibault, Lesot, Marie-Jeanne, Marsala, Christophe, Renard, Xavier, Detyniecki, Marcin · 2019 · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence
- The role of shared mental models in human-AI teams: a theoretical reviewRobert W. Andrews, J. Mason Lilly, Divya Srivastava, Karen M. Feigh · 2022 · Theoretical Issues in Ergonomics Science
- A Survey of Explainable Artificial Intelligence for Smart CitiesAbdul Rehman Javed, Waqas Ahmed, Sharnil Pandya, Praveen Kumar Reddy Maddikunta, Mamoun Alazab, Thippa Reddy Gadekallu · 2023 · Electronics
- Transparency in Complex Computational SystemsKathleen Creel · 2020 · Philosophy of Science
- Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingRastogi, Charvi, Zhang, Yunfeng, Wei, Dennis, Varshney, Kush R., Dhurandhar, Amit, Tomsett, Richard · 2022 · Proceedings of the ACM on Human-Computer Interaction
- Advanced data analytics for enhancing building performances: From data-driven to big data-driven approachesCheng Fan, Da Yan, Fu Xiao, Ao Li, Jingjing An, Xuyuan Kang · 2020 · Building Simulation
- Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanomaTirtha Chanda, Katja Hauser, Sarah Hobelsberger, Tabea-Clara Bucher, Carina Nogueira Garcia, Christoph Wies, Harald Kittler, Philipp Tschandl, Cristián Navarrete‐Dechent, Sebastián Podlipnik et al. · 2024 · Nature Communications
- Interpretability in healthcare: A comparative study of local machine learning interpretability techniquesRadwa Elshawi, Youssef Sherif, Mouaz Husayn Al-Mallah, Sherif Sakr · 2020 · Computational Intelligence
- Advancing Computational Toxicology by Interpretable Machine LearningXuelian Jia, Tong Wang, Hao Zhu · 2023 · Environmental Science & Technology
- Explainable artificial intelligence enhances the ecological interpretability of black‐box species distribution modelsMasahiro Ryo, Boyan Angelov, Stefano Mammola, Jamie M. Kass, Blas M. Benito, Florian Hartig · 2020 · Ecography
- A systematic review of personal thermal comfort modelsLarissa Arakawa Martins, Veronica I. Soebarto, Terence Williamson · 2021 · Building and Environment
- Explainable AI under Contract and Tort Law: Legal Incentives and Technical ChallengesPhilipp Hacker, Ralf Krestel, Stefan Grundmann, Felix Naumann · 2020 · Artificial Intelligence and Law
- Rapid Trust Calibration through Interpretable and Uncertainty-Aware AITomsett, Richard, Preece, Alun, Braines, Dave, Cerutti, Federico, Chakraborty, Supriyo, Srivastava, Mani, Pearson, Gavin, Kaplan, Lance · 2020 · Patterns
- Model-Agnostic Counterfactual Explanations for Consequential DecisionsAmir-Hossein Karimi, Gilles Barthe, Borja Balle, Isabel Valera · 2019 · arXiv (Cornell University)
- A causal framework for explaining the predictions of black-box sequence-to-sequence modelsDavid Alvarez-Melis, Tommi Jaakkola · 2017 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Clinical concept extraction: A methodology reviewSunyang Fu, David J. Chen, Huan He, Sijia Liu, Sungrim Moon, Kevin J. Peterson, Feichen Shen, Liwei Wang, Yanshan Wang, Andrew Wen et al. · 2020 · Journal of Biomedical Informatics
- Roadmap on Machine learning in electronic structureHeather J. Kulik, Thomas Hammerschmidt, Jonathan Schmidt, Silvana Botti, Miguel A. L. Marques, Mario Boley, Matthias Scheffler, Milica Todorović, Patrick Rinke, Corey Oses et al. · 2022 · Electronic Structure
- Transparency and accountability in AI decision support: Explaining and visualizing convolutional neural networks for text informationKim, Buomsoo, Park, Jinsoo, Suh, Jihae · 2020 · Decision Support Systems
- A literature review on applications of explainable artificial intelligence (XAI)Kalasampath, Khushi, Spoorthi, K. N., Sajeev, Sreeparvathy, Kuppa, Sahil Sarma, Ajay, Kavya, Maruthamuthu, Angulakshmi · 2025 · IEEE Access
- From explainable to interactive AI: A literature review on current trends in human-AI interactionRaees, Muhammad, Meijerink, Inge, Lykourentzou, Ioanna, Khan, Vassilis-Javed, Papangelis, Konstantinos · 2024 · International Journal of Human-Computer Studies
- Few-shot learning creates predictive models of drug response that translate from high-throughput screens to individual patientsMa, Jianzhu, Fong, Samson H., Luo, Yunan, Bakkenist, Christopher J., Shen, John Paul, Mourragui, Soufiane, Wessels, Lodewyk F. A., Hafner, Marc, Sharan, Roded, Peng, Jian et al. · 2021 · Nature Cancer
- Modeling Missing Data in Clinical Time Series with RNNsZachary C. Lipton, David C. Kale, Randall C. Wetzel · 2016 · arXiv (Cornell University)
- Sociotechnical Envelopment of Artificial Intelligence: An Approach to Organizational Deployment of Inscrutable Artificial Intelligence SystemsAleksandre Asatiani, Pekka Malo, Per Rådberg Nagbøl, E. Penttinen, Tapani Rinta-Kahila, A. Salovaara · 2021 · Journal of the AIS
- Interpretable machine learning for predicting and evaluating hydrogen production via supercritical water gasification of biomassSheng Hui Zhao, Jian Li, Chao Chen, Beibei Yan, Junyu Tao, Guanyi Chen · 2021 · Journal of Cleaner Production
- Challenges and opportunities for artificial intelligence in auditing: Evidence from the fieldKokina, Julia, Blanchette, Shay, Davenport, Thomas H., Pachamanova, Dessislava · 2025 · International Journal of Accounting Information Systems
- Comparing Automatic and Human Evaluation of Local Explanations for Text ClassificationDong Nguyen · 2018 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
- An explainable AI decision-support-system to automate loan underwritingSwati Sachan, Jianbo Yang, Dong‐Ling Xu, David Eraso Benavides, Yang Li · 2019 · Expert Systems with Applications
- Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and VisionsLuca Longo, Randy G. Goebel, Freddy Lécué, Peter Kieseberg, Andreas Holzinger · 2020 · Lecture notes in computer science
- Interpretability and fairness evaluation of deep learning models on MIMIC-IV datasetChuizheng Meng, Loc Trinh, Nan Xu, James Enouen, Yan Liu · 2022 · Scientific Reports
- Explainable artificial intelligence and interpretable machine learning for agricultural data analysisMasahiro Ryo · 2022 · Artificial Intelligence in Agriculture
- Prediction of Ecofriendly Concrete Compressive Strength Using Gradient Boosting Regression Tree Combined with GridSearchCV Hyperparameter-Optimization TechniquesZaineb Mohammed Alhakeem, Yasir Mohammed Jebur, Sadiq Naama Henedy, Hamza Imran, Luís Filipe Almeida Bernardo, Hussein M. Hussein · 2022 · Materials
- Predictive maintenance using tree-based classification techniques: A case of railway switchesZaharah Allah Bukhsh, Aaqib Saeed, Irina Stipanović, Andries G. Dorée · 2019 · Transportation Research Part C Emerging Technologies
- From Blackbox to Explainable AI in Healthcare: Existing Tools and Case StudiesParvathaneni Naga Srinivasu, N. Sandhya, Rutvij H. Jhaveri, Roshani Raut · 2022 · Mobile Information Systems
- How does the model make predictions? A systematic literature review on the explainability power of machine learning in healthcareJohannes Allgaier, Lena Mulansky, Rachel Lea Draelos, Rüdiger C. Pryss · 2023 · Artificial Intelligence in Medicine
- Pre-trained Language Models in Biomedical Domain: A Systematic SurveyBenyou Wang, Qianqian Xie, Jiahuan Pei, Zhihong Chen, Prayag Tiwari, Zhao Li, Jie Fu · 2023 · ACM Computing Surveys
- Explainable AI Over the Internet of Things (IoT): Overview, State-of-the-Art and Future DirectionsS. K. Jagatheesaperumal, Quoc-Viet Pham, Rukhsana Ruby, Zhaohui Yang, Chunmei Xu, Zhaoyang Zhang · 2022 · IEEE Open Journal of the Communications Society
- Toward Fairness, Accountability, Transparency, and Ethics in AI for Social Media and Health Care: Scoping ReviewSinghal, Aditya, Neveditsin, Nikita, Tanveer, Hasnaat, Mago, Vijay · 2024 · JMIR Medical Informatics
- Explainability of a Machine Learning Granting Scoring Model in Peer-to-Peer LendingMiller Janny Ariza Garzón, Javier Arroyo, Antonio Caparrini, María Jesús Segovia Vargas · 2020 · IEEE Access
- TensorFuzz: Debugging Neural Networks with Coverage-Guided FuzzingAugustus Odena, Ian Goodfellow · 2018 · arXiv (Cornell University)
- A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential RecommendationsKarimi, Amir-Hossein, Barthe, Gilles, Schölkopf, Bernhard, Valera, Isabel · 2023 · ACM Computing Surveys
- Machine Learning for Perovskite Solar Cells and Component Materials: Key Technologies and ProspectsLiu, Yiming, Tan, Xinyu, Liang, Jie, Han, Hongwei, Xiang, Peng, Yan, Wensheng · 2023 · Advanced Functional Materials
- Explainable artificial intelligence (XAI): Precepts, models, and opportunities for research in constructionPeter E.D. Love, Weili Fang, Jane Matthews, Stuart R. Porter, Hanbin Luo, Lieyun Ding · 2023 · Advanced Engineering Informatics
- The Psychological Well-Being of Content ModeratorsSteiger, Miriah, Bharucha, Timir J, Venkatagiri, Sukrit, Riedl, Martin J., Lease, Matthew · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems