The mythos of model interpretability
Lipton, Zachary C.·2018·Communications of the ACM
DOI 10.1145/3233231
Cited by (1,043)
Items 101–200 of 1,043
- Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?Jacovi, Alon, Goldberg, Yoav · 2020 · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Explaining anomalies detected by autoencoders using Shapley Additive ExplanationsAntwarg, Liat, Miller, Ronnie Mindlin, Shapira, Bracha, Rokach, Lior · 2021 · Expert Systems with Applications
- An Overview of Artificial Intelligence EthicsChangwu Huang, Zeqi Zhang, Bifei Mao, Xin Yao · 2022 · IEEE Transactions on Artificial Intelligence
- Analysis Methods in Neural Language Processing: A SurveyYonatan Belinkov, James Robert Glass · 2019 · Transactions of the Association for Computational Linguistics
- Opening the black box: interpretable machine learning for geneticistsAzodi, Christina B., Tang, Jiliang, Shiu, Shin-Han · 2020 · Trends in Genetics
- Attention is not ExplanationSarthak Jain, Byron Wallace · 2019 · arXiv (Cornell University)
- Causal Interpretations of Black-Box ModelsQingyuan Zhao, Trevor J. Hastie · 2019 · Journal of Business and Economic Statistics
- Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-MakingVeale, Michael, Van Kleek, Max, Binns, Reuben · 2018 · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Interpretability of deep learning models: A survey of resultsSupriyo Chakraborty, Richard Tomsett, Ramya Raghavendra, Daniel Harborne, Moustafa Alzantot, Federico Cerutti, Mani B. Srivastava, Alun D. Preece, Simon Julier, Raghuveer Rao et al. · 2017 · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI)
- Explainable Deep Learning: A Field Guide for the UninitiatedGabriëlle Ras, Ning Xie, Marcel A. J. van Gerven, Derek Doran · 2022 · Journal of Artificial Intelligence Research
- Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in ResearchZhang, Zhibo, Hamadi, Hussam Al, Damiani, Ernesto, Yeun, Chan Yeob, Taher, Fatma · 2022 · IEEE Access
- Improving palliative care with deep learningAnand Avati, Kenneth Jung, Stephanie M. Harman, Norman Lance Downing, A.Y. Ng, Nigam Haresh Shah · 2017 · IEEE International Conference on Bioinformatics and Biomedicine (BIBM)
- Transparency and trust in artificial intelligence systemsSchmidt, Philipp, Biessmann, Felix, Teubner, Timm · 2020 · Journal of Decision Systems
- Interpretable and Explainable Machine Learning for Materials Science and ChemistryOviedo, Felipe, Ferres, Juan Lavista, Buonassisi, Tonio, Butler, Keith T. · 2022 · Accounts of Materials Research
- AI-Based Digital Assistants: Opportunities, Threats, and Research PerspectivesMaedche, Alexander, Legner, Christine, Benlian, Alexander, Berger, Benedikt, Gimpel, Henner, Hess, Thomas, Hinz, Oliver, Morana, Stefan, Söllner, Matthias · 2019 · Business & Information Systems Engineering
- Ablation-CAM: Visual Explanations for Deep Convolutional Network via Gradient-free LocalizationSaurabh Ravindra Desai, Harish G. Ramaswamy · 2020 · IEEE Winter Conference on Applications of Computer Vision
- Machine Learning in Mental Health: A Systematic Review of the HCI Literature to Support the Development of Effective and Implementable ML SystemsThieme, Anja, Belgrave, Danielle, Doherty, Gavin · 2020 · ACM Transactions on Computer-Human Interaction
- Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A SurveyBuhrmester, Vanessa, Münch, David, Arens, Michael · 2021 · Machine Learning and Knowledge Extraction
- Neural Machine Translation: A ReviewFelix Stahlberg · 2020 · Journal of Artificial Intelligence Research
- Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI ComplementarityKenneth Holstein, Bruce M. McLaren, Vincent Aleven · 2019 · Journal of Learning Analytics
- Solving the Black Box Problem: A Normative Framework for Explainable Artificial IntelligenceZednik, Carlos · 2021 · Philosophy & Technology
- Evaluating XAI: A comparison of rule-based and example-based explanationsvan der Waa, Jasper, Nieuwburg, Elisabeth, Cremers, Anita, Neerincx, Mark · 2021 · Artificial Intelligence
- Deep learning in drug discovery: an integrative review and future challengesHeba Askr, Enas Elgeldawi, Heba Aboul-Ella, Y. Elshaier, Mamdouh M. Gomaa, A. Hassanien · 2022 · Artificial Intelligence Review
- Integrating explanation and prediction in computational social scienceHofman, Jake M., Watts, Duncan J., Athey, Susan, Garip, Filiz, Griffiths, Thomas L., Kleinberg, Jon, Margetts, Helen, Mullainathan, Sendhil, Salganik, Matthew J., Vazire, Simine et al. · 2021 · Nature
- Explanations as Mechanisms for Supporting Algorithmic TransparencyRader, Emilee, Cotter, Kelley, Cho, Janghee · 2018 · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Machine learning in concrete science: applications, challenges, and best practicesLi, Zhanzhao, Yoon, Jinyoung, Zhang, Rui, Rajabipour, Farshad, Srubar III, Wil V., Dabo, Ismaila, Radlińska, Aleksandra · 2022 · npj Computational Materials
- A Survey on Automated Fact-CheckingGuo, Zhijiang, Schlichtkrull, Michael, Vlachos, Andreas · 2022 · Transactions of the Association for Computational Linguistics
- A historical perspective of explainable Artificial IntelligenceRoberto Confalonieri, Ludovik Çoba, Benedikt Wagner, Tarek R. Besold · 2020 · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery
- Deep Learning for Time Series Forecasting: Tutorial and Literature SurveyBenidis, Konstantinos, Rangapuram, Syama Sundar, Flunkert, Valentin, Wang, Yuyang, Maddix, Danielle, Turkmen, Caner, Gasthaus, Jan, Bohlke-Schneider, Michael, Salinas, David, Stella, Lorenzo et al. · 2023 · ACM Computing Surveys
- Viewpoint: Human-in-the-loop Artificial IntelligenceZanzotto, Fabio Massimo · 2019 · Journal of Artificial Intelligence Research
- Learning to Explain: An Information-Theoretic Perspective on Model InterpretationJianbo Chen, Le Song, Martin J. Wainwright, Michael I. Jordan · 2018 · arXiv (Cornell University)
- Axes of a revolution: challenges and promises of big data in healthcareShilo, Smadar, Rossman, Hagai, Segal, Eran · 2020 · Nature Medicine
- Security and Privacy Challenges of Large Language Models: A SurveyDas, Badhan Chandra, Amini, M. Hadi, Wu, Yanzhao · 2025 · ACM Computing Surveys
- Adversarial Malware Binaries: Evading Deep Learning for Malware Detection in ExecutablesBojan Kolosnjaji, Ambra Demontis, Battista Biggio, Davide Maiorca, Giorgio Giacinto, Claudia Margot Eckert, Fabio Roli · 2018 · European Signal Processing Conference (EUSIPCO)
- Multimodal sentiment analysis based on fusion methods: A surveyLinan Zhu, Zhechao Zhu, Chenwei Zhang, Yifei Xu, Xiangjie Kong · 2023 · Information Fusion
- Toward Human-Understandable, Explainable AIHagras, Hani · 2018 · Computer
- Interpreting CNNs via Decision TreesQuanshi Zhang, Yu Yang, Haotian Ma, Ying Nian Wu · 2019 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep LearningNicolas Papernot, Patrick Drew McDaniel · 2018 · arXiv (Cornell University)
- Perspectives on the Impact of Machine Learning, Deep Learning, and Artificial Intelligence on Materials, Processes, and Structures EngineeringDimiduk, Dennis M., Holm, Elizabeth A., Niezgoda, Stephen R. · 2018 · Integrating Materials and Manufacturing Innovation
- Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIWang, Dakuo, Weisz, Justin D., Muller, Michael, Ram, Parikshit, Geyer, Werner, Dugan, Casey, Tausczik, Yla, Samulowitz, Horst, Gray, Alexander · 2019 · Proceedings of the ACM on Human-Computer Interaction
- Exchange-correlation functionals for band gaps of solids: benchmark, reparametrization and machine learningPedro Borlido, Jonathan Schmidt, Ahmad W. Huran, Fabien Tran, Miguel A. L. Marques, Silvana Botti · 2020 · npj Computational Materials
- A comprehensive taxonomy for explainable artificial intelligence: a systematic survey of surveys on methods and conceptsGesina Schwalbe, Bettina Finzel · 2023 · Data Mining and Knowledge Discovery
- BERTology Meets Biology: Interpreting Attention in Protein Language ModelsVig, Jesse, Madani, Ali, Varshney, Lav R., Xiong, Caiming, Socher, Richard, Rajani, Nazneen Fatema · 2020
- A Review of Trustworthy and Explainable Artificial Intelligence (XAI)Chamola, Vinay, Hassija, Vikas, Sulthana, A Razia, Ghosh, Debshishu, Dhingra, Divyansh, Sikdar, Biplab · 2023 · IEEE Access
- What Does Explainable AI Really Mean? A New Conceptualization of PerspectivesDoran, Derek, Schulz, Sarah, Besold, Tarek R. · 2017 · arXiv
- Enchanted Determinism: Power without Responsibility in Artificial IntelligenceAlexander Campolo, Kate Crawford · 2020 · Engaging Science Technology and Society
- Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-MakingWang, Xinru, Yin, Ming · 2021 · 26th International Conference on Intelligent User Interfaces
- What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End UseTonekaboni, Sana, Joshi, Shalmali, McCradden, Melissa D, Goldenberg, Anna · 2019 · arXiv
- Explainable artificial intelligence (XAI) in finance: a systematic literature reviewJurgita Černevičienė, Audrius Kabašinskas · 2024 · Artificial Intelligence Review
- Pathologist-level interpretable whole-slide cancer diagnosis with deep learningZhang, Zizhao, Chen, Pingjun, McGough, Mason, Xing, Fuyong, Wang, Chunbao, Bui, Marilyn, Xie, Yuanpu, Sapkota, Manish, Cui, Lei, Dhillon, Jasreman et al. · 2019 · Nature Machine Intelligence
- Neural circuit policies enabling auditable autonomyMathias Lechner, Ramin Hasani, Alexander Amini, Thomas A. Henzinger, Daniela L. Rus, Radu Grosu · 2020 · Nature Machine Intelligence
- Machine and deep learning meet genome-scale metabolic modelingGuido Zampieri, Supreeta Vijayakumar, Elisabeth Yaneske, Claudio Angione · 2019 · PLoS Computational Biology
- Automated deep learning design for medical image classification by health-care professionals with no coding experience: a feasibility studyLivia Faes, Siegfried K. Wagner, Dun Jack Fu, Xiaoxuan Liu, Edward Korot, Joseph R. E. Ledsam, Trevor Back, Reena Chopra, Nikolas Pontikos, Christoph Kern et al. · 2019 · The Lancet Digital Health
- Inherent Tradeoffs in the Fair Determination of Risk ScoresManish Raghavan · 2023 · ACM eBooks
- Explainable Artificial Intelligence (XAI): Concepts and Challenges in HealthcareHulsen, Tim · 2023 · AI
- Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable ClaimsBrundage, Miles, Avin, Shahar, Wang, Jasmine, Belfield, Haydn, Krueger, Gretchen, Hadfield, Gillian, Khlaaf, Heidy, Yang, Jingying, Toner, Helen, Fong, Ruth et al. · 2020 · arXiv
- State representation learning for control: An overviewTimothée Lesort, Natalia Díaz-Rodríguez, Jean-François Goudou, David Filliat · 2018 · Neural Networks
- Deep materials informatics: Applications of deep learning in materials scienceAnkit Agrawal, Alok Choudhary · 2019 · MRS Communications
- The relationship between trust in AI and trustworthy machine learning technologiesToreini, Ehsan, Aitken, Mhairi, Coopamootoo, Kovila, Elliott, Karen, Zelaya, Carlos Gonzalez, van Moorsel, Aad · 2020 · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency
- RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical RecordsKwon, Bum Chul, Choi, Min-Je, Kim, Joanne Taery, Choi, Edward, Kim, Young Bin, Kwon, Soonwook, Sun, Jimeng, Choo, Jaegul · 2019 · IEEE Transactions on Visualization and Computer Graphics
- Layer-Wise Relevance Propagation for Explaining Deep Neural Network Decisions in MRI-Based Alzheimer's Disease ClassificationBöhle, Moritz, Eitel, Fabian, Weygandt, Martin, Ritter, Kerstin · 2019 · Frontiers in Aging Neuroscience
- Towards Reverse-Engineering Black-Box Neural NetworksOh, Seong Joon, Schiele, Bernt, Fritz, Mario · 2019 · Lecture Notes in Computer Science
- Explaining a series of models by propagating Shapley valuesHugh Chen, Scott Lundberg, Su‐In Lee · 2022 · Nature Communications
- Counterfactuals and causability in explainable artificial intelligence: Theory, algorithms, and applicationsChou, Yu-Liang, Moreira, Catarina, Bruza, Peter, Ouyang, Chun, Jorge, Joaquim · 2022 · Information Fusion
- AI in education: learner choice and fundamental rightsBerendt, Bettina, Littlejohn, Allison, Blakemore, Mike · 2020 · Learning, Media and Technology
- The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence SystemsDellermann, Dominik, Calma, Adrian, Lipusch, Nikolaus, Weber, Thorsten, Weigel, Sascha, Ebel, Philipp · 2019 · Proceedings of the Annual Hawaii International Conference on System Sciences
- Explainable Agents and Robots: Results from a Systematic Literature ReviewS. Anjomshoae, Amro Najjar, Davide Calvaresi, Kary Främling · 2019 · Adaptive Agents and Multi-Agent Systems
- Low-Cost Outdoor Air Quality Monitoring and Sensor CalibrationFrancesco Concas, Julien Mineraud, Eemil Lagerspetz, Samu Varjonen, Xiaoli Liu, Kai Puolamäki, Petteri Nurmi, Sasu Tarkoma · 2021 · ACM Transactions on Sensor Networks
- To trust or not to trust? An assessment of trust in AI-based systems: Concerns, ethics and contextsNessrine Omrani, Giorgia Rivieccio, Ugo Fiore, Francesco Schiavone, Sergio Garcia Agreda · 2022 · Technological Forecasting and Social Change
- A comprehensive survey of deep learning for time series forecasting: architectural diversity and open challengesJongseon Kim, Hyungjoon Kim, HyunGi Kim, Dongjun Lee, Sungroh Yoon · 2025 · Artificial Intelligence Review
- Algorithmic recourse: From counterfactual explanations to interventionsKarimi, Amir-Hossein, Schölkopf, Bernhard, Valera, Isabel · 2021 · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
- Explainable Reinforcement Learning: A SurveyErika Puiutta, Eric MSP Veith · 2020 · Lecture notes in computer science
- Relation between prognostics predictor evaluation metrics and local interpretability SHAP valuesMárcia Lourenço Baptista, Kai Goebel, Elsa M. P. Henriques · 2022 · Artificial Intelligence
- Neural Prototype Trees for Interpretable Fine-grained Image RecognitionNauta, Meike, van Bree, Ron, Seifert, Christin · 2021 · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Explainability fact sheetsKacper Sokol, Peter A. Flach · 2020 · ACM Conference on Fairness, Accountability, and Transparency (FAccT)
- Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information ProcessingKevin Bauer, Moritz von Zahn, Oliver Fast Hinz · 2023 · Information Systems Research
- Gradient-Based Attribution MethodsMarco Ancona, Enea Ceolini, Cengiz Öztireli, Markus H. Groß · 2019 · Lecture notes in computer science
- From knowledge-based to big data analytic model: a novel IoT and machine learning based decision support system for predictive maintenance in Industry 4.0Riccardo Rosati, Luca Romeo, Gianalberto Cecchini, Flavio Tonetto, Paolo Viti, Adriano Mancini, Emanuele Frontoni · 2022 · Journal of Intelligent Manufacturing
- Towards Human-Centered Explainable AI: A Survey of User Studies for Model ExplanationsRong, Yao, Leemann, Tobias, Nguyen, Thai-Trang, Fiedler, Lisa, Qian, Peizhu, Unhelkar, Vaibhav, Seidel, Tina, Kasneci, Gjergji, Kasneci, Enkelejda · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- Four principles of explainable artificial intelligencePhillips, P Jonathon, Hahn, Carina A, Fontana, Peter C, Yates, Amy N, Greene, Kristen, Broniatowski, David A, Przybocki, Mark A · 2021
- Socially Responsible AI Algorithms: Issues, Purposes, and ChallengesCheng, Lu, Varshney, Kush R., Liu, Huan · 2021 · Journal of Artificial Intelligence Research
- Artificial Discretion as a Tool of Governance: A Framework for Understanding the Impact of Artificial Intelligence on Public AdministrationYoung, Matthew M, Bullock, Justin B, Lecy, Jesse D · 2019 · Perspectives on Public Management and Governance
- Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?Hase, Peter, Bansal, Mohit · 2020 · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- How Much Position Information Do Convolutional Neural Networks Encode?Islam, Md Amirul, Jia, Sen, Bruce, Neil D. B. · 2020 · arXiv
- Beware explanations from AI in health careBabic, Boris, Gerke, Sara, Evgeniou, Theodoros, Cohen, I. Glenn · 2021 · Science
- To explain or not to explain?—Artificial intelligence explainability in clinical decision support systemsAmann, Julia, Vetter, Dennis, Blomberg, Stig Nikolaj, Christensen, Helle Collatz, Coffee, Megan, Gerke, Sara, Gilbert, Thomas K., Hagendorff, Thilo, Holm, Sune, Livne, Michelle et al. · 2022 · PLOS Digital Health
- Human-Centered Explainable AI: Towards a Reflective Sociotechnical ApproachEhsan, Upol, Riedl, Mark O. · 2020 · Lecture Notes in Computer Science
- Improving Robot Controller Transparency Through Autonomous Policy ExplanationBradley Hayes, Julie A. Shah · 2017 · IEEE/ACM International Conference on Human-Robot Interaction
- Explainable artificial intelligence: A survey of needs, techniques, applications, and future directionMelkamu Abay Mersha, Khang Nhứt Lâm, Joseph Wood, Ali K. AlShami, Jugal Kumar Kalita · 2024 · Neurocomputing
- Explainable Artificial Intelligence (XAI) from a user perspective: A synthesis of prior literature and problematizing avenues for future researchAKM Bahalul Haque, A.K.M. Najmul Islam, Patrick Mikalef · 2022 · Technological Forecasting and Social Change
- Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and OpportunitiesSubash Neupane, Jesse Ables, William S. Anderson, Sudip Mittal, Shahram Rahimi, Ioana Banicescu, Maria A. Seale · 2022 · IEEE Access
- Extensions of the External Validation for Checking Learned Model Interpretability and GeneralizabilityHo, Sung Yang, Phua, Kimberly, Wong, Limsoon, Bin Goh, Wilson Wen · 2020 · Patterns
- Uncovering Flooding Mechanisms Across the Contiguous United States Through Interpretive Deep Learning on Representative CatchmentsShijie Jiang, Yi Zheng, Chao Wang, Vladan Babovic · 2021 · Water Resources Research
- A comparison among interpretative proposals for Random ForestsMassimo Aria, Corrado Cuccurullo, Agostino Gnasso · 2021 · Machine Learning with Applications
- Deep Reinforcement LearningChong Li · 2019 · Chapman & Hall/CRC eBooks
- Recent Advances in Trustworthy Explainable Artificial Intelligence: Status, Challenges, and PerspectivesAtul Rawal, James McCoy, Danda B. Rawat, Brian M. Sadler, Robert St. Amant · 2021 · IEEE Transactions on Artificial Intelligence
- Machine Learning for Clinical Outcome PredictionFarah E. Shamout, Tingting Zhu, David Andrew Clifton · 2020 · IEEE Reviews in Biomedical Engineering
- Ethics & AI: A Systematic Review on Ethical Concerns and Related Strategies for Designing with AI in HealthcareFan Li, Nick Ruijs, Yuan Lü · 2022 · AI
- Causal interpretability for machine learning-problems, methods and evaluationMoraffah, Raha, Karami, Mansooreh, Guo, Ruocheng, Raglin, Adrienne, Liu, Huan · 2020 · ACM SIGKDD Explorations Newsletter
- Explainable Reinforcement Learning: A Survey and Comparative ReviewStephanie Milani, Nicholay Topin, Manuela Veloso, Fei Fang · 2023 · ACM Computing Surveys