The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery.

Lipton, Zachary C.·2018·Queue
DOI 10.1145/3236386.3241340

Cited by (1,050)

Items 301–400 of 1,050

  1. General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models
    Molnar, Christoph, König, Gunnar, Herbinger, Julia, Freiesleben, Timo, Dandl, Susanne, Scholbeck, Christian A., Casalicchio, Giuseppe, Grosse-Wentrup, Moritz, Bischl, Bernd · 2022 · Lecture Notes in Computer Science
  2. Explainable artificial intelligence (XAI): Precepts, models, and opportunities for research in construction
    Peter E.D. Love, Weili Fang, Jane Matthews, Stuart R. Porter, Hanbin Luo, Lieyun Ding · 2023 · Advanced Engineering Informatics
  3. The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support
    Steiger, Miriah, Bharucha, Timir J, Venkatagiri, Sukrit, Riedl, Martin J., Lease, Matthew · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
  4. A survey on artificial intelligence (ai) and explainable ai in air traffic management: current trends and development with future research trajectory
    Degas, Augustin, Islam, Mir Riyanul, Hurter, Christophe, Barua, Shaibal, Rahman, Hamidur, Poudel, Minesh, Ruscio, Daniele, Ahmed, Mobyen Uddin, Begum, Shahina, Rahman, Md Aquif et al. · 2022 · Applied Sciences
  5. Explainable Artificial Intelligence (XAI) in Auditing: A Framework and Research Needs
    Chanyuan Zhang, Soohyun Cho, Miklos Antal Vasarhelyi · 2021 · International Journal of Accounting Information Systems
  6. Explainable Artificial Intelligence by Genetic Programming: A Survey
    Yi Mei, Qi Chen, Andrew Lensen, Bing Xue, Mengjie Zhang · 2022 · IEEE Transactions on Evolutionary Computation
  7. In the Land of the Blind, the One-Eyed Man Is King: Knowledge Brokerage in the Age of Learning Algorithms
    Waardenburg, Lauren, Huysman, Marleen, Sergeeva, Anastasia V. · 2022 · Organization Science
  8. Agent Transparency, Situation Awareness, Mental Workload, and Operator Performance: A Systematic Literature Review
    Koen van de Merwe, Steven Mallam, Salman Nazir · 2022 · Human Factors The Journal of the Human Factors and Ergonomics Society
  9. Interpretable and explainable machine learning: A methods‐centric overview with concrete examples
    Ričards Marcinkevičs, Julia Elisabeth Vogt · 2023 · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery
  10. Predicting Outcome of Endovascular Treatment for Acute Ischemic Stroke: Potential Value of Machine Learning Algorithms
    Hendrikus J. A. van Os, Lucas A. Ramos, Adam Hilbert, Matthijs van Leeuwen, Marianne A.A. van Walderveen, Nyika D. Kruyt, Diederik W.J. Dippel, Ewout Willem Steyerberg, Irene C. van der Schaaf, Hester Floor Lingsma et al. · 2018 · Frontiers in Neurology
  11. Explainable Deep Reinforcement Learning: State of the Art and Challenges
    George A. Vouros · 2022 · ACM Computing Surveys
  12. Evaluating saliency map explanations for convolutional neural networks: a user study
    Alqaraawi, Ahmed, Schuessler, Martin, Weiß, Philipp, Costanza, Enrico, Berthouze, Nadia · 2020 · Proceedings of the 25th International Conference on Intelligent User Interfaces
  13. Applying deep learning to the newsvendor problem
    Afshin Oroojlooyjadid, Lawrence Snyder, Martin Takáč · 2019 · IISE Transactions
  14. How Explainability Contributes to Trust in AI
    Ferrario, Andrea, Loi, Michele · 2022 · 2022 ACM Conference on Fairness Accountability and Transparency
  15. Interpretability of Clinical Decision Support Systems Based on Artificial Intelligence from Technological and Medical Perspective: A Systematic Review
    Qian Xu, Wenzhao Xie, Bolin Liao, Chao Hu, Lu Qin, Zhengzijin Yang, Huan Xiong, Lyu Yi, Yue Zhou, Aijing Luo · 2023 · Journal of Healthcare Engineering
  16. 'It's Reducing a Human Being to a Percentage'; Perceptions of Justice in Algorithmic Decisions
    2018
  17. ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases
    Pierre Stock, Moustapha Cissé · 2018 · Lecture notes in computer science
  18. Bridging the Gap Between AI and Explainability in the GDPR: Towards Trustworthiness-by-Design in Automated Decision-Making
    Ronan Hamon, H. Junklewitz, Ignacio Sanchez, Gianclaudio Malgieri, Paul De Hert · 2022 · IEEE Computational Intelligence Magazine
  19. Applications of Deep Learning to Neuro-Imaging Techniques
    Guangming Zhu, Bin Jiang, Liz Tong, Yuan Xie, Greg Zaharchuk, Max Wintermark · 2019 · Frontiers in Neurology
  20. If Only We Had Better Counterfactual Explanations: Five Key Deficits to Rectify in the Evaluation of Counterfactual XAI Techniques
    Mark T. Keane, Eoin M. Kenny, Eoin D. Delaney, Barry Smyth · 2021 · International Joint Conference on Artificial Intelligence
  21. SOPHIA: An Event-Based IoT and Machine Learning Architecture for Predictive Maintenance in Industry 4.0
    Calabrese, Matteo, Cimmino, Martin, Fiume, Francesca, Manfrin, Martina, Romeo, Luca, Ceccacci, Silvia, Paolanti, Marina, Toscano, Giuseppe, Ciandrini, Giovanni, Carrotta, Alberto et al. · 2020 · Information
  22. Neural Machine Reading Comprehension: Methods and Trends
    Shanshan Liu, Xin Zhang, Sheng Zhang, Hui Wang, Weiming Zhang · 2019 · Applied Sciences
  23. Capturing the Style of Fake News
    Piotr Przybyła · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  24. Algorithm Supported Induction for Building Theory: How Can We Use Prediction Models to Theorize?
    Yash Raj Shrestha, Vivianna Fang He, Phanish Puranam, Georg von Krogh · 2020 · Organization Science
  25. Scoring Functions for Protein-Ligand Binding Affinity Prediction Using Structure-based Deep Learning: A Review
    Rocco Meli, Garrett M. Morris, Philip Charles Biggin · 2022 · Frontiers in Bioinformatics
  26. Programmatically Interpretable Reinforcement Learning
    Abhinav Verma, Vijayaraghavan Murali, Rishabh Singh, Pushmeet Kohli, Swarat Chaudhuri · 2018 · arXiv (Cornell University)
  27. The elephant in the interpretability room: Why use attention as explanation when we have saliency methods?
    Jasmijn Bastings, Katja Filippova · 2020 · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP)
  28. A comprehensive analysis of the role of artificial intelligence and machine learning in modern digital forensics and incident response
    Dipo Dunsin, Mohamed Chahine Ghanem, Karim Ouazzane, Vassil Vassilev · 2024 · Forensic Science International Digital Investigation
  29. Explainable AI in Industry
    Krishna Gade, Sahin Cem Geyik, Krishnaram Kenthapadi, Varun Mithal, Ankur Taly · 2019 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  30. Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies
    Feng Xie, Han Yuan, Yilin Ning, Marcus Eng Hock Ong, Mengling Feng, Wynne Hsu, Bibhas Chakraborty, Nan Liu · 2021 · Journal of Biomedical Informatics
  31. Explainable Artificial Intelligence for Neuroscience: Behavioral Neurostimulation
    Jean‐Marc Fellous, Guillermo Sapiro, Andrew F. Rossi, Helen Mayberg, Michele Ferrante · 2019 · Frontiers in Neuroscience
  32. Classification of Explainable Artificial Intelligence Methods through Their Output Formats
    Giulia Vilone, Luca Longo · 2021 · Machine Learning and Knowledge Extraction
  33. Ethical Dimensions of Visualization Research
    Correll, Michael · 2019 · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
  34. Machine learning for nanoplasmonics
    Jean‐François Masson, John Simeon Biggins, Emilie Ringe · 2023 · Nature Nanotechnology
  35. Ethical machines: The human-centric use of artificial intelligence
    Lepri, Bruno, Oliver, Nuria, Pentland, Alex · 2021 · iScience
  36. An Empirical Study of Model-Agnostic Techniques for Defect Prediction Models
    Jiarpakdee, Jirayus, Tantithamthavorn, Chakkrit Kla, Dam, Hoa Khanh, Grundy, John · 2022 · IEEE Transactions on Software Engineering
  37. Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)
    Mark T. Keane, Barry Smyth · 2020 · Lecture notes in computer science
  38. Interpretable vs. noninterpretable machine learning models for data-driven hydro-climatological process modeling
    Debaditya Chakraborty, Hakan Başağaoğlu, James R. Winterle · 2020 · Expert Systems with Applications
  39. Ethical Framework for Harnessing the Power of AI in Healthcare and Beyond
    Nasir, Sidra, Khan, Rizwan Ahmed, Bai, Samita · 2024 · IEEE Access
  40. Using Machine Learning to Predict Complications in Pregnancy: A Systematic Review
    Ayleen Bertini, Rodrigo Salas, Stéren Chabert, Luis Sobrevía, Fabián Pardo · 2022 · Frontiers in Bioengineering and Biotechnology
  41. Artificial intelligence and ethics within the food sector: Developing a common language for technology adoption across the supply chain
    Louise Manning, Steve Brewer, Peter J. Craigon, Jeremy Graham Frey, Anabel Gutiérrez, Naomi Jane Jacobs, Samantha Kanza, Samuel Munday, Justin Sacks, Simon Pearson · 2022 · Trends in Food Science & Technology
  42. Learning the PE Header, Malware Detection with Minimal Domain Knowledge
    Edward Raff, Jared Sylvester, Charles Nicholas · 2017 · ACM Workshop on Artificial Intelligence and Security (AISec)
  43. A Yolo-Based Model for Breast Cancer Detection in Mammograms
    Francesco Prinzi, Marco Insalaco, Alessia Angela Maria Orlando, Salvatore Gaglio, Salvatore Vitabile · 2023 · Cognitive Computation
  44. Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
    Chen, Valerie, Liao, Q. Vera, Wortman Vaughan, Jennifer, Bansal, Gagan · 2023 · Proceedings of the ACM on Human-Computer Interaction
  45. A Review of Explainable Deep Learning Cancer Detection Models in Medical Imaging
    Mehmet Akif Gulum, Christopher M. Trombley, Mehmed M. Kantardzic · 2021 · Applied Sciences
  46. Multimodal Video Sentiment Analysis Using Deep Learning Approaches, a Survey
    Sarah A. Abdu, Ahmed Hassan Yousef, Ashraf Salem · 2021 · Information Fusion
  47. Explaining deep neural networks: A survey on the global interpretation methods
    Rabia Saleem, Bo Yuan, Fatih Kurugöllü, Ashiq Anjum, Lu Liu · 2022 · Neurocomputing
  48. Deep Learning for Automatic Vision-Based Recognition of Industrial Surface Defects: A Survey
    Michela Prunella, Roberto Maria Scardigno, Domenico Buongiorno, Antonio Brunetti, Nicola Longo, Raffaele Carli, Mariagrazia Dotoli, Vitoantonio Bevilacqua · 2023 · IEEE Access
  49. Understanding artificial intelligence ethics and safety
    David Leslie · 2019 · arXiv (Cornell University)
  50. It's complicated: the relationship between user trust, model accuracy and explanations in AI
    Papenmeier, Andrea, Kern, Dagmar, Englebienne, Gwenn, Seifert, Christin · 2022 · ACM Transactions on Computer-Human Interaction
  51. XAI Framework for Cardiovascular Disease Prediction Using Classification Techniques
    Pratiyush Guleria, Parvathaneni Naga Srinivasu, Shakeel Ahmed, Naif Almusallam, Fawaz Khaled Alarfaj · 2022 · Electronics
  52. Toward Explainable Artificial Intelligence for Precision Pathology
    Frederick Klauschen, Jonas Dippel, Philipp Keyl, Philipp Sebastian Jurmeister, Michael Ludwig Bockmayr, Andreas Möck, Oliver Buchstab, Maximilian Alber, Lukas Ruff, Grégoire Montavon et al. · 2023 · Annual Review of Pathology Mechanisms of Disease
  53. Quantum-inspired multimodal fusion for video sentiment analysis
    Li, Qiuchi, Gkoumas, Dimitris, Lioma, Christina, Melucci, Massimo · 2021 · Information Fusion
  54. Model agnostic generation of counterfactual explanations for molecules
    Wellawatte, Geemi P., Seshadri, Aditi, White, Andrew D. · 2022 · Chemical Science
  55. Using Machine Learning to Examine Impact of Type of Performance Indicator on Flexible Pavement Deterioration Modeling
    S. Madeh Piryonesi, Tamer E. El-Diraby · 2021 · Journal of Infrastructure Systems
  56. AI methods in materials design, discovery and manufacturing: A review
    Ioannis Papadimitriou, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Yiannis Kompatsiaris · 2024 · Computational Materials Science
  57. Exploring Two-Dimensional Materials Thermodynamic Stability via Machine Learning
    Gabriel Ravanhani Schleder, Carlos Mera Acosta, A. Fazzio · 2019 · ACS Applied Materials & Interfaces
  58. Exploding the myths: An introduction to artificial neural networks for prediction and forecasting
    Holger Robert Maier, Stefano Galelli, Saman Razavi, Andrea Francesco Castelletti, Andrea Emilio Rizzoli, Ioannis N. Athanasiadis, Miquel Sànchez–Marrè, Marco Acutis, Wenyan Wu, Greer B. Humphrey · 2023 · Environmental Modelling & Software
  59. Scanpath modeling and classification with hidden Markov models
    Antoine Coutrot, Janet H. Hsiao, Antoni B. Chan · 2017 · Behavior Research Methods
  60. Explainable software analytics
    Hoa Khanh Dam, Truyen Tran, Aditya Ghose · 2018 · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER)
  61. Forecasting remaining useful life: Interpretable deep learning approach via variational Bayesian inferences
    Mathias Kraus, Stefan Feuerriegel · 2019 · Decision Support Systems
  62. Interpretable Charge Predictions for Criminal Cases: Learning to Generate Court Views from Fact Descriptions
    Hai Ye, Xin Jiang, Zhunchen Luo, Wenhan Chao · 2018 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  63. Critical appraisal of artificial intelligence-based prediction models for cardiovascular disease
    M. van Smeden, Georg Heinze, B. van Calster, F. Asselbergs, P. Vardas, N. Bruining, P. de Jaegere, Jason H. Moore, Spiros C. Denaxas, Anne-Laure Boulesteix et al. · 2022 · European Heart Journal
  64. A systematic review on the integration of explainable artificial intelligence in intrusion detection systems to enhancing transparency and interpretability in cybersecurity
    Vincent Zibi Mohale, Ibidun Christiana Obagbuwa · 2025 · Frontiers in Artificial Intelligence
  65. Exploring Interpretable LSTM Neural Networks over Multi-Variable Data
    Tian Guo, Tao Lin, Nino Antulov-Fantulin · 2019 · arXiv (Cornell University)
  66. I Think I Get Your Point, AI! The Illusion of Explanatory Depth in Explainable AI
    Chromik, Michael, Eiband, Malin, Buchner, Felicitas, Krüger, Adrian, Butz, Andreas · 2021 · 26th International Conference on Intelligent User Interfaces
  67. Learning to Faithfully Rationalize by Construction
    Sarthak Jain, Sarah Wiegreffe, Yuval Pinter, Byron Wallace · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  68. Implementing machine learning in medicine
    Amol A. Verma, Joshua Murray, Russell Greiner, Joseph Cohen, Kaveh G Shojania, Marzyeh Ghassemi, Sharon Elizabeth Straus, Chloé Pou-Prom, Muhammad Mamdani · 2021 · Canadian Medical Association Journal
  69. Automatic sleep staging of EEG signals: recent development, challenges, and future directions
    Huy Phan, Kaare B. Mikkelsen · 2022 · Physiological Measurement
  70. DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning
    Qiyuan Tian, Berkin Bilgiç, Qiuyun Fan, Congyu Liao, Chanon Ngamsombat, Yuxin Hu, Thomas Witzel, Kawin Setsompop, Jon̈athan R. Polimeni, Susie Y. Huang · 2020 · NeuroImage
  71. Contemporary Symbolic Regression Methods and their Relative Performance
    William La Cava, Patryk Orzechowski, Bogdan Burlacu, Fabrício Olivetti de França, Marco Virgolin, Jin, Ying, Michael Kommenda, Jason H. Moore · 2021 · PubMed
  72. Four Principles of Explainable Artificial Intelligence
    Phillips, P. Jonathon, Hahn, Carina A., Fontana, Peter C., Broniatowski, David A., Przybocki, Mark A. · 2020
  73. Improving Model-Based Genetic Programming for Symbolic Regression of Small Expressions
    M. Virgolin, Tanja Alderliesten, Cees Witteveen, Peter A. N. Bosman · 2020 · Evolutionary Computation
  74. Artificial intelligence explainability: the technical and ethical dimensions
    McDermid, John A., Jia, Yan, Porter, Zoe, Habli, Ibrahim · 2021 · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
  75. Introducing a multi-stakeholder perspective on opacity, transparency and strategies to reduce opacity in algorithm-based human resource management
    Markus Langer, Cornelius J. König · 2021 · Human Resource Management Review
  76. Using machine learning as a surrogate model for agent-based simulations
    Claudio Angione, Eric Silverman, Elisabeth Yaneske · 2022 · PLoS ONE
  77. A comprehensive review on financial explainable AI
    Wei Jie Yeo, Wihan van der Heever, Rui Mao, Erik Cambria, Ranjan Satapathy, Gianmarco Mengaldo · 2025 · Artificial Intelligence Review
  78. Explainable Artificial Intelligence for Tabular Data: A Survey
    Sahakyan, Maria, Aung, Zeyar, Rahwan, Talal · 2021 · IEEE Access
  79. The explainability paradox: Challenges for xAI in digital pathology
    Evans, Theodore, Retzlaff, Carl Orge, Geißler, Christian, Kargl, Michaela, Plass, Markus, Müller, Heimo, Kiehl, Tim-Rasmus, Zerbe, Norman, Holzinger, Andreas · 2022 · Future Generation Computer Systems
  80. Interpretable Machine Learning: A brief survey from the predictive maintenance perspective
    Simon Vollert, Martin Atzmueller, Andreas Theissler · 2021 · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA)
  81. Applying Deep Learning to Medical Imaging: A Review
    Huan Huan Zhang, Yufei Qie · 2023 · Applied Sciences
  82. Eight Things to Know about Large Language Models
    Samuel R. Bowman · 2024 · Critical AI
  83. Can we do better explanations? A proposal of user-centered explainable AI
    Mireia Ribera, Àgata Lapedriza · 2019 · IUI Workshops
  84. A Review of Interpretable ML in Healthcare: Taxonomy, Applications, Challenges, and Future Directions
    Talal A. A. Abdullah, Mohd Soperi Mohd Zahid, Waleed Ali · 2021 · Symmetry
  85. Explainability and Interpretability in Electric Load Forecasting Using Machine Learning Techniques – A Review
    Lukas Baur, Konstantin Ditschuneit, Maximilian Schambach, Can Kaymakci, Thomas Wollmann, Alexander Sauer · 2024 · Energy and AI
  86. Toward Explainable Deep Neural Network Based Anomaly Detection
    Kasun Amarasinghe, Kevin Kenney, Milos Manic · 2018 · Conference on Human System Interactions
  87. The Impact of Feature Importance Methods on the Interpretation of Defect Classifiers
    Gopi Krishnan Rajbahadur, Shaowei Wang, Gustavo A. Oliva, Yasutaka Kamei, Ahmed E. Hassan · 2021 · IEEE Transactions on Software Engineering
  88. AI Anxiety: a comprehensive analysis of psychological factors and interventions
    Jeff J. H. Kim, Jun Young Soh, Shrinidhi Kadkol, Itay Solomon, Hyelin Yeh, Adith V. Srivatsa, George Ronald Nahass, Jeong Yun Choi, Sophie Lee, Theresa Nyugen et al. · 2025 · AI and Ethics
  89. Predicting the mechanical response of oligocrystals with deep learning
    Ari Frankel, Reese E. Jones, Coleman N. Alleman, Jeremy Alan Templeton · 2019 · Computational Materials Science
  90. A Survey on Explainable Anomaly Detection
    Li, Zhong, Zhu, Yuxuan, Van Leeuwen, Matthijs · 2024 · ACM Transactions on Knowledge Discovery from Data
  91. Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
    Benjamin, Jesse Josua, Berger, Arne, Merrill, Nick, Pierce, James · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
  92. Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research
    Jennifer Wortman Vaughan · 2018 · Journal of Machine Learning Research
  93. Evaluation of post-hoc interpretability methods in time-series classification
    Hugues Turbé, Mina Bjelogrlic, Christian Lovis, Gianmarco Mengaldo · 2023 · Nature Machine Intelligence
  94. How Cognitive Biases Affect XAI-assisted Decision-making: A Systematic Review
    Bertrand, Astrid, Belloum, Rafik, Eagan, James R., Maxwell, Winston · 2022 · Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society
  95. Fairness in Machine Learning: A Survey
    Caton, Simon, Haas, Christian · 2020 · arXiv
  96. Towards Faithful Model Explanation in NLP: A Survey
    Qing Lyu, Marianna Apidianaki, Chris Callison-Burch · 2024 · Computational Linguistics
  97. Co-design of human-centered, explainable AI for clinical decision support
    Panigutti, Cecilia, Beretta, Andrea, Fadda, Daniele, Giannotti, Fosca, Pedreschi, Dino, Perotti, Alan, Rinzivillo, Salvatore · 2023 · ACM Transactions on Interactive Intelligent Systems
  98. What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models
    Fahim Dalvi, Nadir Durrani, Hassan Sajjad, Yonatan Belinkov, Anthony Bau, James Robert Glass · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  99. From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices
    Jessica Morley, Luciano Floridi, Libby Kinsey, Anat Elhalal · 2021 · Philosophical studies series
  100. CellBox: Interpretable Machine Learning for Perturbation Biology with Application to the Design of Cancer Combination Therapy
    Bo Yuan, Ciyue Shen, Augustin Luna, Anil Korkut, Debora S. Marks, John Ingraham, Chris Sander · 2020 · Cell Systems