CoChat
Sign Up
Cited by 196

Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interaction

Kim, Sunnie S. Y., Watkins, Elizabeth Anne, Russakovsky, Olga, Fong, Ruth, Monroy-Hernández, Andrés·2023·Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
DOI 10.1145/3544548.3581001
Open this paper in CoChat — free account

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3544548.3581001

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Fewer studies examine how practitioners evaluate criteria such as basic functionality, safety, privacy, or recourse, just as fewer tools exist for this purpose.

    “While there are multiple studies on the use of tools for fairness evaluation [54, 70, 119] and explainability [1, 46, 72, 82, 85, 98], fewer studies examine how practitioners evaluate other criteria such as basic functionality [117], safety, privacy, or recourse, just as fewer tools exist for this purpose.”

    From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [1]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 109

  1. Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankan- halli. 2018. Trends and Trajectories for Explainable, Accountable and Intel- ligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). Association for Computing Machinery, New York, NY, USA, 1-18. https://doi.org/10.1145/3173574.3174156 · DOI · Paper page
  2. Julius Adebayo, Justin Gilmer, Michael Muelly, Ian Goodfellow, Moritz Hardt, and Been Kim. 2018. Sanity Checks for Saliency Maps. In Neural Information Processing Systems (NeurIPS).
  3. Kasun Amarasinghe, Kit T. Rodolfa, Sérgio Jesus, Valerie Chen, Vladimir Balayan, Pedro Saleiro, Pedro Bizarro, Ameet Talwalkar, and Rayid Ghani. 2022. On the Importance of Application-Grounded Experimental Design for Evaluating Explainable ML Methods. https://doi.org/10.48550/ARXIV.2206.13503 · DOI
  4. Ines Arous, Jie Yang, Mourad Khayati, and Philippe Cudré-Mauroux. 2020. OpenCrowd: A Human-AI Collaborative Approach for Finding Social Influencers via Open-Ended Answers Aggregation. In Proceedings of The Web Conference 2020 (Taipei, Taiwan) (WWW '20). Association for Computing Machinery, New York, NY, USA, 1851-1862. https://doi.org/10.1145/3366423.3380254 · DOI
  5. Zahra Ashktorab, Q. Vera Liao, Casey Dugan, James Johnson, Qian Pan, Wei Zhang, Sadhana Kumaravel, and Murray Campbell. 2020. Human-AI Collabora- tion in a Cooperative Game Setting: Measuring Social Perception and Outcomes. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 96 (oct 2020), 20 pages. https://doi.org/10.1145/3415167 · DOI
  6. Shahin Atakishiyev, Mohammad Salameh, Hengshuai Yao, and Randy Goebel. 2021. Explainable Artificial Intelligence for Autonomous Driving: A Com- prehensive Overview and Field Guide for Future Research Directions. CoRR abs/2112.11561 (2021). arXiv:2112.11561 https://arxiv.org/abs/2112.11561 · arXiv
  7. Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, and Eric Horvitz. 2019. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. In AAAI Conference on Human Computation and Crowd- sourcing (HCOMP).
  8. David Bau, Bolei Zhou, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2017. Network Dissection: Quantifying Interpretability of Deep Visual Represen- tations. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  9. David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, and Antonio Torralba. 2019. Seeing What a GAN Cannot Generate. In International Conference on Computer Vision (ICCV).
  10. Umang Bhatt, Alice Xiang, Shubham Sharma, Adrian Weller, Ankur Taly, Yun- han Jia, Joydeep Ghosh, Ruchir Puri, José M. F. Moura, and Peter Eckersley. 2020. Explainable Machine Learning in Deployment. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Machinery, New York, NY, USA, 648-657. https://doi.org/10.1145/3351095.3375624 · DOI · Paper page
  11. Jeffrey P Bigham, Chandrika Jayant, Andrew Miller, Brandyn White, and Tom Yeh. 2010. VizWiz:: LocateIt-enabling blind people to locate objects in their environment. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, 65-72.
  12. Wieland Brendel and Matthias Bethge. 2019. Approximating CNNs with Bag-of- local-Features Models Works Surprisingly Well on ImageNet. In International Conference on Learning Representations (ICLR).
  13. Moritz Böhle, Mario Fritz, and Bernt Schiele. 2021. Convolutional Dynamic Alignment Networks for Interpretable Classifications. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  14. Moritz Böhle, Mario Fritz, and Bernt Schiele. 2022. B-cos Networks: Alignment is All We Need for Interpretability. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  15. Carrie J. Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. "Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 104 (nov 2019), 24 pages. https://doi.org/10.1145/3359206 · DOI · Paper page
  16. Chaofan Chen, Oscar Li, Daniel Tao, Alina Barnett, Cynthia Rudin, and Jonathan K Su. 2019. This Looks Like That: Deep Learning for Interpretable Image Recognition. In Neural Information Processing Systems (NeurIPS).
  17. Arun Das and Paul Rad. 2020. Opportunities and Challenges in Explainable Arti- ficial Intelligence (XAI): A Survey. CoRR abs/2006.11371 (2020). arXiv:2006.11371 https://arxiv.org/abs/2006.11371 · arXiv
  18. Jon Donnelly, Alina Jade Barnett, and Chaofan Chen. 2022. Deformable Pro- toPNet: An Interpretable Image Classifier Using Deformable Prototypes. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  19. Finale Doshi-Velez and Been Kim. 2017. Towards A Rigorous Science of Inter- pretable Machine Learning. arXiv:1702.08608 [stat.ML] · arXiv
  20. Abhimanyu Dubey, Filip Radenovic, and Dhruv Mahajan. 2022. Scalable Inter- pretability via Polynomials. In Neural Information Processing Systems (NeurIPS).
  21. Salvatore D'Avella, Gerardo Camacho-Gonzalez, and Paolo Tripicchio. 2022. On Multi-Agent Cognitive Cooperation: Can virtual agents behave like humans? Neurocomputing 480 (2022), 27-38. https://doi.org/10.1016/j.neucom.2022.01. 025 · DOI
  22. Upol Ehsan, Samir Passi, Q. Vera Liao, Larry Chan, I-Hsiang Lee, Michael J. Muller, and Mark O. Riedl. 2021. The Who in Explainable AI: How AI Back- ground Shapes Perceptions of AI Explanations. CoRR abs/2107.13509 (2021). arXiv:2107.13509 https://arxiv.org/abs/2107.13509 · arXiv
  23. Upol Ehsan and Mark O. Riedl. 2020. Human-centered Explainable AI: To- wards a Reflective Sociotechnical Approach. CoRR abs/2002.01092 (2020). arXiv:2002.01092 https://arxiv.org/abs/2002.01092 · arXiv
  24. Upol Ehsan, Philipp Wintersberger, Q. Vera Liao, Martina Mara, Marc Streit, Sandra Wachter, Andreas Riener, and Mark O. Riedl. 2021. Operationalizing Human-Centered Perspectives in Explainable AI. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA '21). Association for Computing Machinery, New York, NY, USA, Article 94, 6 pages. https://doi.org/10.1145/3411763.3441342 · DOI
  25. Upol Ehsan, Philipp Wintersberger, Q. Vera Liao, Elizabeth Anne Watkins, Carina Manger, Hal Daumé III, Andreas Riener, and Mark O Riedl. 2022. Human- Centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA '22). Association for Computing Machinery, New York, NY, USA, Article 109, 7 pages. https://doi.org/10.1145/ 3491101.3503727 · DOI · Paper page
  26. Thomas Fel, Julien Colin, Rémi Cadène, and Thomas Serre. 2021. What I Cannot Predict, I Do Not Understand: A Human-Centered Evaluation Framework for Explainability Methods. arXiv:2112.04417 [s.CV] · arXiv
  27. Andrea Ferrario and Michele Loi. 2022. How Explainability Contributes to Trust in AI. In 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT '22). Association for Computing Machinery, New York, NY, USA, 1457-1466. https://doi.org/10.1145/3531146.3533202 · DOI · Paper page
  28. Riccardo Fogliato, Shreya Chappidi, Matthew Lungren, Paul Fisher, Diane Wil- son, Michael Fitzke, Mark Parkinson, Eric Horvitz, Kori Inkpen, and Besmira Nushi. 2022. Who Goes First? Influences of Human-AI Workflow on Deci- sion Making in Clinical Imaging. In 2022 ACM Conference on Fairness, Ac- countability, and Transparency (Seoul, Republic of Korea) (FAccT '22). Asso- ciation for Computing Machinery, New York, NY, USA, 1362-1374. https: //doi.org/10.1145/3531146.3533193 · DOI
  29. Ruth Fong. 2020. Understanding convolutional neural networks. Ph. D. Disserta- tion. University of Oxford.
  30. Ruth Fong, Mandela Patrick, and Andrea Vedaldi. 2019. Understanding Deep Networks via Extremal Perturbations and Smooth Masks. In International Con- ference on Computer Vision (ICCV).
  31. Ruth Fong and Andrea Vedaldi. 2017. Interpretable Explanations of Black Boxes by Meaningful Perturbation. In International Conference on Computer Vision (ICCV).
  32. Ruth Fong and Andrea Vedaldi. 2018. Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networks. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  33. Julie Gerlings, Millie Søndergaard Jensen, and Arisa Shollo. 2021. Explainable AI, but explainable to whom? CoRR abs/2106.05568 (2021). arXiv:2106.05568 https://arxiv.org/abs/2106.05568 · arXiv
  34. Leilani H. Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. 2018. Explaining explanations: An overview of interpretability of machine learning. In The 5th IEEE International Conference on Data Science and Advanced Analytics (DSAA).
  35. Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Counterfactual Visual Explanations. In International Conference on Machine Learning (ICML).
  36. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A Survey of Methods for Explaining Black Box Models. ACM Comput. Surv. 51, 5, Article 93 (aug 2018), 42 pages. https://doi.org/10.1145/3236009 · DOI · Paper page
  37. Robert R. Hoffman, Gary Klein, and Shane T. Mueller. 2018. Explaining Ex- planation For "Explainable AI". Proceedings of the Human Factors and Er- gonomics Society Annual Meeting 62, 1 (2018), 197-201. https://doi.org/10. 1177/1541931218621047 arXiv:https://doi.org/10.1177/1541931218621047 · DOI
  38. Adrian Hoffmann, Claudio Fanconi, Rahul Rade, and Jonas Kohler. 2021. This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretabil- ity in Deep Networks. In International Conference on Machine Learning (ICML) Workshop on Theoretic Foundation, Criticism, and Application Trend of Explain- able AI.
  39. Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human- Machine Collaboration for Content Regulation: The Case of Reddit Automoder- ator. ACM Trans. Comput.-Hum. Interact. 26, 5, Article 31 (jul 2019), 35 pages. https://doi.org/10.1145/3338243 · DOI · Paper page
  40. Atoosa Kasirzadeh. 2021. Reasons, Values, Stakeholders: A Philosophical Framework for Explainable Artificial Intelligence. CoRR abs/2103.00752 (2021). arXiv:2103.00752 https://arxiv.org/abs/2103.00752 · arXiv
  41. Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, et al. 2018. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV). In ICML.
  42. Sunnie S. Y. Kim, Nicole Meister, Vikram V. Ramaswamy, Ruth Fong, and Olga Russakovsky. 2022. HIVE: Evaluating the Human Interpretability of Visual Explanations. In European Conference on Computer Vision (ECCV).
  43. Pang Wei Koh and Percy Liang. 2017. Understanding Black-box Predictions via Influence Functions. In International Conference on Machine Learning (ICML).
  44. Pang Wei Koh, Thao Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang. 2020. Concept Bottleneck Models. In International Conference on Machine Learning (ICML).
  45. Ranjay Krishna, Donsuk Lee, Li Fei-Fei, and Michael S. Bernstein. 2022. Socially situated artificial intelligence enables learning from human interaction. Proceedings of the National Academy of Sciences 119, 39 (2022), e2115730119. https://doi.org/10.1073/pnas.2115730119 arXiv:https://www.pnas.org/doi/pdf/10.1073/pnas.2115730119 · DOI
  46. Shitij Kumar, Celal Savur, and Ferat Sahin. 2021. Survey of Human-Robot Collaboration in Industrial Settings: Awareness, Intelligence, and Compliance. IEEE Transactions on Systems, Man, and Cybernetics: Systems 51, 1 (2021), 280-297. https://doi.org/10.1109/TSMC.2020.3041231 · DOI
  47. Markus Langer, Daniel Oster, Timo Speith, Holger Hermanns, Lena Kästner, Eva Schmidt, Andreas Sesing, and Kevin Baum. 2021. What Do We Want From Explainable Artificial Intelligence (XAI)? -A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research. CoRR abs/2102.07817 (2021). arXiv:2102.07817 https://arxiv.org/abs/2102.07817 · arXiv
  48. Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3313831.3376590 · DOI · Paper page
  49. Q. Vera Liao and Kush R. Varshney. 2021. Human-Centered Explainable AI (XAI): From Algorithms to User Experiences. CoRR abs/2110.10790 (2021). arXiv:2110.10790 https://arxiv.org/abs/2110.10790 · arXiv
  50. Ryan Louie, Andy Coenen, Cheng Zhi Huang, Michael Terry, and Carrie J. Cai. 2020. Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376739 · DOI · Paper page
  51. Jörn Lötsch, Dario Kringel, and Alfred Ultsch. 2022. Explainable Artificial Intel- ligence (XAI) in Biomedicine: Making AI Decisions Trustworthy for Physicians and Patients. BioMedInformatics 2, 1 (2022), 1-17. https://doi.org/10.3390/ biomedinformatics2010001 · DOI
  52. R. Machlev, L. Heistrene, M. Perl, K.Y. Levy, J. Belikov, S. Mannor, and Y. Levron. 2022. Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities. Energy and AI 9 (2022), 100169. https://doi.org/10.1016/j.egyai.2022.100169 · DOI · Paper page
  53. Antonios Mamalakis, Imme Ebert-Uphoff, and Elizabeth A. Barnes. 2022. Ex- plainable Artificial Intelligence in Meteorology and Climate Science: Model Fine- Tuning, Calibrating Trust and Learning New Science. Springer International Publishing, Cham, 315-339. https://doi.org/10.1007/978-3-031-04083-2_16 · DOI
  54. Andrei Margeloiu, Matthew Ashman, Umang Bhatt, Yanzhi Chen, Mateja Jamnik, and Adrian Weller. 2021. Do Concept Bottleneck Models Learn as Intended?. In International Conference on Learning Representations (ICLR) Workshop on Responsible AI.
  55. Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1-23.
  56. Quentin Meteier, Marine Capallera, Leonardo Angelini, Elena Mugellini, Omar Abou Khaled, Stefano Carrino, Emmanuel De Salis, Stéphane Galland, and Susanne Boll. 2019. Workshop on Explainable AI in Automated Driv- ing: A User-Centered Interaction Approach. In Proceedings of the 11th Inter- national Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI '19). Association for Computing Machinery, New York, NY, USA, 32-37. https: //doi.org/10.1145/3349263.3350762 · DOI
  57. Tim Miller. 2017. Explanation in Artificial Intelligence: Insights from the Social Sciences. CoRR abs/1706.07269 (2017). arXiv:1706.07269 http://arxiv.org/abs/ 1706.07269 · arXiv
  58. Tim Miller. 2022. Are we measuring trust correctly in explainability, inter- pretability, and transparency research? https://doi.org/10.48550/ARXIV.2209. 00651 · DOI
  59. Tim Miller, Piers Howe, and Liz Sonenberg. 2017. Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences. CoRR abs/1712.00547 (2017). arXiv:1712.00547 http://arxiv.org/abs/1712.00547 · arXiv
  60. Brent Mittelstadt, Chris Russell, and Sandra Wachter. 2019. Explaining Expla- nations in AI. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19). Association for Computing Ma- chinery, New York, NY, USA, 279-288. https://doi.org/10.1145/3287560.3287574 · DOI · Paper page
  61. Sina Mohseni, Niloofar Zarei, and Eric D. Ragan. 2018. A Survey of Eval- uation Methods and Measures for Interpretable Machine Learning. CoRR abs/1811.11839 (2018). arXiv:1811.11839 http://arxiv.org/abs/1811.11839 · arXiv
  62. Raha Moraffah, Mansooreh Karami, Ruocheng Guo, Adrienne Raglin, and Huan Liu. 2020. Causal Interpretability for Machine Learning -Problems, Methods and Evaluation. SIGKDD Explor. Newsl. 22, 1 (may 2020), 18-33. https://doi. org/10.1145/3400051.3400058 · DOI · Paper page
  63. Meike Nauta, Ron van Bree, and Christin Seifert. 2021. Neural Prototype Trees for Interpretable Fine-Grained Image Recognition. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  64. An T. Nguyen, Aditya Kharosekar, Saumyaa Krishnan, Siddhesh Krishnan, Elizabeth Tate, Byron C. Wallace, and Matthew Lease. 2018. Believe It or Not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST '18). Association for Computing Machinery, New York, NY, USA, 189-199. https://doi.org/10.1145/3242587.3242666 · DOI
  65. Giang Nguyen, Daeyoung Kim, and Anh Nguyen. 2021. The effectiveness of feature attribution methods and its correlation with automatic evaluation scores. In Neural Information Processing Systems (NeurIPS).
  66. Giang Nguyen, Mohammad Reza Taesiri, and Anh Nguyen. 2022. Visual correspondence-based explanations improve AI robustness and human-AI team accuracy. In Neural Information Processing Systems (NeurIPS).
  67. Takashi Numata, Hiroki Sato, Yasuhiro Asa, Takahiko Koike, Kohei Miyata, Eri Nakagawa, Motofumi Sumiya, and Norihiro Sadato. 2020. Achieving affective human-virtual agent communication by enabling virtual agents to imitate positive expressions. Scientific Reports 10, 1 (2020), 5977. https://doi.org/10. 1038/s41598-020-62870-7 · DOI
  68. Uchenna Emeoha Ogenyi, Jinguo Liu, Chenguang Yang, Zhaojie Ju, and Honghai Liu. 2021. Physical Human-Robot Collaboration: Robotic Systems, Learning Methods, Collaborative Strategies, Sensors, and Actuators. IEEE Transactions on Cybernetics 51, 4 (2021), 1888-1901. https://doi.org/10.1109/TCYB.2019.2947532 · DOI
  69. Daniel Omeiza, Helena Webb, Marina Jirotka, and Lars Kunze. 2022. Expla- nations in Autonomous Driving: A Survey. IEEE Transactions on Intelligent Transportation Systems 23, 8 (2022), 10142-10162. https://doi.org/10.1109/TITS. 2021.3122865 · DOI · Paper page
  70. Thomas O'Neill, Nathan McNeese, Amy Barron, and Beau Schelble. 2022. Hu- man-Autonomy Teaming: A Review and Analysis of the Empirical Literature. Human Factors 64, 5 (2022), 904-938. https://doi.org/10.1177/0018720820960865 arXiv:https://doi.org/10.1177/0018720820960865 PMID: 33092417. · DOI
  71. Michael Pazzani, Severine Soltani, Robert Kaufman, Samson Qian, and Albert Hsiao. 2022. Expert-Informed, User-Centric Explanations for Machine Learning. Proceedings of the AAAI Conference on Artificial Intelligence 36, 11 (Jun. 2022), 12280-12286. https://doi.org/10.1609/aaai.v36i11.21491 · DOI
  72. Dino Pedreschi, Fosca Giannotti, Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, and Franco Turini. 2019. Meaningful Explanations of Black Box AI Decision Systems. Proceedings of the AAAI Conference on Artificial Intelligence 33, 01 (Jul. 2019), 9780-9784. https://doi.org/10.1609/aaai.v33i01.33019780 · DOI
  73. Vitali Petsiuk, Abir Das, and Kate Saenko. 2018. RISE: Randomized Input Sam- pling for Explanation of Black-box Models. In British Machine Vision Conference (BMVC).
  74. Barbara Pintar. 2017. Birdadvisor 360°: A digital support for birdwatching tourism in Algarve. Ph. D. Dissertation. University of Algarve.
  75. Milda Pocevičiūtė, Gabriel Eilertsen, and Claes Lundström. 2020. Survey of XAI in Digital Pathology. Springer International Publishing, Cham, 56-88. https://doi.org/10.1007/978-3-030-50402-1_4 · DOI
  76. Alun D. Preece, Dan Harborne, Dave Braines, Richard Tomsett, and Supriyo Chakraborty. 2018. Stakeholders in Explainable AI. CoRR abs/1810.00184 (2018). arXiv:1810.00184 http://arxiv.org/abs/1810.00184 · arXiv
  77. Filip Radenovic, Abhimanyu Dubey, and Dhruv Mahajan. 2022. Neural Basis Models for Interpretability. In Neural Information Processing Systems (NeurIPS).
  78. Vikram V. Ramaswamy, Sunnie S. Y. Kim, Ruth Fong, and Olga Russakovsky. 2022. Overlooked factors in concept-based explanations: Dataset choice, concept salience, and human capability. https://doi.org/10.48550/ARXIV.2207.09615 · DOI
  79. Vikram V. Ramaswamy, Sunnie S. Y. Kim, Nicole Meister, Ruth Fong, and Olga Russakovsky. 2022. ELUDE: Generating interpretable explanations via a decom- position into labelled and unlabelled features. https://doi.org/10.48550/ARXIV. 2206.07690 · DOI
  80. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why Should I Trust You?": Explaining the Predictions of Any Classifier. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD).
  81. Cynthia Rudin, Chaofan Chen, Zhi Chen, Haiyang Huang, Lesia Semenova, and Chudi Zhong. 2022. Interpretable machine learning: Fundamental principles and 10 grand challenges. Statistics Surveys 16, none (2022), 1 -85. https: //doi.org/10.1214/21-SS133 · DOI · Paper page
  82. Wojciech Samek, Grégoire Montavon, Andrea Vedaldi, Lars Kai Hansen, and Klaus-Robert Müller (Eds.). 2019. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Lecture Notes in Computer Science, Vol. 11700. Springer.
  83. Lindsay Sanneman and Julie A. Shah. 2020. A Situation Awareness-Based Frame- work for Design and Evaluation of Explainable AI. In Explainable, Transparent Autonomous Agents and Multi-Agent Systems, Davide Calvaresi, Amro Najjar, Michael Winikoff, and Kary Främling (Eds.). Springer International Publishing, Cham, 94-110.
  84. Nicolas Scharowski, Sebastian A. C. Perrig, Nick von Felten, and Florian Brühlmann. 2022. Trust and Reliance in XAI -Distinguishing Between Attitu- dinal and Behavioral Measures. https://doi.org/10.48550/ARXIV.2203.12318 · DOI · Paper page
  85. Ramprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-CAM: Visual Expla- nations From Deep Networks via Gradient-Based Localization. In International Conference on Computer Vision (ICCV).
  86. Mark Sendak, Madeleine Clare Elish, Michael Gao, Joseph Futoma, William Ratliff, Marshall Nichols, Armando Bedoya, Suresh Balu, and Cara O'Brien. 2020. "The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (Barcelona, Spain) (FAT* '20). Association for Computing Ma- chinery, New York, NY, USA, 99-109. https://doi.org/10.1145/3351095.3372827 · DOI · Paper page
  87. Hua Shen and Ting-Hao Kenneth Huang. 2020. How Useful Are the Machine- Generated Interpretations to General Users? A Human Evaluation on Guessing the Incorrectly Predicted Labels. In AAAI Conference on Human Computation and Crowdsourcing (HCOMP).
  88. Vivswan Shitole, Fuxin Li, Minsuk Kahng, Prasad Tadepalli, and Alan Fern. 2021. One Explanation is Not Enough: Structured Attention Graphs for Image Classification. In Neural Information Processing Systems (NeurIPS).
  89. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. In International Conference on Learning Representations (ICLR) Workshops.
  90. Amitojdeep Singh, Sourya Sengupta, and Vasudevan Lakshminarayanan. 2020. Explainable Deep Learning Models in Medical Image Analysis. Journal of Imaging 6 (2020). https://doi.org/10.3390/jimaging6060052 · DOI · Paper page
  91. Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju, and Sameer Singh. 2022. TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations. arXiv (2022).
  92. Alison Smith-Renner, Ron Fan, Melissa Birchfield, Tongshuang Wu, Jordan Boyd- Graber, Daniel S. Weld, and Leah Findlater. 2020. No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive ML. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376624 · DOI · Paper page
  93. Ramya Srinivasan and Ajay Chander. 2020. Explanation Perspectives from the Cognitive Sciences-A Survey. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, Christian Bessiere (Ed.). International Joint Conferences on Artificial Intelligence Organization, 4812- 4818. https://doi.org/10.24963/ijcai.2020/670 Survey track. · DOI
  94. J. Eric T. Taylor and Graham W. Taylor. 2018. Artificial cognition: How experi- mental psychology can help generate explainable artificial intelligence. Psycho- nomic Bulletin & Review 28, 2 (2018), 454-475. https://doi.org/10.3758/s13423- 020-01825-5 · DOI
  95. Richard Tomsett, Dave Braines, Dan Harborne, Alun D. Preece, and Supriyo Chakraborty. 2018. Interpretable to Whom? A Role-based Model for Ana- lyzing Interpretable Machine Learning Systems. CoRR abs/1806.07552 (2018). arXiv:1806.07552 http://arxiv.org/abs/1806.07552 · arXiv
  96. Sana Tonekaboni, Shalmali Joshi, Melissa D. McCradden, and Anna Goldenberg. 2019. What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use. In Proceedings of the 4th Machine Learning for Healthcare Conference (Proceedings of Machine Learning Research, Vol. 106), Finale Doshi- Velez, Jim Fackler, Ken Jung, David Kale, Rajesh Ranganath, Byron Wallace, and Jenna Wiens (Eds.). PMLR, 359-380. https://proceedings.mlr.press/v106/ tonekaboni19a.html
  97. Philipp Tschandl, Christoph Rinner, Zoe Apalla, Giuseppe Argenziano, Noel Codella, Allan Halpern, Monika Janda, Aimilios Lallas, Caterina Longo, Josep Malvehy, John Paoli, Susana Puig, Cliff Rosendahl, H. Peter Soyer, Iris Zalaudek, and Harald Kittler. 2020. Human-computer collaboration for skin cancer recog- nition. Nature Medicine 26, 8 (2020), 1229-1234. https://doi.org/10.1038/s41591- 020-0942-0 · DOI · Paper page
  98. Simon Vandenhende, Dhruv Mahajan, Filip Radenovic, and Deepti Ghadiyaram. 2022. Making Heads or Tails: Towards Semantically Consistent Visual Counter- factuals. In European Conference on Computer Vision (ECCV).
  99. Valeria Villani, Fabio Pini, Francesco Leali, and Cristian Secchi. 2018. Survey on human-robot collaboration in industrial settings: Safety, intuitive interfaces and applications. Mechatronics 55 (2018), 248-266. https://doi.org/10.1016/j. mechatronics.2018.02.009 · DOI
  100. Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing Theory-Driven User-Centric Explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3290605.3300831 · DOI · Paper page
  101. Pei Wang and Nuno Vasconcelos. 2020. SCOUT: Self-Aware Discriminant Counterfactual Explanations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  102. Guang Yang, Qinghao Ye, and Jun Xia. 2022. Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini- review, two showcases and beyond. Information Fusion 77 (2022), 29-52. https: //doi.org/10.1016/j.inffus.2021.07.016 · DOI · Paper page
  103. Chih-Kuan Yeh, Joon Kim, Ian En-Hsu Yen, and Pradeep K Ravikumar. 2018. Representer Point Selection for Explaining Deep Neural Networks. In Neural Information Processing Systems (NeurIPS).
  104. Matthew D Zeiler and Rob Fergus. 2014. Visualizing and understanding convo- lutional networks. In European Conference on Computer Vision (ECCV).
  105. Wencan Zhang and Brian Y Lim. 2022. Towards Relatable Explainable AI with the Perceptual Process. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 181, 24 pages. https: //doi.org/10.1145/3491102.3501826 · DOI · Paper page
  106. Yiming Zhang, Ying Weng, and Jonathan Lund. 2022. Applications of Explainable Artificial Intelligence in Diagnosis and Surgery. Diagnostics 12, 2 (2022). https: //doi.org/10.3390/diagnostics12020237 · DOI · Paper page
  107. Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tong- shuang Wu, Mo Yu, Dakuo Wang, and Toby Jia-Jun Li. 2022. StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI '22). Asso- ciation for Computing Machinery, New York, NY, USA, Article 218, 21 pages. https://doi.org/10.1145/3491102.3517479 · DOI · Paper page
  108. Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. 2016. Learning Deep Features for Discriminative Localization. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  109. Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba. 2018. Interpretable basis decomposition for visual explanation. In European Conference on Computer Vision (ECCV).

Cited by

Sorted by citations

Authors
Kim, S. S. Y., Watkins, E. A., Russakovsky, O., Fong, R., & Monroy-Hernández, A.
Venue
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2023-04-19
Pages
1-17
DOI
10.1145/3544548.3581001
Cited by
196
References
22
Licence
creativecommons.org/licenses/by/4.0/ (vor)
Funders
  • Open Philanthropy Project
  • Princeton SEAS Howard B. Wentz, Jr. Junior Faculty Award
  • NSF (National Science Foundation) (1763642)
  • NSF Graduate Research Fellowship
  • Princeton Center for Information Technology Policy
  • Princeton SEAS Project X Fund

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review