CoChat
Sign Up
Cited by 59

On Selective, Mutable and Dialogic XAI: a Review of What Users Say about Different Types of Interactive Explanations

Bertrand, Astrid, Viard, Tiphaine, Belloum, Rafik, Eagan, James R., Maxwell, Winston·2023·Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
DOI 10.1145/3544548.3581314
Open this paper in CoChat — free account

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3544548.3581314

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Fewer studies examine how practitioners evaluate criteria such as basic functionality, safety, privacy, or recourse, just as fewer tools exist for this purpose.

    “While there are multiple studies on the use of tools for fairness evaluation [54, 70, 119] and explainability [1, 46, 72, 82, 85, 98], fewer studies examine how practitioners evaluate other criteria such as basic functionality [117], safety, privacy, or recourse, just as fewer tools exist for this purpose.”

    From Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling (2025) · cites this paper as [85]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 103

  1. Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankan- halli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1-18. https://doi.org/10.1145/3173574.3174156 · DOI · Paper page
  2. Sabbir Ahmad, Andy Bryant, Erica Kleinman, Zhaoqing Teng, Truong-Huy D. Nguyen, and Magy Seif El-Nasr. 2019. Modeling Individual and Team Behavior through Spatio-temporal Analysis. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '19). Association for Computing Machinery, New York, NY, USA, 601-612. https://doi.org/10.1145/3311350. 3347188 · DOI
  3. Yongsu Ahn, Muheng Yan, Yu-Ru Lin, Wen-Ting Chung, and Rebecca Hwa. 2022. Tribe or Not? Critical Inspection of Group Diferences Using TribalGram. ACM Transactions on Interactive Intelligent Systems 12, 1 (March 2022), 5:1-5:34. https://doi.org/10.1145/3484509 · DOI
  4. R. Amar, J. Eagan, and J. Stasko. 2005. Low-level components of analytic activity in information visualization. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005. IEEE, Minneapolis MN USA, 111-117. https://doi.org/10. 1109/INFVIS.2005.1532136 ISSN: 1522-404X. · DOI
  5. Hilary Arksey and Lisa O'Malley. 2005. Scoping studies: towards a method- ological framework. International Journal of Social Research Methodology 8, 1 (Feb. 2005), 19-32. https://doi.org/10.1080/1364557032000119616 Publisher: Routledge _eprint: https://doi.org/10.1080/1364557032000119616. · DOI · Paper page
  6. Vijay Arya, Rachel K. E. Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C. Hofman, Stephanie Houde, Q. Vera Liao, Ronny Luss, Alek- sandra Mojsilović, Sami Mourad, Pablo Pedemonte, Ramya Raghavendra, John Richards, Prasanna Sattigeri, Karthikeyan Shanmugam, Moninder Singh, Kush R. Varshney, Dennis Wei, and Yunfeng Zhang. 2019. One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques. http: //arxiv.org/abs/1909.03012 arXiv:1909.03012 [cs, stat]. · arXiv
  7. S. Sandra Bae, Clement Zheng, Mary Etta West, Ellen Yi-Luen Do, Samuel Huron, and Danielle Albers Szafr. 2022. Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1-18. https://doi.org/10.1145/ 3491102.3501939 · DOI
  8. Philip Barker. 1994. Designing Interactive Learning. In Design and Production of Multimedia and Simulation-based Learning Material, Ton de Jong and Luigi Sarti (Eds.). Springer Netherlands, Dordrecht, 1-30. https://doi.org/10.1007/978-94- 011-0942-0_1 · DOI
  9. R. K. E. Bellamy, K. Dey, M. Hind, S. C. Hofman, S. Houde, K. Kannan, P. Lohia, J. Martino, S. Mehta, A. Mojsilović, S. Nagar, K. Natesan Ramamurthy, J. Richards, D. Saha, P. Sattigeri, M. Singh, K. R. Varshney, and Y. Zhang. 2019. AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM Journal of Research and Development 63, 4/5 (July 2019), 4:1-4:15. https://doi.org/10.1147/JRD.2019.2942287 · DOI · Paper page
  10. Clara Bove, Jonathan Aigrain, Marie-Jeanne Lesot, Charles Tijus, and Marcin De- tyniecki. 2022. Contextualization and Exploration of Local Feature Importance Explanations to Improve Understanding and Satisfaction of Non-Expert Users. In 27th International Conference on Intelligent User Interfaces. ACM, Helsinki Finland, 807-819. https://doi.org/10.1145/3490099.3511139 · DOI
  11. Zana Buçinca, Phoebe Lin, Krzysztof Z. Gajos, and Elena L. Glassman. 2020. Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems. In Proceedings of the 25th International Conference on Intelligent User Interfaces. ACM, Cagliari Italy, 454-464. https://doi.org/10.1145/3377325. 3377498 · DOI · Paper page
  12. Michael L. Callaham, Robert L. Wears, Ellen J. Weber, Christopher Barton, and Gary Young. 1998. Positive-Outcome Bias and Other Limitations in the Outcome of Research Abstracts Submitted to a Scientifc Meeting. JAMA 280, 3 (July 1998), 254-257. https://doi.org/10.1001/jama.280.3.254 · DOI
  13. Furui Cheng, Dongyu Liu, Fan Du, Yanna Lin, Alexandra Zytek, Haomin Li, Huamin Qu, and Kalyan Veeramachaneni. 2022. VBridge: Connecting the Dots Between Features and Data to Explain Healthcare Models. IEEE Transactions on Visualization and Computer Graphics 28, 1 (Jan. 2022), 378-388. https: //doi.org/10.1109/TVCG.2021.3114836 · DOI
  14. Furui Cheng, Yao Ming, and Huamin Qu. 2021. DECE: Decision Explorer with Counterfactual Explanations for Machine Learning Models. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb. 2021), 1438-1447. https: //doi.org/10.1109/TVCG.2020.3030342 · DOI
  15. Dennis Collaris and Jarke J. van Wijk. 2020. ExplainExplore: Visual Exploration of Machine Learning Explanations. In 2020 IEEE Pacifc Visualization Symposium (PacifcVis). IEEE, Tianjin, China, 26-35. https://doi.org/10.1109/PacifcVis48177. 2020.7090 ISSN: 2165-8773. · DOI
  16. Jason A. Colquitt and Jessica B. Rodell. 2015. Measuring justice and fairness. In The Oxford handbook of justice in the workplace. Oxford University Press, New York, NY, US, 187-202. https://doi.org/10.1093/oxfordhb/9780199981410.013.8 · DOI
  17. Richard Dazeley, Peter Vamplew, Cameron Foale, Charlotte Young, Sunil Aryal, and Francisco Cruz. 2021. Levels of explainable artifcial intelligence for human- aligned conversational explanations. Artifcial Intelligence 299 (Oct. 2021), 103525. https://doi.org/10.1016/j.artint.2021.103525 · DOI
  18. Maartje M. A. de Graaf and Bertram F. Malle. 2017. How People Explain Action (and Autonomous Intelligent Systems Should Too). In 2017 AAAI Fall Symposia, Arlington, Virginia, USA, November 9-11, 2017. AAAI Press, 19-26. https://aaai. org/ocs/index.php/FSS/FSS17/paper/view/16009
  19. Alan Dix and Geofrey Ellis. 1998. Starting simple: adding value to static visualisation through simple interaction. In Proceedings of the working conference on Advanced visual interfaces (AVI '98). Association for Computing Machinery, New York, NY, USA, 124-134. https://doi.org/10.1145/948496.948514 · DOI
  20. Jonathan Dodge, Andrew A. Anderson, Matthew Olson, Rupika Dikkala, and Margaret Burnett. 2022. How Do People Rank Multiple Mutant Agents?. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 191-211. https://doi.org/10.1145/ 3490099.3511115 · DOI
  21. Vicente Dominguez, Pablo Messina, Ivania Donoso-Guzmán, and Denis Parra. 2019. The efect of explanations and algorithmic accuracy on visual recom- mender systems of artistic images. In Proceedings of the 24th International Con- ference on Intelligent User Interfaces. ACM, Marina del Ray California, 408-416. https://doi.org/10.1145/3301275.3302274 · DOI
  22. Filip Karlo Došilović, Mario Brčić, and Nikica Hlupić. 2018. Explainable artifcial intelligence: A survey. In 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE, Opatija, Croatia, 0210-0215. https://doi.org/10.23919/MIPRO.2018.8400040 · DOI · Paper page
  23. Chris Evans and Nicola J. Gibbons. 2007. The interactivity efect in multimedia learning. Computers & Education 49, 4 (Dec. 2007), 1147-1160. https://doi.org/ 10.1016/j.compedu.2006.01.008 · DOI
  24. Shi Feng and Jordan Boyd-Graber. 2019. What can AI do for me? evaluating machine learning interpretations in cooperative play. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 229-239. https://doi.org/10.1145/ 3301275.3302265 · DOI · Paper page
  25. Juliana J. Ferreira and Mateus S. Monteiro. 2020. What Are People Doing About XAI User Experience? A Survey on AI Explainability Research and Practice. In Design, User Experience, and Usability. Design for Contemporary Interactive Environments (Lecture Notes in Computer Science), Aaron Marcus and Elizabeth Rosenzweig (Eds.). Springer International Publishing, Cham, 56-73. https: //doi.org/10.1007/978-3-030-49760-6_4 · DOI
  26. James D. Foley, Foley Dan Van, Andries Van Dam, Steven K. Feiner, and John F. Hughes. 1996. Computer Graphics: Principles and Practice. Addison-Wesley Professional, USA.
  27. Azin Ghazimatin, Soumajit Pramanik, Rishiraj Saha Roy, and Gerhard Weikum. 2021. ELIXIR: Learning from User Feedback on Explanations to Improve Rec- ommender Models. In Proceedings of the Web Conference 2021 (WWW '21). Association for Computing Machinery, New York, NY, USA, 3850-3860. https: //doi.org/10.1145/3442381.3449848 · DOI
  28. H. P. Grice. 1975. Logic and Conversation. Brill. https://doi.org/10.1163/ 9789004368811_003 Pages: 41-58 Section: Speech Acts. · DOI · Paper page
  29. Ziwei Gu, Jing Nathan Yan, and Jefrey M. Rzeszotarski. 2021. Understanding User Sensemaking in Machine Learning Fairness Assessment Systems. In Pro- ceedings of the Web Conference 2021 (WWW '21). Association for Computing Ma- chinery, New York, NY, USA, 658-668. https://doi.org/10.1145/3442381.3450092 · DOI
  30. Lijie Guo, Elizabeth M. Daly, Oznur Alkan, Massimiliano Mattetti, Owen Cornec, and Bart Knijnenburg. 2022. Building Trust in Interactive Machine Learning via User Contributed Interpretable Rules. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 537-548. https://doi.org/10.1145/3490099.3511111 · DOI
  31. Sam Hepenstal, Leishi Zhang, Neesha Kodagoda, and B. l. william Wong. 2021. Developing Conversational Agents for Use in Criminal Investigations. ACM Transactions on Interactive Intelligent Systems 11, 3-4 (Dec. 2021), 1-35. https: //doi.org/10.1145/3444369 · DOI
  32. Diana C. Hernandez-Bocanegra and Jürgen Ziegler. 2021. Conversational review-based explanations for recommender systems: Exploring users' query behavior. In CUI 2021 -3rd Conference on Conversational User Interfaces (CUI '21). Association for Computing Machinery, New York, NY, USA, 1-11. https: //doi.org/10.1145/3469595.3469596 · DOI
  33. Germund Hesslow. 1988. The Problem of Causal Selection. In Contemporary Science and Natural Explanation: Commonsense Conceptions of Causality, Denis J. Hilton (Ed.). New York University Press.
  34. Robert R. Hofman, Shane T. Mueller, Gary Klein, and Jordan Litman. 2019. Metrics for Explainable AI: Challenges and Prospects. http://arxiv.org/abs/ 1812.04608 arXiv:1812.04608 [cs]. · arXiv
  35. Fred Hohman, Andrew Head, Rich Caruana, Robert DeLine, and Steven M. Drucker. 2019. Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1-13. https://doi.org/10.1145/3290605.3300809 · DOI
  36. Maia Jacobs, Jefrey He, Melanie F. Pradier, Barbara Lam, Andrew C. Ahn, Thomas H. McCoy, Roy H. Perlis, Finale Doshi-Velez, and Krzysztof Z. Gajos. 2021. Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1-14. https: //doi.org/10.1145/3411764.3445385 · DOI · Paper page
  37. Lars-Erik Janlert and Erik Stolterman. 2017. The Meaning of Interactivity-Some Proposals for Defnitions and Measures. Human-Computer Interaction 32, 3 (May 2017), 103-138. https://doi.org/10.1080/07370024.2016.1226139 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/07370024.2016.1226139. · DOI
  38. Shichao Jia, Zeyu Li, Nuo Chen, and Jiawan Zhang. 2022. Towards Visual Explainable Active Learning for Zero-Shot Classifcation. IEEE Transactions on Visualization and Computer Graphics 28, 1 (Jan. 2022), 791-801. https: //doi.org/10.1109/TVCG.2021.3114793 · DOI
  39. Zhuochen Jin, Shuyuan Cui, Shunan Guo, David Gotz, Jimeng Sun, and Nan Cao. 2020. CarePre: An Intelligent Clinical Decision Assistance System. ACM Transactions on Computing for Healthcare 1, 1 (March 2020), 6:1-6:20. https: //doi.org/10.1145/3344258 · DOI · Paper page
  40. D.A. Keim. 2002. Information visualization and visual data mining. IEEE Transactions on Visualization and Computer Graphics 8, 1 (Jan. 2002), 1-8. https: //doi.org/10.1109/2945.981847 · DOI
  41. Carmel Kent, Esther Laslo, and Sheizaf Rafaeli. 2016. Interactivity in online discussions and learning outcomes. Computers & Education 97 (June 2016), 116-128. https://doi.org/10.1016/j.compedu.2016.03.002 · DOI
  42. Anjali Khurana, Parsa Alamzadeh, and Parmit K. Chilana. 2021. ChatrEx: De- signing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust. In 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, St Louis, MO, USA, 1-11. https://doi.org/10.1109/ VL/HCC51201.2021.9576440 ISSN: 1943-6106. · DOI
  43. Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory Sayres. 2018. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). https://doi.org/ 10.48550/arXiv.1711.11279 arXiv:1711.11279 [stat]. · DOI · Paper page
  44. Chris Kim, Xiao Lin, Christopher Collins, Graham W. Taylor, and Mohamed R. Amer. 2021. Learn, Generate, Rank, Explain: A Case Study of Visual Explanation by Generative Machine Learning. ACM Transactions on Interactive Intelligent Systems 11, 3-4 (Sept. 2021), 23:1-23:34. https://doi.org/10.1145/3465407 · DOI
  45. Bart P. Knijnenburg, Martijn C. Willemsen, Zeno Gantner, Hakan Soncu, and Chris Newell. 2012. Explaining the user experience of recommender systems. User Modeling and User-Adapted Interaction 22, 4 (Oct. 2012), 441-504. https: //doi.org/10.1007/s11257-011-9118-4 · DOI
  46. Pang Wei Koh, Thao Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang. 2020. Concept Bottleneck Models. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020 (Proceedings of Machine Learning Research, Vol. 119). PMLR, Virtual Event, 5338-5348. http://proceedings.mlr.press/v119/koh20a.html
  47. Yubo Kou and Xinning Gui. 2020. Mediating Community-AI Interaction through Situated Explanation: The Case of AI-Led Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 102:1-102:27. https: //doi.org/10.1145/3415173 · DOI
  48. Pigi Kouki, James Schafer, Jay Pujara, John O'Donovan, and Lise Getoor. 2019. Personalized explanations for hybrid recommender systems. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 379-390. https://doi.org/10. 1145/3301275.3302306 · DOI
  49. Maria Kouvela, Ilias Dimitriadis, and Athena Vakali. 2020. Bot-Detective: An explainable Twitter bot detection service with crowdsourcing functionalities. In Proceedings of the 12th International Conference on Management of Digital EcoSystems (MEDES '20). Association for Computing Machinery, New York, NY, USA, 55-63. https://doi.org/10.1145/3415958.3433075 · DOI
  50. Josua Krause, Adam Perer, and Kenney Ng. 2016. Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 5686-5697. https: //doi.org/10.1145/2858036.2858529 · DOI · Paper page
  51. Todd Kulesza, Margaret Burnett, Weng-Keen Wong, and Simone Stumpf. 2015. Principles of Explanatory Debugging to Personalize Interactive Machine Learn- ing. In Proceedings of the 20th International Conference on Intelligent User In- terfaces (IUI '15). Association for Computing Machinery, New York, NY, USA, 126-137. https://doi.org/10.1145/2678025.2701399 · DOI · Paper page
  52. Bum Chul Kwon, Min-Je Choi, Joanne Taery Kim, Edward Choi, Young Bin Kim, Soonwook Kwon, Jimeng Sun, and Jaegul Choo. 2019. RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 299-309. https://doi.org/10.1109/TVCG.2018.2865027 · DOI · Paper page
  53. Markus Langer, Daniel Oster, Timo Speith, Holger Hermanns, Lena Kästner, Eva Schmidt, Andreas Sesing, and Kevin Baum. 2021. What do we want from Explainable Artifcial Intelligence (XAI)? -A stakeholder perspective on XAI and a conceptual model guiding interdisciplinary XAI research. Artifcial Intelligence 296 (July 2021), 103473. https://doi.org/10.1016/j.artint.2021.103473 · DOI · Paper page
  54. Min Kyung Lee, Anuraag Jain, Hea Jin Cha, Shashank Ojha, and Daniel Kusbit. 2019. Procedural Justice in Algorithmic Fairness: Leveraging Transparency and Outcome Control for Fair Algorithmic Mediation. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 182:1-182:26. https: //doi.org/10.1145/3359284 · DOI
  55. James R. Lewis. 1991. Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ. ACM SIGCHI Bulletin 23, 1 (Jan. 1991), 78-81. https://doi.org/10.1145/122672.122692 · DOI
  56. Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: In- forming Design Practices for Explainable AI User Experiences. In Proceed- ings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3313831.3376590 · DOI · Paper page
  57. Peter Lipton. 1990. Contrastive Explanation*. Royal Institute of Philosophy Sup- plements 27 (March 1990), 247-266. https://doi.org/10.1017/S1358246100005130 Publisher: Cambridge University Press. · DOI
  58. Han Liu, Vivian Lai, and Chenhao Tan. 2021. Understanding the Efect of Out- of-distribution Examples and Interactive Explanations on Human-AI Decision Making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 408:1-408:45. https://doi.org/10.1145/3479552 · DOI · Paper page
  59. Gaspar Isaac Melsión, Ilaria Torre, Eva Vidal, and Iolanda Leite. 2021. Using Explainability to Help Children UnderstandGender Bias in AI. In Interaction Design and Children. ACM, Athens Greece, 87-99. https://doi.org/10.1145/ 3459990.3460719 · DOI
  60. Martijn Millecamp, Nyi Nyi Htun, Cristina Conati, and Katrien Verbert. 2019. To explain or not to explain: the efects of personal characteristics when explaining music recommendations. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 397-407. https://doi.org/10.1145/3301275.3302313 · DOI · Paper page
  61. Yao Ming, Huamin Qu, and Enrico Bertini. 2019. RuleMatrix: Visualizing and Understanding Classifers with Rules. IEEE Transactions on Visualization and Computer Graphics 25, 1 (Jan. 2019), 342-352. https://doi.org/10.1109/TVCG. 2018.2864812 · DOI · Paper page
  62. Akira Miyake and Priti Shah (Eds.). 1999. Models of working memory: Mechanisms of active maintenance and executive control. Cambridge University Press, New York, NY, US. https://doi.org/10.1017/CBO9781139174909 Pages: xx, 506. · DOI
  63. David Moher, Alessandro Liberati, Jennifer Tetzlaf, Douglas G. Altman, and The PRISMA Group. 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Medicine 6, 7 (July 2009), e1000097. https://doi.org/10.1371/journal.pmed.1000097 · DOI · Paper page
  64. Cecily Morrison, Kit Huckvale, Bob Corish, Richard Banks, Martin Grayson, Jonas Dorn, Abigail Sellen, and Sân Lindley. 2018. Visualizing Ubiquitously Sensed Measures of Motor Ability in Multiple Sclerosis: Refections on Com- municating Machine Learning in Practice. ACM Transactions on Interactive Intelligent Systems 8, 2 (July 2018), 1-28. https://doi.org/10.1145/3181670 · DOI
  65. C. D. Mulrow. 1994. Systematic Reviews: Rationale for systematic reviews. BMJ 309, 6954 (Sept. 1994), 597-599. https://doi.org/10.1136/bmj.309.6954.597 Publisher: British Medical Journal Publishing Group Section: Education and debate. · DOI · Paper page
  66. Mohammad Naiseh, Reem S. Al-Mansoori, Dena Al-Thani, Nan Jiang, and Raian Ali. 2021. Nudging through Friction: An Approach for Calibrating Trust in Explainable AI. In 2021 8th International Conference on Behavioral and Social Computing (BESC). IEEE, Doha, Qatar, 1-5. https://doi.org/10.1109/BESC53957. 2021.9635271 · DOI
  67. Heather L. O'Brien, Paul Cairns, and Mark Hall. 2018. A practical approach to measuring user engagement with the refned user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies 112 (April 2018), 28-39. https://doi.org/10.1016/j.ijhcs.2018.01.004 · DOI · Paper page
  68. Sean Penney, Jonathan Dodge, Claudia Hilderbrand, Andrew Anderson, Logan Simpson, and Margaret Burnett. 2018. Toward Foraging for Understanding of StarCraft Agents: An Empirical Study. In 23rd International Conference on Intelligent User Interfaces (IUI '18). Association for Computing Machinery, New York, NY, USA, 225-237. https://doi.org/10.1145/3172944.3172946 · DOI
  69. Sayantan Polley, Suhita Ghosh, Marcus Thiel, Michael Kotzyba, and Andreas Nürnberger. 2020. SIMFIC: An Explainable Book Search Companion. In 2020 IEEE International Conference on Human-Machine Systems (ICHMS). IEEE, Rome, Italy, 1-6. https://doi.org/10.1109/ICHMS49158.2020.9209581 · DOI · Paper page
  70. Gabriëlle Ras, Marcel van Gerven, and Pim Haselager. 2018. Explanation Meth- ods in Deep Learning: Users, Values, Concerns and Challenges. In Explainable and Interpretable Models in Computer Vision and Machine Learning, Hugo Jair Escalante, Sergio Escalera, Isabelle Guyon, Xavier Baró, Yağmur Güçlütürk, Umut Güçlü, and Marcel van Gerven (Eds.). Springer International Publishing, Cham, 19-36. https://doi.org/10.1007/978-3-319-98131-4_2 · DOI · Paper page
  71. Juan Rebanal, Jordan Combitsis, Yuqi Tang, and Xiang 'Anthony' Chen. 2021. XAlgo: a Design Probe of Explaining Algorithms' Internal States via Question- Answering. In 26th International Conference on Intelligent User Interfaces (IUI '21). Association for Computing Machinery, New York, NY, USA, 329-339. https: //doi.org/10.1145/3397481.3450676 · DOI
  72. Dent M. Rhodes and Janet White Azbell. 1985. Designing Interactive Video Instruction Professionally. Training and Development Journal 39, 12 (1985), 31-33.
  73. Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. "Why Should I Trust You?": Explaining the Predictions of Any Classifer. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '16). Association for Computing Machinery, New York, NY, USA, 1135-1144. https://doi.org/10.1145/2939672.2939778 · DOI · Paper page
  74. Andrew Ross, Nina Chen, Elisa Zhao Hang, Elena L. Glassman, and Finale Doshi- Velez. 2021. Evaluating the Interpretability of Generative Models by Interactive Reconstruction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1-15. https://doi.org/10.1145/ 3411764.3445296 · DOI · Paper page
  75. Steven F. Roth and Joe Mattis. 1990. Data characterization for intelligent graphics presentation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). Association for Computing Machinery, New York, NY, USA, 193-200. https://doi.org/10.1145/97243.97273 · DOI
  76. Denise M. Rousseau, Sim B. Sitkin, Ronald S. Burt, and Colin Camerer. 1998. In- troduction to Special Topic Forum: Not so Diferent after All: A Cross-Discipline View of Trust. The Academy of Management Review 23, 3 (1998), 393-404. http://www.jstor.org/stable/259285
  77. Maria Roussou. 2004. Learning by doing and learning through play: an ex- ploration of interactivity in virtual environments for children. Computers in Entertainment 2, 1 (Jan. 2004), 10. https://doi.org/10.1145/973801.973818 · DOI
  78. James Schafer, Prasanna Giridhar, Debra Jones, Tobias Höllerer, Tarek Abdelza- her, and John O'Donovan. 2015. Getting the Message? A Study of Explanation Interfaces for Microblog Data Analysis. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI '15). Association for Computing Ma- chinery, New York, NY, USA, 345-356. https://doi.org/10.1145/2678025.2701406 · DOI
  79. Kara Schick-Makarof, Marjorie MacDonald, Marilyn Plummer, Judy Burgess, and Wendy Neander. 2016. What Synthesis Methodology Should I Use? A Review and Analysis of Approaches to Research Synthesis. AIMS public health 3, 1 (March 2016), 172-215. https://doi.org/10.3934/publichealth.2016.1.172 · DOI
  80. Johanes Schneider and Joshua Handali. 2019. Personalized explanation in machine learning: A conceptualization. In Proceedings of the European Conference on Information Systems (ECIS 2019). arXiv, Stockholm-Uppsala, Sweden. https: //doi.org/10.48550/arXiv.1901.00770 arXiv:1901.00770 [cs, stat]. · DOI
  81. Abigail See, Stephen Roller, Douwe Kiela, and Jason Weston. 2019. What makes a good conversation? How controllable attributes afect human judgments. https://doi.org/10.48550/arXiv.1902.08654 arXiv:1902.08654 [cs]. · DOI
  82. Rita Sevastjanova, Wolfgang Jentner, Fabian Sperrle, Rebecca Kehlbeck, Jürgen Bernard, and Mennatallah El-assady. 2021. QuestionComb: A Gamifcation Ap- proach for the Visual Explanation of Linguistic Phenomena through Interactive Labeling. ACM Transactions on Interactive Intelligent Systems 11, 3-4 (Dec. 2021), 1-38. https://doi.org/10.1145/3429448 · DOI
  83. Lei Shi, Zhiyang Teng, Le Wang, Yue Zhang, and Alexander Binder. 2019. DeepClue: Visual Interpretation of Text-Based Deep Stock Prediction. IEEE Transactions on Knowledge and Data Engineering 31, 6 (June 2019), 1094-1108. https://doi.org/10.1109/TKDE.2018.2854193 · DOI
  84. Rod Sims. 1997. Interactivity: A forgotten art? Computers in Human Behavior 13, 2 (May 1997), 157-180. https://doi.org/10.1016/S0747-5632(97)00004-6 · DOI
  85. Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju, and Sameer Singh. 2022. TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations. https://doi.org/10.48550/arXiv.2207.04154 arXiv:2207.04154 [cs]. · DOI
  86. Kacper Sokol and Peter Flach. 2020. Explainability fact sheets: a framework for systematic assessment of explainable approaches. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. ACM, Barcelona Spain, 56-67. https://doi.org/10.1145/3351095.3372870 · DOI
  87. Kacper Sokol and Peter Flach. 2020. One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparency. KI - Künstliche Intelligenz 34, 2 (June 2020), 235-250. https://doi.org/10.1007/s13218- 020-00637-y arXiv:2001.09734 [cs, stat]. · DOI · Paper page
  88. Francesco Sovrano and Fabio Vitali. 2021. From Philosophy to Interfaces: an Explanatory Method and a Tool Inspired by Achinstein's Theory of Explanation. In 26th International Conference on Intelligent User Interfaces. ACM, College Station TX USA, 81-91. https://doi.org/10.1145/3397481.3450655 · DOI
  89. Thilo Spinner, Udo Schlegel, Hanna Schäfer, and Mennatallah El-Assady. 2020. explAIner: A Visual Analytics Framework for Interactive and Explainable Ma- chine Learning. IEEE Transactions on Visualization and Computer Graphics 26, 1 (Jan. 2020), 1064-1074. https://doi.org/10.1109/TVCG.2019.2934629 · DOI
  90. Jonathan Steuer. 1992. Defning Virtual Reality: Dimensions Determining Telep- resence. Journal of Communication (1992), 73-93.
  91. S. Shyam Sundar, Qian Xu, and Saraswathi Bellur. 2010. Designing interactivity in media interfaces: a communications perspective. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 2247-2256. https://doi.org/10. 1145/1753326.1753666 · DOI
  92. Harini Suresh, Kathleen M Lewis, John Guttag, and Arvind Satyanarayan. 2022. Intuitively Assessing ML Model Reliability through Example-Based Explanations and Editing Model Inputs. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 767-781. https://doi.org/10.1145/3490099.3511160 · DOI
  93. Maxwell Szymanski, Martijn Millecamp, and Katrien Verbert. 2021. Visual, textual or hybrid: the efect of user expertise on diferent explanations. In 26th International Conference on Intelligent User Interfaces. ACM, College Station TX USA, 109-119. https://doi.org/10.1145/3397481.3450662 · DOI · Paper page
  94. Nava Tintarev. 2007. Explanations of recommendations. In Proceedings of the 2007 ACM conference on Recommender systems (RecSys '07). Association for Computing Machinery, New York, NY, USA, 203-206. https://doi.org/10.1145/ 1297231.1297275 · DOI
  95. Betty Vandenbosch and Michael J. Ginzberg. 1996. Lotus Notes® and Collab- oration: Plus ça change... Journal of Management Information Systems 13, 3 (Dec. 1996), 65-81. https://doi.org/10.1080/07421222.1996.11518134 Publisher: Routledge _eprint: https://doi.org/10.1080/07421222.1996.11518134. · DOI
  96. Marco Virgolin, Andrea De Lorenzo, Francesca Randone, Eric Medvet, and Mat- tias Wahde. 2021. Model learning with personalized interpretability estimation (ML-PIE). In Proceedings of the Genetic and Evolutionary Computation Conference Companion (GECCO '21). Association for Computing Machinery, New York, NY, USA, 1355-1364. https://doi.org/10.1145/3449726.3463166 · DOI
  97. Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing Theory-Driven User-Centric Explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/ 3290605.3300831 · DOI · Paper page
  98. Jane Webster and Richard T. Watson. 2002. Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly 26, 2 (2002), xiii-xxiii. https: //www.jstor.org/stable/4132319 Publisher: Management Information Systems Research Center, University of Minnesota.
  99. Daricia Wilkinson, Öznur Alkan, Q. Vera Liao, Massimiliano Mattetti, Inge Vejsbjerg, Bart P. Knijnenburg, and Elizabeth Daly. 2021. Why or Why Not? The Efect of Justifcation Styles on Chatbot Recommendations. ACM Transactions on Information Systems 39, 4 (Oct. 2021), 1-21. https://doi.org/10.1145/3441715 · DOI
  100. Leland Wilkinson. 2005. Introduction. In The Grammar of Graphics. Springer, New York, NY, 1-19. https://doi.org/10.1007/0-387-28695-0_1 · DOI
  101. Tongshuang Wu, Marco Túlio Ribeiro, Jefrey Heer, and Daniel S. Weld. 2021. Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improv- ing Models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP, Chengqing Zong, Fei Xia, Wenjie Li 0002, and Roberto Navigli (Eds.). Association for Computational Linguistics, Virtual Event, 6707-6723. https://aclanthology.org/2021.acl-long.523
  102. Jing Nathan Yan, Ziwei Gu, Hubert Lin, and Jefrey M. Rzeszotarski. 2020. Silva: Interactively Assessing Machine Learning Fairness Using Causality. In Pro- ceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376447 · DOI · Paper page
  103. Ji Soo Yi, Youn ah Kang, John Stasko, and J.A. Jacko. 2007. Toward a Deeper Understanding of the Role of Interaction in Information Visualization. IEEE Transactions on Visualization and Computer Graphics 13, 6 (Nov. 2007), 1224- 1231. https://doi.org/10.1109/TVCG.2007.70515 · DOI

Cited by

Sorted by citations

Authors
Bertrand, A., Viard, T., Belloum, R., Eagan, J. R., & Maxwell, W.
Affiliations
  • LTCI, Telecom Paris, Institut Polytechnique de Paris, France
  • Institut Interdisciplinaire de l'Innovation (i3), Télécom Paris, France
  • LAMIH, CNRS, UMR 8201, Univ. Polytechnique Hauts-de-France, France and LTCI, Télécom Paris, Institut Polytechnique de Paris, France
  • LTCI, Télécom Paris, Institut Polytechnique de Paris, France
  • i3, Telecom Paris - Institut Polytechnique de Paris, France
ORCID
Venue
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2023-04-19
Pages
1-21
DOI
10.1145/3544548.3581314
Cited by
59
References
22
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Funders
Agence Nationale de la Recherche (ANR-20-CHIA-0023-01)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review