Expanding Explainability: Towards Social Transparency in AI systems
Open accessThe DOI matches its Crossref record; 124 of the 124 references it cites were found in a registry or an index.
Abstract
As AI-powered systems increasingly mediate consequential decision-making, their explainability is critical for end-users to take informed and accountable actions. Explanations in human-human interactions are socially-situated. AI systems are often socio-organizationally embedded. However, Explainable AI (XAI) approaches have been predominantly algorithm-centered. We take a developmental step towards socially-situated XAI by introducing and exploring Social Transparency (ST), a sociotechnically informed perspective that incorporates the socio-organizational context into explaining AI-mediated decision-making. To explore ST conceptually, we conducted interviews with 29 AI users and practitioners grounded in a speculative design scenario. We suggested constitutive design elements of ST and developed a conceptual framework to unpack ST’s effect and implications at the technical, decision-making, and organizational level. The framework showcases how ST can potentially calibrate trust in AI, improve decision-making, facilitate organizational collective actions, and cultivate holistic explainability. Our work contributes to the discourse of Human-Centered XAI by expanding the design space of XAI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When these mechanisms are aligned with efforts needed to establish social, organizational, and regulatory ecosystems for the assurance of trustworthy AI [9, 30, 54], they are likely to satisfy the calibration condition.”
From Designing for Responsible Trust in AI Systems: A Communication Perspective (2022) · cites this paper as [9]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As a part of the internal and external accountability processes, transparency can assist in facilitating algorithmic fairness.”
From Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” (2023) · cites this paper as [47]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“User research on XAI is in its infancy, and effects of respective measures are either unknown or varying, with potential influences of moderators that still need to be explored (Ehsan et al., 2021, 2022)”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Ehsan et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the evidence on the effects of these approaches in the context of human-AI interaction is still scarce.”
From Effects of Explainable Artificial Intelligence on trust and human behavior in a high-risk decision task (2023) · cites this paper as Ehsan et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research on social transparency and algorithmic accountability shows that trust in AI systems emerges from explanations embedded within organizational and cultural contexts rather than from technical interpretability alone [12,14].”
From Who speaks when machines read scripture: boundary-making and interpretive authority in AI-mediated religious knowledge (2026) · cites this paper as [12]
Experimental — accuracy not yet measured
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · cited 2×
“While these heuristic-based judgments are indispensable for people to navigate complex technological and social environments, they also lead to biases and errors if inappropriately applied [48], calling for careful study of inferences people make based on ST features and their potential effect.”
The psychology of interpersonal relations.
Heider, F. (1958) · doi:10.1037/10628-000 · Cited by 13,457
The Psychology of Interpersonal Relations.
Newcomb, T., & Heider, F. (1958) · American Sociological Review · doi:10.2307/2089062 · Cited by 11,822
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · cited 2×
“Recent work also emphasizes that explainability is an audience-dependant instead of a model-inherent property [7, 8, 26, 70, 73].”
BackgroundJudgment Under Uncertainty: Heuristics and Biases.
Shafer, G. R., Kahnerman, D., Slovic, P., & Tversky, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288362 · Cited by 5,657
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Judgment under uncertainty: List of contributors
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,670
Judgment under uncertainty: Causality and attribution
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,670
Collective Mind in Organizations: Heedful Interrelating on Flight Decks
Weick, K. E., & Roberts, K. H. (1993) · Administrative Science Quarterly · doi:10.2307/2393372 · Cited by 4,378
(1987) · Medical Entomology and Zoology · Cited by 4,269
Judgment under uncertainty: Heuristics and biases
Tversky, A., & Kahneman, D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.002 · Cited by 3,643
TRUST AND DISTRUST IN ORGANIZATIONS: Emerging Perspectives, Enduring Questions
Kramer, R. M. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.569 · Cited by 3,243
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · Cited by 3,148
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507 · cited 3×
“Although there is no established consensus on the complete set of factors that makes an AI system explainable, XAI work commonly shares the goal of making an AI system’s functioning or decisions easy to understand by people [7, 14, 27, 31, 34, 62, 70, 82].”
BackgroundResnick, P., Kuwabara, K., Zeckhauser, R., & Friedman, E. (2000) · Communications of the ACM · doi:10.1145/355112.355122 · Cited by 2,190
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842 · cited 1×
“Although there is no established consensus on the complete set of factors that makes an AI system explainable, XAI work commonly shares the goal of making an AI system’s functioning or decisions easy to understand by people [7, 14, 27, 31, 34, 62, 70, 82].”
BackgroundHuman-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 2×
“Since an explanation is only explanatory if it can be consumed by the recipient, many recognize the importance of taking user-centered approaches to XAI [70, 89, 100], and the indispensable role that the HCI community should play in advancing the field.”
BackgroundFairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Plans and Situated Actions: The Problem of Human Machine Communication.
Woolgar, S., & Suchman, L. A. (1989) · Contemporary Sociology · doi:10.2307/2073874 · Cited by 1,604
Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work
Star, S. L., & Strauss, A. (1999) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1008651105359 · Cited by 1,500
Grounded Theory Methodology: The Pressing Need for a Coherent Logic of Justification
Rennie, D. L. (1998) · Theory & Psychology · doi:10.1177/0959354398081006 · Cited by 1,434
Social and Heuristic Approaches to Credibility Evaluation Online
Metzger, M. J., Flanagin, A. J., & Medders, R. B. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2010.01488.x · Cited by 1,394
A Descriptive Framework of Workspace Awareness for Real-Time Groupware
Gutwin, C., & Greenberg, S. (2002) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1021271517844 · Cited by 1,185
Sengers, P., Boehner, K., David, S., & Kaye, J. '. (2005) · Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility · doi:10.1145/1094562.1094569 · Cited by 1,030
Credibility and trust of information in online environments: The use of cognitive heuristics
Metzger, M. J., & Flanagin, A. J. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2013.07.012 · Cited by 1,000
Social coding in GitHub: transparency and collaboration in an open software repository
Dabbish, L., Stuart, C., Tsay, J., & Herbsleb, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145396 · Cited by 999
Suchman, L. (1995) · Communications of the ACM · doi:10.1145/223248.223263 · Cited by 991 · cited 1×
“The concept of making others’ activities transparent plays a central role in HCI and Computer-Supported Cooperative Work (CSCW) literature [92, 96].”
BackgroundWhy CSCW applications fail: problems in the design and evaluationof organizational interfaces
Grudin, J. (1988) · Proceedings of the 1988 ACM conference on Computer-supported cooperative work - CSCW '88 · doi:10.1145/62266.62273 · Cited by 961
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
Self-citationDecolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
Mohamed, S., Png, M.-T., & Isaac, W. (2020) · Philosophy & Technology · doi:10.1007/s13347-020-00405-8 · Cited by 912 · cited 1×
“Otherwise one may risk deploying an AI system un-integrated into individual and organizational workflows [66, 106], potentially resulting in misuse, mistrust [108, 109], or having profound ethical risks and unintended consequences, especially for marginalized groups [72, 86, 99].”
BackgroundDesigning Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Self-citationTransactive memory in close relationships.
Wegner, D. M., Erber, R., & Raymond, P. (1991) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.61.6.923 · Cited by 852
Social Media, Knowledge Sharing, and Innovation: Toward a Theory of Communication Visibility
Leonardi, P. M. (2014) · Information Systems Research · doi:10.1287/isre.2014.0536 · Cited by 815
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794 · cited 2×
“Moreover, XAI’s disconnect with the philosophical and psychological grounds of human explanations has been duly noted [71], as best represented by Miller’s call for leveraging insights from the Social Sciences [70].”
BackgroundA Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
Makarius, E. E., Mukherjee, D., Fox, J. D., & Fox, A. K. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.07.045 · Cited by 780
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Manipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · cited 3×
“Only until recently have researchers began to conduct controlled lab studies to rigorously evaluate popular XAI techniques [12, 13, 15, 22, 27, 53, 80], as well as studies to understand real-world user needs for AI explainability [43, 50, 58].”
BackgroundResultManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Vaughan, J. W., & Wallach, H. (2018) · arXiv · doi:10.48550/arxiv.1802.07810 · Cited by 711
Austin, J. R. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.866 · Cited by 656
Artificial Intelligence and Surgical Decision-making.
Loftus, T. J., Tighe, P. J., Filiberto, A. C., Efron, P. A., Brakenridge, S. C., Mohr, A. M., Rashidi, P., Upchurch, G. R., & Bihorac, A. (2020) · JAMA Surgery · doi:10.1001/jamasurg.2019.4917 · Cited by 650 · cited 1×
“being employed in high stakes decision-making scenarios in industries such as healthcare [63], finance [76], college admissions [79], hiring [19], and criminal justice [37], the need for explainability becomes paramount.”
BackgroundTransactive Memory: Learning Who Knows What in Work Groups and Organizations
Moreland, R. L. (1999) · Shared Cognition in Organizations · doi:10.4324/9781410603227-1 · Cited by 566
Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564 · cited 5×
“Recent studies also reported detrimental effects of explanations for AI system users including inducing over-trust or over-estimation of model capabilities [50, 90, 95], and increasing cognitive”
BackgroundResultInfluentialTransactive Memory Systems in Organizations: Matching Tasks, Expertise, and People
Brandon, D. P., & Hollingshead, A. B. (2004) · Organization Science · doi:10.1287/orsc.1040.0069 · Cited by 553
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552
The social organization of distributed cognition.
Hutchins, E. (2004) · Perspectives on socially shared cognition. · doi:10.1037/10096-012 · Cited by 549
Computation and Human Experience
Agre, P. E. (1997) · Cambridge University Press eBooks · doi:10.1017/cbo9780511571169 · Cited by 527
Group awareness in distributed software development
Gutwin, C., Penner, R., & Schneider, K. (2004) · Proceedings of the 2004 ACM conference on Computer supported cooperative work · doi:10.1145/1031607.1031621 · Cited by 388
Explanations as Mechanisms for Supporting Algorithmic Transparency
Rader, E., Cotter, K., & Cho, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173677 · Cited by 388 · cited 1×
“Moreover, while XAI is often claimed to be a critical step towards accountable AI, empirical studies have found little evidence that explanations improve a user’s perceived accountability or control over AI systems [81, 90].”
BackgroundLeonardi, P. M. (2015) · MIS Quarterly · doi:10.25300/misq/2015/39.4.1 · Cited by 379
Šabanović, S. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0066-7 · Cited by 314
Proxy tasks and subjective measures can be misleading in evaluating explainable AI systems
Buçinca, Z., Lin, P., Gajos, K. Z., & Glassman, E. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377498 · Cited by 307 · cited 2×
“Only until recently have researchers began to conduct controlled lab studies to rigorously evaluate popular XAI techniques [12, 13, 15, 22, 27, 53, 80], as well as studies to understand real-world user needs for AI explainability [43, 50, 58].”
BackgroundResultExplaining Decision-Making Algorithms through UI: Strategies to Help Non-Expert Stakeholders
Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300789 · Cited by 292 · cited 2×
“Only until recently have researchers began to conduct controlled lab studies to rigorously evaluate popular XAI techniques [12, 13, 15, 22, 27, 53, 80], as well as studies to understand real-world user needs for AI explainability [43, 50, 58].”
BackgroundResultExplaining models: an empirical study of how explanations impact fairness judgment
Dodge, J., Liao, Q. V., Zhang, Y., Bellamy, R. K. E., & Dugan, C. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302310 · Cited by 286
Self-citationNetWORKers and their Activity in Intensional Networks
Nardi, B. A., Whittaker, S., & Schwarz, H. (2002) · Computer Supported Cooperative Work (CSCW) · doi:10.1023/a:1015241914483 · Cited by 285
An enquiry concerning human understanding : a critical edition
Hume, D., & Beauchamp, T. L. (2000) · Clarendon Press eBooks · Cited by 276
Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach
Ehsan, U., & Riedl, M. O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60117-1_33 · Cited by 274
Self-citationOne Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., et al. (2019) · arXiv · doi:10.48550/arxiv.1909.03012 · Cited by 268 · cited 1×
“Recent work also emphasizes that explainability is an audience-dependant instead of a model-inherent property [7, 8, 26, 70, 73].”
BackgroundSelf-citationExplanation Methods in Deep Learning: Users, Values, Concerns and Challenges
Ras, G., van Gerven, M., & Haselager, P. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_2 · Cited by 255
explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
Spinner, T., Schlegel, U., Schafer, H., & El-Assady, M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934629 · Cited by 254
The challenge of crafting intelligible intelligence
Weld, D. S., & Bansal, G. (2019) · Communications of the ACM · doi:10.1145/3282486 · Cited by 253 · cited 1×
“Recent work has also begun to explore interactive explanations that could address users’ follow-up questions as a way to fill individual knowledge gaps [91, 104].”
BackgroundYang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 1×
“Otherwise one may risk deploying an AI system un-integrated into individual and organizational workflows [66, 106], potentially resulting in misuse, mistrust [108, 109], or having profound ethical risks and unintended consequences, especially for marginalized groups [72, 86, 99].”
BackgroundExplanation and abductive inference
Lombrozo, T. (2012) · The Oxford Handbook of Thinking and Reasoning · doi:10.1093/oxfordhb/9780199734689.013.0014 · Cited by 242
DEVELOPMENTS OF TRANSACTIVE MEMORY SYSTEMS AND COLLECTIVE MIND IN VIRTUAL TEAMS
Yoo, Y., & Kanawattanachai, P. (2001) · The International Journal of Organizational Analysis · doi:10.1108/eb028933 · Cited by 236
Sharing Knowledge and Expertise: The CSCW View of Knowledge Management
Ackerman, M. S., Dachtera, J., Pipek, V., & Wulf, V. (2013) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-013-9192-8 · Cited by 229 · cited 2×
“As reviewed by Ackerman et al, [3], CSCW systems supporting organizational knowledge management fall into two categories: a repository model that externalizes peoples’ knowledge as sharable artifacts or objects; and an expertise-sharing model that supports locating the appropriate person to have in-situ access to know…”
BackgroundValue-Sensitive Algorithm Design: Method, Case Study, and Lessons
Zhu, H., Yu, B., Halfaker, A., & Terveen, L. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274463 · Cited by 220
The effects of example-based explanations in a machine learning interface
Cai, C. J., Jongejan, J., & Holbrook, J. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302289 · Cited by 220 · cited 2×
“Only until recently have researchers began to conduct controlled lab studies to rigorously evaluate popular XAI techniques [12, 13, 15, 22, 27, 53, 80], as well as studies to understand real-world user needs for AI explainability [43, 50, 58].”
BackgroundResultHuman factors in model interpretability: Industry practices, challenges, and needs
Hong, S. R., Hullman, J., & Bertini, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392878 · Cited by 219 · cited 3×
“Their findings suggest that the process of interpreting or making sense of an AI system frequently involves cooperation and mental model comparison between people in different roles, aimed at building trust not only between people and the AI system, but also between people within the organization [43].”
BackgroundExplainable Artificial Intelligence (XAI)
Mohaghegh, S. D. (2024) · Artificial Intelligence for Science and Engineering Applications · doi:10.1201/9781003369356-8 · Cited by 215
Automated rationale generation: a technique for explainable AI and its effects on human perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. O. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302316 · Cited by 210 · cited 4×
“Moreover, a notable area of XAI work focuses on generating human-consumable and domain-specific machine explanations by learning from how humans explain [27, 40], which could be a fruitful area to explore when combined with the availability of 4W information.”
BackgroundMethodInfluentialSelf-citationWeBuildAI: Participatory Framework for Algorithmic Governance
Lee, M. K., Kusbit, D., Kahng, A., Kim, J. T., Yuan, X., Chan, A., See, D., Noothigattu, R., Lee, S., Psomas, A., et al. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359283 · Cited by 206
How do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200 · cited 1×
“There have been rather mixed results on whether current XAI techniques could appropriately enhance user trust [15, 80, 107] or the intended task performance, whether for decision making [12, 58, 111], model evaluation [6, 13, 22], or model development [50].”
ResultExplainable and Interpretable Models in Computer Vision and Machine Learning
(2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4 · Cited by 199
Sánchez-Monedero, J., Dencik, L., & Edwards, L. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372849 · Cited by 196 · cited 1×
“Otherwise one may risk deploying an AI system un-integrated into individual and organizational workflows [66, 106], potentially resulting in misuse, mistrust [108, 109], or having profound ethical risks and unintended consequences, especially for marginalized groups [72, 86, 99].”
BackgroundPotential Benefits of Communication in Transactive Memory Systems
Hollingshead, A. B., & Brandon, D. P. (2003) · Human Communication Research · doi:10.1093/hcr/29.4.607 · Cited by 185
Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI
Agre, P. E. (2006) · Cited by 180
Designing Information Spaces: The Social Navigation Approach
(2003) · Computer Supported Cooperative Work · doi:10.1007/978-1-4471-0035-5 · Cited by 177
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163
Algorithmic realism: expanding the boundaries of algorithmic thought
Green, B., & Viljoen, S. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372840 · Cited by 161
Toward situated interventions for algorithmic equity: lessons from the field
Katell, M., Young, M., Dailey, D., Herman, B., Guetler, V., Tam, A., Bintz, C., Raz, D., & Krafft, P. M. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372874 · Cited by 153 · cited 1×
“In a similar vein, field work on algorithmic fairness often found that meaningful interventions toward usable and ethical algorithmic systems are non-technical, and that user community derive most value from localized, as opposed to “scalable” solutions [49, 54].”
BackgroundToolkit to support intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864353 · Cited by 143
Reflective HCI: towards a critical technical practice
Dourish, P., Finlay, J., Sengers, P., & Wright, P. (2004) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/985921.986203 · Cited by 139
"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
Lai, V., Liu, H., & Tan, C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376873 · Cited by 123
The Instrumental Value of Explanations
Lombrozo, T. (2011) · Philosophy Compass · doi:10.1111/j.1747-9991.2011.00413.x · Cited by 118
Mental Models and Causal Explanation: Judgements of Probable Cause and Explanatory Relevance
Hilton, D. J. (1996) · Thinking & Reasoning · doi:10.1080/135467896394447 · Cited by 117
Rosson, M. B., & Carroll, J. M. (2009) · Human factors and ergonomics · doi:10.1201/9781420088892.ch8 · Cited by 117
Smith-Renner, A., Fan, R., Birchfield, M., Wu, T., Boyd-Graber, J., Weld, D. S., & Findlater, L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376624 · Cited by 112 · cited 2×
“Moreover, while XAI is often claimed to be a critical step towards accountable AI, empirical studies have found little evidence that explanations improve a user’s perceived accountability or control over AI systems [81, 90].”
BackgroundExplainable Active Learning (XAL): Toward AI Explanations as Interfaces for Machine Teachers
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3432934 · Cited by 106
Self-citationYang, Q., Zimmerman, J., Steinfeld, A., Carey, L., & Antaki, J. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858373 · Cited by 105 · cited 1×
“Otherwise one may risk deploying an AI system un-integrated into individual and organizational workflows [66, 106], potentially resulting in misuse, mistrust [108, 109], or having profound ethical risks and unintended consequences, especially for marginalized groups [72, 86, 99].”
BackgroundSocial transparency in networked information exchange: a theoretical framework
Stuart, H. C., Dabbish, L., Kiesler, S., Kinnaird, P., & Kang, R. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145275 · Cited by 100 · cited 4×
“[94] conceptualized Social Transparency (ST) in networked information exchange.”
BackgroundInfluentialCOGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96
TED: Teaching AI to Explain its Decisions
Hind, M., Wei, D., Campbell, M., Codella, N. C. F., Dhurandhar, A., Mojsilović, A., Natesan Ramamurthy, K., & Varshney, K. R. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314273 · Cited by 92
The design of intelligent socio-technical systems
Jones, A. J. I., Artikis, A., & Pitt, J. V. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-012-9387-2 · Cited by 91
Erickson, T. D., & Kellogg, W. A. (2003) · Computer supported cooperative work · doi:10.1007/978-1-4471-0035-5_2 · Cited by 90
Explaining Explanation, Part 1: Theoretical Foundations
Hoffman, R. R., & Klein, G. (2017) · IEEE Intelligent Systems · doi:10.1109/mis.2017.54 · Cited by 86
Mey, G. (2024) · Springer eBooks · doi:10.1007/978-3-658-45155-4_18 · Cited by 84
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. (2021) · Equity and Access in Algorithms, Mechanisms, and Optimization · doi:10.1145/3465416.3483305 · Cited by 82
A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
Suresh, H., & Guttag, J. V. (2019) · arXiv · doi:10.48550/arxiv.1901.10002 · Cited by 82 · cited 1×
“Otherwise one may risk deploying an AI system un-integrated into individual and organizational workflows [66, 106], potentially resulting in misuse, mistrust [108, 109], or having profound ethical risks and unintended consequences, especially for marginalized groups [72, 86, 99].”
BackgroundWhy these Explanations? Selecting Intelligibility Types for Explanation Goals.
Lim, B. Y., Yang, Q., Abdul, A., & Wang, D. (2019) · IUI Workshops · Cited by 79
Huang, S., & Fu, W. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470743 · Cited by 78
Futuristic Autobiographies: Weaving Participant Narratives to Elicit Values around Robots
Cheon, E., & Su, N. M. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171244 · Cited by 74
Inference to the Best Explanation (IBE) Versus Explaining for the Best Inference (EBI)
Wilkenfeld, D. A., & Lombrozo, T. (2015) · Science & Education · doi:10.1007/s11191-015-9784-4 · Cited by 73
Yang, Q., Steinfeld, A. M., & Zimmerman, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09612 · Cited by 68
A Human-Centered Agenda for Intelligible Machine Learning
Vaughan, J. W., & Wallach, H. (2021) · Machines We Trust · doi:10.7551/mitpress/12186.003.0014 · Cited by 50
Evaluating the Promise of Human-Algorithm Collaborations in Everyday Work Practices
Wolf, C., & Blomberg, J. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359245 · Cited by 48
Sánchez‐Monedero, J., Dencik, L., & Edwards, L. (2019) · Goldsmiths (University of London) · doi:10.48550/arxiv.1910.06144 · Cited by 48
Designing social translucence over social networks
Gilbert, E. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208670 · Cited by 43
Automated Rationale Generation: A Technique for Explainable AI and its Effects on Human Perceptions
Ehsan, U., Tambwekar, P., Chan, L., Harrison, B., & Riedl, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03729 · Cited by 42
Self-citationIntegrating roboticist values into a Value Sensitive Design framework for humanoid robots
Cheon, E., & Su, N. M. (2016) · 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2016.7451775 · Cited by 38
TED: Teaching AI to Explain its DecisionsPreprint
Hind, M., Wei, D., Campbell, M. S., Codella, N., Dhurandhar, A., Mojsilović, A., Ramamurthy, K. N., & Varshney, K. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04896 · Cited by 30
Building for social translucence: a domain analysis and prototype system
McDonald, D. W., Gokhman, S., & Zachry, M. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145301 · Cited by 28
Evaluating Saliency Map Explanations for Convolutional Neural Networks: A User Study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Bianchi‐Berthouze, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00772 · Cited by 26
The Perverse Effects of Social Transparency on Online Advice Taking
Nguyêñ, D. T. K., Dabbish, L., & Kiesler, S. B. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675253 · Cited by 19
How Do Visual Explanations Foster End Users' Appropriate Trust in Machine Learning?Preprint
Yang, F. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/s9q8t · Cited by 18
Transactive Memory Systems in Organizations
BrandonDavid, P., & HollingsheadAndrea, B. (2004) · Organization Science · doi:10.5555/1045759.1045804 · Cited by 16
Enriched Social Translucence in Medical Crowdfunding
Kim, J. G., Kong, H., Hong, H., & Karahalios, K. G. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395520 · Cited by 13
(2019)
Research works printed but not linked: 4
- [57] David K Lewis. 1986. Causal explanation. (1986). - · DOI · Paper page
- [75] Michael Muller and Q Vera Liao. [n.d.]. Exploring AI Ethics and Values through Participatory Design Fictions. ([n. d.]). -
- [95] Simone Stumpf, Adrian Bussone, and Dympna O'sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In ACM SIGCHI Workshop on Human-Centered Machine Learning . -
- [98] S Shyam Sundar. 2008. The MAIN model: A heuristic approach to understanding technology effects on credibility . MacArthur Foundation Digital Media and Learning Initiative. -
Cited by
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Survey of Explainable AI Techniques in Healthcare
Chaddad, A., Peng, J., Xu, J., & Bouridane, A. (2023) · Sensors · doi:10.3390/s23020634 · Cited by 591
“Radiologists also want to know the opinions of others when using AI tools for diagnosis [98].”
BackgroundAccountability in artificial intelligence: what it is and how it works
Novelli, C., Taddeo, M., & Floridi, L. (2024) · AI & SOCIETY · doi:10.1007/s00146-023-01635-y · Cited by 495
Explanations Can Reduce Overreliance on AI Systems During Decision-Making
Vasconcelos, H., Jörke, M., Grunde-McLaughlin, M., Gerstenberg, T., Bernstein, M. S., & Krishna, R. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579605 · Cited by 402
“Ecological Validity: Selecting maze solving trade s off some ecological validity compared to other tasks, as few human-XAI tasks outside of the lab will include solving mazes, but a rich literature in cognitive psychology and cognitive science involves solving puzzles of this sort (e.g., [2, 60]).”
BackgroundInfluentialShould ChatGPT be biased? Challenges and risks of bias in large language models
Ferrara, E. (2023) · First Monday · doi:10.5210/fm.v28i11.13346 · Cited by 282
“When users and regulators can see that developers are taking steps to ensure the fairness and equity of their models, they may be more likely to trust and adopt these technologies [92, 93].”
Background
Metadata
- Authors
- Ehsan, U., Liao, Q. V., Muller, M., Riedl, M. O., & Weisz, J. D.
- Affiliations
- Georgia Institute of Technology (US)
- IBM (United States) (US)
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-19
- OpenAlex
- W3119394424
- Cited by
- 538
- References
- 121
- Citations by year
- 2026: 125 · 2025: 150 · 2024: 112 · 2023: 80 · 2022: 57 · 2021: 14
- FWCI
- 30.37
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1928586)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- explainable AI, social transparency, AI-mediated decision-making, human-centered AI, trust in AI, collective action, design elements, conceptual framework, speculative design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.