The DOI matches its Crossref record; 170 of the 170 references it cites were found in a registry or an index.
Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
Abstract
Advances in artificial intelligence, sensors and big data management have far-reaching societal impacts. As these systems augment our everyday lives, it becomes increasing-ly important for people to understand them and remain in control. We investigate how HCI researchers can help to develop accountable systems by performing a literature analysis of 289 core papers on explanations and explaina-ble systems, as well as 12,412 citing papers. Using topic modeling, co-occurrence and network analysis, we mapped the research space from diverse domains, such as algorith-mic accountability, interpretable machine learning, context-awareness, cognitive psychology, and software learnability. We reveal fading and burgeoning trends in explainable systems, and identify domains that are closely connected or mostly isolated. The time is ripe for the HCI community to ensure that the powerful new autonomous systems have intelligible interfaces built-in. From our results, we propose several implications and directions for future research to-wards this goal.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To acquire such knowledge, we follow a user-centric approach as it enables obtaining empirical evidence for designing explanations for specific goals, domain and population [1].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [1]
In the citing paper
“Providing system explanations may also undermine user perceptions when users lack the attentional capacity to process complex explanations, for example when executing a demanding task [1,12,43,85].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [1]
In the citing paper
“Transparency may erode confidence in a system, with users trusting it less, because transparency leads them to question the system even when it is correct [1,13,50].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [1]
In the citing paper
“However, critical scholars highlight that these frameworks often reflect Western-centric values, overlooking the specific needs and cultural contexts of the Global South [1, 3, 10, 16].”
From Designing Responsible AI with Indigenous Communities: Towards Participatory AI with ovaHimba and San People in Namibia (2026) · cites this paper as [1]
In the citing paper
“People's mental model can be refned by explanations of how the system works.”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [1]
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Gephi: An Open Source Software for Exploring and Manipulating Networks
Bastian, M., Heymann, S., & Jacomy, M. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13937 · Cited by 11,675
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Plans and Situated Actions: The Problem of Human-Machine Communication
Kantowitz, B., & Suchman, L. A. (1990) · The American Journal of Psychology · doi:10.2307/1423221 · Cited by 5,299
Research works printed but not linked: 35
- Aha, D. W., Darrell, T., Pazzani, M., Reid, D., Sam-mut, C.,&Stone, P. (2017). Workshop on Explainable AI (XAI). IJCAI 2017.
- Biran, O.,&Cotton, C. (2017). Explanation and justi-fication in machine learning: A survey. In IJCAI-17 Workshop on Explainable AI (XAI) (p. 8).
- 10.5555/300679 · doi:10.5555/300679
- Chalmers, M.,&MacColl, I. (2003, October). Seam-ful and seamless design in ubiquitous computing. In Workshop at the crossroads: The interaction of HCI and systems issues in UbiComp (Vol. 8).
- Das, A., Agrawal, H., Zitnick, C. L., Parikh, D.,&Ba-tra, D. (2016). Human attention in visual question an-swering: Do humans and deep networks look at the same regions?. arXiv preprint arXiv:1606.03556. · arXiv
- Das, S., McCarter, A., Minieri, J., Damaraju, N., Pad-manabhan, S.,&Chau, D. H. P. ISPARK: Interactive Visual Analytics for Fire Incidents and Station Place-ment. In ACM SIGKDD Workshop on Interactive Da-ta Exploration and Analytics (p. 29).
- Diakopoulis, N. (2018). Algorithm Tips -- Find tips for stories on algorithms. Algorithmtips.org. Retrieved 8 January 2018, from http://algorithmtips.org/
- Diakopoulos, N.,&Koliska, M. (2017). Algorithmic Transparency in the News Media. Digital Journalism,
- Doshi-Velez, F.,&Kim, B. (2017). A Roadmap for a Rigorous Science of Interpretability. arXiv preprint arXiv:1702.08608. · arXiv
- 10.5555/270318.270324 · doi:10.5555/270318.270324
- 10.5555/3086952 · doi:10.5555/3086952
- Google Scholar. (2018). Google Scholar. Retrieved 7 January 2018, from http://scholar.google.com/
- Griffiths, T. L.,&Steyvers, M. (2004). Finding scien-tific topics. Proceedings of the National academy of Sciences, 101 (suppl 1), 5228--5235.
- Hailesilassie, T. (2016). Rule extraction algorithm for deep neural networks: A review. arXiv preprint arXiv:1610.05267. · arXiv
- Halpern, J. Y.,&Pearl, J. (2005b). Causes and expla-nations: A structural-model approach. Part II: Expla-nations. The British journal for the philosophy of sci-ence, 56(4), 889--911.
- 10.5555/3157096.3157133 · doi:10.5555/3157096.3157133
- Kim B. (2015a). Interactive and interpretable ma-chine learning models for human machine collabora-tion (Doctoral dissertation Massachusetts Institute of Technology).
- Kim, B., Malioutov D. M., Varshney, K. R. Proceed-ings of the 2016 ICML Workshop on Human Inter-pretability in Machine Learning (WHI 2016). arXiv preprint, arXiv:1607.02531. · arXiv
- 10.5555/2969033.2969045 · doi:10.5555/2969033.2969045
- 10.5555/1759779.1759790 · doi:10.5555/1759779.1759790
- Lambiotte, R., Delvenne, J. C.,&Barahona, M. (2008). Laplacian dynamics and multiscale modular structure in networks. arXiv preprint arXiv:0812.1770. · arXiv
- Lim, B. Y., Ayalon, O.,&Toch, E. 2017. Reducing Communication Uncertainty with Social Intelligibility: Challenges and Opportunities. In CHI 2017 Workshop on Designing for Uncertainty in HCI.
- Lim, B. Y., Smith, A.,&Stumpf, S. (2018). ExSS: Ex-plainable smart systems. In Proceedings of the 23rd ACM International Conference Adjunct Papers on Intelligent User Interfaces.
- Lipton, Z. C. (2016). The mythos of model interpreta-bility. arXiv preprint, arXiv:1606.03490. · arXiv
- 10.5555/1812799.1812875 · doi:10.5555/1812799.1812875
- 10.5555/1053072.1053104 · doi:10.5555/1053072.1053104
- Muñoz-Avila, H.,&Aha, D. (2004). On the role of explanation for hierarchical case-based planning in real-time strategy games. In Proceedings of ECCBR-04 Workshop on Explanations in CBR (pp. 1--10).
- Norman, D. (2009). The design of future things. Basic books.
- 10.2139/ssrn.2512069 · doi:10.2139/ssrn.2512069
- Roth-Berghofer, T., Leake, D. B.,&Cassens, J. (2012, July). Explanation-aware Computing ExaCt 2012. In Proceedings of the Seventh International ExaCt workshop.
- Scopus | The largest database of peer-reviewed liter-ature | Elsevier. (2018). Elsevier.com. Retrieved 7 January 2018, from https://www.elsevier.com/solutions/scopus
- 10.5555/38407 · doi:10.5555/38407
- Stolze, M.,&Ströbel, M. (2003). Dealing with learning in ecommerce product navigation and decision sup-port: the teaching salesman problem. In Proceedings of the Second Interdisciplinary World Congress on Mass Customization and Personalization.
- USACM. 2017. Statement on Algorithmic Transpar-ency and Accountability. Accessed on 2017-09-09. https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
- Zhao, J., Wang, T., Yatskar, M., Ordonez, V.,&Chang, K. W. (2017). Men Also Like Shopping: Re-ducing Gender Bias Amplification using Corpus
Cited by
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
“Given HCI’s [61] core interest in technology that entails understanding and better empowering users, techniques from this research field can help in developing transparent systems.”
BackgroundInfluentialExplaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Metadata
- Authors
- Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M.
- Affiliations
- National University of Singapore (SG)
- Aarhus University (DK)
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-18
- OpenAlex
- W2795530988
- Cited by
- 743
- References
- 170
- Citations by year
- 2026: 75 · 2025: 65 · 2024: 95 · 2023: 89 · 2022: 115 · 2021: 125 · 2020: 91 · 2019: 69 · 2018: 18
- FWCI
- 30.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- explainable systems, algorithmic accountability, model interpretability, human-computer interaction, research trends, research trajectories, context-aware systems, cognitive psychology, autonomous systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. https://app.cochat.ai/papers/10.1145/3173574.3174156
- The paper
- Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018). Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3173574.3174156
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.