Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 170 of the 170 references it cites were found in a registry or an index.

Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda

Abdul, Ashraf, Vermeulen, Jo, Wang, Danding, Lim, Brian Y., Kankanhalli, Mohan·2018·Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Abstract

Advances in artificial intelligence, sensors and big data management have far-reaching societal impacts. As these systems augment our everyday lives, it becomes increasing-ly important for people to understand them and remain in control. We investigate how HCI researchers can help to develop accountable systems by performing a literature analysis of 289 core papers on explanations and explaina-ble systems, as well as 12,412 citing papers. Using topic modeling, co-occurrence and network analysis, we mapped the research space from diverse domains, such as algorith-mic accountability, interpretable machine learning, context-awareness, cognitive psychology, and software learnability. We reveal fading and burgeoning trends in explainable systems, and identify domains that are closely connected or mostly isolated. The time is ripe for the HCI community to ensure that the powerful new autonomous systems have intelligible interfaces built-in. From our results, we propose several implications and directions for future research to-wards this goal.

Overview

Integrity signals

Registry

Crossref · 10.1145/3173574.3174156

Cites

170 of 170 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 170 references

Research works printed but not linked: 35

  1. Aha, D. W., Darrell, T., Pazzani, M., Reid, D., Sam-mut, C.,&Stone, P. (2017). Workshop on Explainable AI (XAI). IJCAI 2017.
  2. Biran, O.,&Cotton, C. (2017). Explanation and justi-fication in machine learning: A survey. In IJCAI-17 Workshop on Explainable AI (XAI) (p. 8).
  3. 10.5555/300679 · doi:10.5555/300679
  4. Chalmers, M.,&MacColl, I. (2003, October). Seam-ful and seamless design in ubiquitous computing. In Workshop at the crossroads: The interaction of HCI and systems issues in UbiComp (Vol. 8).
  5. Das, A., Agrawal, H., Zitnick, C. L., Parikh, D.,&Ba-tra, D. (2016). Human attention in visual question an-swering: Do humans and deep networks look at the same regions?. arXiv preprint arXiv:1606.03556. · arXiv
  6. Das, S., McCarter, A., Minieri, J., Damaraju, N., Pad-manabhan, S.,&Chau, D. H. P. ISPARK: Interactive Visual Analytics for Fire Incidents and Station Place-ment. In ACM SIGKDD Workshop on Interactive Da-ta Exploration and Analytics (p. 29).
  7. Diakopoulis, N. (2018). Algorithm Tips -- Find tips for stories on algorithms. Algorithmtips.org. Retrieved 8 January 2018, from http://algorithmtips.org/
  8. Diakopoulos, N.,&Koliska, M. (2017). Algorithmic Transparency in the News Media. Digital Journalism,
  9. Doshi-Velez, F.,&Kim, B. (2017). A Roadmap for a Rigorous Science of Interpretability. arXiv preprint arXiv:1702.08608. · arXiv
  10. 10.5555/270318.270324 · doi:10.5555/270318.270324
  11. 10.5555/3086952 · doi:10.5555/3086952
  12. Google Scholar. (2018). Google Scholar. Retrieved 7 January 2018, from http://scholar.google.com/
  13. Griffiths, T. L.,&Steyvers, M. (2004). Finding scien-tific topics. Proceedings of the National academy of Sciences, 101 (suppl 1), 5228--5235.
  14. Hailesilassie, T. (2016). Rule extraction algorithm for deep neural networks: A review. arXiv preprint arXiv:1610.05267. · arXiv
  15. Halpern, J. Y.,&Pearl, J. (2005b). Causes and expla-nations: A structural-model approach. Part II: Expla-nations. The British journal for the philosophy of sci-ence, 56(4), 889--911.
  16. 10.5555/3157096.3157133 · doi:10.5555/3157096.3157133
  17. Kim B. (2015a). Interactive and interpretable ma-chine learning models for human machine collabora-tion (Doctoral dissertation Massachusetts Institute of Technology).
  18. Kim, B., Malioutov D. M., Varshney, K. R. Proceed-ings of the 2016 ICML Workshop on Human Inter-pretability in Machine Learning (WHI 2016). arXiv preprint, arXiv:1607.02531. · arXiv
  19. 10.5555/2969033.2969045 · doi:10.5555/2969033.2969045
  20. 10.5555/1759779.1759790 · doi:10.5555/1759779.1759790
  21. Lambiotte, R., Delvenne, J. C.,&Barahona, M. (2008). Laplacian dynamics and multiscale modular structure in networks. arXiv preprint arXiv:0812.1770. · arXiv
  22. Lim, B. Y., Ayalon, O.,&Toch, E. 2017. Reducing Communication Uncertainty with Social Intelligibility: Challenges and Opportunities. In CHI 2017 Workshop on Designing for Uncertainty in HCI.
  23. Lim, B. Y., Smith, A.,&Stumpf, S. (2018). ExSS: Ex-plainable smart systems. In Proceedings of the 23rd ACM International Conference Adjunct Papers on Intelligent User Interfaces.
  24. Lipton, Z. C. (2016). The mythos of model interpreta-bility. arXiv preprint, arXiv:1606.03490. · arXiv
  25. 10.5555/1812799.1812875 · doi:10.5555/1812799.1812875
  26. 10.5555/1053072.1053104 · doi:10.5555/1053072.1053104
  27. Muñoz-Avila, H.,&Aha, D. (2004). On the role of explanation for hierarchical case-based planning in real-time strategy games. In Proceedings of ECCBR-04 Workshop on Explanations in CBR (pp. 1--10).
  28. Norman, D. (2009). The design of future things. Basic books.
  29. 10.2139/ssrn.2512069 · doi:10.2139/ssrn.2512069
  30. Roth-Berghofer, T., Leake, D. B.,&Cassens, J. (2012, July). Explanation-aware Computing ExaCt 2012. In Proceedings of the Seventh International ExaCt workshop.
  31. Scopus | The largest database of peer-reviewed liter-ature | Elsevier. (2018). Elsevier.com. Retrieved 7 January 2018, from https://www.elsevier.com/solutions/scopus
  32. 10.5555/38407 · doi:10.5555/38407
  33. Stolze, M.,&Ströbel, M. (2003). Dealing with learning in ecommerce product navigation and decision sup-port: the teaching salesman problem. In Proceedings of the Second Interdisciplinary World Congress on Mass Customization and Personalization.
  34. USACM. 2017. Statement on Algorithmic Transpar-ency and Accountability. Accessed on 2017-09-09. https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
  35. Zhao, J., Wang, T., Yatskar, M., Ordonez, V.,&Chang, K. W. (2017). Men Also Like Shopping: Re-ducing Gender Bias Amplification using Corpus

Cited by

See all 743

Metadata

Authors
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M.
Affiliations
  • National University of Singapore (SG)
  • Aarhus University (DK)
Venue
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2018-04-21
Pages
1-18
OpenAlex
W2795530988
Cited by
743
References
170
Citations by year
2026: 75 · 2025: 65 · 2024: 95 · 2023: 89 · 2022: 115 · 2021: 125 · 2020: 91 · 2019: 69 · 2018: 18
FWCI
30.94
Type
conference paper
Language
en
Open access
closed
Locations
CHI Conference on Human Factors in Computing Systems (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
explainable systems, algorithmic accountability, model interpretability, human-computer interaction, research trends, research trajectories, context-aware systems, cognitive psychology, autonomous systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. https://app.cochat.ai/papers/10.1145/3173574.3174156
The paper
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018). Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3173574.3174156

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.