CoChat

Visual, textual or hybrid: the effect of user expertise on different explanations

Open access
Szymanski, Maxwell, Millecamp, Martijn, Verbert, Katrien · 2021 · 26th International Conference on Intelligent User Interfaces

The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.

Abstract

As the use of AI algorithms keeps rising continuously, so does the need for their transparency and accountability. However, literature often adopts a one-size-fits-all approach for developing explanations when in practice, the type of explanations needed depends on the type of end-user. This research will look at user expertise as a variable to see how different levels of expertise influence the understanding of explanations. The first iteration consists of developing two common types of explanations (visual and textual explanations) that explain predictions made by a general class of predictive model learners. These explanations are then evaluated by users of different expertise backgrounds to compare the understanding and ease-of-use of each type of explanation with respect to the different expertise groups. Results show strong differences between experts and lay users when using visual and textual explanations, as well as lay users having a preference for visual explanations which they perform significantly worse with. To solve this problem, the second iteration of this research focuses on the shortcomings of the first two explanations and tries to minimize the difference in understanding between both expertise groups. This is done through the means of developing and testing a candidate solution in the form of hybrid explanations, which essentially combine both visual and textual explanations. This hybrid form of explanations shows a significant improvement in terms of correct understanding (for lay users in particular) when compared to visual explanations, whilst not compromising on ease-of-use at the same time.

Overview

Integrity signals

Registry

Crossref · 10.1145/3397481.3450662

Cites

35 of 35 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 35 references

Research works printed but not linked: 6

  1. Leilani H Gilpin , David Bau , Ben Z Yuan , Ayesha Bajwa , Michael Specter , and Lalana Kagal . 2018. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE DSAA . IEEE , 80–89. Leilani H Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. 2018. Explaining explanations: An overview of interpretability of machine learning. In 2018 IEEE DSAA. IEEE, 80–89.
  2. Peter Goos and Bradley Jones. 2011. Optimal Design of Experiments: A Case-Study Approach. https://doi.org/10.1002/9781119974017 · DOI · Paper page
  3. David Gunning . 2017. Explainable artificial intelligence (xai) . Defense Advanced Research Projects Agency (DARPA) , nd Web 2 ( 2017 ), 2. David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2 (2017), 2.
  4. Josua Krause Adam Perer and Kenney Ng. 2016. Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models. 5686-5697. https://doi.org/10.1145/2858036.2858529 · DOI · Paper page
  5. Mireia Ribera Turró and Agata Lapedriza . 2019 . Can we do better explanations? A proposal of User-Centered Explainable AI . In IUI Workshops. Mireia Ribera Turró and Agata Lapedriza. 2019. Can we do better explanations? A proposal of User-Centered Explainable AI. In IUI Workshops.
  6. Aaron Springer and Steve Whittaker . 2019 . Making Transparency Clear. In Algorithmic Transparency for Emerging Technologies Workshop. 5. Aaron Springer and Steve Whittaker. 2019. Making Transparency Clear. In Algorithmic Transparency for Emerging Technologies Workshop. 5.

Cited by

See all 194

Metadata

Authors
Szymanski, M., Millecamp, M., & Verbert, K.
Affiliations
KU Leuven (BE)
Venue
26th International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2021-04-14
Pages
109-119
OpenAlex
W3155920732
Cited by
131
References
33
Citations by year
2026: 24 · 2025: 34 · 2024: 26 · 2023: 30 · 2022: 15 · 2021: 2
FWCI
8.42
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
  • Lirias (submittedVersion, other-oa)
Funders
Research Foundation Flanders (FWO) (G0A3319N)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
explainable AI, user expertise, visual explanations, textual explanations, model interpretability, non-expert users, expert users, ease of use, transparency and accountability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Visual, textual or hybrid: the effect of user expertise on different explanations. https://app.cochat.ai/papers/10.1145/3397481.3450662
The paper
Szymanski, M., Millecamp, M., & Verbert, K. (2021). Visual, textual or hybrid: the effect of user expertise on different explanations. 26th International Conference on Intelligent User Interfaces. https://doi.org/10.1145/3397481.3450662

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.