Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 83 of the 86 references it cites were found in a registry or an index.

Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content

Open access
Lundgard, Alan, Satyanarayan, Arvind · 2022 · IEEE Transactions on Visualization and Computer Graphics

Abstract

Natural language descriptions sometimes accompany visualizations to better communicate and contextualize their insights, and to improve their accessibility for readers with disabilities. However, it is difficult to evaluate the usefulness of these descriptions, and how effectively they improve access to meaningful information, because we have little understanding of the semantic content they convey, and how different readers receive this content. In response, we introduce a conceptual model for the semantic content conveyed by natural language descriptions of visualizations. Developed through a grounded theory analysis of 2,147 sentences, our model spans four levels of semantic content: enumerating visualization construction properties (e.g., marks and encodings); reporting statistical concepts and relations (e.g., extrema and correlations); identifying perceptual and cognitive phenomena (e.g., complex trends and patterns); and elucidating domain-specific insights (e.g., social and political context). To demonstrate how our model can be applied to evaluate the effectiveness of visualization descriptions, we conduct a mixed-methods evaluation with 30 blind and 90 sighted readers, and find that these reader groups differ significantly on which semantic content they rank as most useful. Together, our model and findings suggest that access to meaningful information is strongly reader-specific, and that research in automatic visualization captioning should orient toward descriptions that more richly communicate overall trends and statistics, sensitive to reader preferences. Our work further opens a space of research on natural language as a data interface coequal with visualization.

Overview

Integrity signals

Registry

Crossref · 10.1109/tvcg.2021.3114770

Cites

83 of 83 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 86 references

Research works printed but not linked: 25

  1. gould, 2008, Effective Practices for Description of Science Content within Digital Talking Books
  2. geveci, 2012, VTK, The Architecture of Open Source Applications
  3. fleet, 2021, Things which garner a ton of glowing reviews from mainstream outlets without being of much use to disabled people, For instance Facebook's auto image descriptions much loved by sighted journos but famously useless in the Blind community Twitter
  4. fisher, 2019, Creating Accessible SVGs
  5. elzer, 0, A Browser Extension For Providing Visually Impaired Users Access To The Content Of Bar Charts On The Web, WEBIS
  6. gao, 0, Data-Tone: Managing Ambiguity in Natural Language Interfaces for Data Visualization, UIST
  7. fossheim, 2020, An Introduction To Accessible Data Visualizations With D3 js
  8. ehrenkranz, 2020, Vital Coronavirus Information Is Failing the Blind and Visually Impaired, Vice
  9. elavsky, 2021, Chartability
  10. watson, 2017, Accessible SVG Line Graphs
  11. demir, 0, Generating textual summaries of bar chartsGenerating Textual Summaries Of Bar Charts, INLG
  12. 0, Making Images Accessible
  13. hasty, 2011, Guidelines and Standards for Tactile Graphics
  14. lee, 0, Vlat: Development Of A Visualization Literacy Assessment Test, TVCG
  15. littlefield, 2020, COVID-19 Statistics Tracker
  16. livingston, 0, Position: Visual Sentences: Definitions and Applications, VIS
  17. ackland, 2017, World Blindness and Visual Impairment, Community Eye Health Journal
  18. wilkinson, 2005, The Grammar of Graphics, Statistics and Computing
  19. watson, 2018, Accessible SVG Flowcharts
  20. 2019, WAI Web Accessibility Tutorials Complex Images
  21. team, 2014, Bokeh Python library for interactive visualization
  22. bergstrom, 2020, SARS-CoV-2 Coronavirus
  23. bertin, 1983, Semiology of Graphics
  24. cesal, 2020, Writing Alt Text for Data Visualization
  25. schepers, 2020, Why Accessibility Is at the Heart of Data Visualization

Cited by

See all 170

Metadata

Authors
Lundgard, A., & Satyanarayan, A.
Affiliations
MIT Computer Science and Artificial Intelligence Laboratory (US)
Venue
IEEE Transactions on Visualization and Computer Graphics
Published
2022-01
Volume
28
Issue
1
Pages
1073-1083
ISSN
  • 1077-2626 (ISSN-L)
  • 1941-0506
  • 2160-9306
OpenAlex
W3202687543
Cited by
155
References
86
Citations by year
2026: 30 · 2025: 47 · 2024: 36 · 2023: 26 · 2022: 14
FWCI
7.01
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Visualization and Computer Graphics (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (GRFP-1122374, III-1900991)
Topics
  • Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
Keywords
blind readers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content. https://app.cochat.ai/papers/10.1109/tvcg.2021.3114770
The paper
Lundgard, A., & Satyanarayan, A. (2022). Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content. IEEE Transactions on Visualization and Computer Graphics. https://doi.org/10.1109/tvcg.2021.3114770

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.