CoChat

Rich Screen Reader Experiences for Accessible Data Visualization

Open access
Zong, Jonathan, Lee, Crystal, Lundgard, Alan, Jang, JiWoong, Hajas, Daniel, Satyanarayan, Arvind · 2022 · Computer Graphics Forum
Cited by 89

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Current web accessibility guidelines ask visualization designers to support screen readers via basic non‐visual alternatives like textual descriptions and access to raw data tables. But charts do more than summarize data or reproduce tables; they afford interactive data exploration at varying levels of granularity—from fine‐grained datum‐by‐datum reading to skimming and surfacing high‐level trends. In response to the lack of comparable non‐visual affordances, we present a set of rich screen reader experiences for accessible data visualization and exploration. Through an iterative co‐design process, we identify three key design dimensions for expressive screen reader accessibility: structure, or how chart entities should be organized for a screen reader to traverse; navigation, or the structural, spatial, and targeted operations a user might perform to step through the structure; and, description, or the semantic content, composition, and verbosity of the screen reader's narration. We operationalize these dimensions to prototype screen‐reader‐accessible visualizations that cover a diverse range of chart types and combinations of our design dimensions. We evaluate a subset of these prototypes in a mixed‐methods study with 13 blind and visually impaired readers. Our findings demonstrate that these designs help users conceptualize data spatially, selectively attend to data of interest at different levels of granularity, and experience control and agency over their data analysis process. An accessible HTML version of this paper is available at: http://vis.csail.mit.edu/pubs/rich-screen-reader-vis-experiences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/cgf.14519

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 38

  1. Aldrich Frances K.andSheppard Linda. “Tactile Graphics In School Education: Perspectives From Pupils”.British Journal of Visual Impairment(2001). doi:10.1177/026461960101900204. url:https://doi.org/10.1177/0264619601019002043 9. · DOI
  2. Bagozzi Richard P.“The Legacy of the Technology Acceptance Model and a Proposal for a Paradigm Shift.”Journal of the Association for Information Systems(2007). doi:10.17705/1jais.00122. url:https://aisel.aisnet.org/jais/vol8/iss4/128. · DOI · Paper page
  3. Becker Richard A. Cleveland William S. andShyu Ming‐Jen. “The Visual Design and Control of Trellis Display”.Journal of Computational and Graphical Statistics(1996). doi:10.1080/10618600.1996.10474701. url:http://www.tandfonline.com/doi/abs/10.1080/10618600.1996.104747017. · DOI · Paper page
  4. Bertin Jacques.Semiology of Graphics. University of Wisconsin Press 1983. url:https://dl.acm.org/doi/10.5555/10955975. · doi:10.5555/10955975
  5. Butler Matthew Holloway Leona M Reinders Samuel et al. “Technology Developments in Touch‐Based Accessible Graphics: A Systematic Review of Research 2010‐2020”.ACM Conference on Human Factors in Computing Systems (CHI).2021. url:https://doi.org/10.1145/3411764.34452073. · DOI · Paper page
  6. Barrass StephenandKramer Gregory. “Using Sonification”.Multimedia Systems(1999). doi:10.1007/s005300050108. url:https://doi.org/10.1007/s0053000501082. · DOI
  7. Brehmer MatthewandMunzner Tamara. “A MultiLevel Typology of Abstract Visualization Tasks”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2013. doi:10.1109/TVCG.2013.124. url:http://ieeexplore.ieee.org/document/6634168/7 8. · DOI · Paper page
  8. Baker Catherine M. Milne Lauren R. Drapeau Ryan et al. “Tactile Graphics with a Voice”.ACM Transactions on Accessible Computing (TACCESS)(2016). doi:10.1145/2854005. url:http://doi.org/10.1145/28540053. · DOI
  9. Boger Tal Most Steven B. andFranconeri Steven L.“Jurassic Mark: Inattentional Blindness for a Datasaurus Reveals that Visualizations are Explored not Seen”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2021. doi:10.1109/VIS49827.2021.9623273. url:https://ieeexplore.ieee.org/abstract/document/962327310. · DOI
  10. Brock Anke Truillet Philippe Oriola Bernard andJouffrais Christophe. “Usage Of Multimodal Maps For Blind People: Why And How”.ACM International Conference on Interactive Tabletops and Surfaces (ISS).2010. doi:10.1145/1936652.1936699. url:https://doi.org/10.1145/1936652.19366993. · DOI
  11. Charmaz Kathy.Constructing Grounded Theory. Sage Publications 2006. url:https://uk.sagepub.com/en-gb/eur/constructing-grounded-theory/book2359608.
  12. Cornwall AndreaandJewkes Rachel. “What Is Participatory Research?”:Social Science & Medicine(1995). doi:10.1016/0277‐9536(95)00127‐S. url:https://www.sciencedirect.com/science/article/pii/027795369500127S3. · DOI · Paper page
  13. Choi Jinho Jung Sanghun Park Deok Gun et al. “Visualizing for the Non‐Visual: Enabling the Visually Impaired to Use Visualization”.Computer Graphics Forum (EuroVis)(June2019). doi:10.1111/cgf.13686. url:https://onlinelibrary.wiley.com/doi/10.1111/cgf.136862. · DOI · Paper page
  14. Costanza‐Chock Sasha.Design Justice: Towards an Inter‐sectional Feminist Framework for Design Theory and Practice. MIT Press 2020. url:https://papers.ssrn.com/abstract=31896963.
  15. Chundury Pramod Patnaik Biswaksen Reyazuddin Yasmin et al. “Towards Understanding Sensory Substitution for Accessible Visualization: An Interview Study”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2021). doi:10.1109/TVCG.2021.3114829. url:https://ieeexplore.ieee.org/document/9552177/3 5. · DOI
  16. Dimara EvanthiaandPerin Charles. “What is Interaction for Data Visualization?”:IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2020). doi:10.1109/TVCG.2019.2934283. url:https://hal.archives-ouvertes.fr/hal-021970621. · DOI
  17. Fujiyoshi Mamoru Fujiyoshi Akio Tanaka Hiroshi andIshida Toru. “Universal Design Tactile Graphics Production System BPLOT4 for Blind Teachers and Blind Staffs to Produce Tactile Graphics and Ink Print Graphics of High Quality”.Computers Helping People with Special Needs. Ed. by Miesenberger Klaus and Kouroupetroglou Georgios. Springer International Publishing 2018. url:http://link.springer.com/10.1007/978-3-319-94274-2_233. · doi:10.1007/978-3-319-94274-2_23
  18. Fr⊘kjær ErikandHornbæk Kasper. “Cooperative Usability Testing: Complementing Usability Tests With User‐Supported Interpretation Sessions”.ACM Extended Abstracts on Human Factors in Computing Systems (CHI).2005. doi:10.1145/1056808.1056922. url:https://doi.org/10.1145/1056808.10569226 7. · DOI
  19. Godfrey A.JonathanR.andLoots M. Theodor. “Advice From Blind Teachers on How to Teach Statistics to Blind Students”.Journal of Statistics Education(2015). doi:10.1080/10691898.2015.11889746. url:https://doi.org/10.1080/10691898.2015.118897463 8. · doi:10.1080/10691898.2015.11889746
  20. Hamraie Aimi. “Designing Collective Access: A Feminist Disability Theory of Universal Design”.Disability Studies Quarterly(2013). doi:10.18061/dsq.v33i4.3871. url:http://dsq-sds.org/article/view/38713. · DOI · Paper page
  21. Horst Allison M. Hill Alison Presmanes andGorman Kristen B.Palmerpenguins: Palmer Archipelago (Antarctica) Penguin Data.2020. url:https://github.com/allisonhorst/palmerpenguins7. · doi:10.32614/cran.package.palmerpenguins
  22. Heer JeffreyandShneiderman Ben. “Interactive Dynamics for Visual Analysis”.Communications of the ACM(2012). doi:10.1145/2133806.2133821. url:https://dl.acm.org/doi/10.1145/2133806.21338211 10. · DOI · Paper page
  23. Koch Wolf Günther. “State of the Art of Tactile Maps for Visually Impaired People”.True‐3D in Cartography: Autostereoscopic and Solid Visualisation of Geodata. Ed. by Buchroithner Manfred. Springer 2012. doi:10.1007/978‐3‐642‐12272‐9_9. url:https://doi.org/10.1007/978-3-642-12272-9_93. · doi:10.1007/978-3-642-12272-9_9
  24. Karahanna ElenaandStraub Detmar W.“The Psychological Origins of Perceived Usefulness and Ease‐of‐use”.Information and Management(1999). doi:10.1016/S0378‐7206(98)00096‐2. url:https://doi.org/10.1016/S0378-7206(98)00096‐2 8. · DOI · Paper page
  25. Kaper H.G. Wiebel E. andTipei S.“Data Sonification And Sound Visualization”.Computing in Science Engineering(1999). doi:10.1109/5992.7748402. · doi:10.1109/5992.774840
  26. Li Jingyi Kim Son Miele Joshua A. et al. “Editing Spatial Layouts through Tactile Templates for People with Visual Impairments”.ACM Conference on Human Factors in Computing Systems (CHI).2019. doi:10.1145/3290605.3300436. url:http://dl.acm.org/citation.cfm?doid=3290605.33004365. · DOI · Paper page
  27. Lundgard Alan Lee Crystal andSatyanarayan Arvind. “Sociotechnical Considerations for Accessible Visualization Design”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2019. doi:10.1109/VISUAL.2019.8933762. url:https://ieeexplore.ieee.org/abstract/document/89337622. · DOI · Paper page
  28. Martínez Rubén Alcaraz Turró Mireia Ribera andSaltiveri Toni Granollers. “Accessible Statistical Charts For People With Low Vision And Colour Vision Deficiency”.ACM International Conference on Human Computer Interaction. June2019. doi:10.1145/3335595.3335618. url:https://doi.org/10.1145/3335595.33356183. · DOI
  29. Munzner Tamara. “A Nested Model for Visualization Design and Validation”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2009). Conference Name: IEEE Transactions on Visualization and Computer Graphics. doi:10.1109/TVCG.2009.111. url:https://ieeexplore.ieee.org/abstract/document/52906959. · DOI · Paper page
  30. Potluri Venkatesh Grindeland Tadashi E Froehlich Jon E. andMankoff Jennifer. “Examining Visual Semantic Understanding in Blind and Low‐Vision Technology Users”.ACM Conference on Human Factors in Computing Systems (CHI).2021. doi:10.1145/3411764.3445040. url:https://dl.acm.org/doi/abs/10.1145/3411764.34450402. · DOI · Paper page
  31. Sheppard LindaandAldrich Frances K.“Tactile Graphics In School Education: Perspectives From Pupils”.British Journal of Visual Impairment(2001). doi:10.1177/026461960101900303. url:https://doi.org/10.1177/0264619601019003039. · DOI · Paper page
  32. Sharif Ather Chintalapati Sanjana Shivani Wobbrock Jacob O. andReinecke Katharina. “Understanding Screen‐Reader Users' Experiences with Online Data Visualizations”.ACM Conference on Computers and Accessibility (SIGACCESS).2021. doi:10.1145/3441852.3471202. url:http://doi.org/10.1145/3441852.34712021 2 4 8 9. · DOI · Paper page
  33. Shneiderman Ben. “The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations”.The Craft of Information Visualization. Ed. by Bederson BENJAMIN B. and Shneiderman BEN. Morgan Kaufmann 2003. doi:10.1016/B978‐155860915‐0/50046‐9. url:https://www.sciencedirect.com/science/article/pii/B97815586091505004691 9. · DOI · Paper page
  34. Satyanarayan Arvind Moritz Dominik Wongsuphasawat Kanit andHeer Jeffrey. “Vega‐Lite: A Grammar of Interactive Graphics”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2017. doi:10.1109/TVCG.2016.2599030. url:https://ieeexplore.ieee.org/abstract/document/75396242 6. · DOI · Paper page
  35. Weninger Markus Ortner Gerald Hahn Tobias et al. “ASVG Accessible Scalable Vector Graphics: Intention Trees To Make Charts More Accessible And Usable”.Journal of Assistive Technologies(2015). doi:10.1108/JAT‐10‐2015‐01243. · doi:10.1108/jat-10-2015-0124
  36. Wu Keke Petersen Emma Ahmad Tahmina et al. “Understanding Data Accessibility for People with Intellectual and Developmental Disabilities”.ACM Conference on Human Factors in Computing Systems (CHI).2021. doi:10.1145/3411764.3445743. url:https://dl.acm.org/doi/abs/10.1145/3411764.34457432. · DOI · Paper page
  37. Yi Ji Soo Kang Younah Stasko John and Jacko J.A. “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2007). Conference Name: IEEE Transactions on Visualization and Computer Graphics. doi:10.1109/TVCG.2007.70515. url:https://ieeexplore.ieee.org/abstract/document/43761441 10. · DOI · Paper page
  38. Yu Wai Ramloll Ramesh andBrewster Stephen. “Haptic Graphs For Blind Computer Users”.Lecture Notes in Computer Science(2001). Ed. by Brewster Stephen and Murray‐Smith Roderick. doi:10.1007/3‐540‐44589‐7_5. url:http://link.springer.com/10.1007/3-540-44589-7_52. · DOI

Cited by

See all 89

Metadata

Authors
Zong, J., Lee, C., Lundgard, A., Jang, J., Hajas, D., & Satyanarayan, A.
Venue
Computer Graphics Forum
Publisher
Wiley
Published
2022-06
Volume
41
Issue
3
Pages
15-27
ISSN
  • 0167-7055 (ISSN-L)
  • 1467-8659
OpenAlex
W4280523692
Cited by
89
References
11
FWCI
48.33
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Rich Screen Reader Experiences for Accessible Data Visualization. https://app.cochat.ai/papers/10.1111/cgf.14519
The paper
Zong, J., Lee, C., Lundgard, A., Jang, J., Hajas, D., & Satyanarayan, A. (2022). Rich Screen Reader Experiences for Accessible Data Visualization. Computer Graphics Forum. https://doi.org/10.1111/cgf.14519

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.