Rich Screen Reader Experiences for Accessible Data Visualization
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Current web accessibility guidelines ask visualization designers to support screen readers via basic non‐visual alternatives like textual descriptions and access to raw data tables. But charts do more than summarize data or reproduce tables; they afford interactive data exploration at varying levels of granularity—from fine‐grained datum‐by‐datum reading to skimming and surfacing high‐level trends. In response to the lack of comparable non‐visual affordances, we present a set of rich screen reader experiences for accessible data visualization and exploration. Through an iterative co‐design process, we identify three key design dimensions for expressive screen reader accessibility: structure, or how chart entities should be organized for a screen reader to traverse; navigation, or the structural, spatial, and targeted operations a user might perform to step through the structure; and, description, or the semantic content, composition, and verbosity of the screen reader's narration. We operationalize these dimensions to prototype screen‐reader‐accessible visualizations that cover a diverse range of chart types and combinations of our design dimensions. We evaluate a subset of these prototypes in a mixed‐methods study with 13 blind and visually impaired readers. Our findings demonstrate that these designs help users conceptualize data spatially, selectively attend to data of interest at different levels of granularity, and experience control and agency over their data analysis process. An accessible HTML version of this paper is available at: http://vis.csail.mit.edu/pubs/rich-screen-reader-vis-experiences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bostock, M., Ogievetsky, V., & Heer, J. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.185 · Cited by 3,165
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471
Pirolli, P., & Card, S. (1999) · Psychological Review · doi:10.1037//0033-295x.106.4.643 · Cited by 1,412
Sengers, P., Boehner, K., David, S., & Kaye, J. '. (2005) · Proceedings of the 4th decennial conference on Critical computing: between sense and sensibility · doi:10.1145/1094562.1094569 · Cited by 1,030
Anonymising interview data: challenges and compromise in practice
Saunders, B., Kitzinger, J., & Kitzinger, C. (2015) · Qualitative Research · doi:10.1177/1468794114550439 · Cited by 653
Ableism, technoableism, and future AI
Shew, A. (2020) · IEEE Technology and Society Magazine · doi:10.1109/mts.2020.2967492 · Cited by 201
Rich Representations of Visual Content for Screen Reader Users
Morris, M. R., Johnson, J., Bennett, C. L., & Cutrell, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173633 · Cited by 159 · cited 2×
“However, median scores (which are more robust to outliers than means [MJBC18]) suggest that participants generally enjoy interacting with MULTIVIEW and TARGET more, and found them easier to lookup or locate data with.”
BackgroundAccessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114770 · Cited by 155
Self-citationAccessible Visualization: Design Space, Opportunities, and Challenges
Kim, N. W., Joyner, S. C., Riegelhuth, A., & Kim, Y. (2021) · Computer Graphics Forum · doi:10.1111/cgf.14298 · Cited by 137
Jung, C., Mehta, S., Kulkarni, A., Zhao, Y., & Kim, Y.-S. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114846 · Cited by 91
Interdependent Variables: Remotely Designing Tactile Graphics for an Accessible Workflow
de Greef, L., Moritz, D., & Bennett, C. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3476468 · Cited by 16
Research works printed but not linked: 38
- Aldrich Frances K.andSheppard Linda. “Tactile Graphics In School Education: Perspectives From Pupils”.British Journal of Visual Impairment(2001). doi:10.1177/026461960101900204. url:https://doi.org/10.1177/0264619601019002043 9. · DOI
- Bagozzi Richard P.“The Legacy of the Technology Acceptance Model and a Proposal for a Paradigm Shift.”Journal of the Association for Information Systems(2007). doi:10.17705/1jais.00122. url:https://aisel.aisnet.org/jais/vol8/iss4/128. · DOI · Paper page
- Becker Richard A. Cleveland William S. andShyu Ming‐Jen. “The Visual Design and Control of Trellis Display”.Journal of Computational and Graphical Statistics(1996). doi:10.1080/10618600.1996.10474701. url:http://www.tandfonline.com/doi/abs/10.1080/10618600.1996.104747017. · DOI · Paper page
- Bertin Jacques.Semiology of Graphics. University of Wisconsin Press 1983. url:https://dl.acm.org/doi/10.5555/10955975. · doi:10.5555/10955975
- Butler Matthew Holloway Leona M Reinders Samuel et al. “Technology Developments in Touch‐Based Accessible Graphics: A Systematic Review of Research 2010‐2020”.ACM Conference on Human Factors in Computing Systems (CHI).2021. url:https://doi.org/10.1145/3411764.34452073. · DOI · Paper page
- Barrass StephenandKramer Gregory. “Using Sonification”.Multimedia Systems(1999). doi:10.1007/s005300050108. url:https://doi.org/10.1007/s0053000501082. · DOI
- Brehmer MatthewandMunzner Tamara. “A MultiLevel Typology of Abstract Visualization Tasks”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2013. doi:10.1109/TVCG.2013.124. url:http://ieeexplore.ieee.org/document/6634168/7 8. · DOI · Paper page
- Baker Catherine M. Milne Lauren R. Drapeau Ryan et al. “Tactile Graphics with a Voice”.ACM Transactions on Accessible Computing (TACCESS)(2016). doi:10.1145/2854005. url:http://doi.org/10.1145/28540053. · DOI
- Boger Tal Most Steven B. andFranconeri Steven L.“Jurassic Mark: Inattentional Blindness for a Datasaurus Reveals that Visualizations are Explored not Seen”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2021. doi:10.1109/VIS49827.2021.9623273. url:https://ieeexplore.ieee.org/abstract/document/962327310. · DOI
- Brock Anke Truillet Philippe Oriola Bernard andJouffrais Christophe. “Usage Of Multimodal Maps For Blind People: Why And How”.ACM International Conference on Interactive Tabletops and Surfaces (ISS).2010. doi:10.1145/1936652.1936699. url:https://doi.org/10.1145/1936652.19366993. · DOI
- Charmaz Kathy.Constructing Grounded Theory. Sage Publications 2006. url:https://uk.sagepub.com/en-gb/eur/constructing-grounded-theory/book2359608.
- Cornwall AndreaandJewkes Rachel. “What Is Participatory Research?”:Social Science & Medicine(1995). doi:10.1016/0277‐9536(95)00127‐S. url:https://www.sciencedirect.com/science/article/pii/027795369500127S3. · DOI · Paper page
- Choi Jinho Jung Sanghun Park Deok Gun et al. “Visualizing for the Non‐Visual: Enabling the Visually Impaired to Use Visualization”.Computer Graphics Forum (EuroVis)(June2019). doi:10.1111/cgf.13686. url:https://onlinelibrary.wiley.com/doi/10.1111/cgf.136862. · DOI · Paper page
- Costanza‐Chock Sasha.Design Justice: Towards an Inter‐sectional Feminist Framework for Design Theory and Practice. MIT Press 2020. url:https://papers.ssrn.com/abstract=31896963.
- Chundury Pramod Patnaik Biswaksen Reyazuddin Yasmin et al. “Towards Understanding Sensory Substitution for Accessible Visualization: An Interview Study”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2021). doi:10.1109/TVCG.2021.3114829. url:https://ieeexplore.ieee.org/document/9552177/3 5. · DOI
- Dimara EvanthiaandPerin Charles. “What is Interaction for Data Visualization?”:IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2020). doi:10.1109/TVCG.2019.2934283. url:https://hal.archives-ouvertes.fr/hal-021970621. · DOI
- Fujiyoshi Mamoru Fujiyoshi Akio Tanaka Hiroshi andIshida Toru. “Universal Design Tactile Graphics Production System BPLOT4 for Blind Teachers and Blind Staffs to Produce Tactile Graphics and Ink Print Graphics of High Quality”.Computers Helping People with Special Needs. Ed. by Miesenberger Klaus and Kouroupetroglou Georgios. Springer International Publishing 2018. url:http://link.springer.com/10.1007/978-3-319-94274-2_233. · doi:10.1007/978-3-319-94274-2_23
- Fr⊘kjær ErikandHornbæk Kasper. “Cooperative Usability Testing: Complementing Usability Tests With User‐Supported Interpretation Sessions”.ACM Extended Abstracts on Human Factors in Computing Systems (CHI).2005. doi:10.1145/1056808.1056922. url:https://doi.org/10.1145/1056808.10569226 7. · DOI
- Godfrey A.JonathanR.andLoots M. Theodor. “Advice From Blind Teachers on How to Teach Statistics to Blind Students”.Journal of Statistics Education(2015). doi:10.1080/10691898.2015.11889746. url:https://doi.org/10.1080/10691898.2015.118897463 8. · doi:10.1080/10691898.2015.11889746
- Hamraie Aimi. “Designing Collective Access: A Feminist Disability Theory of Universal Design”.Disability Studies Quarterly(2013). doi:10.18061/dsq.v33i4.3871. url:http://dsq-sds.org/article/view/38713. · DOI · Paper page
- Horst Allison M. Hill Alison Presmanes andGorman Kristen B.Palmerpenguins: Palmer Archipelago (Antarctica) Penguin Data.2020. url:https://github.com/allisonhorst/palmerpenguins7. · doi:10.32614/cran.package.palmerpenguins
- Heer JeffreyandShneiderman Ben. “Interactive Dynamics for Visual Analysis”.Communications of the ACM(2012). doi:10.1145/2133806.2133821. url:https://dl.acm.org/doi/10.1145/2133806.21338211 10. · DOI · Paper page
- Koch Wolf Günther. “State of the Art of Tactile Maps for Visually Impaired People”.True‐3D in Cartography: Autostereoscopic and Solid Visualisation of Geodata. Ed. by Buchroithner Manfred. Springer 2012. doi:10.1007/978‐3‐642‐12272‐9_9. url:https://doi.org/10.1007/978-3-642-12272-9_93. · doi:10.1007/978-3-642-12272-9_9
- Karahanna ElenaandStraub Detmar W.“The Psychological Origins of Perceived Usefulness and Ease‐of‐use”.Information and Management(1999). doi:10.1016/S0378‐7206(98)00096‐2. url:https://doi.org/10.1016/S0378-7206(98)00096‐2 8. · DOI · Paper page
- Kaper H.G. Wiebel E. andTipei S.“Data Sonification And Sound Visualization”.Computing in Science Engineering(1999). doi:10.1109/5992.7748402. · doi:10.1109/5992.774840
- Li Jingyi Kim Son Miele Joshua A. et al. “Editing Spatial Layouts through Tactile Templates for People with Visual Impairments”.ACM Conference on Human Factors in Computing Systems (CHI).2019. doi:10.1145/3290605.3300436. url:http://dl.acm.org/citation.cfm?doid=3290605.33004365. · DOI · Paper page
- Lundgard Alan Lee Crystal andSatyanarayan Arvind. “Sociotechnical Considerations for Accessible Visualization Design”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2019. doi:10.1109/VISUAL.2019.8933762. url:https://ieeexplore.ieee.org/abstract/document/89337622. · DOI · Paper page
- Martínez Rubén Alcaraz Turró Mireia Ribera andSaltiveri Toni Granollers. “Accessible Statistical Charts For People With Low Vision And Colour Vision Deficiency”.ACM International Conference on Human Computer Interaction. June2019. doi:10.1145/3335595.3335618. url:https://doi.org/10.1145/3335595.33356183. · DOI
- Munzner Tamara. “A Nested Model for Visualization Design and Validation”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2009). Conference Name: IEEE Transactions on Visualization and Computer Graphics. doi:10.1109/TVCG.2009.111. url:https://ieeexplore.ieee.org/abstract/document/52906959. · DOI · Paper page
- Potluri Venkatesh Grindeland Tadashi E Froehlich Jon E. andMankoff Jennifer. “Examining Visual Semantic Understanding in Blind and Low‐Vision Technology Users”.ACM Conference on Human Factors in Computing Systems (CHI).2021. doi:10.1145/3411764.3445040. url:https://dl.acm.org/doi/abs/10.1145/3411764.34450402. · DOI · Paper page
- Sheppard LindaandAldrich Frances K.“Tactile Graphics In School Education: Perspectives From Pupils”.British Journal of Visual Impairment(2001). doi:10.1177/026461960101900303. url:https://doi.org/10.1177/0264619601019003039. · DOI · Paper page
- Sharif Ather Chintalapati Sanjana Shivani Wobbrock Jacob O. andReinecke Katharina. “Understanding Screen‐Reader Users' Experiences with Online Data Visualizations”.ACM Conference on Computers and Accessibility (SIGACCESS).2021. doi:10.1145/3441852.3471202. url:http://doi.org/10.1145/3441852.34712021 2 4 8 9. · DOI · Paper page
- Shneiderman Ben. “The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations”.The Craft of Information Visualization. Ed. by Bederson BENJAMIN B. and Shneiderman BEN. Morgan Kaufmann 2003. doi:10.1016/B978‐155860915‐0/50046‐9. url:https://www.sciencedirect.com/science/article/pii/B97815586091505004691 9. · DOI · Paper page
- Satyanarayan Arvind Moritz Dominik Wongsuphasawat Kanit andHeer Jeffrey. “Vega‐Lite: A Grammar of Interactive Graphics”.IEEE Transactions on Visualization & Computer Graphics (Proc. IEEE VIS).2017. doi:10.1109/TVCG.2016.2599030. url:https://ieeexplore.ieee.org/abstract/document/75396242 6. · DOI · Paper page
- Weninger Markus Ortner Gerald Hahn Tobias et al. “ASVG Accessible Scalable Vector Graphics: Intention Trees To Make Charts More Accessible And Usable”.Journal of Assistive Technologies(2015). doi:10.1108/JAT‐10‐2015‐01243. · doi:10.1108/jat-10-2015-0124
- Wu Keke Petersen Emma Ahmad Tahmina et al. “Understanding Data Accessibility for People with Intellectual and Developmental Disabilities”.ACM Conference on Human Factors in Computing Systems (CHI).2021. doi:10.1145/3411764.3445743. url:https://dl.acm.org/doi/abs/10.1145/3411764.34457432. · DOI · Paper page
- Yi Ji Soo Kang Younah Stasko John and Jacko J.A. “Toward a Deeper Understanding of the Role of Interaction in Information Visualization”.IEEE Transactions on Visualization and Computer Graphics (Proc. IEEE VIS)(2007). Conference Name: IEEE Transactions on Visualization and Computer Graphics. doi:10.1109/TVCG.2007.70515. url:https://ieeexplore.ieee.org/abstract/document/43761441 10. · DOI · Paper page
- Yu Wai Ramloll Ramesh andBrewster Stephen. “Haptic Graphs For Blind Computer Users”.Lecture Notes in Computer Science(2001). Ed. by Brewster Stephen and Murray‐Smith Roderick. doi:10.1007/3‐540‐44589‐7_5. url:http://link.springer.com/10.1007/3-540-44589-7_52. · DOI
Cited by
Fan, D., Fay Siu, A., Rao, H., Kim, G. S.-H., Vazquez, X., Greco, L., O'Modhrain, S., & Follmer, S. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3557899 · Cited by 46
“Based on these observations and echoing recommendations from several recent works, we suggest that the reading order of a visualization should provide contextual overviews before specific data points and details [67], and coordinate data points with corresponding details [137] as users interact with the visualization.”
BackgroundSharif, A., Zhang, A. M., Reinecke, K., & Wobbrock, J. O. (2023) · 20th International Web for All Conference · doi:10.1145/3587281.3587284 · Cited by 21
“Prior work has reported that alternative textual descriptions (“alt-text”) for visualizations are often missing [1, 3].”
BackgroundReviving Static Charts Into Live Charts
Ying, L., Wang, Y., Li, H., Dou, S., Zhang, H., Jiang, X., Qu, H., & Wu, Y. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3397004 · Cited by 19
Accessible IoT Dashboard Design with AI-Enhanced Descriptions for Visually Impaired Users
Stelea, G. A., Sangeorzan, L., & Enache-David, N. (2025) · Future Internet · doi:10.3390/fi17070274 · Cited by 5
Chart Accessibility: A Review of Current Alt Text Generation
Yan, C., Hutter, H.-P., Schmitt-Koopmann, F. M., & Darvishy, A. (2025) · IEEE Access · doi:10.1109/access.2025.3571626 · Cited by 5
Metadata
- Authors
- Zong, J., Lee, C., Lundgard, A., Jang, J., Hajas, D., & Satyanarayan, A.
- Venue
- Computer Graphics Forum
- Publisher
- Wiley
- Published
- 2022-06
- Volume
- 41
- Issue
- 3
- Pages
- 15-27
- ISSN
- 0167-7055 (ISSN-L)
- 1467-8659
- OpenAlex
- W4280523692
- Cited by
- 89
- References
- 11
- FWCI
- 48.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.