Understanding Screen-Reader Users’ Experiences with Online Data Visualizations
The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
Online data visualizations are widely used to communicate information from simple statistics to complex phenomena, supporting people in gaining important insights from data. However, due to the defining visual nature of data visualizations, extracting information from visualizations can be difficult or impossible for screen-reader users. To assess screen-reader users’ challenges with online data visualizations, we conducted two empirical studies: (1) A qualitative study with nine screen-reader users, and (2) a quantitative study with 36 screen-reader and 36 non-screen-reader users. Our results show that due to the inaccessibility of online data visualizations, screen-reader users extract information 61.48% less accurately and spend 210.96% more time interacting with online data visualizations compared to non-screen-reader users. Additionally, our findings show that online data visualizations are commonly indiscoverable to screen readers. In visualizations that are discoverable and comprehensible, screen-reader users suggested tabular and textual representation of data as techniques to improve the accessibility of online visualizations. Taken together, our results provide empirical evidence of the inequalities screen-readers users face in their interaction with online data visualizations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Without alt text, people with accessibility needs face significant challenges [22, 69], such as understanding the visual content in academic materials [37, 88, 90].”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [69]
In the citing paper
“Detailed alternative (alt) text or image descriptions 1 are essential for understanding visual content for people with specific accessibility needs, for instance, for those who are blind, have low vision, or have learning disabilities and use screen readers [37, 69, 79].”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [69]
In the citing paper
“It is a well-known phenomenon that screen reader users receive significantly less information from visual content, with research estimating up to 60% loss in conveyed information for vision-impaired users compared to sighted people [69].”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [69]
In the citing paper
“Altogether, prior work [40, 69, 79] emphasizes the importance of evaluating alt text by establishing baseline metrics, for instance, by semantic content scoring and user/human comprehension analysis.”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [69]
In the citing paper
“In cases when alt-text is present, screen-reader users (SRUs) spend 211% more time and are 61% less accurate in extracting information than their non-screenreader user counterparts [68].”
From Understanding and Improving Drilled-Down Information Extraction from Online Data Visualizations for Screen-Reader Users (2023) · cites this paper as [68]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
(1990) · Cited by 24,217
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
(1987) · Open Research Online - ORO (The Open University) · Cited by 4,513
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467 · cited 1×
“Cramer’s V is a measure of effect size [16].”
BackgroundStatistical analysis of repeated measures data using SAS procedures.
Littell, R. C., Henry, P. R., & Ammerman, C. B. (1998) · Journal of Animal Science · doi:10.2527/1998.7641216x · Cited by 2,825 · cited 2×
“Table 5: Summary results from 72 screen-reader and non-screen-reader participants using a mixed-effects model analysis of variance [18, 30].”
MethodLog-normal distributions across the sciences: keys and clues
LIMPERT, E., STAHEL, W. A., & ABBT, M. (2001) · BioScience · doi:10.1641/0006-3568(2001)051[0341:lndats]2.0.co;2 · Cited by 2,621 · cited 1×
“is common practice for time measures [6, 24, 29].”
Anderson, T. W., & Darling, D. A. (1954) · Journal of the American Statistical Association · doi:10.1080/01621459.1954.10501232 · Cited by 2,450 · cited 1×
“Anderson-Darling [5] goodness-of-fit tests of normality showed that the interaction times were conditionally non-normal.”
BackgroundDiscourse and Social Psychology: Beyond Attitudes and Behaviour
BOWERS, J. (1988) · British Journal of Social Psychology · doi:10.1111/j.2044-8309.1988.tb00818.x · Cited by 2,049
Anderson, T. W., & Darling, D. A. (1954) · Journal of the American Statistical Association · doi:10.2307/2281537 · Cited by 1,476
Eta-squared and partial eta-squared in fixed factor anova designs
Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300111 · Cited by 1,333 · cited 1×
“Partial eta-squared (η2 p ) is a measure of effect size [15].”
CONSIDERATIONS IN THE CHOICE OF INTEROBSERVER RELIABILITY ESTIMATES
Hartmann, D. P. (1977) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1977.10-103 · Cited by 762 · cited 2×
“IRR was therefore calculated as 88÷106×100 = 83%, demonstrating an acceptable level of agreement [20, 22].”
MethodA Multi-Level Typology of Abstract Visualization Tasks
Brehmer, M., & Munzner, T. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.124 · Cited by 747 · cited 1×
“The categories were derived based on Brehmer and Munzner’s task topology [11].”
MethodWhat Makes a Visualization Memorable?
Borkin, M. A., Vo, A. A., Bylinskii, Z., Isola, P., Sunkavalli, S., Oliva, A., & Pfister, H. (2013) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2013.234 · Cited by 666 · cited 2×
“’s[8] dataset comprising 2,068 two-dimensional single-panel visualizations”
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374
Self-citation(1995) · Medical Entomology and Zoology · Cited by 353
The analysis of binomial data by a generalized linear mixed model
GILMOUR, A. R., ANDERSON, R. D., & RAE, A. L. (1985) · Biometrika · doi:10.1093/biomet/72.3.593 · Cited by 304 · cited 2×
“Table 3: Summary results from 72 screen-reader and non-screen-reader participants using mixed logistic regression [19].”
MethodMore Than Telling a Story: Transforming Data into Visually Shared Stories
Lee, B., Riche, N. H., Isenberg, P., & Carpendale, S. (2015) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2015.99 · Cited by 288 · cited 1×
“Online data visualizations are being increasingly utilized to communicate essential insights, assisting users to explore, interact with, and extract meaningful information from complex data [28].”
BackgroundPersonal Visualization and Personal Visual Analytics
Huang, D., Tory, M., Adriel Aseniero, B., Bartram, L., Bateman, S., Carpendale, S., Tang, A., & Woodbury, R. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2014.2359887 · Cited by 243 · cited 1×
“, polling data), among other important life domains [25].”
BackgroundLogarithmic Transformations in ANOVA
Berry, D. A. (1987) · Biometrics · doi:10.2307/2531826 · Cited by 195 · cited 1×
“is common practice for time measures [6, 24, 29].”
Task-based effectiveness of basic visualizations
Saket, B., Endert, A., & Demiralp, C. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2829750 · Cited by 178 · cited 2×
“We curated a set of 50 web pages that contained a visualization created using one of three common visualization libraries (Google Charts, ChartJS, or D3) and one of three common chart types (Bar, Scatter, or Line) [36], by searching for terms including “d3 visualizations,” “google charts visualizations,” and “chartjs…”
MethodAbdolrahmani, A., Kuber, R., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236344 · Cited by 172
Haptic graphs for blind computer users
Yu, W. M., Ramloll, R., & Brewster, S. A. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44589-7_5 · Cited by 167 · cited 3×
“Several prior research efforts have attempted to improve upon the accessibility of data visualizations by using a variety of techniques, including automatically generating alternative text for visualization elements [32, 38], sonification [17, 31, 47], haptic graphs [42, 46], and 3-D printing [13, 26, 39].”
BackgroundHurst, A., & Kane, S. (2013) · Proceedings of the 12th International Conference on Interaction Design and Children · doi:10.1145/2485760.2485883 · Cited by 128 · cited 2×
“Several prior research efforts have attempted to improve upon the accessibility of data visualizations by using a variety of techniques, including automatically generating alternative text for visualization elements [32, 38], sonification [17, 31, 47], haptic graphs [42, 46], and 3-D printing [13, 26, 39].”
BackgroundTransformations: An Introduction and a Bibliography
Hoyle, M. H. (1973) · International Statistical Review · doi:10.2307/1402836 · Cited by 127 · cited 1×
“is common practice for time measures [6, 24, 29].”
Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data
Zhao, H., Plaisant, C., Shneiderman, B., & Lazar, J. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1352782.1352786 · Cited by 120
Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples
Flowers, J. H., Buhman, D. C., & Turnage, K. D. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778827151 · Cited by 107 · cited 3×
“Several prior research efforts have attempted to improve upon the accessibility of data visualizations by using a variety of techniques, including automatically generating alternative text for visualization elements [32, 38], sonification [17, 31, 47], haptic graphs [42, 46], and 3-D printing [13, 26, 39].”
BackgroundVizTouch: automatically generated tactile visualizations of coordinate spaces
Brown, C., & Hurst, A. (2012) · Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction · doi:10.1145/2148131.2148160 · Cited by 106
Closing the Loop: User-Centered Design and Evaluation of a Human-in-the-Loop Topic Modeling System
Smith, A., Kumar, V., Boyd-Graber, J., Seppi, K., & Findlater, L. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172965 · Cited by 79
Extraordinary computing: religion as a lens for reconsidering the home
Wyche, S. P., & Grinter, R. E. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518817 · Cited by 74
Tickers and Talker: An Accessible Labeling Toolkit for 3D Printed Models
Shi, L., Zelzer, I., Feng, C., & Azenkot, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858507 · Cited by 69
Visualizing Ranges over Time on Mobile Phones: A Task-Based Crowdsourced Evaluation
Brehmer, M., Lee, B., Isenberg, P., & Choe, E. K. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865234 · Cited by 57 · cited 1×
“Specifically, we considered one Search action (lookup and locate) and two Query actions (identify and compare), similar to prior work [10].”
ResultMultimodal virtual reality versus printed medium in visualization for blind people
Yu, W., & Brewster, S. (2002) · Proceedings of the fifth international ACM conference on Assistive technologies · doi:10.1145/638249.638261 · Cited by 55 · cited 2×
“Perhaps most similar to our work is prior work by Yu and Brewster [45], who compared a multi-modal data visualization system and traditional tactile diagrams, measuring the accuracy of information extracted and the interaction time.”
ResultVisualization tools for blind people using multiple modalities
Brewster, S. (2002) · Disability and Rehabilitation · doi:10.1080/09638280110111388 · Cited by 49
Understanding Blind Screen-Reader Users’ Experiences of Digital Artboards
Schaadhardt, A., Hiniker, A., & Wobbrock, J. O. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445242 · Cited by 44 · cited 1×
“[37] studied screen-readers’ experiences of 2-D digital artboards, such as those appearing in Microsoft PowerPoint and Adobe Illustrator.”
BackgroundSelf-citationUbiquitous Accessibility for People with Visual Impairments: Are We There Yet?
Billah, S. M., Ashok, V., Porter, D. E., & Ramakrishnan, I. V. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025731 · Cited by 43 · cited 2×
“[7] conducted a study with 21 screen-reader users, reporting on the usage of screen-readers in remote access scenarios.”
BackgroundevoGraphs — A jQuery plugin to create web accessible graphs
Sharif, A., & Forouraghi, B. (2018) · 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC) · doi:10.1109/ccnc.2018.8319239 · Cited by 42 · cited 4×
“Several prior research efforts have attempted to improve upon the accessibility of data visualizations by using a variety of techniques, including automatically generating alternative text for visualization elements [32, 38], sonification [17, 31, 47], haptic graphs [42, 46], and 3-D printing [13, 26, 39].”
BackgroundMethodInfluentialSelf-citationSoundBar: exploiting multiple views in multimodal graph browsing
McGookin, D. K., & Brewster, S. A. (2006) · Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles · doi:10.1145/1182475.1182491 · Cited by 41
Scoy, F. V., McLaughlin, D. E., & Fullmer, A. (2005) · Cited by 35
Towards accessible graphs in HTML-based scientific articles
Mirri, S., Peroni, S., Salomoni, P., Vitali, F., & Rubano, V. (2017) · 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC) · doi:10.1109/ccnc.2017.7983287 · Cited by 29 · cited 3×
“Several prior research efforts have attempted to improve upon the accessibility of data visualizations by using a variety of techniques, including automatically generating alternative text for visualization elements [32, 38], sonification [17, 31, 47], haptic graphs [42, 46], and 3-D printing [13, 26, 39].”
BackgroundMethodOn perfect working-memory performance with large numbers of items
Thiele, J. E., Pratte, M. S., & Rouder, J. N. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0108-7 · Cited by 23 · cited 1×
“For answering specific questions about the data, such as what the maximum value is, or how a specific value compares to another, screen-reader users have to remember and compute more data than is humanly possible to keep in working memory [41].”
BackgroundFrederick, B. N. (1999) · Cited by 22
Conducting and Analyzing a Contextual Interview (Excerpt)
Holtzblatt, K., & Jones, S. (1995) · Elsevier eBooks · doi:10.1016/b978-0-08-051574-8.50028-5 · Cited by 22 · cited 1×
“First, through semi-structured contextual interviews [23] with nine screen-reader users, we found that 33% of the visualizations in our study, from a sample of 27 visualizations, were undiscoverable to screen readers.”
BackgroundGrussenmeyer, W., Garcia, J., Folmer, E., & Jiang, F. (2017) · International Web for All Conference (W4A) · doi:10.1145/3058555.3058570 · Cited by 15 · cited 1×
“Several research efforts have explored the interaction of screenreader users with technology via interviews [3, 4, 7, 21, 27], showing that screen-reader users encounter a number of challenges.”
BackgroundPini, A., Hayes, J., Upton, C., & Corcoran, M. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312948 · Cited by 13
Task-Based Effectiveness of Basic VisualizationsPreprint
Saket, B., Endert, A., & Demiralp, Ç. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.08546 · Cited by 11
Interviewing blind photographers
Adams, D., Gallagher, T., Ambard, A., & Kurniawan, S. (2013) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/2513383.2513418 · Cited by 8
Research works printed but not linked: 3
- Ben Caldwell, Michael Cooper, Loretta Guarino Reid, Gregg Vanderheiden, Wendy Chisholm, John Slatin, and Jason White. 2008. Web content accessibility guidelines (WCAG) 2.0. WWW Consortium (W3C)(2008).
- Matthew Graham, Anthony Milanowski, and Jackson Miller. 2012. Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings.Online Submission (2012).
- 10.5555/645443.652687 · doi:10.5555/645443.652687
Cited by
Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114770 · Cited by 155
Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 97
VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In
Sharif, A., Wang, O. H., Muongchan, A. T., Reinecke, K., & Wobbrock, J. O. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517431 · Cited by 86
“We created VoxLens using a user-centered iterative design process, building on fndings and recommendations from prior work [69].”
BackgroundMethodResultInfluentialSelf-citationSharif, A., McCall, A. L., & Bolante, K. R. (2022) · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3517428.3544813 · Cited by 85
“Additionally, we added a tabular representation of data only visible to screen readers, similar to the accessibility measures employed by Google Charts [14, 56].”
MethodSelf-citationAn Autoethnographic Case Study of Generative Artificial Intelligence's Utility for Accessibility
Glazko, K. S., Yamagami, M., Desai, A., Mack, K. A., Potluri, V., Xu, X., & Mankoff, J. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3614548 · Cited by 80
Metadata
- Authors
- Sharif, A., Chintalapati, S. S., Wobbrock, J. O., & Reinecke, K.
- Affiliations
- University of Washington (US)
- Venue
- Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2021-10-17
- Pages
- 1-16
- OpenAlex
- W3205973265
- Cited by
- 85
- References
- 48
- Citations by year
- 2026: 13 · 2025: 15 · 2024: 25 · 2023: 16 · 2022: 15 · 2021: 1
- FWCI
- 18.72
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Keywords
- screen readers, web-based visualization, accessibility, information extraction, data discoverability, assistive technology, user experience
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.