PreprintCited by 24Digital Accessibility for DisabilitiesMathematics, Computing, and Information ProcessingText Readability and Simplification

Improving the Accessibility of Scientific Documents: Current State, User Needs, and a System Solution to Enhance Scientific PDF Accessibility for Blind and Low Vision Users

Open access
Wang, Lucy Lu, Cachola, Isabel, Bragg, Jonathan, Cheng, Evie Yu-Yen, Haupt, Chelsea, Latzke, Matt, Kuehl, Bailey, van Zuylen, Madeleine +2 more·2021·arXiv

Abstract

The majority of scientific papers are distributed in PDF, which pose challenges for accessibility, especially for blind and low vision (BLV) readers. We characterize the scope of this problem by assessing the accessibility of 11,397 PDFs published 2010--2019 sampled across various fields of study, finding that only 2.4% of these PDFs satisfy all of our defined accessibility criteria. We introduce the SciA11y system to offset some of the issues around inaccessibility. SciA11y incorporates several machine learning models to extract the content of scientific PDFs and render this content as accessible HTML, with added novel navigational features to support screen reader users. An intrinsic evaluation of extraction quality indicates that the majority of HTML renders (87%) produced by our system have no or only some readability issues. We perform a qualitative user study to understand the needs of BLV researchers when reading papers, and to assess whether the SciA11y system could address these needs. We summarize our user study findings into a set of five design recommendations for accessible scientific reader systems. User response to SciA11y was positive, with all users saying they would be likely to use the system in the future, and some stating that the system, if available, would become their primary workflow. We successfully produce HTML renders for over 12M papers, of which an open access subset of 1.5M are available for browsing at https://scia11y.org/

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2105.00076

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Research on academic workflows has highlighted the importance of accessible tools and inclusive practices, especially as the research community becomes increasingly diverse.

    “Separately, research on academic workflows has highlighted the importance of accessible tools and inclusive practices, especially as the research community becomes increasingly diverse [34, 50, 54, 76].”

    From "I Don't Trust Any Professional Research Tool": A Re-Imagination of Knowledge Production Workflows by, with, and for Blind and Low-Vision Researchers (2026) · cites this paper as [76]

    The Discussion (p. 32) calls for systems that support blind and low-vision researchers, and the Conclusion (p. 33) urges designers to account for their needs. These passages support the importance of accessible tools and inclusive practices in research workflows, but they do not establish that the research community is becoming increasingly diverse. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Accessibility compliance varies substantially by the typesetting platform, with Microsoft Word producing the most accessible PDFs while LaTeX invariably yielding the least.

    “First, both Wang et al. [39] and Kumar et al. [10] found that accessibility compliance varies substantially by the typesetting platform, with Microsoft Word producing the most accessible PDFs while LaTeX invariably yielding the least.”

    From iTagPDF: Towards Finally Automating PDF Accessibility (2026) · cites this paper as [39]

    Section 3.5 (p. 11) finds significant differences in compliance across typesetting software and identifies Microsoft Word as producing the most accessible PDFs. Section 3.6 (p. 14) says LaTeX produces PDFs with the lowest compliance among the common software examined. Neither passage supports “invariably”: the findings describe distributions and overall rankings, not every PDF. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Authors often fail to provide accessibility metadata consistently or at adequate quality, rendering most academic content inaccessible to people with disabilities.

    “Unsurprisingly, authors often fail to provide this metadata consistently or at adequate quality, rendering most academic content inaccessible to people with disabilities, as the following studies demonstrate.”

    From iTagPDF: Towards Finally Automating PDF Accessibility (2026) · cites this paper as [39]

    The Introduction (p. 2) says accessibility features are often missing from scientific PDFs, and the Summary of analyses (p. 13) reports that only about 2.4% of sampled PDFs met all five criteria. The study does not assess the quality of metadata authors provide; its accessibility findings concern paper PDFs, chiefly for blind and low-vision readers, rather than all academic content or all disabilities. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Page structure is important when situating a visualization and simplifying navigation between visualization and supporting information.

    “screen reader accessible charts, we observe the importance of page structure when situating a visualization and simplifying navigation between visualization and supporting information [123].”
  • Tools such as SciA11y and Paper to HTML have been developed to convert PDFs into more accessible and interactive HTML formats.

    “Consequently, tools such as SciA11y [39] and Paper to HTML [38] have been developed to convert PDFs into more accessible and interactive HTML formats.”

    From iTagPDF: Towards Finally Automating PDF Accessibility (2026) · cites this paper as [39]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 45 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. [14][14] Christin Engel, E. Müller, and G. Weber. 2019. SVGPlott: an accessible tool to generate highly adaptable, accessible audio-tactile charts for and from blind and visually impaired people. Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments (2019). -

Cited by

Sorted by citations

Authors
Wang, L. L., Cachola, I., Bragg, J., Cheng, E. Y.-Y., Haupt, C., Latzke, M., Kuehl, B., van Zuylen, M., Wagner, L., & Weld, D. S.
Affiliations
  • Allen Institute for Artificial Intelligence (US)
  • Johns Hopkins University (US)
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
OpenAlex
W3159933103
Cited by
22
References
45
Citations by year
2025: 2 · 2024: 4 · 2023: 8 · 2022: 7 · 2021: 1
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
  • National Science Foundation (2040196)
  • University of Washington
  • Office of Naval Research (N00014- 18-1-2193, N00014-18, N00014)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Physical Sciences › Computer Science › Computational Theory and Mathematics › Mathematics, Computing, and Information Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Text Readability and Simplification
Keywords
PDF accessibility, scientific documents, blind and visually impaired users, screen readers, user needs, accessibility evaluation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review