Development and Evaluation of a Tool for Assisting Content Creators in Making PDF Files More Accessible
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Most PDF documents are inaccessible for people with disabilities, creating barriers in education, science, commerce, e-government, and recreation. Documents in PDF format are considered harder to make accessible than documents in other formats, primarily due to the insufficient tools available to assist content creators. In this article, we present the research and development of Ally, a new tool to assist content creators in remediating their PDF files to improve accessibility. Ally utilizes best practices from other areas of HCI research to create a more efficient and effective interaction for remediating regions, headers, reading order, and tables in a PDF document for improved accessibility. Twenty participants attempted to complete the same PDF accessibility remediation tasks using both Ally and a standard industry tool, Adobe Acrobat Pro. Ally was almost twice as fast and three times as accurate compared to Acrobat Pro, with participants reporting a strong preference for and a much higher level of satisfaction with Ally. The approaches taken in Ally improve the ability to create accessible PDFs efficiently and accurately for the four important aspects studied, but future work will need to incorporate additional functionality, related to remediating alt text, forms, and other aspects of PDF accessibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007) · International Journal of Human-Computer Interaction · doi:10.1080/10447310709336964 · Cited by 354 · cited 1×
“It has also been shown that inaccurate reading order of online PDF files is one of the most common frustrations of screen reader users on the web [38].”
BackgroundSelf-citationWeb accessibility guidelines: A lesson from the evolving Web
Harper, S., & Chen, A. Q. (2012) · World Wide Web · doi:10.1007/s11280-011-0130-8 · Cited by 72 · cited 1×
“For instance, the Web Content Accessibility Guidelines, a standard for making web content accessible, has been in place since 1999 [15].”
BackgroundCreating accessible PDFs for conference proceedings
Brady, E., Zhong, Y., & Bigham, J. P. (2015) · Proceedings of the 12th International Web for All Conference · doi:10.1145/2745555.2746665 · Cited by 35 · cited 1×
“5% of papers had the title tagged with an H1 [40], and similar results were obtained in our set of chosen 20 documents.”
ResultAn Uninteresting Tour Through Why Our Research Papers Aren't Accessible
Bigham, J. P., Brady, E. L., Gleason, C., Guo, A., & Shamma, D. A. (2016) · Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2851581.2892588 · Cited by 34 · cited 5×
“One of the challenges for PDF Accessibility is that many of the tools that create PDFs do not preserve the document structure needed to tag the PDF [5].”
BackgroundMethodInfluentialPDF Accessibility of Research Papers: What Tools are Needed for Assessment and Remediation?
Jembu Rajkumar, A., Lazar, J., Jordan, J. B., Darvishy, A., & Hutter, H.-P. (2020) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2020.512 · Cited by 28
Self-citationWang, L. L., Cachola, I., Bragg, J., Cheng, E. Y.-Y., Haupt, C., Latzke, M., Kuehl, B., van Zuylen, M., Wagner, L., & Weld, D. S. (2021) · arXiv · doi:10.48550/arxiv.2105.00076 · Cited by 22 · cited 2×
“4% of them are accessible to people with disabilities [18].”
BackgroundMethodMaking the field of computing more inclusive
Lazar, J., Churchill, E. F., Grossman, T., van der Veer, G., Palanque, P., Morris, J. "., & Mankoff, J. (2017) · Communications of the ACM · doi:10.1145/2993420 · Cited by 21 · cited 1×
“8% of the papers for the CHI 2014 conference contained all of the requested accessibility tagging [9].”
BackgroundSelf-citation
Cited by
Kumar, A., & Wang, L. L. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675634 · Cited by 18
“Since 2018, however, a variety of tools and frameworks have been developed to address these issues, focusing on automated solutions [25, 37, 42], artificial intelligence (AI) integration [19, 30, 33], and improved authoring practices [6, 27].”
BackgroundXie, I., Wang, S., Lee, T. H., & Lee, H. S. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2260673 · Cited by 11
“…especially a PDF document, the DL M.Web should present transcripts of the documents or extract and analyze PDF document elements using different research formulas (Fayyaz et al., 2021; Pradhan et al., 2022; Rastan et al., 2019), allowing BVI users to easily access information within PDF documents.”
MethodSchmitt-Koopmann, F. M., Huang, E. M., Hutter, H.-P., & Darvishy, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713084 · Cited by 8
iTagPDF: Towards Finally Automating PDF Accessibility
Mowar, P., Steinfeld, A., & Bigham, J. P. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790289 · Cited by 2
Metadata
- Authors
- Pradhan, D., Rajput, T., Rajkumar, A. J., Lazar, J., Jain, R., Morariu, V. I., & Manjunatha, V.
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2022-03-04
- Volume
- 15
- Issue
- 1
- Pages
- 1-52
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W4214846217
- Cited by
- 15
- References
- 7
- FWCI
- 7.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.