Twitter A11y: A Browser Extension to Make Twitter Images Accessible
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Social media platforms are integral to public and private discourse, but are becoming less accessible to people with vision impairments due to an increase in user-posted images. Some platforms (i.e. Twitter) let users add image descriptions (alternative text), but only 0.1% of images include these. To address this accessibility barrier, we created Twitter A11y, a browser extension to add alternative text on Twitter using six methods. For example, screenshots of text are common, so we detect textual images, and create alternative text using optical character recognition. Twitter A11y also leverages services to automatically generate alternative text or reuse them from across the web. We compare the coverage and quality of Twitter A11y's six alt-text strategies by evaluating the timelines of 50 self-identified blind Twitter users. We find that Twitter A11y increases alt-text coverage from 7.6% to 78.5%, before crowdsourcing descriptions for the remaining images. We estimate that 57.5% of returned descriptions are high-quality. We then report on the experiences of 10 participants with visual impairments using the tool during a week-long deployment. Twitter A11y increases access to social media platforms for people with visual impairments by providing high-quality automatic descriptions for user-posted images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
(2017) · doi:10.1145/2998181.2998364 · Cited by 258
Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images
MacLeod, H., Bennett, C. L., Morris, M. R., & Cutrell, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025814 · Cited by 200 · cited 4×
“Caution should be used when integrating the latter, as prior research has shown that inaccuracies are not easily noticed by people with vision impairments [15, 25].”
BackgroundInfluentialWebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161
Self-citationRich Representations of Visual Content for Screen Reader Users
Morris, M. R., Johnson, J., Bennett, C. L., & Cutrell, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173633 · Cited by 159
Accessibility of Internet websites through time
Hackett, S., Parmanto, B., & Zeng, X. (2003) · Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1028630.1028638 · Cited by 145 · cited 1×
“The lack of alternative text is a perennial problem on the web [3,12], and various methods can be used to describe visual aspects of the image.”
MethodCaption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
Guinness, D., Cutrell, E., & Morris, M. R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174092 · Cited by 108
Gleason, C., Pavel, A., Liu, X., Carrington, P., Chilton, L. B., & Bigham, J. P. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353792 · Cited by 69
Self-citation
Cited by
CLIPScore: A Reference-free Evaluation Metric for Image Captioning
Hessel, J., Holtzman, A., Forbes, M., Le Bras, R., & Choi, Y. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.595 · Cited by 1,232
Bennett, C. L., Gleason, C., Scheuerman, M. K., Bigham, J. P., Guo, A., & To, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445498 · Cited by 128
“Researchers have studied several solutions to increase the number of described images from crowdsourcing [93] to generating them automatically [40, 123].”
BackgroundResultSelf-citationYes: Affirmative Consent as a Theoretical Framework for Understanding and Imagining Social Platforms
Im, J., Dimond, J., Berton, M., Lee, U., Mustelier, K., Ackerman, M. S., & Gilbert, E. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445778 · Cited by 119
Toward Automatic Audio Description Generation for Accessible Videos
Wang, Y., Liang, W., Huang, H., Zhang, Y., Li, D., & Yu, L.-F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445347 · Cited by 87
“developed various tools to help generate alt texts of images [22], memes [21], and GIFs [20].”
MethodStangl, A., Verma, N., Fleischmann, K. R., Morris, M. R., & Gurari, D. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471233 · Cited by 81
“Our work offers a valuable foundation for improving upon the status quo for image description technologies since users reportedly can be frustrated about receiving too much information or not receiving their information of interest [27, 29, 42, 49, 58, 70].”
BackgroundInfluentialSupporting Accessible Data Visualization Through Audio Data Narratives
Siu, A., S-H Kim, G., O'Modhrain, S., & Follmer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517678 · Cited by 64
Lee, J., Herskovitz, J., Peng, Y.-H., & Guo, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501966 · Cited by 61
Designing Tools for High-Quality Alt Text Authoring
Mack, K., Cutrell, E., Lee, B., & Morris, M. R. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471207 · Cited by 58
Gleason, C., Valencia, S., Kirabo, L., Wu, J., Guo, A., Jeanne Carter, E., Bigham, J., Bennett, C., & Pavel, A. (2020) · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3373625.3417023 · Cited by 53
“As prior work has demonstrated [39, 40, 56], we hypothesized that social media channels may still be inaccessible to people with vision impairments.”
BackgroundSelf-citationFigurA11y: AI Assistance for Writing Scientific Alt Text
Singh, N., Wang, L. L., & Bragg, J. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645212 · Cited by 42
“…automated approaches are rapidly improving in quality, they are often also constrained to specific types of figures such as plots or natural images, limiting applicability to scientific communication more broadly which often involve complex diagrams and multi-part scientific figures [12, 44, 48].”
BackgroundWang, R., Chen, Z., Zhang, M. R., Li, Z., Liu, Z., Dang, Z., Yu, C., & Chen, X. '. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445547 · Cited by 42
Privacy Concerns for Visual Assistance Technologies
Stangl, A., Shiroma, K., Davis, N., Xie, B., Fleischmann, K. R., Findlater, L., & Gurari, D. (2022) · ACM Transactions on Accessible Computing · doi:10.1145/3517384 · Cited by 35
“…the types of images and questions blind people share with VATs [19, 25, 44, 46, 47], what information blind people want in image descriptions [40–43, Most related to our work is that which focuses on the privacy, security, and safety concerns of blind people when using camera-based technologies…”
BackgroundChintalapati, S. S., Bragg, J., & Wang, L. L. (2022) · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3517428.3544796 · Cited by 31
CodeA11y: Making AI Coding Assistants Useful for Accessible Web Development
Mowar, P., Peng, Y.-H., Wu, J., Steinfeld, A., & Bigham, J. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713335 · Cited by 31
Self-citationNair, V., Zhu, H. '., & Smith, B. A. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581302 · Cited by 29
“Some researchers have focused on presenting methods and frameworks [2, 12, 30, 51, 52] for authoring higher-quality alt text as well as on improving the quality of auto-generated descriptions [13, 28, 49, 66].”
Toward supporting quality alt text in computing publications
Williams, C., de Greef, L., Harris, E., Findlater, L., Pavel, A., & Bennett, C. (2022) · Proceedings of the 19th International Web for All Conference · doi:10.1145/3493612.3520449 · Cited by 26
“Other efforts to improve alt text quality, which we build on, have focused on authoring assistance tools [8, 19, 27, 32, 37].”
BackgroundInfluentialSelf-citationKreiss, E., Bennett, C., Hooshmand, S., Zelikman, E., Ringel Morris, M., & Potts, C. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.309 · Cited by 24
Wang, L. L., Cachola, I., Bragg, J., Cheng, E. Y.-Y., Haupt, C., Latzke, M., Kuehl, B., van Zuylen, M., Wagner, L., & Weld, D. S. (2021) · arXiv · doi:10.48550/arxiv.2105.00076 · Cited by 22
Stangl, A., Sadjo, E., Emami-Naeini, P., Wang, Y., Gurari, D., & Findlater, L. (2023) · 20th International Web for All Conference · doi:10.1145/3587281.3587296 · Cited by 15
InSupport: Proxy Interface for Enabling Efficient Non-Visual Interaction with Web Data Records
Ferdous, J., Lee, H.-N., Jayarathna, S., & Ashok, V. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511126 · Cited by 11
Xie, I., Choi, W., Wang, S., Lee, H. S., Hong, B. H., Wang, N.-C., & Cudjoe, E. K. (2024) · Journal of Imaging · doi:10.3390/jimaging10080205 · Cited by 8
“Malicious” Pictorials: How Alt Text Matters to Screen Reader Users' Experience of Image-Dense Media
Yin, A., Sogani, R., Oewel, B., Phan, K., Park, J. S. Y., Yeo, M. A., Yazzolino, L. A., Arcos, K., Abdolrahmani, A., Blank, E., et al. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660747 · Cited by 9
“Another approach has been to explore crowdsourced [6][15] [28] and automated object and scene detection [6][15][41] [10][27][11], as well as automated reuse of existing alt text [6] [15].”
BackgroundBuilding the Habit of Authoring Alt Text: Design for Making a Change
Bellscheidt, S., Metcalf, H., Pham, D., & Elglaly, Y. N. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3614495 · Cited by 8
“While machine learning methods can generate alt text, their accuracy is inferior to alt text authored by users [5, 19, 26].”
BackgroundInfluentialFerdous, J., Lee, H.-N., Jayarathna, S., & Ashok, V. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3579364 · Cited by 7
AIDE: an automatic image description engine for review imagery
Sreedhar, R., Tan, N., Zhang, J., Jin, K., Gregson, S., Moreta-Feliz, E., Samudrala, N., & Sadalgi, S. (2022) · Proceedings of the 19th International Web for All Conference · doi:10.1145/3493612.3520465 · Cited by 1
Metadata
- Authors
- Gleason, C., Pavel, A., McCamey, E., Low, C., Carrington, P., Kitani, K. M., & Bigham, J. P.
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-12
- OpenAlex
- W3029105705
- Cited by
- 121
- References
- 8
- FWCI
- 24.92
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.