The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Making Memes Accessible
Open accessAbstract
Images on social media platforms are inaccessible to people with vision impairments due to a lack of descriptions that can be read by screen readers. Providing accurate alternative text for all visual content on social media is not yet feasible, but certain subsets of images, such as internet memes, offer affordances for automatic or semi-automatic generation of alternative text. We present two methods for making memes accessible semi-automatically through (1) the generation of rich alternative text descriptions and (2) the creation of audio macro memes. Meme authors create alternative text templates or audio meme templates, and insert placeholders instead of the meme text. When a meme with the same image is encountered again, it is automatically recognized from a database of meme templates. Text is then extracted and either inserted into the alternative text template or rendered in the audio template using text-to-speech. In our evaluation of meme formats with 10 Twitter users with vision impairments, we found that most users preferred alternative text memes because the description of the visual content conveys the emotional tone of the character. As the preexisting templates can be automatically matched to memes using the same visual image, this combined approach can make a large subset of images on the web accessible, while preserving the emotion and tone inherent in the image memes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Multiscale structural similarity for image quality assessment
Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2004) · The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003 · doi:10.1109/acssc.2003.1292216 · Cited by 6,253 · cited 1×
“To compute structural similarity, we use the Multi-Scale Structural Similarity (MS-SSIM) index [33] that considers the luminance, contrast, and structural similarity between image regions at various zoom levels.”
Method(2017) · doi:10.1145/2998181.2998364 · Cited by 258
Inside jokes: using humor to reverse-engineer the mind
(2012) · Choice Reviews Online · doi:10.5860/choice.49-2983 · Cited by 227
(2008) · doi:10.1515/9783110198492 · Cited by 226
Making computers laugh: investigations in automatic humor recognition
Mihalcea, R., & Strapparava, C. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220642 · Cited by 224
Is word error rate a good indicator for spoken language understanding accuracy
Wang, Y., Acero, A., & Chelba, C. I. (2004) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2003.1318504 · Cited by 216
Hypertext Markup Language - 2.0
Berners-Lee, T., & Connolly, D. (1995) · doi:10.17487/rfc1866 · Cited by 169
WebInSight: making web images accessible
Bigham, J. P., Kaminsky, R. S., Ladner, R. E., Danielsson, O. M., & Hempton, G. L. (2006) · Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/1168987.1169018 · Cited by 161 · cited 1×
“While authors are recommended to follow Web Content Accessibility Guidelines [4], many images on the web are not labelled correctly or at all [2, 12].”
BackgroundSelf-citation
Research works printed but not linked: 6
- Sally Holloway. 2010. The Serious Guide to Joke Writing: How To Say Something Funny About Anything . Bookshaker, Great Yarmouth, UK. 207 pages.
- Chloé Kiddon and Yuriy Brun. 2011. That's What She Said: Double Entendre Identification. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Short Papers - Volume 2 (HLT `11). Association for Computational Linguistics, Stroudsburg, PA, USA, 89--94. http://dl.acm.org/citation.cfm?id=2002736.2002756
- Microsoft. 2017. Seeing AI | Talking camera app for those with a visual impairment. (2017). https://www.microsoft.com/en-us/seeing-ai/
- Adrian Rosebrock. 2014. The complete guide to building an image search engine with Python and OpenCV. (Dec 2014). https://www.pyimagesearch.com/2014/12/01/complete-guide-building-image-search-engine-python-opencv/
- John Vorhaus. 1994. The Comic Toolbox: How to Be Funny Even If You're Not . Silman James Press, Los Angeles, CA. 191 pages.
- Elwyn Brooks White. 1954. Some remarks on humor. The Second Tree from the Corner (1954), 173--181.
Cited by
Twitter A11y: A Browser Extension to Make Twitter Images Accessible
Gleason, C., Pavel, A., McCamey, E., Low, C., Carrington, P., Kitani, K., & Bigham, J. P. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376728 · Cited by 142
Self-citationToward Automatic Audio Description Generation for Accessible Videos
Wang, Y., Liang, W., Huang, H., Zhang, Y., Li, D., & Yu, L.-F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445347 · Cited by 87
Stangl, A., Verma, N., Fleischmann, K. R., Morris, M. R., & Gurari, D. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471233 · Cited by 81
Designing Tools for High-Quality Alt Text Authoring
Mack, K., Cutrell, E., Lee, B., & Morris, M. R. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471207 · Cited by 58
Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People
Penuela, R. E. G., Collins, J., Bennett, C. L., & Azenkot, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642211 · Cited by 105
Metadata
- Authors
- Gleason, C., Pavel, A., Liu, X., Carrington, P., Chilton, L. B., & Bigham, J. P.
- Affiliations
- Carnegie Mellon University (US)
- Columbia University (US)
- Venue
- Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2019-10-24
- Pages
- 367-376
- OpenAlex
- W2981800437
- Cited by
- 69
- References
- 22
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 14 · 2023: 9 · 2022: 16 · 2021: 11 · 2020: 5 · 2019: 1
- FWCI
- 15.85
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- National Institute on Disability, Independent Living, and Rehabilitation Research (90DP0061)
- National Science Foundation (IIS-1816012)
- NSF GFRP (DGE 1745016)
- Topics
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Arts and Humanities › Language and Linguistics › Subtitles and Audiovisual Media
- Keywords
- internet memes, accessibility, visual impairment, screen readers, alternative text, picture description, text-to-speech, template matching, social media images, Twitter
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making Memes Accessible. https://app.cochat.ai/papers/10.1145/3308561.3353792
- The paper
- Gleason, C., Pavel, A., Liu, X., Carrington, P., Chilton, L. B., & Bigham, J. P. (2019). Making Memes Accessible. Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility. https://doi.org/10.1145/3308561.3353792
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.