Strategies for Auditory Display of Social Media
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Social media is an overwhelmingly visual medium, and we ask the simple question: How can the data and images of social media posts be transformed into something as meaningful and vivid in the auditory sense? Such a design would be useful for eyes-free browsing and could enhance the existing visual media. Our strategy first uses artificial intelligence systems to transform low-level input data into high-level sociocultural features. These features are then conveyed using a multifactored temporal design that uses speech, sonification, auditory scenes, and music.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Gil de Zúñiga, H., Jung, N., & Valenzuela, S. (2012) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2012.01574.x · Cited by 1,821
Media Images and the Social Construction of Reality
Gamson, W. A., Croteau, D., Hoynes, W., & Sasson, T. (1992) · Annual Review of Sociology · doi:10.1146/annurev.so.18.080192.002105 · Cited by 1,418
From captions to visual concepts and back
Fang, H., Gupta, S., Iandola, F., Srivastava, R. K., Deng, L., Dollar, P., Gao, J., He, X., Mitchell, M., Platt, J. C., et al. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298754 · Cited by 1,287
Serafin, S., Franinović, K., Hermann, T. M., Lemaître, G., Rinott, M., & Rocchesso, D. (2011) · Cited by 572
Social media use by government: From the routine to the critical
Kavanaugh, A. L., Fox, E. A., Sheetz, S. D., Yang, S., Li, L. T., Shoemaker, D. J., Natsev, A., & Xie, L. (2012) · Government Information Quarterly · doi:10.1016/j.giq.2012.06.002 · Cited by 560
Lambert, J. (2013) · Routledge eBooks · doi:10.4324/9780203102329 · Cited by 385
(2017) · doi:10.1145/2998181.2998364 · Cited by 258
Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images
MacLeod, H., Bennett, C. L., Morris, M. R., & Cutrell, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025814 · Cited by 200
Self-citationProceedings of the 6th international conference on Auditory Display
Ystad, S., Aramaki, M., Kronland-Martinet, R., & Jensen, K. (2009) · Cited by 186
Rich Representations of Visual Content for Screen Reader Users
Morris, M. R., Johnson, J., Bennett, C. L., & Cutrell, E. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173633 · Cited by 159
Self-citation
Research works printed but not linked: 3
- Vickers P., 2006, In Proceedings of the 12th International Conference on Auditory Display, 210
- Winters R. M., 2013, Proceedings of the 3rd International Conference on Music and Emotion, 492
- Winters R. M., 2015, Proceedings of the 21st International Conference on Auditory Display, 273
Cited by
Conversational Information Seeking
Zamani, H., Trippas, J. R., Dalton, J., & Radlinski, F. (2023) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000081 · Cited by 79
Image Accessibility for Screen Reader Users: A Systematic Review and a Road Map
Oh, U., Joh, H., & Lee, Y. (2021) · Electronics · doi:10.3390/electronics10080953 · Cited by 37
A Mixed-Method Analysis of Text and Audio Search Interfaces with Varying Task Complexity
Vtyurina, A., Clarke, C. L. A., Law, E., Trippas, J. R., & Bota, H. (2020) · Proceedings of the 2020 ACM SIGIR on International Conference on Theory of Information Retrieval · doi:10.1145/3409256.3409822 · Cited by 29
TableNarrator: Making Image Tables Accessible to Blind and Low Vision People
Mo, Y., Huang, G., Li, L., Deng, D., Yu, Z., Xu, Y., Ye, K., Zhou, S., & Bu, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714329 · Cited by 16
Kwon, N., Lee, Y.-J., & Oh, U. (2021) · Universal Access in the Information Society · doi:10.1007/s10209-021-00814-2 · Cited by 12
Metadata
- Authors
- Winters, R. M., Joshi, N., Cutrell, E., & Morris, M. R.
- Venue
- Ergonomics in Design: The Quarterly of Human Factors Applications
- Publisher
- SAGE Publications
- Published
- 2018-11-02
- Volume
- 27
- Issue
- 1
- Pages
- 11-15
- ISSN
- 1064-8046 (ISSN-L)
- OpenAlex
- W2899458474
- Cited by
- 11
- References
- 17
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 3 · 2020: 1 · 2019: 1
- FWCI
- 0.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Ergonomics in Design The Quarterly of Human Factors Applications (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Music › Music Technology and Sound Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Keywords
- auditory display, social media, sonification, auditory scene analysis, speech synthesis, temporal design, sociocultural features, multimodal media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Strategies for Auditory Display of Social Media. https://app.cochat.ai/papers/10.1177/1064804618788098
- The paper
- Winters, R. M., Joshi, N., Cutrell, E., & Morris, M. R. (2019). Strategies for Auditory Display of Social Media. Ergonomics in Design: The Quarterly of Human Factors Applications. https://doi.org/10.1177/1064804618788098
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.