“Easier or Harder, Depending on Who the Hearing Person Is”: Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing Status
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
With improvements in automated speech recognition and increased use of videoconferencing, real-time captioning has changed significantly. This shift toward broadly available but less accurate captioning invites exploration of the role hearing conversation partners play in shaping the accessibility of a conversation to d/Deaf and hard of hearing (DHH) captioning users. While recent work has explored DHH individuals’ videoconferencing experiences with captioning, we focus on established groups’ current practices and priorities for future tools to support more accessible online conversations. Our study consists of three codesign sessions, conducted with four groups (17 participants total, 10 DHH, 7 hearing). We found that established groups crafted social accessibility norms that met their relational contexts. We also identify promising directions for future captioning design, including the need to standardize speaker identification and customization, opportunities to provide behavioral feedback during a conversation, and ways that videoconferencing platforms could enable groups to set and share norms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Co-creation and the new landscapes of design
Sanders, E. B.-N., & Stappers, P. J. (2008) · CoDesign · doi:10.1080/15710880701875068 · Cited by 5,561 · cited 1×
“Codesign methods gain strength from focusing on the particulars of participants’ lives and do not emphasize finding a uniform sample, but rather revealing in-depth insights [21, 51], the goal of our study.”
BackgroundRacial disparities in automated speech recognition
Koenecke, A., Nam, A., Lake, E., Nudell, J., Quartey, M., Mengesha, Z., Toups, C., Rickford, J. R., Jurafsky, D., & Goel, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915768117 · Cited by 765
Interdependence as a Frame for Assistive Technology Research and Design
Bennett, C. L., Brady, E., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236348 · Cited by 493 · cited 1×
“, [4, 39, 40]), this thinking creates opportunities to envision access as for communities, rather than solely individual disabled people.”
BackgroundHead-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing
Jain, D., Findlater, L., Gilkeson, J., Holland, B., Duraiswami, R., Zotkin, D., Vogler, C., & Froehlich, J. E. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702393 · Cited by 123 · cited 3×
“In addition to speech, prior studies have found that DHH people desire sound information to contextualize spoken conversations [24].”
BackgroundSelf-citationUnderstanding the telework experience of people with disabilities
Tang, J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449104 · Cited by 109
Anticipate and Adjust: Cultivating Access in Human-Centered Methods
Mack, K., McDonnell, E., Potluri, V., Xu, M., Zabala, J., Bigham, J., Mankoff, J., & Bennett, C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501882 · Cited by 86 · cited 2×
“’s [40] invitation to adapt our study design to work with participants with valuable experience who may not fit all study criteria.”
BackgroundSelf-citationImproving Real-Time Captioning Experiences for Deaf and Hard of Hearing Students
Kawas, S., Karalis, G., Wen, T., & Ladner, R. E. (2016) · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/2982142.2982164 · Cited by 82
Mixed Abilities and Varied Experiences: a group autoethnography of a virtual summer internship
Mack, K., Das, M., Jain, D., Bragg, D., Tang, J., Begel, A., Beneteau, E., Davis, J. U., Glasser, A., Park, J. S., et al. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471199 · Cited by 68 · cited 4×
“For videoconferencing specifically, prior work shows these platforms are not designed with DHH communicators in mind [50, 60] and adapting group social norms can be an effective but difficultto-maintain approach to improve accessibility [35, 39, 55].”
BackgroundInfluentialAccessibility in Action: Co-Located Collaboration among Deaf and Hearing Professionals
Wang, E. Q., & Piper, A. M. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274449 · Cited by 64
McDonnell, E. J., Liu, P., Goodman, S. M., Kushalnagar, R., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479578 · Cited by 54
Self-citationSeita, M., Lee, S., Andrew, S., Shinohara, K., & Huenerfauth, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501843 · Cited by 52 · cited 4×
“[55] briefly discussed new features to guide conversation, our work proposes participant selected and designed features and assesses ideas in context of their”
BackgroundInfluentialBerke, L., Albusays, K., Seita, M., & Huenerfauth, M. (2019) · Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290607.3312921 · Cited by 48 · cited 2×
“, [5, 6, 18, 19, 23, 28, 48, 52, 56]), our participants’ agreed that reading captions requires too much cognitive load to make on-caption visualizations useful [6, 56].”
BackgroundButler, J., Trager, B., & Behm, B. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353772 · Cited by 41 · cited 1×
“Strategies to minimize visual dispersion include collating distributed information to one interface [11], projecting captions to follow the speaker [33], and displaying captions underneath lecture slides [10].”
BackgroundToward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33
Self-citationSeita, M., Albusays, K., Kafle, S., Stinson, M., & Huenerfauth, M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236355 · Cited by 32 · cited 3×
“, [5, 6, 18, 19, 23, 28, 48, 52, 56]), our participants’ agreed that reading captions requires too much cognitive load to make on-caption visualizations useful [6, 56].”
BackgroundGlasser, A. T., Kushalnagar, K. R., & Kushalnagar, R. S. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3134819 · Cited by 28
Self-citation
Cited by
Misfitting With AI: How Blind People Verify and Contest AI Errors
Alharbi, R., Lor, P., Herskovitz, J., Schoenebeck, S., & Brewer, R. N. (2024) · The 26th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663548.3675659 · Cited by 40
“Recently, disability studies have become a central sensibility to many HCI and accessibility works (e.g., [7, 62, 84, 86]).”
Chen, S., Waller, J., Seita, M., Vogler, C., Kushalnagar, R., & Wang, Q. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642017 · Cited by 16
“The impact of time lag in ASR on communication efectiveness has been extensively discussed in prior research [14, 26, 27], which focuses on designing ASR for informal and interactive small-group conversations.”
BackgroundSelf-citationDas, M., Stangl, A., & Findlater, L. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641018 · Cited by 15
Self-citationHuffman, S., Chen, S., Mack, K. A., Su, H., Wang, Q., & Kushalnagar, R. (2025) · Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706599.3719785 · Cited by 14
“Participants also used Text AI to summarize meeting transcripts, mitigating issues like rapid speech of multiple parties and captioning errors [47, 48].”
Self-citation
Metadata
- Authors
- McDonnell, E. J., Moon, S. H., Jiang, L., Goodman, S. M., Kushalnagar, R., Froehlich, J. E., & Findlater, L.
- Venue
- Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-15
- OpenAlex
- W4366549375
- Cited by
- 26
- References
- 16
- FWCI
- 75.08
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.