Feasibility of Using Automatic Speech Recognition with Voices of Deaf and Hard-of-Hearing Individuals
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce costs and interactive friction, supported by the rapid growth in capabilities of speech-controlled interfaces, e.g., Amazon Echo or Apple's Siri. A consequence is that people who are deaf or hard of hearing (DHH) may be unable to use these speech-controlled devices. We show that deaf speech has a high error rate compared to hearing speech, in commercial speech-controlled interfaces. Deaf speech had approximately a 78% word error rate (WER) compared to a hearing speech 18% WER. Our findings show that current speech-controlled interfaces are not usable by DHH people.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior work finds that speech recognition often breaks down for children and older adults [3,21] as well as people who are deaf or hard-of-hearing [16], because there is wide variation in pitch, pronunciation, patterns of stress, and intersyllabic pauses, leading to higher recognition error rates [16,21,35].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [16]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Samar, V. J., & Metz, D. E. (1988) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3103.307 · Cited by 90
Deaf Speech Assessment Using Digital Processing Techniques
Jeyalakshmi, C., Krishnamurthi, V., & Revathy, A. (2010) · Signal & Image Processing An International Journal · doi:10.5121/sipij.2010.1102 · Cited by 8
Research works printed but not linked: 3
- Thirumalai M. S., 2004, Central Institute of Indian Languages
- Osberger Mary J., 1982, McGarr. Speech production characteristics of the hearing impaired. Journal of Speech, Language and Hearing Research, 8, 221
- Doddington George R, 1989 International Conference on, 559
Cited by
Branham, S. M., & Mukkath Roy, A. R. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353797 · Cited by 75
On the impact of dysarthric speech on contemporary ASR cloud platforms
Russis, L. D., & Corno, F. (2019) · Journal of Reliable Intelligent Environments · doi:10.1007/s40860-019-00085-y · Cited by 65
McDonnell, E. J., Liu, P., Goodman, S. M., Kushalnagar, R., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479578 · Cited by 54
“[25] found that Microsoft’s Translator Speech API’s word error rate was 18% for hearing speakers and 78% for Deaf speakers.”
BackgroundSelf-citationMyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
Kim, Y.-H., Chou, D., Lee, B., Danilovich, M., Lazar, A., Conroy, D. E., Kacorri, H., & Choe, E. K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517457 · Cited by 39
Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users
Fok, R., Kaur, H., Palani, S., Mott, M. E., & Lasecki, W. S. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236343 · Cited by 34
Assessing Virtual Assistant Capabilities with Italian Dysarthric Speech
Ballati, F., Corno, F., & De Russis, L. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236354 · Cited by 39
Glasser, A., Kushalnagar, K., & Kushalnagar, R. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3134781 · Cited by 38
Self-citationAutomatic Speech Recognition Services: Deaf and Hard-of-Hearing Usability
Glasser, A. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3308461 · Cited by 36
Self-citationMcDonnell, E. J., Moon, S. H., Jiang, L., Goodman, S. M., Kushalnagar, R., Froehlich, J. E., & Findlater, L. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580809 · Cited by 26
Self-citationBlair, J., & Abdullah, S. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432194 · Cited by 35
Accessibility for Deaf and Hard of Hearing Users: Sign Language Conversational User Interfaces
Glasser, A., Mande, V., & Huenerfauth, M. (2020) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3405755.3406158 · Cited by 29
Self-citationZhao, R., Choi, A. S. G., Koenecke, A., & Rameau, A. (2024) · The Laryngoscope · doi:10.1002/lary.31713 · Cited by 28
Understanding and Designing for Deaf or Hard of Hearing Drivers on Uber
Lee, S., Hubert‐Wallander, B., Stevens, M., & Carroll, J. M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300759 · Cited by 26
Understanding the Needs and Challenges of Using Conversational Agents for Deaf Older Adults
Blair, J., & Abdullah, S. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359487 · Cited by 23
Glasser, A., Mande, V., & Huenerfauth, M. (2021) · International Web for All Conference (W4A) · doi:10.1145/3430263.3452428 · Cited by 21
Self-citationPriority Determination to Apply Artificial Intelligence Technology in Military Intelligence Areas
Cho, S., Shin, W., 김능회, Jeong, J., & In, H. P. (2020) · Electronics · doi:10.3390/electronics9122187 · Cited by 20
Jaddoh, A., Loizides, F., Lee, J., & RANA, O. F. (2023) · Universal Access in the Information Society · doi:10.1007/s10209-023-01037-3 · Cited by 11
Martins, R. S., Rabelo, D. M. F., Araújo, M. D. C. C., & Viana, W. (2022) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3554364.3559133 · Cited by 9
An Analysis of Personalized Speech Recognition System Development for the Deaf and Hard-of-Hearing
Violeta, L. P., & Toda, T. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317318 · Cited by 7
Zeng, S., Xu, X., Chi, X., Liu, Y., Yu, H., & Zou, F. (2025) · IEEE Access · doi:10.1109/access.2025.3569321 · Cited by 6
An Effective Learning Method for Automatic Speech Recognition in Korean CI Patients’ Speech
Jeong, J., Mondol, S. I. M. M. R., Kim, Y. W., & Lee, S. (2021) · Electronics · doi:10.3390/electronics10070807 · Cited by 5
Lin, K. R. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-61947-2_9 · Cited by 5
Yoon, S., Kim, H., Kim, K., & Lee, S. (2025) · IEEE Signal Processing Letters · doi:10.1109/lsp.2025.3640524 · Cited by 4
Alfaro, A. U., Pfaff, M. S., Ybarra, V. T., Browning, N. M., McHugh, J. A., Malloy, J. E., & Edell, J. D. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231193665 · Cited by 3
Speech AI for All: The What, How, and Who of Measurement
Wenzel, K., Pradhan, A., Teleki, M., Weinberg, T. M., Netzorg, R., Zisk, A. H., Choi, A. S. G., Li, J., Kushalnagar, R., Lea, C., et al. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778768 · Cited by 2
Self-citationBuilding A Speech Corpus Of Children With Cochlear Implants Via An Enhanced Metadata Structure
Lee, S., Kim, S., & Chung, M. (2022) · International Conference on Speech Database and Assessments · doi:10.1109/o-cocosda202257103.2022.9997935 · Cited by 2
Alexa, I Wanna See You: Envisioning Smart Home Assistants for the Deaf and Hard-of-HearingPreprint
Maria, T. J. S., & Deja, J. A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.00514 · Cited by 1
Sensory-driven micro-interventions for improved health and wellbeing
Abdalla, Y., Gatti, E., Orlu, M., & Obrist, M. (2025) · Digital Health · doi:10.1177/20552076251408522 · Cited by 1
Development of a Web Platform for Supporting Pronunciation Correction for the Hearing Impaired
Lee, K., Yoon, H., Oh, S., Cho, M., & Yoo, S. (2025) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2025.28.12.009
Alfaro, A. U., Roundtree, K. A., Pfaff, M. S., Bos, N., Edell, J. D., & ten Brink, R. (2026) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2026.2716598
González, J. (2023) · Repositorio Digital Universidad Torcuato Di Tella
Atemnkeng, S., Boudreault, P., DeVries, P. S., May, L., & Vogler, C. (2026) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3797867.3829005
Ko, T., & Lee, K. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3817018
Bridging the Speech AI Accessibility Gap for Deaf and Hard of Hearing People
Glasser, A., Vogler, C., & Kushalnagar, R. (2026) · Interspeech (USB) · doi:10.21437/interspeech.2026-3001
Self-citation
Metadata
- Authors
- Glasser, A. T., Kushalnagar, K. R., & Kushalnagar, R. S.
- Affiliations
- Rochester Institute of Technology (US)
- Gallaudet University (US)
- Venue
- Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2017-10-19
- Pages
- 373-374
- OpenAlex
- W2765687795
- Cited by
- 28
- References
- 2
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 2 · 2023: 4 · 2022: 3 · 2021: 3 · 2020: 3 · 2019: 5 · 2018: 2 · 2017: 1
- FWCI
- 1.37
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1460894)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deaf speech, speech recognition, word error rate, accessibility, assistive technology, voice user interface
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.