Exploring the use of speech input by blind people on mobile devices
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Much recent work has explored the challenge of nonvisual text entry on mobile devices. While researchers have attempted to solve this problem with gestures, we explore a different modality: speech. We conducted a survey with 169 blind and sighted participants to investigate how often, what for, and why blind people used speech for input on their mobile devices. We found that blind people used speech more often and input longer messages than sighted people. We then conducted a study with 8 blind people to observe how they used speech input on an iPod compared with the on-screen keyboard with VoiceOver. We found that speech was nearly 5 times as fast as the keyboard. While participants were mostly satisfied with speech input, editing recognition errors was frustrating. Participants spent an average of 80.3% of their time editing. Finally, we propose challenges for future work, including more efficient eyes-free editing and better error detection methods for reviewing text.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite voice interaction flaws, mobile text entry through automatic speech recognition (ASR) and Text To Speech (TTS), remains the mode preferred by blind users [1], but it can raise privacy issues.”
From Designing a text entry multimodal keypad for blind users of touchscreen mobile phones (2014) · cites this paper as [1]
In the citing paper
“For example, studies report that, unlike other groups, long messages and complex commands are often used by blind users [1,2].”
From Reading Between the Guidelines: How Commercial Voice Assistant Guidelines Hinder Accessibility for Blind Users (2019) · cites this paper as [2]
In the citing paper
“In addition, while it is estimated that there are six times more people with low vision than blind people in the world [12], almost 70% of our participants were blind, similar to an online survey by Azenkot and Lee [6], in which 84% of participants were blind.”
From Understanding Authentication Method Use on Mobile Devices by People with Vision Impairment (2018) · cites this paper as Azenkot and Lee [6]
Citations
Cites
Lea, W. A. (1980) · Prentice Hall PTR eBooks · Cited by 479
The design and evaluation of a high-performance soft keyboard
MacKenzie, I. S., & Zhang, S. X. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.302983 · Cited by 422
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008) · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487 · Cited by 374
Usable gestures for blind people: understanding preference and performance
Kane, S. K., Wobbrock, J. O., & Ladner, R. E. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979001 · Cited by 314
Taming recognition errors with a multimodal interface
Oviatt, S. (2000) · Communications of the ACM · doi:10.1145/348941.348979 · Cited by 299
Patterns of entry and correction in large vocabulary continuous speech recognition systems
Karat, C.-M., Halverson, C., Horn, D., & Karat, J. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303160 · Cited by 275
Analyzing the input stream for character- level errors in unconstrained text entry evaluations
Wobbrock, J. O., & Myers, B. A. (2006) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1188816.1188819 · Cited by 200 · cited 1×
“First, in standard text entry studies ( e.g. , [5,17,22,27,30,33]), participants transcribe sets of phrases.”
BackgroundMultimodal error correction for speech user interfaces
Suhm, B., Myers, B., & Waibel, A. (2001) · ACM Transactions on Computer-Human Interaction · doi:10.1145/371127.371166 · Cited by 198
(2007) · Cited by 192
No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry
Bonner, M. N., Brudvik, J. T., Abowd, G. D., & Edwards, W. K. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-12654-3_24 · Cited by 154 · cited 2×
“Methods that were not based on Braille [9,25,34], including No-Look Notes [6] and NavTouch [22], did not achieve comparable performance to the former set.”
BackgroundBrailleTouch: Mobile Texting for the Visually Impaired
Frey, B., Southern, C., & Romero, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21666-4_3 · Cited by 129
An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired
Southern, C., Clawson, J., Frey, B., Abowd, G., & Romero, M. (2012) · Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2371574.2371623 · Cited by 125
The Beauty of Errors: Patterns of Error Correction in Desktop Speech Systems.
Halverson, C. A., Horn, D. B., Karat, C.-M., & Karat, J. (1999) · International Conference on Human-Computer Interaction · Cited by 123
Blind people and mobile touch-based text-entry: acknowledging the need for different flavors
Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., & Gonçalves, D. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049569 · Cited by 123 · cited 4×
“Methods that were not based on Braille [9,25,34], including No-Look Notes [6] and NavTouch [22], did not achieve comparable performance to the former set.”
BackgroundMethodInfluential(2012) · Graphics Interface · Cited by 103
Self-citation(2007) · doi:10.1016/b978-012373591-1/50003-6 · Cited by 84
Guidelines for the Use of Multimedia in Instruction
Williams, J. R. (1998) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193129804202019 · Cited by 83
Adaptive blind interaction technique for touchscreens
Yfantidis, G., & Evreinov, G. (2006) · Universal Access in the Information Society · doi:10.1007/s10209-004-0109-7 · Cited by 73
TypeInBraille: a braille-based typing application for touchscreen devices
Mascetti, S., Bernareggi, C., & Belotti, M. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049614 · Cited by 68
Sears, A., Karat, C.-M., Oseitutu, K., Karimullah, A. S., & Feng, J. H. (2001) · Universal Access in the Information Society · doi:10.1007/s102090100001 · Cited by 63
Gathering text entry metrics on android devices
Castellucci, S. J., & MacKenzie, I. S. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979799 · Cited by 56
Mobile Messenger for the Blind
Sánchez, J., & Aguayo, F. (2007) · Springer eBooks · doi:10.1007/978-3-540-71025-7_24 · Cited by 48
Voice typing: a new speech interaction model for dictation on touchscreen devices
Kumar, A., Paek, T., & Lee, B. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208386 · Cited by 47
Improving the usability of speech-based interfaces for blind users
Pitt, I. J., & Edwards, A. D. N. (1996) · doi:10.1145/228347.228367 · Cited by 43
Eyes-free text entry on a touchscreen phone
Tinwala, H., & MacKenzie, I. S. (2009) · 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH) · doi:10.1109/tic-sth.2009.5444381 · Cited by 42
On the intelligibility of fast synthesized speech for individuals with early-onset blindness
Stent, A., Syrdal, A., & Mishra, T. (2011) · The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility · doi:10.1145/2049536.2049574 · Cited by 34
Predicting human perceived accuracy of ASR systems
Mishra, T., Ljolje, A., & Gilbert, M. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-364 · Cited by 28
Fischer, A. R. H., Price, K. J., & Sears, A. (2005) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1903_1 · Cited by 20
Research works printed but not linked: 1
- Apple Inc. Chapter 11: Using VoiceOver Gestures. From VoiceOver Getting Started. http://www.apple.com/voiceover/info/guide/_1137.html#vo28035. Apple Inc. Chapter 11: Using VoiceOver Gestures. From VoiceOver Getting Started . http://www.apple.com/voiceover/info/guide/_1137.html#vo28035.
Cited by
Pradhan, A., Mehta, K., & Findlater, L. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174033 · Cited by 448
“For users with visual impairments, speech input on mobile devices is more common than it is for sighted users [4,42], due to efficiency for text entry [4] and browsing [3].”
BackgroundAbdolrahmani, A., Kuber, R., & Branham, S. M. (2018) · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3234695.3236344 · Cited by 172
“While less is known about the experiences and barriers when accessing VAPAs, studies have examined issues associated with speech input for individuals who are blind, in terms of mobile device usage [2,26] for purposes of navigation [13] and supporting education [3,18,23,24].”
BackgroundInfluentialSato, D., Oh, U., Naito, K., Takagi, H., Kitani, K., & Asakawa, C. (2017) · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3132525.3132535 · Cited by 158
“Although evaluating this cognitive assistant is not within the scope of this paper as it is in its early development phase, we expect that speech-based input will relieve cognitive and physical loads, as speech input is known to be faster than manual input [11].”
BackgroundCurrent and future mobile and wearable device use by people with visual impairments
Ye, H., Malu, M., Oh, U., & Findlater, L. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557085 · Cited by 148
“Perhaps reflecting this challenge, participants were likely to use speech input and/or Bluetooth keyboards—confirming the survey findings and past work on speech [2].”
BackgroundResultInfluentialSmartphone Text Input Method Performance, Usability, and Preference With Younger and Older Adults
Smith, A. L., & Chaparro, B. S. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815575644 · Cited by 107
“…level of participant expertise and demographics, and differences in the device used (Allen, McFarlin, & Green, 2008; Arif & Stuerzlinger, 2009; Azenkot & Lee, 2013; Cas-tellucci & MacKenzie, 2013; Hoggan, Brewster, & Johnston, 2008; Nguyen & Bartha, 2012; Nicolau & Jorge, 2012; Page, 2013;…”
ResultInfluential
Metadata
- Authors
- Azenkot, S., & Lee, N. B.
- Affiliations
- University of Washington (US)
- ORCID
- Azenkot, Shiri
- Venue
- Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
- Publisher
- ACM
- Published
- 2013-10-21
- Pages
- 1-8
- OpenAlex
- W2124098101
- Cited by
- 151
- References
- 28
- Citations by year
- 2026: 3 · 2025: 14 · 2024: 18 · 2023: 14 · 2022: 11 · 2021: 17 · 2020: 14 · 2019: 11 · 2018: 20 · 2017: 13 · 2016: 6 · 2015: 5 · 2014: 5
- FWCI
- 8.46
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion)
- Funders
- AT and T
- National Science Foundation (1116051)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Keywords
- speech input, blind users, mobile devices, voice-over, virtual keyboard, text entry speed, error detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.