Ally: Understanding Text Messaging to Build a Better Onscreen Keyboard for Blind People
The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Millions of people worldwide use smartphones every day, but the standard issue QWERTY keyboard is poorly optimized for non-sighted input. In this article, we document the variety of methods blind people use to enter text into their smartphones, and focus on one particular need: sending text messages. We analyze two modern corpora of text messages and contrast them with an older text message corpus, as well as other corpora gathered from news articles, chat rooms, and books. We present a virtual keyboard for blind people optimized for sending text messages called Ally. To evaluate Ally, we conducted two user studies with blind participants. Our first study found increasing speeds and our second study found that half of participants reached comparable speeds to QWERTY, suggesting it may be a viable replacement. We conclude with a discussion of future work for non-sighted text-entry of text messages.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Other studies aimed to improve the usability of QWERTY keyboards for VIBPs (e.g., [38]) or to propose novel gestural (stroke-based) [39] or alternative layout keyboard-based input methods [40].”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [38]
In the citing paper
“Participant numbers ranged from as low as 2 [44] to up to 13 participants [38].”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [38]
In the citing paper
“We finally note that the majority of the prototypes involved some form of gesture support as the main method for entering characters (e.g., [36,38] or as a support mechanism, such as to change keyboard modes (from alphabetic to numeric) or to perform special actions such as backspacing or marking the end of a word.”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [38]
Citations
Cites
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
The design and evaluation of a high-performance soft keyboard
MacKenzie, I. S., & Zhang, S. X. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.302983 · Cited by 422
(2012) · Cited by 370
EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion
Wobbrock, J. O., Myers, B. A., & Kembel, J. A. (2003) · Proceedings of the 16th annual ACM symposium on User interface software and technology · doi:10.1145/964696.964703 · Cited by 355
Quikwriting: continuous stylus-based text entry
Perlin, K. (1998) · Proceedings of the 11th annual ACM symposium on User interface software and technology · doi:10.1145/288392.288613 · Cited by 264
Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic
Soukoreff, R. W., & MacKenzie, I. S. (2001) · CHI '01 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/634067.634256 · Cited by 241
Performance Optimization of Virtual Keyboards
Zhai, S., Hunter, M., & Smith, B. (2002) · Human-Computer Interaction · doi:10.1207/s15327051hci172&3_4 · Cited by 221
Theoretical upper and lower bounds on typing speed using a stylus and a soft keyboard
WILLIAM SOUKOREFF, R., & SCOTT MACKENZIE, I. (1995) · Behaviour & Information Technology · doi:10.1080/01449299508914656 · Cited by 211
Analysis of text entry performance metrics
Arif, A. S., & Stuerzlinger, W. (2009) · 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH) · doi:10.1109/tic-sth.2009.5444533 · Cited by 206
Cirrin: a word-level unistroke keyboard for pen input
Mankoff, J., & Abowd, G. D. (1998) · Proceedings of the 11th annual ACM symposium on User interface software and technology · doi:10.1145/288392.288611 · Cited by 191
Research works printed but not linked: 6
- 10.5555/2305276.2305297 · doi:10.5555/2305276.2305297
- Tiago Guerreiro, Joaquim Jorge, and Daniel Gonçalves. 2012. Exploring the non-visual acquisition of targets on touch phones and tablets. In 2nd Workshop on Mobile Accessibility, MobileHCI.
- Mark S. Mayzner and Margaret Elizabeth Tresselt. 1965. Tables of single-letter and diagram frequency counts for various word-length and letter-position combinations. Psychonomic Monograph Supplements (1965).
- Kyle Montague, João Guerreiro, Hugo Nicolau, Tiago Guerreiro, André Rodrigues, and Daniel Gonçalves. 2016. Towards inviscid text-entry for blind people through non-visual word prediction interfaces. In CHI Workshop on Inviscid Text-Entry and Beyond.
- Sherry Ruan, Jacob O. Wobbrock, Kenny Liou, Andrew Ng, and James Landay. 2016. Speech is 3× faster than typing for English and Mandarin text entry on mobile devices. arXiv:1608.07323. · arXiv
- Crispin Thurlow and Alex Brown. 2003. Generation Txt? The sociolinguistics of young people’s text-messaging. Discourse Analysis Online 1, 1 (2003), 30.
Cited by
Komninos, A., Stefanis, V., & Garofalakis, J. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7020022 · Cited by 16
Griggio, C. F., Gorman, B. M., & Tigwell, G. W. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641014 · Cited by 7
“Second, regarding communication, research has demonstrated the widely used QWERTY key-board layout is not optimised for use with a screen reader and the alternative layout of the keyboard letters can provide improved typing during text messaging [29].”
MethodYim, J., Ko, D., Kim, T., Kim, T., Hong, J., & Lee, G. (2025) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3746059.3747801 · Cited by 4
“External devices like headphones or portable keyboards offer a potential solution, but it is inconvenient to carry and handle additional devices [17, 23].”
Exploring the impact of word prediction assistive features on smartphone keyboards for blind users
Alnfiai, M. M., & Kabir, M. A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36653 · Cited by 3
Signage Detection Based on Adaptive SIFT
Wang, J., Chen, S., Shao, J., Qu, H. Y., & Wang, Z. (2023) · Smart innovation, systems and technologies · doi:10.1007/978-981-99-6706-3_13
Metadata
- Authors
- Lottridge, D., Yoon, C., Burton, D., Wang, C., & Kaye, J.
- Affiliations
- University of Auckland (NZ)
- Yahoo (United States) (US)
- Mozilla Foundation (US)
- Venue
- ACM Transactions on Accessible Computing
- Published
- 2022-10-22
- Volume
- 15
- Issue
- 4
- Pages
- 1-22
- ISSN
- 1936-7228 (ISSN-L)
- 1936-7236
- OpenAlex
- W4225393491
- Cited by
- 6
- References
- 46
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 2
- FWCI
- 0.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Accessible Computing (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
- Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
- Keywords
- text messaging, blind users, virtual keyboard, text entry, assistive technology, smartphone accessibility, QWERTY keyboard, typing speed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.