Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
With the ubiquity of mobile touchscreen devices like smartphones, two widely used text entry methods have emerged: small touch-based keyboards and speech recognition. Although speech recognition has been available on desktop computers for years, it has continued to improve at a rapid pace, and it is currently unknown how today's modern speech recognizers compare to state-of-the-art mobile touch keyboards, which also have improved considerably since their inception. To discover both methods' “upper-bound performance,” we evaluated them in English and Mandarin Chinese on an Apple iPhone 6 Plus in a laboratory setting. Our experiment was carried out using Baidu's Deep Speech 2, a deep learning-based speech recognition system, and the built-in Qwerty (English) or Pinyin (Mandarin) Apple iOS keyboards. We found that with speech recognition, the English input rate was 2.93 times faster (153 vs. 52 WPM), and the Mandarin Chinese input rate was 2.87 times faster (123 vs. 43 WPM) than the keyboard for short message transcription under laboratory conditions for both methods. Furthermore, although speech made fewer errors during entry (5.30% vs. 11.22% corrected error rate), it left slightly more errors in the final transcribed text (1.30% vs. 0.79% uncorrected error rate). Our results show that comparatively, under ideal conditions for both methods, upper-bound speech recognition performance has greatly improved compared to prior systems, and might see greater uptake in the future, although further study is required to quantify performance in non-laboratory settings for both methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Individual Comparisons by Ranking Methods
Wilcoxon, F. (1945) · Biometrics Bulletin · doi:10.2307/3001968 · Cited by 15,354
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“In addition to the performance measures, we asked participants to evaluate the workload of the tasks using the NASA TLX 7-point Likert scale across six categories [12,13].”
MethodPhrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
Soukoreff, R. W., & MacKenzie, I. S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642632 · Cited by 398
Towards an integrated understanding of speaking rate in conversation
Yuan, J., Liberman, M., & Cieri, C. (2006) · Interspeech 2006 · doi:10.21437/interspeech.2006-204 · Cited by 223
Analyzing the input stream for character- level errors in unconstrained text entry evaluations
Wobbrock, J. O., & Myers, B. A. (2006) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1188816.1188819 · Cited by 200 · cited 1×
“Since we want to analyze not only the transcribed string but also what happens during the user’s input, we need to define the input stream and classify characters in an input stream [34].”
BackgroundSelf-citationMultimodal error correction for speech user interfaces
Suhm, B., Myers, B., & Waibel, A. (2001) · ACM Transactions on Computer-Human Interaction · doi:10.1145/371127.371166 · Cited by 198 · cited 1×
“As with existing phone-based systems, we incorporate a touchscreen keyboard in our speech input method and provide the user with the flexibility to correct errors using either speech or the keyboard [43].”
Method(2007) · doi:10.1016/b978-012373591-1/50003-6 · Cited by 84 · cited 2×
“bile, Wearable and Ubiquitous Technologies, Vol. 1, No. 4, Article 159. Publication date: December 2017. 3.6 Measures We present and discuss the following empirical measures of text entry performance [48]. We use T i to denote the ith transcribed string, P i the i th presented string, and S i the i th phrase returned…”
MethodInfluentialSelf-citation
Cited by
Chen, C., Johnson, J. G., Charles, K., Lee, A., Lifset, E. T., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3471218 · Cited by 67
McDonnell, E. J., Liu, P., Goodman, S. M., Kushalnagar, R., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479578 · Cited by 54
Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
Lin, S., Warner, J., Zamfirescu-Pereira, J. D., Lee, M. G., Jain, S., Cai, S., Lertvittayakumjorn, P., Huang, M. X., Zhai, S., Hartmann, B., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642217 · Cited by 39
JustCorrect: Intelligent Post Hoc Text Correction Techniques on Smartphones
Cui, W., Zhu, S., Zhang, M. R., Schwartz, H. A., Wobbrock, J. O., & Bi, X. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415857 · Cited by 24
Self-citationReviewing Speech Input with Audio: Differences between Blind and Sighted Users
Hong, J., Vaing, C., Kacorri, H., & Findlater, L. (2020) · ACM Transactions on Accessible Computing · doi:10.1145/3382039 · Cited by 11
Metadata
- Authors
- Ruan, S., Wobbrock, J. O., Liou, K., Ng, A., & Landay, J. A.
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-01-08
- Volume
- 1
- Issue
- 4
- Pages
- 1-23
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2782574535
- Cited by
- 187
- References
- 9
- FWCI
- 8.49
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones. https://app.cochat.ai/papers/10.1145/3161187
- The paper
- Ruan, S., Wobbrock, J. O., Liou, K., Ng, A., & Landay, J. A. (2018). Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. https://doi.org/10.1145/3161187
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.