Analysis of text entry performance metrics
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Researchers have proposed many text entry systems to enable users to perform this frequent task as quickly and precise as possible. Unfortunately the reported data varies widely and it is difficult to extract meaningful average entry speeds and error rates from this body of work. In this article we collect data from well-designed and well-reported experiments for the most important text entry methods, including those for handheld devices. Our survey results show that thumb keyboard is the fastest text entry method after the standard QWERTY keyboard, and that Twiddler is fastest amongst non-QWERTY methods. Moreover, we survey how text entry errors were handled in these studies. Finally, we conducted a user study to detect which effect different error-handling methodologies have on text entry performance metrics. Our study results show that the way human errors are handled has indeed a significant effect on all frequently used error metrics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Even though the total error rate has been characterized as the most powerful metric out of all those available, since it captures not just error-making behavior but also the effort expended to fix errors [68], it was only reported in five studies.”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [68]
In the citing paper
“An impressive 57.7% of the studies with non-impaired persons used metrics other than the core ones examined in [68].”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [68]
In the citing paper
“In terms of error rate reporting, a variety of metrics was used to report the results, but even though the total error rate has been lauded as the most complete measure of both errors and the effort (if expended) to correct them [68], it was only used in 19.2% of the studies with VIBPs and 30.8% of the studies with non-impaired persons.”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [68]
Citations
Cites
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric
Soukoreff, R. W., & MacKenzie, I. S. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642632 · Cited by 398
Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic
Soukoreff, R. W., & MacKenzie, I. S. (2001) · CHI '01 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/634067.634256 · Cited by 241
TiltText: using tilt for text input to mobile phones
Wigdor, D., & Balakrishnan, R. (2003) · Proceedings of the 16th annual ACM symposium on User interface software and technology · doi:10.1145/964696.964705 · Cited by 202
Twiddler typing: one-handed chording text entry for mobile phones
Lyons, K., Starner, T., Plaisted, D., Fusia, J., Lyons, A., Drew, A., & Looney, E. W. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985777 · Cited by 196
Text input for mobile devices: comparing model prediction to actual performance
James, C. L., & Reischel, K. M. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365300 · Cited by 188
LetterWise: prefix-based disambiguation for mobile text input
MacKenzie, I. S., Kober, H., Smith, D., Jones, T., & Skepner, E. (2001) · Proceedings of the 14th annual ACM symposium on User interface software and technology · doi:10.1145/502348.502365 · Cited by 176
An empirical study of typing rates on mini-QWERTY keyboards
Clarkson, E., Clawson, J., Lyons, K., & Starner, T. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056898 · Cited by 136
Expert Chording Text Entry on the Twiddler One-Handed Keyboard
Lyons, K., Plaisted, D., & Starner, T. E. (2004) · International Symposium on Wearable Computers · doi:10.1109/iswc.2004.19 · Cited by 116
Yamada, H. (1980) · Journal of information processing · Cited by 116
Cited by
WatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding
Gordon, M., Ouyang, T., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858242 · Cited by 150
Lehmann, F., Markert, N., Dang, H., & Buschek, D. (2022) · Mensch und Computer 2022 · doi:10.1145/3543758.3543947 · Cited by 25
Komninos, A., Stefanis, V., & Garofalakis, J. (2023) · Multimodal Technologies and Interaction · doi:10.3390/mti7020022 · Cited by 16
Senorita: A Chorded Keyboard for Sighted, Low Vision, and Blind Mobile Users
Rakhmetulla, G., & Arif, A. S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376576 · Cited by 14
“We recorded the commonly used words per minute (wpm) and error rate [4, 45] metrics to measure speed and accuracy, respectively.”
MethodSelf-citationChallenges in Mobile Text Entry using Virtual Keyboards for Low-Vision Users
Stefanis, V., Komninos, A., & Garofalakis, J. (2020) · 19th International Conference on Mobile and Ubiquitous Multimedia · doi:10.1145/3428361.3428391 · Cited by 6
Metadata
- Authors
- Arif, A. S., & Stuerzlinger, W.
- Affiliations
- York University (CA)
- Venue
- 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH)
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 100-105
- OpenAlex
- W2159203809
- Cited by
- 206
- References
- 21
- Citations by year
- 2026: 9 · 2025: 18 · 2024: 17 · 2023: 24 · 2022: 14 · 2021: 13 · 2020: 18 · 2019: 15 · 2018: 15 · 2017: 7 · 2016: 14 · 2015: 9 · 2014: 7 · 2013: 11 · 2012: 7
- FWCI
- 3.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Toronto International Conference Science and Technology for Humanity (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Keywords
- text entry, entry speed, error rate, error handling, QWERTY keyboard, handheld devices, performance indicators, user study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis of text entry performance metrics. https://app.cochat.ai/papers/10.1109/tic-sth.2009.5444533
- The paper
- Arif, A. S., & Stuerzlinger, W. (2009). Analysis of text entry performance metrics. 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). https://doi.org/10.1109/tic-sth.2009.5444533
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.