Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
We study the performance and user experience of two popular mainstream mobile text entry methods: the Smart Touch Keyboard (STK) and the Smart Gesture Keyboard (SGK). Our first study is a lab-based ten-session text entry experiment. In our second study we use a new text entry evaluation methodology based on the experience sampling method (ESM). In the ESM study, participants installed an Android app on their own mobile phones that periodically sampled their text entry performance and user experience amid their everyday activities for four weeks. The studies show that text can be entered at an average speed of 28 to 39 WPM, depending on the method and the user's experience, with 1.0% to 3.6% character error rates remaining. Error rates of touchscreen input, particularly with SGK, are a major challenge; and reducing out-of-vocabulary errors is particularly important. Both SGK and STK have strengths, weaknesses, and different individual awareness and preferences. Two-thumb touch typing in a focused setting is particularly effective on STK, whereas one-handed SGK typing with the thumb is particularly effective in more mobile situations. When exposed to both, users tend to migrate from STK to SGK. We also conclude that studies in the lab and in the wild can both be informative to reveal different aspects of keyboard experience, but used in conjunction is more reliable in comprehensively assessing input technologies of current and future generations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Delving into the details of how the lab studies were performed, we noted that all involved a form of transcription tasks, which have been termed as the de facto method for text entry studies [64,97], even though its validity has been criticized previously and alternatives have been proposed, such as the image description task or the composition task [64,98,99].”
From A Review of Design and Evaluation Practices in Mobile Text Entry for Visually Impaired and Blind Persons (2023) · cites this paper as [97]
Citations
Cites
Text Entry for Mobile Computing: Models and Methods, Theory and Practice
MacKenzie, I. S., & Soukoreff, R. W. (2002) · Human-Computer Interaction · doi:10.1207/s15327051hci172&3_2 · Cited by 571
SHARK 2: a large vocabulary shorthand writing system for pen-based computers
Kristensson, P.-O., & Zhai, S. (2004) · Proceedings of the 17th annual ACM symposium on User interface software and technology · doi:10.1145/1029632.1029640 · Cited by 419
Self-citationShorthand writing on stylus keyboard
Zhai, S., & Kristensson, P.-O. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642630 · Cited by 371
Self-citationUsing the experience sampling method to evaluate ubicomp applications
Consolvo, S., & Walker, M. (2003) · IEEE Pervasive Computing · doi:10.1109/mprv.2003.1203750 · Cited by 368
Goel, M., Findlater, L., & Wobbrock, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208662 · Cited by 203
The word-gesture keyboard: reimagining keyboard interaction
Zhai, S., & Kristensson, P. O. (2012) · Communications of the ACM · doi:10.1145/2330667.2330689 · Cited by 166
Self-citationDunlop, M., & Levine, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208659 · Cited by 99
ContextType: using hand posture information to improve mobile touch screen text entry
Goel, M., Jansen, A., Mandel, T., Patel, S. N., & Wobbrock, J. O. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481386 · Cited by 96
Relaxing stylus typing precision by geometric pattern matching
Kristensson, P.-O., & Zhai, S. (2005) · Proceedings of the 10th international conference on Intelligent user interfaces · doi:10.1145/1040830.1040867 · Cited by 88 · cited 1×
“Modern STKs perform automatic typing correction (e.g. [10, 16]) and allow users to choose among word predictions.”
BackgroundSelf-citationUncertain text entry on mobile devices
Weir, D., Pohl, H., Rogers, S., Vertanen, K., & Kristensson, P. O. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557412 · Cited by 85
Self-citationIn search of effective text input interfaces for off the desktop computing
Zhai, S., Kristensson, P.-O., & Smith, B. A. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2003.12.007 · Cited by 76
Self-citationFive Challenges for Intelligent Text Entry Methods
Kristensson, P. O., & Jameson, A. (2009) · AI Magazine · doi:10.1609/aimag.v30i4.2269 · Cited by 75
Self-citationDiscrete and Continuous Shape Writing for Text Entry and Control
Kristensson, P. O. (2007) · DiVA (Linkoping University) · Cited by 72
Self-citationCommand strokes with and without preview: using pen gestures on keyboard for command selection
Kristensson, P. O., & Zhai, S. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240797 · Cited by 62
Self-citationComplementing Text Entry Evaluations with a Composition Task
Vertanen, K., & Kristensson, P. O. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2555691 · Cited by 62 · cited 1×
“Complementary data might be gained by also using a composition task [23], which is able to more accurately model actual text entry activities.”
MethodSelf-citationBoth complete and correct?: multi-objective optimization of touchscreen keyboard
Bi, X., Ouyang, T., & Zhai, S. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557414 · Cited by 59
Self-citationPerformance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop
Rick, J. (2010) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/1866029.1866043 · Cited by 58
Gathering text entry metrics on android devices
Castellucci, S. J., & MacKenzie, I. S. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979799 · Cited by 56
Bi, X., Chelba, C., Ouyang, T., Partridge, K., & Zhai, S. (2012) · Proceedings of the 25th annual ACM symposium on User interface software and technology · doi:10.1145/2380116.2380136 · Cited by 53
Self-citationAsynchronous multimodal text entry using speech and gesture keyboards
Kristensson, P. O., & Vertanen, K. D. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-236 · Cited by 31
Self-citationLanguage modeling for soft keyboards
Goodman, J., Venolia, G. D., Steury, K. R., & Parker, C. R. (2002) · National Conference on Artificial Intelligence · doi:10.5555/777092.777159 · Cited by 29
Pickup Usability Dominates: A Brief History of Mobile Text Entry Research and Adoption
Dunlop, M. D., & Masters, M. M. (2009) · International Journal of Mobile Human Computer Interaction · doi:10.4018/jmhci.2009010103 · Cited by 19
Shape Writing on Tablets: Better Performance or Better Experience?
Nguyen, H., & Bartha, M. C. (2012) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181312561317 · Cited by 12
Improving word-recognizers using an interactive lexicon with active and passive words
Kristensson, P. O., & Zhai, S. (2008) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1378773.1378828 · Cited by 7
Self-citationFrom wax tablets to touchscreens: an introduction to text-entry research
Kristensson, P. O. (2014) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/2659835 · Cited by 3
Self-citation
Research works printed but not linked: 1
- MacKenzie , I.S. and Tanaka-Ishii , K. (Eds.). 2007 . Text Entry Systems . San Francisco: Morgan Kauffman, 139--158. MacKenzie, I.S. and Tanaka-Ishii, K. (Eds.). 2007. Text Entry Systems. San Francisco: Morgan Kauffman, 139--158.
Cited by
The Experience Sampling Method on Mobile Devices
van Berkel, N., Ferreira, D., & Kostakos, V. (2018) · ACM Computing Surveys · doi:10.1145/3123988 · Cited by 432
How do People Type on Mobile Devices?: Observations from a Study with 37,000 Volunteers
Palin, K., Feit, A. M., Kim, S., Kristensson, P. O., & Oulasvirta, A. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340120 · Cited by 190
“They reported input rates of 32 WPM [7] and 31 WPM [31].”
BackgroundSelf-citationTap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs
Yu, C., Gu, Y., Yang, Z., Yi, X., Luo, H., & Shi, Y. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025964 · Cited by 169
“In a recent study, WGK yielded 30 WPM in lab and 39 WPM in the wild [27].”
BackgroundA Bermuda Triangle?: A Review of Method Application and Triangulation in User Experience Evaluation
Pettersson, I., Lachner, F., Frison, A.-K., Riener, A., & Butz, A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174035 · Cited by 168
“Only two papers mix theory [89] or user groups [83].”
BackgroundWatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding
Gordon, M., Ouyang, T., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858242 · Cited by 150
“For the latest and perhaps the most comprehensive published smartphone STK and SGK empirical evaluation, see Reyal et al [11].”
BackgroundResultSelf-citation
Metadata
- Authors
- Reyal, S., Zhai, S., & Kristensson, P. O.
- Affiliations
- University of St Andrews (GB)
- Google (United States) (US)
- Venue
- Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2015-04-18
- Pages
- 679-688
- OpenAlex
- W2010376411
- Cited by
- 135
- References
- 25
- Citations by year
- 2026: 1 · 2025: 52 · 2024: 7 · 2023: 11 · 2022: 6 · 2021: 8 · 2020: 15 · 2019: 9 · 2018: 9 · 2017: 10 · 2016: 6 · 2015: 1
- FWCI
- 6.56
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- St Andrews Research Repository (St Andrews Research Repository) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Keywords
- touchscreen keyboards, mobile text entry, typing speed, character error rate, user experience, ecological momentary assessment, in-the-wild evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.