A versatile dataset for text entry evaluations based on genuine mobile emails
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Mobile text entry methods are typically evaluated by having study participants copy phrases. However, currently there is no available phrase set that has been composed by mobile users. Instead researchers have resorted to using invented phrases that probably suffer from low external validity. Further, there is no available phrase set whose phrases have been verified to be memorable. In this paper we present a collection of mobile email sentences written by actual users on actual mobile devices. We obtained our sentences from emails written by Enron employees on their BlackBerry mobile devices. We provide empirical data on how easy the sentences were to remember and how quickly and accurately users could type these sentences on a full-sized keyboard. Using this empirical data, we construct a series of phrase sets we suggest for use in text entry evaluations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Klimt, B., & Yang, Y. (2004) · Conference on Email and Anti-Spam · Cited by 575
When fingers do the talking: a study of text messaging
Faulkner, X., & Culwin, F. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2004.11.002 · Cited by 182
Sampling representative phrase sets for text entry experiments: a procedure and public resource
Paek, T., & Hsu, B.-J. (. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979304 · Cited by 30
Research works printed but not linked: 1
- Klimt B., 2004, Proc. Email and Anti-Spam
Cited by
Effects of Language Modeling and its Personalization on Touchscreen Typing Performance
Fowler, A., Partridge, K., Chelba, C., Bi, X., Ouyang, T., & Zhai, S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702503 · Cited by 127
Complementing Text Entry Evaluations with a Composition Task
Vertanen, K., & Kristensson, P. O. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2555691 · Cited by 62
Self-citationThe inviscid text entry rate and its application as a grand goal for mobile text entry
Kristensson, P. O., & Vertanen, K. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628405 · Cited by 39
“The sentences were taken from a corpus of email messages written by Enron employees on their BlackBerry mobile devices [19].”
BackgroundSelf-citationFingerText: Exploring and Optimizing Performance for Wearable, Mobile and One-Handed Typing
Lee, D., Kim, J., & Oakley, I. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445106 · Cited by 34
Word Clarity as a Metric in Sampling Keyboard Test Sets
Yi, X., Yu, C., Shi, W., Bi, X., & Shi, Y. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025701 · Cited by 26
“Optimization Metrics When sampling phrase sets for text entry experiments, memorability and representativeness are two metrics that have been widely adopted by researchers [23, 25, 33, 39].”
BackgroundMethodResultInfluential
Metadata
- Authors
- Vertanen, K., & Kristensson, P. O.
- Affiliations
- Princeton University (US)
- University of Cambridge (GB)
- Venue
- Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
- Publisher
- ACM
- Published
- 2011-08-30
- Pages
- 295-298
- OpenAlex
- W2104328027
- Cited by
- 177
- References
- 4
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 16 · 2023: 19 · 2022: 10 · 2021: 19 · 2020: 11 · 2019: 10 · 2018: 13 · 2017: 6 · 2016: 13 · 2015: 7 · 2014: 17 · 2013: 5 · 2012: 6
- FWCI
- 6.91
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) (publishedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/H027408/1)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- mobile text entry, mobile email, blackberry, user-generated text, memorability, typing accuracy, generalizability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A versatile dataset for text entry evaluations based on genuine mobile emails. https://app.cochat.ai/papers/10.1145/2037373.2037418
- The paper
- Vertanen, K., & Kristensson, P. O. (2011). A versatile dataset for text entry evaluations based on genuine mobile emails. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. https://doi.org/10.1145/2037373.2037418
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.