A versatile dataset for text entry evaluations based on genuine mobile emails
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Mobile text entry methods are typically evaluated by having study participants copy phrases. However, currently there is no available phrase set that has been composed by mobile users. Instead researchers have resorted to using invented phrases that probably suffer from low external validity. Further, there is no available phrase set whose phrases have been verified to be memorable. In this paper we present a collection of mobile email sentences written by actual users on actual mobile devices. We obtained our sentences from emails written by Enron employees on their BlackBerry mobile devices. We provide empirical data on how easy the sentences were to remember and how quickly and accurately users could type these sentences on a full-sized keyboard. Using this empirical data, we construct a series of phrase sets we suggest for use in text entry evaluations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Klimt, B., & Yang, Y. (2004) · Conference on Email and Anti-Spam · Cited by 575
When fingers do the talking: a study of text messaging
Faulkner, X., & Culwin, F. (2005) · Interacting with Computers · doi:10.1016/j.intcom.2004.11.002 · Cited by 182
Sampling representative phrase sets for text entry experiments: a procedure and public resource
Paek, T., & Hsu, B.-J. (. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979304 · Cited by 30
Research works printed but not linked: 1
- Klimt B., 2004, Proc. Email and Anti-Spam
Cited by
Observations on Typing from 136 Million Keystrokes
Dhakal, V., Feit, A. M., Kristensson, P. O., & Oulasvirta, A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174220 · Cited by 226
Self-citationHow do People Type on Mobile Devices?: Observations from a Study with 37,000 Volunteers
Palin, K., Feit, A. M., Kim, S., Kristensson, P. O., & Oulasvirta, A. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340120 · Cited by 190
Self-citationPerformance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality
Dudley, J. J., Benko, H., Wigdor, D., & Kristensson, P. O. (2019) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar.2019.00027 · Cited by 179
Self-citationText Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards
Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., & Kristensson, P. O. (2018) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2018.8446059 · Cited by 177
Self-citationSelection-based Text Entry in Virtual Reality
Speicher, M., Feit, A. M., Ziegler, P., & Krüger, A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174221 · Cited by 173
Metadata
- Authors
- Vertanen, K., & Kristensson, P. O.
- Affiliations
- Princeton University (US)
- University of Cambridge (GB)
- Venue
- Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
- Publisher
- ACM
- Published
- 2011-08-30
- Pages
- 295-298
- OpenAlex
- W2104328027
- Cited by
- 177
- References
- 4
- Citations by year
- 2026: 9 · 2025: 15 · 2024: 16 · 2023: 19 · 2022: 10 · 2021: 19 · 2020: 11 · 2019: 10 · 2018: 13 · 2017: 6 · 2016: 13 · 2015: 7 · 2014: 17 · 2013: 5 · 2012: 6
- FWCI
- 6.91
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) (publishedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/H027408/1)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › User Authentication and Security Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- mobile text entry, mobile email, blackberry, user-generated text, memorability, typing accuracy, generalizability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.