Analyzing the input stream for character- level errors in unconstrained text entry evaluations
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Recent improvements in text entry error rate measurement have enabled the running of text entry experiments in which subjects are free to correct errors (or not) as they transcribe a presented string. In these “unconstrained” experiments, it is no longer necessary to force subjects to unnaturally maintain synchronicity with presented text for the sake of performing overall error rate calculations. However, the calculation of character-level error rates, which can be trivial in artificially constrained evaluations, is far more complicated in unconstrained text entry evaluations because it is difficult to infer a subject's intention at every character. For this reason, prior character-level error analyses for unconstrained experiments have only compared presented and transcribed strings, not input streams. But input streams are rich sources of character-level error information, since they contain all of the text entered (and erased) by a subject. The current work presents an algorithm for the automated analysis of character-level errors in input streams for unconstrained text entry evaluations. It also presents new character-level metrics that can aid method designers in refining text entry methods. To exercise these metrics, we perform two analyses on data from an actual text entry experiment. One analysis, available from the prior work, uses only presented and transcribed strings. The other analysis uses input streams, as described in the current work. The results confirm that input stream error analysis yields richer information for the same empirical data. To facilitate the use of these new analyses, we offer pseudocode and downloadable software for performing unconstrained text entry experiments and analyzing data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“However, in doing so these works neglect to justify how and why differences exist between interfaces; for instance, in character-level errors [13, 27].”
From Typing Performance of Blind Users (2015) · cites this paper as [27]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In contrast, Wobbrock and Myers [27] presented the input stream taxonomy to support unconstrained text-entry evaluations.”
From Typing Performance of Blind Users (2015) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“Using this analysis, it is possible to not only capture character-level errors, but also identify corrective behaviors.”
From Typing Performance of Blind Users (2015) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“We used an unconstrained text-entry protocol [27], where participants were free to correct any errors they encountered.”
From Typing Performance of Blind Users (2015) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adhi Harmoko, S., M.Komp, Jacquard, J. M., Zuse, K., & Eniac (2005) · Cited by 18,035
Rayward-Smith, V. J. (1991) · Journal of the Operational Research Society · doi:10.1057/jors.1991.155 · Cited by 16,821
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 14,804
The String-to-String Correction Problem
Wagner, R. A., & Fischer, M. J. (1974) · Journal of the ACM · doi:10.1145/321796.321811 · Cited by 3,032
Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison
Sankoff, D., & Kruskal, J. B. (1983) · Medical Entomology and Zoology · Cited by 1,915
A technique for computer detection and correction of spelling errors
Damerau, F. J. (1964) · Communications of the ACM · doi:10.1145/363958.363994 · Cited by 1,575
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825 · cited 3×
“In these experiments, subjects are told to transcribe presented phrases as quickly and accurately as possible [MacKenzie and Soukoreff 2003] while data is logged for later analysis.”
MethodUser interface evaluation in the real world: a comparison of four techniques
Jeffries, R., Miller, J. R., Wharton, C., & Uyeda, K. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108862 · Cited by 619
Text Entry for Mobile Computing: Models and Methods, Theory and Practice
MacKenzie, I. S., & Soukoreff, R. W. (2002) · Human-Computer Interaction · doi:10.1207/s15327051hci172&3_2 · Cited by 571
The design and evaluation of a high-performance soft keyboard
MacKenzie, I. S., & Zhang, S. X. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.302983 · Cited by 422
Research works printed but not linked: 2
- Evreinova , T. , Evreinov , G. , and Raisamo , R . 2004. Four-Key text entry for physically challenged people . Adjunct Proceedings of the 8th ERCIM Workshop on User Interfaces for All (UI4ALL'04) . Vienna, Austria (June 28--29). Evreinova, T., Evreinov, G., and Raisamo, R. 2004. Four-Key text entry for physically challenged people. Adjunct Proceedings of the 8th ERCIM Workshop on User Interfaces for All (UI4ALL'04). Vienna, Austria (June 28--29).
- Rodriguez , N. J. , Borges , J. A. , and Acosta , N . 2005. A study of text and numeric input modalities on PDAs . In Proceedings of the 11th International Conference on Human-Computer Interaction (HCI Int'l). Las Vegas, NV (July 22--27) . Rodriguez, N. J., Borges, J. A., and Acosta, N. 2005. A study of text and numeric input modalities on PDAs. In Proceedings of the 11th International Conference on Human-Computer Interaction (HCI Int'l). Las Vegas, NV (July 22--27).
Cited by
Ability-Based Design: Concept, Principles and Examples
Wobbrock, J. O., Kane, S. K., Gajos, K. Z., Harada, S., & Froehlich, J. (2011) · ACM Transactions on Accessible Computing · doi:10.1145/1952383.1952384 · Cited by 567
“The same is true for understanding text entry without the benefits of a laboratory study where phrases are presented to participants for transcription; prior work has made some progress here [Wobbrock and Myers 2006c].”
InfluentialSelf-citationObservations on Typing from 136 Million Keystrokes
Dhakal, V., Feit, A. M., Kristensson, P. O., & Oulasvirta, A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174220 · Cited by 226
“We used Wobbrock’s TextTest software [40] to make a detailed analysis of the corrected and uncorrected errors.”
MethodResultTouch behavior with different postures on soft smartphone keyboards
Azenkot, S., & Zhai, S. (2012) · Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services · doi:10.1145/2371574.2371612 · Cited by 214
“Users were asked to input short and shortened phrases that were randomly selected from the phrase set designed by MacKenzie and Soukoreff (M&S) [17,24].”
MethodGoel, M., Findlater, L., & Wobbrock, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208662 · Cited by 203
“To calculate WPM and uncorrected error rate, we used StreamAnalyzer [41].”
MethodSelf-citationComparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones
Ruan, S., Wobbrock, J. O., Liou, K., Ng, A., & Landay, J. A. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161187 · Cited by 187
“Since we want to analyze not only the transcribed string but also what happens during the user’s input, we need to define the input stream and classify characters in an input stream [34].”
BackgroundSelf-citation
Metadata
- Authors
- Wobbrock, J. O., & Myers, B. A.
- Affiliations
- University of Washington (US)
- Carnegie Mellon University (US)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2006-12
- Volume
- 13
- Issue
- 4
- Pages
- 458-489
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W2133119840
- Cited by
- 200
- References
- 38
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 50 · 2023: 3 · 2022: 7 · 2021: 8 · 2020: 7 · 2019: 11 · 2018: 7 · 2017: 10 · 2016: 7 · 2015: 8 · 2014: 12 · 2013: 13 · 2012: 12
- FWCI
- 12.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- error rate measurement, error correction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analyzing the input stream for character- level errors in unconstrained text entry evaluations. https://app.cochat.ai/papers/10.1145/1188816.1188819
- The paper
- Wobbrock, J. O., & Myers, B. A. (2006). Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/1188816.1188819
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.