CoChat

Analyzing the input stream for character- level errors in unconstrained text entry evaluations

Wobbrock, Jacob O., Myers, Brad A. · 2006 · ACM Transactions on Computer-Human Interaction

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Abstract

Recent improvements in text entry error rate measurement have enabled the running of text entry experiments in which subjects are free to correct errors (or not) as they transcribe a presented string. In these “unconstrained” experiments, it is no longer necessary to force subjects to unnaturally maintain synchronicity with presented text for the sake of performing overall error rate calculations. However, the calculation of character-level error rates, which can be trivial in artificially constrained evaluations, is far more complicated in unconstrained text entry evaluations because it is difficult to infer a subject's intention at every character. For this reason, prior character-level error analyses for unconstrained experiments have only compared presented and transcribed strings, not input streams. But input streams are rich sources of character-level error information, since they contain all of the text entered (and erased) by a subject. The current work presents an algorithm for the automated analysis of character-level errors in input streams for unconstrained text entry evaluations. It also presents new character-level metrics that can aid method designers in refining text entry methods. To exercise these metrics, we perform two analyses on data from an actual text entry experiment. One analysis, available from the prior work, uses only presented and transcribed strings. The other analysis uses input streams, as described in the current work. The results confirm that input stream error analysis yields richer information for the same empirical data. To facilitate the use of these new analyses, we offer pseudocode and downloadable software for performing unconstrained text entry experiments and analyzing data.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/1188816.1188819

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 38 references

Research works printed but not linked: 2

  1. Evreinova , T. , Evreinov , G. , and Raisamo , R . 2004. Four-Key text entry for physically challenged people . Adjunct Proceedings of the 8th ERCIM Workshop on User Interfaces for All (UI4ALL'04) . Vienna, Austria (June 28--29). Evreinova, T., Evreinov, G., and Raisamo, R. 2004. Four-Key text entry for physically challenged people. Adjunct Proceedings of the 8th ERCIM Workshop on User Interfaces for All (UI4ALL'04). Vienna, Austria (June 28--29).
  2. Rodriguez , N. J. , Borges , J. A. , and Acosta , N . 2005. A study of text and numeric input modalities on PDAs . In Proceedings of the 11th International Conference on Human-Computer Interaction (HCI Int'l). Las Vegas, NV (July 22--27) . Rodriguez, N. J., Borges, J. A., and Acosta, N. 2005. A study of text and numeric input modalities on PDAs. In Proceedings of the 11th International Conference on Human-Computer Interaction (HCI Int'l). Las Vegas, NV (July 22--27).

Cited by

See all 200

Metadata

Authors
Wobbrock, J. O., & Myers, B. A.
Affiliations
  • University of Washington (US)
  • Carnegie Mellon University (US)
Venue
ACM Transactions on Computer-Human Interaction
Published
2006-12
Volume
13
Issue
4
Pages
458-489
ISSN
  • 1073-0516 (ISSN-L)
  • 1557-7325
OpenAlex
W2133119840
Cited by
200
References
38
Citations by year
2026: 1 · 2025: 4 · 2024: 50 · 2023: 3 · 2022: 7 · 2021: 8 · 2020: 7 · 2019: 11 · 2018: 7 · 2017: 10 · 2016: 7 · 2015: 8 · 2014: 12 · 2013: 13 · 2012: 12
FWCI
12.82
Type
journal article
Language
en
Open access
closed
Locations
ACM Transactions on Computer-Human Interaction (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
Keywords
error rate measurement, error correction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Analyzing the input stream for character- level errors in unconstrained text entry evaluations. https://app.cochat.ai/papers/10.1145/1188816.1188819
The paper
Wobbrock, J. O., & Myers, B. A. (2006). Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Transactions on Computer-Human Interaction. https://doi.org/10.1145/1188816.1188819

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.