A Cost-Benefit Study of Text Entry Suggestion Interaction
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Mobile keyboards often present error corrections and word completions (suggestions) as candidates for anticipated user input. However, these suggestions are not cognitively free: they require users to attend, evaluate, and act upon them. To understand this trade-off between suggestion savings and interaction costs, we conducted a text transcription experiment that controlled interface assertiveness: the tendency for an interface to present itself. Suggestions were either always present (extraverted), never present (introverted), or gated by a probability threshold (ambiverted). Results showed that although increasing the assertiveness of suggestions reduced the number of keyboard actions to enter text and was subjectively preferred, the costs of attending to and using the suggestions impaired average time performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Phrase sets for evaluating text entry techniques
MacKenzie, I. S., & Soukoreff, R. W. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765971 · Cited by 825
Accuracy measures for evaluating computer pointing devices
MacKenzie, I. S., Kauppinen, T., & Silfverberg, M. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365028 · Cited by 448
Effects of Language Modeling and its Personalization on Touchscreen Typing Performance
Fowler, A., Partridge, K., Chelba, C., Bi, X., Ouyang, T., & Zhai, S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702503 · Cited by 127 · cited 3×
“Prediction and error correction systems aim to reduce the number of actions required from a user to enter their desired text [4, 7, 8, 24, 31, 32].”
BackgroundMethodSelf-citationPersonalized input: improving ten-finger touchscreen typing through automatic adaptation
Findlater, L., & Wobbrock, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208520 · Cited by 106
Dunlop, M., & Levine, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208659 · Cited by 99
User Interaction with Word Prediction: The Effects of Prediction Quality
Trnka, K., McCaw, J., Yarrington, D., McCoy, K. F., & Pennington, C. (2009) · ACM Transactions on Accessible Computing · doi:10.1145/1497302.1497307 · Cited by 93
Touch typing using thumbs: understanding the effect of mobility and hand posture
Nicolau, H., & Jorge, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208661 · Cited by 50 · cited 1×
“However, compared to their physical counterparts, the lack of strong tactile feedback limits users’ ability to touch type [2, 10, 23, 28, 32].”
Background
Research works printed but not linked: 25
- 10.1145/1753326.1753329 · DOI
- 10.1145/2371574.2371612 · DOI · Paper page
- Card Stuart K., The Psychology of Human-Computer Interaction
- 10.1007/s10209-005-0005-9 · DOI
- Hart Sandra G., 1988, Staveland
- 10.1145/2207676.2208658 · DOI · Paper page
- 10.1080/07434619012331275514 · DOI
- 10.1145/636772.636798 · DOI · Paper page
- Koester Heidi Horstmann, 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 1303--1304
- 10.1109/86.331567 · DOI
- 10.1080/07434619612331277608 · DOI
- 10.1145/2166966.2166972 · DOI · Paper page
- 10.1145/1753326.1753657 · DOI
- 10.1207/S15327051HCI172&3_2 · DOI · Paper page
- I. Scott MacKenzie and Kumiko Tanaka-Ishii (Eds.). 2007. Text Entry Systems: Mobility Accessibility Universality. Morgan Kaufmann San Francisco CA. I. Scott MacKenzie and Kumiko Tanaka-Ishii (Eds.). 2007. Text Entry Systems: Mobility Accessibility Universality. Morgan Kaufmann San Francisco CA.
- 10.1145/274644.274690 · DOI · Paper page
- 10.1145/2470654.2481383 · DOI · Paper page
- 10.1145/2858036.2858074 · DOI
- 10.1016/j.ijhcs.2012.12.001 · DOI · Paper page
- 10.1145/1978942.1979067 · DOI
- 10.1016/0953-5438(91)90016-U · DOI · Paper page
- 10.1080/01449290110049790 · DOI · Paper page
- 10.1080/01449299508914656 · DOI · Paper page
- 10.1145/2556288.2557412 · DOI · Paper page
- 10.1207/S15327051HCI172&3_4 · DOI · Paper page
Cited by
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2023) · arXiv · doi:10.48550/arxiv.2303.03283 · Cited by 284
Co-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3637875 · Cited by 186
“…such systems now explore designs beyond integration at the user’s cursor in the text box or a “suggestion bar” above the key-board (cf. [3, 10, 15, 85]): For example, generated inspirational content is controlled and presented via sidebars [111], visual story arcs [21], manipulable metaphors…”
BackgroundA Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
“Another ethical consideration is accommodating the needs and preferences of diverse users, including those from differently-abled, under-represented, and marginalized communities [1, 14, 103].”
Social Dynamics of AI Support in Creative Writing
Gero, K. I., Long, T., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580782 · Cited by 129
“They may be used to reduce the effort of texting [32], aid in nuanced word choice [14], improve emotional writing [29], or help in professional contexts [18].”
BackgroundWhere to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119
Buschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108
Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models
Dhillon, P. S., Molaei, S., Li, J., Golub, M., Zheng, S., & Robert, L. P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642134 · Cited by 111
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2024) · arXiv · doi:10.48550/arxiv.2409.11360 · Cited by 99
Predictive text encourages predictable writing
Arnold, K. C., Chauncey, K., & Gajos, K. Z. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377523 · Cited by 87
Dang, H., Goller, S., Lehmann, F., & Buschek, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580969 · Cited by 83
“Traditionally, systemsmainly use diegetic information, that is, they predict text based (only) on the preceding text [11, 12, 18, 34].”
BackgroundThe Value, Benefits, and Concerns of Generative AI-Powered Assistance in Writing
Li, Z., Liang, C., Peng, J., & Yin, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642625 · Cited by 81
“Before the rise of LLMs, writing assistants primarily focus on enhancing human writing by offering features such as word-level suggestions [2, 17, 18, 37], sentence-level suggestions [11, 28], and novel text entry methods to optimize both speed and accuracy [4, 42].”
On Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69
“While the suggestion bar plays a central role in commercial products used daily by billions of people, it has received limited attention from academic research [5, 28].”
BackgroundResultInfluentialThe effects of interaction sequencing on user experience and preference
Cockburn, A., Quinn, P., & Gutwin, C. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.07.005 · Cited by 51
“For example, if text-entry autocorrect were used, it would be difficult to control the timing and presence of user errors, potentially requiring artificial constraints on error-free performance that may influence the results ( Quinn and Zhai, 2016 ).”
BackgroundMethodSelf-citation“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions
Robertson, R. E., Olteanu, A., Diaz, F., Shokouhi, M., & Bailey, P. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445557 · Cited by 43
Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
Fu, L., Newman, B., Jakesch, M., & Kreps, S. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581351 · Cited by 31
Lehmann, F., Markert, N., Dang, H., & Buschek, D. (2022) · Mensch und Computer 2022 · doi:10.1145/3543758.3543947 · Cited by 25
Examining Agency, Expertise, and Roles of AI Systems in AI-Mediated Communication
Mieczkowski, H., & Hancock, J. (2022) · doi:10.31219/osf.io/asnv4 · Cited by 16
Metadata
- Authors
- Quinn, P., & Zhai, S.
- Venue
- Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2016-05-07
- Pages
- 83-88
- OpenAlex
- W2401452835
- Cited by
- 98
- References
- 8
- FWCI
- 4.79
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.