The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers
Open accessThe DOI matches its Crossref record; 80 of the 81 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
We present an in-depth analysis of the impact of multi-word suggestion choices from a neural language model on user behaviour regarding input and text composition in email writing. Our study for the first time compares different numbers of parallel suggestions, and use by native and non-native English writers, to explore a trade-off of “efficiency vs ideation”, emerging from recent literature. We built a text editor prototype with a neural language model (GPT-2), refined in a prestudy with 30 people. In an online study (N=156), people composed emails in four conditions (0/1/3/6 parallel suggestions). Our results reveal (1) benefits for ideation, and costs for efficiency, when suggesting multiple phrases; (2) that non-native speakers benefit more from more suggestions; and (3) further insights into behaviour patterns. We discuss implications for research, the design of interactive suggestion systems, and the vision of supporting writers with AI instead of replacing them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Writing with suggestions correlates with shorter and more predictable texts being written [4], along with increased use of standard phrases when writing with a language model [17, 27].”
From Co-Writing with Opinionated Language Models Affects Users’ Views (2023) · cites this paper as [27]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Minimal AI assistance, such as simple word suggestions or basic grammatical corrections, may not offer substantial benefits to writers.This is particularly true for experienced writers who may already possess a rich vocabulary and a strong grasp of syntax.”
From Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models (2024) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Planning and translating support are intermingled due to the frequent use of longer AI outputs that directly ideate and write for the user, though these are generally presented as suggestions in order to preserve the user's engagement with the text [15,65].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, most previous work considered restricted interaction settings (e.g.strict turn-taking [15]) and adapted LMs and interfaces (e.g.fnd-tuned GPT-2 [58]) on specifc tasks (e.g.email writing [8]), thereby making it hard to generalize to other tasks and confgurations of the same model.”
From CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities (2022) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Although this approach may provide less rich insights than interviews, it can cover relatively diverse contexts across tasks and writers, while allowing for a fne-grained analysis of interactions.”
From CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities (2022) · cites this paper as [8]
10 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 2×
“[12]) have improved many benchmarks, including language models for understanding and generating text [12, 21].”
BackgroundlmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 10×
“Columns list the involved HMM states (cf. Figure 3), describe the behaviour, and outline how this interpretation was derived from the state parameters. the rest for evaluation (11 states scored best, considering log-likelihood and BIC [15]).”
BackgroundInfluentialKaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.03771 · Cited by 3,347
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681
A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition
RABINER, L. R. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50027-9 · Cited by 1,869
Bayesian Reasoning and Machine Learning
Barber, D. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804779 · Cited by 1,631
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591 · cited 1×
“In NLP, new Deep Learning architectures [65], pre-training [53], and growing datasets, models, and computing power (e.”
BackgroundStimulus information as a determinant of reaction time.
Hyman, R. (1953) · Journal of Experimental Psychology · doi:10.1037/h0056940 · Cited by 1,443 · cited 1×
“This is logarithmic according to the Hick-Hyman law [34, 42].”
MethodMaggini, M., Bassi, D., & Gamallo, P. (2026) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.18653/v1 · Cited by 1,264
The Enron Corpus: A New Dataset for Email Classification Research
Klimt, B., & Yang, Y. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_22 · Cited by 1,157
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · cited 1×
“Quality, beyond the technical [11], also involves undesirable or biased suggestions (e.”
BackgroundA cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025
Keystroke Logging in Writing Research: Using Inputlog to Analyze and Visualize Writing Processes
Leijten, M., & Van Waes, L. (2013) · Written Communication · doi:10.1177/0741088313491692 · Cited by 513
Mapping the Landscape of Creativity Support Tools in HCI
Frich, J., MacDonald Vermeulen, L., Remy, C., Biskjaer, M. M., & Dalsgaard, P. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300619 · Cited by 410 · cited 1×
“Further (HCI) work on interactive text generation looked into artistic use, with roles akin to creativity-support [26], such as for poetry [29], metaphors [28], slogans [17], and stories [61].”
BackgroundDigital support for academic writing: A review of technologies and pedagogies
Strobl, C., Ailhaud, E., Benetos, K., Devitt, A., Kruse, O., Proske, A., & Rapp, C. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.12.005 · Cited by 298 · cited 6×
“We relate our work to research from NLP and HCI.”
BackgroundInfluentialRelease Strategies and the Social Impacts of Language Models
Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., Krueger, G., Kim, J. W., Kreps, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1908.09203 · Cited by 292 · cited 1×
“Supporting this, a report on the social impact of recent language models tied beneficial use also to future improvements in user interfaces [59].”
BackgroundCreative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172983 · Cited by 257 · cited 1×
“Further (HCI) work on interactive text generation looked into artistic use, with roles akin to creativity-support [26], such as for poetry [29], metaphors [28], slogans [17], and stories [61].”
BackgroundCOGNITIVE MODELS OF WRITING: WRITING PROFICIENCY AS A COMPLEX INTEGRATED SKILL
Deane, P., Odendahl, N., Quinlan, T., Fowles, M. E., Welsh, C., & Bivens‐Tatum, J. (2008) · ETS Research Report Series · doi:10.1002/j.2333-8504.2008.tb02141.x · Cited by 247
Goel, M., Findlater, L., & Wobbrock, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208662 · Cited by 203
How do People Type on Mobile Devices?: Observations from a Study with 37,000 Volunteers
Palin, K., Feit, A. M., Kim, S., Kristensson, P. O., & Oulasvirta, A. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340120 · Cited by 190
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G., Lukacs, L., Ganea, M., Young, P., et al. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939801 · Cited by 183
Small latin squares, quasigroups, and loops
McKay, B. D., Meynert, A. M., & Myrvold, W. J. (2006) · Journal of Combinatorial Designs · doi:10.1002/jcd.20105 · Cited by 182
Gmail Smart Compose: Real-Time Assisted Writing
Chen, M. X., Lee, B. N., Bansal, G., Cao, Y., Zhang, S., Lu, J., Tsay, J., Wang, Y., Dai, A. M., Chen, Z., et al. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330723 · Cited by 169 · cited 6×
“Text prediction in HCI often aims to improve typing speed and reduce errors [40] or keystrokes [16].”
BackgroundMethodInfluentialSelecting hidden Markov model state number with cross-validated likelihood
Celeux, G., & Durand, J.-B. (2008) · Computational Statistics · doi:10.1007/s00180-007-0097-1 · Cited by 165
Language modeling for soft keyboards
Goodman, J., Venolia, G., Steury, K., & Parker, C. (2002) · Proceedings of the 7th international conference on Intelligent user interfaces · doi:10.1145/502716.502753 · Cited by 161
How Program History Can Improve Code Completion
Robbes, R., & Lanza, M. (2008) · 2008 23rd IEEE/ACM International Conference on Automated Software Engineering · doi:10.1109/ase.2008.42 · Cited by 155 · cited 1×
“Interestingly, related observations also appear for code suggestions (in IDEs), which are valued not only to reduce typing yet also to learn and explore an API [51, 58].”
BackgroundSelection from alphabetic and numeric menu trees using a touch screen: breadth, depth, and width
Landauer, T. K., & Nachbar, D. W. (1985) · ACM SIGCHI Bulletin · doi:10.1145/1165385.317470 · Cited by 154
WatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding
Gordon, M., Ouyang, T., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858242 · Cited by 150 · cited 2×
“Likely motivations for this design choice include limitations in (n-gram) models, screen space and interactions [32], and cost-benefit trade-offs for efficiency (e.”
BackgroundMetaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · cited 1×
“Further (HCI) work on interactive text generation looked into artistic use, with roles akin to creativity-support [26], such as for poetry [29], metaphors [28], slogans [17], and stories [61].”
BackgroundOmar, C., Yoon, Y., LaToza, T. D., & Myers, B. A. (2012) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2012.6227133 · Cited by 140
Vertanen, K., Memmi, H., Emge, J., Reyal, S., & Kristensson, P. O. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702135 · Cited by 133
Hafez: an Interactive Poetry Generation System
Ghazvininejad, M., Shi, X., Priyadarshi, J., & Knight, K. (2017) · Proceedings of ACL 2017, System Demonstrations · doi:10.18653/v1/p17-4008 · Cited by 128
Effects of Language Modeling and its Personalization on Touchscreen Typing Performance
Fowler, A., Partridge, K., Chelba, C., Bi, X., Ouyang, T., & Zhai, S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702503 · Cited by 127 · cited 1×
“Even simulation experiments for smartphone keyboards fxed the number to three [25].”
BackgroundDunlop, M., & Levine, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208659 · Cited by 99
A Cost-Benefit Study of Text Entry Suggestion Interaction
Quinn, P., & Zhai, S. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858305 · Cited by 98
User Interaction with Word Prediction: The Effects of Prediction Quality
Trnka, K., McCaw, J., Yarrington, D., McCoy, K. F., & Pennington, C. (2009) · ACM Transactions on Accessible Computing · doi:10.1145/1497302.1497307 · Cited by 93
R Package multgee: A Generalized Estimating Equations Solver for Multinomial Responses
Touloumis, A. (2015) · Journal of Statistical Software · doi:10.18637/jss.v064.i08 · Cited by 90
Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Yang, Q., Cranshaw, J., Amershi, S., Iqbal, S. T., & Teevan, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300415 · Cited by 90
Predictive text encourages predictable writing
Arnold, K. C., Chauncey, K., & Gajos, K. Z. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377523 · Cited by 87
Observing Writing: Insights from Keystroke Logging and Handwriting
Tiryakioglu, G., Peters, E., & Verschaffel, L. (2019) · BRILL eBooks · doi:10.1163/9789004392526 · Cited by 87
Zhang, M. R., Wen, H., & Wobbrock, J. O. (2019) · Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3332165.3347924 · Cited by 86
Controllable Neural Story Plot Generation via Reward Shaping
Tambwekar, P., Dhuliawala, M., Martin, L. J., Mehta, A., Harrison, B., & Riedl, M. O. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/829 · Cited by 81
On Suggesting Phrases vs. Predicting Words for Mobile Text Composition
Arnold, K. C., Gajos, K. Z., & Kalai, A. T. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984584 · Cited by 69 · cited 7×
“[5], for example, suggests that there is more to text predictions than efficiency: People interpreted multi-word phrases as suggestions for content and expression, while single words were seen as predictions of typing.”
BackgroundInfluentialModel of visual search and selection time in linear menus
Bailly, G., Oulasvirta, A., Brumby, D. P., & Howes, A. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557093 · Cited by 68
Omar, C., Yoon, Y., LaToza, T. D., & Myers, B. A. (2012) · doi:10.5555/2337223.2337324 · Cited by 68
Complementing Text Entry Evaluations with a Composition Task
Vertanen, K., & Kristensson, P. O. (2014) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2555691 · Cited by 62
Both complete and correct?: multi-objective optimization of touchscreen keyboard
Bi, X., Ouyang, T., & Zhai, S. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557414 · Cited by 59
Selection from alphabetic and numeric menu trees using a touch screen: breadth, depth, and width
Landauer, T. K., & Nachbar, D. W. (1985) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '85) · doi:10.1145/317456.317470 · Cited by 59
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference
Gehrmann, S., Strobelt, H., Kruger, R., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2019.2934595 · Cited by 58
Making touchscreen keyboards adaptive to keys, hand postures, and individuals
Yin, Y., Ouyang, T. Y., Partridge, K., & Zhai, S. (2013) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481384 · Cited by 56
12 Production media: Writing as using tools in media convergent environments
Mahlow, C., & Dale, R. (2014) · De Gruyter eBooks · doi:10.1515/9783110220674.209 · Cited by 46
Analysing Keystroke Logging Data from a Linguistic Perspective
Leijten, M., Horenbeeck, E. V., & Waes, L. V. (2019) · BRILL eBooks · doi:10.1163/9789004392526_005 · Cited by 46
The inviscid text entry rate and its application as a grand goal for mobile text entry
Kristensson, P. O., & Vertanen, K. (2014) · Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services · doi:10.1145/2628363.2628405 · Cited by 39
The Limits of Expert Text Entry Speed on Mobile Keyboards with Autocorrect
Banovic, N., Sethapakdi, T., Hari, Y., Dey, A. K., & Mankoff, J. (2019) · Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services · doi:10.1145/3338286.3340126 · Cited by 34
Sentiment Bias in Predictive Text Recommendations Results in Biased Writing
Arnold, K., Chauncey, K., & Gajos, K. (2018) · Canadian Human-Computer Communications Society / Société canadienne du dialogue humain-machine · doi:10.20380/gi2018.07 · Cited by 31
Conversations with Documents. An Exploration of Document-Centered Assistance
ter Hoeve, M., Sim, R., Nouri, E., Fourney, A., de Rijke, M., & White, R. W. (2020) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.2002.00747 · Cited by 26
A glimpse of mobile text entry errors and corrective behaviour in the wild
Komninos, A., Dunlop, M. D., Katsaris, K., & Garofalakis, J. D. (2018) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/3236112.3236143 · Cited by 25
Conversations with Documents: An Exploration of Document-Centered Assistance
ter Hoeve, M., Sim, R., Nouri, E., Fourney, A., de Rijke, M., & White, R. W. (2020) · Proceedings of the 2020 Conference on Human Information Interaction and Retrieval · doi:10.1145/3343413.3377971 · Cited by 25
CUI@CHI: Mapping Grand Challenges for the Conversational User Interface Community
Candello, H. C. D. S. P., Munteanu, C., Clark, L., Sin, J., Torres, M. I., Porcheron, M., Myers, C. M., Cowan, B. R., Fischer, J. E., Schlögl, S., et al. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3375152 · Cited by 25
Controllable Neural Story Generation via Reinforcement Learning.Preprint
Tambwekar, P., Dhuliawala, M., Mehta, A., Martin, L. J., Harrison, B. E., & Riedl, M. O. (2018) · arXiv (Cornell University) · Cited by 24
Diversifying Reply Suggestions Using a Matching-Conditional Variational Autoencoder
Deb, B., Bailey, P., & Shokouhi, M. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-2006 · Cited by 24
The Design Space of Nonvisual Word Completion
Nicolau, H., Rodrigues, A., Santos, A., Guerreiro, T., Montague, K., & Guerreiro, J. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353786 · Cited by 21
Investigating the Necessity of Delay in Marking Menu Invocation
Henderson, J., Malacria, S., Nancel, M., & Lank, E. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376296 · Cited by 19
Bringing text input beyond the desktop
James, C., & Longé, M. (2000) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/633292.633324 · Cited by 14
Grand challenges in text entry
Kristensson, P. O., Brewster, S. A., Clawson, J., Dunlop, M. D., Findlater, L., Isokoski, P., Martin, B., Oulasvirta, A., Vertanen, K. D., & Waller, A. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2479675 · Cited by 13
Learning New Words and Spelling with Autocorrections
Arif, A. S., Sylla, C., & Mazalek, A. (2016) · ACM International Conference on Interactive Surfaces and Spaces (ISS) · doi:10.1145/2992154.2996790 · Cited by 13
Diversifying Reply Suggestions using a Matching-Conditional Variational AutoencoderPreprint
Deb, B., Bailey, P., & Shokouhi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10630 · Cited by 13
Swap: A Replacement-based Text Revision Technique for Mobile Devices
Li, Y., Sarcar, S., Kim, S., & Ren, X. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376217 · Cited by 11
Inviscid Text Entry and Beyond
Vertanen, K. D., Dunlop, M. D., Clawson, J., Kristensson, P. O., & Arif, A. S. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2856472 · Cited by 8
Clawson, J., Arif, A. S., Brewster, S. A., Dunlop, M. D., Kristensson, P. O., & Oulasvirta, A. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2702660 · Cited by 7
Vertanen, K., Montague, K., Dunlop, M. D., Arif, A. S., Bi, X., & Azenkot, S. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3027066 · Cited by 7
Counterfactual Language Model Adaptation for Suggesting PhrasesPreprint
Arnold, K. C., Chang, K.-W., & Kalai, A. T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.01799 · Cited by 7
Fleming, M. (2019) · eScholarship (California Digital Library) · Cited by 1
Research works printed but not linked: 4
- N. Carr. 2015. The Glass Cage: Where Automation is Taking Us. Random House, London, UK.
- 10.18653/v1 · doi:10.18653/v1
- 10.5555/108235.108253 · doi:10.5555/108235.108253
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.
Cited by
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Sharma, A., Lin, I. W., Miner, A. S., Atkins, D. C., & Althoff, T. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00593-2 · Cited by 500
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345
“email writing [8]), thereby making it hard to generalize to other tasks and confgurations of the same model.”
BackgroundInfluentialAI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713564 · Cited by 306
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2023) · arXiv · doi:10.48550/arxiv.2303.03283 · Cited by 284
Self-citation
Metadata
- Authors
- Buschek, D., Zürn, M., & Eiband, M.
- Affiliations
- University of Bayreuth (DE)
- Ludwig-Maximilians-Universität München (DE)
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-13
- OpenAlex
- W3123978464
- Cited by
- 108
- References
- 78
- Citations by year
- 2026: 13 · 2025: 28 · 2024: 26 · 2023: 21 · 2022: 14 · 2021: 6
- FWCI
- 12.52
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- ERef Bayreuth (University of Bayreuth) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Bavarian State Ministry of Science and the Arts
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- email writing, neural language models, GPT-2, idea generation, writing efficiency, native vs non-native writers, non-native English speakers, AI-assisted writing, suggestion systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.