Cited by 143Usability and User Interface DesignInnovative Human-Technology InteractionAssistive Technology in Communication and Mobility

A Design Space for Intelligent and Interactive Writing Assistants

Open access
Lee, Mina, Gero, Katy Ilonka, Chung, John Joon Young, Shum, Simon Buckingham, Raheja, Vipul, Shen, Hua, Venugopalan, Subhashini, Wambsganss, Thiemo +28 more·2024·Proceedings of the CHI Conference on Human Factors in Computing Systems

Abstract

In our era of rapid technological advancement, the research landscape for writing assistants has become increasingly fragmented across various research communities. We seek to address this challenge by proposing a design space as a structured way to examine and explore the multidimensional space of intelligent and interactive writing assistants. Through community collaboration, we explore five aspects of writing assistants: task, user, technology, interaction, and ecosystem. Within each aspect, we define dimensions and codes by systematically reviewing 115 papers, while leveraging the expertise of researchers in various disciplines. Our design space aims to offer researchers and designers a practical tool to navigate, comprehend, and compare the various possibilities of writing assistants, and aid in the design of new writing assistants.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3613904.3642697

Cites

237 of 239 references verified0 citation errors · 1 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • We identified three interface metaphor archetypes that were the most prevalent in commercial AI creative co-writing systems: tool-like, agentic, and magic.

    “Based on this review and prior literature [35], we identified three interface metaphor archetypes that were the most prevalent: tool-like, agentic, and magic.”

    From Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems (2026) · cites this paper as [35]

    The “UI -Interaction Metaphor” section identifies agent and tool metaphors, but its third primary metaphor is hybrid, not magic. The passage also does not establish that the three claimed archetypes are the most prevalent in commercial systems. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Lee et al. identified a direct correlation between self-reported ownership and the proportion of user-written versus AI-generated text.

    “Lee et al. [74] identified a direct correlation between self-reported ownership and the proportion of user-written versus AI-generated text.”

    From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [74]

    The “Relationship to System” passage (page unavailable) says a writer’s sense of ownership may diminish as the proportion of system-generated text increases. That supports the direction of the association, but the paper presents it as a qualified observation from cited work, not a direct correlation it identified between self-reported ownership and the proportions of user- and AI-written text. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • In the Creative context, support for planning takes the form of generative ideation, usually presented as suggestions, although some systems have a more equal and collaborative storytelling focus that weaves the AI ideas into the story text.

    “Support for planning takes the form of generative ideation, usually presented as suggestions [74,135], although some systems have a more equal and collaborative storytelling focus that weaves the AI ideas into the story text [70,92].”

    From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [74]

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • Agency and ownership are key factors in how writers experience AI co-writing.

    “Previous work has identified agency and ownership as key factors in how writers experience AI co-writing [35]”
  • Lee et al. described three interaction metaphors for AI co-writing systems: Agent, Tool, and hybrid.

    “Based on a review of prior literature, Lee et al. described three interaction metaphors for AI co-writing systems.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. arXiv preprint arXiv:2005.14165 (2020). · arXiv
  2. Daniel Buschek, Martin Zürn, and Malin Eiband. 2021. The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers. In Conference on Human Factors in Computing Systems (CHI).
  3. Tuhin Chakrabarty, Vishakh Padmakumar, and He He. 2022. Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing. In Empirical Methods in Natural Language Processing (EMNLP).
  4. Elizabeth Clark and Noah A. Smith. 2021. Choose Your Own Adventure: Paired Suggestions in Collaborative Writing for Evaluating Story Generation Models. In Association for Computational Linguistics (ACL).
  5. Michael Gamon. 2010. Using Mostly Native Data to Correct Errors in Learn- ers' Writing. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Los Angeles, California, 163-171. https://aclanthology.org/N10-1019
  6. Tobias Moritz Guggenberger, Frederik Möller, Tim Haarhaus, Inan Gür, and Boris Otto. 2020. Ecosystem Types in Information Systems. In Twenty-Eighth European Conference on Information Systems (ECIS2020). https://aisel.aisnet.org/ ecis2020_rp/45
  7. Harry Halpin, Johanna D. Moore, and Judy Robertson. 2004. Automatic Analysis of Plot for Story Rewriting. In Proceedings of the 2004 Conference on Empiri- cal Methods in Natural Language Processing. Association for Computational Linguistics, Barcelona, Spain, 127-133. https://aclanthology.org/W04-3217
  8. J.R. Hayes. 1996. A new framework for understanding cognition and affect in writing. In The Science of Writing: Theories, Methods, Individual Differences, and Applications, C.M. Levy and S. Randall (Eds.). Lawrence Erlbaum Associates, Mahwah, NJ, 6-44.
  9. Geoffrey Hinton, Oriol Vinyals, and Jeffrey Dean. 2015. Distilling the Knowl- edge in a Neural Network. In NIPS Deep Learning and Representation Learning Workshop.
  10. Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations (ICLR).
  11. Chung-chi Huang, Ping-che Yang, Keh-jiann Chen, and Jason S. Chang. 2012. TransAhead: A Computer-Assisted Translation and Writing Tool. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Com- putational Linguistics: Human Language Technologies. Association for Computa- tional Linguistics, Montréal, Canada, 352-356. https://aclanthology.org/N12- 1036
  12. Chung-chi Huang, Ping-che Yang, Mei-hua Chen, Hung-ting Hsieh, Ting-hui Kao, and Jason S. Chang. 2012. TransAhead: A Writing Assistant for CAT and CALL. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Avignon, France, 16-19. https://aclanthology. org/E12-2004
  13. Justin Hutchens. 2023. The Language of Deception: Weaponizing Next Generation AI. John Wiley & Sons.
  14. Juho Kim. 2022. Interaction-Centric AI (NeurIPS 2022 Keynote). https:// slideslive.com/38996064/interactioncentric-ai Accessed: Jan 26, 2024.
  15. Tomi Kinnunen, Henri Leisma, Monika Machunik, Tuomo Kakkonen, and Jean- Luc LeBrun. 2012. SWAN -Scientific Writing AssistaNt. A Tool for Helping Scholars to Write Reader-Friendly Manuscripts. In Proceedings of the Demon- strations at the 13th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Avignon, France, 20-24. https://aclanthology.org/E12-2005
  16. Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michi- hiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Alexan- der Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew Arad Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue WANG, Keshav Santhanam, Laurel Orr, Lu- cia Zheng, Mert Yuksekgonul, Mirac Suzgun, Nathan Kim, Neel Guha, Ni- ladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan An- drew Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, and Yuta Koreeda. 2023. Holistic Evalu- ation of Language Models. Transactions on Machine Learning Research (2023). https://openreview.net/forum?id=iO4LZibEqW Featured Certification, Expert Certification.
  17. Allan MacLean, Richard Young, Victoria Bellotti, and Thomas Moran. 1991. Questions, Options, and Criteria: Elements of Design Space Analysis. Human- Computer Interaction 6 (09 1991), 201-250. https://doi.org/10.1080/07370024. 1991.9667168 · DOI
  18. Vishakh Padmakumar and He He. 2024. Does Writing with Language Models Reduce Content Diversity?. In The Twelfth International Conference on Learning Representations. https://openreview.net/forum?id=Feiz5HtCD0
  19. Denise Schmandt-Besserat. 1992. Before writing, vol. I: from counting to cuneiform. Vol. 1. University of Texas press.
  20. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems (NeurIPS). 3104-3112.
  21. Rohan Taori and Tatsunori Hashimoto. 2023. Data feedback loops: Model-driven amplification of dataset biases. In International Conference on Machine Learning. PMLR, 33883-33920.
  22. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. LLaMA: Open and Efficient Foundation Language Models. arXiv (2023).
  23. Eric L Trist. 1981. The evolution of socio-technical systems. Vol. 2. Ontario Quality of Working Life Centre Toronto.
  24. Florian Weber, Thiemo Wambsganss, Dominic Rüttimann, and Matthias Söllner. 2021. Pedagogical agents for interactive learning: A taxonomy of conversational agents in education. In Forty-Second International Conference on Information Systems. Austin, Texas.
  25. Chin yew Lin and Marina Rey. 2004. Looking for a Few Good Metrics: ROUGE and its Evaluation. In NTCIR Workshop.

Cited by

Sorted by citations

Authors
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., August, T., Bhat, A., Choksi, M. Z., Dutta, S., Guo, J. L. C., Hoque, M. N., Kim, Y., Knight, S., Neshaei, S. P., Shibani, A., Shrivastava, D., Shroff, L., Sergeyuk, A., Stark, J., Sterman, S., Wang, S., Bosselut, A., Buschek, D., Chang, J. C., Chen, S., Kreminski, M., Park, J., Pea, R., Rho, E. H. R., Shen, Z., & Siangliulue, P.
Affiliations
  • Microsoft (United States) (US)
  • Harvard University (US)
  • Midjourney, United States
  • University of Technology Sydney (AU)
  • Grammarly, United States
  • University of Michigan (US)
  • Google (United States) (US)
  • Bern University of Applied Sciences (CH)
  • University of Illinois Urbana-Champaign (US)
  • King Abdulaziz University (SA)
  • University of Washington (US)
  • McGill University (CA)
  • Cornell Tech (US)
  • University of Tennessee at Knoxville (US)
  • University of Maryland, College Park (US)
  • Korea Advanced Institute of Science and Technology (KR)
  • École Polytechnique Fédérale de Lausanne (CH)
  • Google DeepMind (United Kingdom) (GB)
  • Stanford University (US)
  • JetBrains Research, Serbia and Montenegro
  • University of Toronto (CA)
  • Columbia University (US)
  • University of Bayreuth (DE)
  • Allen Institute for Artificial Intelligence (US)
  • Department of Computer Science, University of Richmond, United States
  • Virginia Tech (US)
  • MIT Computer Science and Artificial Intelligence Laboratory (US)
  • B12, United States
Venue
Proceedings of the CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2024-05-11
Pages
1-35
OpenAlex
W4393118307
Cited by
136
References
129
Citations by year
2026: 47 · 2025: 71 · 2024: 18
FWCI
43.82
Type
conference paper
Language
en
Open access
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion, other-oa)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-sa)
  • DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
  • ARBOR - Bern University of Applied Sciences Repository (submittedVersion)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
University of Technology Sydney
Topics
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
Keywords
writing assistants, design space, interactive writing, writing support systems, task dimensions, technology dimension

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review