Where to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Open accessThe DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Abstract
While developing a story, novices and published writers alike have had to look outside themselves for inspiration. Language models have recently been able to generate text fluently, producing new stochastic narratives upon request. However, effectively integrating such capabilities with human cognitive faculties and creative processes remains challenging. We propose to investigate this integration with a multimodal writing support interface that offers writing suggestions textually, visually, and aurally. We conduct an extensive study that combines elicitation of prior expectations before writing, observation and semi-structured interviews during writing, and outcome evaluations after writing. Our results illustrate the individual and situational variation in machine-in-the-loop writing approaches, suggestion acceptance, and ways the system is helpful. Centrally, we report how participants perform integrative leaps , by which they do cognitive work to integrate suggestions of varying semantic relevance into their developing stories. We interpret these findings, offering modeling and design recommendations for future creative writing support technologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Translating support provides preliminary drafts or helps the user to restructure their ideas in a different form (e.g., point form to prose), but encourages the user to write and integrate ideas on their own [21,122,124].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [122]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Reviewing support is delivered in qualitative form, such as suggestions or summaries [7,114,122].”
From Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process (2025) · cites this paper as [122]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Lenses can also be assembled together to view the same generation outputs through multiple representations [64,82].”
From Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models (2023) · cites this paper as [82]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
The Interpretation of Cultures
Fenn, R., & Geertz, C. (1974) · Journal for the Scientific Study of Religion · doi:10.2307/1384392 · Cited by 19,154 · cited 2×
“writing and to observe immediate reaction and, to the extent possible, raw and unmediated answers, allowed us to produce "thick description" [43], as noted earlier.”
BackgroundMethodDevelopment of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 1×
“"In which editor was the text that you wrote more creative?") and four items on cognitive load adapted from the NASA TLX survey [47] (e.”
MethodBaddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007) · Journal of Speech, Language, and Hearing Research · doi:10.1044/1092-4388(2007/067 · Cited by 1,991
Language Models as Knowledge Bases?
Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y., & Miller, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1250 · Cited by 1,834 · cited 1×
“In parallel, models with implicitly richer knowledge bases [74] may also extend more diverse suggestions to users, inding interesting relations with aspects of their writing, and assisting them in performing contextually appropriate and creatively fulilling integrations.”
BackgroundSome observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549
Creative Cognition: Theory, Research, and Applications
Finke, R. A., Ward, T. B., & Smith, S. M. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/7722.001.0001 · Cited by 1,433 · cited 1×
“More recent psychological approaches to studying creative writing have emphasized the role of retrieval, conceptual combination, and analogical mapping as some of the fundamental cognitive processes that explain creative cognition [35, 48, 95].”
BackgroundPaivio, A. (1990) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195066661.001.0001 · Cited by 1,149
Research works printed but not linked: 21
- Kenneth Arnold Kai-Wei Chang and Adam Kalai. 2017. Counterfactual Language Model Adaptation for Suggesting Phrases. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers) . 49–54.
- Eden Bensaid. 2021. Multimodal generative models for storytelling. Master’s Thesis. Massachusetts Institute of Technology.
- Eden Bensaid Mauro Martino Benjamin Hoover Jacob Andreas and Hendrik Strobelt. 2021. FairyTailor: A multimodal generative framework for storytelling. arXiv:2108.04324. Retrieved from https://arxiv.org/abs/2108.04324. · arXiv
- Lukas Bieringer Kathrin Grosse Michael Backes and Katharina Krombholz. 2021. Mental Models of Adversarial Machine Learning. In ICCV 2021 Workshop on Adversarial Robustness in the Real World .
- Margaret A. Boden. 2004. The creative mind: Myths and mechanisms. Routledge.
- Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger T. J. Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeff Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language models are few-shot learners. Advances in Neural Information Processing Systems 33 (2020) 1877–1901.
- Alex Calderwood, Vivian Qiu, Katy Ilonka Gero, and Lydia B. Chilton. 2020. How novelists use generative language models: An exploratory user study. In Proceedings of the HAI-GEN+ user2agent@ IUI.
- Orson Scott Card. 1990. How to Write Science Fiction and Fantasy. Writer’s digest books Cincinnati, OH.
- Michelene T. H. Chi. 2000. Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. Advances in Instructional Psychology 5 (2000), 161–238.
- Stephen R. Donaldson. 2008. The Gap Into Conflict: The Real Story. CNIB.
- Angela Fan Mike Lewis and Yann Dauphin. 2018. Hierarchical Neural Story Generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 889–898.
- 10.2307/356600 · doi:10.2307/356600 · Paper page
- 10.1207/s15516709cog1404_3 · doi:10.1207/s15516709cog1404_3 · Paper page
- Roger Levy and Galen Andrew. 2006. Tregex and Tsurgeon: Tools for querying and manipulating tree data structures.. In Proceedings of the LREC. Citeseer, 2231–2234.
- Ellen W. Nold. 1981. Revising. Writing: The Nature, Development, and Teaching of Written Communication 2 (1981), 67–79.
- Ben Pietrzak Ben Swanson Kory Mathewson Monica Dinculescu and Sherol Chen. 2021. Story centaur: Large language model few shot learning as a creative writing tool. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations.
- Paul A. Prior. 2005. A Sociocultural Theory of Writing. In The Handbook of Writing Research . Guilford Press 54–66.
- Alec Radford Jong Wook Kim Chris Hallacy Aditya Ramesh Gabriel Goh Sandhini Agarwal Girish Sastry Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger and Ilya Sutskever. 2021. Learning transferable visual models from natural language supervision. In International Conference on Machine Learning . PMLR 8748–8763.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog 1, 8 (2019), 9.
- David Ramsay, Ishwarya Ananthabhotla, and Joseph Paradiso. 2019. The intrinsic memorability of everyday sounds. In Proceedings of the Audio Engineering Society Conference: 2019 AES International Conference on Immersive and Interactive Audio. Audio Engineering Society.
- Thomas B. Ward and E. Thomas Lawson. 2009. Creative Cognition in Science Fiction and Fantasy Writing . Cambridge University Press.
Cited by
Brynjolfsson, E., Li, D., & Raymond, L. (2023) · National Bureau of Economic Research · doi:10.3386/w31161 · Cited by 995
“writing suggestion tool, Singh et al. (2022) finds that four of the 23 study participants refused to engage with AI suggestions.”
Co-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265
“Studies have investigated interface design factors and interactions with writing assistants that directly or indirectly support inspiration [17, 70, 95, 105], language prof-ciency [27], story writing [95, 105], text revision [36, 107] or creative writing [33, 46].”
BackgroundDraxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3637875 · Cited by 186
“Related, Singh et al. [96] describes how writers actively invest into taking ‘leaps’ to fit their story around a suggested phrase.”
BackgroundHomogenization Effects of Large Language Models on Human Creative Ideation
Anderson, B. R., Shah, J. H., & Kreminski, M. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656204 · Cited by 188
3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows
Liu, V., Vermeulen, J., Fitzmaurice, G., & Matejka, J. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596098 · Cited by 163
“3DALL-E’s interdisciplinary design knowledge is both a strength of AI pretraining as well as the ability of designers to make integrative leaps to meet the AI halfway [81].”
BackgroundSparks: Inspiration for Science Writing using Language Models
Gero, K. I., Liu, V., & Chilton, L. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533533 · Cited by 161
Interactive AI With Retrieval-Augmented Generation for Next Generation Networking
Zhang, R., Du, H., Liu, Y., Niyato, D., Kang, J., Sun, S., Shen, X., & Poor, H. V. (2024) · IEEE Network · doi:10.1109/mnet.2024.3401159 · Cited by 147
“For example, in [15], the authors investigated machine-in-the-loop creative writing using a multi-modal based IAI method that suggested improvements through sight, sound, and language, marking an innovative approach in AI-assisted creativity.”
BackgroundA Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
“The most common mechanism is to use text formatting such”
Social Dynamics of AI Support in Creative Writing
Gero, K. I., Long, T., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580782 · Cited by 129
“In turn, the HCI research community has leapt to the challenge of understanding how users can interact with these technologies, developing new interaction techniques like prompt chaining [40] and documenting new interaction patterns like integrative leaps [34].”
BackgroundShaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language Models
Dhillon, P. S., Molaei, S., Li, J., Golub, M., Zheng, S., & Robert, L. P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642134 · Cited by 111
“This shift redefines AI as an active col-laborator, expanding its use in diverse contexts like story writing [7, 18, 40, 62, 63, 74] and creative tasks [19, 25, 28, 41, 72].”
Background“How knowledge workers think generative AI will (not) transform their industries,”
Woodruff, A., Shelby, R., Kelley, P. G., Rousso-Schindler, S., Smith-Loud, J., & Wilcox, L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642700 · Cited by 105
“A dominant thread of research focuses on different writing tasks [63, 130, 138, 142, 162, 164], including marketing slogans [35] and storytelling [131].”
BackgroundHan, Y., Qiu, Z., Cheng, J., & Lc, R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642133 · Cited by 183
“Another tool is designed to assist with the prompting process through automatic prompt editing [54].”
MethodHan, A., Zhou, X., Cai, Z., Han, S., Ko, R., Corrigan, S., & Peppler, K. A. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642438 · Cited by 114
AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713564 · Cited by 306
“Beyond creative writing, HCI researchers have also proposed tools for argumentative writing, including jour-nalism [65], scientific writing [30], email writing [46], and crafting self-introductions for networking [41].”
InfluentialAI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
Agarwal, D., Naaman, M., & Vashistha, A. (2024) · arXiv · doi:10.48550/arxiv.2409.11360 · Cited by 99
“Beyond creative writing, HCI researchers have also proposed tools for argumentative writing, including jour-nalism [65], scientific writing [30], email writing [46], and crafting self-introductions for networking [41].”
InfluentialOpal: Multimodal Image Generation for News Illustration
Liu, V., Qiao, H., & Chilton, L. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545621 · Cited by 104
“[36] Recent momentum within multimodal representation learning has driven more people to create and open-source multimodal frameworks and systems.”
BackgroundDesignAID: Using Generative AI and Semantic Diversity for Design Inspiration
Cai, A., Rick, S. R., Heyman, J. L., Zhang, Y., Filipowicz, A., Hong, M., Klenk, M., & Malone, T. (2023) · Proceedings of The ACM Collective Intelligence Conference · doi:10.1145/3582269.3615596 · Cited by 87
“Singh et al. further uncover the human role of performing integrative leaps in incorporating AI-generated text into their developing stories [42].”
BackgroundQin, H. X., Jin, S., Gao, Z., Fan, M., & Hui, P. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642105 · Cited by 82
“…visualization of ideas through CharacterMeet, with participants’ diverse visualization needs for visuals and audio aligning with the diversity in types (e.g., images and other sensory information) and degrees of vividness of mental imagery found in prior works [15, 25, 31, 36, 64, 102, 107, 121].”
BackgroundBeyond Text Generation: Supporting Writers with Continuous Automatic Text Summaries
Dang, H., Benharrak, K., Lehmann, F., & Buschek, D. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545672 · Cited by 84
“for the next sentence [38] or paragraph [54] or in a sidebar [42]).”
BackgroundDang, H., Goller, S., Lehmann, F., & Buschek, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580969 · Cited by 83
“evaluation fatigue [4], integrative leaps [41]).”
BackgroundInfluentialHow Beginning Programmers and Code LLMs (Mis)read Each Other
Nguyen, S., Babe, H. M., Zi, Y., Guha, A., Anderson, C. J., & Feldman, M. Q. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642706 · Cited by 160
“Our post-study interview and survey was inspired by their exploration of participant’s perceptions of AI.”
MethodHadan, H., Wang, D., Mogavi, R. H., Tu, J., Zhang-Kennedy, L., & Nacke, L. E. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100095 · Cited by 91
“Our RQ1 aims to validate this hypothesis by examining reviewers ’ awareness across various levels of AI involvement in research writing.”
Kim, T. S., Lee, Y., Chang, M., & Kim, J. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606833 · Cited by 56
“Lenses can also be assembled together to view the same generation outputs through multiple representations [64, 82].”
BackgroundReza, M., Laundry, N. M., Musabirov, I., Dushniku, P., Yu, Z. Y. “., Mittal, K., Grossman, T., Liut, M., Kuzminykh, A., & Williams, J. J. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641899 · Cited by 52
“There has been an explosion of recent work [4, 9, 14, 16, 26–28, 31, 47, 48, 50, 56, 67, 82, 84, 97] on interfaces for writing with LLMs in tandem with rapid advancements in AI writing capabilities using LLMs [8, 18, 66, 76, 91], examining various aspects of the AI-assisted writing process…”
DATATALES: Investigating the use of Large Language Models for Authoring Data-Driven Articles
Sultanum, N., & Srinivasan, A. (2023) · 2023 IEEE Visualization and Visual Analytics (VIS) · doi:10.1109/vis54172.2023.00055 · Cited by 52
“These include creative writing support tools such as plot suggestions [30], journalistic angle ideation [24] and co-writing of theater scripts [21]; as well as technical writing support such as argumentative writing [41], scientifc writing [9], and reverse outlining for manuscript revision [4].”
BackgroundBhat, A., Agashe, S., Oberoi, P., Mohile, N., Jangir, R., & Joshi, A. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584060 · Cited by 47
WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI
Dang, H., Brudy, F., Fitzmaurice, G. W., & Anderson, F. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606772 · Cited by 71
“A formative study was carried out to gain insight into the approaches and perceptions creators have in constructing and defining their fictional worlds.”
BackgroundWoo, D. J., Wang, Y., Susanto, H., & Guo, K. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231175999 · Cited by 44
“At the same time, individual writers ’ approaches and motivations could explain differences in machine-in-the-loop writing of stories (Singh et al., 2022).”
BackgroundMultimodal composing with generative AI: Examining preservice teachers’ processes and perspectives
Smith, B. E., Shimizu, A. Y., Burriss, S. K., Hundley, M. K., & Pendergrass, E. (2024) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2024.102896 · Cited by 71
FigurA11y: AI Assistance for Writing Scientific Alt Text
Singh, N., Wang, L. L., & Bragg, J. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645212 · Cited by 42
“The continuations appended generated text conditioned on figure metadata, a common strategy in writing support which allows suggestions that build on user-authored text [35, 42, 53].”
BackgroundSelf-citationBeyond Text-to-Image: Multimodal Prompts to Explore Generative AI
Liu, V. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3577043 · Cited by 38
“Advances in AI have now been embedded within systems such as Opal [18], Sparks [12], FashionQ [15], and the writing editors in [28].”
MethodFrom Pen to Prompt: How Creative Writers Integrate AI into their Writing Practice
Guo, A., Sathyanarayanan, S., Wang, L., Heer, J., & Zhang, A. X. (2025) · Creativity and Cognition · doi:10.1145/3698061.3726910 · Cited by 77
Rafner, J., Zana, B., Bang Hansen, I., Ceh, S., Sherson, J., Benedek, M., & Lebuda, I. (2025) · Creativity Research Journal · doi:10.1080/10400419.2025.2587803 · Cited by 38
'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models
Hwang, A. H.-C., Liao, Q. V., Blodgett, S. L., Olteanu, A., & Trischler, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711020 · Cited by 42
PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels
Cai, R., Janaka, N., Chen, Y., Wang, L., Zhao, S., & Liu, C. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642320 · Cited by 36
“Mixed-initiative interactions have been applied to collaborative documentation and writing tasks [21, 71, 75].”
Ding, Z., Srinivasan, A., Macneil, S., & Chan, J. (2023) · Creativity and Cognition · doi:10.1145/3591196.3593516 · Cited by 35
“For example, researchers have explored the potential of LLMs to replicate or assist creative writing tasks such as metaphor generation [9, 31], science writing [32] and storytelling [3, 18, 25, 62, 66, 69, 75].”
BackgroundGenerative AI at WorkPreprint
Brynjolfsson, E., Li, D., & Raymond, L. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4426942 · Cited by 235
A Preliminary Exploration of YouTubers' Use of Generative-AI in Content Creation
Lyu, Y., Zhang, H., Niu, S., & Cai, J. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651057 · Cited by 57
Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflow
Long, T., Gero, K. I., & Chilton, L. B. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661587 · Cited by 60
Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
Fu, L., Newman, B., Jakesch, M., & Kreps, S. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581351 · Cited by 31
“In addition, these models may provide ideas and inspiration [31, 40, 49] beyond simply increasing text input efciency.”
BackgroundArakawa, R., Yakura, H., & Goto, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581133 · Cited by 29
“recent studies that demonstrate how human writers and AI-based generation techniques can collaborate to support writers [23, 35, 60], such as in creative writing [57, 63, 65, 78, 82].”
BackgroundCo-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing Process
Reza, M., Thomas-Mitchell, J., Dushniku, P., Laundry, N., Williams, J. J., & Kuzminykh, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757566 · Cited by 37
“” W15 further described this decision-making as a “negotiation” with the AI, framing ownership as an iterative process of consciously selecting and refining suggestions: “I find it has to be a negotiation.”
InfluentialLoose Ends: A Mixed-Initiative Creative Interface for Playful Storytelling
Kreminski, M., Dickinson, M., Wardrip–Fruin, N., & Mateas, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v18i1.21955 · Cited by 29
“…a story (Roemmele and Gordon 2015); taking the story in unexpected directions (Kreminski et al. 2020a; Calderwood et al. 2020; Singh et al. 2022); and creating a sense of shared authorship (Samuel 2016) between the user and system (Kreminski et al. 2020a; Calderwood et al. 2020; Singh et al. 2022).”
BackgroundInfluentialBreaking from realism: exploring the potential of glitch in AI-generated dance
Wallace, B., Nymoen, K., Tørresen, J., & Martin, C. P. (2024) · Digital Creativity · doi:10.1080/14626268.2024.2327006 · Cited by 32
Ai.llude: Investigating Rewriting AI-Generated Text to Support Creative Expression
Zhou, D., & Sterman, S. (2024) · Creativity and Cognition · doi:10.1145/3635636.3656187 · Cited by 41
Supermind Ideator: How Scaffolding Human-AI Collaboration Can Increase Creativity
Heyman, J. L., Rick, S., Giacomelli, G., Wen, H., Laubacher, R., Taubenslag, N., Knicker, M. S., Jeddi, Y., Ragupathy, P., Curhan, J. R., et al. (2024) · ACM Collective Intelligence Conference (CI) · doi:10.1145/3643562.3672611 · Cited by 58
“A complex topic concerning LLMs today is their safety and accuracy with generated content [3, 51].”
Lehmann, F., Markert, N., Dang, H., & Buschek, D. (2022) · Mensch und Computer 2022 · doi:10.1145/3543758.3543947 · Cited by 25
The Role of Inclusion, Control, and Ownership in Workplace AI-Mediated Communication
Kadoma, K., Aubin Le Quere, M., Fu, X. J., Munsch, C., Metaxa, D., & Naaman, M. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642650 · Cited by 24
“In our experiment, we consider two targets– the message itself and the message style.”
MethodWill Code Remain a Relevant User Interface for End-User Programming with Generative AI Models?
Sarkar, A. (2023) · Proceedings of the 2023 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3622758.3622882 · Cited by 23
“…increases the rapidity of such exploration but also enables forms of assistance that were not possible with previous approaches, such as the generation of alternative narratives to trigger nonlinear “leaps” in the user’s thinking (though this is yet to be investigated in an EUP setting) [90, 101].”
BackgroundAmuse: Human-AI Collaborative Songwriting with Multimodal Inspirations
Kim, Y., Lee, S.-J., & Donahue, C. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713818 · Cited by 23
“Moreover, multimodal systems could further enhance this process by providing real-time feedback across different modalities, supporting the user’s creative exploration of musical ideas.”
InfluentialRead, Revise, Repeat: A System Demonstration for Human-in-the-loop Iterative Text Revision
Du, W., Kim, Z. M., Raheja, V., Kumar, D., & Kang, D. (2022) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.18653/v1/2022.in2writing-1.14 · Cited by 83
“Another line of work by Sun et al. (2021); Singh et al. (2022) on creative writing designed human-machine interaction interfaces to encourage new content generation.”
BackgroundNon-Expert Programmers in the Generative AI Future
Feldman, M. Q., & Anderson, C. J. (2024) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3663384.3663393 · Cited by 50
Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language Arts
Kim, T., Han, H., Adar, E., Kay, M., & Chung, J. J. Y. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642529 · Cited by 20
“…how these LLM suggestions can change people’s writing and found that generated texts could spark new ideas [14, 18, 36], lower grammatical errors [58], and increase vocabulary diversity [58], while introducing cognitive challenge of integrating generated texts into the user’s writing [14, 90].”
BackgroundBeyond Productivity: Rethinking the Impact of Creativity Support Tools
Rhys Cox, S., Bøjer Djernæs, H., & van Berkel, N. (2025) · Proceedings of the 2025 Conference on Creativity and Cognition · doi:10.1145/3698061.3726924 · Cited by 28
Siddiqui, M. N., Pea, R. D., & Subramonyam, H. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714119 · Cited by 45
“Several LLM co-writing systems have emerged to bridge this gap [8, 12, 15, 16, 26–29, 44, 47, 50, 56, 69, 71].”
Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools
Buschek, D. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660681 · Cited by 44
“…Proposer Getting/exploringideas Ineedideasformywriting. metaphorgraph[50],plotinspirationsidebar[40,77],discussionelaborationpop-up[84],ideapanel[33],inspirationalimages/audio[77] Translator Producingtext HowcanIputthisideaintowords?…”
BackgroundMethodInfluentialKreijkes, P., Kewenig, V. N., Kuvalja, M., Lee, M., Hofman, J. M., Vitello, S., Sellen, A. J., Rintel, S., Goldstein, D. G., Rothschild, D. M., et al. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105514 · Cited by 50
Cloudy, J., Banks, J., & Bowman, N. D. (2022) · Technology Mind and Behavior · doi:10.1037/tmb0000083 · Cited by 20
Navigating Complexity in Software Engineering: A Prototype for Comparing GPT-n Solutions
Treude, C. (2023) · IEEE/ACM International Workshop on Bots in Software Engineering (BotSE) · doi:10.1109/botse59190.2023.00008 · Cited by 30
“ample, diversifying reply suggestions for instant messaging systems [14] and emails [15] has been shown to improve creativity [16].”
BackgroundExamining Agency, Expertise, and Roles of AI Systems in AI-Mediated Communication
Mieczkowski, H., & Hancock, J. (2022) · doi:10.31219/osf.io/asnv4 · Cited by 16
Generative AI and Perceptual Harms: Who's Suspected of using LLMs?
Kadoma, K., Metaxa, D., & Naaman, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713897 · Cited by 14
“The general public is using generative AI for a variety of tasks from inspiring ideas [23, 65, 72] and revising text [13] to creating images [17, 73] and popular music [10, 14, 19].”
Qin, H. X., Zhu, G., Fan, M., & Hui, P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713569 · Cited by 31
“…improved writing experience for an interface supporting the integration of generative AI output into the content being worked on [70, 108, 110, 112, 129, 155], D2) a system should integrate person-alizable writing and visualization support through text (chatbot and non-chatbot interfaces), images,…”
InfluentialSARD: A Human-AI Collaborative Story Generation
Radwan, A. Y., Alasmari, K. M., Abdulbagi, O. A., & Alghamdi, E. A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76806-4_7 · Cited by 18
Supermind Ideator: Exploring generative AI to support creative problem-solving
Rick, S. R., Giacomelli, G., Wen, H., Laubacher, R. J., Taubenslag, N., Heyman, J. L., Knicker, M. S., Jeddi, Y., Maier, H., Dwyer, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2311.01937 · Cited by 12
“A complex topic concerning LLMs today is their safety and accuracy with generated content [3, 44].”
BackgroundThe use of ChatGPT in creative writing assistance
Фіялка, С. Б., Kornieva, Z., & Гончарук, Т. Г. (2024) · XLinguae · doi:10.18355/xl.2024.17.01.01 · Cited by 27
Supermind Ideator: How scaffolding Human-AI collaboration can increase creativity
Heyman, J. L., Rick, S., Giacomelli, G., Wen, H., Laubacher, R., Taubenslag, N., Knicker, M. S., Jeddi, Y., Ragupathy, P., Curhan, J. R., et al. (2024) · Collective Intelligence · doi:10.1177/26339137241305117 · Cited by 14
Making the Write Connections: Linking Writing Support Tools with Writer Needs
Zhao, Z., Masson, D., Kim, Y., Penn, G., & Chevalier, F. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713161 · Cited by 24
“The literature has mainly focused on different methods for increasing creative immersion through time constraint [9], smell [39], virtual environments [41], subliminal messaging [43], and AI [102].”
InfluentialGmeiner, F., Marquardt, N., Bentley, M., Romat, H., Pahud, M., Brown, D., Roseway, A., Martelaro, N., Holstein, K., Hinckley, K., et al. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713861 · Cited by 39
“Adding to this observation, a recent study in the context of AI-assisted writing found that participants, despite the many integrated AI suggestions, felt ownership over the content "because of the numerous authorial decisions" they made [83].”
Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces
Weinberg, T. M., Kadoma, K., Penuela, R. E. G., Valencia, S., & Roumen, T. J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714102 · Cited by 21
“Higginbotham et al. [24] studied conversations between AAC users and their interlocutors, finding that the perception of an AAC user’s competence is influenced by how well their conversational timing aligns with their partner’s.”
Paratrouper: Exploratory Creation of Character Cast Visuals Using Generative AI
Leong, J., Ledo, D., Driscoll, T. R., Grossman, T., Fitzmaurice, G. W., & Anderson, F. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714242 · Cited by 17
“For instance, they have been used to provide inspiration [70, 83] as well as help generate ideas [10, 11, 83].”
Orchid: A Creative Approach for Authoring LLM-Driven Interactive Narratives
Wu, Z., Kumyol, S., Wong, S., Hu, X., Tong, X., & Braud, T. (2025) · Creativity and Cognition · doi:10.1145/3698061.3726906 · Cited by 14
“For instance, in the work introducing AI to facilitate writing activities, particularly in machine-in-the-loop creative writing, it helps to spark ideas, as mentioned by [18, 64, 78].”
The Impact of Technology on Students’ Creative Writing: A Case Study in Jordan
Alkhaldi, A. A. (2023) · Theory and Practice in Language Studies · doi:10.17507/tpls.1303.06 · Cited by 13
Ding, Z. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640544.3645241 · Cited by 18
“These tasks demand not only domain expertise but also capabilities for planning, reasoning, ideating, and maintaining context over extended periods to create coherent and innovative content.”
BackgroundSingh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2022) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.18653/v1/2022.in2writing-1.3 · Cited by 10
Self-citationMixed-Initiative Interaction with Computational Generative Systems
Lehmann, F. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3577061 · Cited by 17
“[27] on inspiring writers showed that offering system generated multimedia stimuli by analyzing the written text helped to inspire the writer, even without accepting system generated suggestions.”
BackgroundCoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents
Wan, R., Gebreegziabher, S. A., Li, T. J.-J., & Badillo-Urquiola, K. (2024) · Creativity and Cognition · doi:10.1145/3635636.3664260 · Cited by 9
Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks
Ding, Z., & Chan, J. (2023) · arXiv · doi:10.48550/arxiv.2303.06430 · Cited by 9
“These are larger scale creative tasks containing a set of subtasks interdependent to each other, such as storytelling [1, 4, 13, 21, 25, 27, 28].”
BackgroundA Systematic Review of Artistic Human-AI Co-Creative Systems and Interaction Design
Singh, S., Hindriks, K. V., Heylen, D., & Baraka, K. (2026) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3834857 · Cited by 37
AI in the Writing Process: How Purposeful AI Support Fosters Student Writing
Siddiqui, M. N., Feliciano, V. A., Pea, R. D., & Subramonyam, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98459-4_14 · Cited by 12
Digital Storytelling to Improve English Narrative Writing Skills
Ngoi, S., Tan, K. H., Alias, J., & Mat, N. (2024) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v14-i4/21249 · Cited by 5
“These challenges may result in narratives lacking consistency and flow, making it difficult for readers to follow the story and grasp its message (Singh et al., 2023).”
BackgroundCo-Creating Question-and-Answer Style Articles with Large Language Models for Research Promotion
Lim, H., Cho, J. Y., Kim, T., Park, J., Shin, H., Choi, S., Park, S., Lee, K., Kim, J., Lee, M., et al. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3660705 · Cited by 10
“Research on human-AI co-creation systems have been actively conducted in a wide range of creative tasks for design [29], illustrations [9, 62, 65], music composition [40], dancing [64], drawing [19, 33, 46], storytelling [14, 16, 43, 45, 48, 59], and writing [4, 17, 23, 28, 39, 52, 77].”
BackgroundMethodInfluentialZhou, D., Gallagher, J. R., & Sterman, S. (2025) · Creativity and Cognition · doi:10.1145/3698061.3726907 · Cited by 9
Zhang, Y., & Li, Z. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101017 · Cited by 4
Reactive Writers: How Co-Writing with AI Changes How We Engage with Ideas
Bhat, A., Quéré, M. A. L., Naaman, M., & Jakesch, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791529 · Cited by 17
Ma, Z., Mei, Y., Bruderlein, C., Gajos, K. Z., & Pan, W. (2025) · Annual Symposium on Human-Computer Interaction for Work (CHIWORK) · doi:10.1145/3729176.3729194 · Cited by 28
“Although this shift is frequently described as enhancing efficiency, existing studies also suggest that it can introduce additional cognitive demands when integrating AI-generated content [29, 91].”
Kim, Y., Le, T.-L. V., Kim, D., Lee, M., & Lee, S.-J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735740 · Cited by 15
Defending mutation-based adversarial text perturbation: a black-box approach
Deanda, D., Alsmadi, I. M., Guerrero, J., & Liang, G. (2025) · Cluster Computing · doi:10.1007/s10586-024-04916-3 · Cited by 5
“Large language models (LLMs) have demonstrably transformed diverse applications, from democratizing creative writing [9] to facilitating document summarizing [10], language translation [11], and question answering [12].”
CorpusStudio: Surfacing Emergent Patterns In A Corpus Of Prior Work While Writing
Dang, H., Swoopes, C., Buschek, D., & Glassman, E. L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713974 · Cited by 15
Self-citationProceedings of The ACM Collective Intelligence Conference
(2023) · doi:10.1145/3582269 · Cited by 4
Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing Systems
Carrera, D., Thomas-Mitchell, J., & Wigdor, D. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791952 · Cited by 3
AI-Assisted Writing in Education: Ecosystem Risks and Mitigations
Shibani, A., & Shum, S. B. (2024) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.1145/3690712.3690714 · Cited by 9
“Advances in generative AI (GenAI) are propelling R&D into intelligent and interactive writing assistants (IIWAs) enabling innovative forms of writing feedback [4, 5] and human-AI co-writing [6].”
Herding CATs: Making Sense of Creative Activity Traces
Kreminski, M., Smith, A., Chung, J. J. Y., Son, K., Yang, Q., Lee, S. W., Hammad, N., Rawn, E., Almeda, S. G., & Zamfirescu-Pereira, J. D. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778743 · Cited by 7
Fu, K., Huang, J., Ling, L., Hong, S., Zuo, Y., Ray, L. C., & Li, T. J.-J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790400 · Cited by 8
“…repeatedly convert visually grounded ideas back into verbal form for any narrative change to take effect, thereby increasing cognitive load and un-dermining many of the well-established benefits of external representations such as diagrams, sketches, and other forms of external cognition [48, 80].”
InfluentialLiu, M., Zhang, L. J., & Biebricher, C. (2026) · Written Communication · doi:10.1177/07410883261461544 · Cited by 2
Debugging for Inclusivity in Online CS Courseware: Does it Work?
Chatterjee, A., Choudhuri, R., Sarkar, M., Chattopadhyay, S., Liu, D., Hedaoo, S., Burnett, M., & Sarma, A. (2024) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3632620.3671117 · Cited by 3
“We used the RAKE algorithm [57] for automatic keyword extraction to extract the top 10 ranked keywords, according to recommended practices [59].”
MethodCalibRead: Unobtrusive Eye Tracking Calibration from Natural Reading Behavior
Liu, C., Yu, C., Wang, X. F., Jiang, J., Yang, T., Tang, B., Shi, Y., Liang, C., & Shi, Y. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3699737 · Cited by 3
“While large models like GPT have shown promise in diverse fields [8, 9, 35, 37, 45, 49, 55], our study employed a simple network with GPT-provided embeddings.”
A Thematic Framework for Human-AI Co-creative Writing: Writers' Experiences of the ProcessPreprint
Hansen, I. B., & Rafner, J. F. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/fgqcz_v1 · Cited by 4
The Integration of Character Building in Novel Writing through AI
Shahbudin, M. S. I. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i04.24906 · Cited by 1
“AI can serve as a creative assistant, offering writers new ideas, generating content, and even suggesting narrative directions that the author may not have considered (Singh et al., 2023).”
BackgroundUnderstanding How Paper Writers Use AI-Generated Captions in Figure Caption Writing
Ng, H. Y., Hsu, T.-Y., Min, J., Kim, S., Rossi, R. A., Yu, T., Jung, H., & Huang, T.-H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-8912-5_8 · Cited by 4
Metadata
- Authors
- Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L.
- Affiliations
- MIT Media Lab (US)
- Harvard University (US)
- Venue
- ACM Transactions on Computer-Human Interaction
- Published
- 2023-09-23
- Volume
- 30
- Issue
- 5
- Pages
- 1-57
- ISSN
- 1073-0516 (ISSN-L)
- 1557-7325
- OpenAlex
- W4213451626
- Cited by
- 119
- References
- 77
- Citations by year
- 2026: 15 · 2025: 32 · 2024: 38 · 2023: 23
- FWCI
- 12.82
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Transactions on Computer-Human Interaction (publishedVersion, cc-by)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- Funders
- NSF (2107391)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Artistic and Creative Research
- Keywords
- creative writing, language models, text generation, human-AI collaboration, story development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.