Cited by 26Artificial Intelligence in GamesNarrative Theory and AnalysisArtistic and Creative Research

Unmet Creativity Support Needs in Computationally Supported Creative Writing

Open access
Kreminski, Max, Martens, Chris·2022·Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022)

Abstract

Large language models (LLMs) enabled by the datasets and computing power of the last decade have recently gained popularity for their capacity to generate plausible natural language text from human-provided prompts.This ability makes them appealing to fiction writers as prospective co-creative agents, addressing the common challenge of writer's block, or getting unstuck.However, creative writers face additional challenges, including maintaining narrative consistency, developing plot structure, architecting reader experience, and refining their expressive intent, which are not well-addressed by current LLM-backed tools.In this paper, we define these needs by grounding them in cognitive and theoretical literature, then survey previous computational narrative research that holds promise for supporting each of them in a co-creative setting.

AI snapshot

Written from the paper’s full text.

TL;DR

This position/survey paper identifies five creativity support needs in computationally supported creative writing—getting unstuck, maintaining consistency, plot structure, reader experience, and refining expressive intent—and argues current LLMs meaningfully address only getting unstuck. It surveys AI/digital games and computational narrative technologies that could support the other four needs, aiming to bridge ACL/NLP and games research toward hybrid co-creative writing tools.

Key findings

  • The paper defines five interrelated needs: getting unstuck, maintaining consistency, constructing a satisfying overall story arc including conclusion/resolution, managing reader experience, and refining/iterating on expressive intent.
  • Current LLMs are good at getting unstuck via short-term continuation suggestions, but do not directly address consistency maintenance, longer-term plot structure, reader experience, or refining high-level expressive intent; some novelists suggest LLMs may work against coherent plot structure due to divergent suggestions.
  • For the remaining needs, it surveys technologies including world models/planning and stories-as-proofs for consistency; symbolic grammars/logic programming, BRUTUS, and answer set programming for plot structure; story/discourse distinction, drama managers, IDTension, Suspenser, and QUEST for reader experience; and Writing Buddy, Mimisbrunnur, Why Are We Like This?, and story sifting for expressive intent.
  • The conclusion states that only one of the five needs is meaningfully supported by current LLMs, and that surveyed technologies are at varying maturity and mostly tested in automated/generative rather than mixed-initiative co-creative modes.

Methods

  • Conceptual/survey paper, not an empirical study; it defines needs by grounding them in cognitive and theoretical literature, then surveys previous computational narrative research.
  • Scope is primarily narrative fiction: short stories, novels, and game writing/interactive storytelling; it also considers visual, audio, and hybrid narrative such as film and game narrative, but notes suggestions may not all apply to other creative writing such as poetry.
  • Main analysis is qualitative synthesis and bridge-building between ACL/NLP and AI/digital games communities, proposing complementary technologies rather than evaluating them.

Limitations

  • The paper states its scope is limited primarily to narrative fiction, so the suggestions may not all be applicable to other forms of creative writing such as poetry.
  • The paper states that surveyed technologies are at varying levels of maturity and most have only been tested in purely automated or generative forms rather than in mixed-initiative, co-creative interaction modes; evaluating them in those modes is future work.
  • Evident from the text: no empirical user study or system evaluation is reported; the paper is a position/survey synthesis, so its claims about unmet needs and technology promise are not tested here.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.18653/v1/2022.in2writing-1.11

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 18 cited sources checked · 0 supported · 0 flagged

  • Interpretationnone given

    Most of the surveyed technologies have only been tested in purely automated or generative forms rather than in mixed-initiative, co-creative interaction modes.

    “These technologies are at varying levels of maturity, and most of them have only been tested in purely automated or generative forms rather than in mixed-initiative, co-creative interaction modes.”
    Quote in the paperNot a substantial claim
  • Interpretationcitation

    Story sifting technologies can be applied to the task of inferring an author's intent for the story they are writing.

    “Additionally, story sifting technologies (Ryan et al., 2015;Ryan, 2018;Kreminski et al., 2019a)which apply pattern matching to the identification of potentially compelling new plot directions in chronicles of past story events-can also be applied to the task of inferring an author's intent for the story they are writing.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ryan et al., 2015

      Not checked in the free run.

    • cites Ryan, 2018

      Not checked in the free run.

    • cites Kreminski et al., 2019a

      Not checked in the free run.

  • Interpretationnone given

    In order to reason about consistency, authors need to reason about narrative material at a level more abstract than narrative text.

    “In order to reason about consistency, authors need to reason about narrative material at a level more abstract than narrative text (including storyboards, scene scripts, etc).”
    Quote in the paperNot a substantial claim
  • Premisecitation

    Technologies have been created for modeling reader cognition to support reader experience effects such as pacing, tension, and surprise.

    “Finally, technologies have been created for modeling reader cognition to support reader experience effects such as pacing, tension, and surprise.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Szilas, 2003

      Not checked in the free run.

    • cites Cheong and Young, 2006

      Not checked in the free run.

    • cites Graesser and Franklin, 1990

      Not checked in the free run.

  • Premisecitation

    Writing Buddy, Mimisbrunnur, and Why Are We Like This? all address the challenge of intent refinement to some extent by providing explicit interfaces for the specification of author goals.

    “However, Writing Buddy (Samuel et al., 2016), Mimisbrunnur (Stefnisson and Thue, 2018), and Why Are We Like This? (Kreminski et al., 2020a,b) all address this challenge to some extent by providing explicit interfaces for the specification of author goals: high-level, machine-interpretable descriptions of what the human user wants to have happen in the story they are writing.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Samuel et al., 2016

      Not checked in the free run.

    • cites Stefnisson and Thue, 2018

      Not checked in the free run.

    • cites Kreminski et al., 2020a,b

      Not checked in the free run.

  • Classified as probably not a substantial claim. 14
  • May combine two claims. 7
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Since refinement of expressive intent has only recently been recognized as an explicit goal for creativity support tools in some contexts, relatively little work has been done to provide computational support for intent refinement in storytelling contexts.

    “Since refinement of expressive intent has only recently been recognized as an explicit goal for creativity support tools in some contexts, relatively little work has been done to provide computational support for intent refinement in storytelling contexts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Distinguishing between story and discourse is one promising first step for reader experience support, since it allows a narrative generation engine to retell the same story in different ways.

    “Distinguishing between story and discourse is one promising first step for reader experience support, since it allows a narrative generation engine to retell the same story (plot-wise) in different ways (Rishes et al., 2013).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rishes et al., 2013

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    As stories and their casts of characters grow in size and more of the fictional timeline is filled in, the author runs increasing risk of introducing inconsistencies, plot holes, or unexplained situations that may break the reader's ability to suspend disbelief.

    “As stories and their casts of characters grow in size, and more of the fictional timeline is filled in, the author runs increasing risk of introducing inconsistencies (conflicting factual assertions or implications), plot holes, or unexplained situations that may break the reader's ability to suspend disbelief.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Language model continuations of human-written text tend to be syntactically valid and relevant to storyworld entities or situations described in the immediately preceding text, enabling them to function as viable short-term suggestions.

    “Language model continuations of humanwritten text tend to be syntactically valid and relevant to storyworld entities or situations that were described in the immediately preceding text, enabling them to function as viable short-term suggestions for what might happen next in a written story.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Machine-learned language models are good at capturing local coherence, but tend to struggle with the global constraints implied by plot structure.

    “Machine-learned language models are good at capturing local coherence, but tend to struggle with the global constraints implied by plot structure.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The key technological tool for maintaining consistency is a world model, or a computational representation of the diegetic phenomena that a story aims to fictionalize.

    “The key technological tool for maintaining consistency is a world model, or a computational representation of the diegetic phenomena that a story aims to fictionalize.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    If story authors strategically withhold information, they can elicit inferences on the part of readers to fill in the gaps in ways that can evoke humor, shock, or horror understanding.

    “If story authors strategically withhold information, they can elicit inferences on the part of readers to fill in the gaps in ways that can evoke humor, shock, or horror understanding (Cohn, 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cohn, 2019

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    By representing a world model in its own right, one can specify consistency constraints as first-order logic formulas whose constituent predicates refer to the world model.

    “By representing a world model in its own right, one can specify consistency constraints as (e.g.) first-order logic formulas whose constituent predicates refer to the world model.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    To support authors in crafting an intentional experience for their readers, computational tools need to be able to reason about or simulate the reader's cognitive processes.

    “To support authors in crafting an intentional experience for their readers, computational tools need to be able to reason about (or perhaps even simulate) the reader's cognitive processes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    One difficulty in creative work is that the creator may not know exactly what they are trying to express, and the expressive intent may shift as the creator's understanding of the work evolves.

    “One difficulty in creative work is that the creator themselves may not know exactly what they are trying to express, and the expressive intent may shift as the creator's understanding of the work evolves.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Poor pacing can cause a reader to get bored or overwhelmed with the story and fail to connect with the characters or the underlying message.

    “Poor pacing can cause a reader to get bored or overwhelmed with the story and fail to connect with the characters or the underlying message that the writer is attempting to convey.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Creative writers face additional challenges, including maintaining narrative consistency, developing plot structure, architecting reader experience, and refining their expressive intent.

    “However, creative writers face additional challenges, including maintaining narrative consistency, developing plot structure, architecting reader experience, and refining their expressive intent”
    • Also stated in: § 1 Introduction · boosted
      “have revealed a preliminary inventory of several distinct but interrelated creativity support needs among creative writers, including:”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Kreminski et al., 2019b

      Not checked in the free run.

    • cites Kreminski and Wardrip-Fruin, 2019

      Not checked in the free run.

    • cites Kreminski et al., 2020a

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Current large language models do not directly address consistency maintenance, longer-term plot structure, management of reader experience, or the challenge of refining high-level expressive intent.

    “However, they do not directly address consistency maintenance, longer-term plot structure, management of reader experience, or the challenge of refining high-level expressive intent”
    • Also stated in: § Abstract · plain
      “which are not well-addressed by current LLM-backed tools”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    The five creative writing support needs are getting unstuck, maintaining consistency, constructing a satisfying overall story arc including a conclusion/resolution, managing reader experience, and refining and iterating on expressive intent.

    “• Getting unstuck • Maintaining consistency • Constructing a satisfying overall story arc, including a conclusion/resolution”
    • Also stated in: § 1 Introduction · plain
      “• Managing reader experience”
    • Also stated in: § 1 Introduction · plain
      “• Refining and iterating on expressive intent”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Kreminski et al., 2019b

      Not checked in the free run.

    • cites Kreminski and Wardrip-Fruin, 2019

      Not checked in the free run.

    • cites Kreminski et al., 2020a

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    Reasoning about reader experience requires a good understanding of how stories work at a cognitive level.

    “Reasoning about reader experience requires a good understanding of how stories work at a cognitive level: e.g., that readers work as problem solvers when processing narrative text, working to stay one step ahead of the story to make sense of what has happened so far and predict what will happen next (Gerrig and Bernardo, 1994).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gerrig and Bernardo, 1994

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    A written work has an experiential impact on its readers, and understanding the levers that affect that impact is a key part of narrative intelligence.

    “Likewise, a written work has an experiential impact on its readers, and understanding the levers that affect that impact is a key part of narrative intelligence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Plot structures describe global rather than local features of a text, and they have more to do with the underlying world model than with the specific actions or events inferable from lexical properties of the text.

    “Importantly, plot structures describe global rather than local features of a text, and they have more to do with the underlying world model (see previous section) than they do with the specific actions or events that are inferable from lexical properties of the text.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The ability to directly author and manipulate knowledge corresponding to a situation model is central to a fiction author's task.

    “The ability to directly author and manipulate knowledge corresponding to a situation model (or similar) is central to a fiction author's task.”
    Quote in the paperNot a substantial claim
18 of 18

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Research works printed but not linked: 12

  1. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in Neural Information Processing Systems, 33:1877-1901.
  2. Rogelio E. Cardona-Rivera and R. Michael Young. 2019. Desiderata for a computational model of human on- line narrative sensemaking. In Working Notes of the 2019 AAAI Spring Symposium on Story-enabled In- telligence.
  3. Raymond Chandler. 1950. The simple art of murder. Saturday Review of Literature.
  4. David Gorman. 2018. Russian formalism. A Compan- ion to Literary Theory, pages 36-47.
  5. Max Kreminski and Michael Mateas. 2021. Reflective creators. In International Conference on Computa- tional Creativity.
  6. Lara Jean Martin. 2021. Neurosymbolic Automated Story Generation. Ph.D. thesis, Georgia Institute of Technology.
  7. Michael Mateas and Andrew Stern. 2003. Façade: An experiment in building a fully-realized interactive drama. In Game Developers Conference, volume 2, pages 4-8.
  8. Julie Porteous, Marc Cavazza, and Fred Charles. 2010. Applying planning to interactive storytelling: Narra- tive control using state constraints. ACM Transac- tions on Intelligent Systems and Technology (TIST), 1(2):1-21.
  9. David L Roberts and Charles L Isbell. 2007. Desiderata for managers of interactive experiences: A survey of recent advances in drama management. In Proceed- ings of the First Workshop on Agent-Based Systems for Human Learning and Entertainment (ABSHLE 07).
  10. Ingibergur Stefnisson and David Thue. 2018. Mimis- brunnur: AI-assisted authoring for interactive story- telling. In Proceedings of the AAAI Conference on artificial Intelligence and Interactive Digital enter- tainment, volume 14, pages 236-242.
  11. Nicolas Szilas. 2003. Idtension: a narrative engine for interactive drama. In Proceedings of the technologies for interactive digital storytelling and entertainment (TIDSE) conference, volume 3, pages 1-11.
  12. R. Michael Young, Stephen Ware, Brad Cassell, and Jus- tus Robertson. 2013. Plans and Planning in Narrative Generation: A Review of Plan-Based Approaches to the Generation of Story, Discourse, and Interactiv- ity in Narratives. Sprache und Datenverarbeitung, 37(1-2):67-77.

Cited by

Sorted by citations

Authors
Kreminski, M., & Martens, C.
Affiliations
  • University of California, Santa Cruz (US)
  • North Carolina State University (US)
Venue
Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022)
Published
2022
Pages
74-82
OpenAlex
W4285220829
Cited by
26
References
53
Citations by year
2026: 3 · 2025: 8 · 2024: 7 · 2023: 5 · 2022: 3
FWCI
3.18
Type
conference paper
Language
en
Open access
Licence
cc-by
Locations
Workshop on Intelligent and Interactive Writing Assistants (In2Writing) (publishedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
  • Social Sciences › Arts and Humanities › Literature and Literary Theory › Narrative Theory and Analysis
  • Social Sciences › Arts and Humanities › Visual Arts and Performing Arts › Artistic and Creative Research
Keywords
large language models, creative writing, co-creation, writer's block, narrative consistency, plot structure, reader experience, computational narrative, fiction writing, unmet needs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review