CoChat

Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories

Clark, Elizabeth, Ross, Anne Spencer, Tan, Chenhao, Ji, Yangfeng, Smith, Noah A. · 2018 · 23rd International Conference on Intelligent User Interfaces

The DOI matches its Crossref record; 29 of the 30 references it cites were found in a registry or an index.

Abstract

As the quality of natural language generated by artificial intelligence systems improves, writing interfaces can support interventions beyond grammar-checking and spell-checking, such as suggesting content to spark new ideas. To explore the possibility of machine-in-the-loop creative writing, we performed two case studies using two system prototypes, one for short story writing and one for slogan writing. Participants in our studies were asked to write with a machine in the loop or alone (control condition). They assessed their writing and experience through surveys and an open-ended interview. We collected additional assessments of the writing from Amazon Mechanical Turk crowdworkers. Our findings indicate that participants found the process fun and helpful and could envision use cases for future systems. At the same time, machine suggestions do not necessarily lead to better written artifacts. We therefore suggest novel natural language models and design choices that may better support creative writing.

Overview

Integrity signals

Registry

Crossref · 10.1145/3172944.3172983

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 1

  1. Myle Ott , Yejin Choi , Claire Cardie , and Jeffrey T . Hancock . 2011 . Finding deceptive opinion spam by any stretch of the imagination. In Proceedings of ACL. Myle Ott, Yejin Choi, Claire Cardie, and Jeffrey T. Hancock. 2011. Finding deceptive opinion spam by any stretch of the imagination. In Proceedings of ACL.

Cited by

See all 298

Metadata

Authors
Clark, E., Ross, A. S., Tan, C., Ji, Y., & Smith, N. A.
Affiliations
  • University of Washington (US)
  • University of Colorado Boulder (US)
Venue
23rd International Conference on Intelligent User Interfaces
Publisher
ACM
Published
2018-03-05
Pages
329-340
OpenAlex
W2790165607
Cited by
257
References
30
Citations by year
2026: 34 · 2025: 39 · 2024: 47 · 2023: 30 · 2022: 25 · 2021: 35 · 2020: 23 · 2019: 19 · 2018: 5
FWCI
8.37
Type
conference paper
Language
en
Open access
closed
Locations
ACM International Conference on Intelligent User Interfaces (IUI) (publishedVersion)
Funders
  • National Science Foundation Graduate Research Fellowship (DGE-1256082)
  • Defense Advanced Research Projects Agency (W911NF-15-1-0543)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence in Games
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
creative writing, natural language generation, short story writing, writing quality, user experience, AI-assisted writing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.