CoChat

Using rhetorical strategies to design prompts: a human-in-the-loop approach to make AI useful

Open access
Ranade, Nupoor, Saravia, Marly, Johri, Aditya · 2025 · AI & SOCIETY

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Abstract

The growing capabilities of artificial intelligence (AI) word processing models have demonstrated exceptional potential to impact language related tasks and functions. Their fast pace of adoption and probable effect has also given rise to controversy within certain fields. Models, such as GPT-3, are a particular concern for professionals engaged in writing, particularly as their engagement with these technologies is limited due to lack of ability to control their output. Most efforts to maximize and control output rely on a process known as prompt engineering, the construction and modification of the inputted prompt with expectation for certain outputted or desired text. Consequently, prompt engineering has emerged as an important consideration for research and practice. Previous conceptions of prompt engineering have largely focused on technical and logistic modifications to the back-end processing, remaining inaccessible and, still, limited for most users. In this paper, we look to the technical communication field and its methods of text generation—the rhetorical situation—to conceptualize prompt engineering in a more comprehensible way for its users by considering the context and rhetoric. We introduce a framework, consisting of a formula, to prompt engineering, which demands all components of the rhetorical situation be present in the inputted prompt. We present discussions on the future of AI writing models and their use in both professional and educational settings. Ultimately, this discussion and its findings aim to provide a means of integrating agency and writer-centric methods to AI writing tools to advance a more human-in-the-loop approach. As the use of generative AI and especially NLP-based technologies become common across societal functions, the use of prompt engineering will play a crucial role not just in adoption of the technology, but also its productive and responsible use.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00146-024-01905-3

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Figures

Image 1
CC-BY · From the PDF
Fig. 2 The rhetorical situation
Fig. 2 The rhetorical situationCC-BY · From the PDF
Image 3
CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 10

  1. Biesecker BA (1989) Rethinking the rhetorical situation from within the thematic of ‘différance.’ Philos Rhetor 22:110–130
  2. Bitzer LF (1968) The rhetorical situation. Philos Rhetor 1:1–14
  3. Dhuri U, Jain N (2020) Teaching assessment tool: using AI and secure techniques. Int J Educ Manage Eng 6(08):12–21
  4. Li C, Zhang M, He Y (2022) The stability-efficiency dilemma: investigating sequence length warmup for training GPT models. Adv Neural Inf Process Syst 35:26736–26750
  5. Liu Q, Kusner MJ, Blunsom P (2020) A survey on contextual embeddings. Preprint at arXiv:2003.07278 · arXiv
  6. Liu P, Yuan W, Fu J, Jiang Z, Hayashi H, Neubig G (2021) Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing. Preprint at http://arxiv.org/abs/2107.13586 · arXiv
  7. Marcus G, Davis E (2020) GPT-3, Bloviator: OpenAI’s language generator has no idea what it’s talking about. Technology Review
  8. Smith TS (2008) What connection does rhetorical theory have to technical and professional communication? In: MacLennan J (ed) Readings for technical communication. Oxford University Press Canada, Don Mills, ON, Canada, pp 114–120
  9. Vatz RE (1973) The myth of the rhetorical situation. Philos Rhetor 6:154–161
  10. Zhao Z, Wallace E, Feng S, Klein D, Singh S (2021, July) Calibrate before use: improving few-shot performance of language models. In: International conference on machine learning, pp 12697–12706 PMLR

Cited by

See all 91

Metadata

Authors
Ranade, N., Saravia, M., & Johri, A.
Affiliations
George Mason University (US)
Corresponding author
Ranade, Nupoor
Venue
AI & SOCIETY
Published
2024-04-01
Volume
40
Issue
2
Pages
711-732
ISSN
  • 0951-5666 (ISSN-L)
  • 1435-5655
OpenAlex
W4393381464
Cited by
53
References
22
Citations by year
2026: 31 · 2025: 18 · 2024: 4
FWCI
7.85
Type
journal article
Language
en
Open access
Licence
Locations
AI & Society (publishedVersion, cc-by)
Funders
  • National Science Foundation (204863, 1937950, 1939105)
  • Office of the Provost and Executive Vice President, George Mason University
  • National Institute of Food and Agriculture (2021-67021-35329)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
prompt engineering, rhetorical situation, human-in-the-loop, generative AI, AI writing tools, technical communication, GPT-3, writer agency, responsible AI use

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.