Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index; 4 of the 19 sources its claims cite were checked for support.

Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning

Open access

Abstract

As generative AI becomes ubiquitous, writers must decide if, when, and how to incorporate generative AI into their writing process. Educators must sort through their role in preparing students to make these decisions in a quickly evolving technological landscape. We created an AI-enabled writing tool that provides scaffolded use of a large language model as part of a research study on integrating generative AI into an upper division STEM writing-intensive course. Drawing on decades of research on integrating digital tools into instruction and writing research, we discuss the framework that drove our initial design considerations and instructional resources. We then share our findings from a year of design-based implementation research during the 2023–2024 academic year. Our original instruction framework identified the need for students to understand, access, prompt, corroborate, and incorporate the generative AI use effectively. In this paper, we explain the need for students to think first, before using AI, move through good enough prompting to agentic iterative prompting, and reflect on their use at the end. We also provide emerging best practices for instructors, beginning with identifying learning objectives, determining the appropriate AI role, revising the content, reflecting on the revised curriculum, and reintroducing learning as needed. We end with an indication of our future directions.

Overview

CoChat Summary

TL;DR

This paper reports first-year design-based implementation research integrating a scaffolded LLM writing tool, PapyrusAI, into an upper-division engineering writing-intensive course. It identifies emerging student practices—iterative prompting, corroboration, thinking first, and reflection—and instructor practices for infusing AI while keeping learning objectives central.

Key findings

  • For students, the most promising uses involved prompting iteratively from a “good enough” prompt, “talking back” to interrogate AI output, corroborating accuracy, thinking first before using AI, and reflecting on AI use; one-and-done prompting “leads to little if any learning.”
  • For instructors, emerging practices included identifying student learning objectives, using backward design, determining the appropriate AI role, revising or reducing content to make time, reflecting on the revised curriculum, and reintroducing learning as needed; AI should not overtake course goals.
  • Implementation occurred in Engineering 190W at UC Irvine during the 2023–2024 academic year across 3 quarters: Fall 2023 used ChatGPT’s free version, Winter 2024 piloted the MVP with GPT-4.0, and Spring 2024 added 3 instructors, each teaching at least two sections of approximately 20 students; the course requires 4,000 words or more of finished work.
  • Concerns emerged that weaker writers may benefit less: one instructor said “poor writers [are] poor writers with prompts,” and the team noted the risk of the “Matthew Effect” widening achievement gaps; one instructor reported about 50% of students thought the tool was useful after brainstorming with it once.

Methods

  • Design-based implementation research during the 2023–2024 academic year in an upper-division STEM writing-intensive course, using qualitative methods borrowed from phenomenological and design-based practices.
  • Data included class observations, instructor interviews, student focus interviews, student writing artifacts, instructional artifacts, and student surveys; participants included the lead instructor across 3 quarters and, in Spring 2024, 3 additional instructors teaching at least two sections of approximately 20 students each.
  • Analysis used flexible coding, memo-writing, coding by the first author with checks from the second and fourth authors, participant checks with the instructional team, and searches for disconfirming evidence.

Limitations

  • Stated: the study is limited to a single institution and single course, so it is not generalizable to other institutions, different student demographics, or different content areas; instructors had taught the course for multiple years, and new teachers would face additional burdens; the article focuses on the instructor side, with student voices planned for future work.
  • Evident: the qualitative design and small instructor sample limit broad claims; the paper reports no student writing-quality outcomes, and the authors note that bias-interrogation materials were underdeveloped and that it remains unclear whether the tool’s friction is productive effort or unnecessary friction.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s10791-025-09563-9

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 3 Not valid · 11 Not checked · 75 Own results and interpretations

15 more claims

Create a free account to see all 93 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 31
  • Probably not a substantial claim. 59

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 63 references

Research works printed but not linked: 1

  1. Weisz, Justin D., Jessica He, Michael Muller, Gabriela Hoefer, Rachel Miles, and Werner Geyer. “Design Principles for Generative AI Applications.” In Proceedings of the CHI Conference on Human Factors in Computing Systems, 1–22. Honolulu HI USA: ACM, 2024. https://doi.org/10.1145/3613904.3642466. · DOI · Paper page

Cited by

See all 14

Metadata

Authors
Tate, T. P., Harnick-Shapiro, B., Ritchie, D. R., Tseng, W., Dennin, M., & Warschauer, M.
Affiliations
University of California, Irvine (US)
Corresponding author
Tate, Tamara P.
Venue
Discover Computing
Published
2025-05-08
Volume
28
Issue
1
ISSN
2948-2992 (ISSN-L)
OpenAlex
W4410189969
Cited by
14
References
63
Citations by year
2026: 9 · 2025: 5
FWCI
14.56
Type
journal article
Language
en
Open access
Licence
Locations
  • Discover Computing (publishedVersion, cc-by)
  • eScholarship (California Digital Library) (submittedVersion, cc-by-nc)
Funders
National Science Foundation (23152984)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Educational Technology in Learning
Keywords
generative AI, large language models, writing-intensive courses, scaffolding, prompting, iterative prompting, student reflection, instructor role, curriculum development, writing process

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning. https://app.cochat.ai/papers/10.1007/s10791-025-09563-9
The paper
Tate, T. P., Harnick-Shapiro, B., Ritchie, D. R., Tseng, W., Dennin, M., & Warschauer, M. (2025). Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning. Discover Computing. https://doi.org/10.1007/s10791-025-09563-9

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.