CoChat

Tool, tutor, or crutch?: A grounded theory of cognitive scaffolding and offloading in AI-assisted programming education

Open access
Liu, Dandan, Fan, Guangrui, Pan, Lihu · 2026 · International Journal of STEM Education

The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index; 29 of the 57 sources its claims cite were checked for support.

Abstract

Analysis revealed a core tension between students’ pursuit of “Domain Mastery” (conceptualization, explanation, and evaluation) and “Tool Mastery” (procedural efficiency with AI). We identified dynamic strategy switching (the Strategic Dance), Partnership Framing with an Illusion of Dialogue subtheme, and two recurrent evaluation challenges (Trust-but-Can't-Verify for novices; a Boilerplate Blindspot for more experienced students). We also describe attenuated meta-cognitive calibration–a miscalibration...

Overview

CoChat Summary

TL;DR

This constructivist grounded-theory study distinguishes Domain Mastery from Tool Mastery and proposes a tension model with Scaffolding and Offloading loops to explain how AI-assisted programming can improve performance while thinning germane processing and authorship. Across AI-enabled (N=24) and human pair-programming contrast (N=17) sections, it identifies Strategic Dance, Partnership Framing/Illusion of Dialogue, Trust-but-Can’t-Verify, Boilerplate Blindspot, and attenuated metacognitive calibration.

Key findings

  • The core tension is between Domain Mastery (conceptualization, explanation, evaluation) and Tool Mastery (procedural efficiency with AI), with two recurrent loops—Scaffolding and Offloading—and boundary conditions including time pressure, task complexity/element interactivity, prior familiarity, and scaffolding design/norms.
  • Students showed a Strategic Dance between Socratic Inquiry and Transactional Delegation: of 857 solution-seeking prompts, 75% (N=643) were Transactional Generation and 25% were Conceptual Inquiry; delegation typically increased within 24–36 h of deadlines, while novel APIs or multi-component tasks prompted renewed inquiry.
  • Evaluation was uneven: novices showed Trust-but-Can’t-Verify, more experienced students showed a Boilerplate Blindspot, and Partnership Framing included an Illusion-of-Dialogue subtheme when partnership language co-occurred with one-shot acceptances; the human pair-programming contrast described social verification through rapid questioning and shoulder-surf review.
  • Metacognitive outcomes included tool-linked self-efficacy and attenuated calibration: 14 of 24 AI users described pride in “prompt craft,” concept maps descriptively showed the human-pair contrast group with larger increases in cross-links and hierarchical organization, and some AI users expressed uncertainty about unassisted performance despite strong project grades.

Methods

  • Constructivist grounded theory (Charmaz) with constant comparison, conducted over a 16-week Fall 2024 semester in a required second-year undergraduate Java course at a public university in Shanxi, China; two naturally occurring sections: AI-enabled GitHub Copilot in IntelliJ (N=24) and human pair-programming theoretical contrast (N=17), total 41 students.
  • Data sources: IDE interaction logs (857 solution-seeking prompts; a stratified subset of 220 prompts coded for prompt type and verification intensity 0–2), pre-/post-course concept maps, and post-course 60-minute semi-structured dyadic interviews with stimulus recall; triangulation across data sources and analysts, supported by NVivo 14.
  • Analysis proceeded through initial/open coding, focused coding with constant comparison, and theoretical integration via memoing and diagramming; member checking involved six participants (three AI-enabled, three pair-programming), and the study makes no causal or efficacy claims.

Limitations

  • The paper states: sections differed in instructor/time/peer norms and were not constructed for controlled contrasts; the study covered a single 16-week semester at one Mandarin-language Chinese public university; concept maps are a narrow indicator; dyadic interviews can invite peer influence and social desirability; no individual follow-ups were conducted; interviews near exams confound anxiety with metacognitive accuracy; and the study claims theoretical sufficiency rather than universal saturation.
  • The paper also states alternative explanations: cross-section contrasts may reflect social verification affordances of collaboration rather than AI per se; concept mapping offers only one window on conceptual structure; partnership language can be metaphorical; and pre-assessment anxiety may partly explain reported uncertainty.
  • Evident from the text: the small qualitative sample and non-equivalent ecologies limit generalizability, the concept-map comparisons are descriptive rather than inferential, and the design cannot support causal claims.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s40594-025-00592-w

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

19 Valid · 1 Not valid · 17 Not checked · 153 Own results and interpretations

61 more claims · 8 with their cited sources checked

Create a free account to see all 190 claims and to verify the 1 reference still open.

See all claims — free account
  • Probably not a substantial claim. 74
  • It may state two separate claims as one. 78
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 36 references

Research works printed but not linked: 6

  1. Charmaz, K. (2014). Constructing grounded theory (2nd Ed). SAGE.
  2. Collins, A., Brown, J. S., Holum, A., et al. (1991). Cognitive apprenticeship: Making thinking visible. American Educator,15(3), 6–11.
  3. Leinwand, S., Brahier, D. J., Huinker, D., Berry, R. Q., Dillon, F. L., Larson, M. R., & Smith, M. S. (2014). Principles to actions: Ensuring mathematical success for all. National Council of Teachers of Mathematics: NCTM.
  4. Lincoln, Y. S., & Guba, E. G. (1988). Criteria for assessing naturalistic inquiries as reports. New Orleans, LA: Annual meeting of the american educational research association.
  5. Patton, M. Q. (2002). Qualitative research and evaluation methods (vol 3). Sage.
  6. Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (vol 86). Harvard University Press.

Cited by

See all 16

Metadata

Authors
Liu, D., Fan, G., & Pan, L.
Affiliations
  • University of Malaya (MY)
  • Taiyuan University of Science and Technology (CN)
Corresponding author
  • Liu, Dandan
  • Fan, Guangrui
  • Pan, Lihu
Venue
International Journal of STEM Education
Published
2026-03-13
Volume
13
Issue
1
ISSN
2196-7822 (ISSN-L)
OpenAlex
W7135212788
Cited by
16
References
27
Citations by year
2026: 16
FWCI
133.49
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of STEM Education (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Natural Science Foundation of Shanxi Province (No.202203021221145)
  • Shanxi Province Intelligent Software and Human Machine Environment System Postgraduate Joint Training Demonstration Base (No.2022JD11)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
cognitive scaffolding, offloading, AI-assisted programming, conceptual understanding, transfer of learning, pair programming, trust in AI, boilerplate code, self-determination theory, cognitive load theory, AI authorship, Java programming

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Tool, tutor, or crutch?: A grounded theory of cognitive scaffolding and offloading in AI-assisted programming education. https://app.cochat.ai/papers/10.1186/s40594-025-00592-w
The paper
Liu, D., Fan, G., & Pan, L. (2026). Tool, tutor, or crutch?: A grounded theory of cognitive scaffolding and offloading in AI-assisted programming education. International Journal of STEM Education. https://doi.org/10.1186/s40594-025-00592-w

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.