Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its DataCite record; 61 of the 61 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.

Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing

Open access

Abstract

The integration of Generative AI (GenAI) into education is reshaping how students learn, making self-regulated learning (SRL) - the ability to plan, monitor, and adapt one's learning - more important than ever. To support learners in these new contexts, it is essential to understand how SRL unfolds during interaction with GenAI tools. Learning analytics offers powerful techniques for analyzing digital trace data to infer SRL behaviors. However, existing approaches often assume SRL processes are linear, segmented, and non-overlapping-assumptions that overlook the dynamic, recursive, and non-linear nature of real-world learning. We address this by conceptualizing SRL as a layered system: observable learning patterns reflect hidden tactics (short, purposeful action states), which combine into broader SRL strategies. Using Hidden Markov Models (HMMs), we analyzed trace data from higher education students engaged in GenAI-assisted academic writing. We identified three distinct groups of learners, each characterized by different SRL strategies. These groups showed significant differences in performance, indicating that students' use of different SRL strategies in GenAI-assisted writing led to varying task outcomes. Our findings advance the methodological toolkit for modeling SRL and inform the design of adaptive learning technologies that more effectively support learners in GenAI-enhanced educational environments.

Overview

CoChat Summary

TL;DR

This study models self-regulated learning (SRL) in GenAI-assisted academic writing by inserting hidden tactics as latent states between SRL processes and strategies using Hidden Markov Models. It identifies nine hidden tactics and three SRL strategy groups, with the GenAI-Integrated Writers showing significantly higher essay scores than the other groups.

Key findings

  • HMM analysis identified nine hidden tactics behind SRL processes; some tactics were tied to a single SRL process, while others captured multiple intertwined processes (e.g., Hidden Tactic 9 mixed HECO, LCR, MCE, and MCM).
  • Clustering hidden tactic sequences yielded three SRL strategy groups: Conventional Strategic Writers (n = 89), GenAI-Integrated Writers (n = 16), and Intensive Material Reviewers (n = 34).
  • GenAI-Integrated Writers had significantly higher essay scores than Conventional Strategic Writers (M = 18.438, SD = 2.549 vs. M = 16.674, SD = 3.637; Mann-Whitney U = 481.5, p = 0.039, r = 0.324) and Intensive Material Reviewers (M = 15.735, SD = 4.082; U = 402.0, p = 0.006, r = 0.478); Cluster 3 vs. Cluster 1 was not significant (U = 1726.5, p = 0.226, r = 0.141).
  • The benchmark method without hidden tactics found four clusters and no significant differences in task performance among them; similarity to the proposed method was Homogeneity = 0.685, Completeness = 0.527, V-Measure = 0.596.

Methods

  • Data came from 241 higher education students in an English academic writing course at a Chinese university (55% male, mean age = 22.40, SD = 1.01; non-native English speakers; over 86% had prior ChatGPT experience), using the FLoRA system with a ChatGPT 4.0 interface; after keeping only ChatGPT users and removing outliers, the final sample was 139 students.
  • Trace events were mapped to 17 learning actions, then to seven SRL processes plus a CHATGPT label; HMM was applied to SRL process sequences, with AIC/BIC/LL selecting nine hidden states, and hidden tactic sequences were clustered using Levenshtein distance, radial basis function transformation, and K-means, with the Elbow method selecting three clusters (silhouette ≈ 0.55).
  • For performance comparisons, a Shapiro-Wilk test showed non-normal essay scores (W = 0.914, p = 2.298e-07), so Mann-Whitney U tests were used; the benchmark used the same pipeline without hidden tactics.

Limitations

  • Stated by the authors: the analysis used only one writing dataset, limiting generalization; all GenAI interactions were broadly labeled “CHATGPT” without capturing diverse prompting, interpretation, or incorporation of AI suggestions; and no think-aloud data were collected to support criterion-related validity.
  • Evident in the text: the final analysis was restricted to 139 students who used ChatGPT and passed outlier filtering, so findings may not generalize to non-GenAI users or the full 241-student sample; the study also relies on a single task and course context.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2508.10310

Cites

61 of 61 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 1 Not valid · 7 Not checked · 86 Own results and interpretations

60 more claims

Create a free account to see all 94 claims and to verify the 8 references still open.

See all claims — free account
  • It may state two separate claims as one. 23
  • The quote only partly states this claim. 2
  • Probably not a substantial claim. 5

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 61 references

Research works printed but not linked: 4

  1. Azevedo, R., Aleven, V. et al. (2013) International handbook of metacognition and learning technologies, vol. 26. Springer.
  2. Bholowalia, P. and Kumar, A. (2014) Ebk-means: A clustering technique based on elbow method and k-means in wsn. Inter- national Journal of Computer Applications, 105.
  3. Shibani, A., Rajalakshmi, R., Mattins, F., Selvaraj, S. and Knight, S. (2023) Visual representation of co-authorship with GPT-3: Studying human-machine interaction for effective writing. In Proceedings of the 16th International Conference on Educational Data Mining, 183-193.
  4. Yang, K., Cheng, Y., Zhao, L., Raković, M., Swiecki, Z., Gašević, D. and Chen, G. (2024) Ink and algorithm: Exploring temporal dynamics in human-ai collaborative writing. arXiv preprint arXiv:2406.14885. · arXiv

Cited by

See all 8

Metadata

Authors
Yang, K., Fan, Y., Tang, L., Raković, M., Li, X., Gašević, D., & Chen, G.
Affiliations
  • Monash University (AU)
  • Peking University (CN)
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
OpenAlex
W6910555254
Cited by
8
References
61
Citations by year
2026: 6 · 2025: 2
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
student self-regulation, hidden Markov models, learning analytics, digital traces, university students, academic writing, adaptive learning systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing. https://app.cochat.ai/papers/10.48550/arxiv.2508.10310
The paper
Yang, K., Fan, Y., Tang, L., Raković, M., Li, X., Gašević, D., & Chen, G. (2025). Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing. arXiv. https://doi.org/10.48550/arxiv.2508.10310

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.