The DOI matches its DataCite record; 61 of the 61 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.
Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing
Open accessAbstract
The integration of Generative AI (GenAI) into education is reshaping how students learn, making self-regulated learning (SRL) - the ability to plan, monitor, and adapt one's learning - more important than ever. To support learners in these new contexts, it is essential to understand how SRL unfolds during interaction with GenAI tools. Learning analytics offers powerful techniques for analyzing digital trace data to infer SRL behaviors. However, existing approaches often assume SRL processes are linear, segmented, and non-overlapping-assumptions that overlook the dynamic, recursive, and non-linear nature of real-world learning. We address this by conceptualizing SRL as a layered system: observable learning patterns reflect hidden tactics (short, purposeful action states), which combine into broader SRL strategies. Using Hidden Markov Models (HMMs), we analyzed trace data from higher education students engaged in GenAI-assisted academic writing. We identified three distinct groups of learners, each characterized by different SRL strategies. These groups showed significant differences in performance, indicating that students' use of different SRL strategies in GenAI-assisted writing led to varying task outcomes. Our findings advance the methodological toolkit for modeling SRL and inform the design of adaptive learning technologies that more effectively support learners in GenAI-enhanced educational environments.
Overview
CoChat Summary
TL;DR
This study models self-regulated learning (SRL) in GenAI-assisted academic writing by inserting hidden tactics as latent states between SRL processes and strategies using Hidden Markov Models. It identifies nine hidden tactics and three SRL strategy groups, with the GenAI-Integrated Writers showing significantly higher essay scores than the other groups.
Key findings
- HMM analysis identified nine hidden tactics behind SRL processes; some tactics were tied to a single SRL process, while others captured multiple intertwined processes (e.g., Hidden Tactic 9 mixed HECO, LCR, MCE, and MCM).
- Clustering hidden tactic sequences yielded three SRL strategy groups: Conventional Strategic Writers (n = 89), GenAI-Integrated Writers (n = 16), and Intensive Material Reviewers (n = 34).
- GenAI-Integrated Writers had significantly higher essay scores than Conventional Strategic Writers (M = 18.438, SD = 2.549 vs. M = 16.674, SD = 3.637; Mann-Whitney U = 481.5, p = 0.039, r = 0.324) and Intensive Material Reviewers (M = 15.735, SD = 4.082; U = 402.0, p = 0.006, r = 0.478); Cluster 3 vs. Cluster 1 was not significant (U = 1726.5, p = 0.226, r = 0.141).
- The benchmark method without hidden tactics found four clusters and no significant differences in task performance among them; similarity to the proposed method was Homogeneity = 0.685, Completeness = 0.527, V-Measure = 0.596.
Methods
- Data came from 241 higher education students in an English academic writing course at a Chinese university (55% male, mean age = 22.40, SD = 1.01; non-native English speakers; over 86% had prior ChatGPT experience), using the FLoRA system with a ChatGPT 4.0 interface; after keeping only ChatGPT users and removing outliers, the final sample was 139 students.
- Trace events were mapped to 17 learning actions, then to seven SRL processes plus a CHATGPT label; HMM was applied to SRL process sequences, with AIC/BIC/LL selecting nine hidden states, and hidden tactic sequences were clustered using Levenshtein distance, radial basis function transformation, and K-means, with the Elbow method selecting three clusters (silhouette ≈ 0.55).
- For performance comparisons, a Shapiro-Wilk test showed non-normal essay scores (W = 0.914, p = 2.298e-07), so Mann-Whitney U tests were used; the benchmark used the same pipeline without hidden tactics.
Limitations
- Stated by the authors: the analysis used only one writing dataset, limiting generalization; all GenAI interactions were broadly labeled “CHATGPT” without capturing diverse prompting, interpretation, or incorporation of AI suggestions; and no think-aloud data were collected to support criterion-related validity.
- Evident in the text: the final analysis was restricted to 139 students who used ChatGPT and passed outlier filtering, so findings may not generalize to non-GenAI users or the full 241-student sample; the study also relies on a single task and course context.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 1 Not valid · 7 Not checked · 86 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“others (i.e., hidden tactics 1, 4, 5, 8, and 9) captured multiple intertwined SRL processes.”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 4.1 | Results on RQ1
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In response to RQ1, we identified nine distinct hidden tactics within the dataset.”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 5 | DISCUSSION AND CONCLUSIONS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For instance, Hidden Tactic 9 is characterized by a blend of SRL processes, including HECO, LCR, MCE, and MCM.”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 5 | DISCUSSION AND CONCLUSIONS
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Figure 3, the AIC and BIC values were lowest, while the LL was highest when the number of hidden states was nine, indicating that the optimal number of SRL hidden tactics was nine.”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 3.2.6 | Benchmark
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we found that while some tactics were solely related to a single primary SRL process (i.e., hidden tactics 2, 3, 6, and 7)”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 4.1 | Results on RQ1
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
60 more claims
Create a free account to see all 94 claims and to verify the 8 references still open.
- It may state two separate claims as one. 23
- The quote only partly states this claim. 2
- Probably not a substantial claim. 5
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 3.2.1 | SRL process labeling
“Evaluation MCE Monitoring and checking the reading and writing process; checking of progress according to instruction or plan.”
§ Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing > 3.2.1 | SRL process labeling
“Monitoring MCM Evaluation of the learning process; checking of content-wise correctness (e.g., the essay content) of learning activities.”
Citations
Cites
The Intraclass Correlation Coefficient as a Measure of Reliability
Bartko, J. J. (1966) · Psychological Reports · doi:10.2466/pr0.1966.19.1.3 · Cited by 2,299
Handbook of Self-Regulation of Learning and Performance
Schunk, D. H. (2011) · Routledge eBooks · doi:10.4324/9780203839010 · Cited by 2,122
Metacognition in Educational Theory and Practice
(1998) · Routledge eBooks · doi:10.4324/9781410602350 · Cited by 2,119
Studying as Self-Regulated Learning
(1998) · Metacognition in Educational Theory and Practice · doi:10.4324/9781410602350-19 · Cited by 1,589
V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure
Rosenberg, A., & Hirschberg, J. (2007) · Cited by 1,322
Theories of Self-Regulated Learning and Academic Achievement: An Overview and Analysis
Zimmerman, B. J. (2013) · doi:10.4324/9781410601032-5 · Cited by 1,143
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Self-citationDent, A. L., & Koenka, A. C. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9320-8 · Cited by 802
Ephraim, Y., & Merhav, N. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.1003838 · Cited by 798
Promises and challenges of generative artificial intelligence for human learning
Yan, L., Greiff, S., Teuber, Z., & Gašević, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02004-5 · Cited by 499
Self-citation
Research works printed but not linked: 4
- Azevedo, R., Aleven, V. et al. (2013) International handbook of metacognition and learning technologies, vol. 26. Springer.
- Bholowalia, P. and Kumar, A. (2014) Ebk-means: A clustering technique based on elbow method and k-means in wsn. Inter- national Journal of Computer Applications, 105.
- Shibani, A., Rajalakshmi, R., Mattins, F., Selvaraj, S. and Knight, S. (2023) Visual representation of co-authorship with GPT-3: Studying human-machine interaction for effective writing. In Proceedings of the 16th International Conference on Educational Data Mining, 183-193.
- Yang, K., Cheng, Y., Zhao, L., Raković, M., Swiecki, Z., Gašević, D. and Chen, G. (2024) Ink and algorithm: Exploring temporal dynamics in human-ai collaborative writing. arXiv preprint arXiv:2406.14885. · arXiv
Cited by
Assessing students’ DRIVE: A framework to evaluate learning through interactions with generative AI
Oliveira, M., Zednik, C., Bombaerts, G. J. T., Sadowski, B. M., & Conijn, R. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100497 · Cited by 46
Jin, H., Yoo, M., Han, J., Chen, Z., Ahn, S.-Y., & Wang, X. (2026) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3774398.3811612 · Cited by 6
Zhidkikh, D., Isomöttönen, V., & Taipalus, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.09178 · Cited by 3
GenAI Analytics and Pedagogical Configurations: Featuring New Generative AI Systems in Education
Ortega-Arranz, A., Topali, P., García-Zarza, P., Bote-Lorenzo, M. L., Asensio-Pérez, J. I., & Molenaar, I. (2026) · Proceedings of the LAK26: 16th International Learning Analytics and Knowledge Conference · doi:10.1145/3785022.3785054 · Cited by 2
Artificial Intelligence in Formative and Shared Assessment in Higher Education
Herguedas, J. L. A., Soria, M. M., Fuentes, T., & Pastor, V. M. L. (2026) · Encyclopedia · doi:10.3390/encyclopedia6070158 · Cited by 1
Metadata
- Authors
- Yang, K., Fan, Y., Tang, L., Raković, M., Li, X., Gašević, D., & Chen, G.
- Affiliations
- Monash University (AU)
- Peking University (CN)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2508.10310
- OpenAlex
- W6910555254
- Cited by
- 8
- References
- 61
- Citations by year
- 2026: 6 · 2025: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- student self-regulation, hidden Markov models, learning analytics, digital traces, university students, academic writing, adaptive learning systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing. https://app.cochat.ai/papers/10.48550/arxiv.2508.10310
- The paper
- Yang, K., Fan, Y., Tang, L., Raković, M., Li, X., Gašević, D., & Chen, G. (2025). Beyond Self-Regulated Learning Processes: Unveiling Hidden Tactics in Generative AI-Assisted Writing. arXiv. https://doi.org/10.48550/arxiv.2508.10310
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.