Ink and algorithm: Exploring temporal dynamics in generative AI ‐assisted writing
Open accessAbstract
The advent of Generative AI (GAI) has transformed writing, marking a shift towards GAI‐assisted writing in education. However, the dynamics of human–AI interaction in the writing process are not well‐understood, and thus, it remains largely unknown how human learning can be effectively supported with such technologies. This study addresses this gap by investigating how humans employ GAI during writing and examining the interplay between patterns of GAI usage and writing behaviours. To capture these patterns, we applied Dynamic Time Warping time‐series clustering to identify temporal trajectories of GAI use and employed Epistemic Network Analysis to examine how these trajectories relate to cognitive processes such as knowledge telling, knowledge transformation and cognitive presence. Our analysis revealed four distinct temporal patterns of GAI usage (ie, AI‐critical writers, AI‐dependent writers, AI‐independent writers and AI‐balanced writers), each associated with different cognitive engagement strategies. The findings suggest that some writers tend to rely excessively on GAI, which may limit opportunities for meaningful learning by reinforcing surface‐level strategies such as knowledge telling. These insights highlight the need for researchers and educators to design GAI‐based writing assistants that are sensitive to students' temporal dynamics and can scaffold more productive cognitive engagement. Practitioner notes What is already known about this topic Researchers and educators can gain practical insights into achieving intelligence augmentation through critical engagement by studying effective user behaviours for enhanced human–AI partnership in writing. Generative AI‐assisted writing can be evaluated using an evidence‐centred assessment framework, which relates to writing cognitive processes. Current studies on Generative AI‐assisted writing usually classify writers according to their overall AI usage behaviours throughout the entire writing session. What this paper adds We propose using time‐series clustering to identify and analyse common temporal patterns in AI usage during generative AI‐assisted writing processes. We uncover the correlation between temporal patterns in AI usage and human writing behaviours, which reflect cognitive processes, through Epistemic Network Analysis. We identify four major distinct temporal patterns in AI utilization and highlight that each pattern is correlated with different cognitive processes. Implications for practice and/or policy Researchers and educators should be aware of the risks associated with students overly relying on GAI for writing tasks, as this dependency can hinder opportunities for meaningful learning. Researchers and educators should carefully consider the types of suggestions provided by GAI‐based writing tools when integrating them into educational contexts.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
12 of 47 cited sources checked · 8 supported · 1 flagged · accuracy not yet measured
- Interpretationcitation
Previous studies revealed limited insight into writers' writing behaviours and corresponding cognitive processes, offering limited implications for supporting human learning in GAI-assisted writing.
“(ii) they revealed limited insight into writers' writing behaviours and the corresponding cognitive processes and thus offered limited implications for supporting human learning in this particular task (studies by Nguyen et al., 2024;Shibani et al., 2023;Wambsganss et al., 2023).”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Nguyen et al., 2024 source
The Discussion identifies distinct writing behaviours and cognitive and metacognitive skills, then explicitly says these findings can inform targeted pedagogical interventions. The Conclusions and final remarks call the understanding preliminary and recommend deeper study of cognitive processes, but that qualification does not support the claim that the study offered limited insight into behaviours and limited implications for learning support. The indexed passages have no page numbers. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured - cites Shibani et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Wambsganss et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationcitation
Previous studies on GAI-assisted writing often categorize writers based on overall AI usage throughout the entire writing session, overlooking temporal dynamics.
“However, these existing studies often have two primary shortcomings: (i) They generally categorized writers based on their overall AI usage throughout the entire writing session, overlooking the temporal dynamics of these behaviours as the progression of a writing session (studies by Cheng et al., 2024;Shibani et al., 2023;Wambsganss et al., 2023;Yang et al., 2025);”
Quote in the paperSubstantial claim2 of 3 sources checked- cites Cheng et al., 2024 source
- cites Shibani et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Yang et al., 2025 source
Section 3.2 (p. 6) classifies writers in this study by the overall frequency of AI-assisted behavior patterns, supporting that part of the claim. But Section 2.2 (p. 5) describes an earlier study that used time-series clustering, so this paper does not support treating the neglect of temporal dynamics as a general shortcoming of previous studies. (LLM, conf=0.83)
Experimental — accuracy not yet measured
- Findingown data
Some writers often accept GAI-generated text with minimal modification before incorporating it into their work.
“Our study shows that some writers often accept GAI-generated text with minimal modification before incorporating it into their work.”
Quote in the paperSubstantial claim - Findingown data
Cluster 3 was characterized by the weakest connection between compose and seekSugg among all clusters.
“Cluster 3 was characterized by the weakest connection between compose and seek-Sugg among all clusters, suggesting that writers in this group were less inclined to frequently seek input from GAI during the writing process.”
Quote in the paperNot a substantial claim - Findingown data
Cluster 1 writers exhibited the highest rate of modification among all clusters, adjusting about 46% of accepted suggestions.
“Instead, they exhibited the highest rate of modification among all clusters-adjusting nearly half of the suggestions they accepted (about 46%).”
Quote in the paperNot a substantial claim
- Findingown data
Different types of writers exhibited distinct writing behaviours reflective of various cognitive processes.
“We then applied ENA to each cluster and conducted comparative analyses, revealing that different types of writers exhibited distinct writing behaviours reflective of various cognitive processes.”
Quote in the paperSubstantial claim - Findingown data
Only a weak presence of the Knowledge Transformation strategy was observed among AI-balanced writers (Cluster 4).
“Only a weak presence of the Knowledge Transformation strategy was observed among AI-balanced writers (Cluster 4).”
Quote in the paperSubstantial claim - Findingown data
Cluster 1 writers displayed a distinctive pattern of engagement with GAI, marked by measured use and selective incorporation of suggestions.
“Writers in this group displayed a distinctive pattern of engagement with GAI, marked by measured use and selective incorporation of suggestions.”
Quote in the paperSubstantial claim - Findingown data
Cluster 3 had the second-highest rate of modification.
“At the same time, they had the second-highest rate of modification, indicating that even when they did incorporate AI suggestions, they often altered them significantly before inclusion.”
Quote in the paperNot a substantial claim - Findingown data
Our clustering results show significant differences in 22 out of 24 AI-usage features.
“Our clustering results show significant differences in 22 out of 24 AI-usage features, demonstrating the validity of our approach in distinguishing AI usage patterns.”
Quote in the paperSubstantial claim - Findingown data
When compared to Cluster 2, Cluster 4 also showed stronger connections between reviseSugg and both lowModification and HighModification.
“When compared to Cluster 2, Cluster 4 also showed stronger connections between reviseSugg and both lowModification and HighModification, indicating a greater tendency to modify GAI suggestions rather than accept them unchanged.”
Quote in the paperNot a substantial claim - Findingown data
The ideal number of clusters is 4.
“Our results in Figure 2 show that the ideal number of clusters is 4.”
Quote in the paperSubstantial claim - Findingown data
Using DTW time-series clustering, we identified four distinct clusters of writers: AI-critical, AI-dependent, AI-independent and AI-balanced writers.
“Using DTW time-series clustering, we identified four distinct clusters of writers: AI-critical, AI-dependent, AI-independent and AI-balanced writers.”
Quote in the paperSubstantial claim - Findingown data
Our findings indicate that most writers adopt the Knowledge Telling strategy, meaning they make only minor modifications or no modifications at all to AI-generated texts.
“Our findings indicate that most writers adopt the Knowledge Telling strategy, meaning they make only minor modifications or no modifications at all to AI-generated texts.”
Quote in the paperSubstantial claim - Findingown data
Only limited evidence of Cognitive Presence-Resolution was found within Cluster 4.
“Similarly, only limited evidence of Cognitive Presence-Resolution was found within this group.”
Quote in the paperSubstantial claim - Findingown data
Cluster 3 writers demonstrated a dynamic but ultimately restrained pattern of interaction with GAI.
“Writers in this cluster demonstrated a dynamic but ultimately restrained pattern of interaction with GAI throughout their writing process.”
Quote in the paperNot a substantial claim - Findingown data
Cluster 2 writers requested GAI suggestions more than any other group, averaging over 18 requests per draft.
“The data show that these writers requested GAI suggestions more than any other group, averaging over 18 requests per draft.”
Quote in the paperNot a substantial claim - Findingown data
The clustering achieved an ARI of 0.56 through bootstrapping.
“The clustering achieved an ARI of 0.56 through bootstrapping, indicating a moderate level of agreement in the clustering results.”
Quote in the paperSubstantial claim - Findingown data
Cluster 2 stood out with the strongest connections among compose, seekSugg and acceptSugg, more so than any other cluster.
“Cluster 2 stood out with the strongest connections among compose, seekSugg and ac-ceptSugg, more so than any other cluster.”
Quote in the paperSubstantial claim - Findingown data
Cluster 2 writers demonstrated a steady pattern of interaction with GAI across all stages.
“Writers in this cluster demonstrated a steady pattern of interaction with GAI across all stages of their writing process.”
Quote in the paperNot a substantial claim - Findingown data
Our results demonstrated that AI-critical writers, AI-dependent writers and AI-balanced writers predominantly adopt the Knowledge Telling strategy.
“Our results demonstrated that AI-critical writers, AI-dependent writers and AI-balanced writers predominantly adopt the Knowledge Telling strategy.”
Quote in the paperSubstantial claim - Premisereasoning
GAI-powered writing assistants have introduced new writing behaviours, such as requesting, accepting, and rejecting AI suggestions, which were not present in traditional human-only writing scenarios.
“Moreover, these GAI-powered writing assistants have introduced new writing behaviours, such as the frequency of requesting suggestions from AI, accepting these suggestions and rejecting them, which were not present in traditional human-only writing scenarios.”
Quote in the paperSubstantial claim - Premisecitation
The advent of GAI-assisted writing is altering conventional cognitive processes in writing, as AI assumes part of the cognitive burden.
“Nevertheless, the advent of GAI-assisted writing is altering the conventional cognitive processes in writing, as AI assumes part of the cognitive burden (Knowles, 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Knowles, 2022 source
- Premisecitation
Dynamic Time Warping (DTW) is capable of assessing the similarity between two action sequences irrespective of their length disparities.
“we opted for Dynamic Time Warping (DTW) (Müller, 2007), a method capable of assessing the similarity between two action sequences irrespective of their length disparities.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Müller, 2007
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Writing behaviours derived from keystroke data provide meaningful insights into a writer's cognitive activities, offering a foundational basis for inferring cognitive processes through keystroke dynamics.
“Writing behaviours derived from keystroke data have been empirically and theoretically shown in previous studies to provide meaningful insights into a writer's cognitive activities, offering a foundational basis for inferring cognitive processes through keystroke dynamics.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Conijn et al., 2019 source
- cites Zhang et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductreasoning
Findings derived from the CoAuthor dataset may not be directly applicable to other writing contexts that involve different subjects or requirements.
“Second, our findings are derived from the CoAuthor dataset and may not be directly applicable to other writing contexts that involve different subjects or requirements.”
Quote in the paperNot a substantial claim - Interpretationown data
As a result, biases embedded within AI-generated content are likely integrated into their written outputs.
“As a result, biases embedded within AI-generated content are likely integrated into their written outputs.”
Quote in the paperSubstantial claim - Interpretationown data
Cluster 1 patterns suggest a careful, perhaps critical, approach to integrating GAI output.
“These patterns suggest a careful, perhaps even critical, approach to integrating GAI output.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Identified human-AI interactive writing patterns align closely with established human-only collaborative writing approaches as described by Heinonen et al. (2020).
“Nevertheless, our results indicate that identified human-AI interactive writing patterns align closely with established human-only collaborative writing approaches as described by Heinonen et al. (2020).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Heinonen et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductnone given
CoAuthor provides a limited range of interactions with GAI, such as not permitting GAI to modify human-written content, which confines the ability to identify even more diverse patterns.
“First, CoAuthor provides a limited range of interactions with GAI, such as not permitting GAI to modify human-written content, which confines our ability to identify even more diverse patterns.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Cluster 3 self-reports suggest a lower level of perceived usefulness or effectiveness of GAI in supporting their writing.
“These self-reports suggest a lower level of perceived usefulness or effectiveness of GAI in supporting their writing.”
Quote in the paperNot a substantial claim - Interpretationown data
Cluster 4 engaged in a balanced mode of writing: integrating AI assistance in the early stages while preserving room for independent authorship.
“Taken together, the behavioural and survey data position Cluster 4 as engaging in a balanced mode of writing: one that integrates AI assistance in the early stages, while preserving room for independent authorship as the piece evolves.”
Quote in the paperSubstantial claim - Interpretationreasoning
Cluster 3 exhibited minimal and highly selective integration of AI-generated content, reflecting a tendency to lean more heavily on self-authored text.
“Overall, this group exhibited minimal and highly selective integration of AI-generated content, which reflects their tendency to lean more heavily on self-authored text.”
Quote in the paperNot a substantial claim - Interpretationown data
These findings raise concerns about whether writing with GAI may reduce opportunities for meaningful learning.
“These findings raise concerns about whether writing with GAI may reduce opportunities for meaningful learning, especially considering that traditional writing research emphasizes the importance of review and revision in improving writing quality and fostering deep learning (Stellmack et al., 2012).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Stellmack et al., 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
Cluster 3 writers were more likely to explore suggestions without incorporating them (Cognitive Presence-Exploration).
“This pattern suggests that, when these writers engaged with GAI suggestions, they were more likely to explore suggestions without incorporating them (Cognitive Presence-Exploration).”
Quote in the paperSubstantial claim - Interpretationreasoning
An ARI of 0.56 is sufficient to support our findings.
“Therefore, we consider an ARI of 0.56 to be sufficient to support our findings.”
Quote in the paperSubstantial claim - Premisecitation
The collective writing approach is perceived as more effective by groups that find scripts restrictive or difficult to adhere to, favouring flexibility.
“Conversely, the collective writing approach is perceived as more effective by groups that find scripts restrictive or difficult to adhere to, favouring flexibility.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Heinonen et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
Cluster 2 suggests a pattern of frequent and unaltered use of GAI-generated content.
“At the same time, they had the lowest modification rate (about 17%) and the second-highest acceptance rate (about 66%), suggesting a pattern of frequent and unaltered use of GAIgenerated content.”
Quote in the paperSubstantial claim - Interpretationreasoning
The presence of both lowModification and HighModification implies that writers in Cluster 4 engaged in both Knowledge Telling and Knowledge Transformation.
“The presence of both lowModification and HighModification implies that writers in Cluster 4 engaged in both Knowledge Telling and Knowledge Transformation.”
Quote in the paperSubstantial claim - Study design and conductnone given
The absence of detailed demographic information about participants in the dataset limits the ability to generalize the findings to specific student populations.
“Lastly, the absence of detailed demographic information about participants in the dataset limits our ability to generalize the findings to specific student populations.”
Quote in the paperNot a substantial claim - Premisecitation
Keystroke data can offer valuable insights into how writers manage and distribute their cognitive resources while composing text.
“Several studies have shown that keystroke data can offer valuable insights into how writers manage and distribute their cognitive resources while composing text (Conijn et al., 2019;Zhang et al., 2021).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Conijn et al., 2019 source
- cites Zhang et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Classified as probably not a substantial claim. 40
- May combine two claims. 18
- The quote only partly states this claim. 3
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA writer's sense of ownership may diminish as the proportion of system-generated content increases.
“In particular, a writer's sense of ownership may diminish as the proportion of system-generated content increases (Lee et al., 2022).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Lee et al., 2022 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationYang et al. (2025) demonstrated that writers who actively engaged in higher order cognitive processes consistently produced higher-quality essays.
“Similarly, Yang et al. (2025) demonstrated that writers who actively engaged in higher order cognitive processes consistently produced higher-quality essays.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Yang et al., 2025 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationCheng et al. (2024) revealed significant differences in writing processes across groups defined by authorship (User vs. GAI), writing type (Creative vs. Argumentative), and GPT temperature settings (High vs. Low).
“Cheng et al. (2024) proposed a learning analytics-based methodology for evaluating GAI-assisted writing, revealing significant differences in writing processes across groups defined by authorship (User vs. GAI), writing type (Creative vs. Argumentative) and GPT temperature settings (High vs. Low).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Cheng et al., 2024 source
The Discussion and Conclusions reports an assessment method and statistically significant writing-process differences for user versus GAI ownership and creative versus argumentative prompts. The Regression Results (section 4.2; page not provided) says temperature was not statistically significant on either dimension, so the claimed significant High-versus-Low temperature difference is not supported. (LLM, conf=0.94)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
InterpretationcitationHow writers' relationships to systems evolve through extended use, especially in interactions with GAI tools, remains underexplored.
“However, how writers' relationships to systems evolve through extended use (Lee et al., 2024), especially in the context of interactions with GAI tools, remains underexplored.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Lee et al., 2024 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLee et al. (2024) emphasized that the effectiveness of a writing assistant often depends on how well it aligns with a user's specific needs.
“Lee et al. (2024) emphasized that the effectiveness of a writing assistant often depends on how well it aligns with a user's specific needs.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Lee et al., 2024 source
Classified as probably not a substantial claim.
PremisecitationNguyen et al. (2024) found that doctoral students who engaged in iterative, highly interactive processes with GAI-powered tools generally performed better in the writing task.
“Nguyen et al. (2024) proposed using Hidden Markov Models (HMM) and hierarchical sequence clustering to analyse human-AI interaction sequences in academic writing, finding that doctoral students who engaged in iterative, highly interactive processes with GAI-powered tools generally performed better in the writing task.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Nguyen et al., 2024 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLee et al. (2024) categorized the outputs of writing assistants into three types: analysis, generation, and proposal.
“Lee et al. (2024) categorized the outputs of writing assistants into three types: analysis, generation and proposal.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Lee et al., 2024 source
May combine two claims.
PremisecitationENA has demonstrated its effectiveness and validity as a method for assessing GAI-assisted writing in previous research.
“ENA has demonstrated its effectiveness and validity as a method for assessing GAIassisted writing in previous research (Cheng et al., 2024).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Cheng et al., 2024 source
The Discussion and Conclusions report statistically significant differences between writing conditions using an ENA-based assessment, supporting its usefulness as a proof of concept. But the Research Questions section says the dataset lacked writing-quality scores needed to test whether the method distinguishes high- from low-quality processes, and the Discussion calls the method plausible rather than validated. The claim overstates the evidence for validity. (LLM, conf=0.87)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationStudents expect AI to fulfil multiple roles, such as multi-tasking writing assistant, virtual tutor and digital peer, to support multifaceted writing processes and performance.
“Some studies examined students' perceptions of using these tools during the writing process (Kim et al., 2025;Wang, 2024), finding that students expect AI to fulfil multiple roles, such as multi-tasking writing assistant, virtual tutor and digital peer, to support multifaceted writing processes and performance.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Kim et al., 2025 source
- cites Wang, 2024
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Findingown dataCluster 2 had the lowest modification rate (about 17%) and the second-highest acceptance rate (about 66%).
“At the same time, they had the lowest modification rate (about 17%) and the second-highest acceptance rate (about 66%), suggesting a pattern of frequent and unaltered use of GAIgenerated content.”
Quote in the paperNot a substantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataCluster 4 produced the highest proportion of AI-generated characters (averaging 36%) and maintained a moderate modification rate (about 34%).
“They also produced the highest proportion of AI-generated characters (averaging 36%) and maintained a moderate modification rate (about 34%), pointing to a willingness to both accept and adapt AI suggestions as needed.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataCluster 3 writers submitted the fewest GAI requests overall (fewer than 8 per draft on average) and their final outputs contained the lowest proportion of AI-generated content (approximately 18%).
“Writers in this group submitted the fewest GAI requests overall (fewer than 8 per draft, on average), and their final outputs contained the lowest proportion of AIgenerated content (approximately 18%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAI-dependent writers consistently interacted with GAI across all stages of the writing process, whereas AI-balanced writers primarily engaged with GAI during the initial stages.
“For instance, our findings reveal that AIdependent writers consistently interacted with GAI across all stages of the writing process, whereas AI-balanced writers primarily engaged with GAI during the initial stages.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningAI-dependent writers (Cluster 2) maintain consistent, predefined roles between human writers and GAI, aligning closely with the script-based writing approach.
“This aligns closely with practices observed among AI-dependent writers (Cluster 2), who maintain consistent, predefined roles between human writers and GAI.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataCluster 4 displayed the second-highest average number of GAI requests and the highest acceptance rate of all clusters (approximately 77%).
“In terms of their final outputs, this group displayed the second-highest average number of GAI requests and the highest acceptance rate of all clusters (approximately 77%).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing), S4 (based). The quote only partly states this claim.
Findingown dataCluster 4 writers demonstrated a front-loaded pattern of engagement with GAI, using the tool most heavily during the early stages.
“Writers in this cluster demonstrated a front-loaded pattern of engagement with GAI, using the tool most heavily during the early stages of their writing process.”
Quote in the paperNot a substantial claimMay combine two claims.
FindingreasoningAI-balanced writers (Cluster 4) interchangeably utilize GAI either to propose content based on human-generated ideas or to modify AI-generated text to better meet their evolving requirements, mirroring the collective writing approach.
“This mirrors the behaviour of AI-balanced writers (Cluster 4), who interchangeably utilize GAI either to propose content based on human-generated ideas or to modify AI-generated text to better meet their evolving requirements.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataCluster 1 exhibited notably stronger connections between compose and seekSugg, as well as between cursorFwd and lowModification, when compared to Cluster 3.
“Cluster 1 exhibited notably stronger connections between compose and seekSugg, as well as between cursorFwd and lowModification, when compared to Cluster 3.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationTime-series clustering methods are commonly divided into three classes: model-based, feature-based, and shape-based approaches.
“Methods for clustering time-series data are commonly divided into three classes (Aghabozorgi et al., 2015): modelbased, feature-based and shape-based approaches.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Aghabozorgi et al., 2015 source
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenResearch exploring the use of shape-based time-series clustering in GAI-assisted writing tasks is notably absent.
“Research exploring the use of shape-based time-series clustering in GAI-assisted writing tasks is notably absent.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
Premisenone givenThese cognitive frameworks collectively suggest a set of claims for assessing the processes involved in co-writing with GAI: using GAI suggestions as is (Knowledge Telling); modifying GAI suggestions to fit the writer's own goals (Knowledge Transformation/integration); requesting suggestions from GAI (triggering); comparing different GAI suggestions (exploration); and arriving at a final product (
“These cognitive frameworks collectively suggest a set of claims for assessing the processes involved in co-writing with GAI: using GAI suggestions as is (Knowledge Telling); modifying GAI suggestions to fit the writer's own goals (Knowledge Transformation/ integration); requesting suggestions from GAI (triggering); comparing different GAI suggestions (exploration); and arriving at a final product”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningIn education, the majority of time-series clustering research has utilized feature-based and shape-based methods.
“In the field of education, the majority of research has utilized feature-based (Hassan et al., 2022;Talebinamvar & Zarrabi, 2022;Zhang et al., 2019) and shape-based (He et al., 2023;Ma'ady et al., 2022;Shen & Chi, 2017) methods, primarily due to their ease of interpretation and lower computational complexity.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Hassan et al., 2022 source
- cites He et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Shen & Chi, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationShibani et al. (2023) found that writers who used GPT-3 less frequently produced texts with higher lexical density and greater semantic overlap.
“For example, Shibani et al. (2023) found that writers who used GPT-3 less frequently produced texts with higher lexical density and greater semantic overlap.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Shibani et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationENA models the co-occurrence of coded elements in discourse to identify and compare patterns of thinking and learning.
“In education, a cornerstone of QE is Epistemic Network Analysis (ENA), which models the co-occurrence of coded elements in discourse to identify and compare patterns of thinking and learning (Shaffer & Ruis, 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Shaffer & Ruis, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenExisting research on GAI-assisted writing is relatively scarce.
“Existing research on GAI-assisted writing is relatively scarce.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationENA has been widely applied across various educational settings to investigate complex learning processes such as collaborative learning, self-regulated learning, and communities of practice.
“ENA has been widely applied across various educational settings to investigate complex learning processes such as collaborative learning (Csanadi et al., 2017;Nachtigall & Sung, 2019), self-regulated learning (Lim et al., 2021;Uzir et al., 2020) and communities of practice (Hu et al., 2018;Peng et al., 2020).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Csanadi et al., 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Lim et al., 2021 source
- cites Hu et al., 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S4 (based).
InterpretationreasoningHow temporal AI usage patterns interact with human writing behaviours and their subsequent impact on writing performance and human learning remain largely unexplored.
“Additionally, how these temporal AI usage patterns interact with human writing behaviours and their subsequent impact on writing performance and human learning remain largely unexplored.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationEpistemic Network Analysis (ENA) utilizes network models to depict epistemic actions and can evidence cognitive behaviours inherent to co-writing with GAI.
“we conducted Epistemic Network Analysis (ENA) (Shaffer & Ruis, 2017), a popular learning analytics method that utilizes network models to depict epistemic actions, on each cluster to evidence the cognitive behaviours inherent to co-writing with GAI.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Shaffer & Ruis, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.
PremisecitationLearning is a process that unfolds over time, making temporal analyses essential to better capture its nature.
“Additionally, several studies point out that learning is a process that unfolds over time, making it essential to conduct insightful temporal analyses to better capture its nature (Chen et al., 2018;Knight et al., 2017).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWambsganss et al. (2023) found no significant difference in bias between reviews written by students with and without GAI-generated suggestions, regardless of whether GPT-2 or GPT-3 was used.
“Wambsganss et al. (2023) investigated gender bias in a GAI-assisted writing pipeline and found no significant difference in bias between reviews written by students with and without GAI-generated suggestions, regardless of whether GPT-2 or GPT-3 was used.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Wambsganss et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Classified as probably not a substantial claim.
InterpretationreasoningPrioritizing proposal-type suggestions over generation-type suggestions leads students to maintain greater control over their writing processes.
“By prioritizing proposal-type suggestions over generation-type suggestions, students maintain greater control over their writing processes.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationreasoningBecause GAI generates suggestions based on human-created content, human-written content can influence GAI-written content, making separate writing less distinct in GAI-assisted writing tasks.
“However, because GAI generates suggestions based on human-created content, the human-written content can influence the GAI-written content, making the separate writing less distinct in GAI-assisted writing tasks.”
Quote in the paperSubstantial claim- Rests on an assumption: GAI generates suggestions based on human-created content.
May combine two claims.
InterpretationreasoningThe convergence of behavioural and self-reported data suggests that Cluster 2 writers engaged with GAI frequently and incorporated its output extensively.
“The convergence of behavioural and self-reported data suggests that these writers engaged with GAI frequently and incorporated its output extensively.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationZhang et al. (2021) found that text production and editing behaviours captured from keystrokes can be used to distinguish writers with different cognitive processes.
“Similarly, Zhang et al. (2021) found that text production and editing behaviours captured from keystrokes can be used to distinguish writers with different cognitive processes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zhang et al., 2021
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningInsights into writers' temporal behaviours in GenAI-assisted writing can inform the design of features for time-series models that capture writing performance over time.
“Our insights into writers' temporal behaviours in GenAI-assisted writing can inform the design of features for time-series models that capture writing performance over time.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningPrioritizing proposal-type suggestions over generation-type suggestions supports student agency.
“This approach supports student agency, encourages deeper engagement with writing tasks and ensures that final written products predominantly reflect students' authentic voices and ideas, rather than becoming a blend of human-AI contributions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe analysis did not differentiate data according to essay genres, such as creative vs. argumentative writing.
“Third, our analysis did not differentiate data according to essay genres, such as creative vs. argumentative writing.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe dataset is well-suited to address the research questions and can provide meaningful insights into real-world educational scenarios.
“Therefore, this dataset is well-suited to address our research questions and can provide meaningful insights into real-world educational scenarios.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningCluster 2 writers predominantly adopted the Knowledge Telling strategy and engaged in Cognitive Presence-Triggering.
“As a result, these writers predominantly adopted the Knowledge Telling strategy and engaged in Cognitive Presence-Triggering.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationLatif (2021) proposed a writing process model composed of seven components (eg, Linguistic rehearsing, Reviewing and Ideational planning) and offered explanations of the strategies used in each component.
“Latif (2021) proposed a writing process model composed of seven components (eg, Linguistic rehearsing, Reviewing and Ideational planning) and offered explanations of the strategies used in each component.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Latif, 2021 source
Classified as probably not a substantial claim.
InterpretationreasoningPrioritizing proposal-type suggestions over generation-type suggestions ensures that final written products predominantly reflect students' authentic voices and ideas rather than becoming a blend of human-AI contributions.
“This approach supports student agency, encourages deeper engagement with writing tasks and ensures that final written products predominantly reflect students' authentic voices and ideas, rather than becoming a blend of human-AI contributions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn the separate writing approach, writing tasks are divided into distinct parts among group members, rather than collaboratively producing a single document.
“Additionally, in the separate writing approach, writing tasks are divided into distinct parts among group members, rather than collaboratively producing a single document.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Heinonen et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningTime-series models informed by writers' temporal behaviours can support the development of writing scaffolds and adaptive support systems, for example by using counterfactual modelling to identify key cognitive activities.
“These models can, in turn, support the development of writing scaffolds and adaptive support systems (ie, by using counterfactual modelling to identify key cognitive activities that writers should engage in).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationWriting encompasses a set of recursive and intertwined cognitive processes, for example planning, translating, reviewing and monitoring.
“Writing encompasses a set of recursive and intertwined cognitive processes, for example planning, translating, reviewing and monitoring (Koppenhaver & Williams, 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Koppenhaver & Williams, 2010 source
Probably not a substantial claim: may not pass S4 (based).
Interpretationnone givenStudents overly relying on GAI for writing tasks may hinder opportunities for meaningful learning, for example by consistently adopting the knowledge-telling strategy.
“Researchers and educators should be aware of the risks associated with students overly relying on GAI for writing tasks, as this dependency may hinder opportunities for meaningful learning (eg, consistently adopting the knowledge-telling strategy).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationBaaijen et al. (2012) developed methods and measures for analysing keystroke logging with the goal of enhancing the correlation between keystroke data and cognitive processes.
“Baaijen et al. (2012) developed methods and measures for analysing keystroke logging with the goal of enhancing the correlation between keystroke data and cognitive processes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Baaijen et al., 2012 source
Classified as probably not a substantial claim.
PremisecitationIn the script-based writing approach, the script provides clear structure and explicitly outlines the responsibilities and tasks for each group member at specific points in the process.
“In the script-based writing approach, the script provides clear structure and explicitly outlines the responsibilities and tasks for each group member at specific points in the process.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Heinonen et al. (2020)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningDistinct motivational and contextual factors between Mechanical Turk workers and students may shape cognitive processes, temporal writing patterns and responses to GenAI assistance in fundamentally different ways.
“These distinct motivational and contextual factors may shape cognitive processes, temporal writing patterns and responses to GenAI assistance in fundamentally different ways.”
Quote in the paperNot a substantial claim- Rests on an assumption: Mechanical Turk workers' motivations are likely tied to task completion and compensation.
- Rests on an assumption: Student-authored educational writing often entails different goals, such as meeting academic expectations, demonstrating learning or engaging with disciplinary conventions.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationKeystroke logging is a prevalent method for examining the writing process in educational settings, involving recording and timestamping keystroke actions to reconstruct the writing process.
“Keystroke logging is a prevalent method for examining the writing process in educational settings, involving the recording and timestamping of keystroke actions to reconstruct the writing process (Leijten & Van Waes, 2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Leijten & Van Waes, 2013 source
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningDTW aligns well with the tasks of GAI-assisted writing.
“This aligns well with the tasks of GAI-assisted writing.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningPrioritizing proposal-type suggestions over generation-type suggestions encourages deeper engagement with writing tasks.
“This approach supports student agency, encourages deeper engagement with writing tasks and ensures that final written products predominantly reflect students' authentic voices and ideas, rather than becoming a blend of human-AI contributions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationConijn et al. (2019) proposed the method of mapping features from the keystroke logs to higher level cognitive processes, such as planning and revising.
“Conijn et al. (2019) proposed the method of mapping features from the keystroke logs to higher level cognitive processes, such as planning and revising.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Conijn et al., 2019 source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationConijn et al.'s (2019) findings suggest that keystroke features such as word count and number of revisions are associated with cognitive load.
“For example, Conijn et al.'s (2019) findings suggest that keystroke features such as word count and number of revisions are associated with cognitive load.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Conijn et al., 2019 source
The paper relies on this without support.
The CoAuthor dataset's log trace events provide a valid record of writers' AI usage and writing behaviours.
“It offers a detailed log of keystroke-level interactions during these sessions, capturing 13 different event types (eg, text-insertion, text-deletion and suggestionget).”
The paper relies on this without support.
Temporal patterns in AI usage can be meaningfully identified by clustering writing sessions with Dynamic Time Warping.
“For this reason, to answer RQ1, we opted for Dynamic Time Warping (DTW) (Müller, 2007), a method capable of assessing the similarity between two action sequences irrespective of their length disparities.”
The paper relies on this without support.
Humans vary in the speed of essay writing but exhibit comparable patterns in AI-usage behaviours.
“Humans might vary in the speed of essay writing, yet exhibit comparable patterns in AI-usage behaviours.”
The paper relies on this without support.
GAI generates suggestions based on human-created content.
“because GAI generates suggestions based on human-created content”
The paper relies on this without support.
Most existing approaches to writing scaffolds and adaptive support systems have not been specifically designed for the context of GAI-assisted writing.
“most existing approaches have not been specifically designed for the context of GAI-assisted writing.”
The paper relies on this without support.
Mechanical Turk workers' motivations are likely tied to task completion and compensation.
“whose motivations are likely tied to task completion and compensation.”
The paper relies on this without support.
Student-authored educational writing often entails different goals, such as meeting academic expectations, demonstrating learning or engaging with disciplinary conventions.
“student-authored educational writing often entails different goals, such as meeting academic expectations, demonstrating learning or engaging with disciplinary conventions.”
The paper relies on this without support.
Writing patterns can differ among genres.
“Given that writing patterns can differ among genres”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Cluster 2 is described as making no modifications despite a nonzero modification rate
MinorThe results interpret Cluster 2 as accepting suggestions without any modifications, but Table 3 reports that its writers modified an average of 17% of accepted suggestions. The absence of a network connection does not make that measured rate zero.
“Notably, the absence of connections to lowModification and highModification further suggests that they accepted AI-generated suggestions as they were without making any modifications.”
“Rate of GPT-3 suggestions modified 0.46 (0.30) 0.17 (0.22) 0.36 (0.31) 0.34 (0.25)”
Q9 is described as measuring improvement rather than confidence
MinorThe Cluster 1 interpretation treats Q9 as an item about whether GAI improved the writing. Table 5 identifies Q9 as confidence in one's ability to write with the system's help, which is a different question.
“they reported the lowest average scores on items measuring perceived helpfulness of GAI in generating new ideas (Q2), understanding their writing intents (Q6), and improving their writing (Q9).”
“Q9: I am confident in my ability to write a story/essay with the help of the system”
Cites
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344 · see citing works
Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education
Garrison, D. R., Anderson, T., & Archer, W. (1999) · The Internet and Higher Education · doi:10.1016/s1096-7516(00)00016-6 · Cited by 6,619 · see citing works
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.03109 · Cited by 3,159 · see citing works
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 2,842 · see citing works
On the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676 · see citing works
Clustering of time series data—a survey
Liao, T. W. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.025 · Cited by 2,410 · see citing works
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150 · see citing works
Time-series clustering – A decade review
Aghabozorgi, S., Seyed Shirkhorshidi, A., & Ying Wah, T. (2015) · Information Systems · doi:10.1016/j.is.2015.04.007 · Cited by 1,826 · see citing works
(2007) · Springer eBooks · doi:10.1007/978-3-540-74048-3_4 · Cited by 1,373 · see citing works
Shaffer, D. W., Collier, W., & Ruis, A. R. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.33.3 · Cited by 811 · see citing works
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805 · see citing works
Self-citationKeystroke Logging in Writing Research: Using Inputlog to Analyze and Visualize Writing Processes
Leijten, M., & Van Waes, L. (2013) · Written Communication · doi:10.1177/0741088313491692 · Cited by 513 · see citing works
The Psychology of Written Composition
(2013) · doi:10.4324/9780203812310 · Cited by 505 · see citing works
ESL Learners' Writing Skills: Problems, Factors and Suggestions
Fareed, M., Ashraf, A., & Bilal, M. (2016) · Journal of Education & Social Sciences · doi:10.20547/jess0421604201 · Cited by 461 · see citing works
Human-AI collaboration patterns in AI-assisted academic writing
Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2323593 · Cited by 449 · see citing works
Exploring students' perspectives on generative AI-assisted academic writing
Kim, J., Yu, S., Detrick, R., & Li, N. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12878-7 · Cited by 438 · see citing works
Gender bias and stereotypes in Large Language Models
Kotek, H., Dockum, R., & Sun, D. (2023) · Proceedings of The ACM Collective Intelligence Conference · doi:10.1145/3582269.3615599 · Cited by 381 · see citing works
Liu, M., Zhang, L. J., & Biebricher, C. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104977 · Cited by 372 · see citing works
Lee, M., Liang, P., & Yang, Q. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502030 · Cited by 345 · see citing works
Digital support for academic writing: A review of technologies and pedagogies
Strobl, C., Ailhaud, E., Benetos, K., Devitt, A., Kruse, O., Proske, A., & Rapp, C. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.12.005 · Cited by 298 · see citing works
Co-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265 · see citing works
Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics
University of Wisconsin–Madison, U., Shaffer, D. W., Ruis, A. R., & University of Wisconsin–Madison, U. (2017) · Handbook of Learning Analytics · doi:10.18608/hla17.015 · Cited by 255 · see citing works
Effects of Task Complexity on L2 Writing Behaviors and Linguistic Complexity
Révész, A., Kourtali, N., & Mazgutova, D. (2016) · Language Learning · doi:10.1111/lang.12205 · Cited by 226 · see citing works
A Survey of Clustering Techniques
Rai, P., & Singh, S. (2010) · International Journal of Computer Applications · doi:10.5120/1326-1808 · Cited by 225 · see citing works
Wang, C. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09744-3 · Cited by 212 · see citing works
TaleBrush: Sketching Stories with Generative Pretrained Language Models
Chung, J. J. Y., Kim, W., Yoo, K. M., Lee, H., Adar, E., & Chang, M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501819 · Cited by 206 · see citing works
Zhao, X. (2023) · RELC Journal · doi:10.1177/00336882221094089 · Cited by 192 · see citing works
A Benchmark Study on Time Series Clustering
Javed, A., Lee, B., & Rizzo, D. (2020) · Machine Learning with Applications · doi:10.1016/j.mlwa.2020.100001 · Cited by 149 · see citing works
Metaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · see citing works
A Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136 · see citing works
Time for Change: Why Learning Analytics Needs Temporal Analysis
Knight, S., Friend Wise, A., & Chen, B. (2017) · Journal of Learning Analytics · doi:10.18608/jla.2017.43.2 · Cited by 135 · see citing works
The Mathematical Foundations of Epistemic Network Analysis
Bowman, D. A., Swiecki, Z., Cai, Z., Wang, Y., Eagan, B. R., Linderoth, J., & Shaffer, D. W. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-67788-6_7 · Cited by 131 · see citing works
Self-citationSocial Dynamics of AI Support in Creative Writing
Gero, K. I., Long, T., & Chilton, L. B. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580782 · Cited by 129 · see citing works
Keystroke Analysis: Reflections on Procedures and Measures
Baaijen, V. M., Galbraith, D., & de Glopper, K. (2012) · Written Communication · doi:10.1177/0741088312451108 · Cited by 124 · see citing works
Biermann, O. C., Ma, N. F., & Yoon, D. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533506 · Cited by 116 · see citing works
Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Pardo, A., Fudge, A., & Gentili, S. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1782831 · Cited by 113 · see citing works
Self-citationIdentifying At-Risk Students for Early Interventions—A Time-Series Clustering Approach
Hung, J.-L., Wang, M. C., Wang, S., Abdelrasoul, M., Li, Y., & He, W. (2015) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2015.2504239 · Cited by 108 · see citing works
Buschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108 · see citing works
Roe, J., Renandya, W. A., & Jacobs, G. M. (2023) · Journal of English and Applied Linguistics · doi:10.59588/2961-3094.1035 · Cited by 100 · see citing works
Dang, H., Goller, S., Lehmann, F., & Buschek, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580969 · Cited by 83 · see citing works
Uzir, N. A., Gašević, D., Jovanović, J., Matcha, W., Lim, L.-A., & Fudge, A. L. (2020) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3375462.3375493 · Cited by 76 · see citing works
Self-citationIntroAssist: A Tool to Support Writing Introductory Help Requests
Hui, J. S., Gergle, D., & Gerber, E. M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173596 · Cited by 76 · see citing works
What do teachers share within Socialized Knowledge Communities: a case of Pinterest
Hu, S., Torphy, K. T., Opperman, A., Jansen, K., & Lo, Y. (2018) · Journal of Professional Capital and Community · doi:10.1108/jpcc-11-2017-0025 · Cited by 75 · see citing works
Aligning Keystrokes with Cognitive Processes in Writing
Galbraith, D., & Baaijen, V. M. (2019) · BRILL eBooks · doi:10.1163/9789004392526_015 · Cited by 66 · see citing works
Understanding the keystroke log: the effect of writing task on keystroke features
Conijn, R., Roeser, J., & van Zaanen, M. (2019) · Reading and Writing · doi:10.1007/s11145-019-09953-8 · Cited by 55 · see citing works
Prediction of Essay Scores From Writing Process and Product Features Using Data Mining Methods
Sinharay, S., Zhang, M., & Deane, P. (2019) · Applied Measurement in Education · doi:10.1080/08957347.2019.1577245 · Cited by 51 · see citing works
Why Are We Like This?: The AI Architecture of a Co-Creative Storytelling Game
Kreminski, M., Dickinson, M., Mateas, M., & Wardrip-Fruin, N. (2020) · International Conference on the Foundations of Digital Games · doi:10.1145/3402942.3402953 · Cited by 50 · see citing works
Adjusting the adjusted Rand Index
Sundqvist, M., Chiquet, J., & Rigaill, G. J. (2022) · Computational Statistics · doi:10.1007/s00180-022-01230-7 · Cited by 49 · see citing works
Enough With “Human-AI Collaboration”
Sarkar, A. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3582735 · Cited by 47 · see citing works
He, Q., Borgonovi, F., & Suárez‐Álvarez, J. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12748 · Cited by 45 · see citing works
Stellmack, M. A., Keenan, N. K., Sandidge, R. R., Sippl, A. L., & Konheim-Kalkstein, Y. L. (2012) · Teaching of Psychology · doi:10.1177/0098628312456589 · Cited by 42 · see citing works
Process Features in Writing: Internal Structure and Incremental Value Over Product Features
Zhang, M., & Deane, P. (2015) · ETS Research Report Series · doi:10.1002/ets2.12075 · Cited by 39 · see citing works
Wordcraft: a Human-AI Collaborative Editor for Story Writing
Coenen, A., Davis, L., Ippolito, D., Reif, E., & Yuan, A. (2021) · arXiv · doi:10.48550/arxiv.2107.07430 · Cited by 35 · see citing works
Remodeling writers’ composing processes: Implications for writing assessment
Abdel Latif, M. M. M. (2021) · Assessing Writing · doi:10.1016/j.asw.2021.100547 · Cited by 31 · see citing works
Supporting Cognitive and Emotional Empathic Writing of Students
Wambsganss, T., Niklaus, C., Söllner, M., Handschuh, S., & Leimeister, J. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.314 · Cited by 31 · see citing works
Evidence-centered Assessment for Writing with Generative AI
Cheng, Y., Lyons, K., Chen, G., Gašević, D., & Swiecki, Z. (2024) · Proceedings of the 14th Learning Analytics and Knowledge Conference · doi:10.1145/3636555.3636866 · Cited by 29 · see citing works
Self-citationA Conceptual Review of Writing Research in Augmentative and Alternative Communication
Koppenhaver, D., & Williams, A. (2010) · Augmentative and Alternative Communication · doi:10.3109/07434618.2010.505608 · Cited by 28 · see citing works
ANALYZING THE STUDENTS'ABILITY IN WRITING OPINION ESSAY USING FLASH FICTION
Setyowati, L. (2016) · Journal of English Language Teaching and Linguistics · doi:10.21462/jeltl.v1i1.1 · Cited by 27 · see citing works
Critical issues in designing and implementing temporal analytics.
Chen, B., Knight, S., & Wise, A. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.51.1 · Cited by 26 · see citing works
Modifying AI, Enhancing Essays: How Active Engagement with Generative AI Boosts Writing Quality
Yang, K., Raković, M., Liang, Z., Yan, L., Zeng, Z., Fan, Y., Gašević, D., & Chen, G. (2025) · Proceedings of the 15th International Learning Analytics and Knowledge Conference · doi:10.1145/3706468.3706544 · Cited by 26 · see citing works
Self-citationIdentifying and Comparing Writing Process Patterns Using Keystroke Logs
Zhang, M., Zhu, M., Deane, P., & Guo, H. (2019) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-030-01310-3_32 · Cited by 25 · see citing works
Zhao, L., Gašević, D., Swiecki, Z., Li, Y., Lin, J., Sha, L., Yan, L., Alfredo, R., Li, X., & Martínez‐Maldonado, R. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13476 · Cited by 24 · see citing works
Self-citationAdaptive Empathy Learning Support in Peer Review Scenarios
Wambsganss, T., Soellner, M., Koedinger, K. R., & Leimeister, J. M. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517740 · Cited by 24 · see citing works
Modeling and predicting students’ engagement behaviors using mixture Markov models
Maqsood, R., Ceravolo, P., Romero, C., & Ventura, S. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01674-9 · Cited by 21 · see citing works
Talebinamvar, M., & Zarrabi, F. (2022) · Language Testing in Asia · doi:10.1186/s40468-021-00150-5 · Cited by 21 · see citing works
ten Peze, A., Janssen, T., Rijlaarsdam, G., & van Weijen, D. (2023) · Instructional Science · doi:10.1007/s11251-023-09647-3 · Cited by 18 · see citing works
Scripting as a pedagogical method to guide collaborative writing: university students’ reflections
Syynimaa, K., Grez, N. D., Hämäläinen, R., Wever, B. D., & van der Meijs, S. (2020) · Research and Practice in Technology Enhanced Learning · doi:10.1186/s41039-020-00131-x · Cited by 17 · see citing works
Nachtigall, V., & Sung, H. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-33232-7_14 · Cited by 15 · see citing works
Utilizing Social Clustering-Based Regression Model for Predicting Student’s GPA
Hassan, Y. M. I., Elkorany, A., & Wassif, K. (2022) · IEEE Access · doi:10.1109/access.2022.3172438 · Cited by 15 · see citing works
Sadauskas, J., Byrne, D., & Atkinson, R. K. (2015) · doi:10.1145/2702123.2702383 · Cited by 14 · see citing works
WriteAhead2: Mining Lexical Grammar Patterns for Assisted Writing
Chang, J., & Chang, J. S. (2015) · doi:10.3115/v1/n15-3022 · Cited by 14 · see citing works
Human-AI Collaborative Writing: Sharing the Rhetorical Task Load
Knowles, A. M. (2022) · 2022 IEEE International Professional Communication Conference (ProComm) · doi:10.1109/procomm53155.2022.00053 · Cited by 13 · see citing works
Wei, Z.-F., Shang, H., & Briody, P. (2012) · International Journal of Academic Research in Progressive Education and Development · doi:10.6007/ijarped/v1-i4/12012 · Cited by 12 · see citing works
Self-regulated Learning Processes in Secondary Education: A Network Analysis of Trace-based Measures
Cheng, Y., Guan, R., Li, T., Raković, M., Li, X., Fan, Y., Jin, F. J.-Y., Tsai, Y., Gašević, D., & Swiecki, Z. (2025) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3706468.3706502 · Cited by 12 · see citing works
Self-citationWambsganß, T., Su, X., Swamy, V., Neshaei, S. P., Rietsche, R., & Käser, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.689 · Cited by 10 · see citing works
arXivEdits: Understanding the Human Revision Process in Scientific Writing
Jiang, C., Xu, W., & Stevens, S. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.641 · Cited by 9 · see citing works
Modeling STEM Learning Design Competence Through Discourse Analysis
Peng, X., Wu, B., & Hu, Y. (2020) · doi:10.1109/icalt49669.2020.00065 · Cited by 6 · see citing works
Predicting essay quality from search and writing behavior
Vakkari, P., Völske, M., Potthast, M., et al. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24451 · Cited by 6 · see citing works
Using Vocabularies to Collaboratively Create Better Plans for Writing Tasks
Kaur, H., Williams, A. C., Thompson, A. L., Lasecki, W. S., Iqbal, S. T., & Teevan, J. B. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188640 · Cited by 1 · see citing works
arXivEdits: Understanding the Human Revision Process in Scientific WritingPreprint
Jiang, C., Xu, W. H., & Stevens, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.15067 · Cited by 1 · see citing works
Supporting Cognitive and Emotional Empathic Writing of Students
Wambsganss, T., Niklaus, C., Söllner, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2105.14815
Flagged first, then by citations
Research works printed but not linked: 13
- Allen L. K., 2016, {ENTER}ing the time series {SPACE}: Uncovering the writing process through keystroke analyses
- Bholowalia P., 2014, Ebk‐means: A clustering technique based on elbow method and k‐means in wsn, International Journal of Computer Applications, 105, 17
- Cobo G., 2011, EDM, 253
- Csanadi A., 2017, Collaborative and individual scientific reasoning of pre‐service teachers: New insights through epistemic network analysis (ENA)
- Dj M. Z., 2015, Using hypnoteaching strategy to improve students' writing ability, Dinamika Ilmu, 15, 185
- Liu Y., 2022, Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22), New Orleans, LA, USA, 1
- Ma'ady M. N. P., 2022, 2022 Seventh ICIC, 1
- Senin P., 2008, Dynamic time warping algorithm review, 40
- Shaffer D. W., 2017, Quantitative ethnography
- Shen S., 2017, Clustering student sequential trajectories using dynamic time warping
- Shibani A., 2023, Visual representation of co‐authorship with GPT‐3: Studying human‐machine interaction for effective writing
- Tavenard R., 2020, Tslearn, a machine learning toolkit for time series data, Journal of Machine Learning Research, 21, 1
- Zhang M., 2021, Using keystroke analytics to understand cognitive processes during writing
Cited by
Sorted by citations
Yang, L., Wen, X., & Chen, Y. (2026) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.70258 · Cited by 1 · see citing works
Student-AI interaction in computer-assisted consecutive interpreting: patterns and performance
Kuang, H., Li, J., & Weng, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1890808 · Cited by 1 · see citing works
“This balanced approach leverages AI strengths while preserving human agency and critical evaluation (Gomez et al., 2025), a synergy frequently found successful in educational settings (Güner and Er, 2025; Gruenhagen et al., 2024; Jose et al., 2025; Ninghardjanti et al., 2025; Yang et al., 2025).”
Guo, Y., Huang, T., Yue, S., Yu, J., Wei, M., & Chen, M. (2026) · Journal of Educational Computing Research · doi:10.1177/07356331261481381
Jin, Y., Martínez‐Maldonado, R., Gašević, D., Han, X., & Yan, L. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70310 · Cited by 1 · see citing works
“…in how individuals participate, influence direction-setting, and regulate collaborative processes over time–and how these profiles align with or diverge from human behaviour in creative collaboration (Heinimäki, Volet, Jones, Laakkonen, & Vauras, 2021; K. Yang et al., 2025; Wei et al., 2025).”
InfluentialSelf-citation
- Authors
- Yang, K., Cheng, Y., Zhao, L., Raković, M., Swiecki, Z., Gašević, D., & Chen, G.
- Affiliations
- Monash University (AU)
- Corresponding author
- Chen, Guanliang
- ORCID
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2025-11-26
- Volume
- 57
- Issue
- 2
- Pages
- 508-534
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W4416722686
- Cited by
- 4
- References
- 54
- Citations by year
- 2026: 4
- FWCI
- 16.84
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- British Journal of Educational Technology (publishedVersion)
- Funders
- Australian Research Council (DP220101209; DP240100069)
- Jacobs Foundation (CELLA2CERES)
- Topics
- Social Sciences › Education › Writing and Handwriting Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Keywords
- human-AI interaction, knowledge transformation, cognitive presence, epistemic network analysis, dynamic time warping, time series clustering, AI dependency, intelligence enhancement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review