CoChat

Students-Generative AI interaction patterns and its impact on academic writing

Kim, Jinhee, Lee, Sang-Soog, Detrick, Rita, Wang, Jialin, Li, Na · 2026 · Journal of Computing in Higher Education
Cited by 74

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Considering both the transformative opportunities and challenges presented by generative AI (GenAI) in academic writing, effectively integrating GenAI into the academic setting becomes a significant need requiring prioritization. Yet, there is limited understanding regarding the nature of interactions between different types of students, what behavioral patterns students exhibit during a student-GenAI interaction (SAI) on a given task, and how these different SAI patterns relate to the actual writing task performance. This study, therefore, aimed to identify SAI patterns of academic writing tasks depending on students’ level of AI literacy and examine the differences in academic writing performance between the identified SAI patterns. Drawing from the combination of three data sources, including think-aloud protocols, screen-recordings, and chat histories between 36 Chinese graduate students and a GenAI writing system, epistemic network analysis (ENA) was used to reveal the distinctive SAI patterns of students with different levels of AI literacy. The study found that students with a high level of AI literacy exhibited a collaborative approach to SAI, actively accepting GenAI’s suggestions and engaging GenAI in meta-cognitive-related activities such as planning, whereas students with a low level of AI literacy demonstrated much less interaction with GenAI in completing their writing tasks, instead choosing to ideate and evaluate independently. In addition, the Wilcoxon rank-sum (Mann-Whitney U) test was conducted to assess the writing task performance of the two AI literacy groups. Findings revealed statistical differences in all evaluation rubrics (content, structure/organization, expression). This study offers implications for the design and implementation of GenAI agents in writing tasks and the pedagogy of GenAI-assisted instruction.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s12528-025-09444-6

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 18 references

Research works printed but not linked: 37

  1. Ahmad, Z. (2019). Analyzing argumentative essay as an academic genre on assessment framework of IELTS and TOEFL. In english Language teaching research in the middle East and North Africa (pp. 279–299). Palgrave Macmillan. · DOI
  2. Aldabbus, S., & Almansouri, E. (2022). Academic writing difficulties encountered by university EFL learners. British Journal of English Linguistics, 10(3), 1–11. https://doi.org/10.37745/bjel.2013/vol10n3111 · DOI · Paper page
  3. Allen, L. K., & McNamara, D. S. (2017). Five Building blocks for comprehension strategy instruction. In A. León José, & E. Inmaculada (Eds.), Reading comprehension in educational settings (pp. 125–144). John Benjamins Publishing Company. https://doi.org/10.1075/swll.16.05all · DOI
  4. Ayanwale, M. A., & Molefi, R. R. (2024). Exploring intention of undergraduate students to embrace chatbots: From the vantage point of Lesotho. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00451-8 · DOI
  5. Barak, M., & Levenberg, A. (2016). Flexible thinking in learning: An individual differences measure for learning in technology-enhanced environments. Computers & Education, 99, 39–52. · DOI · Paper page
  6. Behrooz, H., Lipizzi, C., Korfiatis, G., Ilbeigi, M., Powell, M., & Nouri, M. (2023). Towards automating the identification of sustainable projects seeking financial support: An AI-powered approach. Sustainability, 15(12), 9701. · DOI
  7. Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295. https://doi.org/10.1177/23294906231176517 · DOI · Paper page
  8. Chango, W., Cerezo, R., Sanchez-Santillan, M., Azevedo, R., & Romero, C. (2021). Improving prediction of students’ performance in intelligent tutoring systems using attribute selection and ensembles of different multimodal data sources. Journal of Computing in Higher Education, 33(3), 614–634. https://doi.org/10.1007/s12528-021-09298-8 · DOI · Paper page
  9. Chichekian, T., & Benteux, B. (2022). The potential of learning with (and not from) artificial intelligence in education. Frontiers in Artificial Intelligence, 5, 903051. · DOI · Paper page
  10. Delcker, J., Heil, J., Ifenthaler, D., Seufert, S., & Spirgi, L. (2024). First-year students AI-competence as a predictor for intended and de facto use of AI-tools for supporting learning processes in higher education. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00452-7 · DOI · Paper page
  11. Engwall, O., & Lopes, J. (2020). Interaction and collaboration in robot-assisted Language learning for adults. Computer Assisted Language Learning, 1–37. https://doi.org/10.1080/09588221.2020.1799821 · DOI
  12. Gupta, S., Jaiswal, A., Paramasivam, A., & Kotecha, J. (2022). Academic writing challenges and supports: Perspectives of international doctoral students and their supervisors. Frontiers in Education, 7, 891534. https://doi.org/10.3389/feduc.2022.891534 · DOI
  13. Hall, R. (2024). Generative AI and re-weaving a pedagogical horizon of social possibility. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00445-6 · DOI
  14. Hyland, K. (2014). English for academic purposes. In Leung, C., & Street, B. V. (Eds.), The Routledge companion to English studies (pp. 392–404). Routledge. https://doi-org.proxy.lib.odu.edu/https://doi.org/10.4324/9781315852515 · DOI
  15. Kim, J. (2024b). Types of teacher-AI collaboration in K-12 classroom instruction: Chinese teachers’ perspective. Education and Information Technologies, 29, 17433–17465. https://doi.org/10.1007/s10639-024-12523-3 · DOI
  16. Kim, J., & Lee, S. S. (2023). Are two heads better than one? The effect of student-AI collaboration on students’ learning task performance. TechTrends, 67(2), 365–375. https://doi.org/10.1007/s11528-022-00788-9 · DOI · Paper page
  17. Kim, J., Ham, Y., & Lee, S. S. (2024). Differences in student-AI interaction process on a drawing task: Focusing on students’ attitude towards AI and the level of drawing skills. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.8859 · DOI · Paper page
  18. Kim, J., Yu, S., Lee, S. S., & Derrick, R. (2025). Students’ Prompt patterns and its effects in AI-assisted academic writing: Focusing on students’ level of AI literacy. Journal of Research on Technology in Education, 1–18. https://doi.org/10.1080/15391523.2025.2456043 · DOI
  19. Lee, S. S., Li, N., & Kim, J. (2023). Conceptual model for Mexican teachers’ adoption of learning analytics systems: The integration of the information system success model and the technology acceptance model. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12371-7 · DOI
  20. Lemaignan, S., Warnier, M., Sisbot, E. A., Clodic, A., & Alami, R. (2017). Artificial cognition for social human–robot interaction: An implementation. Artificial Intelligence, 247, 45–69. · DOI · Paper page
  21. Li, N., Zhang, X., & Limniou, M. (2021). A country’s National culture affects virtual learning environment adoption in higher education: A systematic review (2001–2020). Interactive Learning Environments, 1–19. https://doi.org/10.1080/10494820.2021.1967408 · DOI
  22. Li, N., Purwanto, E., Zhang, X., Cao, F., Wong, K. H., & Chen, X. (2022). Understanding the perceived pedagogical value of JazzQuiz in interactive hybrid learning among university students: A technology acceptance analysis. Interactive Learning Environments. https://doi.org/10.1080/10494820.2022.2129393 · DOI
  23. Liu, S. (2019). Everybody’s song making. Performance Research, 24(1). https://doi.org/10.1080/13528165.2019.1594267 · DOI
  24. Mänty, K., Järvenoja, H., & Törmänen, T. (2020). Socio-emotional interaction in collaborative learning: Combining individual emotional experiences and group-level emotion regulation. International Journal of Educational Research, 102, 101589. · DOI
  25. Nieminen, J. H., Tai, J., Boud, D., & Henderson, M. (2021). Student agency in feedback: Beyond the individual. Assessment & Evaluation in Higher Education, 47(1), 95–108. https://doi.org/10.1080/02602938.2021.1887080 · DOI · Paper page
  26. OECD. (2013). Trends shaping education 2013. OECD. · DOI
  27. Pekrun, R. (2005). Progress and open problems in educational emotion research. Learning and Instruction, 15(5), 497–506. · DOI · Paper page
  28. Roe, J., Renandya, W. A., & Jacobs, G. M. (2023). A review of AI-Powered writing tools and their implications for academic integrity in the Language classroom. Journal of English and Applied Linguistics, 2(1). https://doi.org/10.59588/2961-3094.1035 · DOI · Paper page
  29. Sharifi, A., Ahmadi, M., & Ala, A. (2021). The impact of artificial intelligence and digital style on industry and energy post-COVID-19 pandemic. Environmental Science and Pollution Research, 28, 46964–46984. · DOI · Paper page
  30. Spiro, R. J., Collins, B. P., & Ramchandran, A. R. (2008). Modes of openness and flexibility in cognitive flexibility hypertext learning environments. Online and distance learning: Concepts, methodologies, tools, and applications (pp. 1903–1908). IGI Global. · doi:10.4018/978-1-59904-935-9.ch152
  31. Swales, J. M., & Feak, C. (2012). Academic writing for graduate students: Essential tasks and skills. University of Michigan Press. https://doi.org/10.3998/mpub.2173936 · DOI · Paper page
  32. Swiecki, Z., Ruis, A. R., Farrell, C., & Shaffer, D. W. (2020). Assessing individual contributions to collaborative problem solving: A network analysis approach. Computers in Human Behavior, 104, 105876. https://doi.org/10.1016/j.chb.2019.01.009 · DOI · Paper page
  33. Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540 · DOI · Paper page
  34. Verpoorten, D., Westera, W., & Specht, M. (2017). Effects of isolated versus combined learning enactments in an online course. International Journal of Technology Enhanced Learning, 9(2–3), 169–185. https://doi.org/10.1504/IJTEL.2017.084499 · doi:10.1504/ijtel.2017.084499
  35. Wang, X., Liu, Q., Pang, H., Tan, S. C., Lei, J., Wallace, M. P., & Li, L. (2023b). What matters in AI-supported learning: A study of human-AI interactions in Language learning using cluster analysis and epistemic network analysis. Computers & Education, 194, 104703. · DOI · Paper page
  36. Yoon, M., Lee, J., & Jo, I. H. (2021). Video learning analytics: Investigating behavioral patterns and learner clusters in video-based online learning. The Internet and Higher Education, 50, 100806. https://doi.org/10.1016/j.iheduc.2021.100806 · DOI · Paper page
  37. Zhang, Y. (2012). Comparison of select reference management tools. Medical Reference Services Quarterly, 31(1), 45–60. · DOI

Cited by

See all 74

Metadata

Authors
Kim, J., Lee, S.-S., Detrick, R., Wang, J., & Li, N.
Venue
Journal of Computing in Higher Education
Published
2025-04-17
Volume
38
Issue
1
Pages
504-525
ISSN
  • 1042-1726
  • 1867-1233
Cited by
74
References
18
Language
en
Licence
Funders
  • Old Dominion University (300987-004)
  • Xi’an Jiaotong-Liverpool University (RC4AIED202405)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Students-Generative AI interaction patterns and its impact on academic writing. https://app.cochat.ai/papers/10.1007/s12528-025-09444-6
The paper
Kim, J., Lee, S.-S., Detrick, R., Wang, J., & Li, N. (2026). Students-Generative AI interaction patterns and its impact on academic writing. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-025-09444-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.