Students-Generative AI interaction patterns and its impact on academic writing
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Considering both the transformative opportunities and challenges presented by generative AI (GenAI) in academic writing, effectively integrating GenAI into the academic setting becomes a significant need requiring prioritization. Yet, there is limited understanding regarding the nature of interactions between different types of students, what behavioral patterns students exhibit during a student-GenAI interaction (SAI) on a given task, and how these different SAI patterns relate to the actual writing task performance. This study, therefore, aimed to identify SAI patterns of academic writing tasks depending on students’ level of AI literacy and examine the differences in academic writing performance between the identified SAI patterns. Drawing from the combination of three data sources, including think-aloud protocols, screen-recordings, and chat histories between 36 Chinese graduate students and a GenAI writing system, epistemic network analysis (ENA) was used to reveal the distinctive SAI patterns of students with different levels of AI literacy. The study found that students with a high level of AI literacy exhibited a collaborative approach to SAI, actively accepting GenAI’s suggestions and engaging GenAI in meta-cognitive-related activities such as planning, whereas students with a low level of AI literacy demonstrated much less interaction with GenAI in completing their writing tasks, instead choosing to ideate and evaluate independently. In addition, the Wilcoxon rank-sum (Mann-Whitney U) test was conducted to assess the writing task performance of the two AI literacy groups. Findings revealed statistical differences in all evaluation rubrics (content, structure/organization, expression). This study offers implications for the design and implementation of GenAI agents in writing tasks and the pedagogy of GenAI-assisted instruction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There are differences in the needs of students in different majors for GenAI, with art students preferring GenAI to stimulate creativity and provide a variety of outputs, while technology students are more concerned with accuracy and efficiency (Kim et al., 2025b).”
From Exploring the factors influencing college students’ learning satisfaction in generative AI-supported MOOCs learning environment: a learning experience framework perspective (2025) · cites this paper as Kim et al., 2025b
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 1×
“Before the experiment, all participants were asked to answer AI literacy level questionnaires (7-point Likert-scale) adapted from Long and Magerko ( 2020) that include, for instance, ‘I can distinguish between devices utilizing AI and devices that are not.’”
Students' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504 · cited 2×
“Positive emotions can be fostered through immedi - ate, constructive feedback which helps students manage potential frustrations in the writing process (Chan & Hu, 2023 ).”
Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00411-8 · Cited by 2,301 · cited 2×
“Positive emotions can be fostered through immedi - ate, constructive feedback which helps students manage potential frustrations in the writing process (Chan & Hu, 2023 ).”
Walter, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00448-3 · Cited by 1,113 · cited 2×
“In the educa - tional context, the advent of AI has underscored the need for enhanced AI literacy among teachers and students (Walter, 2024 ).”
Bond, M., Khosravi, H., De Laat, M., Bergdahl, N., Negrea, V., Oxley, E., Pham, P., Chong, S. W., & Siemens, G. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00436-z · Cited by 852 · cited 1×
“The confidence level in utilizing these devices can significantly influence how information systems incorporating AI algorithms are perceived and used (Bond et al., 2024 ; Delcker et al., 2024 ).”
Human-AI collaboration patterns in AI-assisted academic writing
Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024) · Studies in Higher Education · doi:10.1080/03075079.2024.2323593 · Cited by 449 · cited 5×
“In contrast, some students merely used AI in a linear fashion where they typically copied generated content into their essays seemingly without assessing it, and, as a result, had lower performance outcomes on their final essay (Nguyen et al., 2024 ).”
InfluentialExploring AI chatbot affordances in the EFL classroom: young learners’ experiences and perspectives
Jeon, J. (2024) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.2021241 · Cited by 433
Exploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100296 · Cited by 418
Leading teachers' perspective on teacher-AI collaboration in education
Kim, J. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12109-5 · Cited by 376
Self-citationMeyer, J., Jansen, T., Schiller, R., Liebenow, L. W., Steinbach, M., Horbach, A., & Fleckenstein, J. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100199 · Cited by 311 · cited 1×
“Similarly, Meyer et al. ( 2024) reported that the automated, evidence-based feedback received during GenAI-assisted argumentative writing tasks induces achievement emotions such as enjoyment and pride, enhancing students’ emotional experience and perseverance with a task in a GenAI-assisted…”
Research works printed but not linked: 37
- Ahmad, Z. (2019). Analyzing argumentative essay as an academic genre on assessment framework of IELTS and TOEFL. In english Language teaching research in the middle East and North Africa (pp. 279–299). Palgrave Macmillan. · DOI
- Aldabbus, S., & Almansouri, E. (2022). Academic writing difficulties encountered by university EFL learners. British Journal of English Linguistics, 10(3), 1–11. https://doi.org/10.37745/bjel.2013/vol10n3111 · DOI · Paper page
- Allen, L. K., & McNamara, D. S. (2017). Five Building blocks for comprehension strategy instruction. In A. León José, & E. Inmaculada (Eds.), Reading comprehension in educational settings (pp. 125–144). John Benjamins Publishing Company. https://doi.org/10.1075/swll.16.05all · DOI
- Ayanwale, M. A., & Molefi, R. R. (2024). Exploring intention of undergraduate students to embrace chatbots: From the vantage point of Lesotho. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00451-8 · DOI
- Barak, M., & Levenberg, A. (2016). Flexible thinking in learning: An individual differences measure for learning in technology-enhanced environments. Computers & Education, 99, 39–52. · DOI · Paper page
- Behrooz, H., Lipizzi, C., Korfiatis, G., Ilbeigi, M., Powell, M., & Nouri, M. (2023). Towards automating the identification of sustainable projects seeking financial support: An AI-powered approach. Sustainability, 15(12), 9701. · DOI
- Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The challenges and opportunities of AI-assisted writing: Developing AI literacy for the AI age. Business and Professional Communication Quarterly, 86(3), 257–295. https://doi.org/10.1177/23294906231176517 · DOI · Paper page
- Chango, W., Cerezo, R., Sanchez-Santillan, M., Azevedo, R., & Romero, C. (2021). Improving prediction of students’ performance in intelligent tutoring systems using attribute selection and ensembles of different multimodal data sources. Journal of Computing in Higher Education, 33(3), 614–634. https://doi.org/10.1007/s12528-021-09298-8 · DOI · Paper page
- Chichekian, T., & Benteux, B. (2022). The potential of learning with (and not from) artificial intelligence in education. Frontiers in Artificial Intelligence, 5, 903051. · DOI · Paper page
- Delcker, J., Heil, J., Ifenthaler, D., Seufert, S., & Spirgi, L. (2024). First-year students AI-competence as a predictor for intended and de facto use of AI-tools for supporting learning processes in higher education. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00452-7 · DOI · Paper page
- Engwall, O., & Lopes, J. (2020). Interaction and collaboration in robot-assisted Language learning for adults. Computer Assisted Language Learning, 1–37. https://doi.org/10.1080/09588221.2020.1799821 · DOI
- Gupta, S., Jaiswal, A., Paramasivam, A., & Kotecha, J. (2022). Academic writing challenges and supports: Perspectives of international doctoral students and their supervisors. Frontiers in Education, 7, 891534. https://doi.org/10.3389/feduc.2022.891534 · DOI
- Hall, R. (2024). Generative AI and re-weaving a pedagogical horizon of social possibility. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00445-6 · DOI
- Hyland, K. (2014). English for academic purposes. In Leung, C., & Street, B. V. (Eds.), The Routledge companion to English studies (pp. 392–404). Routledge. https://doi-org.proxy.lib.odu.edu/https://doi.org/10.4324/9781315852515 · DOI
- Kim, J. (2024b). Types of teacher-AI collaboration in K-12 classroom instruction: Chinese teachers’ perspective. Education and Information Technologies, 29, 17433–17465. https://doi.org/10.1007/s10639-024-12523-3 · DOI
- Kim, J., & Lee, S. S. (2023). Are two heads better than one? The effect of student-AI collaboration on students’ learning task performance. TechTrends, 67(2), 365–375. https://doi.org/10.1007/s11528-022-00788-9 · DOI · Paper page
- Kim, J., Ham, Y., & Lee, S. S. (2024). Differences in student-AI interaction process on a drawing task: Focusing on students’ attitude towards AI and the level of drawing skills. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.8859 · DOI · Paper page
- Kim, J., Yu, S., Lee, S. S., & Derrick, R. (2025). Students’ Prompt patterns and its effects in AI-assisted academic writing: Focusing on students’ level of AI literacy. Journal of Research on Technology in Education, 1–18. https://doi.org/10.1080/15391523.2025.2456043 · DOI
- Lee, S. S., Li, N., & Kim, J. (2023). Conceptual model for Mexican teachers’ adoption of learning analytics systems: The integration of the information system success model and the technology acceptance model. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12371-7 · DOI
- Lemaignan, S., Warnier, M., Sisbot, E. A., Clodic, A., & Alami, R. (2017). Artificial cognition for social human–robot interaction: An implementation. Artificial Intelligence, 247, 45–69. · DOI · Paper page
- Li, N., Zhang, X., & Limniou, M. (2021). A country’s National culture affects virtual learning environment adoption in higher education: A systematic review (2001–2020). Interactive Learning Environments, 1–19. https://doi.org/10.1080/10494820.2021.1967408 · DOI
- Li, N., Purwanto, E., Zhang, X., Cao, F., Wong, K. H., & Chen, X. (2022). Understanding the perceived pedagogical value of JazzQuiz in interactive hybrid learning among university students: A technology acceptance analysis. Interactive Learning Environments. https://doi.org/10.1080/10494820.2022.2129393 · DOI
- Liu, S. (2019). Everybody’s song making. Performance Research, 24(1). https://doi.org/10.1080/13528165.2019.1594267 · DOI
- Mänty, K., Järvenoja, H., & Törmänen, T. (2020). Socio-emotional interaction in collaborative learning: Combining individual emotional experiences and group-level emotion regulation. International Journal of Educational Research, 102, 101589. · DOI
- Nieminen, J. H., Tai, J., Boud, D., & Henderson, M. (2021). Student agency in feedback: Beyond the individual. Assessment & Evaluation in Higher Education, 47(1), 95–108. https://doi.org/10.1080/02602938.2021.1887080 · DOI · Paper page
- OECD. (2013). Trends shaping education 2013. OECD. · DOI
- Pekrun, R. (2005). Progress and open problems in educational emotion research. Learning and Instruction, 15(5), 497–506. · DOI · Paper page
- Roe, J., Renandya, W. A., & Jacobs, G. M. (2023). A review of AI-Powered writing tools and their implications for academic integrity in the Language classroom. Journal of English and Applied Linguistics, 2(1). https://doi.org/10.59588/2961-3094.1035 · DOI · Paper page
- Sharifi, A., Ahmadi, M., & Ala, A. (2021). The impact of artificial intelligence and digital style on industry and energy post-COVID-19 pandemic. Environmental Science and Pollution Research, 28, 46964–46984. · DOI · Paper page
- Spiro, R. J., Collins, B. P., & Ramchandran, A. R. (2008). Modes of openness and flexibility in cognitive flexibility hypertext learning environments. Online and distance learning: Concepts, methodologies, tools, and applications (pp. 1903–1908). IGI Global. · doi:10.4018/978-1-59904-935-9.ch152
- Swales, J. M., & Feak, C. (2012). Academic writing for graduate students: Essential tasks and skills. University of Michigan Press. https://doi.org/10.3998/mpub.2173936 · DOI · Paper page
- Swiecki, Z., Ruis, A. R., Farrell, C., & Shaffer, D. W. (2020). Assessing individual contributions to collaborative problem solving: A network analysis approach. Computers in Human Behavior, 104, 105876. https://doi.org/10.1016/j.chb.2019.01.009 · DOI · Paper page
- Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540 · DOI · Paper page
- Verpoorten, D., Westera, W., & Specht, M. (2017). Effects of isolated versus combined learning enactments in an online course. International Journal of Technology Enhanced Learning, 9(2–3), 169–185. https://doi.org/10.1504/IJTEL.2017.084499 · doi:10.1504/ijtel.2017.084499
- Wang, X., Liu, Q., Pang, H., Tan, S. C., Lei, J., Wallace, M. P., & Li, L. (2023b). What matters in AI-supported learning: A study of human-AI interactions in Language learning using cluster analysis and epistemic network analysis. Computers & Education, 194, 104703. · DOI · Paper page
- Yoon, M., Lee, J., & Jo, I. H. (2021). Video learning analytics: Investigating behavioral patterns and learner clusters in video-based online learning. The Internet and Higher Education, 50, 100806. https://doi.org/10.1016/j.iheduc.2021.100806 · DOI · Paper page
- Zhang, Y. (2012). Comparison of select reference management tools. Medical Reference Services Quarterly, 31(1), 45–60. · DOI
Cited by
Patel, K., Shah, M., Qureshi, K. M., & Qureshi, M. R. N. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11435-z · Cited by 42
Zhu, H., & Yang, S. (2026) · Behavioral Sciences · doi:10.3390/bs16020304 · Cited by 13
“This includes acts such as logical restructuring (H. Jung & Park, 2023), frame generation (Gahar et al., 2025), textual expression optimization, and stylistic transformation (De Wilde, 2024; Kim et al., 2025).”
Lv, P., Wang, X., Nie, Y., Wu, R., & Wang, L. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1633686 · Cited by 5
Metadata
- Authors
- Kim, J., Lee, S.-S., Detrick, R., Wang, J., & Li, N.
- Venue
- Journal of Computing in Higher Education
- Published
- 2025-04-17
- Volume
- 38
- Issue
- 1
- Pages
- 504-525
- ISSN
- 1042-1726
- 1867-1233
- Cited by
- 74
- References
- 18
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- Old Dominion University (300987-004)
- Xi’an Jiaotong-Liverpool University (RC4AIED202405)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Students-Generative AI interaction patterns and its impact on academic writing. https://app.cochat.ai/papers/10.1007/s12528-025-09444-6
- The paper
- Kim, J., Lee, S.-S., Detrick, R., Wang, J., & Li, N. (2026). Students-Generative AI interaction patterns and its impact on academic writing. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-025-09444-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.