Collaboration with Generative Artificial Intelligence: An Exploratory Study Based on Learning Analytics
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
The emergence of Generative Artificial Intelligence (GAI) has caused significant disruption to the traditional educational teaching ecosystem. GAI possesses remarkable capabilities in generating human-like text and boasts an extensive knowledge repository, thereby paving the way for potential collaboration with humans. However, current research on collaborating with GAI within the educational context remains insufficient and the methods are relatively limited. This study aims to utilize methods such as Lag Sequential Analysis (LSA) and Epistemic Network Analysis (ENA) to unveil the “black box” of the human-machine collaborative process. In this research, 22 students engaged in collaborative tasks with GAI to refine instructional design schemes within an authentic classroom setting. The results show that the participants significantly improved the quality of instructional design. Leveraging the improvement demonstrated in students’ instructional design performance, we categorized them into high- and low-performance groups. Through the analysis of learning behavior, it was observed that the high-performance group adhered to a structured GAI content application framework: “generate → monitor → apply → evaluate.” Moreover, they adeptly employed communication strategies emphasizing exercising cognitive agency and actively cultivating a collaborative environment. The conclusions drawn from this research may serve as a reference for a series of practical applications in human-machine collaboration and provide directions for subsequent studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“These characteristics provide opportunities for large-scale collaboration with GAI in educational settings (Brown et al., 2020; Carvalho et al., 2022; Moore et al., 2022; Srinivasan, 2022).”
What is technological pedagogical content knowledge (TPACK)?
Koehler, M. J., Mishra, P., & Cain, W. (2013) · Journal of Education · doi:10.1177/002205741319300303 · Cited by 2,790
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 1×
“For instance, it offers opportunities for communication and writing practice, enhances peer communication skills, helps identify gaps in understanding speci fi c topics, and provides personalized preferences and hints based on individual learning (Farrokhnia et al., 2023).”
Walter, Y. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00448-3 · Cited by 1,113 · cited 1×
“Initially, teachers should seize opportunities to stay informed about technological advancements, with training sessions and workshops being crucial channels for educators to systematically comprehend such tools and maintain pace with knowledge updates (Walter, 2024).”
Eysenbach, G. (2023) · JMIR Medical Education · doi:10.2196/46885 · Cited by 840 · cited 1×
“Some scholars have pointed out that GAI-based learning has the potential to foster the development of students ’ higher-order thinking skills, including promoting creativity, critical thinking, and problem-solving performance (Eysenbach, 2023).”
Yilmaz, R., & Karaoglan Yilmaz, F. G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100147 · Cited by 745
Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models
Sarsa, S., Denny, P., Hellas, A., & Leinonen, J. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3501385.3543957 · Cited by 497 · cited 1×
“Research by Sarsa et al. (2022) showcased that Copilot can furnish various programming tasks along with their correct solutions.”
Better by You, better than Me? ChatGPT-3 as writing assistance in students’ essays.
Bašić, Ž., Banovac, A., Kružić, I., & Jerković, I. (2023) · doi:10.35542/osf.io/n5m7s · Cited by 189
How can we design for learning in an AI world?
Carvalho, L., Martinez-Maldonado, R., Tsai, Y.-S., Markauskaite, L., & De Laat, M. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100053 · Cited by 128 · cited 1×
“These characteristics provide opportunities for large-scale collaboration with GAI in educational settings (Brown et al., 2020; Carvalho et al., 2022; Moore et al., 2022; Srinivasan, 2022).”
Assessing the quality of student-generated short answer questions using GPT-3
Moore, S., Nguyen, H. A., Bier, N., Domadia, T., & Stamper, J. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-16290-9_18 · Cited by 93 · cited 3×
“These characteristics provide opportunities for large-scale collaboration with GAI in educational settings (Brown et al., 2020; Carvalho et al., 2022; Moore et al., 2022; Srinivasan, 2022).”
Chen, W., Tan, J. S. H., & Pi, Z. (2021) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-021-09338-6 · Cited by 83
Exploring the Learnability of Program Synthesizers by Novice Programmers
Jayagopal, D., Lubin, J., & Chasins, S. E. (2022) · Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3526113.3545659 · Cited by 40 · cited 1×
“Jayagopal et al. (2022) applied Github Copilot in undergraduate programming courses, allowing students to pair with GAI to complete programming tasks.”
Cited by
Pedagogical Applications of Generative AI in Higher Education: A Systematic Review of the Field
Qian, Y. (2025) · TechTrends · doi:10.1007/s11528-025-01100-1 · Cited by 206
“Similarly, Liu et al. (2024) found that students who performed best using GenAI tools adhered to a structured interaction framework, effectively leveraging GenAI-generated feedback to enhance their understanding.”
Zhang, L., & Xu, J. (2025) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100978 · Cited by 168
Sun, L., & Zhou, L. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241277937 · Cited by 129
“…(Koç, 2024; Kuhail et al., 2022; Qureshi, 2023) by developing their writing skills (Banihashem et al., 2024), critical thinking (Essien et al., 2024), problem-solving skills (Liu et al., 2024), and can also be effective in improving college students ’ motivation and self-ef fi cacy (Pellas, 2023).”
Zhao, G., Yang, L., Hu, B., & Wang, J. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251336154 · Cited by 27
Lu, G., & Ba, S. (2026) · Educational Psychology · doi:10.1080/01443410.2025.2489784 · Cited by 24
Metadata
- Authors
- Liu, J., Li, S., & Dong, Q.
- Venue
- Journal of Educational Computing Research
- Publisher
- SAGE Publications
- Published
- 2024-04
- Volume
- 62
- Issue
- 5
- Pages
- 1014-1046
- ISSN
- 0735-6331 (ISSN-L)
- 1541-4140
- OpenAlex
- W4393376799
- Cited by
- 60
- References
- 14
- FWCI
- 22.96
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.