Generative Artificial Intelligence in Learning Analytics: Contextualising Opportunities and Challenges through the Learning Analytics Cycle
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Generative artificial intelligence (GenAI), exemplified by ChatGPT, Midjourney, and other state-of-the-art large language models and diffusion models, holds significant potential for transforming education and enhancing human productivity. While the prevalence of GenAI in education has motivated numerous research initiatives, integrating these technologies within the learning analytics (LA) cycle and their implications for practical interventions remain underexplored. This paper delves into the prospective opportunities and challenges GenAI poses for advancing LA. We present a concise overview of the current GenAI landscape and contextualise its potential roles within Clow’s generic framework of the LA cycle. We posit that GenAI can play pivotal roles in analysing unstructured data, generating synthetic learner data, enriching multimodal learner interactions, advancing interactive and explanatory analytics, and facilitating personalisation and adaptive interventions. As the lines blur between learners and GenAI tools, a renewed understanding of learners is needed. Future research can delve deep into frameworks and methodologies that advocate for human-AI collaboration. The LA community can play a pivotal role in capturing data about human and AI contributions and exploring how they can collaborate most effectively. As LA advances, it is essential to consider the pedagogical implications and broader socioeconomic impact of GenAI for ensuring an inclusive future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293
Human agency in social cognitive theory.
Bandura, A. (1989) · American Psychologist · doi:10.1037/0003-066x.44.9.1175 · Cited by 8,263 · cited 1×
“Learner agency is defined as learners’ capacity to act independently and make decisions regarding their learning [3].”
BackgroundChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
Zimmerman, B. J. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50031-7 · Cited by 6,069 · cited 1×
“For example, based on the social cognitive perspective of self-regulation [123], a learner’s decision to use GenAI tools for specific tasks but not others could potentially offer insights into their self-efficacy, values, and strategic decision-making processes.”
BackgroundKung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101 · cited 2×
“For example, using retrieval-augmented generation [54] to connect GenAI with course resources and relevant theoretical frameworks (e.g., self-regulated learning [60, 109]) could support AI-powered dashboards to proactively recommend resources, interventions, or learning strategies to learners based…”
BackgroundMethodAyers, J. W., Poliak, A., Dredze, M., Leas, E. C., Zhu, Z., Kelley, J. B., Faix, D. J., Goodman, A. M., Longhurst, C. A., Hogarth, M., et al. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1838 · Cited by 2,613 · cited 1×
“A study highlighted that AI-generated responses to patient queries in an online forum were deemed more empathetic and of higher quality than responses from physicians by experts [2].”
BackgroundGenerative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Cognitive Theory of Multimedia Learning
Mayer, R. E. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.004 · Cited by 1,602 · cited 1×
“Apart from benefiting learners with dyslexia [58] or preferring multimedia learning [61], there is also some evidence showing that audio and video feedback was perceived as more personal, fostering learner comprehension, and more dynamic and engaging than written feedback [64, 72].”
BackgroundPractical and ethical challenges of large language models in education: A systematic scoping review
Yan, L., Sha, L., Zhao, L., Li, Y., Martinez‐Maldonado, R., Chen, G., Li, X., Jin, Y., & Gašević, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13370 · Cited by 1,435
Self-citationLet’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049 · cited 2×
“While this final step is essential to make LA more impactful and contribute to addressing immediate and long-standing challenges in education [25, 111], it is also the step that is most underdeveloped in existing LA literature [73] with merely a small amount of studies that demonstrated practical…”
BackgroundSelf-citationUsing learning analytics to scale the provision of personalised feedback
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12592 · Cited by 425 · cited 2×
“Prior studies on learners’ attitudes and expectations of LA have consistently identified personalisation as one of the expected values of LA [75, 85, 88].”
BackgroundSelf-citationCan Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, H., Li, T., Tsai, Y.-S., Gašević, D., & Chen, G. (2023) · 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt58122.2023.00100 · Cited by 395 · cited 2×
“…of GenAI to transform unstructured text into structured data [112], analyse diverse linguistic structures [117], and generate coherent feedback [15] can be integrated into functions that foster the reciprocal communications between learners and LA interventions [104], where these…”
BackgroundSelf-citationMake-A-Video: Text-to-Video Generation without Text-Video Data
Singer, U., Polyak, A., Hayes, T., Yin, X., An, J., Zhang, S., Hu, Q., Yang, H., Ashual, O., Gafni, O., et al. (2022) · arXiv · doi:10.48550/arxiv.2209.14792 · Cited by 395
Can Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, F., Li, T., Tsai, Y.-S., Gasevic, D., & Chen, G. (2023) · doi:10.35542/osf.io/hcgzj · Cited by 395
Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Koivuniemi, M., & Järvenoja, H. (2015) · Educational Technology Research and Development · doi:10.1007/s11423-014-9358-1 · Cited by 373 · cited 1×
“…forums), can be deemed reliable to a certain degree for modelling learners’ metacognitive (e.g., self-regulated learning [86, 109] and socially shared regulation of learning [39, 41]), cognitive (e.g., memory and reflection [27, 49]), and affective processes (e.g., emotion and motivation [16, 95]).”
BackgroundUsing artificial intelligence in craft education: crafting with text-to-image generative models
Vartiainen, H., & Tedre, M. (2023) · Digital Creativity · doi:10.1080/14626268.2023.2174557 · Cited by 263 · cited 1×
“Meanwhile, speech-to-text models, such as OpenAI’s Whis-per, could potentially transform educational content transcription [80] and automate the capture of collaborative discourse [7].”
MethodZhang (2021) · doi:10.1145/3432945 · Cited by 225
Molenaar, I. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100070 · Cited by 217
Tsai, Y.-S., & Gasevic, D. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027400 · Cited by 211 · cited 2×
“Such a combination has the potential to support systemic changes in education, making LA more comprehensive, evidence-based, and aligned with the real-world complexities of education [97].”
BackgroundLim, L.-A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.003 · Cited by 159 · cited 1×
“Similar opportunities may also apply to the illustration and presentation of LA. Prior LA research has demonstrated the benefits of data-driven personalised feedback in improving learners’ academic achievement [57, 75].”
BackgroundSelf-citationHuman and artificial cognition
Siemens, G., Marmolejo-Ramos, F., Gabriel, F., Medeiros, K., Marrone, R., Joksimovic, S., & de Laat, M. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100107 · Cited by 133
Learning analytics dashboards: the past, the present and the future
Verbert, K., Ochoa, X., De Croon, R., Dourado, R. A., & De Laet, T. (2020) · Proceedings of the Tenth International Conference on Learning Analytics & Knowledge · doi:10.1145/3375462.3375504 · Cited by 129 · cited 5×
“To address these issues, Verbert et al. [104] emphasised the need to move beyond building LA dashboards that serve merely as a one-way information route, where users receive information and potentially get more explanations through interaction (e.g., click on a data point).”
BackgroundInfluentialFrom Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics
Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., & Buckingham Shum, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376148 · Cited by 123 · cited 3×
“This limitation undermines the utility of explanatory analytics in open-ended learning tasks where learning behaviours were less predictable [59].”
BackgroundAdapt and overcome: Perceptions of adaptive autonomous agents for human-AI teaming
Hauptman, A. I., Schelble, B. G., McNeese, N. J., & Madathil, K. C. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107451 · Cited by 110
Towards investigating the validity of measurement of self-regulated learning based on trace data
Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09291-1 · Cited by 101 · cited 1×
“This ensures that the essence of learning remains deeply rooted in human-centric principles.”
BackgroundSelf-citationCan large language models write reflectively
Li, Y., Sha, L., Yan, L., Lin, J., Raković, M., Galbraith, K., Lyons, K., Gašević, D., & Chen, G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100140 · Cited by 99 · cited 2×
“These models also out-performed average students in reflective writing tasks [56] and innovated conversational assessments that could potentially transform conventional digital formative assessments [116].”
BackgroundSelf-citationScalability, Sustainability, and Ethicality of Multimodal Learning Analytics
Yan, L., Zhao, L., Gasevic, D., & Martinez-Maldonado, R. (2022) · LAK22: 12th International Learning Analytics and Knowledge Conference · doi:10.1145/3506860.3506862 · Cited by 83 · cited 4×
“Such integration could advance future LA interventions, making them more adaptive and holistic.”
BackgroundInfluentialSelf-citationReflective writing analytics for actionable feedback
Gibson, A., Aitken, A., Sándor, Á., Buckingham Shum, S., Tsingos-Lucas, C., & Knight, S. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027436 · Cited by 83
Multimodal Learning Analytics: Rationale, Process, Examples, and Direction
Ochoa, X. (2022) · The Handbook of Learning Analytics · doi:10.18608/hla22.006 · Cited by 81
PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis
Gebreegziabher, S. A., Zhang, Z., Tang, X., Meng, Y., Glassman, E. L., & Li, T. J.-J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581352 · Cited by 72
Echeverria, V., Martinez-Maldonado, R., Buckingham Shum, S., Chiluiza, K., Granda, R., & Conati, C. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.6 · Cited by 70 · cited 1×
“Moving away from exploratory and towards explanatory visual LA could facilitate learners’ and educators’ ease of interpretation and provide more actionable insights [20].”
BackgroundA Comparison of Text, Voice, and Screencasting Feedback to Online Students
Orlando, J. (2016) · American Journal of Distance Education · doi:10.1080/08923647.2016.1187472 · Cited by 54
“A Comparative Analysis of Automatic Speech Recognition Errors in Small Group Classroom Discourse.”
Cao, J., Ganesh, A., Cai, J., Southwell, R., Perkoff, E. M., Regan, M., Kann, K., Martin, J. H., Palmer, M., & D'Mello, S. (2023) · Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3565472.3595606 · Cited by 25
An Intelligent Virtual Standard Patient for Medical Students Training Based on Oral Knowledge Graph
Song, W., Hou, X., Li, S., Chen, C., Gao, D., Wang, X., Sun, Y., Hou, J., & Hao, A. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3205456 · Cited by 18 · cited 1×
“…models, using these AI agents to play the role of learners, educators, and specialised roles, such as standard patients for medical students’ diagnosis practice training [94], could open up a range of novel learning opportunities, and thus, generating rich data for future LA research to tackle.”
BackgroundApplications of learning analytics in Latin America
Pontual Falcão, T., Ferreira Mello, R., & Lins Rodrigues, R. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12978 · Cited by 16 · cited 1×
“Such economic barriers could widen the digital divide, placing advanced GenAI-powered LA tools out of reach for many learners, especially those in under-resourced settings [77].”
Background
Cited by
Jin, Y., Yan, L., Echeverria, V., Gašević, D., & Martinez-Maldonado, R. (2024) · arXiv · doi:10.48550/arxiv.2405.11800 · Cited by 447
“Moreover, the compatibility between GAI and the goal of fostering innovation and 21st-century skills stressed the need to integrate these tools into educational practices, ensuring that institutions remain relevant in an AI-influenced future (Yan et al., 2024a; Darvishi et al., 2023).”
InfluentialSelf-citationAn, Y., Yu, J. H., & James, S. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00507-3 · Cited by 403
“There are also concerns about unequal access to GenAI tools, student privacy and data security, biases in AI algorithms, and the spread of fraudulent information generated by AI (Ghimire & Edwards, 2024; Luo, 2024; Rudolph et al., 2023; Sullivan et al., 2023; UNESCO, 2023; Yan et al., 2024b).”
Jin, Y., Yan, L., Echeverria, V., Gašević, D., & Martinez-Maldonado, R. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100348 · Cited by 452
Self-citationDai, W., Tsai, Y.-S., Lin, J., Aldino, A., Jin, H., Li, T., Gašević, D., & Chen, G. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100299 · Cited by 93
Self-citationYan, L., Martinez-Maldonado, R., Jin, Y., Echeverria, V., Milesi, M., Fan, J., Zhao, L., Alfredo, R., Li, X., & Gašević, D. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105322 · Cited by 85
Self-citation
Metadata
- Authors
- Yan, L., Martinez-Maldonado, R., & Gasevic, D.
- Venue
- Proceedings of the 14th Learning Analytics and Knowledge Conference
- Publisher
- ACM
- Published
- 2024-03-18
- Pages
- 101-111
- OpenAlex
- W4389325641
- Cited by
- 102
- References
- 37
- FWCI
- 45.81
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.