The End is the Beginning is the End: The closed-loop learning analytics framework
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
This article provides a comprehensive review of current practices and methodologies within the field of learning analytics, structured around a dedicated closed-loop framework. This framework effectively integrates various aspects of learning analytics into a cohesive framework, emphasizing the interplay between data collection, processing and analysis, as well as adaptivity and personalization, all connected by the learners involved and underpinned by educational and psychological theory. In reviewing each step of the closed loop, the article delves into the advancements in data collection, exploring how technological progress has expanded data collection methods, particularly focusing on the potential of multimodal data acquisition and how theory can inform this step. The processing and analysis step is thoroughly reviewed, highlighting a range of methods including machine learning and AI, and discussing the critical balance between prediction accuracy and interpretability. The adaptivity and personalization step examines the current state of research, underscoring significant gaps and the necessity for theory-informed, personalized learning interventions. Overall, the article underscores the importance of interdisciplinarity in learning analytics, advocating for the integration of insights from various fields to address challenges such as ethical data usage and the creation of quality learning experiences. This framework and review aim to guide future research and practice in learning analytics, promoting the development of effective, learner-centric educational environments driven by balancing data-driven insights and theoretical understanding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197
THE ROLE OF TUTORING IN PROBLEM SOLVING *
Wood, D., Bruner, J. S., & Ross, G. (1976) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1976.tb00381.x · Cited by 8,851
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
Self-citationChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Self-citationHeart rate variability: origins, methods, and interpretive caveats
BERNTSON, G. G., THOMAS BIGGER, J., ECKBERG, D. L., GROSSMAN, P., KAUFMANN, P. G., MALIK, M., NAGARAJA, H. N., PORGES, S. W., SAUL, J. P., STONE, P. H., et al. (1997) · Psychophysiology · doi:10.1111/j.1469-8986.1997.tb02140.x · Cited by 3,962
Feedback and Self-Regulated Learning: A Theoretical Synthesis
Butler, D. L., & Winne, P. H. (1995) · Review of Educational Research · doi:10.3102/00346543065003245 · Cited by 3,334
The ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Ferrari, M., & Quaresima, V. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.049 · Cited by 2,274
Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020
Cognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
The theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research
Wisniewski, B., Zierer, K., & Hattie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03087 · Cited by 1,199
Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056
Let’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049
Pea, R. D. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1303_6 · Cited by 1,047
Measuring student engagement in technology-mediated learning: A review
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.09.005 · Cited by 1,010
Application and theory gaps during the rise of artificial intelligence in education
Chen, X., Xie, H., Zou, D., & Hwang, G.-J. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100002 · Cited by 1,003
Intelligent tutoring systems and learning outcomes: A meta-analysis
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014) · Journal of Educational Psychology · doi:10.1037/a0037123 · Cited by 840
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793
The current landscape of learning analytics in higher education
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.027 · Cited by 766
AutoTutor: an intelligent tutoring system with mixed-initiative dialogue.
Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005) · IEEE Transactions on Education · doi:10.1109/te.2005.856149 · Cited by 750
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2021) · arXiv · doi:10.48550/arxiv.2112.10752 · Cited by 737
Help Seeking and Help Design in Interactive Learning Environments
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003) · Review of Educational Research · doi:10.3102/00346543073003277 · Cited by 609
Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564
Are We There Yet? - A Systematic Literature Review on Chatbots in Education
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.654924 · Cited by 557
Toward a script theory of guidance in computer-supported collaborative learning
Fischer, F., Kollar, I., Stegmann, K., & Wecker, C. (2013) · Educational Psychologist · doi:10.1080/00461520.2012.748005 · Cited by 525
Toward an Instructionally Oriented Theory of Example‐Based Learning
Renkl, A. (2014) · Cognitive Science · doi:10.1111/cogs.12086 · Cited by 509
Stealth Assessment: Measuring and Supporting Learning in Video Games
Shute, V., & Ventura, M. (2013) · doi:10.7551/mitpress/9589.001.0001 · Cited by 406
The power of internal feedback: Exploiting natural comparison processes
Nicol, D. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1823314 · Cited by 402
Measuring emotions during epistemic activities: the Epistemically-Related Emotion Scales
Pekrun, R., Vogl, E., Muis, K. R., & Sinatra, G. M. (2017) · Cognition and Emotion · doi:10.1080/02699931.2016.1204989 · Cited by 373
Steenbergen-Hu, S., & Cooper, H. (2014) · Journal of Educational Psychology · doi:10.1037/a0034752 · Cited by 355
Towards hybrid human‐AI learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348
Synthesizing Results From Empirical Research on Computer-Based Scaffolding in STEM Education
Belland, B. R., Walker, A. E., Kim, N. J., & Lefler, M. (2017) · Review of Educational Research · doi:10.3102/0034654316670999 · Cited by 346
Azevedo, R., & Gašević, D. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.025 · Cited by 345
Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017) · Educational Psychology Review · doi:10.1007/s10648-016-9361-7 · Cited by 278
Cognition and Metacognition within Self-Regulated Learning
Winne, P. H. (2017) · Handbook of Self-Regulation of Learning and Performance · doi:10.4324/9781315697048-3 · Cited by 274
Exploring feedback and student characteristics relevant for personalizing feedback strategies
Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., & Melis, E. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.09.011 · Cited by 260
Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics
Duan, L., Liu, J., Yang, W., Huang, T., & Gao, W. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3016485 · Cited by 260
Gal, R., May, A. M., van Overmeeren, E. J., Simons, M., & Monninkhof, E. M. (2018) · Sports Medicine - Open · doi:10.1186/s40798-018-0157-9 · Cited by 257
Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235
Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence
Freeman, J., Avons, S. E., Pearson, D. E., & IJsselsteijn, W. A. (1999) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474699566017 · Cited by 233
Zhu, M., Liu, O. L., & Lee, H.-S. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103668 · Cited by 229
Chen, O., Paas, F., & Sweller, J. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09782-w · Cited by 224
Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217
Cognitive load theory and individual differences
Sweller, J. (2024) · Learning and Individual Differences · doi:10.1016/j.lindif.2024.102423 · Cited by 214
Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning
Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107547 · Cited by 198
Self-regulated Learning with MetaTutor: Advancing the Science of Learning with MetaCognitive Tools
Azevedo, R., Johnson, A., Chauncey, A., & Burkett, C. (2010) · New Science of Learning · doi:10.1007/978-1-4419-5716-0_11 · Cited by 189
Patchan, M. M., & Schunn, C. D. (2015) · Instructional Science · doi:10.1007/s11251-015-9353-x · Cited by 181
Stark, R., Kopp, V., & Fischer, M. R. (2011) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.10.001 · Cited by 154
Bauer, E., Greisel, M., Kuznetsov, I., Berndt, M., Kollar, I., Dresel, M., Fischer, M. R., & Fischer, F. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13336 · Cited by 130
Self-citationThe Cambridge Handbook of the Learning Sciences
(2022) · doi:10.1017/9781108888295 · Cited by 122
Sailer, M., Bauer, E., Hofmann, R., Kiesewetter, J., Glas, J., Gurevych, I., & Fischer, F. (2023) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101620 · Cited by 106
Self-citationTowards investigating the validity of measurement of self-regulated learning based on trace data
Fan, Y., van der Graaf, J., Lim, L., Raković, M., Singh, S., Kilgour, J., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09291-1 · Cited by 101
Productive failure in learning from generation and invention activities
Kapur, M., & Rummel, N. (2012) · Instructional Science · doi:10.1007/s11251-012-9235-4 · Cited by 87
Huber, S. E., Kiili, K., Nebel, S., Ryan, R. M., Sailer, M., & Ninaus, M. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09868-z · Cited by 85
Self-citationMultimodal Learning Analytics: Rationale, Process, Examples, and Direction
Ochoa, X. (2022) · The Handbook of Learning Analytics · doi:10.18608/hla22.006 · Cited by 81
A meta-analysis of the effectiveness of ALEKS on learning
Fang, Y., Ren, Z., Hu, X., & Graesser, A. C. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1495829 · Cited by 79
Staying on target: A systematic literature review on learner‐facing learning analytics dashboards
Valle, N., Antonenko, P., Dawson, K., & Huggins‐Manley, A. C. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13089 · Cited by 79
Capturing motivation and emotion regulation during a learning process
Järvenoja, H., Järvelä, S., Törmänen, T., Näykki, P., Malmberg, J., Kurki, K., Mykkänen, A., & Isohätälä, J. (2018) · frontline Learning Research · doi:10.14786/flr.v6i3.369 · Cited by 77
The equalizing effect of teacher dashboards on feedback in K-12 classrooms
Knoop-van Campen, C. A. N., Wise, A., & Molenaar, I. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1931346 · Cited by 58
The validity and utility of activity logs as a measure of student engagement
Motz, B., Quick, J., Schroeder, N., Zook, J., & Gunkel, M. (2019) · Proceedings of the 9th International Conference on Learning Analytics & Knowledge · doi:10.1145/3303772.3303789 · Cited by 47
Drugova, E., Zhuravleva, I., Zakharova, U., & Latipov, A. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12894 · Cited by 39
Cited by
Looking Beyond the Hype: Understanding the Effects of AI on Learning
Bauer, E., Greiff, S., Graesser, A. C., Scheiter, K., & Sailer, M. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10020-8 · Cited by 153
Self-citationArtificial intelligence in multimodal learning analytics: a systematic literature review
Mohammadi, M., Tajik, E., Martinez-Maldonado, R., Sadiq, S., Tomaszewski, W., & Khosravi, H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100426 · Cited by 85
Schiller, R., Fleckenstein, J., Mertens, U., Horbach, A., & Meyer, J. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105163 · Cited by 36
On the role of engagement in automated feedback effectiveness: Insights from keystroke logging
Schiller, R., Fleckenstein, J., Höft, L., Horbach, A., & Meyer, J. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105386 · Cited by 14
Ali, M., Ma, M., Muneeb, M., & Wong, G. K. W. (2025) · Metrics · doi:10.3390/metrics2040023 · Cited by 6
Metadata
- Authors
- Sailer, M., Ninaus, M., Huber, S. E., Bauer, E., & Greiff, S.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2024-09
- Volume
- 158
- Pages
- 108305
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W4396950990
- Cited by
- 53
- References
- 67
- FWCI
- 20.54
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.