Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 46

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence

de Mooij, Susanne, Lämsä, Joni, Lim, Lyn, Aksela, Olli, Athavale, Shruti, Bistolfi, Inti, Jin, Flora, Li, Tongguang, Azevedo, Roger, Bannert, Maria, Gašević, Dragan, Järvelä, Sanna, Molenaar, Inge · 2025 · Educational Psychology Review

Abstract

While behavioral, contextual, and physiological data streams have long been used to investigate self-regulated learning (SRL), a systematic understanding of the current state how different data streams and modalities contribute to measuring regulation processes across diverse learning contexts remains limited. This systematic literature review provides a foundational step toward this understanding by addressing two objectives: (1) identifying which data streams and modalities researchers have used to capture cognitive, affective, metacognitive, and motivational (CAMM) processes underlying SRL, and (2) examining how multimodal data analytics have been applied to capture the temporal and sequential characteristics of these processes across study contexts. The studies were mapped onto the Self-Regulated Learning Processes, Multimodal Data, and Analysis grid, a two-dimensional framework with CAMM processes on one axis and multimodal data streams on the other. By evaluating four analytic approaches—unimodal, horizontal, vertical, and integrated—we identify how different combinations of data streams and processes have been employed. Our findings reveal a shift from unimodal approaches (one data stream, one process), to more integrated approaches (combining multiple data streams and processes). Although multimodal data collection is increasingly common, gaps remain, especially in measuring motivation and affective states. Futhermore, analytic methods often do not reflect alignment between data streams, with standard statistics predominating even in integrated approaches, whereas AI-based analytics may be more suited. This review positions itself as a foundational step in advancing SRL measurement, offering insights into current practices and highlighting the need for more sophisticated methods to capture SRL across diverse learning contexts.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10648-025-10028-0

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 51

  1. Azevedo, R. (2020). Reflections on the field of metacognition: Issues, challenges, and opportunities. Metacognition and Learning, 15(2), 91–98. https://doi.org/10.1007/s11409-020-09231-x · DOI
  2. Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025 · DOI · Paper page
  3. Baker, M., & Reimann, P. (2024). CSCL: A learning and collaboration science. International Journal of Computer-Supported Collaborative Learning, 19, 273–281. · DOI
  4. Borchers, C., Zhang, J., Baker, R. S., & Aleven, V. (2024). Using think-aloud data to understand relations between self-regulation cycle characteristics and student performance in intelligent tutoring systems. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 529–539), ACM. https://doi.org/10.1145/3636555.3636911 · DOI
  5. Chung, C.-Y., & Hsiao, I.-H. (2019). Quantitative analytics in exploring self-regulated learning behaviors: Effects of study persistence and regularity. In 2019 IEEE frontiers in education conference (FIE), (pp. 1–9). https://doi.org/10.1109/FIE43999.2019.9028665 · DOI
  6. Di Mitri, D., Schneider, J., Specht, M., & Drachsler, H. (2018). From signals to knowledge: A conceptual model for multimodal learning analytics. Journal of Computer Assisted Learning, 34(4), 338–349. https://doi.org/10.1111/jcal.12288 · DOI · Paper page
  7. Dindar, M., Alikhani, I., Malmberg, J., Jarvela, S., & Seppanen, T. (2019). Examining shared monitoring in collaborative learning: A case of a recurrence quantification analysis approach. Computers in Human Behavior, 100, 335–344. https://doi.org/10.1016/j.chb.2019.03.004 · DOI
  8. Efklides, A., & Schwartz, B. L. (2024). Revisiting the metacognitive and affective model of self-regulated learning: Origins, development, and future directions. Educational Psychology Review, 36(2), 61. https://doi.org/10.1007/s10648-024-09896-9 · DOI
  9. Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2024). GPTs are GPTs: Labor market impact potential of LLMs. Science, 384(6702), 1306–1308. https://doi.org/10.1126/science.adj0998 · doi:10.1126/science.adj0998 · Paper page
  10. Fan, Y., Rakovic, M., Van Der Graaf, J., Lim, L., Singh, S., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2023). Towards a fuller picture: Triangulation and integration of the measurement of self-regulated learning based on trace and think aloud data. Journal of Computer Assisted Learning, jcal.12801,. https://doi.org/10.1111/jcal.12801 · DOI
  11. Feng, S., Yan, L., Zhao, L., Maldonado, R. M., & Gašević, D. (2024). Heterogenous network analytics of small group teamwork: Using multimodal data to uncover individual behavioral engagement strategies. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 587–597), ACM. https://doi.org/10.1145/3636555.3636918 · DOI
  12. Gray, G., & Bergner, Y. (2022). A practitioner’s guide to measurement in learning analytics: Decisions, opportunities, and challenges. In Handbook of learning analytics (pp. 20–28). SOLAR. · DOI
  13. Greene, J. A., Bernacki, M. L., & Hadwin, A. (2024). Self-regulation. In Handbook of educational psychology (pp. 314–334). Routledge. · DOI
  14. Harley, J. M., Taub, M., Azevedo, R., & Bouchet, F. (2018). let’s set up some subgoals: Understanding human-pedagogical agent collaborations and their implications for learning and prompt and feedback compliance. IEEE Transactions on Learning Technologies, 11(1), 54–66. https://doi.org/10.1109/TLT.2017.2756629 · DOI
  15. Järvelä, S., & Bannert, M. (2021). Temporal and adaptive processes of regulated learning—What can multimodal data tell? Learning and Instruction, 72, 101268. https://doi.org/10.1016/j.learninstruc.2019.101268 · DOI · Paper page
  16. Järvelä, S., & Hadwin, A. (2024). Triggers for self-regulated learning: A conceptual framework for advancing multimodal research about SRL. Learning and Individual Differences, 115, 102526. https://doi.org/10.1016/j.lindif.2024.102526 · DOI
  17. Järvenoja, H., Törmänen, T., Järvelä, S., spsampsps Shubina, T. (2023). Motivation and emotion regulation in collaborative learning contexts. In Motivation and emotion in learning and teaching across educational contexts (pp. 100–113). Routledge. · DOI
  18. Khiat, H., & Vogel, S. (2022). A self-regulated learning management system: Enhancing performance, motivation and reflection in learning. Journal of University Teaching and Learning Practice, 19(2), 43–59. https://doi.org/10.53761/1.19.2.4 · DOI
  19. Lämsä, J., De Mooij, S., Aksela, O., Athavale, S., Bistolfi, I., Azevedo, R., Bannert, M., Gasevic, D., Molenaar, I., & Järvelä, S. (2025). Measuring secondary education students’ self-regulated learning processes with digital trace data. Learning and Individual Differences, 118, 102625. https://doi.org/10.1016/j.lindif.2024.102625 · DOI
  20. Li, J., Majumdar, R., & Ogata, H. (2021). Mining mathematics learning strategies of high and low performing students using log data. International Conference on Advanced Learning Technologies (ICALT), 2021, 229–230. https://doi.org/10.1109/ICALT52272.2021.00074 · doi:10.1109/icalt52272.2021.00074
  21. Li, S., Zheng, J., Huang, X., & Xie, C. (2022). Self-regulated learning as a complex dynamical system: Examining students’ STEM learning in a simulation environment. Learning and Individual Differences, 95, 102144. https://doi.org/10.1016/j.lindif.2022.102144 · DOI
  22. Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R. F., Morales, N., & Munoz-Gama, J. (2018). Mining theory-based patterns from big data: Identifying self-regulated learning strategies in massive open online courses. Computers in Human Behavior, 80, 179–196. https://doi.org/10.1016/j.chb.2017.11.011 · DOI · Paper page
  23. Matcha, W., Gašević, D., Jovanović, J., Uzir, N. A., Oliver, C. W., Murray, A., & Gasevic, D. (2020). Analytics of learning strategies: The association with the personality traits. In Proceedings of the tenth international conference on learning analytics & knowledge, (pp. 151–160), ACM. https://doi.org/10.1145/3375462.3375534 · DOI
  24. McCardle, L., & Hadwin, A. F. (2015). Using multiple, contextualized data sources to measure learners’ perceptions of their self-regulated learning. Metacognition and Learning, 10(1), 43–75. https://doi.org/10.1007/s11409-014-9132-0 · DOI
  25. Mejia-Domenzain, P., Nazaretsky, T., Schultze, S., Hochweber, J., spsampsps Käser, T. (2024). Navigating self-regulated learning dimensions: Exploring interactions across modalities. In A. M. Olney, I.-A. Chounta, Z. Liu, O. C. Santos, spsampsps I. I. Bittencourt (Eds.), Artificial intelligence in education (Vol. 14830, pp. 104–118). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-64299-9_8 · DOI
  26. Molenaar, I., & Chiu, M. M. (2014). Dissecting sequences of regulation and cognition: Statistical discourse analysis of primary school children’s collaborative learning. Metacognition and Learning, 9(2), 137–160. https://doi.org/10.1007/s11409-013-9105-8 · DOI
  27. Mu, S., Cui, M., & Huang, X. (2020). Multimodal data fusion in learning analytics: A systematic review. Sensors, 20(23), 6856. https://doi.org/10.3390/s20236856 · DOI
  28. Noroozi, O., Pijeira-Díaz, H. J., Sobocinski, M., Dindar, M., Järvelä, S., & Kirschner, P. A. (2020). Multimodal data indicators for capturing cognitive, motivational, and emotional learning processes: A systematic literature review. Education and Information Technologies, 25(6), 5499–5547. https://doi.org/10.1007/s10639-020-10229-w · DOI
  29. Ochoa, X. (2022). Multimodal learning analytics: rationale, process, examples, and direction. In C. Lang, G. Siemens, & A. F. Wise (Eds.), The handbook of learning analytics (2nd ed.). SOLAR. https://doi.org/10.18608/hla22 · DOI
  30. Roll, I., & Winne, P. H. (2015). Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics, 2(1), 7–12. https://doi.org/10.18608/jla.2015.21.2 · DOI · Paper page
  31. Rovers, S. F. E., Clarebout, G., Savelberg, H. H. C. M., De Bruin, A. B. H., & Van Merriënboer, J. J. G. (2019). Granularity matters: Comparing different ways of measuring self-regulated learning. Metacognition and Learning, 14(1), 1–19. https://doi.org/10.1007/s11409-019-09188-6 · DOI · Paper page
  32. Sailer, M., Ninaus, M., Huber, S. E., Bauer, E., & Greiff, S. (2024). The end is the beginning is the end: The closed-loop learning analytics framework. Computers in Human Behavior, 158, 108305. https://doi.org/10.1016/j.chb.2024.108305 · DOI
  33. Saint, J., Fan, Y., Gašević, D., & Pardo, A. (2022). Temporally-focused analytics of self-regulated learning: A systematic review of literature. Computers and Education: Artificial Intelligence, 3, 100060. https://doi.org/10.1016/j.caeai.2022.100060 · DOI · Paper page
  34. Schneider, M. (2021). Digital bioethics: Contextualizing digital technologies and introducing digital methods for empirical research. https://doi.org/10.3929/ethz-b-000501191 · doi:10.3929/ethz-b-000501191
  35. Shaffer, D. W., Collier, W., & Ruis, A. R. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. https://doi.org/10.18608/jla.2016.33.3 · DOI · Paper page
  36. Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ, 349(jan02 1), g7647–g7647. https://doi.org/10.1136/bmj.g7647 · DOI · Paper page
  37. Sharma, K., Nguyen, A., & Hong, Y. (2024). Self-regulation and shared regulation in collaborative learning in adaptive digital learning environments: A systematic review of empirical studies. British Journal of Educational Technology, Advance Online Publication. https://doi.org/10.1111/bjet.13459 · DOI
  38. Suraworachet, W., Seon, J., & Cukurova, M. (2024). Predicting challenge moments from students’ discourse: A comparison of GPT-4 to two traditional natural language processing approaches. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 473–485), ACM. https://doi.org/10.1145/3636555.3636905 · DOI
  39. Taub, M., & Azevedo, R. (2019). How does prior knowledge influence eye fixations and sequences of cognitive and metacognitive SRL processes during learning with an intelligent tutoring system? International Journal of Artificial Intelligence in Education, 29(1), 1–28. https://doi.org/10.1007/s40593-018-0165-4 · DOI
  40. Taub, M., Banzon, A. M., Zhang, T., & Chen, Z. (2022). Tracking changes in students’ online self-regulated learning behaviors and achievement goals using trace clustering and process mining. Frontiers in Psychology, 13,. https://doi.org/10.3389/fpsyg.2022.813514 · DOI
  41. Törmänen, T., Järvenoja, H., Saqr, M., Malmberg, J., & Järvelä, S. (2023). Affective states and regulation of learning during socio-emotional interactions in secondary school collaborative groups. British Journal of Educational Psychology, 93(S1), 48–70. https://doi.org/10.1111/bjep.12525 · DOI
  42. van Halem, N., van Klaveren, C., Drachsler, H., Schmitz, M., & Cornelisz, I. (2020). Tracking patterns in self-regulated learning using students’ self-reports and online trace data. Frontline Learning Research, 8(3), 140–163. https://doi.org/10.14786/flr.v8i3.497 · DOI
  43. Viberg, O., Khalil, M., & Baars, M. (2020). Self-regulated learning and learning analytics in online learning environments: A review of empirical research. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, (pp. 524–533), ACM. https://doi.org/10.1145/3375462.3375483 · DOI · Paper page
  44. Wiedbusch, M. D., Dever, D., Li, S., Amon, M. J., Lajoie, S., & Azevedo, R. (2023). Measuring multidimensional facets of SRL engagement with multimodal data. Unobtrusive observations of learning in digital environments: Examining behavior, cognition, emotion, metacognition and social processes using learning analytics (pp. 141–173). Springer International Publishing. · DOI
  45. Winne, P. H. (2015). Self-regulated learning. In J. D. Wright (Ed.), International encyclopedia of the social & behavioral sciences (Second Edition) (pp. 535–540). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.25091-5 · DOI
  46. Wise, A. F., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13. https://doi.org/10.18608/jla.2015.22.2 · DOI · Paper page
  47. Zheng, J., Xing, W., & Zhu, G. (2019). Examining sequential patterns of self- and socially shared regulation of STEM learning in a CSCL environment. Computers & Education, 136, 34–48. https://doi.org/10.1016/j.compedu.2019.03.005 · DOI
  48. Zhidkikh, D., Saarela, M., & Kärkkäinen, T. (2023). Measuring self-regulated learning in a junior high school mathematics classroom: Combining aptitude and event measures in digital learning materials. Journal of Computer Assisted Learning, 39(6), 1834–1851. https://doi.org/10.1111/jcal.12842 · DOI
  49. Zhu, M., Sari, A. R., & Lee, M. M. (2022). Trends and issues in MOOC learning analytics empirical research: A systematic literature review (2011–2021). Education and Information Technologies, 27(7), 10135–10160. https://doi.org/10.1007/s10639-022-11031-6 · DOI
  50. Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81(3), 329. · DOI · Paper page
  51. Zimmerman, B. J. (2000). Chapter 2 - attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7 · DOI · Paper page

Cited by

See all 46

Metadata

Authors
de Mooij, S., Lämsä, J., Lim, L., Aksela, O., Athavale, S., Bistolfi, I., Jin, F., Li, T., Azevedo, R., Bannert, M., Gašević, D., Järvelä, S., & Molenaar, I.
Venue
Educational Psychology Review
Published
2025-06
Volume
37
Issue
2
ISSN
  • 1040-726X
  • 1573-336X
Cited by
46
References
15
Language
en
Licence
Funders
Jacobs Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence. https://app.cochat.ai/papers/10.1007/s10648-025-10028-0
The paper
de Mooij, S., Lämsä, J., Lim, L., Aksela, O., Athavale, S., Bistolfi, I., Jin, F., Li, T., Azevedo, R., Bannert, M., Gašević, D., Järvelä, S., & Molenaar, I. (2025). A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence. Educational Psychology Review. https://doi.org/10.1007/s10648-025-10028-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.