The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence
Abstract
While behavioral, contextual, and physiological data streams have long been used to investigate self-regulated learning (SRL), a systematic understanding of the current state how different data streams and modalities contribute to measuring regulation processes across diverse learning contexts remains limited. This systematic literature review provides a foundational step toward this understanding by addressing two objectives: (1) identifying which data streams and modalities researchers have used to capture cognitive, affective, metacognitive, and motivational (CAMM) processes underlying SRL, and (2) examining how multimodal data analytics have been applied to capture the temporal and sequential characteristics of these processes across study contexts. The studies were mapped onto the Self-Regulated Learning Processes, Multimodal Data, and Analysis grid, a two-dimensional framework with CAMM processes on one axis and multimodal data streams on the other. By evaluating four analytic approaches—unimodal, horizontal, vertical, and integrated—we identify how different combinations of data streams and processes have been employed. Our findings reveal a shift from unimodal approaches (one data stream, one process), to more integrated approaches (combining multiple data streams and processes). Although multimodal data collection is increasingly common, gaps remain, especially in measuring motivation and affective states. Futhermore, analytic methods often do not reflect alignment between data streams, with standard statistics predominating even in integrated approaches, whereas AI-based analytics may be more suited. This review positions itself as a foundational step in advancing SRL measurement, offering insights into current practices and highlighting the need for more sophisticated methods to capture SRL across diverse learning contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · cited 2×
“We identified 9416 articles and exported them to Rayyan (Ouzzani et al., 2016) for the initial screening of abstracts.”
Studying as Self-Regulated Learning
(1998) · Metacognition in Educational Theory and Practice · doi:10.4324/9781410602350-19 · Cited by 1,589
Let’s not forget: Learning analytics are about learning
Gašević, D., Dawson, S., & Siemens, G. (2015) · TechTrends · doi:10.1007/s11528-014-0822-x · Cited by 1,049
Self-citationAzevedo, R. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1004069 · Cited by 418 · cited 3×
“Azevedo (2015) made the distinction between process, product, self-report, and knowledge construction data when measuring different CAMM processes.”
InfluentialSelf-citationTowards hybrid human‐AI learning technologies
Molenaar, I. (2022) · European Journal of Education · doi:10.1111/ejed.12527 · Cited by 348
Self-citationAzevedo, R., & Gašević, D. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.025 · Cited by 345
Self-citationHuman and artificial intelligence collaboration for socially shared regulation in learning
Järvelä, S., Nguyen, A., & Hadwin, A. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13325 · Cited by 342 · cited 2×
“Even though researchers apply conventional, inferential statistics to get insights into the different CAMM processes (e.g., van Halem et al., 2020), current AI capabilities also enable reliance on human-AI synergies when pre-processing and analysing multimodal data (Järvelä et al., 2023).”
Self-citationCognition and Metacognition within Self-Regulated Learning
Winne, P. H. (2017) · Handbook of Self-Regulation of Learning and Performance · doi:10.4324/9781315697048-3 · Cited by 274
GREENE, J. A., & AZEVEDO, R. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.515935 · Cited by 267
Self-citationMolenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217 · cited 7×
“He illustrated how the different data sources are ideal for capturing only some of the CAMM processes, highlighting the necessity for multimodal learning analytics, especially when focusing on multiple or even all the CAMM processes (see also Molenaar et al., 2023).”
InfluentialSelf-citation
Research works printed but not linked: 51
- Azevedo, R. (2020). Reflections on the field of metacognition: Issues, challenges, and opportunities. Metacognition and Learning, 15(2), 91–98. https://doi.org/10.1007/s11409-020-09231-x · DOI
- Azevedo, R., & Gašević, D. (2019). Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025 · DOI · Paper page
- Baker, M., & Reimann, P. (2024). CSCL: A learning and collaboration science. International Journal of Computer-Supported Collaborative Learning, 19, 273–281. · DOI
- Borchers, C., Zhang, J., Baker, R. S., & Aleven, V. (2024). Using think-aloud data to understand relations between self-regulation cycle characteristics and student performance in intelligent tutoring systems. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 529–539), ACM. https://doi.org/10.1145/3636555.3636911 · DOI
- Chung, C.-Y., & Hsiao, I.-H. (2019). Quantitative analytics in exploring self-regulated learning behaviors: Effects of study persistence and regularity. In 2019 IEEE frontiers in education conference (FIE), (pp. 1–9). https://doi.org/10.1109/FIE43999.2019.9028665 · DOI
- Di Mitri, D., Schneider, J., Specht, M., & Drachsler, H. (2018). From signals to knowledge: A conceptual model for multimodal learning analytics. Journal of Computer Assisted Learning, 34(4), 338–349. https://doi.org/10.1111/jcal.12288 · DOI · Paper page
- Dindar, M., Alikhani, I., Malmberg, J., Jarvela, S., & Seppanen, T. (2019). Examining shared monitoring in collaborative learning: A case of a recurrence quantification analysis approach. Computers in Human Behavior, 100, 335–344. https://doi.org/10.1016/j.chb.2019.03.004 · DOI
- Efklides, A., & Schwartz, B. L. (2024). Revisiting the metacognitive and affective model of self-regulated learning: Origins, development, and future directions. Educational Psychology Review, 36(2), 61. https://doi.org/10.1007/s10648-024-09896-9 · DOI
- Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2024). GPTs are GPTs: Labor market impact potential of LLMs. Science, 384(6702), 1306–1308. https://doi.org/10.1126/science.adj0998 · doi:10.1126/science.adj0998 · Paper page
- Fan, Y., Rakovic, M., Van Der Graaf, J., Lim, L., Singh, S., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2023). Towards a fuller picture: Triangulation and integration of the measurement of self-regulated learning based on trace and think aloud data. Journal of Computer Assisted Learning, jcal.12801,. https://doi.org/10.1111/jcal.12801 · DOI
- Feng, S., Yan, L., Zhao, L., Maldonado, R. M., & Gašević, D. (2024). Heterogenous network analytics of small group teamwork: Using multimodal data to uncover individual behavioral engagement strategies. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 587–597), ACM. https://doi.org/10.1145/3636555.3636918 · DOI
- Gray, G., & Bergner, Y. (2022). A practitioner’s guide to measurement in learning analytics: Decisions, opportunities, and challenges. In Handbook of learning analytics (pp. 20–28). SOLAR. · DOI
- Greene, J. A., Bernacki, M. L., & Hadwin, A. (2024). Self-regulation. In Handbook of educational psychology (pp. 314–334). Routledge. · DOI
- Harley, J. M., Taub, M., Azevedo, R., & Bouchet, F. (2018). let’s set up some subgoals: Understanding human-pedagogical agent collaborations and their implications for learning and prompt and feedback compliance. IEEE Transactions on Learning Technologies, 11(1), 54–66. https://doi.org/10.1109/TLT.2017.2756629 · DOI
- Järvelä, S., & Bannert, M. (2021). Temporal and adaptive processes of regulated learning—What can multimodal data tell? Learning and Instruction, 72, 101268. https://doi.org/10.1016/j.learninstruc.2019.101268 · DOI · Paper page
- Järvelä, S., & Hadwin, A. (2024). Triggers for self-regulated learning: A conceptual framework for advancing multimodal research about SRL. Learning and Individual Differences, 115, 102526. https://doi.org/10.1016/j.lindif.2024.102526 · DOI
- Järvenoja, H., Törmänen, T., Järvelä, S., spsampsps Shubina, T. (2023). Motivation and emotion regulation in collaborative learning contexts. In Motivation and emotion in learning and teaching across educational contexts (pp. 100–113). Routledge. · DOI
- Khiat, H., & Vogel, S. (2022). A self-regulated learning management system: Enhancing performance, motivation and reflection in learning. Journal of University Teaching and Learning Practice, 19(2), 43–59. https://doi.org/10.53761/1.19.2.4 · DOI
- Lämsä, J., De Mooij, S., Aksela, O., Athavale, S., Bistolfi, I., Azevedo, R., Bannert, M., Gasevic, D., Molenaar, I., & Järvelä, S. (2025). Measuring secondary education students’ self-regulated learning processes with digital trace data. Learning and Individual Differences, 118, 102625. https://doi.org/10.1016/j.lindif.2024.102625 · DOI
- Li, J., Majumdar, R., & Ogata, H. (2021). Mining mathematics learning strategies of high and low performing students using log data. International Conference on Advanced Learning Technologies (ICALT), 2021, 229–230. https://doi.org/10.1109/ICALT52272.2021.00074 · doi:10.1109/icalt52272.2021.00074
- Li, S., Zheng, J., Huang, X., & Xie, C. (2022). Self-regulated learning as a complex dynamical system: Examining students’ STEM learning in a simulation environment. Learning and Individual Differences, 95, 102144. https://doi.org/10.1016/j.lindif.2022.102144 · DOI
- Maldonado-Mahauad, J., Pérez-Sanagustín, M., Kizilcec, R. F., Morales, N., & Munoz-Gama, J. (2018). Mining theory-based patterns from big data: Identifying self-regulated learning strategies in massive open online courses. Computers in Human Behavior, 80, 179–196. https://doi.org/10.1016/j.chb.2017.11.011 · DOI · Paper page
- Matcha, W., Gašević, D., Jovanović, J., Uzir, N. A., Oliver, C. W., Murray, A., & Gasevic, D. (2020). Analytics of learning strategies: The association with the personality traits. In Proceedings of the tenth international conference on learning analytics & knowledge, (pp. 151–160), ACM. https://doi.org/10.1145/3375462.3375534 · DOI
- McCardle, L., & Hadwin, A. F. (2015). Using multiple, contextualized data sources to measure learners’ perceptions of their self-regulated learning. Metacognition and Learning, 10(1), 43–75. https://doi.org/10.1007/s11409-014-9132-0 · DOI
- Mejia-Domenzain, P., Nazaretsky, T., Schultze, S., Hochweber, J., spsampsps Käser, T. (2024). Navigating self-regulated learning dimensions: Exploring interactions across modalities. In A. M. Olney, I.-A. Chounta, Z. Liu, O. C. Santos, spsampsps I. I. Bittencourt (Eds.), Artificial intelligence in education (Vol. 14830, pp. 104–118). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-64299-9_8 · DOI
- Molenaar, I., & Chiu, M. M. (2014). Dissecting sequences of regulation and cognition: Statistical discourse analysis of primary school children’s collaborative learning. Metacognition and Learning, 9(2), 137–160. https://doi.org/10.1007/s11409-013-9105-8 · DOI
- Mu, S., Cui, M., & Huang, X. (2020). Multimodal data fusion in learning analytics: A systematic review. Sensors, 20(23), 6856. https://doi.org/10.3390/s20236856 · DOI
- Noroozi, O., Pijeira-Díaz, H. J., Sobocinski, M., Dindar, M., Järvelä, S., & Kirschner, P. A. (2020). Multimodal data indicators for capturing cognitive, motivational, and emotional learning processes: A systematic literature review. Education and Information Technologies, 25(6), 5499–5547. https://doi.org/10.1007/s10639-020-10229-w · DOI
- Ochoa, X. (2022). Multimodal learning analytics: rationale, process, examples, and direction. In C. Lang, G. Siemens, & A. F. Wise (Eds.), The handbook of learning analytics (2nd ed.). SOLAR. https://doi.org/10.18608/hla22 · DOI
- Roll, I., & Winne, P. H. (2015). Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics, 2(1), 7–12. https://doi.org/10.18608/jla.2015.21.2 · DOI · Paper page
- Rovers, S. F. E., Clarebout, G., Savelberg, H. H. C. M., De Bruin, A. B. H., & Van Merriënboer, J. J. G. (2019). Granularity matters: Comparing different ways of measuring self-regulated learning. Metacognition and Learning, 14(1), 1–19. https://doi.org/10.1007/s11409-019-09188-6 · DOI · Paper page
- Sailer, M., Ninaus, M., Huber, S. E., Bauer, E., & Greiff, S. (2024). The end is the beginning is the end: The closed-loop learning analytics framework. Computers in Human Behavior, 158, 108305. https://doi.org/10.1016/j.chb.2024.108305 · DOI
- Saint, J., Fan, Y., Gašević, D., & Pardo, A. (2022). Temporally-focused analytics of self-regulated learning: A systematic review of literature. Computers and Education: Artificial Intelligence, 3, 100060. https://doi.org/10.1016/j.caeai.2022.100060 · DOI · Paper page
- Schneider, M. (2021). Digital bioethics: Contextualizing digital technologies and introducing digital methods for empirical research. https://doi.org/10.3929/ethz-b-000501191 · doi:10.3929/ethz-b-000501191
- Shaffer, D. W., Collier, W., & Ruis, A. R. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. https://doi.org/10.18608/jla.2016.33.3 · DOI · Paper page
- Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ, 349(jan02 1), g7647–g7647. https://doi.org/10.1136/bmj.g7647 · DOI · Paper page
- Sharma, K., Nguyen, A., & Hong, Y. (2024). Self-regulation and shared regulation in collaborative learning in adaptive digital learning environments: A systematic review of empirical studies. British Journal of Educational Technology, Advance Online Publication. https://doi.org/10.1111/bjet.13459 · DOI
- Suraworachet, W., Seon, J., & Cukurova, M. (2024). Predicting challenge moments from students’ discourse: A comparison of GPT-4 to two traditional natural language processing approaches. In Proceedings of the 14th learning analytics and knowledge conference, (pp. 473–485), ACM. https://doi.org/10.1145/3636555.3636905 · DOI
- Taub, M., & Azevedo, R. (2019). How does prior knowledge influence eye fixations and sequences of cognitive and metacognitive SRL processes during learning with an intelligent tutoring system? International Journal of Artificial Intelligence in Education, 29(1), 1–28. https://doi.org/10.1007/s40593-018-0165-4 · DOI
- Taub, M., Banzon, A. M., Zhang, T., & Chen, Z. (2022). Tracking changes in students’ online self-regulated learning behaviors and achievement goals using trace clustering and process mining. Frontiers in Psychology, 13,. https://doi.org/10.3389/fpsyg.2022.813514 · DOI
- Törmänen, T., Järvenoja, H., Saqr, M., Malmberg, J., & Järvelä, S. (2023). Affective states and regulation of learning during socio-emotional interactions in secondary school collaborative groups. British Journal of Educational Psychology, 93(S1), 48–70. https://doi.org/10.1111/bjep.12525 · DOI
- van Halem, N., van Klaveren, C., Drachsler, H., Schmitz, M., & Cornelisz, I. (2020). Tracking patterns in self-regulated learning using students’ self-reports and online trace data. Frontline Learning Research, 8(3), 140–163. https://doi.org/10.14786/flr.v8i3.497 · DOI
- Viberg, O., Khalil, M., & Baars, M. (2020). Self-regulated learning and learning analytics in online learning environments: A review of empirical research. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, (pp. 524–533), ACM. https://doi.org/10.1145/3375462.3375483 · DOI · Paper page
- Wiedbusch, M. D., Dever, D., Li, S., Amon, M. J., Lajoie, S., & Azevedo, R. (2023). Measuring multidimensional facets of SRL engagement with multimodal data. Unobtrusive observations of learning in digital environments: Examining behavior, cognition, emotion, metacognition and social processes using learning analytics (pp. 141–173). Springer International Publishing. · DOI
- Winne, P. H. (2015). Self-regulated learning. In J. D. Wright (Ed.), International encyclopedia of the social & behavioral sciences (Second Edition) (pp. 535–540). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.25091-5 · DOI
- Wise, A. F., & Shaffer, D. W. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13. https://doi.org/10.18608/jla.2015.22.2 · DOI · Paper page
- Zheng, J., Xing, W., & Zhu, G. (2019). Examining sequential patterns of self- and socially shared regulation of STEM learning in a CSCL environment. Computers & Education, 136, 34–48. https://doi.org/10.1016/j.compedu.2019.03.005 · DOI
- Zhidkikh, D., Saarela, M., & Kärkkäinen, T. (2023). Measuring self-regulated learning in a junior high school mathematics classroom: Combining aptitude and event measures in digital learning materials. Journal of Computer Assisted Learning, 39(6), 1834–1851. https://doi.org/10.1111/jcal.12842 · DOI
- Zhu, M., Sari, A. R., & Lee, M. M. (2022). Trends and issues in MOOC learning analytics empirical research: A systematic literature review (2011–2021). Education and Information Technologies, 27(7), 10135–10160. https://doi.org/10.1007/s10639-022-11031-6 · DOI
- Zimmerman, B. J. (1989). A social cognitive view of self-regulated academic learning. Journal of Educational Psychology, 81(3), 329. · DOI · Paper page
- Zimmerman, B. J. (2000). Chapter 2 - attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7 · DOI · Paper page
Cited by
Fütterer, T., Bardach, L., Kuhn, J., Keller, S. D., & Gerjets, P. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10133-8 · Cited by 17
Metadata
- Authors
- de Mooij, S., Lämsä, J., Lim, L., Aksela, O., Athavale, S., Bistolfi, I., Jin, F., Li, T., Azevedo, R., Bannert, M., Gašević, D., Järvelä, S., & Molenaar, I.
- Venue
- Educational Psychology Review
- Published
- 2025-06
- Volume
- 37
- Issue
- 2
- ISSN
- 1040-726X
- 1573-336X
- Cited by
- 46
- References
- 15
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor, 3 d)
- Funders
- Jacobs Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence. https://app.cochat.ai/papers/10.1007/s10648-025-10028-0
- The paper
- de Mooij, S., Lämsä, J., Lim, L., Aksela, O., Athavale, S., Bistolfi, I., Jin, F., Li, T., Azevedo, R., Bannert, M., Gašević, D., Järvelä, S., & Molenaar, I. (2025). A Systematic Review of Self-Regulated Learning through Integration of Multimodal Data and Artificial Intelligence. Educational Psychology Review. https://doi.org/10.1007/s10648-025-10028-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.