Capturing self‐regulated learning processes in virtual reality: Causal sequencing of multimodal data
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
This study examines the embodied ways in which learners monitor their cognition while learning about exponential functions in an immersive virtual reality (VR) based game, Pandemic by Prisms of Reality. Traditionally, metacognitive monitoring has been assessed through behavioural traces and verbalised instances. When learning in VR, learners are fully immersed in the learning environment, actively manipulating it based on affordances designed to support learning, offering insights into the relationship between physical interaction and metacognition. The study collected multimodal data from 15 participants, including think‐aloud audio, bird's‐eye view video recordings and physiological data. Metacognitive monitoring was analysed through qualitative coding of the think‐aloud protocol, while movement was measured via optical flow analysis and cognitive load was assessed through heart rate variability analysis. The results revealed embodied metacognition by aligning the data to identify learners' physical states alongside their verbalised metacognition. The findings demonstrated a temporal interplay among cognitive load, metacognitive monitoring, and motion during VR‐based learning. Specifically, cognitive load, indicated by the low‐ and high‐frequency heart rate variability index, predicted instances of metacognitive monitoring, and monitoring predicted learners' motion while interacting with the VR environment. This study further provides future directions in understanding self‐regulated learning processes during VR learning by utilizing multimodal data to inform real‐time adaptive personalised support within these environments. Practitioner notes: What is already known about this topic Immersive virtual reality (VR) environments have the potential to offer personalised support based on users' individual needs and characteristics. Self‐regulated learning (SRL) involves learners monitoring their progress and strategically regulating their learning when needed. Multimodal data captured during VR learning, such as birds‐eye‐view video, screen recordings, physiological changes and verbalisations, can provide insights into learners' SRL processes and support needs. What this paper adds Provides insights into the embodied aspects of learners' metacognitive monitoring during learning in an immersive VR environment. Demonstrates how SRL processes can be captured via the collection and analysis of multimodal data, including think‐aloud audio, bird's‐eye view video recordings and physiological data, to capture metacognitive monitoring and movement during VR‐based learning. Contributes to the understanding of the interplay between cognitive load, metacognitive monitoring, and motion in immersive VR learning. Implications for practice and/or policy Researchers and practitioners can use the causal relationships identified in this study to identify instances of SRL in an immersive VR setting. Educational technology developers can consider the integration of online measures, such as cognitive load and physiological arousal, into adaptive VR environments to enable real‐time personalised support for learners based on their self‐regulatory needs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An overview of heart rate variability metrics and norms
Shaffer, F., & Ginsberg, J. P. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00258 · Cited by 7,185
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297
Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103778 · Cited by 3,585
A review of the use of virtual reality head-mounted displays in education and training
Jensen, L., & Konradsen, F. (2018) · Education and Information Technologies · doi:10.1007/s10639-017-9676-0 · Cited by 1,638
New Frontiers: Regulating Learning in CSCL
Järvelä, S., & Hadwin, A. F. (2013) · Educational Psychologist · doi:10.1080/00461520.2012.748006 · Cited by 722
Self-citationAdaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia
Azevedo, R., Cromley, J. G., Winters, F. I., Moos, D. C., & Greene, J. A. (2005) · Instructional Science · doi:10.1007/s11251-005-1273-8 · Cited by 306
Self-citationGREENE, J. A., & AZEVEDO, R. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.515935 · Cited by 267
Self-citationAdaptive virtual reality-based training: a systematic literature review and framework
Zahabi, M., & Abdul Razak, A. M. (2020) · Virtual Reality · doi:10.1007/s10055-020-00434-w · Cited by 233
The interplay between self-regulation in learning and cognitive load
Seufert, T. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.03.004 · Cited by 227
Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107540 · Cited by 217
Self-citation
Cited by
Wang, W.-S., Lin, C.-J., Lee, H.-Y., Huang, Y.-M., & Wu, T.-T. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13557-x · Cited by 43
Silseth, K., Steier, R., & Arnseth, H. C. (2024) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-023-09413-0 · Cited by 20
AI in assessment analysis and improvement
Trajkovski, G., & Hayes, H. (2025) · Digital Education and Learning · doi:10.1007/978-3-031-88252-4_4 · Cited by 4
Metadata
- Authors
- Sobocinski, M., Dever, D., Wiedbusch, M., Mubarak, F., Azevedo, R., & Järvelä, S.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2023-09-30
- Volume
- 55
- Issue
- 4
- Pages
- 1486-1506
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W4387219841
- Cited by
- 41
- References
- 13
- FWCI
- 7.06
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.