Multimodal learning analytics for game‐based learning
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
A distinctive feature of game‐based learning environments is their capacity to create learning experiences that are both effective and engaging. Recent advances in sensor‐based technologies such as facial expression analysis and gaze tracking have introduced the opportunity to leverage multimodal data streams for learning analytics. Learning analytics informed by multimodal data captured during students’ interactions with game‐based learning environments hold significant promise for developing a deeper understanding of game‐based learning, designing game‐based learning environments to detect maladaptive behaviors and informing adaptive scaffolding to support individualized learning. This paper introduces a multimodal learning analytics approach that incorporates student gameplay, eye tracking and facial expression data to predict student posttest performance and interest after interacting with a game‐based learning environment, Crystal Island . We investigated the degree to which separate and combined modalities (ie, gameplay, facial expressions of emotions and eye gaze) captured from students ( n = 65) were predictive of student posttest performance and interest after interacting with Crystal Island . Results indicate that when predicting student posttest performance and interest, models utilizing multimodal data either perform equally well or outperform models utilizing unimodal data. We discuss the synergistic effects of combining modalities for predicting both student interest and posttest performance. The findings suggest that multimodal learning analytics can accurately predict students’ posttest performance and interest during game‐based learning and hold significant potential for guiding real‐time adaptive scaffolding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 1×
“We include student gameplay actions, which may reveal their interest, a key component of the multifaceted construct of emotional engagement (Fredricks, Blumenfeld, & Paris, 2004).”
BackgroundEye movements in reading and information processing: 20 years of research
Rayner, K. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.124.3.372 · Cited by 7,979
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory.
Ryan, R. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.3.450 · Cited by 2,721 · cited 2×
“After interacting with C rystal I sland , the Intrinsic Motivation Inventory (IMI; Ryan, 1982) was administered, a validated survey consisting of a 7-point Likert scale (1 = Not true at all, 4 = Somewhat true, 7 = Very true) with 29 items and five subscales related to intrinsic motivation (McAuley,…”
MethodMcAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements
Barrett, L. F., Adolphs, R., Marsella, S., Martinez, A. M., & Pollak, S. D. (2019) · Psychological Science in the Public Interest · doi:10.1177/1529100619832930 · Cited by 1,748
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
The effect of games and simulations on higher education: a systematic literature review
Vlachopoulos, D., & Makri, A. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0062-1 · Cited by 776 · cited 1×
“Empirical studies of game-based learning have found that students achieve higher learning gains relative to traditional learning environments such as classroom settings (Mayer, 2019; Vlachopoulos & Makri, 2017).”
BackgroundAzevedo, R., & Gašević, D. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.03.025 · Cited by 345
Self-citation
Cited by
The promise and challenges of multimodal learning analytics
Cukurova, M., Giannakos, M., & Martinez‐Maldonado, R. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13015 · Cited by 169
Unpacking student engagement in higher education learning analytics: a systematic review
Bergdahl, N., Bond, M., Sjöberg, J., Dougherty, M., & Oxley, E. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00493-y · Cited by 138
Artificial intelligence in multimodal learning analytics: a systematic literature review
Mohammadi, M., Tajik, E., Martinez-Maldonado, R., Sadiq, S., Tomaszewski, W., & Khosravi, H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100426 · Cited by 85
AI to Support Guided Experiential Learning
Goldberg, B., & Robson, R. (2023) · Communications in Computer and Information Science · doi:10.1007/978-3-031-36336-8_16 · Cited by 36
System design for using multimodal trace data in modeling self-regulated learning
Cloude, E. B., Azevedo, R., Winne, P. H., Biswas, G., & Jang, E. E. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.928632 · Cited by 23
“Using large volumes of multimodal data to analyze and interpret learners’ SRL processes in near real-time is theoretically and algorithmically challenging (Cloude et al., 2020; Emerson et al., 2020).”
BackgroundSelf-citation
Metadata
- Authors
- Emerson, A., Cloude, E. B., Azevedo, R., & Lester, J.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2020-07-03
- Volume
- 51
- Issue
- 5
- Pages
- 1505-1526
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W3039470340
- Cited by
- 148
- References
- 11
- FWCI
- 19.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimodal learning analytics for game‐based learning. https://app.cochat.ai/papers/10.1111/bjet.12992
- The paper
- Emerson, A., Cloude, E. B., Azevedo, R., & Lester, J. (2020). Multimodal learning analytics for game‐based learning. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12992
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.