Generative AI and multimodal data for educational feedback: Insights from embodied math learning
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
This study explores the role of generative AI (GenAI) in providing formative feedback in children's digital learning experiences, specifically in the context of mathematics education. Using multimodal data, the research compares AI‐generated feedback with feedback from human instructors, focusing on its impact on children's learning outcomes. Children engaged with a digital body‐scale number line to learn addition and subtraction of positive and negative integers through embodied interaction. The study followed a between‐group design, with one group receiving feedback from a human instructor and the other from GenAI. Eye‐tracking data and system logs were used to evaluate student's information processing behaviour and cognitive load. The results revealed that while task‐based performance did not differ significantly between conditions, the GenAI feedback condition demonstrated lower cognitive load and students show different visual information processing strategies among the two conditions. The findings provide empirical support for the potential of GenAI to complement traditional teaching by providing structured and adaptive feedback that supports efficient learning. The study underscores the importance of hybrid intelligence approaches that integrate human and AI feedback to enhance learning through synergistic feedback. This research offers valuable insights for educators, developers and researchers aiming to design hybrid AI‐human educational environments that promote effective learning outcomes. Practitioner notes: What is already known about this topic? Embodied learning approaches have been shown to facilitate deeper cognitive processing by engaging students physically with learning materials, which is especially beneficial in abstract subjects like mathematics. GenAI has the potential to enhance educational experiences through personalized feedback, making it crucial for fostering student understanding and engagement. Previous research indicates that hybrid intelligence that combines AI with human instructors can contribute to improved educational outcomes. What this paper adds? This study empirically examines the effectiveness of GenAI‐generated feedback when compared to human instructor feedback in the context of a multisensory environment (MSE) for math learning. Findings from system logs and eye‐tracking analysis reveal that GenAI feedback can support learning effectively, particularly in helping students manage their cognitive load. The research uncovers that GenAI and teacher feedback lead to different information processing strategies. These findings provide actionable insights into how feedback modality influences cognitive engagement. Implications for practice and/or policy The integration of GenAI into educational settings presents an opportunity to enhance traditional teaching methods, enabling an adaptive learning environment that leverages the strengths of both AI and human feedback. Future educational practices should explore hybrid models that incorporate both AI and human feedback to create inclusive and effective learning experiences, adapting to the diverse needs of learners. Policymakers should establish guidelines and frameworks to facilitate the ethical and equitable adoption of GenAI technologies for learning. This includes addressing issues of trust, transparency and accessibility to ensure that GenAI systems are effectively supporting, rather than replacing, human instructors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911
Where the Action Is: The Foundations of Embodied Interaction
Dourish, P. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/7221.001.0001 · Cited by 1,866
Zhai, C., Wibowo, S., & Li, L. D. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00316-7 · Cited by 1,567
Eye tracking in HCI and usability research
Poole, A., & Ball, L. J. (2006) · Encyclopedia of Human Computer Interaction · doi:10.4018/978-1-59140-562-7.ch034 · Cited by 690
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425
Akata, Z., Balliet, D., de Rijke, M., Dignum, F., Dignum, V., Eiben, G., Fokkens, A., Grossi, D., Hindriks, K., Hoos, H., et al. (2020) · Computer · doi:10.1109/mc.2020.2996587 · Cited by 415
Human and artificial intelligence collaboration for socially shared regulation in learning
Järvelä, S., Nguyen, A., & Hadwin, A. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13325 · Cited by 342
Inclusive AI literacy for kids around the world
Druga, S., Vu, S. T., Likhith, E., & Qiu, T. (2019) · Proceedings of FabLearn 2019 · doi:10.1145/3311890.3311904 · Cited by 318
Duchowski, A. T., Krejtz, K., Krejtz, I., Biele, C., Niedzielska, A., Kiefer, P., Raubal, M., & Giannopoulos, I. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173856 · Cited by 228
van Duijvenvoorde, A. C. K., Zanolie, K., Rombouts, S. A. R. B., Raijmakers, M. E. J., & Crone, E. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1485-08.2008 · Cited by 211
The promise and challenges of multimodal learning analytics
Cukurova, M., Giannakos, M., & Martinez‐Maldonado, R. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13015 · Cited by 169
Self-citationAI and the Future of Learning: Expert Panel Report
Roschelle, J., Lester, J., & Fusco, J. (2020) · doi:10.51388/20.500.12265/106 · Cited by 76
Research works printed but not linked: 48
- 10.1186/s41235-016-0034-3 · DOI · Paper page
- 10.1159/000443153 · DOI
- 10.1145/3027385.3027429 · DOI
- 10.1016/j.ijhcs.2023.103030 · DOI
- Bofferding L., 2014, International Group for the Psychology of Mathematics Education
- 10.1145/3501712.3535294 · DOI
- 10.1111/bjet.13525 · DOI
- 10.1145/3585088.3589385 · DOI
- 10.1109/TLT.2023.3243210 · DOI
- Csikszentmihalyi M., 2020, Finding flow: The psychology of engagement with everyday life
- Czikszentmihalyi M., 1990, Flow: The psychology of optimal experience
- 10.1007/s10639-022-11486-7 · DOI · Paper page
- Gelsomini M., 2023, Sensei—Experience in all senses. Multisensory and multimodal research framework
- 10.1111/bjet.13320 · DOI
- Giannakos M. N., 2020, Movement forward: The continued growth of child‐computer interaction research
- Ginsburg H., 1997, Not a cookbook: Guidelines for conducting a clinical interview, 115
- 10.1007/978‐3‐030‐52237‐7 · DOI
- Huang Y., 2019, Human‐AI co‐learning for datadriven AI, CoRR
- 10.1007/978-981-16-2327-1_115-1 · DOI
- 10.37398/JSR.2020.640137 · DOI
- 10.1007/s11423-024-10342-4 · DOI
- 10.4324/9781315798844 · DOI · Paper page
- 10.1016/j.ijcci.2021.100355 · DOI
- 10.1111/bjet.12861 · DOI · Paper page
- 10.1007/s10055-023-00903-y · DOI
- Moyer‐PackenhaM P. S., 2015, Young children's learning performance and efficiency when using virtual manipulative mathematics ipad apps, Journal of Computers in Mathematics and Science Teaching, 34, 41
- 10.1007/s11042-022-12296-2 · DOI
- 10.1207/S15326985EP3801_1 · DOI · Paper page
- 10.1037//0022‐0663.86.1.122 · doi:10.1037//0022-0663.86.1.122 · Paper page
- 10.1145/1743666.1743701 · DOI · Paper page
- 10.7312/piag91272 · DOI · Paper page
- 10.1177/1555412013496894 · DOI · Paper page
- Shapiro L., 2019, The oxford handbook of cognitive science, 118
- 10.3389/frai.2021.713176 · DOI
- 10.1075/aicr.82 · doi:10.1075/aicr.82
- 10.1111/jcal.12473 · DOI · Paper page
- 10.1007/s10758-014-9212-x · DOI
- Suraworachet W. Seon J. &Cukurova M.(2024).Predicting challenge moments from students’ discourse: A comparison of GPT‐4 to two traditional natural language processing approaches. Proceedings of the 14th Learning Analytics and Knowledge Conference 473–485.https://doi.org/10.1145/3636555.3636905 · DOI
- 10.1007/978-1-4614-6977-3_4 · DOI
- 10.3389/frbhe.2024.1384713 · DOI
- 10.1007/978-1-4419-5546-3_10 · DOI
- 10.1016/j.cognition.2011.08.005 · DOI
- 10.1186/s40561‐018‐0071‐0 · DOI · Paper page
- 10.1016/j.ijcci.2021.100406 · DOI
- 10.1007/s11042‐024‐19814‐4 · DOI
- Yang C., 2018, Comparison of animation and static‐picture based instruction: Effects on performance and cognitive load for learning genetics, Journal of Educational Technology & Society, 21, 1
- 10.1016/j.caeai.2022.100061 · DOI · Paper page
- 10.1111/jcal.12892 · DOI · Paper page
Cited by
Yan, L., Pammer‐Schindler, V., Mills, C., Nguyen, A., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.70000 · Cited by 84
Jia, W., Pan, L., & Neary, S. (2025) · Behavioral Sciences · doi:10.3390/bs15101348 · Cited by 45
“It demonstrates significant potential in enhancing learning efficiency, fostering inquiry-based learning, and providing personalized feedback (Cosentino et al., 2025).”
AI assistance in peer feedback provision: Pedagogically sound, but minimally adopted
Pozdniakov, S., Brazil, J., Banihashem, S. K., Noroozi, O., Gašević, D., Sadiq, S., & Khosravi, H. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105591 · Cited by 11
Teng, D., Zhou, X., Al‐Samarraie, H., & Fang, L. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70176 · Cited by 10
Seung, Y., & Basham, J. D. (2026) · Learning Disability Quarterly · doi:10.1177/07319487261439132 · Cited by 12
Metadata
- Authors
- Cosentino, G., Anton, J., Sharma, K., Gelsomini, M., Giannakos, M., & Abrahamson, D.
- Venue
- British Journal of Educational Technology
- Publisher
- Wiley
- Published
- 2025-04-21
- Volume
- 56
- Issue
- 5
- Pages
- 1686-1709
- ISSN
- 0007-1013 (ISSN-L)
- 1467-8535
- OpenAlex
- W4409629882
- Cited by
- 54
- References
- 12
- FWCI
- 22.47
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.