The DOI matches its Crossref record; 86 of the 87 references it cites were found in a registry or an index.
Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis
Open accessPublished version of a preprint
Abstract
Multimedia is ubiquitous in 21st-century education. Cognitive load theory and the cognitive theory of multimedia learning both postulate that the quality of multimedia design heavily influences learning. We sought to identify how to best design multimedia and review how well those learning theories held up to meta-analyses. We conducted an overview of systematic reviews that tested the effects of multimedia design on learning or cognitive load. We found 29 reviews including 1,189 studies and 78,177 participants. We found 11 design principles that demonstrated significant, positive, meta-analytic effects on learning and five that significantly improved management of cognitive load. The largest benefits were for captioning second-language videos, temporal/spatial contiguity, and signaling. We also found robust evidence for modality, animation, coherence/removing seductive details, anthropomorphics, segmentation, personalization, pedagogical agents, and verbal redundancy effects. Good design was more important for more complex materials, and in system-paced environments (e.g., lectures) than self-paced ones (e.g., websites). Results supported many tenets of both theories. We highlight a range of evidence-based strategies that could be implemented by educators.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most principles were found to benefit learning outcomes and, or reduce cognitive load (Noetel et al., 2022;Rey et al., 2019;Schroeder & Cenkci, 2018;Sundararajan & Adesope, 2020).”
From From Research to Practice: Are Multimedia Principles Present in Instructional Videos Used by Teachers in Science and History? (2024) · cites this paper as Noetel et al., 2022
In the citing paper
“Finally, although previous research (Ibrahim et al., 2012;Noetel et al., 2022) has reported that the SSW principles were particularly efficient in supporting learning, we found that these were not often followed in our sample of videos.”
From From Research to Practice: Are Multimedia Principles Present in Instructional Videos Used by Teachers in Science and History? (2024) · cites this paper as Noetel et al., 2022
Citations
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787 · cited 1×
“Therefore, we recommend that future reviews implement a gold-standard assessment of the quality of primary studies (currently RoB 2; Sterne et al., 2019) drawn from meta-meta-analytic estimates of what design choices inflate effect sizes (e.g., unblinded designs, no prospective registration).”
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · cited 1×
“Design : We included systematic reviews, meta-analyses, or similar reviews characterized by Grant and Booth (2009), which includes rapid reviews, scoping reviews, state-of-the-art reviews, systematic searches with review, systematized reviews, mapping reviews, or systematic maps.”
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · cited 5×
“The full AMSTAR2 tool was developed on the basis of a scoping review of tools for assessing the quality of systematic reviews, followed by iterative workshops with content experts (Shea et al., 2017).”
InfluentialMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800 · cited 16×
“One final, “active process-ing” assumption is that learning involves an active, coordinated cognitive process; mere passive exposure is not sufficient (Mayer, 2009).”
InfluentialMayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 5×
“Cognitive load can be influenced by many factors, from the goals given to learners, to the presence of worked examples, to the skills of the learner (Sweller et al., 1998; Sweller et al., 2019; Van Gog et al., 2005; van Merriënboer & Sweller, 2005).”
InfluentialDistribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 1×
“First, we converted all reported, pooled effect sizes to a common metric, Hedges’s g , which corrects for biases in small sample sizes (Hedges, 1981).”
Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., & Moher, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.003 · Cited by 3,490
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396 · cited 1×
“We did not tally different criteria into a summative score because each criteria carry different risks that should not be weighted equally (Higgins et al., 2011).”
Research works printed but not linked: 4
- *Amaka I. H., Goeman K. (2017). Selecting media for effective learning in online and blended courses: A review study. Journal of Educational Multimedia and Hypermedia, 26(1), 29–59. https://www.learntechlib.org/primary/p/173341/
- *Cromley J. G., 2018, Strategies for deep learning with digital technology: Theories and practices in education, 93
- Pollock M., Fernandes R. M., Becker L. A., Pieper D., Hartling L. Others. (2018). Chapter V: Overviews of reviews. Cochrane Handbook for systematic reviews of interventions, Version 6. https://training.cochrane.org/handbook/current/chapter-v
- Snook I., O’Neill J., Clark J., O’Neill A.M., Openshaw R. & Others. (2009). Invisible learnings? A commentary on John Hattie’s book—“Visible learning: A synthesis of Over 800 meta-analyses relating to achievement”. New Zealand Journal of Educational Studies, 44(1), 93. https://doi.org/10.3316/INFORMIT.467818990993648 · doi:10.3316/informit.467818990993648
Cited by
Ahmadi, A., Noetel, M., Parker, P., Ryan, R. M., Ntoumanis, N., Reeve, J., Beauchamp, M., Dicke, T., Yeung, A., Ahmadi, M., et al. (2023) · Journal of Educational Psychology · doi:10.1037/edu0000783 · Cited by 476
Self-citationDai, C.-P., Ke, F., Pan, Y., Moon, J., & Liu, Z. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09855-4 · Cited by 116
“…perspective argued that information exhibition with audio-visual dual channels (voice and graphic presentations) can be easier to understand than the ones presented with illustrated text (i.e., text and graphic presentations) (Castro-Alonso & Sweller, 2022; Noetel et al., 2022; Reinwein, 2012).”
InfluentialDecision-guided chatbots and cognitive styles in interdisciplinary learning
Iku-Silan, A., Hwang, G., & Chen, C. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104812 · Cited by 132
AlShaikh, R., Al-Malki, N. A., & Almasre, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25361 · Cited by 187
“The theory emphasizes the importance of effectively managing cognitive load by presenting information in a meaningful, organized, and integrated manner [11,58].”
BackgroundCampos, D. G., Fütterer, T., Gfrörer, T., Lavelle-Hill, R., Murayama, K., König, L., Hecht, M., Zitzmann, S., & Scherer, R. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09862-5 · Cited by 75
Metadata
- Authors
- Noetel, M., Griffith, S., Delaney, O., Harris, N. R., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C.
- Affiliations
- Australian Catholic University (AU)
- The University of Queensland (AU)
- University of Southern Denmark
- Venue
- Review of Educational Research
- Published
- 2021-10-23
- Volume
- 92
- Issue
- 3
- Pages
- 413-454
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W3210645082
- Cited by
- 148
- References
- 87
- Citations by year
- 2026: 46 · 2025: 40 · 2024: 33 · 2023: 22 · 2022: 5 · 2021: 2
- FWCI
- 14.98
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- University of Southern Denmark Research Portal (University of Southern Denmark) (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- multimedia learning, cognitive load theory, cognitive theory of multimedia learning, multimedia design principles, signaling, modality, animation, coherence, seductive details, anthropomorphism, segmentation, personalization, educational agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis. https://app.cochat.ai/papers/10.3102/00346543211052329
- The paper
- Noetel, M., Griffith, S., Delaney, O., Harris, N. R., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C. (2022). Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis. Review of Educational Research. https://doi.org/10.3102/00346543211052329
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.