The perceptual basis of the modality effect in multimedia learning.
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Various studies have demonstrated an advantage of auditory over visual text modality when learning with texts and pictures. To explain this modality effect, two complementary assumptions are proposed by cognitive theories of multimedia learning: first, the visuospatial load hypothesis, which explains the modality effect in terms of visuospatial working memory overload in the visual text condition; and second, the temporal contiguity assumption, according to which the modality effect occurs because solely auditory texts and pictures can be attended to simultaneously. The latter explanation applies only to simultaneous presentation, the former to both simultaneous and sequential presentation. This paper introduces a third explanation, according to which parts of the modality effect are due to early, sensory processes. This account predicts that-for texts longer than one sentence-the modality effect with sequential presentation is restricted to the information presented most recently. Two multimedia experiments tested the influence of text modality across three different conditions: simultaneous presentation of texts and pictures versus sequential presentation versus presentation of text only. Text comprehension and picture recognition served as dependent variables. An advantage for auditory texts was restricted to the most recent text information and occurred under all presentation conditions. With picture recognition, the modality effect was restricted to the simultaneous condition. These findings clearly support the idea that the modality effect can be attributed to early processes in perception and sensory memory rather than to a working memory bottleneck.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
The episodic buffer: a new component of working memory?
Baddeley, A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01538-2 · Cited by 7,359 · cited 1×
“, Crowder & Morton, 1969; Penney, 1989) and working memory (Baddeley, 2000).”
The information available in brief visual presentations
Sperling, G. (1960) · Psychological Monographs: General and Applied · doi:10.1037/h0093759 · Cited by 4,042
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894
Mayer, R. E., & Moreno, R. (1998) · Journal of Educational Psychology · doi:10.1037/0022-0663.90.2.312 · Cited by 1,315
Reducing cognitive load by mixing auditory and visual presentation modes.
Mousavi, S. Y., Low, R., & Sweller, J. (1995) · Journal of Educational Psychology · doi:10.1037/0022-0663.87.2.319 · Cited by 995
Baddeley, A. D. (1999) · doi:10.4324/9780203345160 · Cited by 816
Meta-analysis of the modality effect
Ginns, P. (2005) · Learning and Instruction · doi:10.1016/j.learninstruc.2005.07.001 · Cited by 547 · cited 2×
“In line with this argumentation, the modality effect has been shown to disappear when learners can determine the pace of the multimedia presentation on their own (cf. the self-paced replication of our Experiment 2; Ginns, 2005; Tabbers, 2002).”
BackgroundPhysicists Reading Physics: Schema-Laden Purposes and Purpose-Laden Schema
BAZERMAN, C. (1985) · Written Communication · doi:10.1177/0741088385002001001 · Cited by 279
Observational learning from animated models: Effects of modality and reflection on transfer
Wouters, P., Paas, F., & van Merriënboer, J. J. G. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.03.001 · Cited by 71
Cited by
Mayer, R. E., & Fiorella, L. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.015 · Cited by 364
Cognitive load theory, the transient information effect and e-learning
Wong, A., Leahy, W., Marcus, N., & Sweller, J. (2012) · Learning and Instruction · doi:10.1016/j.learninstruc.2012.05.004 · Cited by 281
A meta-analysis of how signaling affects learning with media
Schneider, S., Beege, M., Nebel, S., & Rey, G. D. (2018) · Educational Research Review · doi:10.1016/j.edurev.2017.11.001 · Cited by 268
Instructional benefits of spoken words: A review of cognitive load factors
Kalyuga, S. (2012) · Educational Research Review · doi:10.1016/j.edurev.2011.12.002 · Cited by 93
How Inspecting a Picture Affects Processing of Text in Multimedia Learning
Eitel, A., Scheiter, K., & Schüler, A. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2922 · Cited by 85
Self-citation
Metadata
- Authors
- Rummer, R., Schweppe, J., Fürstenberg, A., Scheiter, K., & Zindler, A.
- Venue
- Journal of Experimental Psychology: Applied
- Published
- 2011
- Volume
- 17
- Issue
- 2
- Pages
- 159-173
- ISSN
- 1076-898X (ISSN-L)
- 1939-2192
- OpenAlex
- W1982739778
- Cited by
- 64
- References
- 11
- FWCI
- 11.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.