Direct Measurement of Cognitive Load in Multimedia Learning
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Cognitive load theory (CLT) is gaining increasing importance in the design and evaluation of instruction, both traditional and technology based. Although it is well understood as a theoretical construct, the measurement of cognitive load induced by instructional materials in general, and by multimedia instruction in particular, mainly relies on methods that are either indirect, subjective, or both. Integrating aspects of CLT, working memory research, and cognitive theories of multimedia learning, we describe the conceptual basis and practical implementation of a dual-task approach to the direct measurement of cognitive load in multimedia learning. This computer-based instrument provides a direct and objective measure that overcomes many of the shortcomings of other indirect and subjective methods that will enable researchers to validate empirically theoretical predictions of CLT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though Bru ¨nken et al. (2003) have empirically shown the suitability of the dual task approach for measuring cognitive load, this technique is used relatively rarely”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“The principle of this approach is that slower or more inaccurate performance on the secondary task indicates more consumption of cognitive resources by the primary task.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“An important disadvantage to this methodology is that the secondary task can interfere considerably with the primary task, especially if the primary task is complex and requires much of the learner's limited cognitive capacity [34,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“While these studies have made progress one factor is repeatedly highlighted as the weak link in CLT studies and learning studies in general: the measurement of cognitive workload [10,31,24,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview).”
From Measuring Cognitive Load in Embodied Learning Settings (2017) · cites this paper as Brünken et al., 2003
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“…involved in holding information in memory for short periods of time; Baddeley & Logie, 1999), it has been utilized only rarely in cognitive load research (Chandler & Sweller, 1996; Marcus, Cooper, & Sweller, 1996; Sweller, 1988) and in the field of multimedia learning (Brünken et al., 2002).”
MethodMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 6×
“Based on different sources for cognitive load, Sweller (1999) distinguished three types of load: one type that is attributed to”
BackgroundInfluentialMental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“…imagining (Cooper, Tindall-Ford, Chan-dler, & Sweller, 2001); and activities that are designed based on the completion effect (van Merriënboer, Schuurman, de Croock, & Paas, 2002), modality effect (Brünken & Leutner, 2001; Mayer & Moreno, 2003; Sweller, 1999), and redundancy effect (Sweller, 1999).”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 2×
“…load, formulated principles of instructional design that are based on cognitive load theory (CLT), and learned how to de-sign instructional strategies and activities that reduce certain types of load (Chandler & Sweller, 1991; Mayer, 2001; Sweller, 1999; Sweller, van Merriënboer, & Paas, 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Another method, used in experimental psychology and in cognitive load research, is eye-tracking analysis (Paas et al., 2003).”
MethodModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,451
Cited by
Items 901–1,000 of 1,000
Stasi, D., & Luigi, L. (2011) · Institutional Repository of the University of Granada (University of Granada)
Johnson, D. L. (2007) · University of Minnesota Digital Conservancy (University of Minnesota)
Mitarbeiterschulung mit Rollenspielen und Workflow-Management-Systemen
Börner, R., & Moormann, J. (2011) · HMD Praxis der Wirtschaftsinformatik · doi:10.1007/bf03340628
Instructional geographic information science: map overlay and spatial abilities
Tricot, T. A. (2010) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro)
Kim, B., & Lee, Y.-K. (2011) · The Journal of the Korea Contents Association · doi:10.5392/jkca.2011.986
Loftus, J. J. (2014) · Libraries and Cultural Resources (University of Calgary) · doi:10.11575/prism/28026
Cognitive Load of Rating Scales
Isaac, E., Sparling, G., & Sen, S. (2010)
Evaluating Learner Cognitive Load Using Concurrent Verbal Reports
Kalyuga, S., & Plass, J. L. (2007) · Proceedings of the Annual Meeting of the Cognitive Science Society
Self-citationII carico cognitivo nel multimedia learning
Zipoli, V. (2011) · Springer eBooks · doi:10.1007/978-88-470-1824-2_25
“Attualmente sono disponibili vari strumenti di valutazione del carico cognitivo [12, 13 ] che possono essere distinti in base all’oggettivita e alla relazione causale.”
BackgroundA Multi-Disciplinary Framework for Geospatial Technologies in Education
Bunch, R. L., Nelson, E. S., Lloyd, R. E., Kane, M. J., & Tricot, T. A. (2007)
Muñoz, F. S. (2023) · Zeitschrift für interkulturellen Fremdsprachenunterricht · doi:10.26083/tuprints-00012249
Chung, S. (2015) · ThinkTech (Texas Tech University)
Mazarakis, A. (2007) · MADOC (University of Mannheim)
Jiang, M., Liu, Y., Barlowe, S., Feng, Y., & Yang, J. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2080288
Horne, R. M. (2015) · UC Research Repository (University of Canterbury) · doi:10.26021/1514
Development of a Research Framework to Elicit the Optimal Level of Users’ Functional Intervention
Jung, S. Y., & Lee, S. (2015) · Communications in computer and information science · doi:10.1007/978-3-319-21380-4_22
Towards Diverse Media Augmented E-Book Reader Platform
Alam, K. M. (2012) · uO Research (University of Ottawa) · doi:10.20381/ruor-5809
“Indirect objective based performance analysis is the most commonly used method of investigation in multimedia learning [10].”
MethodDesjarlais, M. (2011) · Brock University Digital Repository (Brock University)
NETWORKING WEBSITES USAGE: ALL STUDENTS MULTITASK, DO ALL MANAGE COGNITIVE LOAD? A COMPARATIVE STUDY
Rouis, S., Ayadi, F. M., & Zarbout, R. (2015) · MCIS
Hintsala, S. (2014) · Jyväskylä University Digital Archive (University of Jyväskylä)
Altebrando, G. (2015) · SUNY Digital Repository Support (State University of New York System)
Use of Observational Learning Enhanced Instruction in Low Language Competency Audiences
Zain-ul-abdin, K. (2013) · ProQuest LLC eBooks
Exploratory visualization of graphs based on community structure
Liu, Y. (2013) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro)
Kleinhans, J., & Schümann, M. (2015) · International Association for Development of the Information Society
Cognitive Load and Disorientation Issues in Hypermedia as Assistive Technology
Demirbilek, M. (2010) · IGI Global eBooks · doi:10.4018/978-1-61520-817-3.ch007
Güngör, A. S., Çadırcı, T. O., & Köse, Ş. G. (2017) · IGI Global eBooks · doi:10.4018/978-1-5225-1793-1.ch073
The Influence of Visual and Temporal Dynamics on Split Attention
Schmidt‐Weigand, F. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-503-2.ch412
Application of neuroergonomics in the industrial design of mining equipment.
Mach, Q. H. (2015) · Lu Zone Ul (Laurentian University)
Andrade, J. (2014) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Development of a Sensory Feedback System for Lower-limb Amputees using Vibrotactile Haptics
Sharma, A. (2013) · TSpace (University of Toronto)
Medien im naturwissenschaftlichen Unterricht
Nerdel, C. (2017) · Springer eBooks · doi:10.1007/978-3-662-53158-7_10
Kratchounova, D. (2012) · STARS (University of Central Florida)
Influence of Motivational Message with Narration on Learner's Cognitive Load and Time-On-Task
RyuJeeheon, & 임지현 (2009) · 교과교육학연구 · doi:10.24231/rici.2009.13.2.323
A Comparison of Interactive Multimedia Instruction Designs Addressing Soldiers Learning Needs
Graves, T. R., Blankenbeckler, P. N., Wampler, R. L., & Roberts, A. (2016)
Visual learning: the effect of sketching on recall of a witness' account
Luther, K. (2016) · Memorial University Research Repository (Memorial University)
IADIS International Conference International Higher Education, IHE 2010 : Proceedings
Huai, H., Zhang, J., Kommers, P., & Isaias, P. T. (2010) · University of Twente Research Information
Innocence and guilt detection in high-stakes television appeals
Ng, M. (2016) · University of Huddersfield Repository (University of Huddersfield)
Assessing Learning Strategies with an Educational Video
Harrison, D. J. (2017) · ODU Digital Commons (Old Dominion University) · doi:10.25777/txzh-qq61
MiNT: MULTIMODAL iNTERACTION FOR MODELING AND MODEL REFACTORING
Narayan, N. (2017) · mediaTUM (Technical University of Munich)
(2010) · IEEE-EMBS Conference on Biomedical Engineering and Sciences · doi:10.1109/iecbes.2010.5742258
TACTILE NAVIGATION: AN ADDITIONAL PROCESSING CHANNEL FOR ENVIRONMENTS OF HIGH SENSORY LOAD
Bharadwaj, A. (2017) · MacSphere (McMaster University) · doi:10.71548/22895
Multi-modal Reading For Low Level Readers
O'Neal, J. (2010) · STARS (University of Central Florida)
Gangata, H. (2018) · Staffordshire Online Repository (Staffordshire University)
Cognitive load assessment in computer based video training for the purposes of one-hand knot tying
Addison, R. (2016) · Memorial University Research Repository (Memorial University)
The Role of Information in Inquiry-Based Learning in a Remote Lab on Optical Spectrometry
Thoms, L., & Girwidz, R. (2018) · Springer eBooks · doi:10.1007/978-3-319-96184-2_12
Bamgboje‐Ayodele, A. (2018) · UTAS Research Repository · doi:10.25959/100.00028441
Ponle pausa: videos y cuadernillo didáctico
Tejada, J. (2018) · Átemus · doi:10.5354/0719-885x.2017.48568
Automatic Detection of Cognitive Load and User’s Age Using a Machine Learning Eye Tracking System
Shojaeizadeh, M. (2018) · Digital WPI
Moffett, J. W. (2019) · Louisiana State University · doi:10.31390/gradschool_dissertations.4933
Mental States in Information Search Process
Na, K., & Choi, W. (2017) · Han-guk doseogwan·jeongbo hakoeji · doi:10.16981/kliss.48.3.201709.281
Lehmann, J. (2019) · OPen Access Repositorium der Universität Ulm (OPARU) (Ulm University) · doi:10.18725/oparu-17576
Student Perceptions of Streaming-Media Effectiveness
Baber, S. F. (2009) · NSUWorks (Nova Southeastern University)
Digital Equity: Not just an 'add on' but business as usual
Willems, J., Farley, H., Freund, K., Britten, D., Tickler, S., Tucker, S., Garner, J., Campbell, C., Stejar, L., Hinze, M., et al. (2018) · Murdoch University Research Portal · doi:10.13140/rg.2.2.36111.29607
Study on individual cognitive load in Sternberg tasks for wayfinding system
Pei, Z. (2019) · Digital Repository Service (Northeastern University) · doi:10.17760/d20317904
خلیفة, أ. م. (2019) · مجلة دراسات تربوية واجتماعية · doi:10.21608/jsu.2019.65602
When Students Fail: Neurocognitive Mechanisms Underlying Test Anxiety
Schillinger, F. L. (2018) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-6866
Moussa, M. (2020) · International Journal of research in Educational Sciences · doi:10.29009/ijres.3.2.12
الربابعه, خ. ز., & الحموري, ف. أ. م. (2020) · IUG Journal of Educational and Psychological Studies · doi:10.33976/iugjeps.v28i2.5581
van Vliet, H., de Groot, W. T., Kuijper, A., & Hallema, G. (2019) · Data Archiving and Networked Services (DANS)
نظیر, ا. ع. ا. ع. ا. (2019) · مجلة کلیة التربیة فى العلوم التربویة · doi:10.21608/jfees.2019.78419
Brandt, S. (2017) · ProQuest LLC eBooks
Recommendations for enhancing consumer safe food management behaviour with smartphone technology
Bamgboje‐Ayodele, A., Ellis, L., & Turner, P. A. (2019) · AIS Electronic Library (AISeL)
Algorithm visualization design guidelines for mobile leaning
Supli, A. A., & Shiratuddin, N. (2018) · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia)
Carter, M.-L. Y. (2020) · UCL Discovery (University College London)
Exploring the Interaction of Abstraction and Engagement in Learning Programming Concepts
Heinonen, A. (2020) · Helda - University of Helsinki Institutional Repository
Processos automáticos e controlados de cooperação em jogos de dilema social
Caldas, L. S. (2019) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
السید, ن. م. م. (2018) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2018.120128
متولى, إ. ع. (2018) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2018.124664
الجواد, ت. س. ع. ا. ع. (2020) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2020.143666
المعتصم, أ. م. (2020) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2020.139856
The effect of gesture congruency on the cognitive learning process and learning outcomes
van Helden, G. (2019) · Utrecht University Repository (Utrecht University)
الأعصر, س. ع. ا., & الباسط, م. س. ع. (2016) · Al-Mağallah Al-ʿilmiyyaẗ Li Kulliyyaẗ Al-Tarbiyyaẗ Al-Nawʿiyyaẗ - Ǧāmiʿaẗ Al-Munūfiyyaẗ · doi:10.21608/molag.2016.156938
Ergonomics Society of the Human Factors and Human Factors: The Journal
Kalyuga, S., Chandler, P., & Sweller, J. (2010)
Frisz-Conlon, A. M. (2021) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/85773
Robinson, K. P., Robert, L., & Eglash, R. (2021) · IEEE RO-MAN · doi:10.1109/ro-man50785.2021.9515372
“If we view HRI experimentation as a form of carefully controlled design wherein subject learning does and does not occur then we can consider cognitive theory of multimedia learning [10], [24] in the”
Backgroundدسوقي, و. م. ع. ا. (2021) · مجلة کلیة التربیة فى العلوم التربویة · doi:10.21608/jfees.2021.196068
مدکور, أ. م. د. أ. ف. خ., & سليمان, د. م. و. م. (2021) · Al-Mağallah Al-Dawliyyaẗ Lil Taʿlim Al-Iliktirūnī · doi:10.21608/ijel.2021.199679
Achtung „Overload“: Präsentation von Text, Bild und Ton am Bildschirm
Niegemann, H. M., Hessel, S., Hochscheid-Mauel, D., Aslanski, K., Deimann, M., & Kreuzberger, G. (2004) · X.media.press · doi:10.1007/978-3-642-18677-6_12 · Cited by 1
Fillet, D. (2010) · OpenGrey (Institut de l'Information Scientifique et Technique)
(2008) · Springer eBooks · doi:10.1007/978-3-540-37226-4_3
مباديء تصميم التعلم الإلكتروني المُشتقة من نظرية العبء المعرفي
الفيل, ح. م. ح. (2014) · Maǧallaẗ Buḥūṯ fi Al-ʿulūm wa Al-Funūn Al-Nawʿiyyaẗ · doi:10.21608/balexu.2014.196650
(2019) · doi:10.31038/asmhs.2019313
“The response time covaries with the effort was being expended to ‘process’ the information, with response time [13].”
BackgroundKritzenberger, H. (2005) · Oldenbourg Wissenschaftsverlag eBooks · doi:10.1524/9783486593273.bm
Aguiar, Y. P. C., Vieira, M. D. F. Q., Galy, É., & Santoni, C. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8356-1.ch016
بیومى, إ. ع. (2019) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2019.252025
الليف, ن. م. ع. ا. أ. (2023) · Maǧallaẗ Al-H̲idmaẗ Al-Iǧtimāʿiyyaẗ · doi:10.21608/egjsw.2023.188043.1152
Current Status and Prospect in Research on Learner Cognitive Load Measurement
(2023) · Journal of Educational Research and Policies · doi:10.53469/jerp.2023.05(04).07
Jerome Seymour Bruner and John Dewey: connections of cognition and experience
Gerulaitis, Š. (2023) · Geografija ir edukacija mokslo almanachas / Geography and Education Science Almanac · doi:10.5200/ge.2023.7
Learning with Pedagogical Agent: Effects of Transfer of Information Function
Xu, L., Li, X., Tang, N., Wang, H., Liao, M., & Liu, N. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34866-2_28
Cognitive load and expertise dynamics in information processing : the case of mass transit travelers
Armougum, A. (2019) · theses.fr (ABES) · doi:10.70675/89bf391bzc39ez4b9bz8722zca434029b855
Alashoor, T., Blicher, A., & Gleasure, R. (2024) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-58396-4_4
Cognitive Load: Categories and Measurements
Jiang, D. (2024) · Springer eBooks · doi:10.1007/978-981-97-2317-1_4
Understanding and Identifying Cognitive Load in Networked Learning
Kehrwald, B. A., & Bentley, B. (2018) · Proceedings of the International Conference on Networked Learning · doi:10.54337/nlc.v11.8746
الحميد, أ. ص. ع., & العظيم, ح. أ. ع. (2024) · تکنولوجيا التعليم سلسلة دراسات وبحوث · doi:10.21608/tesr.2024.399861
علي, ا. م. ا., الغفار, غ. م. ع., علي, ر., & ماضى, ز. (2025) · مجلة کلیة علوم ذوی الاحتیاجات الخاصة · doi:10.21608/jshm.2025.268544.1360
Metadata
- Authors
- Brunken, R., Plass, J. L., & Leutner, D.
- Affiliations
- New York University (US)
- University of Erfurt (DE)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 53-61
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1967395107
- Semantic Scholar
- 70a37f895bee605bed1aa6df431495797b53e86b
- Cited by
- 896
- References
- 49
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 34 · 2023: 32 · 2022: 51 · 2021: 42 · 2020: 54 · 2019: 63 · 2018: 57 · 2017: 40 · 2016: 52 · 2015: 60 · 2014: 45 · 2013: 35 · 2012: 36
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- cognitive load, cognitive load theory, multimedia learning, direct measurement, dual-task paradigm, working memory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.