Direct Measurement of Cognitive Load in Multimedia Learning
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Cognitive load theory (CLT) is gaining increasing importance in the design and evaluation of instruction, both traditional and technology based. Although it is well understood as a theoretical construct, the measurement of cognitive load induced by instructional materials in general, and by multimedia instruction in particular, mainly relies on methods that are either indirect, subjective, or both. Integrating aspects of CLT, working memory research, and cognitive theories of multimedia learning, we describe the conceptual basis and practical implementation of a dual-task approach to the direct measurement of cognitive load in multimedia learning. This computer-based instrument provides a direct and objective measure that overcomes many of the shortcomings of other indirect and subjective methods that will enable researchers to validate empirically theoretical predictions of CLT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though Bru ¨nken et al. (2003) have empirically shown the suitability of the dual task approach for measuring cognitive load, this technique is used relatively rarely”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“The principle of this approach is that slower or more inaccurate performance on the secondary task indicates more consumption of cognitive resources by the primary task.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“An important disadvantage to this methodology is that the secondary task can interfere considerably with the primary task, especially if the primary task is complex and requires much of the learner's limited cognitive capacity [34,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“While these studies have made progress one factor is repeatedly highlighted as the weak link in CLT studies and learning studies in general: the measurement of cognitive workload [10,31,24,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview).”
From Measuring Cognitive Load in Embodied Learning Settings (2017) · cites this paper as Brünken et al., 2003
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“…involved in holding information in memory for short periods of time; Baddeley & Logie, 1999), it has been utilized only rarely in cognitive load research (Chandler & Sweller, 1996; Marcus, Cooper, & Sweller, 1996; Sweller, 1988) and in the field of multimedia learning (Brünken et al., 2002).”
MethodMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 6×
“Based on different sources for cognitive load, Sweller (1999) distinguished three types of load: one type that is attributed to”
BackgroundInfluentialMental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“…imagining (Cooper, Tindall-Ford, Chan-dler, & Sweller, 2001); and activities that are designed based on the completion effect (van Merriënboer, Schuurman, de Croock, & Paas, 2002), modality effect (Brünken & Leutner, 2001; Mayer & Moreno, 2003; Sweller, 1999), and redundancy effect (Sweller, 1999).”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 2×
“…load, formulated principles of instructional design that are based on cognitive load theory (CLT), and learned how to de-sign instructional strategies and activities that reduce certain types of load (Chandler & Sweller, 1991; Mayer, 2001; Sweller, 1999; Sweller, van Merriënboer, & Paas, 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Another method, used in experimental psychology and in cognitive load research, is eye-tracking analysis (Paas et al., 2003).”
MethodModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,451
Cited by
Items 201–300 of 1,000
Darejeh, A., Marcus, N., Mohammadi, G., & Sweller, J. (2026) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208261427867 · Cited by 58
The Impact of Colors on Learning
Chang, B., Xu, R., & Watt, T. (2018) · New Prairie Press (Kansas State University) · Cited by 57
Abbas, A., Seo, J., & Kim, M.-K. (2020) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000931 · Cited by 58
Moreno, R. (2009) · Educational Research and Evaluation · doi:10.1080/13803610903444592 · Cited by 51
“This has motivated some experts to suggest the use of direct rather than indirect measures of cognitive load during learning (Brunken, Plass, & Leutner, 2003 ).”
BackgroundMultimedia learning: Working memory and the learning of word and picture diagrams
Dutke, S., & Rinck, M. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.10.002 · Cited by 56
Xu, T. S., Zhang, L. J., & Gaffney, J. S. (2022) · Assessing Writing · doi:10.1016/j.asw.2022.100690 · Cited by 56
Imhof, M., Välikoski, T.-R., Laukkanen, A.-M., & Orlob, K. (2014) · Studies in Communication Sciences · doi:10.1016/j.scoms.2014.03.011 · Cited by 56
Tugtekin, U., & Odabasi, H. F. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10912-0 · Cited by 55
“In addition, we consulted the criteria of objectivity and subjectivity that Brünken et al. (2003) emphasized in the measurement of cognitive load.”
MethodNovice Programmers and the Problem Description Effect
Bouvier, D., Lovellette, E., Matta, J., Alshaigy, B., Becker, B. A., Craig, M., Jackova, J., McCartney, R., Sanders, K., & Zarb, M. (2016) · Proceedings of the 2016 ITiCSE Working Group Reports · doi:10.1145/3024906.3024912 · Cited by 43
Efficiency 4.0 for Industry 4.0
Kumar, N., & Kumar, J. (2019) · Human Technology · doi:10.17011/ht/urn.201902201608 · Cited by 57
Learning most with least effort: subtitles and cognitive load
Baranowska, K. (2020) · ELT Journal · doi:10.1093/elt/ccz060 · Cited by 55
van Gog, T., & PAAS, F. G. W. C. (2012) · Springer eBooks · doi:10.1007/978-1-4419-1428-6_412 · Cited by 55
Toward Mental Effort Measurement Using Electrodermal Activity Features
Romine, W. L., Schroeder, N. L., Banerjee, T., & Graft, J. (2022) · Sensors · doi:10.3390/s22197363 · Cited by 55
“These efforts are noteworthy, but there are situations in which completing secondary tasks may distract from the learning task [18], and there is still a limited body of research around physiological measures that can be measured non-intrusively.”
BackgroundEye-Tracking Study of Complexity in Gas Law Problems
Tang, H. N., & Pienta, N. J. (2012) · Journal of Chemical Education · doi:10.1021/ed200644k · Cited by 54
Kollöffel, B., Eysink, T. H. S., de Jong, T., & Wilhelm, P. (2008) · Instructional Science · doi:10.1007/s11251-008-9056-7 · Cited by 55
“The literature mentions several ways to measure cognitive load ( Ayres 2006; Bru ¨nken et al. 2003, 2004; DeLeeuw and Mayer 2008; Paas et al. 2003).”
BackgroundGamifying a Simulation: Do a Game Goal, Choice, Points, and Praise Enhance Learning?
Brom, C., Stárková, T., Bromová, E., & Děchtěrenko, F. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633118797330 · Cited by 55
Dillenbourg, P., Prieto, L. P., & Olsen, J. K. (2018) · Routledge eBooks · doi:10.4324/9781315617572-18 · Cited by 54
Instructional Game Design Using Cognitive Load Theory
Huang, W. D., & Johnson, T. (2009) · Handbook of Research on Effective Electronic Gaming in Education · doi:10.4018/978-1-59904-808-6.ch066 · Cited by 45
“, extraneous) cognitive load (Brünken et al., 2003).”
Effects of performance feedback valence on perceptions of invested mental effort
Raaijmakers, S. F., Baars, M., Schaap, L., Paas, F., & van Gog, T. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.12.002 · Cited by 52
“…feedback on effort invested in subsequent tasks, for instance, by including a condition in which feed-back is given after the effort rating is requested, or by using objective measures (e.g., physiological, or dual task measures; Brünken et al., 2003) of effort investment during a subsequent task.”
Guidelines for Choosing Cognitive Load Measures in Perceptually Rich Environments
Skulmowski, A. (2022) · Mind Brain and Education · doi:10.1111/mbe.12342 · Cited by 52
A video annotation learning approach to improve the effects of video learning
Chiu, P., Chen, H., Huang, Y., Liu, C., Liu, M.-C., & Shen, M.-H. (2016) · Innovations in Education and Teaching International · doi:10.1080/14703297.2016.1213653 · Cited by 52
“Several studies demonstrated the benefits of using annotation on multimedia materials and achieved meaningful learning (Brunken, Plass, & Leutner, 2003; Huang & Chiu, 2015; Lai, Tsai, & Yu, 2011).”
BackgroundDesigning planning and control interfaces to support user collaboration with flying robots
Szafir, D. J., Mutlu, B., & Fong, T. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916688256 · Cited by 52
“This secondary task was designed to measure user free time and thus indirectly gauge the attentional demands and cognitive load the work placed on the user (Brunken et al., 2003; van Gerven et al., 2006).”
BackgroundAssessment of Cognitive Load in Multimedia Learning: Theory, Methods and Applications
Paas, F., Ayres, P., & Pachman, M. (2008) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-942-220251003 · Cited by 56
Acquisition of Information Online: Knowledge, Navigation and Learning Outcomes
Lawless, K. A., Schrader, P. G., & Mayall, H. J. (2007) · Journal of Literacy Research · doi:10.1080/10862960701613086 · Cited by 52
“These constructs have included both cognitive and affective factors, such as cognitive load, metacognition, interest, and self-efficacy, to name just a few (e.g., Brünken, Plass, & Leutner, 2003; Lawless & Kulikowich, 1998; Tsai & Tsai, 2003).”
BackgroundKruger, J., Doherty, S., Fox, W., & de Lissa, P. (2018) · American Translators Association scholarly monograph series · doi:10.1075/ata.18.12kru · Cited by 51
Haji, F. A., Khan, R., Regehr, G., Drake, J. M., de Ribaupierre, S., & Dubrowski, A. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9599-8 · Cited by 52
“In addition, because a response to the signal is required ‘as soon as possible’, the task flexibly consumes all available cognitive resources at the time the measurement is taken (Brunken et al. 2003).”
BackgroundDifferential benefits of situated instructional prompts
Horz, H., Winter, C., & Fries, S. (2008) · Computers in Human Behavior · doi:10.1016/j.chb.2008.07.001 · Cited by 52
Dyer, J.-O., Hudon, A., Montpetit-Tourangeau, K., Charlin, B., Mamede, S., & van Gog, T. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0308-3 · Cited by 51
“Other options for cognitive load measurement that would not rely on subjective ratings, would be to use objective and continuous measures of cognitive load, such as response times during dual-task performance [108], or neuroimaging and electrophysiological techniques [108,110].”
BackgroundYafie, E., Nirmala, B., Kurniawaty, L., Bakri, T. S. M., Hani, A. B., & Setyaningsih, D. (2020) · Universal Journal of Educational Research · doi:10.13189/ujer.2020.082313 · Cited by 50
A multi‐user virtual laboratory environment for gear train design
Aziz, E. S., Chang, Y., Esche, S. K., & Chassapis, C. (2013) · Computer Applications in Engineering Education · doi:10.1002/cae.21573 · Cited by 50
“Providing sufficient levels of instructional guidance and support for learners is an important means for reducing cognitive load factors [35,36] and improving learning-effective engagement in interactive gaming environments.”
BackgroundTheoretical foundations for collaboration engineering
Kolfschoten, G. L. (2007) · Research Repository (Delft University of Technology) · Cited by 50
Sun, J. C.-Y., Yu, S.-J., & Chao, C.-H. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1527291 · Cited by 49
Haslam, C., & Hamilton, R. J. (2009) · International Journal of Science Education · doi:10.1080/09500690903183741 · Cited by 49
“a direct measure of cognitive load (Brunken, Plass, & Leutner, 2003 ).”
BackgroundChildren like it more but don’t learn more: Effects of esthetic visual design in educational games
Javora, O., Hannemann, T., Stárková, T., Volná, K., & Brom, C. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12701 · Cited by 50
Towards an Online Continuous Adaptation Mechanism (OCAM) for Enhanced Engagement: An EEG Study
Eldenfria, A., & Al‐Samarraie, H. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1595303 · Cited by 49
Chen, H., Liu, C., Zhou, F., Chiang, C.-H., Chen, Y., Wu, K., Huang, D., Liu, C.-Y., & Chiou, W. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.894337 · Cited by 49
Prieto, L. P., Sharma, K., & Dillenbourg, P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24258-3_20 · Cited by 49
“In both cases the teacher assessed the overall load as involving ‘some mental effort’ (6 out of 9 in the standard subjective mental effort scale [5]).”
BackgroundLearning Protein Structure with Peers in an AR-Enhanced Learning Environment
Chen, Y.-C. (2013) · ResearchWorks at the University of Washington (University of Washington) · Cited by 49
Hoch, E., Sidi, Y., Ackerman, R., Hoogerheide, V., & Scheiter, K. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09779-5 · Cited by 50
The Effects of Restricted Peripheral Field-of-View on Spatial Learning while Navigating
Barhorst-Cates, E. M., Rand, K. M., & Creem-Regehr, S. H. (2016) · PLoS ONE · doi:10.1371/journal.pone.0163785 · Cited by 48
Two or three lines: a mixed-methods study on subtitle processing and preferences
Szarkowska, A., & Gerber-Morón, O. (2018) · Perspectives · doi:10.1080/0907676x.2018.1520267 · Cited by 49
Gross, M. M., Wright, M. C., & Anderson, O. S. (2017) · Anatomical Sciences Education · doi:10.1002/ase.1684 · Cited by 47
Using the multi-display teaching system to lower cognitive load.
Cheng, T.-S., Lu, Y., & Yang, C.-S. (2015) · Educational Technology & Society · Cited by 47
Cunff, A. L., Dommett, E. J., & Giampietro, V. (2023) · European Journal of Neuroscience · doi:10.1111/ejn.16201 · Cited by 48
“Several reviews have been carried out to investigate the neurophysiological measures of cognitive load in neu-rotypical people (Brünken et al., 2003; Paas et al., 2016), and one review enquired into neurophysiological measures of cognitive load in younger adults, patients with mild cognitive…”
BackgroundJan, J.-C., Chen, C., & Huang, P. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.09.006 · Cited by 46
Design Factors for Effective Science Simulations: Representation of Information
Plass, J. L., Homer, B. D., Milne, C. E., Jordan, T., Kalyuga, S., Kim, M. C., & Lee, H. (2009) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/jgcms.2009010102 · Cited by 46
Self-citationMusallam, R. (2010) · USF Scholarship Repository (University of San Francisco) · Cited by 46
Use of Mouse-tracking Method to Measure Cognitive Load
Rheem, H., Verma, V., & Becker, D. V. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621449 · Cited by 45
“Such methods include self-report (Paas, Van Merriënboer & Adam, 1994), performance outcome measures (Brunken, Plass, & Leutner, 2003), heart rate (Paas & Van Merriënboer, 1994), pupil dilation (Beatty, 1982), eye-tracking data (Paas et al., 2003), fMRI data (Smith & Jonides, 1997), and behavioral…”
MethodThere’s more to the multimedia effect than meets the eye: is seeing pictures believing?
Ögren, M., Nyström, M., & Jarodzka, H. (2016) · Instructional Science · doi:10.1007/s11251-016-9397-6 · Cited by 45
Towards the Evaluation of Augmented Reality in the Metaverse: Information Presentation Modes
Gattullo, M., Laviola, E., Evangelista, A., Fiorentino, M., & Uva, A. E. (2022) · Applied Sciences · doi:10.3390/app122412600 · Cited by 44
Gadosey, C. K., Schnettler, T., Scheunemann, A., Bäulke, L., Thies, D. O., Dresel, M., Fries, S., Leutner, D., Wirth, J., & Grunschel, C. (2023) · European Journal of Psychology of Education · doi:10.1007/s10212-023-00756-8 · Cited by 44
Self-citationPastore, R. (2009) · Educational Technology Research and Development · doi:10.1007/s11423-009-9145-6 · Cited by 44
“, how much mental effort was required (Brunken et al. 2003).”
BackgroundInfluentialRand, K. M., Creem-Regehr, S. H., & Thompson, W. B. (2015) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000040 · Cited by 44
Electrodermal activity as a measure of cognitive load: a methodological approach
Buchwald, M., Kupiński, S., Bykowski, A., Marcinkowska, J., Ratajczyk, D., & Jukiewicz, M. (2019) · Signal Processing: Algorithms, Architectures, Arrangements, and Applications · doi:10.23919/spa.2019.8936745 · Cited by 44
“Although CLT has strong theoretical basis, it is still vividly disputed what is the most appropriate way of measuring different aspects of the cognitive load (CL) [12].”
BackgroundDesigning product listing pages—Effects on sales and users’ cognitive workload
Schmutz, P., Roth, S. P., Seckler, M., & Opwis, K. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.02.001 · Cited by 46
“Cognitive load theory has been applied in several e-learning and webrelated studies in the past, e.g. Brünken et al. (2002, 2003), Dennis et al. (1998), Joseph et al. (2006), Paas et al. (2003), and Schmutz et al. (2009).”
MethodAdaptive diagrams: Handing control over to the learner to manage split-attention online
Agostinho, S., Tindall‐Ford, S., & Roodenrys, K. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.01.007 · Cited by 44
Digital Note Taking: The Use of Electronic Pens with Students with Specific Learning Disabilities
Belson, S. I., Hartmann, D., & Sherman, J. (2013) · Journal of Special Education Technology · doi:10.1177/016264341302800202 · Cited by 45
Mind over mouse: The effect of cognitive load on mouse movement behavior
Grimes, G. M., & Valacich, J. S. (2015) · International Conference on Information Systems · Cited by 43
Using Gaze Behavior to Measure Cognitive Load
Perkhofer, L., & Lehner, O. M. (2018) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-01087-4_9 · Cited by 43
Understanding Effects of Cognitive Load from Pupillary Responses Using Hilbert Analytic Phase
Hossain, G., & Yeasin, M. (2014) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2014.62 · Cited by 44
“CATEGORIZATION OF COGNITIVE LOAD MEASUREMENT [29, 21]”
Cognitive Load Theory: Instruction-based Research with Applications for Designing Tests
Elliott, S. N., Kurz, A., Beddow, P. A., & Frey, J. R. (2009) · Cited by 44
Khan, R., Vernooij, J. C. M., Salvatori, D. C. F., & Hierck, B. P. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9090099 · Cited by 44
Huang, Y., Shadiev, R., & Hwang, W. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.011 · Cited by 42
Furtado, P. G. F., Hirashima, T., & Hayashi, Y. (2018) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2861744 · Cited by 42
“measurements of cognitive load [45] and have been used before [46], [47].”
MethodCognitive Load Theory in E-Learning
van Mierlo, C. M., Jarodzka, H., Kirschner, F., & Kirschner, P. A. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-0315-8.ch097 · Cited by 41
Zhu, G., Zong, F., Zhang, H., Wei, B., & Liu, F. (2021) · IEEE Access · doi:10.1109/access.2021.3058271 · Cited by 40
“Cognitive load can be evaluated through subjective or objective measurements [7], [8].”
Backgroundvan Hooijdonk, C. M. J., & Krahmer, E. (2008) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2007.2000054 · Cited by 40
“advocated by Brünken, Plass, and Leutner [49]), many studies rely on indirect measures such as behavioural or learning outcome measures (e.”
BackgroundEffect of Flipped Learning on Cognitive Load: A Higher Education Research
Karaca, C., & Ocak, M. A. (n.d.) · Journal of Learning and Teaching in Digital Age · Cited by 40
Applying the segmenting principle to online geography slideshow lessons
Mayer, R. E., Howarth, J. T., Kaplan, M., & Hanna, S. (2017) · Educational Technology Research and Development · doi:10.1007/s11423-017-9554-x · Cited by 39
“Based on the cognitive theory of multimedia learning (Mayer 2009, 2014) and cognitive load theory (Brunken et al. 2003; Plass et al. 2010; Sweller et al. 2011) the theoretical rationale for segmenting is to manage essential processing—cognitive processing that is needed to mentally represent the…”
BackgroundMarei, H. F., Donkers, J. H. H. L. M., Al-Eraky, M. M., & van Merriënboer, J. J. G. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1472372 · Cited by 39
“The current development of instruments that can be used at the end of teaching and learning sessions to measure the different types of cognitive load (Brunken et al. 2003; Leppink et al. 2013) has made the practice of exposing the students to cognitive overload educationally unjustified.”
BackgroundAlyami, H., Alawami, M., Lyndon, M., Alyami, M. M., Coomarasamy, C., Henning, M. A., Hill, A. G., & Sundram, F. (2019) · JMIR Serious Games · doi:10.2196/13748 · Cited by 40
“Despite the known criticism of single-item scales [62], such as cognitive load and perceived task difficulty scales, research has shown these scales to have comparable properties with multi-item scales [63].”
BackgroundMeasuring performance in leaning process of digital game-based learning and static E-learning
Wu, C., Tzeng, Y.-L., & Huang, Y. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09765-6 · Cited by 39
Terlutter, R., Diehl, S., Koinig, I., & Waiguny, M. K. J. (2016) · Media Psychology · doi:10.1080/15213269.2016.1142377 · Cited by 39
Understanding the relationship between physiological signals and digital game-based learning outcome
Wu, C., Tzeng, Y.-L., & Huang, Y. M. (2014) · Journal of Computers in Education · doi:10.1007/s40692-014-0006-x · Cited by 38
“The objectivity dimension includes three types of measures: physiological, behavioral, and learning outcome (Brunken et al. 2013).”
Gamification for Human Factors Integration: Social, Education, and Psychological Issues
Bishop, J. (2013) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-4666-5071-8 · Cited by 40
Role of dual task design when measuring cognitive load during multimedia learning
Schoor, C., Bannert, M., & Brünken, R. (2012) · Educational Technology Research and Development · doi:10.1007/s11423-012-9251-8 · Cited by 38
“The dual task methodology can be viewed as a direct, objective measurement of cognitive load (Bru¨nken et al. 2003) which means that it is independent from the learner’s self-report (so-called objective) and directly linked to cognitive load without further mediating variables (so-called direct).”
BackgroundMethodResultInfluentialZhang, L., & Cui, H. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.1011475 · Cited by 38
“Measuring cognitive workload has been recognized as one challenge when taking objectivity and causality into consideration (Brunken et al., 2003; Brünken et al., 2010).”
BackgroundYudintseva, A. (2024) · Computers & Education X Reality · doi:10.1016/j.cexr.2024.100076 · Cited by 38
Wynder, M. B. (2017) · Accounting Education · doi:10.1080/09639284.2017.1361847 · Cited by 37
“…were all measured on a continuum from 0 (not at all the case) to 10 (completely the case).4 Prior knowledge also determines learning and cognitive load (Brunken et al., 2003; Leppink et al., 2013) and so students were also asked to rate their understanding of resources, capabilities, and core…”
BackgroundThe Effects of Multi-Sensory Augmented Reality on Students’ Motivation in English Language Learning
Vedadi, S., Abdullah, Z. B., & Cheok, A. D. (2019) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2019.8725096 · Cited by 37
“One of the major characteristics of multimedia is its ability to induce perceptions and information processing in different formats and which enabled multisensory modalities involvement [14], [16].”
BackgroundBusiness process and rule integration approaches—An empirical analysis of model understanding
Wang, W., Chen, T., Indulska, M., Sadiq, S. W., & Weber, B. (2021) · Information Systems · doi:10.1016/j.is.2021.101901 · Cited by 37
Breves, P. L., & Schramm, H. (2019) · International Journal of Advertising · doi:10.1080/02650487.2019.1622326 · Cited by 37
Oje, A. V., Hunsu, N. J., & Fiorella, L. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100676 · Cited by 36
Predicting Cognitive Load in Future Code Puzzles
Kelleher, C. L., & Hnin, W. Y. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300487 · Cited by 35
“Instead, we measure cognitive load indirectly using instruments like subjective surveys [54] and biometrics (e.g. pupil dilation) [56], and interference with co-requisite tasks [18].”
MethodInvestigating the Impact of Construction Robots Autonomy Level on Workers’ Cognitive Load
Shayesteh, S., & Jebelli, H. (2022) · Lecture notes in civil engineering · doi:10.1007/978-981-19-0503-2_21 · Cited by 35
The consequences of additional cognitive load on performing musicians
Çorlu, M., Muller, C., Desmet, F., & Leman, M. (2014) · Psychology of Music · doi:10.1177/0305735613519841 · Cited by 36
APPLICATION OF MULTIMEDIA DESIGN PRINCIPLES TO VISUALS USED IN COURSE-BOOKS: AN EVALUATION TOOL
Kuzu, A., Akbulut, Y., & Sahin, M. C. (2007) · The Turkish Online Journal of Educational Technology · Cited by 36
Why Combining Text and Visualization Could Improve Bayesian Reasoning: A Cognitive Load Perspective
Bancilhon, M., Wright, A. J., Ha, S., Crouser, R. J., & Ottley, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581218 · Cited by 37
Chang, T., Kinshuk, K., Chen, N., & Yu, P.-T. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.09.022 · Cited by 34
“The total overloads of learners’ working memory would be the sum of these three types of loads (Brünken et al., 2003).”
BackgroundMethodInfluentialThe usefulness of graphic illustrations in online dictionaries
Dziemianko, A. (2021) · ReCALL · doi:10.1017/s0958344021000264 · Cited by 34
“Chun and Plass (1996) observed that annotations showing text and pictures stimulated lexical recall much more than text alone or text combined with video.”
BackgroundVisual Aids to Learning in a Second Language: Adding Redundant Video to an Audio Lecture
Lee, H., & Mayer, R. E. (2015) · Applied Cognitive Psychology · doi:10.1002/acp.3123 · Cited by 34
Lee, C.-C., & Tan, S. C. (2010) · Educational Media International · doi:10.1080/09523987.2010.492678 · Cited by 34
“In addition, various studies have often attributed the success or failure of an intervention to students’ cognitive load without explicitly measuring their cognitive loads (Brunken, Plass, & Leutner, 2003 ).”
BackgroundCognitive load in intralingual and interlingual respeaking – a preliminary study
Szarkowska, A., Krejtz, K., Dutka, Ł., & Pilipczuk, O. (2016) · Poznań Studies in Contemporary Linguistics · doi:10.1515/psicl-2016-0008 · Cited by 35
“Working memory is responsible for the “mechanisms and processes that control, regulate and actively maintain task-relevant information” (Miyake and Shah 1999 cited after Brünken et al. 2003: 54).”
BackgroundA novel method to monitoring changes in cognitive load in video‐based learning
Huh, D., Kim, J., & Jo, I. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12378 · Cited by 35
E-learning Environments in Academy: Technology, Pedagogy and Thinking Dispositions
Bouhnik, D., & Carmi, G. (2012) · Journal of Information Technology Education Research · doi:10.28945/1698 · Cited by 34
Huang, S., Wen, C., Bai, X., Li, S., Wang, S., Wang, X., & Yang, D. (2025) · Journal of Medical Internet Research · doi:10.2196/68538 · Cited by 33
“Instructional practitioners also need to incorporate Cognitive Load Theory [19,20] and the Control Value Theory of Achievement Emotions [21] into their instructional design; the former emphasizes minimizing the extraneous cognitive load, providing appropriate learning content for a given learner,…”
A Cyber-Physical-Human System for One-to-Many UAS Operations: Cognitive Load Analysis
Planke, L. J., Lim, Y., Gardi, A., Sabatini, R., Kistan, T., & Ezer, N. (2020) · Sensors · doi:10.3390/s20195467 · Cited by 33
“Although a more widely accepted measure for MWL, secondary task performance can be disturbing as it interferes with the primary task and may not be operationally relevant [32].”
BackgroundThees, M., Kapp, S., Altmeyer, K., Malone, S., Brünken, R., & Kühn, J. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.705551 · Cited by 33
Embodiment as a pedagogical tool to enhance learning
Mavilidi, M. F., Ouwehand, K., Schmidt, M., Pesce, C., Tomporowski, P. D., Okely, A. D., & PAAS, F. G. W. C. (2021) · Routledge eBooks · doi:10.4324/9781003142010-10 · Cited by 33
Prieto, L. P., Sharma, K., Wen, Y., & Dillenbourg, P. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.22318/cscl2015.206 · Cited by 33
“Multiple techniques have been used to measure cognitive load, which Brunken et al. (2003) classify along two dimensions: direct measures (targeting cognitive load itself) vs.”
Method
Metadata
- Authors
- Brunken, R., Plass, J. L., & Leutner, D.
- Affiliations
- New York University (US)
- University of Erfurt (DE)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 53-61
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1967395107
- Semantic Scholar
- 70a37f895bee605bed1aa6df431495797b53e86b
- Cited by
- 896
- References
- 49
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 34 · 2023: 32 · 2022: 51 · 2021: 42 · 2020: 54 · 2019: 63 · 2018: 57 · 2017: 40 · 2016: 52 · 2015: 60 · 2014: 45 · 2013: 35 · 2012: 36
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- cognitive load, cognitive load theory, multimedia learning, direct measurement, dual-task paradigm, working memory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.