Direct Measurement of Cognitive Load in Multimedia Learning
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Cognitive load theory (CLT) is gaining increasing importance in the design and evaluation of instruction, both traditional and technology based. Although it is well understood as a theoretical construct, the measurement of cognitive load induced by instructional materials in general, and by multimedia instruction in particular, mainly relies on methods that are either indirect, subjective, or both. Integrating aspects of CLT, working memory research, and cognitive theories of multimedia learning, we describe the conceptual basis and practical implementation of a dual-task approach to the direct measurement of cognitive load in multimedia learning. This computer-based instrument provides a direct and objective measure that overcomes many of the shortcomings of other indirect and subjective methods that will enable researchers to validate empirically theoretical predictions of CLT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though Bru ¨nken et al. (2003) have empirically shown the suitability of the dual task approach for measuring cognitive load, this technique is used relatively rarely”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“The principle of this approach is that slower or more inaccurate performance on the secondary task indicates more consumption of cognitive resources by the primary task.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“An important disadvantage to this methodology is that the secondary task can interfere considerably with the primary task, especially if the primary task is complex and requires much of the learner's limited cognitive capacity [34,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“While these studies have made progress one factor is repeatedly highlighted as the weak link in CLT studies and learning studies in general: the measurement of cognitive workload [10,31,24,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview).”
From Measuring Cognitive Load in Embodied Learning Settings (2017) · cites this paper as Brünken et al., 2003
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“…involved in holding information in memory for short periods of time; Baddeley & Logie, 1999), it has been utilized only rarely in cognitive load research (Chandler & Sweller, 1996; Marcus, Cooper, & Sweller, 1996; Sweller, 1988) and in the field of multimedia learning (Brünken et al., 2002).”
MethodMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 6×
“Based on different sources for cognitive load, Sweller (1999) distinguished three types of load: one type that is attributed to”
BackgroundInfluentialMental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“…imagining (Cooper, Tindall-Ford, Chan-dler, & Sweller, 2001); and activities that are designed based on the completion effect (van Merriënboer, Schuurman, de Croock, & Paas, 2002), modality effect (Brünken & Leutner, 2001; Mayer & Moreno, 2003; Sweller, 1999), and redundancy effect (Sweller, 1999).”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 2×
“…load, formulated principles of instructional design that are based on cognitive load theory (CLT), and learned how to de-sign instructional strategies and activities that reduce certain types of load (Chandler & Sweller, 1991; Mayer, 2001; Sweller, 1999; Sweller, van Merriënboer, & Paas, 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Another method, used in experimental psychology and in cognitive load research, is eye-tracking analysis (Paas et al., 2003).”
MethodModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,451
Cited by
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
“The secondary task technique has also been used in studies by Brünken et al. (2003), Chandler and Sweller (1996; memory task of letters), Marcus et al. (1996; simple tone detection task and memory task of numbers), and Van Gerven, Paas, van Merriënboer, and Schmidt (2002c; simple visual signal-detection task). Whereas…”
BackgroundMethodInfluentialCognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
“Whereas more recent techniques such as secondary task methods (e.g., Brünken et al., 2003) and psychophysiological measures (e.g., van Gerven et al., 2004) are used to measure cognitive load, to this point, most researchers have used rating scales.”
MethodElement Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020
“There is no reason why the currently commonly used subjective ratings of task difficulty or secondary task analysis (Brunken et al. 2003; 2004; Paas et al. 2003) cannot be used to determine changes in overall cognitive load.”
MethodCognitive load theory, educational research, and instructional design: some food for thought
de Jong, T. (2010) · Instructional Science · doi:10.1007/s11251-009-9110-0 · Cited by 1,180
“A good secondary task could be a simple monitoring task such as reacting as quickly as possible to a color change (Brünken et al. 2003) or a change of the screen background color (DeLeeuw and Mayer 2008), or detecting a simple auditory stimulus (Brünken et al.”
BackgroundA Reconsideration of Cognitive Load Theory
Schnotz, W., & Kürschner, C. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9053-4 · Cited by 755
“Accordingly, decrease in performance of the secondary task can be used as an indicator for the cognitive load imposed by the primary task (Brüncken et al. 2003).”
MethodUsing Electroencephalography to Measure Cognitive Load
Antonenko, P., Paas, F., Grabner, R., & van Gog, T. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9130-y · Cited by 742
“Objective measures include secondary task procedures, in which the amount of load imposed by the primary (learning) task is measured by the performance or response time on a secondary task (see Brunken et al. 2003 ).”
MethodKlepsch, M., Schmitz, F., & Seufert, T. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01997 · Cited by 601
“Many researchers stated that measuring cognitive load is one of the persistent challenges in educational research (Mayer and Moreno, 2002; Brünken et al., 2003, 2010; Schnotz and Kürschner, 2007; de Jong, 2010; Moreno, 2010).”
BackgroundDeLeeuw, K. E., & Mayer, R. E. (2008) · Journal of Educational Psychology · doi:10.1037/0022-0663.100.1.223 · Cited by 558
Emotional design in multimedia learning: Effects of shape and color on affect and learning
Plass, J. L., Heidig, S., Hayward, E. O., Homer, B. D., & Um, E. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.02.006 · Cited by 550
Self-citationPaas, F., & Sweller, J. (2012) · Educational Psychology Review · doi:10.1007/s10648-011-9179-2 · Cited by 502
“The higher the load imposed by the primary explanation task, the lower the available cognitive capacity would be for remembering the words or letters of the secondary task (e.g., Brünken et al. 2003; Chandler and Sweller 1996; Paas et al. 2003; Sweller 1988).”
BackgroundInstructional Efficiency: Revisiting the Original Construct in Educational Research
van Gog, T., & Paas, F. (2008) · Educational Psychologist · doi:10.1080/00461520701756248 · Cited by 473
“Objective online measures include physiological measures such as heart-rate variability ( Paas & Van Merrienboer, 1994 ; note though that they found this measure to be quite intrusive as well as insensitive to subtle fluctuations in cognitive load), psychophysiological measures such as eye-movement data ( Van Gerven,…”
BackgroundThe Split-Attention Principle in Multimedia Learning
Ayres, P., & Sweller, J. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.009 · Cited by 472
Tyler-Smith, K. (2006) · Journal of online learning and teaching · Cited by 467
Classification of learning outcomes: evidence from the computer games literature
O'Neil, H. F., Wainess, R., & Baker, E. L. (2005) · The Curriculum Journal · doi:10.1080/09585170500384529 · Cited by 447
“Level 3 concerns the concept of transfer , which Brunken et al .”
BackgroundLearning with desktop virtual reality: Low spatial ability learners are more positively affected
Lee, E. A.-L., & Wong, K. W. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.07.010 · Cited by 444
“It has been increasingly used to inform the instructional design and to predict effectiveness with new technologies (Brunken et al., 2003).”
BackgroundLearning anatomy via mobile augmented reality: Effects on achievement and cognitive load
Küçük, S., Kapakin, S., & Göktaş, Y. (2016) · Anatomical Sciences Education · doi:10.1002/ase.1603 · Cited by 430
Cierniak, G., Scheiter, K., & Gerjets, P. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.020 · Cited by 412
“Once an appropriate secondary task is found, using secondary task performance as a cognitive load measure has the advantage of providing objective and direct measures of the overall cognitive load (Brünken et al., 2003).”
MethodMayer, R. E. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.013 · Cited by 399
What is the relationship between mental workload factors and cognitive load types?
Galy, E., Cariou, M., & Mélan, C. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.09.023 · Cited by 395
“However, psychophysiological measures are also very sensitive to physical effort and will reflect specific mental load variations only for activities involving little or no physical effort (Brünken et al., 2003).”
BackgroundFostering social agency in multimedia learning: Examining the impact of an animated agent’s voice
Atkinson, R. K., Mayer, R. E., & Merrill, M. M. (2005) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2004.07.001 · Cited by 388
Using subjective measures to detect variations of intrinsic cognitive load within problems
Ayres, P. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.09.001 · Cited by 381
Personalized Messages That Promote Science Learning in Virtual Environments.
Moreno, R., & Mayer, R. E. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.1.165 · Cited by 370
Mayer, R. E., & Fiorella, L. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.015 · Cited by 364
Handbook of Research on Effective Electronic Gaming in Education
(2009) · IGI Global eBooks · doi:10.4018/978-1-59904-808-6 · Cited by 363
Mayer, R. E. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.017 · Cited by 309
Cognitive load in multimedia learning environments: A systematic review
Mutlu-Bayraktar, D., Cosgun, V., & Altan, T. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103618 · Cited by 304
Cognitive Load and Classroom Teaching: The Double-Edged Sword of Automaticity
FELDON, D. F. (2007) · Educational Psychologist · doi:10.1080/00461520701416173 · Cited by 300
“The automated knowledge of experts occupies very little space in working memory, which allows for allocation of more resources to other cognitive activities ( Brown & Bennett, 2002 ; Bruenken, Plass, & Leutner, 2003 ).”
BackgroundFrederiksen, J. G., Sørensen, S. M. D., Konge, L., Svendsen, M. B. S., Nobel-Jørgensen, M., Bjerrum, F., & Andersen, S. A. W. (2020) · Surgical Endoscopy · doi:10.1007/s00464-019-06887-8 · Cited by 294
Chang, C.-C., Liang, C., Chou, P.-N., & Lin, G.-Y. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.01.031 · Cited by 292
Butcher, K. R. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.010 · Cited by 291
Mayer, R. E. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.012 · Cited by 290
Brünken, R., Plass, J. L., & Leutner, D. (2004) · Instructional Science · doi:10.1023/b:truc.0000021812.96911.c5 · Cited by 277
“We therefore need to develop and implement methods that can provide insights into cognitive processes that go beyond learning outcomes, such as eye tracking analysis, neuroimaging techniques, or dual task analysis, which, although new in this domain, are successfully used in general psychology ( Brunken, Plass and Leu…”
BackgroundMethodInfluentialSelf-citationTurner-McGrievy, G., & Tate, D. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1841 · Cited by 263
“In addition to the diet, physical activity, and psychosocial measures discussed above, other measures were collected at both 3 and 6 months including novelty, cognitive load [26], user control [27], elaboration (Elaboration Likelihood Model Questionnaire) [28], and process evaluation questions, all via online question…”
BackgroundFletcher, J. D., & Tobias, S. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.008 · Cited by 132
Instructional aids to support a conceptual understanding of multiple representations.
Berthold, K., & Renkl, A. (2009) · Journal of Educational Psychology · doi:10.1037/a0013247 · Cited by 238
“The latter finding disconfirms Chi’s (2000) probably too optimistic theoretical account of incorrect self-explanations.”
ResultLai, A., Chen, C., & Lee, G. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12716 · Cited by 235
When Redundant On-Screen Text in Multimedia Technical Instruction Can Interfere With Learning
Kalyuga, S., Chandler, P., & Sweller, J. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.3.567.50405 · Cited by 235
Huang, C. L., Luo, Y. F., Yang, S. C., Lu, C. M., & Chen, A.-S. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119867422 · Cited by 234
“The cognitive load of the learner-based aspect is the cognitive ability and the resources demanded of the learner in the performance of tasks, which is called mental effort (Brunken, Plass, & Leutner, 2003; S. F. Chen, 2016).”
BackgroundThe instructor’s face in video instruction: Evidence from two large-scale field studies.
Kizilcec, R. F., Bailenson, J. N., & Gomez, C. J. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000013 · Cited by 220
Measuring Knowledge to Optimize Cognitive Load Factors During Instruction.
Kalyuga, S., & Sweller, J. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.558 · Cited by 219
Cognitive Load as Motivational Cost
Feldon, D. F., Callan, G., Juth, S., & Jeong, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09464-6 · Cited by 218
Virtual reality learning environment for enhancing electronics engineering laboratory experience
Singh, G., Mantri, A., Sharma, O., & Kaur, R. (2021) · Computer Applications in Engineering Education · doi:10.1002/cae.22333 · Cited by 214
Kim, Y., Soyata, T., & Behnagh, R. F. (2018) · IEEE Access · doi:10.1109/access.2018.2791861 · Cited by 213
“The same video stream is also used to compute the presenter’s cognitive load ([C] vector) using techniques that correlate pupil dilations or other facial expressions to the cognitive load [11], [12].”
BackgroundMethodMayer, R. E., & Pilegard, C. (2014) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9781139547369.016 · Cited by 212
Digital game elements, user experience and learning: A conceptual framework
Alexiou, A., & Schippers, M. C. (2018) · Education and Information Technologies · doi:10.1007/s10639-018-9730-6 · Cited by 137
“The problem with heavy structure and frequent corrective feedback is that it can have a negative impact on the engagement of the user (Huang 2011; Moreno 2004) while no structure, high complexity and minimal feedback can lead to high cognitive load and subsequent frustration and disengagement (Brünken et al. 2003; Van…”
BackgroundInfluentialKlepsch, M., & Seufert, T. (2020) · Instructional Science · doi:10.1007/s11251-020-09502-9 · Cited by 211
What does germane load mean? An empirical contribution to the cognitive load theory
Debue, N., & van de Leemput, C. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01099 · Cited by 209
“There are three types of meth-ods to address the measure of cognitive load: subjective rating, performance-based measures and physiological measures (Brunken et al., 2003; Paas et al., 2003; Chanquoy et al., 2007; Galy et al., 2012).”
BackgroundSchmeck, A., Opfermann, M., van Gog, T., Paas, F., & Leutner, D. (2015) · Instructional Science · doi:10.1007/s11251-014-9328-3 · Cited by 206
“Measuring cognitive load by means of a secondary task, that is with dual task methodologies, is one of the frequently used methods (see for instance Brünken et al. 2003, 2004; Chandler and Sweller 1996; Park et al. 2011; Sweller, 1988).”
BackgroundMethodSelf-citationIs a ‘Complex’ Task Really Complex? Validating the Assumption of Cognitive Task Complexity
SASAYAMA, S. (2016) · The Modern Language Journal · doi:10.1111/modl.12313 · Cited by 205
A systematic review of immersive virtual reality for industrial skills training
Radhakrishnan, U., Koumaditis, K., & Chinello, F. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2021.1954693 · Cited by 200
“What is more, literature beyond IVR highlights the importance of task load in the design and evaluation of instructional technology-based training (Brünken, Plass, and Leutner 2003)?”
BackgroundMayer, R. E. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.014 · Cited by 192
Ayres, P., Marcus, N., Chan, C., & Qian, N. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.013 · Cited by 191
Cognitive Load and Working Memory in Multimedia Learning: Conceptual and Measurement Issues
Anmarkrud, Ø., Andresen, A., & Bråten, I. (2019) · Educational Psychologist · doi:10.1080/00461520.2018.1554484 · Cited by 188
Cheng, K.-H. (2016) · Australasian Journal of Educational Technology · doi:10.14742/ajet.2820 · Cited by 181
Roettl, J., & Terlutter, R. (2018) · PLOS ONE · doi:10.1371/journal.pone.0200724 · Cited by 181
Schroeder, N. L., & Cenkci, A. T. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9435-9 · Cited by 180
Su, C.-H. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2799-7 · Cited by 180
“The study also confirmed the above correlation: Brünken, Plass and Leutner [12] success through the cognitive ability to predict academic achievement.”
ResultHuang, W.-H. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2010.07.021 · Cited by 178
Wästlund, E., Reinikka, H., Norlander, T., & Archer, T. (2005) · Computers in Human Behavior · doi:10.1016/j.chb.2004.02.007 · Cited by 176
Virtual reality: A new method to investigate cognitive load during navigation
Armougum, A., Orriols, E., Gaston-Bellegarde, A., Marle, C. J.-L., & Piolino, P. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101338 · Cited by 144
Multimodal behavior and interaction as indicators of cognitive load
Chen, F., Ruiz, N., Choi, E., Epps, J., Khawaja, M. A., Taib, R., Yin, B., & Wang, Y. (2012) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2395123.2395127 · Cited by 141
Chen, C. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09834-w · Cited by 170
Measuring cognitive load: performance, mental effort and simulation task complexity
Haji, F. A., Rojas, D., Childs, R., de Ribaupierre, S., & Dubrowski, A. (2015) · Medical Education · doi:10.1111/medu.12773 · Cited by 135
Multimedia Learning with Animated Pedagogical Agents
Moreno, R. (2005) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/cbo9780511816819.032 · Cited by 138
Neuroimaging of cognitive load in instructional multimedia
Whelan, R. R. (2007) · Educational Research Review · doi:10.1016/j.edurev.2006.11.001 · Cited by 165
Cognitive Cost of Using Augmented Reality Displays
Baumeister, J., Ssin, S. Y., ElSayed, N. A. M., Dorrian, J., Webb, D. P., Walsh, J. A., Simon, T. M., Irlitti, A., Smith, R. T., Kohler, M., et al. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2735098 · Cited by 165
“The dual-task paradigm is a direct, objective measurement of cognitive load [3].”
BackgroundMethodCognitive Load Theory: New Directions and Challenges
Ayres, P., & Paas, F. (2012) · Applied Cognitive Psychology · doi:10.1002/acp.2882 · Cited by 127
Gerjets, P. H., Walter, C., Rosenstiel, W., Bogdan, M., & Zander, T. O. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00385 · Cited by 160
“However, up to now these measures mostly turned out to be not very reliable and specific indicators of WML (Brünken et al., 2003; Paas et al., 2003).”
BackgroundMethodDan, A., & Reiner, M. (2016) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.08.013 · Cited by 159
Spanjers, I. A. E., van Gog, T., Wouters, P., & van Merriënboer, J. J. G. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.12.024 · Cited by 159
Fiorella, L., van Gog, T., Hoogerheide, V., & Mayer, R. E. (2017) · Journal of Educational Psychology · doi:10.1037/edu0000161 · Cited by 109
Differentiating Different Types of Cognitive Load: a Comparison of Different Measures
Korbach, A., Brünken, R., & Park, B. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9404-8 · Cited by 153
Measurement of Cognitive Load in HCI Systems Using EEG Power Spectrum: An Experimental Study
Kumar, N., & Kumar, J. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.04.068 · Cited by 153
Measuring the impact of subtitles on cognitive load: eye tracking and dynamic audiovisual texts
Kruger, J.-L., Hefer, E., & Matthew, G. (2013) · Proceedings of the 2013 Conference on Eye Tracking South Africa · doi:10.1145/2509315.2509331 · Cited by 106
Neuroanatomy Learning: Augmented Reality vs. Cross‐Sections
Henssen, D. J. H. A., van den Heuvel, L., de Jong, G., Vorstenbosch, M. A. T. M., van Walsum, A. V. C., van den Hurk, M. M., Kooloos, J. G. M., & Bartels, R. (2019) · Anatomical Sciences Education · doi:10.1002/ase.1912 · Cited by 152
“This suggests that it is difficult for students to study neuroanatomy using cross-sections, a trend that has been observed by others as well (Brunken et al., 2003; Anglin et al., 2004; Wilson, 2015).”
BackgroundUnderstanding mental workload: from a clarifying concept analysis toward an implementable framework
Acker, B. B. V., Parmentier, D. D., Vlerick, P., & Saldien, J. (2018) · Cognition Technology & Work · doi:10.1007/s10111-018-0481-3 · Cited by 150
“…dependent variables such as reaction time, quality, accuracy and error rate (Paas et al. 2003) or performance on subsequent or even simultaneous secondary tasks (cf., dual-task paradigms) to make inferences about the cognitive resources spent (cf., Brookhuis and de Waard 2000; Brunken et al. 2003).”
BackgroundMultimedia learning principles in different learning environments: a systematic review
Çeken, B., & Taşkın, N. (2022) · Smart Learning Environments · doi:10.1186/s40561-022-00200-2 · Cited by 149
“Assessment of the cognitive load was categorized by Brunken et al. (2003) in two dimensions: objectivity (subjective or objective) and causal relationship (direct or indirect).”
BackgroundCognitive load theory: Practical implications and an important challenge
Leppink, J. (2017) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2017.05.003 · Cited by 149
Measuring cognitive load in introductory CS: adaptation of an instrument
Morrison, B. B., Dorn, B., & Guzdial, M. (2014) · Proceedings of the tenth annual conference on International computing education research · doi:10.1145/2632320.2632348 · Cited by 147
“Examples of cognitive load studies using the dual task methodology can be found in [8, 11, 40].”
Backgroundde Guinea, A. O., Titah, R., & Léger, P.-M. (2014) · Journal of Management Information Systems · doi:10.2753/mis0742-1222300407 · Cited by 127
The dark sides of AI personal assistant: effects of service failure on user continuance intention
Sun, Y., Li, S., & Yu, L. (2021) · Electronic Markets · doi:10.1007/s12525-021-00483-2 · Cited by 148
“1 3 load caused by the complexity of the object (Brünken et al., 2003).”
BackgroundInfluentialCognitive load and the format of instructional aids for coherence formation
Seufert, T., & Brünken, R. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1248 · Cited by 129
Harris, D., Wilson, M., & Vine, S. (2020) · Virtual Reality · doi:10.1007/s10055-019-00422-9 · Cited by 146
Does the modality principle for multimedia learning apply to science classrooms?
Harskamp, E. G., Mayer, R. E., & Suhre, C. (2007) · Learning and Instruction · doi:10.1016/j.learninstruc.2007.09.010 · Cited by 145
Brünken, R., Seufert, T., & Paas, F. (2010) · Cognitive Load Theory · doi:10.1017/cbo9780511844744.011 · Cited by 143
Self-citationAttention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2
Kruger, J., Hefer, E., & Matthew, G. (2014) · Journal of Eye Movement Research · doi:10.16910/jemr.7.5.4 · Cited by 143
Measuring Cognitive Load in Embodied Learning Settings
Skulmowski, A., & Rey, G. D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01191 · Cited by 141
“Physiological measures of cognitive load (for overviews, see Brünken et al., 2003; Paas et al., 2003) include electroencephalography (EEG; e.g., Antonenko et al., 2010), heart rate (e.g., Paas et al., 1994), and pupil dilation (e.g., van Gerven et al., 2004).”
BackgroundInfluentialThrive or overload? The effect of task complexity on novices’ simulation‐based learning
Haji, F. A., Cheung, J. J. H., Woods, N. N., Regehr, G., de Ribaupierre, S., & Dubrowski, A. (2016) · Medical Education · doi:10.1111/medu.13086 · Cited by 141
Schmeck, A., Mayer, R. E., Opfermann, M., Pfeiffer, V. D. I., & Leutner, D. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.07.003 · Cited by 140
Self-citationCegarra, J., & Chevalier, A. (2008) · Behavior Research Methods · doi:10.3758/brm.40.4.988 · Cited by 140
“Brunken, Plass, and Leutner (2003) suggested that methods can be classified along two of these antitheses: direct or indirect (causal relation) and objective or subjective (objectivity).”
BackgroundYuksel, B. F., Oleson, K. B., Harrison, L., Peck, E. M., Afergan, D., Chang, R., & Jacob, R. J. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858388 · Cited by 137
“The method of cognitive workload measurement in learning studies have come under criticism and scrutiny in recent years [7, 10, 31, 24].”
BackgroundMethodInfluentialCognition and Student-Centered, Web-Based Learning: Issues and Implications for Research and Theory
Hannafin, M. J., & Hannafin, K. M. (2009) · Springer eBooks · doi:10.1007/978-1-4419-1551-1_2 · Cited by 137
“Many researchers have concluded that hyperlinked learning materials can sig-nificantly increase extraneous cognitive load (Brunken, Plass, & Leutner, 2003; Niederhauser, Reynolds, Salmen, & Skolmoski, 2000).”
BackgroundLi, Q., & Baker, R. B. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.08.005 · Cited by 136
Computer-aided diagnosis of congestive heart failure using ECG signals – A review
Jahmunah, V., Oh, S. L., Wei, J. K. E., Ciaccio, E. J., Chua, K. C., San, T. R., & Acharya, U. R. (2019) · Physica Medica · doi:10.1016/j.ejmp.2019.05.004 · Cited by 135
Cybertext redux: using digital game-based learning to teach L2 vocabulary, reading, and culture
Neville, D. O., Shelton, B. E., & McInnis, B. (2009) · Computer Assisted Language Learning · doi:10.1080/09588220903345168 · Cited by 93
“The consideration of cognitive load in our methodology is important as numerous researchers in cognitive load theory (CLT) identify engagement in learning with the germane cognitive load of interacting with instructional media (Bru¨nken, Plass, & Leutner, 2003; Sweller, 1994).”
BackgroundExploring Multidimensional Approaches to the Efficiency of Instructional Conditions
Tuovinen, J. E., & Paas, F. (2004) · Instructional Science · doi:10.1023/b:truc.0000021813.24669.62 · Cited by 134
Cognitive load theory: more food for thought
Moreno, R. (2010) · Instructional Science · doi:10.1007/s11251-009-9122-9 · Cited by 132
“de Jong and others have discussed the strengths and limitations of the objective and subjective measures of CL used in the past (see also Brünken and Seufert 2009; Brünken et al. 2003; Brünken et al. 2009).”
BackgroundThe Cognitive Load of Geographic Information
Bunch, R. L., & Lloyd, R. E. (2006) · The Professional Geographer · doi:10.1111/j.1467-9272.2006.00527.x · Cited by 131
Gerjets, P., Scheiter, K., & Cierniak, G. (2009) · Educational Psychology Review · doi:10.1007/s10648-008-9096-1 · Cited by 130
“It has turned out that testing these assumptions seems to be one of the major scientific challenges for CLT (Brünken et al. 2003; Schnotz and Kürschner 2007).”
Background
Metadata
- Authors
- Brunken, R., Plass, J. L., & Leutner, D.
- Affiliations
- New York University (US)
- University of Erfurt (DE)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 53-61
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1967395107
- Semantic Scholar
- 70a37f895bee605bed1aa6df431495797b53e86b
- Cited by
- 896
- References
- 49
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 34 · 2023: 32 · 2022: 51 · 2021: 42 · 2020: 54 · 2019: 63 · 2018: 57 · 2017: 40 · 2016: 52 · 2015: 60 · 2014: 45 · 2013: 35 · 2012: 36
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- cognitive load, cognitive load theory, multimedia learning, direct measurement, dual-task paradigm, working memory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.