Direct Measurement of Cognitive Load in Multimedia Learning
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Cognitive load theory (CLT) is gaining increasing importance in the design and evaluation of instruction, both traditional and technology based. Although it is well understood as a theoretical construct, the measurement of cognitive load induced by instructional materials in general, and by multimedia instruction in particular, mainly relies on methods that are either indirect, subjective, or both. Integrating aspects of CLT, working memory research, and cognitive theories of multimedia learning, we describe the conceptual basis and practical implementation of a dual-task approach to the direct measurement of cognitive load in multimedia learning. This computer-based instrument provides a direct and objective measure that overcomes many of the shortcomings of other indirect and subjective methods that will enable researchers to validate empirically theoretical predictions of CLT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though Bru ¨nken et al. (2003) have empirically shown the suitability of the dual task approach for measuring cognitive load, this technique is used relatively rarely”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“The principle of this approach is that slower or more inaccurate performance on the secondary task indicates more consumption of cognitive resources by the primary task.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“An important disadvantage to this methodology is that the secondary task can interfere considerably with the primary task, especially if the primary task is complex and requires much of the learner's limited cognitive capacity [34,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“While these studies have made progress one factor is repeatedly highlighted as the weak link in CLT studies and learning studies in general: the measurement of cognitive workload [10,31,24,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview).”
From Measuring Cognitive Load in Embodied Learning Settings (2017) · cites this paper as Brünken et al., 2003
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“…involved in holding information in memory for short periods of time; Baddeley & Logie, 1999), it has been utilized only rarely in cognitive load research (Chandler & Sweller, 1996; Marcus, Cooper, & Sweller, 1996; Sweller, 1988) and in the field of multimedia learning (Brünken et al., 2002).”
MethodMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 6×
“Based on different sources for cognitive load, Sweller (1999) distinguished three types of load: one type that is attributed to”
BackgroundInfluentialMental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“…imagining (Cooper, Tindall-Ford, Chan-dler, & Sweller, 2001); and activities that are designed based on the completion effect (van Merriënboer, Schuurman, de Croock, & Paas, 2002), modality effect (Brünken & Leutner, 2001; Mayer & Moreno, 2003; Sweller, 1999), and redundancy effect (Sweller, 1999).”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 2×
“…load, formulated principles of instructional design that are based on cognitive load theory (CLT), and learned how to de-sign instructional strategies and activities that reduce certain types of load (Chandler & Sweller, 1991; Mayer, 2001; Sweller, 1999; Sweller, van Merriënboer, & Paas, 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Another method, used in experimental psychology and in cognitive load research, is eye-tracking analysis (Paas et al., 2003).”
MethodModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,451
Cited by
Items 101–200 of 1,000
Dinçer, S., & Doğanay, A. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.04.005 · Cited by 132
The effectiveness of multimedia programmes in children's vocabulary learning
Acha, J. (2008) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00800.x · Cited by 130
The effect of a virtual reality learning environment on learners’ spatial ability
Sun, R., Wu, Y. J., & Cai, Q. (2018) · Virtual Reality · doi:10.1007/s10055-018-0355-2 · Cited by 128
Aubert, A. H., Bauer, R., & Lienert, J. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2018.03.023 · Cited by 127
“Moreover, it is influenced by the individual's prior knowledge (Brünken et al., 2003).”
BackgroundAssessment of learners' organised knowledge structures in adaptive learning environments
Kalyuga, S. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1249 · Cited by 96
The Rhythm Method: A New Method for Measuring Cognitive Load—An Experimental Dual‐Task Study
Park, B., & Brünken, R. (2015) · Applied Cognitive Psychology · doi:10.1002/acp.3100 · Cited by 102
Sparling, E. I., & Sen, S. (2011) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/2043932.2043961 · Cited by 122
“Ratings for all scales have been translated to [1,5].”
BackgroundMethodInfluentialCognition Digital Twins for Personalized Information Systems of Smart Cities: Proof of Concept
Du, J., Zhu, Q., Shi, Y., Wang, Q., Lin, Y., & Zhao, D. (2020) · Journal of Management in Engineering · doi:10.1061/(asce)me.1943-5479.0000740 · Cited by 102
“The working memory accuracy is used as a direct indicator of cognitive load, as suggested by the literature (Brunken et al. 2003; Engle 2016; Jonides et al. 1997; Tracy and Albers 2006).”
MethodGetting the point: Tracing worked examples enhances learning
Hu, F., Ginns, P., & Bobis, J. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.10.002 · Cited by 123
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
“The CLT is an instructional framework finding wide application in multimedia learning research (Brünken et al., 2003; Paas & Sweller, 2014).”
BackgroundShayesteh, S., Ojha, A., Liu, Y., & Jebelli, H. (2022) · Safety Science · doi:10.1016/j.ssci.2022.106019 · Cited by 117
Learning programming via worked-examples: Relation of learning styles to cognitive load
Abdul-Rahman, S.-S., & du Boulay, B. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2013.09.007 · Cited by 92
Turner-McGrievy, G. M., Campbell, M. K., Tate, D. F., Truesdale, K. P., Bowling, J. M., & Crosby, L. (2009) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.06.010 · Cited by 112
Cognitive load in distributed and massed practice in virtual reality mastoidectomy simulation
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2016) · The Laryngoscope · doi:10.1002/lary.25449 · Cited by 95
“Secondary task performance, including the measurement of reaction time, is an established direct/objective method to estimate CL 11 ; in line with this assumption, we will discuss our findings on change in reaction time as a change in CL.”
MethodIdea Convergence Quality in Open Innovation Crowdsourcing: A Cognitive Load Perspective
Cheng, X., Fu, S., de Vreede, T., de Vreede, G., Seeber, I., Maier, R. K., & Weber, B. (2020) · Journal of Management Information Systems · doi:10.1080/07421222.2020.1759344 · Cited by 111
“Cognitive overload leads to frustration and dissatisfaction [10].”
BackgroundInfluentialEffects of concurrent monitoring on cognitive load and performance as a function of task complexity
van Gog, T., Kester, L., & PAAS, F. G. W. C. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1726 · Cited by 109
The role of working memory components in multimedia comprehension
Gyselinck, V., Jamet, E., & Dubois, V. (2008) · Applied Cognitive Psychology · doi:10.1002/acp.1411 · Cited by 93
“Brünken et al. (2002) concluded that an audiovisual document imposes a lower load on WM than a visual document.”
BackgroundDistribution of cognitive load in Web search
Gwizdka, J. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21385 · Cited by 108
Measuring cognitive load in augmented reality with physiological methods: A systematic review
Suzuki, Y., Wild, F., & Scanlon, E. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12882 · Cited by 107
“Conventionally, cognitive load has been measured by subjective methods and performance tests (Brünken et al., 2003; Martin, 2014; Zagermann et al., 2016).”
MethodElme, L., Jørgensen, M. L. M., Dandanell, G., Mottelson, A., & Makransky, G. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10139-3 · Cited by 106
“If the instructional methods are suboptimal, the learners need to apply cognitive processes that do not directly contribute to the construction of their cognitive schemata and do not serve the learning goals (Brünken et al., 2003; Sweller & Chandler, 1994; Sweller et al., 1990).”
MethodCurrent Issues and Open Questions in Cognitive Load Research
Brünken, R., Plass, J. L., & Moreno, R. (2010) · Cognitive Load Theory · doi:10.1017/cbo9780511844744.014 · Cited by 78
Self-citationReanalyzing the expertise reversal effect
Schnotz, W. (2009) · Instructional Science · doi:10.1007/s11251-009-9104-y · Cited by 107
Task-Based Language Teaching: Issues, Research and Practice
(2013) · Task-based language teaching · doi:10.1075/tblt · Cited by 102
Feenstra, H. E. M., Murre, J. M. J., Vermeulen, I., Kieffer, J. M., & Schagen, S. B. (2017) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2017.1339017 · Cited by 101
“Instructions are presented through an audiovisual mode (video), promoting “ dual processing ” that fosters better understanding and learning as cognitive overload is prevented, and individual capacity is optimized (Brünken & Plass, 2003; van Hooijdonk & Krahmer, 2008).”
BackgroundEngagement: what is it good for? The role of learner engagement in healthcare simulation contexts
Padgett, J. K., Cristancho, S., Lingard, L., Cherry, R. A., & Haji, F. A. (2018) · Advances in Health Sciences Education · doi:10.1007/s10459-018-9865-7 · Cited by 101
Ignacio Madrid, R., Van Oostendorp, H., & Puerta Melguizo, M. C. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.06.005 · Cited by 99
Measurement of cognitive load in multimedia learning: a comparison of different objective measures
Korbach, A., Brünken, R., & Park, B. (2017) · Instructional Science · doi:10.1007/s11251-017-9413-5 · Cited by 98
“The better the format of instruction, the lower the amount of extraneous cognitive load (Bru¨nken et al. 2003; Paas et al. 2003b).”
BackgroundMethodTask Complexity, Cognitive Load, and L1 Speech
Lee, J. (2018) · Applied Linguistics · doi:10.1093/applin/amx054 · Cited by 98
Engaging robots: easing complex human-robot teamwork using backchanneling
Jung, M. F., Lee, J. J., DePalma, N., Adalgeirsson, S. O., Hinds, P. J., & Breazeal, C. (2013) · Proceedings of the 2013 conference on Computer supported cooperative work · doi:10.1145/2441776.2441954 · Cited by 81
“To measure cognitive load, we took a direct, objective measure using a dual task paradigm [12, 50].”
MethodChevalier, A., & Kicka, M. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.06.002 · Cited by 96
Cognitive Load in eCommerce Applications—Measurement and Effects on User Satisfaction
Schmutz, P., Heinz, S., Métrailler, Y., & Opwis, K. (2009) · Advances in Human-Computer Interaction · doi:10.1155/2009/121494 · Cited by 74
“The methods that are used to measure cognitive load can be classified based on the two dimensions of objectivity (subjective or objective) and causal relationship (direct or indirect) [24].”
BackgroundMethodInfluentialThe Interplay of Cognitive Load, Learners’ Resources and Self-regulation
Seufert, T., Hamm, V., Vogt, A., & Riemer, V. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09890-1 · Cited by 98
“Thus, cognitive load seems to depend on different characteristics of learners, such as ability, interest, or prior knowledge (Brünken et al., 2003).”
Measuring physician cognitive load: validity evidence for a physiologic and a psychometric tool
Szulewski, A., Gegenfurtner, A., Howes, D. W., Sivilotti, M. L. A., & van Merriënboer, J. J. G. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-016-9725-2 · Cited by 94
“Dual-task performance techniques (which are based on the premise that limited cognitive resources exist that must be distributed between two competing tasks) have gained some popularity in the literature as a means to quantify cognitive load as well (Brunken et al. 2003).”
BackgroundAndersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.09.010 · Cited by 93
Grangeia, T. D. A. G., de Jorge, B., Franci, D., Santos, T. M., Setúbal, M. S. V., Schweller, M., & Filho, C. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152462 · Cited by 91
“Different pedagogic approaches can also reduce the extraneous load, such as, splitting the main task in partial ones which students can complete by themselves (problem completion), providing worked examples and maintaining one integrated source of information [10,12].”
BackgroundCoherence formation when learning from text and pictures: What kind of support for whom?
Bartholomé, T., & Bromme, R. (2009) · Journal of Educational Psychology · doi:10.1037/a0014312 · Cited by 81
Understanding Programming Expertise: An Empirical Study of Phasic Brain Wave Changes
Crk, I., Kluthe, T., & Stefik, A. (2015) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2829945 · Cited by 91
“Traditional objective CLT measures use performance and response timing of secondary tasks to measure the load of primary tasks [Brunken et al. 2003].”
BackgroundHan, Y., Diao, Y., Yin, Z., Jin, R., Kangwa, J., & Ebohon, O. J. (2021) · Advanced Engineering Informatics · doi:10.1016/j.aei.2021.101298 · Cited by 88
Khawaja, M. A., Chen, F., & Marcus, N. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2013.860579 · Cited by 67
“Traditionally, the most reliable results for cognitive load assessment have been achieved through subjective measures (Brunken, Plass, & Leutner, 2003; Paas & Merrinboer, 1994; Paas, Tuovinen, Tabbers, & Gerven, 2003), which ask users to describe in fine detail their own perceived level of cognitive…”
BackgroundÖrün, Ö., & Akbulut, Y. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.11.027 · Cited by 87
A systematic map of research characteristics in studies on augmented reality and cognitive load
Buchner, J., Buntins, K., & Kerres, M. (2021) · Computers and Education Open · doi:10.1016/j.caeo.2021.100036 · Cited by 86
“7%) each assess the cognitive load using the 9-Point Cognitive Load Scale (9-Point CLS, referenced as based on [68]) and a dual task approach [69].”
MethodThe effect of page layout on mental workload: A dual-task experiment
Wästlund, E., Norlander, T., & Archer, T. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2007.05.001 · Cited by 86
“The rationale used in this interpretation of the reaction time results is that the level of mental workload determines the cognitive resources available for reacting to the occurrence of a stimulus (Brunken et al., 2002; Marcus, Cooper, & Sweller, 1996a; Verwey & Veltman, 1996; Wickens, 1984), in this case the pop-ups…”
Roles for software technologies in advancing research and theory in educational psychology
Hadwin, A. F., Winne, P. H., & Nesbit, J. C. (2005) · British Journal of Educational Psychology · doi:10.1348/000709904x19263 · Cited by 85
“…is organized and presented, extraneous cognitive load is the effort applied by learners to comprehend and process information, and germaine cognitive load refers to load produced when trying to understand and learn content (Brunken et al., 2003; Pollock, Chandler, & Sweller, 2002; Sweller, 1999).”
BackgroundThe effect of thematic video-based instruction on learning and motivation in e-learning
Chen, Y.-T. (2012) · International Journal of the Physical Sciences · doi:10.5897/ijps11.1788 · Cited by 84
“…different sources of working memory load, related to the complexity of the material (intrinsic load), the instructional design (extraneous load), and the amount of mental effort learners invest in learning the materials (germane load) (Brünken et al., 2003; Paas et al., 2003; Sweller, 1999).”
BackgroundEvaluating and Managing Cognitive Load in Games
Kalyuga, S., & Plass, J. L. (2009) · Handbook of Research on Effective Electronic Gaming in Education · doi:10.4018/978-1-59904-808-6.ch041 · Cited by 64
Self-citationOnline cognition: factors facilitating reliable online neuropsychological test results
Feenstra, H. E. M., Vermeulen, I., Murre, J. M. J., & Schagen, S. B. (2016) · The Clinical Neuropsychologist · doi:10.1080/13854046.2016.1190405 · Cited by 83
“…of stress and anxiety increase cognitive load (Buckelew & Hannay, 1986) – just like high cognitive load can increase feelings of stress and anxiety (Brünken & Plass, 2003) – and, furthermore, lead to an uncomfortable assessment. therefore, the amount of stress and anxiety should be limited as…”
BackgroundInfluentialYoo, G., Kim, H., & Hong, S. (2023) · Bioengineering · doi:10.3390/bioengineering10030361 · Cited by 82
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2016) · Advances in Simulation · doi:10.1186/s41077-016-0022-1 · Cited by 81
“In the following, we will discuss the change in reaction time as a change in CL as established in the literature [5, 6].”
BackgroundMethodLaviola, E., Gattullo, M., Manghisi, V. M., Fiorentino, M., & Uva, A. E. (2022) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-021-08449-6 · Cited by 79
“At various times, they received a signal consisting of the color change (from blue to white) of a letter [55], placed at the top center of the interface (Fig.”
BackgroundRittschof, K. A. (2008) · Educational Technology Research and Development · doi:10.1007/s11423-008-9093-6 · Cited by 81
“Varying types of formative assessment feedback ( Black and Wiliam 1998 ) might be used to allow students to monitor their progress, provide a source of encouragement for their sustained effort, and determine their readiness to engage in deeper, less structured levels of topic learning.”
BackgroundDoes the Modality Effect Exist? and if So, Which Modality Effect?
Reinwein, J. (2011) · Journal of Psycholinguistic Research · doi:10.1007/s10936-011-9180-4 · Cited by 77
The effect of autostereoscopic holograms on anatomical knowledge: a randomised trial
Hackett, M., & Proctor, M. D. (2018) · Medical Education · doi:10.1111/medu.13729 · Cited by 77
Wallen, E. S., Plass, J. L., & Brünken, R. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504798 · Cited by 78
Self-citationDo You Trust Me, Blindly? Factors Influencing Trust Towards a Robot Recommender System
Herse, S., Vitale, J., Tonkin, M., Ebrahimian, D., Ojha, S., Johnston, B., Judge, W., & Williams, M.-A. (2018) · 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2018.8525581 · Cited by 61
“This leads to the addition of an extra cognitive load during decision making, with increases in cognitive load linked to increases in reaction time due to mental processing [34].”
BackgroundOrchestration Load Indicators and Patterns: In-the-Wild Studies Using Mobile Eye-Tracking
Prieto, L. P., Sharma, K., Kidziński, Ł., & Dillenbourg, P. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2690687 · Cited by 75
“physiological ones [25], which track involuntary reactions”
BackgroundRomine, W. L., Schroeder, N. L., Graft, J., Yang, F., Sadeghi, R., Zabihimayvan, M., Kadariya, D., & Banerjee, T. (2020) · Sensors · doi:10.3390/s20174833 · Cited by 75
“Similarly, secondary task techniques have the potential to interfere with the primary learning task [13], meaning that they may have to be changed depending on”
BackgroundCollaboration modality, cognitive load, and science inquiry learning in virtual inquiry environments
Erlandson, B. E., Nelson, B. C., & Savenye, W. C. (2010) · Educational Technology Research and Development · doi:10.1007/s11423-010-9152-7 · Cited by 77
“Brünken et al. (2003) provide an in-depth description of the difference between direct subjective, direct objective, and other types of cognitive load measurement methods.”
BackgroundMethodPhan, H. P., Ngu, B. H., & Yeung, A. S. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9373-3 · Cited by 74
“However, researchers have criticized this scale for its problematic psychometric properties (Brunken et al. 2003).”
BackgroundAngkan, P., Behinaein, B., Mahmud, Z., Bhatti, A., Rodenburg, D., Hungler, P. C., & Etemad, A. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3345846 · Cited by 73
“Prior research has shown that measuring cognitive load from physiological signals [12], [13] continues to be a challenging task [14], [15].”
BackgroundBlohm, I., Riedl, C., Leimeister, J. M., & Krcmar, H. (2011) · Alexandria (UniSG) (University of St.Gallen) · Cited by 75
Renkl, A., Gruber, H., Weber, S., Lerche, T., & Schweizer, K. (2003) · Zeitschrift für Pädagogische Psychologie · doi:10.1024//1010-0652.17.2.93 · Cited by 35
How do i do? Investigating effects of expertise and performance‐process records on self‐assessment
Kostons, D. D. N. M., van Gog, T., & PAAS, F. G. W. C. (2008) · Applied Cognitive Psychology · doi:10.1002/acp.1528 · Cited by 73
A Current View on Dual-Task Paradigms and Their Limitations to Capture Cognitive Load
Bijarsari, S. E. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.648586 · Cited by 71
Lyu, Y., Luo, X., Zhou, J., Yu, C., Miao, C., Wang, T., Shi, Y., & Kameyama, K.-I. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702399 · Cited by 59
“In addition to EEG, neuroimaging techniques, such as positron-emission tomography (PET) and functional magnetic resonance imaging (fMRI) are also very important for measuring brain activation during task execution [4].”
BackgroundInfluentialMultimodal Learning Analytics to Inform Learning Design: Lessons Learned from Computing Education
Mangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. N. (2020) · Journal of Learning Analytics · doi:10.18608/jla.2020.73.7 · Cited by 69
“Although MMLA methods for measuring complex internal conditions are objective and indirect, as defined by Brunken, Plass, and Leutner (2003), we do not exclude the possibility of measuring complex internal conditions with other methods such as think-aloud protocols, pretests/post-tests, or…”
MethodUysal, M. P. (2015) · Interactive Learning Environments · doi:10.1080/10494820.2015.1041400 · Cited by 68
“Brünken, Plass, and Leutner (2003) classi fi es these techniques into two groups: (1) objective/subjective and (2) direct/indirect methods.”
MethodShadiev, R., & Huang, Y. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1559863 · Cited by 69
“In this study, the inherent nature of the learning material, learner expertise, and the interaction between them was the most factor most influencing cognitive load (Brunken et al., 2003; Sweller et al., 1998).”
BackgroundThe double-edged effects of explanation prompts
Berthold, K., Röder, H., Knörzer, D., Kessler, W., & Renkl, A. (2011) · Computers in Human Behavior · doi:10.1016/j.chb.2010.05.025 · Cited by 67
Xu, T. S., Zhang, L. J., & Gaffney, J. S. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263121000310 · Cited by 67
“Dualtask methodology, as an objective measurement, serves as a direct measure of cognitive demands without the influence of mediating variables, and is independent from the learners’ self-report (Brünken et al., 2003; Schoor et al., 2012).”
BackgroundMethodInfluentialKeith, N., Richter, T., & Naumann, J. (2009) · Applied Psychology · doi:10.1111/j.1464-0597.2009.00417.x · Cited by 68
Wang, J., Antonenko, P., Keil, A., & Dawson, K. (2020) · Mind Brain and Education · doi:10.1111/mbe.12239 · Cited by 67
Chang, S. L., & Ley, K. (2006) · Journal of interactive online learning · Cited by 66
Chae, H., & Choi, J. N. (2018) · Human Relations · doi:10.1177/0018726718765630 · Cited by 67
Measuring cognitive load and cognition: metrics for technology-enhanced learning.
Martin, S. (2014) · Educational Research and Evaluation · doi:10.1080/13803611.2014.997140 · Cited by 65
“The amount of this difference between the total cognitive load and the processing capacity of the auditory or visual system is seen as the free cognitive resource of the learner, and this has also been used to create one direct measure of cognitive load (Brünken et al., 2003).”
BackgroundMethodInfluentialBahari, A. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2021.2019957 · Cited by 42
“…the language learner ’ s own objective observations, self-reported tools, performance, and physiological conditions, while the causal relationship dimension is concerned with the existence/ absence of a relationship between cognitive load and observed/measured phenomenon (Brunken et al., 2003).”
BackgroundA neuroergonomic approach to evaluating mental workload in hypermedia interactions
Stasi, L. L. D., Antolí, A., Gea, M., & Cañas, J. J. (2011) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2011.02.008 · Cited by 67
Neurodiversity and cognitive load in online learning: A systematic review with narrative synthesis
Cunff, A. L., Giampietro, V., & Dommett, E. J. (2024) · Educational Research Review · doi:10.1016/j.edurev.2024.100604 · Cited by 66
Cognitive load of critical thinking strategies
Shehab, H. M., & Nussbaum, E. M. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.09.004 · Cited by 64
“variants (Brunken et al., 2003).”
BackgroundMethodConfirmatory Factor Analysis of Cognitive Load Ratings Supports a Two-Factor Model
Jiang, D., & Kalyuga, S. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.3.p216 · Cited by 51
“Finally, indirect subjective measures rely on learners’ ratings of subjective experiences that that are presumably affected by or correlated with cognitive load, such as self-reported stress levels (Brünken et al., 2003).”
BackgroundA comparison of four methods for cognitive load measurement
Chen, S., Epps, J., & Chen, F. (2011) · Proceedings of the 23rd Australian Computer-Human Interaction Conference · doi:10.1145/2071536.2071547 · Cited by 63
“Physiological, behavioral measures and task performance are objectiveindirect techniques while brain activity measures and dual-task performance are objective-direct techniques [1].”
BackgroundLooking at Mental Effort Appraisals through a Metacognitive Lens: Are they Biased?
Scheiter, K., Ackerman, R., & Hoogerheide, V. (2020) · Educational Psychology Review · doi:10.1007/s10648-020-09555-9 · Cited by 63
“Second, as discussed in detail below, effort measures are typically based on either subjective self-reports or objective behavioral (e.g., response time) and physiological measures (e.g., eye tracking, EEG; see Brünken et al. 2003; Sweller et al. 2011, for reviews).”
BackgroundMayer, R. E., & Fiorella, L. (2021) · The Cambridge Handbook of Multimedia Learning · doi:10.1017/9781108894333.025 · Cited by 36
Homer, B. D., & Plass, J. L. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.041 · Cited by 63
Self-citationPastore, R. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.09.018 · Cited by 62
“A seven-point Likert-scale question asking participants how easy or difficult the materials were to understand i.e., how much mental effort was required, was used to measure their perceived cognitive load (Brünken et al., 2003).”
MethodBrom, C., Děchtěrenko, F., Frollová, N., Stárková, T., Bromová, E., & D’Mello, S. K. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.07.001 · Cited by 62
Andersen, S. A. W., Konge, L., & Sørensen, M. S. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1465182 · Cited by 63
“In motor skills learning, distributed and repeated practice allows for memory consolidation (Shea et al. 2000), and in the framework of cognitive load theory, repeated practice supports the construction of mental schemata (germane load) for dealing with task intrinsic load (Br€unken et al. 2003).”
BackgroundQuality of Experience in Telemeetings and Videoconferencing: A Comprehensive Survey
Skowronek, J., Raake, A., Berndtsson, G. H., Rummukainen, O., Usai, P., Gunkel, S. N. B., Johanson, M., Habets, E. A. P., Malfait, L., Lindero, D., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3176369 · Cited by 62
Förderung der Kohärenzbildung beim Lernen mit multiplen Repräsentationen
Brünken, R., Seufert, T., & Zander, S. (2005) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652.19.12.61 · Cited by 63
Working memory capacity and disfluency effect: an aptitude-treatment-interaction study
Lehmann, J., Goussios, C., & Seufert, T. (2016) · Metacognition and Learning · doi:10.1007/s11409-015-9149-z · Cited by 61
“Brünken et al. (2003) argue that objective ratings should be preferred therefore.”
BackgroundResearching cognition and technology: how we learn across the lifespan
Petrina, S., Feng, F., & Kim, J. (2007) · International Journal of Technology and Design Education · doi:10.1007/s10798-007-9033-5 · Cited by 63
Larmuseau, C., Vanneste, P., Cornelis, J. P., Desmet, P., & Depaepe, F. (2019) · Frontline Learning Research · doi:10.14786/flr.v7i2.403 · Cited by 61
Analysis of Collaborative Communication for Linguistic Cues of Cognitive Load
Khawaja, M. A., Chen, F., & Marcus, N. (2012) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811431258 · Cited by 63
“…& Sweller, 1995; Nickel & Nachreiner, 2000), brain activity (changes in oxygenation and blood volume, electrocardiography, electroencephalography; Brunken et al., 2003; Wilson & Russell, 2003), skin conductance (Jacobs et al., 1994; Shi, Ruiz, Taib, Choi, & Chen, 2007), and eye activity (blink…”
MethodExplorations in Learning and the Brain
de Jong, T., van Gog, T., Jenks, K., Manlove, S., van Hell, J. G., Jolles, J., van Merriënboer, J. J. G., van Leeuwen, T. H., & Boschloo, A. (2009) · Springer eBooks · doi:10.1007/978-0-387-89512-3 · Cited by 61
Multiple levels of mental attentional demand modulate peak saccade velocity and blink rate
Bachurina, V., & Arsalidou, M. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e08826 · Cited by 60
“While this method has been criticized as potentially unreliable (Brunken et al., 2003), a comprehensive review on cognitive load measurement theory concludes that it shows surprising sensitivity to changes in task load (Sweller et al.”
MethodBeauchemin, N., Charland, P., Karran, A. J., Boasen, J., Tadson, B., Sénécal, S., & Léger, P. (2024) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2024.1416683 · Cited by 63
Assessing the validity of the cognitive load scale in a problem-based learning setting
Hadie, S. N. H., & Yusoff, M. S. B. (2016) · Journal of Taibah University Medical Sciences · doi:10.1016/j.jtumed.2016.04.001 · Cited by 61
Effects of Multimedia Software on Achievement of Middle School Students in an American History Class
Kingsley, K. V., & Boone, R. (2008) · Journal of Research on Technology in Education · doi:10.1080/15391523.2008.10782529 · Cited by 60
The anatomy of E ‐Learning tools: Does software usability influence learning outcomes?
Nuland, S. E. V., & Rogers, K. A. (2015) · Anatomical Sciences Education · doi:10.1002/ase.1589 · Cited by 62
The specific involvement of verbal and visuospatial working memory in hypermedia learning
Pazzaglia, F., Toso, C., & Cacciamani, S. (2007) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00741.x · Cited by 59
Chen, J., & Mokmin, N. A. M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12456-x · Cited by 59
“Brunken et al. (2003) stated that the contiguity effect can be reduced by presenting the corresponding pictures and text to reduce the extraneous cognitive load.”
Metadata
- Authors
- Brunken, R., Plass, J. L., & Leutner, D.
- Affiliations
- New York University (US)
- University of Erfurt (DE)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 53-61
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1967395107
- Semantic Scholar
- 70a37f895bee605bed1aa6df431495797b53e86b
- Cited by
- 896
- References
- 49
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 34 · 2023: 32 · 2022: 51 · 2021: 42 · 2020: 54 · 2019: 63 · 2018: 57 · 2017: 40 · 2016: 52 · 2015: 60 · 2014: 45 · 2013: 35 · 2012: 36
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- cognitive load, cognitive load theory, multimedia learning, direct measurement, dual-task paradigm, working memory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.