Direct Measurement of Cognitive Load in Multimedia Learning
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Cognitive load theory (CLT) is gaining increasing importance in the design and evaluation of instruction, both traditional and technology based. Although it is well understood as a theoretical construct, the measurement of cognitive load induced by instructional materials in general, and by multimedia instruction in particular, mainly relies on methods that are either indirect, subjective, or both. Integrating aspects of CLT, working memory research, and cognitive theories of multimedia learning, we describe the conceptual basis and practical implementation of a dual-task approach to the direct measurement of cognitive load in multimedia learning. This computer-based instrument provides a direct and objective measure that overcomes many of the shortcomings of other indirect and subjective methods that will enable researchers to validate empirically theoretical predictions of CLT.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Though Bru ¨nken et al. (2003) have empirically shown the suitability of the dual task approach for measuring cognitive load, this technique is used relatively rarely”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“The principle of this approach is that slower or more inaccurate performance on the secondary task indicates more consumption of cognitive resources by the primary task.”
From Cognitive load theory, educational research, and instructional design: some food for thought (2010) · cites this paper as Brünken et al. 2003
In the citing paper
“An important disadvantage to this methodology is that the secondary task can interfere considerably with the primary task, especially if the primary task is complex and requires much of the learner's limited cognitive capacity [34,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“While these studies have made progress one factor is repeatedly highlighted as the weak link in CLT studies and learning studies in general: the measurement of cognitive workload [10,31,24,7].”
From Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State (2016) · cites this paper as [7]
In the citing paper
“Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview).”
From Measuring Cognitive Load in Embodied Learning Settings (2017) · cites this paper as Brünken et al., 2003
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1×
“…involved in holding information in memory for short periods of time; Baddeley & Logie, 1999), it has been utilized only rarely in cognitive load research (Chandler & Sweller, 1996; Marcus, Cooper, & Sweller, 1996; Sweller, 1988) and in the field of multimedia learning (Brünken et al., 2002).”
MethodMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 6×
“Based on different sources for cognitive load, Sweller (1999) distinguished three types of load: one type that is attributed to”
BackgroundInfluentialMental Representations: A Dual Coding Approach
Paivio, A. (1986) · Medical Entomology and Zoology · Cited by 5,087
Nine Ways to Reduce Cognitive Load in Multimedia Learning
Mayer, R. E., & Moreno, R. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_6 · Cited by 4,207 · cited 1×
“…imagining (Cooper, Tindall-Ford, Chan-dler, & Sweller, 2001); and activities that are designed based on the completion effect (van Merriënboer, Schuurman, de Croock, & Paas, 2002), modality effect (Brünken & Leutner, 2001; Mayer & Moreno, 2003; Sweller, 1999), and redundancy effect (Sweller, 1999).”
BackgroundCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 2×
“…load, formulated principles of instructional design that are based on cognitive load theory (CLT), and learned how to de-sign instructional strategies and activities that reduce certain types of load (Chandler & Sweller, 1991; Mayer, 2001; Sweller, 1999; Sweller, van Merriënboer, & Paas, 1998).”
BackgroundCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 1×
“Another method, used in experimental psychology and in cognitive load research, is eye-tracking analysis (Paas et al., 2003).”
MethodModels of Working Memory: Mechanisms of Active Maintenance and Executive Control
Miyake, A., & Shah, P. (1999) · Cited by 2,451
Cited by
Items 301–400 of 1,000
Hsieh, S., Hsu, L., & Huang, T. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.03.025 · Cited by 33
Modality effects on cognitive load and performance in high-load information presentation
Cao, Y., Theune, M., & Nijholt, A. (2009) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1502650.1502697 · Cited by 33
“Their studies are mainly based on two theoretical foundations [8,17]: dual-channel theory and dual-coding theory.”
BackgroundGuo, X., Zhu, T., Wu, C., Bao, Z., & Liu, Y. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.889427 · Cited by 32
“Subjective measures, however, have some limitations, such as limited reliability and validity (Brunken et al., 2003; Anmarkrud et al., 2019).”
BackgroundLearning from interactive video: the influence of self-explanations, navigation, and cognitive load
Beege, M., & Ploetzner, R. (2024) · Instructional Science · doi:10.1007/s11251-024-09693-5 · Cited by 32
“Although attempts have been made to objectively and reliably assess cognitive load using neurophysiological and dual-task methods (for reviews see Brünken et al., 2003; Korbach et al., 2017 ), these methods are difficult to apply in educational settings.”
Seyderhelm, A. J. A., & Blackmore, K. L. (2023) · Simulation & Gaming · doi:10.1177/10468781231169910 · Cited by 32
“A wide range of secondary task methods have been developed in different experiment settings (Brunken et al., 2003; Chandler & Sweller, 1996; Haji et al., 2015; Park & Brünken, 2015; Sweller, 2011), and the DRT has been shown to be particularly successful and relatively simple to implement.”
BackgroundMethodE‐learning, dual‐task, and cognitive load: The anatomy of a failed experiment
Nuland, S. E. V., & Rogers, K. A. (2015) · Anatomical Sciences Education · doi:10.1002/ase.1576 · Cited by 33
The reverse modality effect: Examining student learning from interactive computer‐based instruction
Inan, F. A., Crooks, S. M., Cheon, J., Ari, F., Flores, R., Kurucay, M., & Paniukov, D. (2013) · British Journal of Educational Technology · doi:10.1111/bjet.12129 · Cited by 32
Effects of electronic outlining on students' argumentative writing performance
de Smet, M. J. R., Broekkamp, H., Brand‐Gruwel, S., & Kirschner, P. A. (2011) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2011.00418.x · Cited by 33
“In addition to using self-report data such as the scale used here, more direct measures such as secondary task reaction times (Kellogg 1988; Brünken et al. 2003) could be used.”
MethodStuijfzand, B. G., van der Schaaf, M. F., Kirschner, F., Ravesloot, C. J., van der Gijp, A., & Vincken, K. L. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.04.015 · Cited by 32
“As a result, there is a potential influence of performance on the relationship of information exposure and cognitive load (Brünken et al., 2003).”
BackgroundExpertise reversal effect: Cost of generating new schemas
Armougum, A., Gaston‐Bellegarde, A., Marle, C. J.-L., & Piolino, P. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106406 · Cited by 32
Münzer, S., & Holmer, T. (2009) · Communication Research · doi:10.1177/0093650208326464 · Cited by 32
“The secondary task adopted in this study was developed after a description provided in Brünken, Plass, and Leutner (2003).”
MethodYadegarfar, H., & Simin, S. (2016) · International Journal of Research Studies in Educational Technology · doi:10.5861/ijrset.2016.1572 · Cited by 31
“Therefore, according to Brierley and Kemble (1997), there is no need for educators to give up entirely their professions to the educational technology such as utilization of mobiles; rather, they should consider mobile phones as supplementary to the teaching profession.”
The Effect of Screen Size on Students’ Cognitive Load in Mobile Learning
Alasmari, T. M. (2020) · JETL (Journal Of Education Teaching and Learning) · doi:10.26737/jetl.v5i2.2203 · Cited by 31
Reducing the Cognitive Load of Playing a Digital Tabletop Game with a Multimodal Interface
Zimmerer, C., Krop, P., Fischbach, M., & Latoschik, M. E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502062 · Cited by 31
“It is a direct method for the objective assessment of cognitive load, similar to brain activity measurements [9].”
BackgroundMethodMeasuring cognitive load in test items: static graphics versus animated graphics
Dindar, M., Yurdakul, I. K., & Dönmez, F. İ. (2014) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12086 · Cited by 32
Technologies for intentional learning: Beyond a cognitive perspective
Spector, J. M., & Kim, C. (2014) · Australian Journal of Education · doi:10.1177/0004944113517828 · Cited by 31
Schwaighofer, M., Bühner, M., & Fischer, F. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000115 · Cited by 31
Information flow and cognition affect each other: Evidence from digital learning
Sharma, K., Mangaroska, K., van Berkel, N., Giannakos, M. N., & Kostakos, V. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102549 · Cited by 31
“At first glance, this might appear contradictory, because most of the multimodal learning literature (Brunken et al., 2003; Mayer and Moreno, 2003) views “the control of information flow” as a way to manage the cognitive load, due to the user’s active role in information processing.”
BackgroundMethodInfluentialThe Impact of Persistent Pain on Working Memory and Learning
Smith, A. K., & Ayres, P. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9247-x · Cited by 32
“Time and Efficiency Ratio Studies on working memory and cognition have demonstrated processing speed and response time variation between persistent pain and pain-free controls (see Schmitz et al. 2008; Veldhuijzen et al. 2012) and instructional formats (see Brunken et al. 2002, 2003).”
BackgroundMeasurement of Cognitive Load During Multimedia Learning Activities
Cook, A. E. (2009) · IGI Global eBooks · doi:10.4018/978-1-60566-158-2.ch003 · Cited by 31
Mendel, J., & Pak, R. (2009) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120905302206 · Cited by 30
Quantity over quality: Do single-item scales reflect what users truly experienced?
Cuvillier, M., Léger, P., & Sénécal, S. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100097 · Cited by 30
Psychometric Properties for Multidimensional Cognitive Load Scale in an E-Learning Environment
Choi, Y., & Lee, H. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19105822 · Cited by 30
Skuballa, I. T., Dammert, A., & Renkl, A. (2018) · Learning and Instruction · doi:10.1016/j.learninstruc.2018.02.001 · Cited by 31
Comparing Tactile to Auditory Guidance for Blind Individuals
Bharadwaj, A., Shaw, S. B., & Goldreich, D. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00443 · Cited by 30
“Novel procedures often induce a cognitive load, resulting in diminished task performance (Sweller, 1994; Brunken et al., 2003; Haji et al., 2015).”
BackgroundLambert, J. L., Kalyuga, S., & Capan, L. A. (2009) · E-Learning and Digital Media · doi:10.2304/elea.2009.6.2.150 · Cited by 30
“Subjective measures are frequently used in cognitive load research to assess mental effort and they have been found to reliably assess perceptions of invested effort (Brüken et al, 2003).”
BackgroundMethodApplying Cognitive Load Theory to the Design of Online Learning.
Burkes, K. M. E. (2007) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc3698 · Cited by 30
Darejeh, A., Marcus, N., & Sweller, J. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-10024-5 · Cited by 29
Training non-native aspirated plosives with hand gestures: learners’ gesture performance matters
Li, P., Xi, X., Baills, F., & Prieto, P. (2021) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2021.1937663 · Cited by 29
“Future investigations could include complementary measures in this respect (see Brünken et al., 2003; Skulmowski & Rey, 2017 formeasurement of cognitive load).”
BackgroundRuiter, M., Loyens, S., & Paas, F. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9324-4 · Cited by 29
“Commonly, the secondary task involves simple activities such as remembering a list of letters or words or activities requiring sustained attention, such as detecting a visual or auditory signal (e.g., Brünken et al. 2003; Goldin-Meadow et al. 2001).”
BackgroundExamining memory for ritualized gesture in complex causal sequences
Kapitány, R., Kavanagh, C. M., Whitehouse, H., & Nielsen, M. (2018) · Cognition · doi:10.1016/j.cognition.2018.08.005 · Cited by 29
Morett, L. M., Roche, J. M., Fraundorf, S. H., & McPartland, J. C. (2020) · Cognitive Science · doi:10.1111/cogs.12912 · Cited by 30
Cognitive load theory and its measurement: a study of secondary tasks in relation to working memory
Greenberg, K., & Zheng, R. Z. (2022) · Journal of Cognitive Psychology · doi:10.1080/20445911.2022.2026052 · Cited by 29
“Cognitive load researchers claim secondary tasks show promise to provide a precise measure of the usage of the limited attentional resources in the working memory system (Brünken et al., 2003; Park & Brünken, 2015, 2018).”
BackgroundMethodInfluentialStudy on the Differences of Icon Cognition of Graphical Interface for Age-Friendly Design
Liu, H., Wang, W., Liu, Y., Song, F., Wang, S., & Guo, H. (2022) · Journal of Gerontological Social Work · doi:10.1080/01634372.2022.2139319 · Cited by 29
“There are three methods commonly used to assess cognitive load, namely task performance measurement, subjective assessment measurement and physiological measurement (Ahlstrom & Friedman-Berg, 2006; Berka et al., 2007; Brunken et al., 2003; Fairclough et al., 2005).”
MethodJeong, S., Kim, J., & Lee, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3372126 · Cited by 29
“In the dual-task paradigm, participants are asked to perform two independent tasks simultaneously to increase the level of cognitive load [6].”
BackgroundRecency Effect on Problem Solving in Interactive Multimedia Learning
Zheng, R. Z., & Zhou, B. (2006) · Educational Technology & Society · Cited by 29
Write between the lines: Electronic outlining and the organization of text ideas
de Smet, M. J. R., Brand‐Gruwel, S., Broekkamp, H., & Kirschner, P. A. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2012.06.015 · Cited by 29
Zhou, Y., Xu, T., Cai, Y., Wu, X., & Dong, B. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58509-3_7 · Cited by 29
Developmental Level of Moral Judgment Influences Behavioral Patterns During Moral Decision-Making
Han, H., Dawson, K. J., Thoma, S. J., & Glenn, A. L. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1574701 · Cited by 29
Yelizarov, A., & Gamayunov, D. (2014) · International Symposium on Visual Information Communication and Interaction (VINCI) · doi:10.1145/2636240.2636844 · Cited by 30
“Simple tasks like reacting on auditory [5], or visual stimulus [4, 9, 13] are just a few examples of usable secondary tasks.”
BackgroundInfluentialPhotoplethysmogram-based Cognitive Load Assessment Using Multi-Feature Fusion Model
Zhang, X., Lyu, Y., Qu, T., Qiu, P., Luo, X., Zhang, J., Fan, S., & Shi, Y. (2019) · ACM Transactions on Applied Perception · doi:10.1145/3340962 · Cited by 28
“Dual-task necessitates dedicated design and control of the tasks, and its sensitivity and reliability vary due to variable participants’ attention [7].”
BackgroundGenç, H., & Gülözer, K. (2013) · The Turkish Online Journal of Educational Technology · Cited by 28
Ohle, A., McElvany, N., Horz, H., & Ullrich, M. (2015) · Journal for Educational Research Online / Journal für Bildungsforschung Online · doi:10.25656/01:11488 · Cited by 28
Efendioğlu, A. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.03.015 · Cited by 28
Brom, C., Hannemann, T., Stárková, T., Bromová, E., & Děchtěrenko, F. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.01.001 · Cited by 28
Gerjets, P. H., Scheiter, K., & Schuh, J. (2005) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652.19.12.23 · Cited by 28
Разработка и апробация лингвистической методики оценки когнитивной сложности научно-учебного текста
Samsonov, N. B., Чмыхова, Е., & Давыдов, Д. Г. (2015) · Психологические исследования · doi:10.54359/ps.v8i41.548 · Cited by 27
Frazier, S., Pitts, B. J., & McComb, S. A. (2022) · Cognition Technology & Work · doi:10.1007/s10111-022-00708-0 · Cited by 27
“, queries regarding the amount of mental effort exerted during a task) (Brünken et al. 2003).”
BackgroundWenk, N., Buetler, K. A., Penalver-Andres, J. A., Müri, R. M., & Marchal–Crespo, L. (2022) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-022-01101-8 · Cited by 27
“The measurement with a dual-task paradigm is assumed to be a more direct and objective measurement technique than questionnaires [49].”
MethodByte by bite: Use of a mobile Bite Counter and weekly behavioral challenges to promote weight loss
Turner‐McGrievy, G. M., Boutté, A. K., Crimarco, A. E., Wilcox, S., Hutto, B., Hoover, A. W., & Muth, E. R. (2017) · Smart Health · doi:10.1016/j.smhl.2017.03.004 · Cited by 28
“Cognitive Load Theory states that the more cognitive burden, or mental effort, a user feels when learning, the less able they will be to retain and act upon what they learned (Brunken et al., 2003; Paas, Tuovinen, Tabbers, & Van Gerven, 2003).”
BackgroundGoing beyond performance scores: understanding cognitive-affective states in kindergarteners
Sridhar, P. K., Chan, S., & Nanayakkara, S. C. (2018) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3202185.3202739 · Cited by 27
“The second common method of measuring cognitive load is us-ing dual or secondary tasks [53, 5] that draw from psychology where a secondary task is introduced along with the primary task of learning.”
MethodInteractive Multimedia Analysis in Thematic Learning: A Study of Practical Aspect
Putra, A. P., Nawawi, I., Badawi, A., Sutarno, S., Pratiwi, I., Kim, J., Untari, E., & Umaroh, M. (2019) · doi:10.1109/icet48172.2019.8987218 · Cited by 27
Exploring the SenseMaking Process through Interactions and fNIRS in Immersive Visualization
Galati, A., Schoppa, R., & Lu, A. (2021) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3067693 · Cited by 27
“…from the amount of information that one has to hold in working memory (intrinsic cognitive load), the format or complexity of the instructed actions (extraneous cognitive load), and the work one puts into processing and representing that information for the long-term (germane cognitive load) [8].”
BackgroundThe Cognitive Theory of Multimedia Learning
Sorden, S. D. (2013) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-61735-867-820251017 · Cited by 29
de Bruin, A. B. H., Rikers, R. M. J. P., & Schmidt, H. G. (2007) · The European Journal of Cognitive Psychology · doi:10.1080/09541440701326204 · Cited by 29
“The amount of interference that this task causes is indicative of the working memory load that is associated with the primary task (Brunken, Plass, & Leutner, 2003 , 2004 ).”
BackgroundMobile haptic e-book system to support 3D immersive reading in ubiquitous environments
Alam, K. M., Rahman, A. S. M. M., & Saddik, A. E. (2013) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2501643.2501649 · Cited by 27
Ko, L. K., Turner‐McGrievy, G. M., & Campbell, M. K. (2013) · Health Education & Behavior · doi:10.1177/1090198113504413 · Cited by 27
“CLT and ICT guided the formatting of each episode and lent support to the use of podcasting over other intervention delivery methods.”
BackgroundMethodInfluentialBiosignals Monitoring of First Responders for Cognitive Load Estimation in Real-Time Operation
Gutiérrez, Á., Blanco, P., Bejerano, V. R., Chatzigeorgiou, C., Oregui, X., Álvarez, M., Navarro, S., Feidakis, M., Azpiroz, I., Izquierdo, G., et al. (2023) · Applied Sciences · doi:10.3390/app13137368 · Cited by 26
Levity: A Virtual Reality System that Responds to Cognitive Load
Gerry, L. J., Ens, B. M., Drogemuller, A., Thomas, B. H., & Billinghurst, M. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188479 · Cited by 28
Can You Ink While You Blink? Assessing Mental Effort in a Sensor-Based Calligraphy Trainer
Limbu, B. H., Jarodzka, H., Klemke, R., & Specht, M. M. (2019) · Sensors · doi:10.3390/s19143244 · Cited by 26
“The mental effort was measured using dual-task methodology [25].”
BackgroundMethodSkowronek, J., & Raake, A. (2014) · Speech Communication · doi:10.1016/j.specom.2014.10.003 · Cited by 26
“In the context of learning, the difficulty of a learning task and its instruction material is determining Cognitive Load (see e.g. Bruenken et al., 2003).”
BackgroundInfluentialMultimodal behavioral and physiological signals as indicators of cognitive load
Zhou, J., Yu, K., Chen, F., Wang, Y., & Arshad, S. Z. (2018) · The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations - Volume 2 · doi:10.1145/3107990.3108002 · Cited by 25
Video Tutorials in the Traditional Classroom: The Effects on Different Types of Cognitive Load
Fan, E., Bower, M., & Siemon, J. (2024) · Technology Knowledge and Learning · doi:10.1007/s10758-024-09754-1 · Cited by 26
“It is now widely accepted that measures of cognitive load are categorized as subjective and objective (Brunken et al., 2003 ; Plass et al., 2010).”
Learning Analytics for Diagnosing Cognitive Load in E-Learning Using Bayesian Network Analysis
Choi, Y., & Kim, J. (2021) · Sustainability · doi:10.3390/su131810149 · Cited by 25
“Optimal learning can be achieved by managing and controlling the cognitive load in a learning system [19–21].”
BackgroundZhou, J. J., Miao, X., He, F., & Miao, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3151915 · Cited by 25
Neurophysiological correlates in interface design: An HCI perspective
Mach, Q. H., Hunter, M. D., & Grewal, R. S. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2009.11.008 · Cited by 26
Playing educational micro-games at high schools: Individually or collectively?
Brom, C., Levčík, D., Buchtová, M., & Klement, D. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.025 · Cited by 25
Dual Modality Code Explanations for Novices: Unexpected Results
Morrison, B. B. (2017) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3105726.3106191 · Cited by 25
“Two basic means of measuring cognitive load through direct measures have been used in research: using a dual task [9, 13, 60] and physiological measurements such as measurements of heart rates [41], pupillary response [59], EEGs [2], and eye tracking [58, 62].”
MethodGender Differences in Eye Movements in Solving Text-and-Diagram Science Problems
Huang, P.-S., & Chen, H. (2015) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-015-9644-3 · Cited by 26
Zooming to work or working to Zoom: relations between Zoom fatigue, cognitive load, and boredom
Park, M. J., Calistro, T., & Lipnevich, A. A. (2025) · Research Papers in Education · doi:10.1080/02671522.2025.2507592 · Cited by 24
“Cognitive load can be assessed through both subjective and objective measures (Brünken, Plass, and Leutner 2003; Paas et al. 2003).”
Introducing Augmented Reality Technology to Enhance Learning in Pharmacy Education: A Pilot Study
Schneider, J., Patfield, M., Croft, H., Salem, S., & Munro, I. (2020) · Pharmacy · doi:10.3390/pharmacy8030109 · Cited by 24
Shadiev, R., Chien, Y.-C., & Huang, Y. (2020) · SAGE Open · doi:10.1177/2158244020953177 · Cited by 24
“Three types of cognitive load, such as (a) intrinsic, (b) extraneous, and (c) ger-mane, are listed by scholars (Brunken et al., 2003).”
BackgroundRethinking Cognitive Load Theory
Kalyuga, S., & Plass, J. L. (2025) · doi:10.1093/9780190078539.001.0001 · Cited by 24
Self-citationWang, C.-C., Cheng, P. K.-H., & Wang, T. (2022) · Brain Sciences · doi:10.3390/brainsci12081036 · Cited by 23
“Studies by Sweller [1] and Brünken, Plass, and Leutner [16] are representative of task- and performance-based techniques, which are divided into primary and secondary task measurements.”
Zitouni, M. S., Oh, S. L., Vicnesh, J., Khandoker, A. H., & Acharya, U. R. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.970993 · Cited by 24
“Hjorth complexity and mobility (44, 45), 10.”
BackgroundPitterson, N. P., Brown, S., Pascoe, J., & Fisher, K. Q. (2016) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757733 · Cited by 23
Mitigating Information Overload in e-Commerce Interactions with Conversational Agents
Palma, M. D. C. O., Seeger, A.-M., & Heinzl, A. (2019) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-28144-1_24 · Cited by 23
3D Displays in Cars: Exploring the User Performance for a Stereoscopic Instrument Cluster
Broy, N., Alt, F., Schneegaß, S., & Pfleging, B. (2014) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/2667317.2667319 · Cited by 23
“Popular metrics include task completion time or detection rates [7].”
BackgroundInvestigating the Effect of Complexity Factors in Gas Law Problems
Schuttlefield, J. D., Kirk, J. S., Pienta, N. J., & Tang, H. N. (2012) · Journal of Chemical Education · doi:10.1021/ed100865y · Cited by 23
Künsting, J. (2007) · Cited by 24
Turner-McGrievy, G. M., Yang, C.-H., Monroe, C., Pellegrini, C., & West, D. S. (2021) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-021-00203-9 · Cited by 22
“Cognitive load theory states that the more cognitive burden, or mental effort, users feel when learning, the less able they will be to retain and act upon what they learned (Brunken et al., 2003; Paas et al., 2003).”
BackgroundMethodCognitive Load Estimation Based on Pupillometry in Virtual Reality with Uncontrolled Scene Lighting
Eckert, M., Habets, E. A. P., & Rummukainen, O. (2021) · International Conference on Quality of Multimedia Experience (QoMEX) · doi:10.1109/qomex51781.2021.9465417 · Cited by 22
Noroozi, S., & Karami, H. (2022) · Language Testing in Asia · doi:10.1186/s40468-022-00163-8 · Cited by 22
Sudár, A., & Csapó, Á. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31717 · Cited by 22
“Despite offering a viable approach in diverse situations, such questionnaires may nevertheless suffer from subjective bias and low data resolution [4,9,102,15].”
BackgroundScientific Investigations of Elementary School Children
Valanides, N., Papageorgiou, M., & Angeli, C. (2013) · Journal of Science Education and Technology · doi:10.1007/s10956-013-9448-6 · Cited by 22
Educational Neuroscience: Exploring Cognitive Processes that Underlie Learning
Antonenko, P. (2018) · Educational communications and technology: issues and innovations · doi:10.1007/978-3-030-02631-8_3 · Cited by 23
3D learning spaces and activities fostering users’ learning, acceptance, and creativity
Shin, D., & Park, S. (2019) · Journal of Computing in Higher Education · doi:10.1007/s12528-019-09205-2 · Cited by 22
Relationship between objective and subjective cognitive load measurements in multimedia learning
Mutlu-Bayraktar, D., Özel, P., Altindış, F., & Yılmaz, B. (2020) · Interactive Learning Environments · doi:10.1080/10494820.2020.1833042 · Cited by 22
“The causal relationship, on the other hand, includes classi fi cations on whether there is a direct relationship between the features that are measured and the measurement (Brunken et al., 2003).”
BackgroundSharek, D. J., & Wiebe, E. (2015) · International Journal of Gaming and Computer-Mediated Simulations · doi:10.4018/ijgcms.2015010102 · Cited by 22
Comparison of Visual and Vibrotactile Feedback Methods for Seated Posture Guidance
Zheng, Y., & Morrell, J. B. (2012) · IEEE Transactions on Haptics · doi:10.1109/toh.2012.3 · Cited by 22
“A common methodology of assessing task interference and mental workload is dual-task performance [36].”
MethodLin, C. (2010) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810386606 · Cited by 23
“Nevertheless, when the primary tasks became excessively difficult, the load scores obtained turned low again, implying a cognitive disengagement of the learner (Brunken et al., 2003).”
Using Cognitive Load to Evaluate Participation and Design of an Asynchronous Course
McQuaid, J. W. (2010) · American Journal of Distance Education · doi:10.1080/08923647.2010.519949 · Cited by 23
“There are currently four accepted approaches or techniques employed: physiological measures, subjective measures, secondary task measures, and primary task measures (Brunken, Plass, and Leutner 2003; Zhang and Luximon 2005).”
The effect of the segmentation of video tutorials on User’s training experience and performance
Lamontagne, C., Sénécal, S., Frédette, M., Labonté-LeMoyne, É., & Léger, P. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100071 · Cited by 21
Song, M., & Bruning, R. (2015) · Educational Psychology · doi:10.1080/01443410.2015.1072133 · Cited by 21
The effects of cognitive load on query reformulation: mental demand, temporal demand and frustration
Na, K. (2021) · Aslib Journal of Information Management · doi:10.1108/ajim-07-2020-0206 · Cited by 21
Laybidi, M. I., Rasoulzadeh, Y., Dianat, I., Samavati, M., Jafarabadi, M. A., & Nazari, M. A. (2022) · Physiology & Behavior · doi:10.1016/j.physbeh.2022.113842 · Cited by 21
Measuring Cognitive Load: A Comparison of Self-Report and Physiological Methods.
Joseph, S. S. (2013) · ProQuest LLC eBooks · Cited by 21
Dimopoulos, Κ., & Asimakopoulos, A. (2009) · Journal of Science Education and Technology · doi:10.1007/s10956-009-9197-8 · Cited by 21
“Lawless and Kulikowich 1998; Brunken et al. 2003; Macedo-Rouet et al. 2003; MaKinster et al. 2002; Potelle and Rouet 2003; Tu et al. 2008).”
BackgroundDigital Multimedia Perception and Design
(2006) · IGI Global eBooks · doi:10.4018/978-1-59140-860-4 · Cited by 21
Dönmez, O., Akbulut, Y., Telli, E., Kaptan, M., Özdemir, İ. H., & Erdem, M. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11035-2 · Cited by 20
“Scholarly attempts have yet to reach an agreement on a standardized, valid, and reliable measurement methodology of CL (Brunken et al., 2003).”
Background
Metadata
- Authors
- Brunken, R., Plass, J. L., & Leutner, D.
- Affiliations
- New York University (US)
- University of Erfurt (DE)
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2003-01-01
- Volume
- 38
- Issue
- 1
- Pages
- 53-61
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W1967395107
- Semantic Scholar
- 70a37f895bee605bed1aa6df431495797b53e86b
- Cited by
- 896
- References
- 49
- Citations by year
- 2026: 26 · 2025: 69 · 2024: 34 · 2023: 32 · 2022: 51 · 2021: 42 · 2020: 54 · 2019: 63 · 2018: 57 · 2017: 40 · 2016: 52 · 2015: 60 · 2014: 45 · 2013: 35 · 2012: 36
- FWCI
- 21.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Psychologist (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Education › Online and Blended Learning
- Keywords
- cognitive load, cognitive load theory, multimedia learning, direct measurement, dual-task paradigm, working memory, instructional design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.