The DOI matches its Crossref record; 111 of the 111 references it cites were found in a registry or an index.
Cognitive Load Theory in Computing Education Research: A Review
Abstract
One of the most commonly cited theories in computing education research is cognitive load theory (CLT), which explains how learning is affected by the bottleneck of human working memory and how teaching may work around that limitation. The theory has evolved over a number of decades, addressing shortcomings in earlier versions; other issues remain and are being debated by the CLT community. We conduct a systematic mapping review of how CLT has been used across a number of leading computing education research (CER) forums since 2010. We find that the most common reason to cite CLT is to mention it briefly as a design influence; authors predominantly cite old versions of the theory; hypotheses phrased in terms of cognitive load components are rare; and only a small selection of cognitive load measures have been applied, sparsely. Overall, the theory’s evolution and recent themes in CLT appear to have had limited impact on CER so far. We recommend that studies in CER explain which version of the theory they use and why; clearly distinguish between load components (e.g., intrinsic and extraneous load); phrase hypotheses in terms of load components a priori ; look further into validating different measures of cognitive load; accompany cognitive load measures with complementary constructs, such as motivation; and explore themes such as collaborative CLT and individual differences in working-memory capacity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 9×
“New CLT is frequently cited as being more up to date, and it bears the cachet of CLT’s primary creator, John Sweller.”
BackgroundInfluentialMayer, R. E. (2009) · doi:10.1017/cbo9780511811678 · Cited by 7,800
Mayer, R. (2020) · doi:10.1017/9781316941355 · Cited by 7,777
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“CLT has been at the heart of many debates between proponents of “explicit (or direct) instruction” and proponents of “construc-tivism” (see, e.g., [26, 42, 57, 96, 105]).”
BackgroundCognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · cited 3×
“[102], Chandler and Sweller [10], and Sweller [99] as examples of commonly cited references for Old CLT, with New CLT commonly cited via Sweller [100].”
BackgroundNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 3×
“[37], and Ayres [2], as well as the NASA-TLX [29] and PSA [52].”
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 1×
“It builds on the guidelines for systematic reviews presented by Petersen et al. [78].”
MethodEye Tracking: A comprehensive guide to methods and measures
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R. J., Jarodzka, H. M., & van de Weijer, J. (2015) · Lund University Publications (Lund University) · Cited by 2,919
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · cited 8×
“New CLT is frequently cited as being more up to date, and it bears the cachet of CLT’s primary creator, John Sweller.”
BackgroundInfluentialCognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527 · cited 5×
“They measured load using Paas’s instrument.”
MethodInfluentialCognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337 · cited 7×
“One is championed by CLT’s creators as the simplest and most current version of the theory, another builds on the concept of germane cognitive load that was introduced to CLT in 1998 but has since fallen out of favor with CLT’s creators [100, 103].”
BackgroundMethodInfluentialPaas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150 · cited 2×
“Paas’s [74] unidimensional nine-point scale for mental effort from 1992 is the time-tested instrument that continues to be used, but that simple scale cannot differentiate between load types and suffers from noisy measurements [49].”
BackgroundMethodElement Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load
Sweller, J. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9128-5 · Cited by 2,020 · cited 10×
“Moreover, numerous studies reported that learning results went up as overall cognitive load went down, which conflicted with Old CLT’s notion that a reduction in extraneous load should lead to an equal increase in germane load [100, 103].”
BackgroundResultInfluentialTraining and plasticity of working memory
Klingberg, T. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.002 · Cited by 1,585 · cited 1×
“Although people’s working-memory capacity varies somewhat and can be improved through training [46, 87], it remains the case that any person’s working memory can only hold”
BackgroundCognitive load theory, educational research, and instructional design: some food for thought
de Jong, T. (2010) · Instructional Science · doi:10.1007/s11251-009-9110-0 · Cited by 1,180 · cited 2×
“Notable scholars in and around CLT complained that Old CLT sufered from conceptual laws, failed to explain various empirical results, used a germane-load construct that was unnecessary and unjustiied by results, and led to unfalsiiable circular interpretations of indings [16, 23, 36, 86, 100].”
BackgroundResultLiaw, S.-S. (2008) · Computers & Education · doi:10.1016/j.compedu.2007.09.005 · Cited by 1,116 · cited 2×
“[37], and Ayres [2], as well as the NASA-TLX [29] and PSA [52].”
Development of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066 · cited 2×
“Of those, CER has largely relied on the Paas single-question instrument [74] and Morrison and colleagues’ [69] programming-domain adaptation of Leppink and colleagues’ [50] ten-item questionnaire.”
BackgroundMethodExpertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056 · cited 1×
“Schemas also explain the expertise reversal efect [35]: learners with prior knowledge may treat complex information as a single chunk, which reduces element interactivity and may drastically inluence which instructional methods are eicient.”
BackgroundKapur, M. (2008) · Cognition and Instruction · doi:10.1080/07370000802212669 · Cited by 867 · cited 1×
“Lately, such discussions have frequently featured the pedagogical pattern of productive failure [39, 92], in which a problem-solving activity that fails by design precedes other activities that teach a solution.”
BackgroundChanging minds: computers, learning, and literacy
(2001) · Choice Reviews Online · doi:10.5860/choice.38-2855 · Cited by 816
A Reconsideration of Cognitive Load Theory
Schnotz, W., & Kürschner, C. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9053-4 · Cited by 755 · cited 3×
“…load was observed in an intervention, researchers might state post hoc that the change must have been in extraneous load (if learning was enhanced) or germane load (if learning was hindered), but there was no way of falsifying such interpretations, rendering them nearly worthless [16, 23, 86].”
BackgroundResultUsing Electroencephalography to Measure Cognitive Load
Antonenko, P., Paas, F., Grabner, R., & van Gog, T. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9130-y · Cited by 742 · cited 1×
“They are usually based on physiological data sources, such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundMeasurement of Cognitive Load in Instructional Research
Paas, F. G. W. C., van Merriënboer, J. J. G., & Adam, J. J. (1994) · Perceptual and Motor Skills · doi:10.2466/pms.1994.79.1.419 · Cited by 731 · cited 1×
“They are usually based on physiological data sources, such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundCognitive Load Theory: How Many Types of Load Does It Really Need?
Kalyuga, S. (2011) · Educational Psychology Review · doi:10.1007/s10648-010-9150-7 · Cited by 725 · cited 5×
“Some scholars have stressed that germane load is not just any useful load but instead arises from those additional, effortful aspects of learning that go beyond task performance, such as conscious reflection and self-explanation [36, 86].”
BackgroundResultInfluentialSkulmowski, A., & Xu, K. M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09624-7 · Cited by 678 · cited 4×
“In some cases, it is justifiable to increase load (e.g., to introduce interesting but potentially distracting details for motivational purposes [94]).”
BackgroundInfluentialKlepsch, M., Schmitz, F., & Seufert, T. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01997 · Cited by 601 · cited 4×
“Nevertheless, Old CLT has notable support from some groups of researchers who deliberately opt to use the original formulation of germane load [44, 45, 89, 114].”
BackgroundInfluentialFrom Cognitive Load Theory to Collaborative Cognitive Load Theory
Kirschner, P. A., Sweller, J., Kirschner, F., & Zambrano R., J. (2018) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-018-9277-y · Cited by 590 · cited 1×
“An extension of CLT, collaborative cognitive load theory , has been proposed [41, 43] and related research is emerging (see, e.g., [33]).”
BackgroundA Cognitive Load Approach to Collaborative Learning: United Brains for Complex Tasks
Kirschner, F., Paas, F., & Kirschner, P. A. (2009) · Educational Psychology Review · doi:10.1007/s10648-008-9095-2 · Cited by 547 · cited 1×
“An extension of CLT, collaborative cognitive load theory , has been proposed [41, 43] and related research is emerging (see, e.g., [33]).”
BackgroundEffects of pairs of problems and examples on task performance and different types of cognitive load
Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P. M., & van Merriënboer, J. J. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.12.001 · Cited by 520 · cited 2×
“Doubts remain over these instruments’ construct validity, however, and especially over the questionnaire items that target germane load [34, 49, 51, 60, 115].”
BackgroundGalvanic skin response (GSR) as an index of cognitive load
Shi, Y., Ruiz, N., Taib, R., Choi, E., & Chen, F. (2007) · CHI '07 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1240866.1241057 · Cited by 423 · cited 1×
“They are usually based on physiological data sources, such as such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundChoi, H.-H., van Merriënboer, J. J. G., & Paas, F. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9262-6 · Cited by 413 · cited 1×
“conceptual knowledge [14], human movement [88], the physical environment [15], and the testing efect [27, 40, 49], among others.”
BackgroundFour Ways of Considering Emotion in Cognitive Load Theory
Plass, J. L., & Kalyuga, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09473-5 · Cited by 404 · cited 2×
“Such possibilities continue to be debated (see, e.g., [79, 85, 101]).”
BackgroundUsing subjective measures to detect variations of intrinsic cognitive load within problems
Ayres, P. (2006) · Learning and Instruction · doi:10.1016/j.learninstruc.2006.09.001 · Cited by 381 · cited 1×
“These include those by Leppink et al. [50], Kalyuga et al. [37], and Ayres [2], as well as the NASA-TLX [29] and PSA [52].”
MethodDoes Working Memory Training Transfer? A Meta-Analysis Including Training Conditions as Moderators
Schwaighofer, M., Fischer, F., & Bühner, M. (2015) · Educational Psychologist · doi:10.1080/00461520.2015.1036274 · Cited by 332 · cited 1×
“Although people’s working-memory capacity varies somewhat and can be improved through training [46, 87], it remains the case that any person’s working memory can only hold”
Background(2009) · Routledge eBooks · doi:10.4324/9780203878842 · Cited by 328
Memory load and the cognitive pupillary response in aging
Van Gerven, P. W. M., Paas, F., Van Merriënboer, J. J. G., & Schmidt, H. G. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2003.00148.x · Cited by 292 · cited 1×
“They are usually based on physiological data sources, such as such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundRethinking the Boundaries of Cognitive Load Theory in Complex Learning
Kalyuga, S., & Singh, A.-M. (2016) · Educational Psychology Review · doi:10.1007/s10648-015-9352-0 · Cited by 241 · cited 3×
“Cognitive load is the intensity of cognitive activity required for a specific learning goal during a narrow time frame [38]; it arises directly from element interactivity.”
BackgroundChen, O., Castro-Alonso, J. C., Paas, F., & Sweller, J. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9426-2 · Cited by 239 · cited 1×
“Recent work has examined CLT’s relationship with themes such as individual diferences in working-memory capacity [11, 84], emotions [30, 79, 94, 114], procedural vs.”
BackgroundStrategies for Programming Instruction in High School: Program Completion vs. Program Generation
Van Merriënboer, J. J. G. (1990) · Journal of Educational Computing Research · doi:10.2190/4nk5-17l7-twqv-1ehl · Cited by 222 · cited 1×
“In CER, CLT has inluenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
MethodUsing galvanic skin response for cognitive load measurement in arithmetic and reading tasks
Nourbakhsh, N., Wang, Y., Chen, F., & Calvo, R. A. (2012) · Proceedings of the 24th Australian Computer-Human Interaction Conference · doi:10.1145/2414536.2414602 · Cited by 219 · cited 1×
“They are usually based on physiological data sources, such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundCognitive Load as Motivational Cost
Feldon, D. F., Callan, G., Juth, S., & Jeong, S. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09464-6 · Cited by 218 · cited 1×
“Moreover, it has been suggested that cognitive load should be studied as an influence on motivation [22] and that CLT could be revised to encompass tradeoffs between risking high extraneous load and risking low learner engagement [94].”
BackgroundWhen Problem Solving Followed by Instruction Works: Evidence for Productive Failure
Sinha, T., & Kapur, M. (2021) · Review of Educational Research · doi:10.3102/00346543211019105 · Cited by 212 · cited 1×
“Lately, such discussions have frequently featured the pedagogical pattern of productive failure [39, 92], in which a problem-solving activity that fails by design precedes other activities that teach a solution.”
BackgroundKlepsch, M., & Seufert, T. (2020) · Instructional Science · doi:10.1007/s11251-020-09502-9 · Cited by 211 · cited 2×
“Nevertheless, Old CLT has notable support from some groups of researchers who deliberately opt to use the original formulation of germane load [44, 45, 89, 114].”
BackgroundAn application of adaptive games-based learning based on learning style to teach SQL
Soflano, M., Connolly, T. M., & Hainey, T. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.03.015 · Cited by 191 · cited 1×
“, [95]) to others whose study design is grounded in CLT (e.”
BackgroundThe Testing Effect Is Alive and Well with Complex Materials
Karpicke, J. D., & Aue, W. R. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9309-3 · Cited by 181 · cited 2×
“conceptual knowledge [14], human movement [88], the physical environment [15], and the testing efect [27, 40, 49], among others.”
BackgroundJanssen, J., & Kirschner, P. A. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09729-5 · Cited by 177 · cited 1×
“An extension of CLT, collaborative cognitive load theory , has been proposed [41, 43] and related research is emerging (see, e.g., [33]).”
BackgroundCan collaborative learning improve the effectiveness of worked examples in learning mathematics?
Retnowati, E., Ayres, P., & Sweller, J. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000167 · Cited by 174 · cited 1×
“In one study, for example, collaborative problem-solving was found to be superior to problem solving on one’s own, but collaboration was counterproductive when studying worked examples [83].”
BackgroundCognitive Load Theory and Human Movement: Towards an Integrated Model of Working Memory
Sepp, S., Howard, S. J., Tindall-Ford, S., Agostinho, S., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09461-9 · Cited by 174
Neuroimaging of cognitive load in instructional multimedia
Whelan, R. R. (2007) · Educational Research Review · doi:10.1016/j.edurev.2006.11.001 · Cited by 165 · cited 1×
“They are usually based on physiological data sources, such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundDifferentiating Different Types of Cognitive Load: a Comparison of Different Measures
Korbach, A., Brünken, R., & Park, B. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9404-8 · Cited by 153 · cited 1×
“Researchers have come up with an assortment of methods for approximating cognitive load empirically; for recent reviews and commentaries, see [48, 60, 103, 118].”
MethodVisual program simulation in introductory programming education
Sorva, J. (2012) · Aaltodoc (Aalto University) · Cited by 153
Self-citationGlogger-Frey, I., Fleischer, C., Grüny, L., Kappich, J., & Renkl, A. (2015) · Learning and Instruction · doi:10.1016/j.learninstruc.2015.05.001 · Cited by 151
Measuring cognitive load in introductory CS: adaptation of an instrument
Morrison, B. B., Dorn, B., & Guzdial, M. (2014) · Proceedings of the tenth annual conference on International computing education research · doi:10.1145/2632320.2632348 · Cited by 147 · cited 5×
“[69] adapted and validated a cognitive load measuring instrument for programming.”
BackgroundMethodInfluentialRoss, V., Jongen, E. M. M., Wang, W., Brijs, T., Brijs, K., Ruiter, R. A. C., & Wets, G. (2013) · Accident Analysis & Prevention · doi:10.1016/j.aap.2013.06.032 · Cited by 141 · cited 1×
“Recent work has examined CLT’s relationship with themes such as individual diferences in working-memory capacity [11, 84], emotions [30, 79, 94, 114], procedural vs.”
BackgroundCognitive load theory: more food for thought
Moreno, R. (2010) · Instructional Science · doi:10.1007/s11251-009-9122-9 · Cited by 132 · cited 2×
“” Although Old CLT did have the concept of germane load, which was sometimes linked to pedagogies promoting deeper engagement, Moreno [66] persua-sively argued that Old CLT “has not attempted to clearly specify the characteristics of mental processes that promote ‘good’ versus ‘bad’ load” and the…”
BackgroundGerjets, P., Scheiter, K., & Cierniak, G. (2009) · Educational Psychology Review · doi:10.1007/s10648-008-9096-1 · Cited by 130 · cited 2×
“Notable scholars in and around CLT complained that Old CLT sufered from conceptual laws, failed to explain various empirical results, used a germane-load construct that was unnecessary and unjustiied by results, and led to unfalsiiable circular interpretations of indings [16, 23, 36, 86, 100].”
BackgroundResultMetacognitive Difficulties Faced by Novice Programmers in Automated Assessment Tools
Prather, J., Pettit, R., McMurry, K., Peters, A., Homer, J., & Cohen, M. (2018) · Proceedings of the 2018 ACM Conference on International Computing Education Research · doi:10.1145/3230977.3230981 · Cited by 129
Theoretical underpinnings of computing education research: what is the evidence?
Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Kinnunen, P., Korhonen, A., Myller, N., Sorva, J., & Taherkhani, A. (2014) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2632320.2632358 · Cited by 124 · cited 1×
“[55] noted that CLT is among the theories most frequently cited.”
BackgroundSelf-citationSolving parsons problems versus fixing and writing code
Ericson, B. J., Margulieux, L. E., & Rick, J. (2017) · Proceedings of the 17th Koli Calling International Conference on Computing Education Research · doi:10.1145/3141880.3141895 · Cited by 121 · cited 1×
“— Ericson et al. [20] compared the effects of two forms of practice—Parsons problems and program writing—on learning outcomes, efficiency, and cognitive load.”
BackgroundMargulieux, L. E., Morrison, B. B., & Decker, A. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00222-7 · Cited by 119 · cited 1×
“In CER, CLT has influenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
BackgroundLikourezos, V., & Kalyuga, S. (2016) · Instructional Science · doi:10.1007/s11251-016-9399-4 · Cited by 109 · cited 1×
“Various scholarsÐand this includes voices from within cognitive load researchÐhave recently argued that eforts to reconcile CLT with productive failure and other complementary frameworks have been insuicient [38, 49, 53].”
BackgroundGlogger‐Frey, I., Gaus, K., & Renkl, A. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.11.002 · Cited by 106
Moons, J., & de Backer, C. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.08.009 · Cited by 102 · cited 1×
“In CER, CLT has inluenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
MethodWell-Being as a Cognitive Load Reducing Agent: A Review of the Literature
Hawthorne, B. S., Vella‐Brodrick, D., & Hattie, J. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00121 · Cited by 87 · cited 1×
“Recent work has examined CLT’s relationship with themes such as individual differences in working-memory capacity [11, 84], emotions [30, 79, 94, 114], procedural vs conceptual knowledge [14], human movement [88], the physical environment [15], and the testing effect [27, 40, 49], among others.”
BackgroundIdentifying Design Principles for CS Teacher Ebooks through Design-Based Research
Ericson, B. J., Rogers, K., Parker, M. C., Morrison, B. B., & Guzdial, M. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960335 · Cited by 84 · cited 1×
“…as a design influence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justified on the grounds of cognitive load.”
BackgroundOn Use of Theory in Computing Education Research
Nelson, G. L., & Ko, A. J. (2018) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3230977.3230992 · Cited by 83 · cited 3×
“Some of these criticisms were highlighted in CER by Nelson and Ko [71], who argued that computing education researchers have typically failed to acknowledge the theory’s limitations.”
BackgroundInfluentialCognitive Load Measurement and Application
Zheng, R. Z. (2017) · Routledge eBooks · doi:10.4324/9781315296258 · Cited by 77 · cited 1×
“Researchers have come up with an assortment of methods for approximating cognitive load empirically; for recent reviews and commentaries, see [48, 60, 103, 118].”
MethodBergman, E. M., de Bruin, A. B. H., Vorstenbosch, M. A. T. M., Kooloos, J. G. M., Puts, G. C. W. M., Leppink, J., Scherpbier, A. J. J. A., & van der Vleuten, C. P. M. (2015) · BMC Medical Education · doi:10.1186/s12909-015-0416-0 · Cited by 77
Optimal self-explanation prompt design in dynamic multi-representational learning environments
Yeh, Y.-F., Chen, M.-C., Hung, P., & Hwang, G. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.10.013 · Cited by 73 · cited 1×
“[111] prompted germane processing in working memory through multimedia learning materials.”
BackgroundOn Novices' Interaction with Compiler Error Messages: A Human Factors Approach
Prather, J., Pettit, R., McMurry, K. H., Peters, A., Homer, J., Simone, N., & Cohen, M. (2017) · Proceedings of the 2017 ACM Conference on International Computing Education Research · doi:10.1145/3105726.3106169 · Cited by 72
Writing In-Code Comments to Self-Explain in Computational Science and Engineering Education
Vieira, C., Magana, A. J., Falk, M. L., & García, R. E. (2017) · ACM Transactions on Computing Education · doi:10.1145/3058751 · Cited by 69 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundMeasuring cognitive load during procedural skills training with colonoscopy as an exemplar
Sewell, J. L., Boscardin, C. K., Young, J. Q., ten Cate, O., & O'Sullivan, P. S. (2016) · Medical Education · doi:10.1111/medu.12965 · Cited by 64 · cited 3×
“Nevertheless, Old CLT has notable support from some groups of researchers who deliberately opt to use the original formulation of germane load [44, 45, 89, 114].”
BackgroundConfirmatory Factor Analysis of Cognitive Load Ratings Supports a Two-Factor Model
Jiang, D., & Kalyuga, S. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.3.p216 · Cited by 64 · cited 1×
“Doubts remain over these instruments’ construct validity, however, and especially over the questionnaire items that target germane load [34, 49, 51, 60, 115].”
BackgroundDistractors in Parsons Problems Decrease Learning Efficiency for Young Novice Programmers
Harms, K. J., Chen, J., & Kelleher, C. L. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960314 · Cited by 60 · cited 1×
“In CER, CLT has inluenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
MethodChen, O., & Kalyuga, S. (2019) · European Journal of Psychology of Education · doi:10.1007/s10212-019-00445-5 · Cited by 60
Novice Programmers and the Problem Description Effect
Bouvier, D. J., Lovellette, E., Matta, J., Alshaigy, B., Becker, B. A., Craig, M., Jacková, J., McCartney, R., Sanders, K., & Zarb, M. (2016) · doi:10.1145/3024906.3024912 · Cited by 55
Should self-regulated learning be integrated with cognitive load theory? A commentary
Sweller, J., & Paas, F. (2017) · Learning and Instruction · doi:10.1016/j.learninstruc.2017.05.005 · Cited by 54 · cited 1×
“Such possibilities continue to be debated (see, e.g., [79, 85, 101]).”
BackgroundCognitive Load Theory, Element Interactivity, and the Testing and Reverse Testing Effects
Hanham, J., Leahy, W., & Sweller, J. (2017) · Applied Cognitive Psychology · doi:10.1002/acp.3324 · Cited by 48 · cited 2×
“” In many studies of cognitive load, researchers have estimated the load imposed by learning materials, classifying the materials as high or low in element interactivity (see, e.g., [12, 13, 27, 54, 72]).”
BackgroundNachtigall, V., Serova, K., & Rummel, N. (2020) · Instructional Science · doi:10.1007/s11251-020-09525-2 · Cited by 46
Pupillary response to complex interdependent tasks: A cognitive-load theory perspective
Mitra, R., McNeal, K. S., & Bondell, H. D. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0833-y · Cited by 45 · cited 1×
“They are usually based on physiological data sources, such as eye-tracking [32], pupillometry [64, 106], heart rate [76], or neuronal [1, 109] or electrodermal [73, 90] activity.”
BackgroundTowards an Analysis of Program Complexity From a Cognitive Perspective
Duran, R., Sorva, J., & Leite, S. (2018) · Proceedings of the 2018 ACM Conference on International Computing Education Research · doi:10.1145/3230977.3230986 · Cited by 44 · cited 1×
“Another is the work of Duran et al. [18], who proposed (but did not empirically evaluate) an approach for analyzing the complexity of computer programs in terms of the hierarchical schemas required to understand the programs.”
BackgroundSelf-citationEvaluating the Effectiveness of Parsons Problems for Block-based Programming
Zhi, R., Chi, M., Barnes, T., & Price, T. W. (2019) · Proceedings of the 2019 ACM Conference on International Computing Education Research · doi:10.1145/3291279.3339419 · Cited by 42 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundChen, O., Retnowati, E., & Kalyuga, S. (2019) · British Journal of Educational Psychology · doi:10.1111/bjep.12317 · Cited by 41
Mavilidi, M. F., & Zhong, L. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09463-7 · Cited by 39
Smartphones, Studio-Based Learning, and Scaffolding: Helping Novices Learn to Program
Reardon, S., & Tangney, B. (2014) · ACM Transactions on Computing Education · doi:10.1145/2677089 · Cited by 37 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundBlueJ Visual Debugger for Learning the Execution of Object-Oriented Programs?
Bennedsen, J., & Schulte, C. (2010) · ACM Transactions on Computing Education · doi:10.1145/1789934.1789938 · Cited by 32
Design and analysis of microworlds and puzzles for block-based programming
Pelánek, R., & Effenberger, T. (2020) · Computer Science Education · doi:10.1080/08993408.2020.1832813 · Cited by 32 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundLu, J., Kalyuga, S., & Sweller, J. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3668 · Cited by 31
Evidence for validity for the Cognitive Load Inventory for Handoffs
Young, J. Q., John, M., Thakker, K., Friedman, K. A., Sugarman, R., Sewell, J. L., & O’Sullivan, P. (2020) · Medical Education · doi:10.1111/medu.14292 · Cited by 28 · cited 1×
“, [44, 45, 50, 50, 51, 89, 112, 113]); this work on instrument development extends to CER as well [69, 115].”
BackgroundExploring Novice Programmers' Hint Requests in an Intelligent Block-Based Coding Environment
Wiggins, J. B., Fahid, F. M., Emerson, A., Hinckle, M., Smith, A., Boyer, K. E., Mott, B., Wiebe, E., & Lester, J. C. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432538 · Cited by 28 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundResearch-based design of the first weeks of CS1
Sorva, J., & Seppälä, O. (2014) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2674683.2674690 · Cited by 26 · cited 1×
“In CER, CLT has influenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
BackgroundSelf-citationSubjective Measures of Cognitive Load
Ayres, P. (2017) · Routledge eBooks · doi:10.4324/9781315296258-2 · Cited by 26 · cited 2×
“However, there are arguably no truly well established and conidence-inspiring ways to measure load, and the problem is even worse if one wishes to measure individual load componentsÐa goal that has been referred to as CLT’s łholy grailž [3] and łmission impossiblež [44].”
BackgroundDual Modality Code Explanations for Novices: Unexpected Results
Morrison, B. B. (2017) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3105726.3106191 · Cited by 25 · cited 1×
“In CER, CLT has inluenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
MethodUsing Learners' Self-Explanations of Subgoals to Guide Initial Problem Solving in App Inventor
Margulieux, L. E., & Catrambone, R. (2017) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3105726.3106168 · Cited by 25 · cited 1×
“—Margulieux and Catrambone [56] measured cognitive load as part of a study on subgoal labels in programming education.”
BackgroundTasir, Z., & Ong, C. P. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.01.009 · Cited by 24 · cited 2×
“We list a few examples here to illustrate: — Shin [91] and Tasir and Pin [104] sought to reduce extraneous load in learning materials by addressing cognitive load effects.”
BackgroundExploring the relationship between emotion and cognitive load types during patient handovers
Young, J. Q., Thakker, K., John, M., Friedman, K. A., Sugarman, R., van Merriënboer, J. J. G., Sewell, J. L., & O’Sullivan, P. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-021-10053-y · Cited by 23 · cited 2×
“Nevertheless, Old CLT has notable support from some groups of researchers who deliberately opt to use the original formulation of germane load [44, 45, 89, 114].”
BackgroundReducing intrinsic cognitive load in percentage change problems: The equation approach
Ngu, B. H., Phan, H. P., Hong, K. S., & Usop, H. H. (2016) · Learning and Individual Differences · doi:10.1016/j.lindif.2016.08.029 · Cited by 21
Revisiting cognitive load theory: second thoughts and unaddressed questions
Leppink, J. (2020) · Scientia Medica · doi:10.15448/1980-6108.2020.1.36918 · Cited by 21 · cited 7×
“Various scholars—and this includes voices from within cognitive load research—have recently argued that efforts to reconcile CLT with productive failure and other complementary frameworks have been insufficient [38, 49, 53].”
BackgroundInfluentialMeasuring the Cognitive Load of Learning to Program: A Replication Study
Zavgorodniaia, A., Duran, R., Hellas, A., Seppälä, O., & Sorva, J. (2020) · doi:10.1145/3416465.3416468 · Cited by 17 · cited 3×
“Some passages of text in Section 2 have been replicated from an earlier conference publication [115].”
BackgroundSelf-citationWhen Practice Doesn’t Make Perfect: Effects of Task Goals on Learning Computing Concepts
Miller, C. S., & Settle, A. (2011) · ACM Transactions on Computing Education · doi:10.1145/2048931.2048933 · Cited by 13 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundEmbracing complexity in research on learning from examples and from problem solving
Scheiter, K. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3702 · Cited by 13
Chen, O., Woolcott, G., & Kalyuga, S. (2021) · The Educational and Developmental Psychologist · doi:10.1080/20590776.2021.1915098 · Cited by 13
Should Explanations of Program Code Use Audio, Text, or Both? A Replication Study
Zavgorodniaia, A., Hellas, A., Seppälä, O., & Sorva, J. (2020) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3428029.3428050 · Cited by 10 · cited 2×
“In CER, CLT has inluenced example-based learning [58, 93], course design [8, 97, 107], the design of learning materials and visualizations [6, 65, 68, 116], practice tasks such as Parsons problems [20, 28], and complexity analysis of program code [18], among other things.”
BackgroundMethodSelf-citationWorked Examples, Cognitive Load, and Exam Assessments in a Senior Database Course
Knorr, E. M. (2020) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3328778.3366915 · Cited by 9 · cited 1×
“At least in principle, many more CER studies might have benefited measuring cognitive load than actually did measure it; the lack of measurement is explicitly recognized as a limitation by some authors (e.g., [7, 47]).”
BackgroundStudent Attitudes Toward Syntax Exercises in CS1
Sullivan, S., Swanson, H., & Edwards, J. (2021) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3408877.3432399 · Cited by 9 · cited 1×
“Many articles in CER cite CLT as a design inluence for a pedagogical decision or a learner-facing technology: for instance, block-based programming [77, 82], Parsons problems [119], worked examples [62, 108, 110], audio explanations of code [21], and syntax exercises [98] have been justiied on grounds of cognitive loa…”
BackgroundFlipping the Assessment of Cognitive Load: Why and How
Mason, R., Simon, Cooper, G. A., & Wilks, B. (2016) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/2960310.2960321 · Cited by 7 · cited 2×
“[59] observed in CER: łthere are circumstances in which a decision on learning materials must be made before those materials are developed and deployed, .”
BackgroundLearning to Get Literal: Investigating Reference-Point Difficulties in Novice Programming
Miller, C. S., & Settle, A. (2019) · ACM Transactions on Computing Education · doi:10.1145/3313291 · Cited by 7
Shin, S. (2016) · ACM Transactions on Computing Education · doi:10.1145/2914797 · Cited by 7
Algorithm Visualization and the Elusive Modality Effect
Zavgorodniaia, A., Tilanterä, A., Korhonen, A., Seppälä, O., Hellas, A., & Sorva, J. (2021) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3446871.3469747 · Cited by 7 · cited 1×
“Moreover, complications in transferring cognitive load efects to the computing domain have been documented [67, 116, 117], and cross-contextual transfer is a perennial challenge in general.”
BackgroundSelf-citationMorrison, B. B. (2016) · SMARTech Repository (Georgia Institute of Technology) · Cited by 3
Exploring the Instructional Efficiency of Representation and Engagement in Online Learning Materials
Heinonen, A., & Hellas, A. (2020) · doi:10.1145/3416465.3416470 · Cited by 3
Research works printed but not linked: 8
- 10.1145/1145/3448018.3458617 · doi:10.1145/1145/3448018.3458617
- Michael E. Caspersen. 2007. Educating Novices in the Skills of Programming. Ph.D. Dissertation. Department of Computer Science, University of Aarhus.
- 10.1145/3389/feduc.2018.00059 · doi:10.1145/3389/feduc.2018.00059
- 10.1145/1145/2714488 · doi:10.1145/1145/2714488
- 10.1002/(SICI)1099-0720(199908) · doi:10.1002/(sici)1099-0720(199908
- 10.1145/1145/3446871.3469750 · doi:10.1145/1145/3446871.3469750
- Ben Skudder and Andrew Luxton-Reilly. 2014. Worked examples in computer science. In Proceedings of the 16th Australasian Conference on Computing Education (ACE’14)(CRPIT, Vol. 148), Jacqueline Whalley and Daryl D’Souza (Eds.). Australian Computer Society, 59–64.
- 10.1207/s15516709cog1202_4 · doi:10.1207/s15516709cog1202_4 · Paper page
Cited by
Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models
Sarsa, S., Denny, P., Hellas, A., & Leinonen, J. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3501385.3543957 · Cited by 497
Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming
Kazemitabaar, M., Chow, J., Ma, C. K. T., Ericson, B. J., Weintrop, D., & Grossman, T. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580919 · Cited by 366
“The learning environment included 45 two-part programming tasks that were designed to avoid overwhelming learners through too much cognitive load [23] by gradually increasing complexity and introducing new concepts as they made progress.”
A Survey on Measuring Cognitive Workload in Human-Computer Interaction
Kosch, T., Karolus, J., Zagermann, J., Reiterer, H., Schmidt, A., & Woźniak, P. W. (2023) · ACM Computing Surveys · doi:10.1145/3582272 · Cited by 304
“For example, interfaces that require users to search for items or memorize lengthy menu structures can increase cognitive workload by straining their memory [24].”
InfluentialPrather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3617367 · Cited by 256
“Prior work has demonstrated that student learning is impacted by both cognitive [37], and meta-cognitive processes (such as explicitly monitoring their own progress and reflecting on the effectiveness of their problem solving strategies) [65].”
BackgroundXu, N., Li, Y., Wei, X., Xie, L., Yu, L., & Liang, H.-N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2171350 · Cited by 75
“On the other hand, users ’ germane load arises when they are engaged with the learning activities (Duran et al., 2022), which contributes to the learning effectiveness.”
Background
Metadata
- Authors
- Duran, R., Zavgorodniaia, A., & Sorva, J.
- Affiliations
- Federal Institute of Mato Grosso do Sul, Brazil
- Aalto University (FI)
- Venue
- ACM Transactions on Computing Education
- Published
- 2022-12-31
- Volume
- 22
- Issue
- 4
- Pages
- 1-27
- ISSN
- 1946-6226 (ISSN-L)
- OpenAlex
- W4225149680
- Cited by
- 92
- References
- 110
- Citations by year
- 2026: 35 · 2025: 32 · 2024: 12 · 2023: 10 · 2022: 3
- FWCI
- 13.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Computing Education (publishedVersion)
- Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (201365/2015-4)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- cognitive load theory, computing education research, working memory, intrinsic cognitive load, extraneous load, learning design, hypothesis generation, cooperative learning, working memory capacity, motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.