The DOI matches its Crossref record; 66 of the 68 references it cites were found in a registry or an index.
Measuring Knowledge to Optimize Cognitive Load Factors During Instruction.
Open accessAbstract
The expertise reversal effect occurs when a learning procedure that is effective for novices becomes ineffective for more knowledgeable learners. The authors consider how to match instructional presen-tations to levels of learner knowledge. Experiments 1–2 were designed to develop a schema-based rapid method of measuring learners ’ knowledge in a specific area. Experimental data using algebra and geometry materials for students in Grades 9–10 indicated a highly significant correlation (up to.92) between performance on the rapid measure and traditional measures of knowledge, with test times reduced by factors of 4.9 and 2.5, respectively. Experiments 3–4 used this method to monitor learners’ cognitive performance to determine which instructional design should be used for given levels of expertise. The expertise reversal effect (see Kalyuga, Ayres, Chandler, & Sweller, 2003) occurs when an instructional procedure that is relatively effective for novices becomes ineffective for more knowledgeable learners. A consequence of the effect is that an instructor must be able to accurately estimate the knowledge levels of learners to determine an appropriate instructional design for
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A limitation to this method, however, is that it is only tested with relatively well-structured problems, and not with ill-structured problems in complex domains that can be solved in various ways.”
From Interactivity in Video-based Models (2007) · cites this paper as Kalyuga and Sweller (2004)
In the citing paper
“The method has promising results, because the time involved in assessing expertise levels was drastically reduced compared with more traditional assessment methods.”
From Interactivity in Video-based Models (2007) · cites this paper as Kalyuga and Sweller (2004)
In the citing paper
“A method proposed by Kalyuga and Sweller (2004) requires learners to use schemas in order to recognize a problem state and retrieve the appropriate next solution step,”
From Interactivity in Video-based Models (2007) · cites this paper as Kalyuga and Sweller (2004)
Citations
Cites
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,559
Review of research in education
Shulman, L. S., Mowry, S., & Berliner, D. C. (1973) · F.E. Peacock eBooks · Cited by 7,754
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Self-citationThe Psychology of Learning and Motivation
(2021) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(21)x0002-3 · Cited by 5,082
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479
Ericsson, K. A., & Kintsch, W. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.211 · Cited by 3,498
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Self-citationCognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894
Self-citationEducational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,858
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Douglas, O. B., & Holland, B. F. (2015) · MacMillan Co eBooks · doi:10.1037/14910-020 · Cited by 2,283
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Self-citationde Groot, A. D. (1978) · De Gruyter eBooks · doi:10.1515/9783110800647 · Cited by 1,888
Advances in the Psychology of Human Intelligence
Sternberg, R. J. (2014) · Psychology Press eBooks · doi:10.4324/9781315808246 · Cited by 1,771
Advances in the psychology of human intelligence
Eysenck, H. J. (1983) · Behaviour Research and Therapy · doi:10.1016/0005-7967(83)90111-0 · Cited by 1,590
Michelene, T. H., Glaser, R. A., & Rees, E. T. (1981) · Defense Technical Information Center (DTIC) · Cited by 1,529
Aptitudes and Instructional Methods: A Handbook for Research on Interactions
McLeod, D. B., Cronbach, L. J., & Snow, R. E. (1978) · Journal for Research in Mathematics Education · doi:10.2307/748778 · Cited by 1,473
Why Some Material Is Difficult to Learn
Sweller, J., & Chandler, P. (1994) · Cognition and Instruction · doi:10.1207/s1532690xci1203_1 · Cited by 1,455
Self-citationMcNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996) · Cognition and Instruction · doi:10.1207/s1532690xci1401_1 · Cited by 1,341
Brook, C. V., & Groot, A. D. D. (1966) · The American Journal of Psychology · doi:10.2307/1421155 · Cited by 1,295
Handbook of Human Intelligence
Cronbach, L. J., & Sternberg, R. J. (1984) · The American Journal of Psychology · doi:10.2307/1422532 · Cited by 1,277
Learning from Examples: Instructional Principles from the Worked Examples Research
Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. W. (2000) · Review of Educational Research · doi:10.3102/00346543070002181 · Cited by 1,109
Mayer, R. E., Heiser, J., & Lonn, S. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.1.187 · Cited by 1,029
Direct Measurement of Cognitive Load in Multimedia Learning
Brunken, R., Plass, J. L., & Leutner, D. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_7 · Cited by 896
Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_2 · Cited by 857
Marshall, S. P. (1995) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527890 · Cited by 660
(1981) · Defense Technical Information Center (DTIC) · Cited by 622
When problem solving is superior to studying worked examples.
Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001) · Journal of Educational Psychology · doi:10.1037/0022-0663.93.3.579 · Cited by 548
Self-citationRenkl, A., & Atkinson, R. K. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_3 · Cited by 540 · cited 1×
“The training session was based on a completion strategy (Van Merrienboer, 1990; Van Merrienboer, Kirschner, & Kester, 2003) realized as a series of faded worked examples (Atkinson, Derry, Renkl, & Wortham, 2000; Renkl & Atkinson, 2003; Renkl, Atkinson, Maier, & Staley, 2002).”
MethodWhen less is more: Meaningful learning from visual and verbal summaries of science textbook lessons.
Mayer, R., Bove, W., Bryman, A., Mars, R., & Tapangco, L. (1996) · Journal of Educational Psychology · doi:10.1037/0022-0663.88.1.64 · Cited by 534
Models of Competence in Solving Physics Problems*
Larkin, J. H., McDermott, J. P., Simon, D. P., & Simon, H. A. (1980) · Cognitive Science · doi:10.1207/s15516709cog0404_1 · Cited by 531
Incorporating learner experience into the design of multimedia instruction.
Kalyuga, S., Chandler, P., & Sweller, J. (2000) · Journal of Educational Psychology · doi:10.1037/0022-0663.92.1.126 · Cited by 525
Self-citationLevels of Expertise and Instructional Design
Kalyuga, S., Chandler, P., & Sweller, J. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480587 · Cited by 520
Self-citationEvolution of human cognitive architecture
Sweller, J. (2003) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(03)01015-6 · Cited by 511
Self-citationCognitively Diagnostic Assessment
Nichols, P. D., Chipman, S. F., & Brennan, R. L. (2012) · Routledge eBooks · doi:10.4324/9780203052969 · Cited by 491
Diagnostic Monitoring of Skill and Knowledge Acquisition
(2013) · Routledge eBooks · doi:10.4324/9780203056899 · Cited by 468
Craig, S. D., Gholson, B., & Driscoll, D. M. (2002) · Journal of Educational Psychology · doi:10.1037/0022-0663.94.2.428 · Cited by 455
Objective measurement : theory into practice
Wilson, M. R., Engelhard, G., & Draney, K. (1992) · Ablex Pub. Corp. eBooks · Cited by 453
A comparison of cognitive load associated with discovery learning and worked examples.
Tuovinen, J. E., & Sweller, J. (1999) · Journal of Educational Psychology · doi:10.1037/0022-0663.91.2.334 · Cited by 381
Self-citationAbstract Planning and Perceptual Chunks: Elements of Expertise in Geometry
Koedinger, K. R., & Anderson, J. R. (1990) · Cognitive Science · doi:10.1207/s15516709cog1404_2 · Cited by 375
Implications of cognitive psychology for educational measurement.
Snow, R. E., & Lohman, D. F. (1989) · Cited by 312
From Example Study to Problem Solving: Smooth Transitions Help Learning
Renkl, A., Atkinson, R. K., Maier, U. H., & Staley, R. (2002) · The Journal of Experimental Education · doi:10.1080/00220970209599510 · Cited by 312
Item Generation for Test Development
(2013) · Routledge eBooks · doi:10.4324/9781410602145 · Cited by 298
A Multidimensional Latent Trait Model for Measuring Learning and Change
Embretson, S. E. (1991) · Psychometrika · doi:10.1007/bf02294487 · Cited by 295
Test theory for a new generation of tests
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5724 · Cited by 279
Aptitude-treatment interaction as a framework for research on individual differences in learning.
Snow, R. E. (1989) · Cited by 267
Development of expertise in mathematical problem solving.
Sweller, J., Mawer, R. F., & Ward, M. R. (1983) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.112.4.639 · Cited by 258
Self-citationLearning and individual differences: Advances in theory and research.
Ackerman, P. L., Glaser, R. A., & Sternberg, R. J. (1989) · Medical Entomology and Zoology · Cited by 243
Strategies for Programming Instruction in High School: Program Completion vs. Program Generation
van Merriënboer, J. J. G. (1990) · Journal of Educational Computing Research · doi:10.2190/4nk5-17l7-twqv-1ehl · Cited by 222
Toward an Integration of IteD1-Response Theory and Cognitive Error Diagnosis
(2013) · Routledge eBooks · doi:10.4324/9780203056899-22 · Cited by 215
Mislevy, R. J. (1996) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1996.tb00498.x · Cited by 208
EVIDENCE AND INFERENCE IN EDUCATIONAL ASSESSMENT1,2
Mislevy, R. J. (1995) · ETS Research Report Series · doi:10.1002/j.2333-8504.1995.tb01643.x · Cited by 195
Test Theory for a New Generation of Tests.
Gudgeon, A. C., Fredericksen, N., Mislevy, R. J., & Bejar, I. I. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348147 · Cited by 193
Learner Experience and Efficiency of Instructional Guidance
Kalyuga, S., Chandler, P., & Sweller, J. (2001) · Educational Psychology · doi:10.1080/01443410124681 · Cited by 192
Self-citationEvidence and Inference in Educational Assessment
Mislevy, R. J. (1994) · Psychometrika · doi:10.1007/bf02294388 · Cited by 164
A comparison of texts and their summaries: Memorial consequences
Reder, L. M., & Anderson, J. R. (1980) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(80)90122-x · Cited by 162
Simple information Processing and Intelligence
Deary, I. J. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807947.014 · Cited by 159
Pellegrino, J. W., Baxter, G. P., & Glaser, R. A. (1999) · Review of Research in Education · doi:10.3102/0091732x024001307 · Cited by 126
Effects of spacing and embellishment on memory for the main points of a text
Reder, L. M., & Anderson, J. R. (1982) · Memory & Cognition · doi:10.3758/bf03209210 · Cited by 119
Cognitive load effects in a primary-school geometry task
Bobis, J., Sweller, J., & Cooper, M. G. (1993) · Learning and Instruction · doi:10.1016/s0959-4752(09)80002-9 · Cited by 115
Self-citationHow people learn to skip steps.
Blessing, S. B., & Anderson, J. R. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.22.3.576 · Cited by 103
Complex Information Processing and Intelligence
Lohman, D. F. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807947.015 · Cited by 86
Predicting Mathemathanic Effects in the Teaching of Higher-Order Thinking Skills
Lohman, D. F. (1986) · Educational Psychologist · doi:10.1207/s15326985ep2103_3 · Cited by 52
Edith Wharton's Social Register (review)
Singley, C. J. (2002) · Legacy A Journal of American Women Writers · doi:10.1353/leg.2003.0034 · Cited by 1
- Self-citation
Flagged first, then by citations
2 of the 68 references couldn’t be matched to a known paper.
Research works printed but not linked: 8
- Adams, 1996, Formulating the Rasch model as a mixed coefficients multinomial logit., Vol. 3, 143
- 10.2307/1170661 · DOI
- Baddeley, 1986, Working memory.
- Embertson, 1993, Psychometric models for learning and cognitive processes., 125
- 10.1016/0364-0213(90)90008-K · DOI
- 10.1016/S0364-0213(80)80008-5 · DOI
- Martin, 1995, A Bayesian approach to cognitive assessment., 141
- Sweller, 1999, Instructional design.
Cited by
Sorted by citations
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Self-citationKalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Self-citationExpertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056
“In the first study ( Kalyuga and Sweller 2004 ), the allocation of learners to appropriate stages of instructional guidance was based on levels of expertise as measured by the rapid online first-step test.”
BackgroundMethodInfluentialSelf-citationCognitive load theory and educational technology
Sweller, J. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09701-3 · Cited by 911
Self-citationKoedinger, K. R., Corbett, A. T., & Perfetti, C. (2012) · Cognitive Science · doi:10.1111/j.1551-6709.2012.01245.x · Cited by 772
Metadata
- Authors
- Kalyuga, S., & Sweller, J.
- Affiliations
- UNSW Sydney (AU)
- Venue
- Journal of Educational Psychology
- Published
- 2004-09
- Volume
- 96
- Issue
- 3
- Pages
- 558-568
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2078428840
- Cited by
- 219
- References
- 68
- Citations by year
- 2026: 5 · 2025: 15 · 2024: 5 · 2023: 6 · 2022: 7 · 2021: 9 · 2020: 6 · 2019: 4 · 2018: 9 · 2017: 12 · 2016: 7 · 2015: 7 · 2014: 17 · 2013: 12 · 2012: 18
- FWCI
- 12.81
- Type
- journal article
- Language
- en
- Open access
- green
- handle.unsw.edu.au
- Licence
- cc-by-nc-nd
- Locations
- Journal of Educational Psychology (publishedVersion)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- expertise reversal effect, cognitive load, instructional design, algebra instruction, geometry teaching, high school students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review