When less is more in cognitive diagnosis: A rapid online method for diagnosing learner task-specific expertise.
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Rapid cognitive diagnosis allows measuring current levels of learner domain-specific knowledge in online learning environments. Such measures are required for individualizing instructional support in real time, as students progress through a learning session. This article describes 2 experiments designed to validate a rapid online diagnostic method that was inspired by experimental procedures applied in classical cognitive studies of chess expertise. With the described rapid verification method, learners are required to rapidly verify suggested steps at various stages of a problem solution procedure. In this study involving 33 university students, a high degree of correlation was found between rapid testing scores and results of in-depth cognitive diagnosis based on observations of problem-solving steps using video recordings and concurrent verbal reports in the domains of kinematics (vector addition motion problems) and mathematics (transforming graphs of linear and quadratic functions). The article discusses possible applications of the suggested method in adaptive learning environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479 · cited 1×
“Some experimental procedures used in classical cognitive studies of chess expertise by De Groot (1965) and Chase and Simon (1973) suggested another idea.”
Ericsson, K. A., & Kintsch, W. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.211 · Cited by 3,498
Short-term retention of individual verbal items.
Peterson, L., & Peterson, M. J. (1959) · Journal of Experimental Psychology · doi:10.1037/h0049234 · Cited by 2,939
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Expert performance: its structure and acquisition.
Ericsson, K. A., & Charness, N. (1994) · American Psychologist · doi:10.1037/0003-066x.49.8.725 · Cited by 2,072
Chapter 3: Rethinking Transfer: A Simple Proposal With Multiple Implications
BRANSFORD, J. D., & SCHWARTZ, D. L. (1999) · Review of Research in Education · doi:10.3102/0091732x024001061 · Cited by 881
Rapid dynamic assessment of expertise to improve the efficiency of adaptive e-learning
Kalyuga, S., & Sweller, J. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504800 · Cited by 265
Self-citationDevelopment of expertise in mathematical problem solving.
Sweller, J., Mawer, R. F., & Ward, M. R. (1983) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.112.4.639 · Cited by 258
Measuring Knowledge to Optimize Cognitive Load Factors During Instruction.
Kalyuga, S., & Sweller, J. (2004) · Journal of Educational Psychology · doi:10.1037/0022-0663.96.3.558 · Cited by 219
Self-citation
Cited by
Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction
Kalyuga, S. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9054-3 · Cited by 1,056
Self-citationKnowledge elaboration: A cognitive load perspective
Kalyuga, S. (2009) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.02.003 · Cited by 213
“Results indicated significant correlations between both types of performance measure (Kalyuga, 2008).”
BackgroundSelf-citationThe worked example effect, the generation effect, and element interactivity.
Chen, O., Kalyuga, S., & Sweller, J. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000018 · Cited by 167
Self-citationThe expertise reversal effect: cognitive load and motivational explanations
Rey, G. D., & Buchwald, F. (2011) · Journal of Experimental Psychology: Applied · doi:10.1037/a0022243 · Cited by 105
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · Cognitive Load Theory · doi:10.1007/978-1-4419-8126-4_12 · Cited by 68
Self-citation
Metadata
- Authors
- Kalyuga, S.
- Venue
- Journal of Educational Psychology
- Published
- 2008-08
- Volume
- 100
- Issue
- 3
- Pages
- 603-612
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2038966547
- Cited by
- 52
- References
- 10
- FWCI
- 6.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When less is more in cognitive diagnosis: A rapid online method for diagnosing learner task-specific expertise. https://app.cochat.ai/papers/10.1037/0022-0663.100.3.603
- The paper
- Kalyuga, S. (2008). When less is more in cognitive diagnosis: A rapid online method for diagnosing learner task-specific expertise. Journal of Educational Psychology. https://doi.org/10.1037/0022-0663.100.3.603
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.