A stochastic detection and retrieval model for the study of metacognition
The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
We present a signal detection-like model termed the stochastic detection and retrieval model (SDRM) for use in studying metacognition. Focusing on paradigms that relate retrieval (e.g., recall or recognition) and confidence judgments, the SDRM measures (1) variance in the retrieval process, (2) variance in the confidence process, (3) the extent to which different sources of information underlie each response, (4) simple bias (i.e., increasing or decreasing confidence criteria across conditions), and (5) metacognitive bias (i.e., contraction or expansion of the confidence criteria across conditions). In the metacognition literature, gamma correlations have been used to measure the accuracy of confidence judgments. However, gamma cannot distinguish between the first 3 attributes, and it cannot measure either form of bias. In contrast, the SDRM can distinguish among the attributes, and it can measure both forms of bias. In this way, the SDRM can be used to test competing process theories by determining the attribute that best accounts for a change across conditions. To demonstrate the SDRM's usefulness, we investigated judgments of learning (JOLs) followed by cued-recall. Through a series of nested and non-nested model comparisons applied to a new experiment, the SDRM determined that a reduction in variance during the confidence process is the most likely explanation of the delayed-JOL effect, and a stronger relation between information underlying JOLs and recall is the most likely explanation of the testing-JOL effect. Following a brief discussion of implications for JOL theories, we conclude with a broader discussion of how the SDRM can benefit metacognition research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A similar bias-free approach to modeling metacognitive accuracy is the “Stochastic Detection and Retrieval Model” (SDRM) introduced by Jang et al. (2012). The SDRM not only measures metacognitive accuracy, but is also able to model different potential causes of metacognitive inaccuracy.”
From How to measure metacognition (2014) · cites this paper as Jang et al. (2012)
In the citing paper
“many of these “classic” findings in the metacognition rely on measures such as G (Rhodes and Tauber, 2011) that may be confounded by bias and performance effects (although see Jang et al., 2012).”
From How to measure metacognition (2014) · cites this paper as Jang et al., 2012
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(1966) · Medical Entomology and Zoology · Cited by 10,293
Detection Theory: A User's Guide
Macmillan, N. A., & Creelman, C. D. (1991) · Cited by 5,415
Metacognition: Knowing about Knowing
(1994) · The MIT Press eBooks · doi:10.7551/mitpress/4561.001.0001 · Cited by 1,720
Monitoring and control processes in the strategic regulation of memory accuracy.
Koriat, A., & Goldsmith, M. (1996) · Psychological Review · doi:10.1037//0033-295x.103.3.490 · Cited by 1,065
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976
Why Investigate Metacognition?
Nelson, T. O., & Narens, L. (1994) · Metacognition · doi:10.7551/mitpress/4561.003.0003 · Cited by 750
Indices of discrimination or diagnostic accuracy: Their ROCs and implied models.
Swets, J. A. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.1.100 · Cited by 582
The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index.
Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.127.1.55 · Cited by 529
Swets, J. A. (1986) · Psychological Bulletin · doi:10.1037//0033-2909.99.2.181 · Cited by 508
Cited by
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings
Fleming, S. M. (2017) · Neuroscience of Consciousness · doi:10.1093/nc/nix007 · Cited by 309
Distinguishing the Roles of Dorsolateral and Anterior PFC in Visual Metacognition
Shekhar, M., & Rahnev, D. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3484-17.2018 · Cited by 154
Mazancieux, A., Fleming, S. M., Souchay, C., & Moulin, C. J. A. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000746 · Cited by 131
Metadata
- Authors
- Jang, Y., Wallsten, T. S., & Huber, D. E.
- Affiliations
- University of California San Diego (US)
- ORCID
- Huber, David E.
- Venue
- Psychological Review
- Published
- 2012
- Volume
- 119
- Issue
- 1
- Pages
- 186-200
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2051602937
- Cited by
- 59
- References
- 40
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 5 · 2023: 9 · 2022: 3 · 2021: 5 · 2020: 8 · 2019: 4 · 2018: 6 · 2017: 4 · 2016: 2 · 2015: 3 · 2014: 4 · 2013: 1 · 2012: 1
- FWCI
- 0.97
- Type
- journal article
- Language
- en
- Update notices
- correction (2012-01-09)
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (RMH081084A)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
- Keywords
- metacognition, confidence judgments, metacognitive bias, signal detection theory, judgments of learning, cued recall, recognition memory
- MeSH terms
- Cognition, Cues, Data Interpretation, Statistical, Humans, Judgment, Learning, Models, Psychological, Mental Recall, Stochastic Processes, Time Factors, Signal Detection, Psychological, Recognition, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.