Confidence Leak in Perceptual Decision Making
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
People live in a continuous environment in which the visual scene changes on a slow timescale. It has been shown that to exploit such environmental stability, the brain creates a continuity field in which objects seen seconds ago influence the perception of current objects. What is unknown is whether a similar mechanism exists at the level of metacognitive representations. In three experiments, we demonstrated a robust intertask confidence leak—that is, confidence in one’s response on a given task or trial influencing confidence on the following task or trial. This confidence leak could not be explained by response priming or attentional fluctuations. Better ability to modulate confidence leak predicted higher capacity for metacognition as well as greater gray matter volume in the prefrontal cortex. A model based on normative principles from Bayesian inference explained the results by postulating that observers subjectively estimate the perceptual signal strength in a stable environment. These results point to the existence of a novel metacognitive mechanism mediated by regions in the prefrontal cortex.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Notably, the level of confidence is a relatively stable feature of individuals’ judgments that generalizes across different tasks 10, 11, 12”
From Psychiatric Symptom Dimensions Are Associated With Dissociable Shifts in Metacognition but Not Task Performance (2018) · cites this paper as [12]
Experimental — accuracy not yet measuredIn the citing paper
“confidence estimates in turn shape and control choices 12, 16”
From Psychiatric Symptom Dimensions Are Associated With Dissociable Shifts in Metacognition but Not Task Performance (2018) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 4×
“Second, the model predicted that stronger confidence leak leads to impaired metacognitive sensitivity (Fleming & Lau, 2014), which was confirmed with the combined data from Experiments 1– 3, as well as in Experiment 4.”
BackgroundMethodResultInfluentialSelf-citationRepresentation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 1×
“…to use the mouse to make a subjective confidence response on a continuous visual analog scale (VAS), while the second was the “opt out” paradigm (Kiani & Shadlen, 2009) in which observers are given the option of not responding if they are unsure about the response (but do not give confidence…”
BackgroundRelating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667
Metacognition and consciousness
Koriat, A. (2007) · The Cambridge Handbook of Consciousness · doi:10.1017/cbo9780511816789.012 · Cited by 554 · cited 1×
“…act immediately on the decision or to continue gathering information, as well as whether to update our model of the world with the newly acquired information (Fleming, Dolan, & Frith, 2012; Koriat, 2007; Metcalfe & Shimamura, 1994; Nelson & Narens, 1990; Shimamura, 2000; Yeung & Summerfield, 2012).”
Metacognition: computation, biology and function
Fleming, S. M., Dolan, R. J., & Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0021 · Cited by 344
Anatomical coupling between distinct metacognitive systems for memory and visual perception
McCurdy, L. Y., Maniscalco, B., Metcalfe, J., Liu, K. Y., de Lange, F. P., & Lau, H. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1890-12.2013 · Cited by 299 · cited 8×
“We repeated the analyses by McCurdy et al. (2013) except that we were interested in the brain correlates of confidence leak rather than metacognition scores.”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 25
- 10.1163/156856897X00357 · DOI · Paper page
- 10.1523/JNEUROSCI.1422-04.2004 · DOI · Paper page
- Dienes Z., 2008, Understanding psychology as a science: An introduction to scientific and statistical inference
- 10.1016/j.conb.2012.07.007 · DOI · Paper page
- 10.1038/nn.3689 · DOI · Paper page
- Fründ I., Wichmann F. A., Macke J. H. (2014). Quantifying the effect of intertrial dependence on perceptual decisions. Journal of Vision, 14(7), Article 9. Retrieved from http://jov.arvojournals.org/article.aspx?articleid=2194025 · DOI · Paper page
- 10.3758/CABN.5.4.452 · DOI · Paper page
- 10.1037/0278-7393.34.4.945 · DOI · Paper page
- 10.1037/a0022171 · DOI · Paper page
- 10.1016/j.cub.2014.09.025 · DOI · Paper page
- Macmillan N. A., 2005, Detection theory: A user’s guide
- 10.3758/s13414-012-0291-2 · DOI
- 10.1016/j.concog.2011.09.021 · DOI · Paper page
- 10.7551/mitpress/4561.001.0001 · DOI · Paper page
- 10.3758/PBR.15.3.465 · DOI
- 10.1111/j.1460-9568.2011.07987.x · DOI · Paper page
- 10.1163/156856897X00366 · DOI · Paper page
- 10.1152/jn.00184.2012 · DOI · Paper page
- 10.1152/jn.00209.2013 · DOI · Paper page
- 10.1523/JNEUROSCI.1478-11.2011 · DOI · Paper page
- 10.1038/nn.2948 · DOI · Paper page
- 10.1006/ccog.2000.0450 · DOI · Paper page
- Yu A. J., 2009, Advances in Neural Information Processing Systems, 21, 1873
- 10.1093/brain/113.6.1721 · DOI · Paper page
- 10.1073/pnas.1407540111 · DOI
Cited by
Rouault, M., Seow, T., Gillan, C. M., & Fleming, S. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.12.017 · Cited by 393
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
Self-citationHMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings
Fleming, S. M. (2017) · Neuroscience of Consciousness · doi:10.1093/nc/nix007 · Cited by 309
Morales, J., Lau, H., & Fleming, S. M. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2360-17.2018 · Cited by 274
“Due to intertask “leaks” in confidence (Rahnev et al., 2015), in which confidence in one task influences confidence ratings on the following task (or even in the following trial), there is a possibility that interleaving blocks of different tasks might favor the observation of more domain-general confidence-related pa…”
Self-citationCausal evidence for frontal cortex organization for perceptual decision making
Rahnev, D., Nee, D. E., Riddle, J., Larson, A. S., & D’Esposito, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1522551113 · Cited by 200
“(37) by taking the absolute value of the Fisher transform of the lag-1 confidence autocorrelation.”
BackgroundSelf-citationUnexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182
Human Metacognition Across Domains: Insights from Individual Differences and Neuroimaging
Rouault, M., McWilliams, A., Allen, M. G., & Fleming, S. M. (2018) · Personality Neuroscience · doi:10.1017/pen.2018.16 · Cited by 176
“Notably, the ability to resist such leakage was positively correlated with lateral aPFC grey matter volume across subjects (Rahnev, Koizumi, McCurdy, D ’ Esposito, & Lau, 2015).”
BackgroundAbnormalities of confidence in psychiatry: an overview and future perspectives
Hoven, M., Lebreton, M., Engelmann, J. B., Denys, D., Luigjes, J., & van Holst, R. J. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0602-7 · Cited by 171
Distinguishing the Roles of Dorsolateral and Anterior PFC in Visual Metacognition
Shekhar, M., & Rahnev, D. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.3484-17.2018 · Cited by 154
Self-citationRahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0813-1 · Cited by 151
Self-citationForming global estimates of self-performance from local confidence
Rouault, M., Dayan, P., & Fleming, S. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09075-3 · Cited by 134
Behavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
“The involvement of supramodal, prefrontal brain regions during confidence judgments first suggested that metacognition is partly governed by supramodal rules (Fleming et al., 2010; Yokoyama et al., 2010; Rahnev et al., 2015).”
BackgroundConfidence reflects a noisy decision reliability estimate
Boundy-Singer, Z. M., Ziemba, C. M., & Goris, R. L. T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01464-x · Cited by 71
Modeling perceptual confidence and the confidence forced-choice paradigm.
Mamassian, P., & de Gardelle, V. (2022) · Psychological Review · doi:10.1037/rev0000312 · Cited by 70
“44 quantified with a single parameter in our model, may aggregate multiple sources of inefficiencies, including noisy read-out of the perceptual evidence, but also influences from previous confidence judgments (Rahnev et al., 2015), or influences from other features that are not related to perceptual performance.”
BackgroundConsensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
Self-citationThe future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
Metacognition in functional cognitive disorder- a potential mechanism and treatment target
Bhome, R., McWilliams, A., Huntley, J. D., Fleming, S. M., & Howard, R. J. (2019) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2019.1651708 · Cited by 48
Examining the robustness of the relationship between metacognitive efficiency and metacognitive bias
Xue, K., Shekhar, M., & Rahnev, D. (2021) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103196 · Cited by 45
Self-citationLee, A. L. F., de Gardelle, V., & Mamassian, P. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01869-7 · Cited by 32
Yeon, J., Shekhar, M., & Rahnev, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-77820-6 · Cited by 30
Self-citationWinter, C. J., & Peters, M. A. K. (2022) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-021-02358-2 · Cited by 17
The impact of feedback on metacognition: Enhancing in easy tasks, impeding in difficult ones
Luo, T., & Liu, C. (2023) · Consciousness and Cognition · doi:10.1016/j.concog.2023.103601 · Cited by 15
Metadata
- Authors
- Rahnev, D., Koizumi, A., McCurdy, L. Y., D’Esposito, M., & Lau, H.
- Affiliations
- Department of Psychology, Georgia Institute of Technology
- Department of Psychology, Columbia University
- Interdepartmental Neuroscience Program, Yale University School of Medicine
- Helen Wills Neuroscience Institute, University of California, Berkeley
- Department of Psychology, University of California, Los Angeles
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2015-09-25
- Volume
- 26
- Issue
- 11
- Pages
- 1664-1680
- ISSN
- 0956-7976
- 1467-9280
- PMC
- PMC4636919
- Cited by
- 151
- References
- 12
- Language
- en
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.