Sources of Metacognitive Inefficiency
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Confidence judgments are typically less informative about one’s accuracy than they could be, a phenomenon we call “metacognitive inefficiency.” We review the existence of different sources of metacognitive inefficiency and classify them into four categories based on whether the corruption is due to (1) systematic or non-systematic influences, and (2) the input to or the computation of the metacognitive system. Critically, the existence of different sources of metacognitive inefficiency provides an alternative explanation for behavioral findings typically interpreted as evidence for domain-specific and against domain-general metacognitive systems. We argue that, contrary to the dominant assumption in the field, metacognitive failures are not monolithic and suggest that understanding the sources of metacognitive inefficiency should be a primary goal of the science of metacognition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Metamemory: A Theoretical Framework and New Findings
Nelson, T. O. (1990) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60053-5 · Cited by 2,583 · cited 1×
“While this opinion article focuses on understanding the (in)efficiency in the monitoring function of metacognition [18,19], we note that metacognition has additional functions such as control and social communication [18–22] and, in some cases, inefficiency in monitoring may arise from the efficient function of these…”
BackgroundDysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring
Stephan, K. E., Friston, K. J., & Frith, C. D. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn176 · Cited by 1,134
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 1×
“For example, confidence ratings may consider only the last part of the evidence accumulation process or only on the evidence of some accumulators but not others [72,73].”
BackgroundRelating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Metacognition and consciousness
Koriat, A. (2007) · The Cambridge Handbook of Consciousness · doi:10.1017/cbo9780511816789.012 · Cited by 554
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534
Relative blindsight in normal observers and the neural correlate of visual consciousness
Lau, H. C., & Passingham, R. E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607716103 · Cited by 518
Choice Certainty Is Informed by Both Evidence and Decision Time
Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470 · cited 1×
“Further studies have shown that confidence is affected by manipulations of movementrelated parameters such as increasing movement speed [65] and extending response times without affecting accuracy [66].”
BackgroundThe Relationship Between Eyewitness Confidence and Identification Accuracy: A New Synthesis
Wixted, J. T., & Wells, G. L. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100616686966 · Cited by 467 · cited 1×
“Finally, a mechanistic understanding of the exact sources of metacognitive inefficiency will result in greater insight into neuropsychiatric disorders characterized by disruptions of metacognition [88–92] and potentially allow us to create targeted interventions to improve the quality of confidence ratings, especially…”
BackgroundThe role of metacognition in human social interactions
Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0123 · Cited by 407
Rounis, E., Maniscalco, B., Rothwell, J. C., Passingham, R. E., & Lau, H. (2010) · Cognitive Neuroscience · doi:10.1080/17588921003632529 · Cited by 407 · cited 1×
“For example, decreases in metacognitive efficiency due to transcranial magnetic stimulation have been theorized to arise from increased noise in the signal used to determine confidence [7,38,42].”
BackgroundRouault, M., Seow, T., Gillan, C. M., & Fleming, S. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.12.017 · Cited by 393
Prefrontal Contributions to Metacognition in Perceptual Decision Making
Fleming, S. M., Huijgen, J., & Dolan, R. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6489-11.2012 · Cited by 391
Supra-personal cognitive control and metacognition
Shea, N., Boldt, A., Bang, D., Yeung, N., Heyes, C., & Frith, C. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.006 · Cited by 368
Metacognition: computation, biology and function
Fleming, S. M., Dolan, R. J., & Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0021 · Cited by 344
Suboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342 · cited 1×
“One example is criterion jitter [47]: the inability of observers to maintain stable confidence”
BackgroundSelf-citationSowing the seeds of doubt: a narrative review on metacognitive training in schizophrenia
Moritz, S., Andreou, C., Schneider, B. C., Wittekind, C. E., Menon, M., Balzan, R. P., & Woodward, T. S. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.04.004 · Cited by 325
Anatomical coupling between distinct metacognitive systems for memory and visual perception
McCurdy, L. Y., Maniscalco, B., Metcalfe, J., Liu, K. Y., de Lange, F. P., & Lau, H. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1890-12.2013 · Cited by 299 · cited 1×
“Critically, examining the data from individual subjects demonstrates that within the same task, some people are able to achieve metacognitive efficiency very close to meta-d′ = d′, whereas many others fall far below this ideal [3,32,33].”
BackgroundThe construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297
Morales, J., Lau, H., & Fleming, S. M. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2360-17.2018 · Cited by 274
Error awareness and the insula: links to neurological and psychiatric diseases
Klein, T. A., Ullsperger, M., & Danielmeier, C. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00014 · Cited by 210
Distinct encoding of decision confidence in human medial prefrontal cortex
Bang, D., & Fleming, S. M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800795115 · Cited by 207
Causal evidence for frontal cortex organization for perceptual decision making
Rahnev, D., Nee, D. E., Riddle, J., Larson, A. S., & D’Esposito, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1522551113 · Cited by 200 · cited 1×
“For example, decreases in metacognitive efficiency due to transcranial magnetic stimulation have been theorized to arise from increased noise in the signal used to determine confidence [7,38,42].”
BackgroundSelf-citationSpatial attention increases performance but not subjective confidence in a discrimination task
Wilimzig, C., Tsuchiya, N., Fahle, M., Einhäuser, W., & Koch, C. (2008) · Journal of Vision · doi:10.1167/8.5.7 · Cited by 196
Effects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
Unexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182
Domain-general enhancements of metacognitive ability through adaptive training.
Carpenter, J., Sherman, M. T., Kievit, R. A., Seth, A. K., Lau, H., & Fleming, S. M. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000505 · Cited by 174
Relating inter-individual differences in metacognitive performance on different perceptual tasks
Song, C., Kanai, R., Fleming, S. M., Weil, R. S., Schwarzkopf, D. S., & Rees, G. (2011) · Consciousness and Cognition · doi:10.1016/j.concog.2010.12.011 · Cited by 158 · cited 1×
“Critically, examining the data from individual subjects demonstrates that within the same task, some people are able to achieve metacognitive efficiency very close to meta-d′ = d′, whereas many others fall far below this ideal [3,32,33].”
BackgroundDirect injection of noise to the visual cortex decreases accuracy but increases decision confidence
Rahnev, D. A., Maniscalco, B., Luber, B., Lau, H., & Lisanby, S. H. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00985.2011 · Cited by 156
Self-citationMeasures of metacognition on signal-detection theoretic models
Barrett, A. B., Dienes, Z., & Seth, A. K. (2013) · Psychological Methods · doi:10.1037/a0033268 · Cited by 155
Rahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0813-1 · Cited by 151
Self-citationMedin, D., Ojalehto, B., Marin, A., & Bang, M. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0088 · Cited by 146
Metacognitive therapy in treatment-resistant depression: A platform trial
Wells, A., Fisher, P., Myers, S., Wheatley, J., Patel, T., & Brewin, C. R. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.02.004 · Cited by 145
Confidence matching in group decision-making
Bang, D., Aitchison, L., Moran, R., Herce Castanon, S., Rafiee, B., Mahmoodi, A., Lau, J. Y. F., Latham, P. E., Bahrami, B., & Summerfield, C. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0117 · Cited by 141
Mazancieux, A., Fleming, S. M., Souchay, C., & Moulin, C. J. A. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000746 · Cited by 131 · cited 1×
“It should also be noted that a lack of correlation may also arise due to insufficient statistical power with larger studies being more likely to find significant correlations [13,82,84].”
BackgroundBehavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
Maniscalco, B., Peters, M. A. K., & Lau, H. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1059-x · Cited by 129
Humans incorporate attention-dependent uncertainty into perceptual decisions and confidence
Denison, R. N., Adler, W. T., Carrasco, M., & Ma, W. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717720115 · Cited by 122
Comparing Bayesian and non-Bayesian accounts of human confidence reports
Adler, W. T., & Ma, W. J. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006572 · Cited by 118 · cited 3×
“Of course, it is possible that some of them are also due to processing or resource limitations, especially when computing the probability of being correct is complex or resource demanding [75,77].”
BackgroundThe impact of evidence reliability on sensitivity and bias in decision confidence.
Boldt, A., de Gardelle, V., & Yeung, N. (2017) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000404 · Cited by 110
Variance misperception explains illusions of confidence in simple perceptual decisions
Zylberberg, A., Roelfsema, P. R., & Sigman, M. (2014) · Consciousness and Cognition · doi:10.1016/j.concog.2014.05.012 · Cited by 97 · cited 1×
“variability affects task accuracy [70].”
Confidence as a Common Currency between Vision and Audition
de Gardelle, V., Le Corre, F., & Mamassian, P. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147901 · Cited by 95
Sensory noise increases metacognitive efficiency
Bang, J. W., Shekhar, M., & Rahnev, D. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000511 · Cited by 94
Self-citationComputations underlying confidence in visual perception.
Spence, M. L., Dux, P. E., & Arnold, D. H. (2016) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/xhp0000179 · Cited by 89
Noradrenaline blockade specifically enhances metacognitive performance
Hauser, T. U., Allen, M., Purg, N., Moutoussis, M., Rees, G., & Dolan, R. J. (2017) · eLife · doi:10.7554/elife.24901 · Cited by 87 · cited 1×
“Additionally, confidence has been found to be modulated by several other nonperceptual factors including physiological variables such as one’s level of arousal [54,55]; highly accessible perceptual cues such as the font size in which to-be-remembered words are printed [56]; the contrast in which to-be-remembered pictu…”
BackgroundUnconscious information changes decision accuracy but not confidence
Vlassova, A., Donkin, C., & Pearson, J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403619111 · Cited by 70
Cited by
Metacognition and Confidence: A Review and Synthesis
Fleming, S. M. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-022423-032425 · Cited by 256
“These confidence judgments are higher for objectively correct than incorrect decisions, showing sensitivity to performance, albeit often corrupted by additional metacognitive noise (Shekhar & Rahnev, 2021).”
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
Self-citationThe future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
Examining the robustness of the relationship between metacognitive efficiency and metacognitive bias
Xue, K., Shekhar, M., & Rahnev, D. (2021) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103196 · Cited by 45
Self-citationCommon computations for metacognition and meta-metacognition
Zheng, Y., Recht, S., & Rahnev, D. (2023) · Neuroscience of Consciousness · doi:10.1093/nc/niad023 · Cited by 15
Self-citation
Metadata
- Authors
- Shekhar, M., & Rahnev, D.
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 25
- Issue
- 1
- Pages
- 12-23
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W3106536246
- Cited by
- 119
- References
- 49
- FWCI
- 2.40
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.