The nature of metacognitive inefficiency in perceptual decision making.
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Humans have the metacognitive ability to judge the accuracy of their own decisions via confidence ratings. A substantial body of research has demonstrated that human metacognition is fallible but it remains unclear how metacognitive inefficiency should be incorporated into a mechanistic model of confidence generation. Here we show that, contrary to what is typically assumed, metacognitive inefficiency depends on the level of confidence. We found that, across 5 different data sets and 4 different measures of metacognition, metacognitive ability decreased with higher confidence ratings. To understand the nature of this effect, we collected a large dataset of 20 subjects completing 2,800 trials each and providing confidence ratings on a continuous scale. The results demonstrated a robustly nonlinear zROC curve with downward curvature, despite a decades-old assumption of linearity. This pattern of results was reproduced by a new mechanistic model of confidence generation, which assumes the existence of lognormally distributed metacognitive noise. The model outperformed competing models either lacking metacognitive noise altogether or featuring Gaussian metacognitive noise. Further, the model could generate a measure of metacognitive ability which was independent of confidence levels. These findings establish an empirically validated model of confidence generation, have significant implications about measures of metacognitive ability, and begin to reveal the underlying nature of metacognitive inefficiency. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408
Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring
Stephan, K. E., Friston, K. J., & Frith, C. D. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn176 · Cited by 1,134
A comparison of current measures of the accuracy of feeling-of-knowing predictions
Nelson, T. O. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.109 · Cited by 976
Relating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Confidence in value-based choice
De Martino, B., Fleming, S. M., Garrett, N., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3279 · Cited by 534
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Relative blindsight in normal observers and the neural correlate of visual consciousness
Lau, H. C., & Passingham, R. E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607716103 · Cited by 518
Choice Certainty Is Informed by Both Evidence and Decision Time
Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470
Rounis, E., Maniscalco, B., Rothwell, J. C., Passingham, R. E., & Lau, H. (2010) · Cognitive Neuroscience · doi:10.1080/17588921003632529 · Cited by 407
Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
Mechanisms of perceptual learning
Dosher, B. A., & Lu, Z.-L. (1999) · Vision Research · doi:10.1016/s0042-6989(99)00059-0 · Cited by 394
Rouault, M., Seow, T., Gillan, C. M., & Fleming, S. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.12.017 · Cited by 393
Metacognition: computation, biology and function
Fleming, S. M., Dolan, R. J., & Frith, C. D. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0021 · Cited by 344
Causal role of prefrontal cortex in the threshold for access to consciousness
Del Cul, A., Dehaene, S., Reyes, P., Bravo, E., & Slachevsky, A. (2009) · Brain · doi:10.1093/brain/awp111 · Cited by 337
Sowing the seeds of doubt: a narrative review on metacognitive training in schizophrenia
Moritz, S., Andreou, C., Schneider, B. C., Wittekind, C. E., Menon, M., Balzan, R. P., & Woodward, T. S. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.04.004 · Cited by 325
The construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297
Signatures of a Statistical Computation in the Human Sense of Confidence
Sanders, J. I., Hangya, B., & Kepecs, A. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.025 · Cited by 253
Error awareness and the insula: links to neurological and psychiatric diseases
Klein, T. A., Ullsperger, M., & Danielmeier, C. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00014 · Cited by 210
Causal evidence for frontal cortex organization for perceptual decision making
Rahnev, D., Nee, D. E., Riddle, J., Larson, A. S., & D’Esposito, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1522551113 · Cited by 200
Self-citationSpatial attention increases performance but not subjective confidence in a discrimination task
Wilimzig, C., Tsuchiya, N., Fahle, M., Einhäuser, W., & Koch, C. (2008) · Journal of Vision · doi:10.1167/8.5.7 · Cited by 196
Effects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
Unexpected arousal modulates the influence of sensory noise on confidence
Allen, M., Frank, D., Schwarzkopf, D. S., Fardo, F., Winston, J. S., Hauser, T. U., & Rees, G. (2016) · eLife · doi:10.7554/elife.18103 · Cited by 182
Direct injection of noise to the visual cortex decreases accuracy but increases decision confidence
Rahnev, D. A., Maniscalco, B., Luber, B., Lau, H., & Lisanby, S. H. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00985.2011 · Cited by 156
Self-citationMeasures of metacognition on signal-detection theoretic models
Barrett, A. B., Dienes, Z., & Seth, A. K. (2013) · Psychological Methods · doi:10.1037/a0033268 · Cited by 155
Metacognitive therapy in treatment-resistant depression: A platform trial
Wells, A., Fisher, P., Myers, S., Wheatley, J., Patel, T., & Brewin, C. R. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.02.004 · Cited by 145
The signal processing architecture underlying subjective reports of sensory awareness
Maniscalco, B., & Lau, H. (2016) · Neuroscience of Consciousness · doi:10.1093/nc/niw002 · Cited by 133
Maniscalco, B., Peters, M. A. K., & Lau, H. (2016) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-016-1059-x · Cited by 129
Humans incorporate attention-dependent uncertainty into perceptual decisions and confidence
Denison, R. N., Adler, W. T., Carrasco, M., & Ma, W. J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1717720115 · Cited by 122
Sensory noise increases metacognitive efficiency
Bang, J. W., Shekhar, M., & Rahnev, D. (2019) · Journal of Experimental Psychology: General · doi:10.1037/xge0000511 · Cited by 94
Self-citationHigham, P. A., Perfect, T. J., & Bruno, D. (2009) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0013865 · Cited by 70
Unconscious information changes decision accuracy but not confidence
Vlassova, A., Donkin, C., & Pearson, J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403619111 · Cited by 70
A stochastic detection and retrieval model for the study of metacognition
Jang, Y., Wallsten, T. S., & Huber, D. E. (2012) · Psychological Review · doi:10.1037/a0025960 · Cited by 59
Cited by
Confidence reflects a noisy decision reliability estimate
Boundy-Singer, Z. M., Ziemba, C. M., & Goris, R. L. T. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01464-x · Cited by 71
Measuring metacognitive performance: type 1 performance dependence and test-retest reliability
Guggenmos, M. (2021) · Neuroscience of Consciousness · doi:10.1093/nc/niab040 · Cited by 66
Consensus Goals in the Field of Visual Metacognition
Rahnev, D., Balsdon, T., Charles, L., de Gardelle, V., Denison, R., Desender, K., Faivre, N., Filevich, E., Fleming, S. M., Jehee, J., et al. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221075615 · Cited by 63
Self-citationThe future of metacognition research: Balancing construct breadth with measurement rigor
Katyal, S., & Fleming, S. M. (2024) · Cortex · doi:10.1016/j.cortex.2023.11.002 · Cited by 63
Examining the robustness of the relationship between metacognitive efficiency and metacognitive bias
Xue, K., Shekhar, M., & Rahnev, D. (2021) · Consciousness and Cognition · doi:10.1016/j.concog.2021.103196 · Cited by 45
Self-citation
Metadata
- Authors
- Shekhar, M., & Rahnev, D.
- Venue
- Psychological Review
- Published
- 2021-01
- Volume
- 128
- Issue
- 1
- Pages
- 45-70
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W3018041557
- Cited by
- 111
- References
- 35
- FWCI
- 6.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.