There are things that we know that we know, and there are things that we do not know we do not know: Confidence in decision-making
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Metacognition, the ability to think about our own thoughts, is a fundamental component of our mental life and is involved in memory, learning, planning and decision-making. Here we focus on one aspect of metacognition, namely confidence in perceptual decisions. We review the literature in psychophysics, neuropsychology and neuroscience. Although still a very new field, several recent studies suggest there are specific brain circuits devoted to monitoring and reporting confidence, whereas others suggest that confidence information is encoded within decision-making circuits. We provide suggestions, based on interdisciplinary research, to disentangle these disparate results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Insensitivity to future consequences following damage to human prefrontal cortex
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994) · Cognition · doi:10.1016/0010-0277(94)90018-3 · Cited by 6,128
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 2×
“In the standard model, the accumulation stops when evidence reaches one of the two boundaries (Figure 3A, Ratcliff, 1978).”
BackgroundMethodThe Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 1×
“This is a modification of the drift diffusion model popularized in the decision-making literature (Ratcliff, 1978; Ratcliff and McKoon, 2008).”
MethodImplicit learning of artificial grammars
Reber, A. S. (1967) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(67)80149-x · Cited by 2,026
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
Neural correlates of decision variables in parietal cortex
Platt, M. L., & Glimcher, P. W. (1999) · Nature · doi:10.1038/22268 · Cited by 1,721 · cited 1×
“For example, decision-related activity appears in the lateral intraparietal (LIP) area (Kim and Shadlen, 1999; Platt and Glimcher, 1999; Roitman and Shadlen, 2002), frontal eye field (FEF, Gold and Shadlen, 2000; Kim and Shadlen, 1999) and superior colliculus (Horwitz and Newsome, 1999, 2001; Kim…”
BackgroundRoitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“For example, decision-related activity appears in the lateral intraparietal (LIP) area (Kim and Shadlen, 1999; Platt and Glimcher, 1999; Roitman and Shadlen, 2002), frontal eye field (FEF, Gold and Shadlen, 2000; Kim and Shadlen, 1999) and superior colliculus (Horwitz and Newsome, 1999, 2001; Kim…”
BackgroundImplicit learning and tacit knowledge
Reber, A. S. (1989) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.118.3.219 · Cited by 1,581 · cited 2×
“Implicit learning is learning without awareness and without intention (Reber, 1989).”
BackgroundBayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
Fleming, S. M., & Lau, H. C. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00443 · Cited by 1,408 · cited 1×
“Whereas this kind of SDT analysis of confidence has been applied to numerous human studies (for a recent review, see Fleming and Lau, 2014), it has received little attention in the animal literature.”
MethodSelf-citationRepresentation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 13×
“The authors concluded that the scaling of LIP neuronal activity with correct, highly confident choices, to less confident choices, indicated that LIP neurons multiplex decision and confidence signals.”
BackgroundInfluentialNeural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950 · cited 2×
“For example, decision-related activity appears in the lateral intraparietal (LIP) area (Kim and Shadlen, 1999; Platt and Glimcher, 1999; Roitman and Shadlen, 2002), frontal eye field (FEF, Gold and Shadlen, 2000; Kim and Shadlen, 1999) and superior colliculus (Horwitz and Newsome, 1999, 2001; Kim…”
BackgroundAre we aware of neural activity in primary visual cortex?
Crick, F., & Koch, C. (1995) · Nature · doi:10.1038/375121a0 · Cited by 932
Cortical microstimulation influences perceptual judgements of motion direction
Salzman, C. D., Britten, K. H., & Newsome, W. T. (1990) · Nature · doi:10.1038/346174a0 · Cited by 881 · cited 2×
“…the direction of random moving dots while a current was injected in area MT and MST. Consistently with previous findings (Ditterich et al., 2003; Salzman et al., 1990; Salzman et al., 1992), the authors found that the monkey was more likely to choose the preferred direction of stimulated…”
ResultEmpirical support for higher-order theories of conscious awareness
Lau, H., & Rosenthal, D. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.05.009 · Cited by 869 · cited 1×
“The exact relationship between the two may be complicated, and in general, issues surrounding consciousness are controversial (Lau and Rosenthal, 2011).”
BackgroundSelf-citationRelating Introspective Accuracy to Individual Differences in Brain Structure
Fleming, S. M., Weil, R. S., Nagy, Z., Dolan, R. J., & Rees, G. (2010) · Science · doi:10.1126/science.1191883 · Cited by 809
Neural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · cited 2×
“In fact, with a few exceptions (Kepecs et al., 2008; and Kiani and Shadlen, 2009), most animal studies on confidence typically do not apply formal psychophysics or computational models.”
BackgroundThe neural basis of metacognitive ability
Fleming, S. M., & Dolan, R. J. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0417 · Cited by 747 · cited 1×
“In this context, metacognition is often described as either prospective or retrospective (Fleming and Dolan, 2012).”
BackgroundTwo-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Microstimulation in visual area MT: effects on direction discrimination performance
Salzman, C., Murasugi, C., Britten, K., & Newsome, W. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-06-02331.1992 · Cited by 657
Probabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
Probabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615 · cited 1×
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript 2012; Lau, 2008; Pouget et al., 2013).”
BackgroundRelative blindsight in normal observers and the neural correlate of visual consciousness
Lau, H. C., & Passingham, R. E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0607716103 · Cited by 518 · cited 6×
“…prefrontal cortex (Del Cul et al., 2009), 2, 4: anterior prefrontal cortex and temporal lobe (Fleming et al., 2010), 3: Brodmann area 46 (Lau and Passingham, 2006), 5: ventral striatum (Hebart et al., 2014), 6: pulvinar (Komura et al., 2013), 7: SEF (Middlebrooks and Sommer, 2012), 8:…”
BackgroundInfluentialSelf-citationRhesus monkeys know when they remember
Hampton, R. R. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071600998 · Cited by 493 · cited 4×
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript strategy (Shields et al., 1997), a betting strategy (Son and Kornell, 2005) and an escape strategy (the possibility to avoid being tested, Hampton, 2001).”
BackgroundMethodInfluentialPost-decision wagering objectively measures awareness
Persaud, N., McLeod, P., & Cowey, A. (2007) · Nature Neuroscience · doi:10.1038/nn1840 · Cited by 454
Measuring consciousness: Is one measure better than the other?
Sandberg, K., Timmermans, B., Overgaard, M., & Cleeremans, A. (2010) · Consciousness and Cognition · doi:10.1016/j.concog.2009.12.013 · Cited by 443
The Missing Link in CognitionOrigins of self-reflective consciousness
Terrace, H. S., & Metcalfe, J. (2005) · doi:10.1093/acprof:oso/9780195161564.001.0001 · Cited by 417
Rounis, E., Maniscalco, B., Rothwell, J. C., Passingham, R. E., & Lau, H. (2010) · Cognitive Neuroscience · doi:10.1080/17588921003632529 · Cited by 407 · cited 1×
“To test whether the prefrontal cortex plays a causal role in confidence reporting, Rounis et al. (2010) applied transcranial magnetic stimulation to the prefrontal cortex and found that subject's confidence decreased, even though their perceptual discrimination performance remained unchanged with…”
BackgroundSelf-citationGalvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196546 · Cited by 405
Separate Signals for Target Selection and Movement Specification in the Superior Colliculus
Horwitz, G. D., & Newsome, W. T. (1999) · Science · doi:10.1126/science.284.5417.1158 · Cited by 346
Transfer of metacognitive skills and hint seeking in monkeys
Kornell, N., Son, L. K., & Terrace, H. S. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01850.x · Cited by 341
Causal role of prefrontal cortex in the threshold for access to consciousness
Del Cul, A., Dehaene, S., Reyes, P., Bravo, E., & Slachevsky, A. (2009) · Brain · doi:10.1093/brain/awp111 · Cited by 337 · cited 6×
“[PubMed: 7753166] Del Cul A, Dehaene S, Reyes P, Bravo E, Slachevsky A. Causal role of prefrontal cortex in the threshold for access to consciousness.”
BackgroundMethodInfluentialAnatomical coupling between distinct metacognitive systems for memory and visual perception
McCurdy, L. Y., Maniscalco, B., Metcalfe, J., Liu, K. Y., de Lange, F. P., & Lau, H. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1890-12.2013 · Cited by 299
Self-citationThe construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297 · cited 2×
“Finally, Zylberberg and colleagues (Zylberberg et al., 2012) measured performance accuracy and confidence judgments in a visual motion discrimination task.”
BackgroundMemory and metamemory: a study of the feeling-of-knowing phenomenon in amnesic patients
Shimamura, A. P., & Squire, L. R. (1986) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.12.3.452 · Cited by 294
Cowey, A. (2010) · Experimental Brain Research · doi:10.1007/s00221-009-1914-2 · Cited by 279
Microstimulation of visual cortex affects the speed of perceptual decisions
Ditterich, J., Mazurek, M. E., & Shadlen, M. N. (2003) · Nature Neuroscience · doi:10.1038/nn1094 · Cited by 234 · cited 2×
“Consistently with previous findings (Ditterich et al., 2003; Salzman et al., 1990; Salzman et al., 1992), the authors found that the monkey was more likely to choose the preferred direction of stimulated neurons.”
ResultResponses of pulvinar neurons reflect a subject's confidence in visual categorization
Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T., & Miyamoto, A. (2013) · Nature Neuroscience · doi:10.1038/nn.3393 · Cited by 226
Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence
Lak, A., Costa, G. M., Romberg, E., Koulakov, A. A., Mainen, Z. F., & Kepecs, A. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.039 · Cited by 209
Effects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
Shields, W. E., Smith, J. D., & Washburn, D. A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.2.147 · Cited by 142 · cited 6×
“…into the nature of confidence, one limitation is that they used relatively simple quantitative analysis, such as how often an ambiguous stimulus was followed by a sure choice (Shields et al., 1997) or how often a correct choice was endorsed with a high confidence judgment (Son and Kornell, 2005).”
BackgroundResultInfluentialNeuronal Correlates of Metacognition in Primate Frontal Cortex
Middlebrooks, P. G., & Sommer, M. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.028 · Cited by 124
Know thyself: Metacognitive networks and measures of consciousness
Pasquali, A., Timmermans, B., & Cleeremans, A. (2010) · Cognition · doi:10.1016/j.cognition.2010.08.010 · Cited by 102
Consciousness and metarepresentation: A computational sketch
Cleeremans, A., Timmermans, B., & Pasquali, A. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.09.011 · Cited by 91
Cited by
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Vaccaro, A. G., & Fleming, S. M. (2018) · Brain and Neuroscience Advances · doi:10.1177/2398212818810591 · Cited by 218
“Previous reviews have highlighted the specific contribution of a network centred on medial/lateral aPFC in metacognition (Fleming and Dolan, 2014; Grimaldi et al., 2015; Metcalfe and Schwartz, 2015).”
BackgroundBehavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition
Faivre, N., Filevich, E., Solovey, G., Kühn, S., & Blanke, O. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.0322-17.2017 · Cited by 129
“, 2013) and more evidence has been gathered regarding the brain areas involved in metacognitive monitoring (Grimaldi et al., 2015), the core properties and underlying mechanisms of metacognition remain largely unknown.”
BackgroundHuman VMPFC encodes early signatures of confidence in perceptual decisions
Gherman, S., & Philiastides, M. G. (2018) · eLife · doi:10.7554/elife.38293 · Cited by 107
“…confidence representations in the VMPFC may in themselves not be sufficient or available in an appropriate form for metacognitive report (Grimaldi et al., 2015), thus requiring further read-out from higher-order networks (Insabato et al., 2010) such as the prefrontal cortex (Fleming et…”
BackgroundInfluential
Metadata
- Authors
- Grimaldi, P., Lau, H., & Basso, M. A.
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2015-08
- Volume
- 55
- Pages
- 88-97
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W1989912475
- Cited by
- 126
- References
- 44
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.