Predicting the Accuracy of a Decision: A Neural Mechanism of Confidence
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
The quantitative study of decision-making has traditionally rested on three key behavioral measures: accuracy, response time, and confidence. Of these, confidence--defined as the degree of belief, prior to feedback, that a decision is correct-is least well understood at the level of neural mechanism, although recent years have seen a surge in interest in the topic among theoretical and systems neuroscientists. Here we review some of these developments and highlight a particular candidate mechanism for assigning confidence in a perceptual decision. The mechanism is appealing because it is rooted in the same decision-making framework--bounded accumulation of evidence--that successfully explains accuracy and reaction time in many tasks, and it is validated by neurophysiology and microstimulation experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · cited 1×
“…and RT distributions across many domains 5 (Busemeyer 1985; Luce 1986; Reddi et al. 2003; Ratcliff and Smith 2004; Krajbich and Rangel 2011; DasGupta et al. 2014), as well as their robust neural correlates (Smith and Ratcliff 2004; Gold and Shadlen 2007; Heekeren et al. 2008; Ploran et al. 2011).”
Self-citationRoitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 1×
“…eye movement, neurons related to oculomotor planning show persistent activity resembling the accumulation of noisy evidence toward a threshold or bound (Hanes and Schall 1996; Shadlen and Newsome 1996; Kim and Shadlen 1999; Horwitz and Newsome 2001; Roitman and Shadlen 2002; Ratcliff et al. 2003).”
Self-citationNeural Control of Voluntary Movement Initiation
Hanes, D. P., & Schall, J. D. (1996) · Science · doi:10.1126/science.274.5286.427 · Cited by 1,145 · cited 1×
“…eye movement, neurons related to oculomotor planning show persistent activity resembling the accumulation of noisy evidence toward a threshold or bound (Hanes and Schall 1996; Shadlen and Newsome 1996; Kim and Shadlen 1999; Horwitz and Newsome 2001; Roitman and Shadlen 2002; Ratcliff et al. 2003).”
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 1×
“In contrast, our recent findings (Kiani and Shadlen 2009; Fetsch et al. 2014; Kiani et al. 2014a) support a role for time in and of itself, as explained below.”
Self-citationNeural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950
Self-citationCortical microstimulation influences perceptual judgements of motion direction
Salzman, C. D., Britten, K. H., & Newsome, W. T. (1990) · Nature · doi:10.1038/346174a0 · Cited by 881 · cited 5×
“As previously shown (Salzman et al. 1990, 1992; Celebrini and Newsome 1995), mS caused the monkey to choose the preferred direction of the stimulated neurons more frequently, manifesting as a horizontal shift of the choice function (Fig.”
InfluentialNeural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881
Self-citationNeural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809 · cited 1×
“SDT-based models of confidence remain highly influential in psychology and neuroscience (Higham 2007; Kepecs et al. 2008; Rounis et al. 2010; Rahnev et al. 2011, 2012; Ko and Lau 2012; Komura et al. 2013; Lak et al. 2014; Scott et al. 2014).”
Motion perception: seeing and deciding.
Shadlen, M. N., & Newsome, W. T. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.2.628 · Cited by 723
Self-citationTwo-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
Decision-making with multiple alternatives
Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008) · Nature Neuroscience · doi:10.1038/nn.2123 · Cited by 671
Self-citationMicrostimulation in visual area MT: effects on direction discrimination performance
Salzman, C., Murasugi, C., Britten, K., & Newsome, W. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-06-02331.1992 · Cited by 657
A role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Self-citationA representation of the hazard rate of elapsed time in macaque area LIP
Janssen, P., & Shadlen, M. N. (2005) · Nature Neuroscience · doi:10.1038/nn1386 · Cited by 601
Self-citationRepresentation of Time by Neurons in the Posterior Parietal Cortex of the Macaque
Leon, M. I., & Shadlen, M. N. (2003) · Neuron · doi:10.1016/s0896-6273(03)00185-5 · Cited by 601
Self-citationPerformance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581
Huk, A. C., & Shadlen, M. N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4684-04.2005 · Cited by 538
Self-citationKiani, R., Hanks, T. D., & Shadlen, M. N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4761-07.2008 · Cited by 500 · cited 3×
“In the lateral intraparietal area (LIP), this activity reflects not only the mean (Roitman and Shadlen 2002; Huk and Shadlen 2005; Kiani et al. 2008) but also the variance and autocorrelation (Churchland et al. 2011) of an evolving DV that explains choice and RT.”
Self-citationLearning and selective attention
Dayan, P., Kakade, S., & Montague, P. R. (2000) · Nature Neuroscience · doi:10.1038/81504 · Cited by 495 · cited 1×
“Confidence serves to modulate learning rates and the allocation of attentional resources (Dayan et al. 2000), and it enables online regulation of the decision process itself (Vickers 1979).”
A Sequential Theory of Psychological Discrimination
Link, S. W., & Heath, R. A. (1975) · Psychometrika · doi:10.1007/bf02291481 · Cited by 492
Choice Certainty Is Informed by Both Evidence and Decision Time
Kiani, R., Corthell, L., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.12.015 · Cited by 470 · cited 11×
“In this case the model predicts—and the data show—that confidence is an increasing function of evidence strength on both correct and error trials (Fig. 4E; Kiani et al. 2014a).”
InfluentialSelf-citationRounis, E., Maniscalco, B., Rothwell, J. C., Passingham, R. E., & Lau, H. (2010) · Cognitive Neuroscience · doi:10.1080/17588921003632529 · Cited by 407 · cited 1×
“SDT-based models of confidence remain highly influential in psychology and neuroscience (Higham 2007; Kepecs et al. 2008; Rounis et al. 2010; Rahnev et al. 2011, 2012; Ko and Lau 2012; Komura et al. 2013; Lak et al. 2014; Scott et al. 2014).”
Performance monitoring by the supplementary eye field
Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000) · Nature · doi:10.1038/35048576 · Cited by 392
Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task
Hanks, T. D., Mazurek, M. E., Kiani, R., Hopp, E., & Shadlen, M. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5613-10.2011 · Cited by 378 · cited 3×
“bias (Hanks et al. 2011) may need to be discounted or subtracted at later stages in order to recover the true level of evidence that informs confidence.”
InfluentialSelf-citationMicrostimulation of macaque area LIP affects decision-making in a motion discrimination task
Hanks, T. D., Ditterich, J., & Shadlen, M. N. (2006) · Nature Neuroscience · doi:10.1038/nn1683 · Cited by 360 · cited 2×
“Taken together with previous work (Salzman et al. 1990; Ditterich et al. 2003; Hanks et al. 2006), this study provides a quantitative, causal link between the activity of neurons in visual cortex and the three core behavioral indices in decision-making.”
Self-citationVariance as a signature of neural computations during decision making
Churchland, A. K., Kiani, R., Chaudhuri, R., Wang, X.-J., Pouget, A., & Shadlen, M. N. (2011) · Neuron · doi:10.1016/j.neuron.2010.12.037 · Cited by 350 · cited 2×
“In the lateral intraparietal area (LIP), this activity reflects not only the mean (Roitman and Shadlen 2002; Huk and Shadlen 2005; Kiani et al. 2008) but also the variance and autocorrelation (Churchland et al. 2011) of an evolving DV that explains choice and RT.”
Self-citationValuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309 · cited 2×
“2003), and ranking unchosen options (Hayden et al. 2009; Rushworth et al. 2012).”
A computational framework for the study of confidence in humans and animals
Kepecs, A., & Mainen, Z. F. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2012.0037 · Cited by 305
The construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297 · cited 1×
“…the BE hypothesis implies that the primary relationship is between evidence strength and confidence ; the correlation between RT and confidence is incidental (Vickers 2001)—a property shared by more recent work as well (Rolls et al. 2010; Zylberberg et al. 2012; Ratcliff and Starns 2013).”
Lateral habenula neurons signal errors in the prediction of reward information
Bromberg-Martin, E. S., & Hikosaka, O. (2011) · Nature Neuroscience · doi:10.1038/nn.2902 · Cited by 275
Microstimulation of visual cortex affects the speed of perceptual decisions
Ditterich, J., Mazurek, M. E., & Shadlen, M. N. (2003) · Nature Neuroscience · doi:10.1038/nn1094 · Cited by 234 · cited 5×
“The effect on choice and RT (Ditterich et al. 2003, not shown) mimics a horizontal shift along the motion strength axis (dashed arrow).”
InfluentialSelf-citationResponses of pulvinar neurons reflect a subject's confidence in visual categorization
Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T., & Miyamoto, A. (2013) · Nature Neuroscience · doi:10.1038/nn.3393 · Cited by 226
Accuracy, Information, and Response Time in a Saccadic Decision Task
Reddi, B. A. J., Asrress, K. N., & Carpenter, R. H. S. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00689.2002 · Cited by 217
Error Correction Time without External Error Signals
RABBITT, P. M. A. (1966) · Nature · doi:10.1038/212438a0 · Cited by 213
Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence
Lak, A., Costa, G. M., Romberg, E., Koulakov, A. A., Mainen, Z. F., & Kepecs, A. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.039 · Cited by 209
The study of animal metacognition
Smith, J. D. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.06.009 · Cited by 203
The relation of the time of a judgment to its accuracy
Henmon, V. A. C. (1911) · Psychological Review · doi:10.1037/h0074579 · Cited by 190
A cognitive signal for the proactive timing of action in macaque LIP
Maimon, G., & Assad, J. A. (2006) · Nature Neuroscience · doi:10.1038/nn1716 · Cited by 185
Effects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
Self-citationHorwitz, G. D., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.5.2543 · Cited by 168
Direct injection of noise to the visual cortex decreases accuracy but increases decision confidence
Rahnev, D. A., Maniscalco, B., Luber, B., Lau, H., & Lisanby, S. H. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00985.2011 · Cited by 156 · cited 2×
“6 by SDT-based models and at least one predecessor (Cartwright and Festinger 1943; Vickers 1979), and similar observations have been made in human subjects undergoing transcranial magnetic stimulation (Rahnev et al. 2012).”
Vickers, D., & Packer, J. (1982) · Acta Psychologica · doi:10.1016/0001-6918(82)90006-3 · Cited by 139
Does Confidence Use a Common Currency Across Two Visual Tasks?
de Gardelle, V., & Mamassian, P. (2014) · Psychological Science · doi:10.1177/0956797614528956 · Cited by 131
Confidence-Related Decision Making
Insabato, A., Pannunzi, M., Rolls, E. T., & Deco, G. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01068.2009 · Cited by 95
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72
Metacognition in monkeys during an oculomotor task
Middlebrooks, P. G., & Sommer, M. A. (2011) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/a0021611 · Cited by 51
Cited by
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Perceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 372
Decision-making in sensorimotor control
Gallivan, J. P., Chapman, C. S., Wolpert, D. M., & Flanagan, J. R. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0045-9 · Cited by 304
Compulsivity reveals a novel dissociation between action and confidence
Vaghi, M. M., Luyckx, F., Sule, A., Fineberg, N. A., Robbins, T. W., & De Martino, B. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.006 · Cited by 145
Metacognitive ability correlates with hippocampal and prefrontal microstructure
Allen, M., Glen, J. C., Müllensiefen, D., Schwarzkopf, D. S., Fardo, F., Frank, D., Callaghan, M. F., & Rees, G. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.02.008 · Cited by 85
Metadata
- Authors
- Fetsch, C. R., Kiani, R., & Shadlen, M. N.
- Venue
- Cold Spring Harbor Symposia on Quantitative Biology
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2014
- Volume
- 79
- Pages
- 185-197
- ISSN
- 0091-7451 (ISSN-L)
- 1943-4456
- OpenAlex
- W2121454341
- Cited by
- 55
- References
- 46
- Type
- posted content
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.