The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Choice Certainty Is Informed by Both Evidence and Decision Time
Open accessAbstract
"Degree of certainty" refers to the subjective belief, prior to feedback, that a decision is correct. A reliable estimate of certainty is essential for prediction, learning from mistakes, and planning subsequent actions when outcomes are not immediate. It is generally thought that certainty is informed by a neural representation of evidence at the time of a decision. Here we show that certainty is also informed by the time taken to form the decision. Human subjects reported simultaneously their choice and confidence about the direction of a noisy display of moving dots. Certainty was inversely correlated with reaction times and directly correlated with motion strength. Moreover, these correlations were preserved even for error responses, a finding that contradicts existing explanations of certainty based on signal detection theory. We also contrived a stimulus manipulation that led to longer decision times without affecting choice accuracy, thus demonstrating that deliberation time itself informs the estimate of certainty. We suggest that elapsed decision time informs certainty because it serves as a proxy for task difficulty.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For instance, we may hold a belief that faster decisions are more likely to be accurate and use these feelings of fluency to inform our confidence estimates (Kiani et al. 2014).”
From Metacognition and Confidence: A Review and Synthesis (2024) · cites this paper as Kiani et al. 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 20,012
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,616
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Self-citationSpatiotemporal energy models for the perception of motion
Adelson, E. H., & Bergen, J. R. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000284 · Cited by 3,442
Shadlen, M. N., & Newsome, W. T. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03870.1998 · Cited by 2,178
Self-citationThe time course of perceptual choice: The leaky, competing accumulator model.
Usher, M., & McClelland, J. L. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.550 · Cited by 2,152
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
Self-citationNeural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Self-citationNeurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 2×
“In the direction discrimination task, stronger motion led to improved accuracy and faster RTs (Figure 1C), as previously shown (Churchland et al., 2008; Ditterich et al., 2003; Huk and Shadlen, 2005; Palmer et al., 2005; Roitman and Shadlen, 2002).”
Self-citationBayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457
The simplest complete model of choice response time: Linear ballistic accumulation
Brown, S. D., & Heathcote, A. (2008) · Cognitive Psychology · doi:10.1016/j.cogpsych.2007.12.002 · Cited by 1,198
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027
Self-citationThe statistical reliability of signals in single neurons in cat and monkey visual cortex
Tolhurst, D. J., Movshon, J. A., & Dean, A. F. (1983) · Vision Research · doi:10.1016/0042-6989(83)90200-6 · Cited by 982
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950
Self-citationNeural computations that underlie decisions about sensory stimuli
Gold, J. I., & Shadlen, M. N. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01567-9 · Cited by 881
Self-citationNeural correlates, computation and behavioural impact of decision confidence
Kepecs, A., Uchida, N., Zariwala, H. A., & Mainen, Z. F. (2008) · Nature · doi:10.1038/nature07200 · Cited by 809
Two-stage dynamic signal detection: A theory of choice, decision time, and confidence.
Pleskac, T. J., & Busemeyer, J. R. (2010) · Psychological Review · doi:10.1037/a0019737 · Cited by 722
The effect of stimulus strength on the speed and accuracy of a perceptual decision
Palmer, J., Huk, A. C., & Shadlen, M. N. (2005) · Journal of Vision · doi:10.1167/5.5.1 · Cited by 691
Self-citationChanges of mind in decision-making
Resulaj, A., Kiani, R., Wolpert, D. M., & Shadlen, M. N. (2009) · Nature · doi:10.1038/nature08275 · Cited by 678
Self-citationDecision-making with multiple alternatives
Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008) · Nature Neuroscience · doi:10.1038/nn.2123 · Cited by 671
Self-citationProbabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
Self-citationA role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Self-citationRepresentation of Time by Neurons in the Posterior Parietal Cortex of the Macaque
Leon, M. I., & Shadlen, M. N. (2003) · Neuron · doi:10.1016/s0896-6273(03)00185-5 · Cited by 601
Self-citationA representation of the hazard rate of elapsed time in macaque area LIP
Janssen, P., & Shadlen, M. N. (2005) · Nature Neuroscience · doi:10.1038/nn1386 · Cited by 601
Self-citationResponses of neurons in macaque MT to stochastic motion signals
Britten, K. H., Shadlen, M. N., Newsome, W. T., & Movshon, J. A. (1993) · Visual Neuroscience · doi:10.1017/s0952523800010269 · Cited by 594
Self-citationDecision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
The Cost of Accumulating Evidence in Perceptual Decision Making
Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., & Pouget, A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4010-11.2012 · Cited by 577
Self-citationOptimal representation of sensory information by neural populations
Jazayeri, M., & Movshon, J. A. (2006) · Nature Neuroscience · doi:10.1038/nn1691 · Cited by 545
Huk, A. C., & Shadlen, M. N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4684-04.2005 · Cited by 538
Self-citationDecision Processes in Visual Perception
(1979) · Elsevier eBooks · doi:10.1016/c2013-0-11654-6 · Cited by 513
Kiani, R., Hanks, T. D., & Shadlen, M. N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4761-07.2008 · Cited by 500
Self-citationA Sequential Theory of Psychological Discrimination
Link, S. W., & Heath, R. A. (1975) · Psychometrika · doi:10.1007/bf02291481 · Cited by 492
Elapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task
Hanks, T. D., Mazurek, M. E., Kiani, R., Hopp, E., & Shadlen, M. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5613-10.2011 · Cited by 378
Self-citationEfficient computation and cue integration with noisy population codes
Denève, S., Latham, P. E., & Pouget, A. (2001) · Nature Neuroscience · doi:10.1038/90541 · Cited by 351
The Wave Theory of Difference and Similarity
Link, S. W. (2020) · Routledge eBooks · doi:10.1201/9780429054709 · Cited by 351
Cisek, P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.5605-05.2006 · Cited by 344
Neurally constrained modeling of perceptual decision making.
Purcell, B. A., Heitz, R. P., Cohen, J. Y., Schall, J. D., Logan, G. D., & Palmeri, T. J. (2010) · Psychological Review · doi:10.1037/a0020311 · Cited by 342
Probabilistic Interpretation of Population Codes
Zemel, R. S., Dayan, P., & Pouget, A. (1998) · Neural Computation · doi:10.1162/089976698300017818 · Cited by 333
The calibration and resolution of confidence in perceptual judgments
Baranski, J. V., & Petrusic, W. M. (1994) · Perception & Psychophysics · doi:10.3758/bf03205299 · Cited by 308
Probabilistic Interpretation of Population Codes
Zemel, R. S., Dayan, P., & Pouget, A. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/4924.003.0011 · Cited by 308
The construction of confidence in a perceptual decision
Zylberberg, A., Barttfeld, P., & Sigman, M. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00079 · Cited by 297
Dynamics of neuronal responses in macaque MT and VIP during motion detection
Cook, E. P., & Maunsell, J. H. R. (2002) · Nature Neuroscience · doi:10.1038/nn924 · Cited by 289
The response of neurons in areas V1 and MT of the alert rhesus monkey to moving random dot patterns
Snowden, R. J., Treue, S., & Andersen, R. A. (1992) · Experimental Brain Research · doi:10.1007/bf02259114 · Cited by 263
Modeling confidence and response time in recognition memory.
Ratcliff, R., & Starns, J. J. (2009) · Psychological Review · doi:10.1037/a0014086 · Cited by 261
Ratcliff, R., Hasegawa, Y. T., Hasegawa, R. P., Smith, P. L., & Segraves, M. A. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00393.2006 · Cited by 236
Microstimulation of visual cortex affects the speed of perceptual decisions
Ditterich, J., Mazurek, M. E., & Shadlen, M. N. (2003) · Nature Neuroscience · doi:10.1038/nn1094 · Cited by 234
Self-citationThe response variability of striate cortical neurons in the behaving monkey
Vogels, R., Spileers, W., & Orban, G. A. (1989) · Experimental Brain Research · doi:10.1007/bf00275002 · Cited by 234
The accumulator model of two-choice discrimination
Smith, P. L., & Vickers, D. (1988) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(88)90043-0 · Cited by 223
Accuracy, Information, and Response Time in a Saccadic Decision Task
Reddi, B. A. J., Asrress, K. N., & Carpenter, R. H. S. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00689.2002 · Cited by 217
Posterior Cingulate Cortex Mediates Outcome-Contingent Allocation of Behavior
Hayden, B. Y., Nair, A. C., McCoy, A. N., & Platt, M. L. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.012 · Cited by 200
The relation of the time of a judgment to its accuracy
Henmon, V. A. C. (1911) · Psychological Review · doi:10.1037/h0074579 · Cited by 190
Donkin, C., Brown, S. D., Heathcote, A., & Wagenmakers, E. (2010) · Psychonomic Bulletin & Review · doi:10.3758/s13423-010-0022-4 · Cited by 185
Effects of cortical microstimulation on confidence in a perceptual decision
Fetsch, C. R., Kiani, R., Newsome, W. T., & Shadlen, M. N. (2014) · Neuron · doi:10.1016/j.neuron.2014.07.011 · Cited by 185
Self-citationBogacz, R., Usher, M., Zhang, J., & McClelland, J. L. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2059 · Cited by 182
Juslin, P., & Olsson, H. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.344 · Cited by 177
Ratcliff, R., & Starns, J. J. (2013) · Psychological Review · doi:10.1037/a0033152 · Cited by 173
Probing the locus of confidence judgments: Experiments on the time to determine confidence.
Baranski, J. V., & Petrusic, W. M. (1998) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.24.3.929 · Cited by 163
Kiani, R., Cueva, C. J., Reppas, J. B., & Newsome, W. T. (2014) · Current Biology · doi:10.1016/j.cub.2014.05.049 · Cited by 160
Self-citationA stochastic model for individual choice behavior.
Audley, R. J. (1960) · Psychological Review · doi:10.1037/h0046438 · Cited by 143
Confidence and speed in the two-category judgment
Johnson, D. M. (1939) · University of Michigan Library Repository · Cited by 143
Vickers, D., & Packer, J. (1982) · Acta Psychologica · doi:10.1016/0001-6918(82)90006-3 · Cited by 139
Statement verification: A stochastic model of judgment and response.
Wallsten, T. S., & Gonzalez-Vallejo, C. C. (1994) · Psychological Review · doi:10.1037/0033-295x.101.3.490 · Cited by 127
Neuronal Correlates of Metacognition in Primate Frontal Cortex
Middlebrooks, P. G., & Sommer, M. A. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.028 · Cited by 124
Decision-Making, Errors, and Confidence in the Brain
Rolls, E. T., Fabian Grabenhorst, B., & Deco, G. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00571.2010 · Cited by 123
The time course of visual information accrual guiding eye movement decisions
Caspi, A., Beutter, B. R., & Eckstein, M. P. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0305329101 · Cited by 116
Short-term response variability of monkey striate neurons
Schiller, P. H., Finlay, B. L., & Volman, S. F. (1976) · Brain Research · doi:10.1016/0006-8993(76)90432-7 · Cited by 77
Relation between belief and performance in perceptual decision making
Drugowitsch, J., Moreno-Bote, R., & Pouget, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096511 · Cited by 72
Testing models of decision making using confidence ratings in classification.
Balakrishnan, J. D., & Ratcliff, R. (1996) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.22.3.615 · Cited by 63
Response Reversals in Recognition Memory.
Zandt, T. V., & Maldonado‐Molina, M. M. (2004) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.30.6.1147 · Cited by 62
Integration of Direction Cues Is Invariant to the Temporal Gap between Them
Kiani, R., Churchland, A. K., & Shadlen, M. N. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2094-13.2013 · Cited by 54
Self-citationLocal Computation of Decision-Relevant Net Sensory Evidence in Parietal Cortex
Bollimunta, A., & Ditterich, J. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr165 · Cited by 51
The setting and maintenance of criteria representing levels of confidence.
Treisman, M., & Faulkner, A. (1984) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.10.1.119 · Cited by 42
Ferrell, W. R. (1995) · Perception & Psychophysics · doi:10.3758/bf03206511 · Cited by 34
Dynamics of decision-making: from evidence accumulation to preference and belief
Usher, M., Tsetsos, K., Yu, E. C., & Lagnado, D. A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00758 · Cited by 34
Accumulator and Random-Walk Models of Psychophysical Discrimination: A Counter-Evaluation
Vickers, D., & Smith, P. L. (1985) · Perception · doi:10.1068/p140471 · Cited by 29
Some Relationships between Comparative Judgment, Confidence, and Decision-Time in Weight-Lifting
Pierrel, R., & Murray, C. S. (1963) · The American Journal of Psychology · doi:10.2307/1419996 · Cited by 22
Petrusic, W. M., & Cloutier, P. (1992) · Perception & Psychophysics · doi:10.3758/bf03211644 · Cited by 8
Flagged first, then by citations
Research works printed but not linked: 1
- Volkmann, 1934, The relation of time of judgment to certainty of judgment, Psychol. Bull., 31, 672
Cited by
Sorted by citations
Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions
Forstmann, B. U., Ratcliff, R., & Wagenmakers, E. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033645 · Cited by 665
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 584
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Decision Making and Sequential Sampling from Memory
Shadlen, M. N., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.036 · Cited by 441
Self-citationConfidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
Metadata
- Authors
- Kiani, R., Corthell, L., & Shadlen, M. N.
- Affiliations
- New York University (US)
- University of Alabama at Birmingham (US)
- Howard Hughes Medical Institute (US)
- Corresponding author
- Kiani, Roozbeh
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2014-12
- Volume
- 84
- Issue
- 6
- Pages
- 1329-1342
- ISSN
- 0896-6273 (ISSN-L)
- PMC
- PMC4271191
- OpenAlex
- W2101518352
- Cited by
- 470
- References
- 79
- Citations by year
- 2026: 38 · 2025: 42 · 2024: 42 · 2023: 45 · 2022: 45 · 2021: 47 · 2020: 45 · 2019: 37 · 2018: 39 · 2017: 37 · 2016: 38 · 2015: 13 · 2014: 1
- FWCI
- 15.19
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Howard Hughes Medical Institute
- University of Washington
- National Eye Institute (EY11378, R01EY011378, P30EY013079)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Keywords
- decision confidence, decision time, evidence accumulation, reaction time, motion direction discrimination, signal detection theory, error response, task difficulty, deliberation
- MeSH terms
- Choice Behavior, Eye Movements, Female, Humans, Motion Perception, Photic Stimulation, Reaction Time, Uncertainty, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
