Making Decisions with Unknown Sensory Reliability
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
To make fast and accurate behavioral choices, we need to integrate noisy sensory input, take prior knowledge into account, and adjust our decision criteria. It was shown previously that in two-alternative-forced-choice tasks, optimal decision making can be formalized in the framework of a sequential probability ratio test and is then equivalent to a diffusion model. However, this analogy hides a "chicken and egg" problem: to know how quickly we should integrate the sensory input and set the optimal decision threshold, the reliability of the sensory observations must be known in advance. Most of the time, we cannot know this reliability without first observing the decision outcome. We consider here a Bayesian decision model that simultaneously infers the probability of two different choices and at the same time estimates the reliability of the sensory information on which this choice is based. We show that this can be achieved within a single trial, based on the noisy responses of sensory spiking neurons. The resulting model is a non-linear diffusion to bound where the weight of the sensory inputs and the decision threshold are both dynamically changing over time. In difficult decision trials, early sensory inputs have a stronger impact on the decision, and the threshold collapses such that choices are made faster but with low accuracy. The reverse is true in easy trials: the sensory weight and the threshold increase over time, leading to slower decisions but at much higher accuracy. In contrast to standard diffusion models, adaptive sensory weights construct an accurate representation for the probability of each choice. This information can then be combined appropriately with other unreliable cues, such as priors. We show that this model can account for recent findings in a motion discrimination task, and can be implemented in a neural architecture using fast Hebbian learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 10×
“Therefore, q dq and q dq describe the likelihood of a sensory spike given choice A and choice B, respectively.”
BackgroundMethodInfluentialBienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 2×
“Indeed, recent experimental and theoretical results suggest that humans use Bayes optimal strategies in a wide variety of tasks (Doya 2002; Knill and Pouget 2004; Sugrue, Corrado et al. 2004; Daw, O'Doherty et al. 2006; Wolpert 2007).”
BackgroundShadlen, M. N., & Newsome, W. T. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03870.1998 · Cited by 2,178 · cited 2×
“For example, subjects could be asked to decide between two directions of motion, while varying the level of noise in the motion display (Shadlen and Newsome, 1998), or to do a categorization task, while varying the distance between the test stimulus and the category boundary (Ratcliff et al.”
BackgroundLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 2×
“On the other hand, a major advantage of the Bayesian approach is its adaptability and generalizability to situations where simpler decision models would be suboptimal or not work (Doya, 2002; Yu and Dayan, 2005; Behrens et al., 2007; Walton et al., 2007; Whiteley and Sahani, 2008).”
BackgroundProbabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
A Recurrent Network Mechanism of Time Integration in Perceptual Decisions
Wong, K.-F., & Wang, X.-J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3733-05.2006 · Cited by 1,029 · cited 1×
“An example of biologically plausible mechanisms for decision making involves recurrent network models with two competing populations of neurons receiving evidence for each direction of motion (Wang, 2002, 2008; Wong and Wang, 2006).”
BackgroundRepresentation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 2×
“Other solutions have also been proposed involving the use of elapsed time rather than an explicit representation of the choice probability (Kiani and Shadlen 2009; Hanks, Mazurek et al. 2011).”
BackgroundMetalearning and neuromodulation
Doya, K. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00044-8 · Cited by 704
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · cited 4×
“An example of biologically plausible mechanisms for decision making involves recurrent network models with two competing populations of neurons receiving evidence for each direction of motion (Wang 2002; Wong and Wang 2006; Wang 2008).”
BackgroundInfluentialProbabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
A role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Decision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
The Cost of Accumulating Evidence in Perceptual Decision Making
Drugowitsch, J., Moreno-Bote, R., Churchland, A. K., Shadlen, M. N., & Pouget, A. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4010-11.2012 · Cited by 577 · cited 4×
“In a more recent experiment including zero coherence trials, evidence for an urgency signal was also found in human subjects (Drugowitsch et al, 2012) albeit its exact influence on RT distributions is not shown.”
BackgroundMethodInfluentialKiani, R., Hanks, T. D., & Shadlen, M. N. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4761-07.2008 · Cited by 500 · cited 5×
“Other models of decision making have focused on proposing a biologically plausible neural basis for decision mechanisms (Gold and Shadlen, 2002; Kiani et al., 2008; Wang, 2008; Churchland et al., 2011).”
BackgroundInfluentialElapsed Decision Time Affects the Weighting of Prior Probability in a Perceptual Decision Task
Hanks, T. D., Mazurek, M. E., Kiani, R., Hopp, E., & Shadlen, M. N. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5613-10.2011 · Cited by 378 · cited 5×
“Other solutions have also been proposed involving the use of elapsed time rather than an explicit representation of the choice probability (Kiani and Shadlen, 2009; Hanks et al., 2011).”
BackgroundResultInfluentialVariance as a signature of neural computations during decision making
Churchland, A. K., Kiani, R., Chaudhuri, R., Wang, X.-J., Pouget, A., & Shadlen, M. N. (2011) · Neuron · doi:10.1016/j.neuron.2010.12.037 · Cited by 350
Probabilistic Interpretation of Population Codes
Zemel, R. S., Dayan, P., & Pouget, A. (1998) · Neural Computation · doi:10.1162/089976698300017818 · Cited by 333
Bayesian Spiking Neurons I: Inference
Deneve, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.91 · Cited by 313 · cited 2×
“However, in general, Bayesian methods lead to non-linear, non stationary models of integration and decision making (Behrens, Woolrich et al. 2007; Deneve 2008; Deneve 2008; Mongillo and Deneve 2008).”
MethodBayesian decision theory and psychophysics
Yuille, A. L., & Bülthoff, H. H. (1996) · Perception as Bayesian Inference · doi:10.1017/cbo9780511984037.006 · Cited by 250 · cited 2×
“Variants of diffusion models have been shown to successfully reproduce human and animal behaviour in 2AFC tasks (Ferguson 1967; Newsome, Britten et al. 1989; Yuille and Bülthoff 1996; Mazurek, Roitman et al. 2003; Ratcliff, Cherian et al. 2003; Palmer, McKinley et al. 2005; Ratcliff and McKoon 2008).”
BackgroundProbabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
Wong, K.-F. (2007) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.006.2007 · Cited by 204
Bayesian spiking neurons II: learning
Deneve, S. (2008) · Neural Computation · doi:10.1162/neco.2008.20.1.118 · Cited by 71 · cited 2×
“However, in general, Bayesian methods lead to non-linear, non stationary models of integration and decision making (Behrens, Woolrich et al. 2007; Deneve 2008; Deneve 2008; Mongillo and Deneve 2008).”
Method
Cited by
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630
“cases where it is possible to set different boundaries for each difficulty level, human decision makers seem fairly efficient at setting those many boundaries in an optimal manner [74,75].”
BackgroundConsensus Paper: The Role of the Cerebellum in Perceptual Processes
Baumann, O., Borra, R. J., Bower, J. M., Cullen, K. E., Habas, C., Ivry, R. B., Leggio, M., Mattingley, J. B., Molinari, M., Moulton, E. A., et al. (2015) · The Cerebellum · doi:10.1007/s12311-014-0627-7 · Cited by 462
“There is growing evidence that neurons use Bayesian Monte-Carlo algorithms of this kind to implement decisions and actions [75–83].”
BackgroundPerceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 372
Striatal activation reflects urgency in perceptual decision making
van Maanen, L., Fontanesi, L., Hawkins, G. E., & Forstmann, B. U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.045 · Cited by 36
“The importance of this notion of urgency has only recently been acknowledged in theoretical models of decision making (Cisek et al., 2009; Deneve, 2012; Ditterich, 2006a, 2006b; Drugowitsch et al., 2012; Frazier and Yu, 2008; Hanks et al., 2014; Ratcliff and Frank, 2012; Thura et al., 2012).”
Metadata
- Authors
- Deneve, S.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2012
- Volume
- 6
- Pages
- 75-75
- ISSN
- 1662-453X (ISSN-L)
- 1662-4548
- OpenAlex
- W2097233367
- Cited by
- 86
- References
- 27
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.