Making Decisions with Unknown Sensory Reliability
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
To make fast and accurate behavioral choices, we need to integrate noisy sensory input, take prior knowledge into account, and adjust our decision criteria. It was shown previously that in two-alternative-forced-choice tasks, optimal decision making can be formalized in the framework of a sequential probability ratio test and is then equivalent to a diffusion model. However, this analogy hides a "chicken and egg" problem: to know how quickly we should integrate the sensory input and set the optimal decision threshold, the reliability of the sensory observations must be known in advance. Most of the time, we cannot know this reliability without first observing the decision outcome. We consider here a Bayesian decision model that simultaneously infers the probability of two different choices and at the same time estimates the reliability of the sensory information on which this choice is based. We show that this can be achieved within a single trial, based on the noisy responses of sensory spiking neurons. The resulting model is a non-linear diffusion to bound where the weight of the sensory inputs and the decision threshold are both dynamically changing over time. In difficult decision trials, early sensory inputs have a stronger impact on the decision, and the threshold collapses such that choices are made faster but with low accuracy. The reverse is true in easy trials: the sensory weight and the threshold increase over time, leading to slower decisions but at much higher accuracy. In contrast to standard diffusion models, adaptive sensory weights construct an accurate representation for the probability of each choice. This information can then be combined appropriately with other unreliable cues, such as priors. We show that this model can account for recent findings in a motion discrimination task, and can be implemented in a neural architecture using fast Hebbian learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
Ratcliff, R., & McKoon, G. (2008) · Neural Computation · doi:10.1162/neco.2008.12-06-420 · Cited by 3,059 · cited 10×
“Therefore, q dq and q dq describe the likelihood of a sensory spike given choice A and choice B, respectively.”
BackgroundMethodInfluentialBienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896
The Bayesian brain: The role of uncertainty in neural coding and computation
Knill, D. C., & Pouget, A. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.10.007 · Cited by 2,588 · cited 2×
“Indeed, recent experimental and theoretical results suggest that humans use Bayes optimal strategies in a wide variety of tasks (Doya 2002; Knill and Pouget 2004; Sugrue, Corrado et al. 2004; Daw, O'Doherty et al. 2006; Wolpert 2007).”
BackgroundShadlen, M. N., & Newsome, W. T. (1998) · The Journal of Neuroscience · doi:10.1523/jneurosci.18-10-03870.1998 · Cited by 2,178 · cited 2×
“For example, subjects could be asked to decide between two directions of motion, while varying the level of noise in the motion display (Shadlen and Newsome, 1998), or to do a categorization task, while varying the distance between the test stimulus and the category boundary (Ratcliff et al.”
BackgroundLearning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 2×
“On the other hand, a major advantage of the Bayesian approach is its adaptability and generalizability to situations where simpler decision models would be suboptimal or not work (Doya, 2002; Yu and Dayan, 2005; Behrens et al., 2007; Walton et al., 2007; Whiteley and Sahani, 2008).”
BackgroundProbabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Matching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
A Recurrent Network Mechanism of Time Integration in Perceptual Decisions
Wong, K.-F., & Wang, X.-J. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3733-05.2006 · Cited by 1,029 · cited 1×
“An example of biologically plausible mechanisms for decision making involves recurrent network models with two competing populations of neurons receiving evidence for each direction of motion (Wang, 2002, 2008; Wong and Wang, 2006).”
Background
Cited by
Diffusion decision model: Current issues and history
Ratcliff, R., Smith, P. L., Brown, S. D., & McKoon, G. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.01.007 · Cited by 1,630
“cases where it is possible to set different boundaries for each difficulty level, human decision makers seem fairly efficient at setting those many boundaries in an optimal manner [74,75].”
BackgroundConsensus Paper: The Role of the Cerebellum in Perceptual Processes
Baumann, O., Borra, R. J., Bower, J. M., Cullen, K. E., Habas, C., Ivry, R. B., Leggio, M., Mattingley, J. B., Molinari, M., Moulton, E. A., et al. (2015) · The Cerebellum · doi:10.1007/s12311-014-0627-7 · Cited by 462
“There is growing evidence that neurons use Bayesian Monte-Carlo algorithms of this kind to implement decisions and actions [75–83].”
BackgroundPerceptual Decision Making in Rodents, Monkeys, and Humans
Hanks, T. D., & Summerfield, C. (2017) · Neuron · doi:10.1016/j.neuron.2016.12.003 · Cited by 372
Striatal activation reflects urgency in perceptual decision making
van Maanen, L., Fontanesi, L., Hawkins, G. E., & Forstmann, B. U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.045 · Cited by 36
“The importance of this notion of urgency has only recently been acknowledged in theoretical models of decision making (Cisek et al., 2009; Deneve, 2012; Ditterich, 2006a, 2006b; Drugowitsch et al., 2012; Frazier and Yu, 2008; Hanks et al., 2014; Ratcliff and Frank, 2012; Thura et al., 2012).”
Metadata
- Authors
- Deneve, S.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2012
- Volume
- 6
- Pages
- 75-75
- ISSN
- 1662-453X (ISSN-L)
- 1662-4548
- OpenAlex
- W2097233367
- Cited by
- 86
- References
- 24
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making Decisions with Unknown Sensory Reliability. https://app.cochat.ai/papers/10.3389/fnins.2012.00075
- The paper
- Deneve, S. (2012). Making Decisions with Unknown Sensory Reliability. Frontiers in Neuroscience. https://doi.org/10.3389/fnins.2012.00075
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.