Optimal multisensory decision-making in a reaction-time task
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Ratcliff, R. (1978) · Psychological Review · doi:10.1037/0033-295x.85.2.59 · Cited by 4,513 · cited 2×
“The model builds upon the structure of diffusion models (DMs), which have previously been shown to account nicely for the tradeoff between speed and accuracy of decisions (Ratcliff, 1978; Ratcliff and Smith, 2004; Palmer et al., 2005).”
Bayesian inference with probabilistic population codes
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006) · Nature Neuroscience · doi:10.1038/nn1790 · Cited by 1,457 · cited 2×
“…Neuroscience annual meeting 2012) estimates the sensitivity to the visual input from motion sensitive neurons and uses this estimate to perform near-optimal multisensory integration with generalized probabilistic population codes (Ma et al., 2006; Beck et al., 2008) using divisive normalization.”
Self-citationBayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
A retrieval theory of priming in memory.
Ratcliff, R., & McKoon, G. (1988) · Psychological Review · doi:10.1037//0033-295x.95.3.385 · Cited by 781
The effect of stimulus strength on the speed and accuracy of a perceptual decision
Palmer, J., Huk, A. C., & Shadlen, M. N. (2005) · Journal of Vision · doi:10.1167/5.5.1 · Cited by 691 · cited 4×
“The model builds upon the structure of diffusion models (DMs), which have previously been shown to account nicely for the tradeoff between speed and accuracy of decisions (Ratcliff, 1978; Ratcliff and Smith, 2004; Palmer et al., 2005).”
InfluentialDIVISION OF PSYCHOLOGY : STATISTICAL FACILITATION OF SIMPLE REACTION TIMES*
Raab, D. H. (1962) · Transactions of the New York Academy of Sciences · doi:10.1111/j.2164-0947.1962.tb01433.x · Cited by 668
Probabilistic population codes for Bayesian decision making
Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., Shadlen, M. N., Latham, P. E., & Pouget, A. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.021 · Cited by 645
Self-citationA role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Neural correlates of multisensory cue integration in macaque MSTd
Gu, Y., Angelaki, D. E., & DeAngelis, G. C. (2008) · Nature Neuroscience · doi:10.1038/nn.2191 · Cited by 554
Self-citation
Cited by
Confidence and certainty: Distinct probabilistic quantities for different goals
Pouget, A., Drugowitsch, J., & Kepecs, A. (2016) · Nature Neuroscience · doi:10.1038/nn.4240 · Cited by 528
Self-citationSuboptimality in perceptual decision making
Rahnev, D., & Denison, R. N. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000936 · Cited by 342
Optimal policy for value-based decision-making
Tajima, S., Drugowitsch, J., & Pouget, A. (2016) · Nature Communications · doi:10.1038/ncomms12400 · Cited by 206
Self-citationA flexible framework for simulating and fitting generalized drift-diffusion models
Shinn, M., Lam, N. H., & Murray, J. D. (2020) · eLife · doi:10.7554/elife.56938 · Cited by 133
Dynamic multisensory integration: somatosensory speed trumps visual accuracy during feedback control
Crevecoeur, F., Munoz, D. P., & Scott, S. H. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.0184-16.2016 · Cited by 114
Khalvati, K., Kiani, R., & Rao, R. P. N. (2021) · Nature Communications · doi:10.1038/s41467-021-25419-4 · Cited by 64
Cognition as a Window into Neuronal Population Space
Ruff, D. A., Ni, A. M., & Cohen, M. R. (2018) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-080317-061936 · Cited by 63
“On the other hand, numerous studies have shown that in certain situations, subjects do appear to behave optimally based on the available sensory information (Drugowitsch et al. 2014, Ernst & Banks 2002, Fetsch et al. 2011, Jacobs 1999, Knill 2007, Pitkow et al. 2015).”
BackgroundAuditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19306-7 · Cited by 57
Metadata
- Authors
- Drugowitsch, J., DeAngelis, G. C., Klier, E. M., Angelaki, D. E., & Pouget, A.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2014-06-14
- Volume
- 3
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W2152548506
- Cited by
- 137
- References
- 17
- FWCI
- 14.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.