Learning Priors for Bayesian Computations in the Nervous System
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Our nervous system continuously combines new information from our senses with information it has acquired throughout life. Numerous studies have found that human subjects manage this by integrating their observations with their previous experience (priors) in a way that is close to the statistical optimum. However, little is known about the way the nervous system acquires or learns priors. Here we present results from experiments where the underlying distribution of target locations in an estimation task was switched, manipulating the prior subjects should use. Our experimental design allowed us to measure a subject's evolving prior while they learned. We confirm that through extensive practice subjects learn the correct prior for the task. We found that subjects can rapidly learn the mean of a new prior while the variance is learned more slowly and with a variable learning rate. In addition, we found that a Bayesian inference model could predict the time course of the observed learning while offering an intuitive explanation for the findings. The evidence suggests the nervous system continuously updates its priors to enable efficient behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 2×
“Further evidence proposes that neuromodulators may also encode uncertainty [15,21].”
BackgroundPerceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia
Fletcher, P. C., & Frith, C. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2536 · Cited by 1,462
Motion illusions as optimal percepts
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002) · Nature Neuroscience · doi:10.1038/nn0602-858 · Cited by 1,076
Causal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · cited 2×
“In particular, the Bayesian use of prior information has been observed in tasks such as the perception of visual movement [1,2], cue combination [3,4], visuomotor integration [5,6] movement planning [7] and motor adaptation [8].”
BackgroundMethodMatching Behavior and the Representation of Value in the Parietal Cortex
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2004) · Science · doi:10.1126/science.1094765 · Cited by 1,030
Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex
Kiani, R., & Shadlen, M. N. (2009) · Science · doi:10.1126/science.1169405 · Cited by 1,027 · cited 2×
“Similarly, recent evidence suggesting specific cortical regions modulate learning rates [13] based on representations of uncertainty [14,15] implies this type of learning may be the norm.”
BackgroundLearning of action through adaptive combination of motor primitives
Thoroughman, K. A., & Shadmehr, R. (2000) · Nature · doi:10.1038/35037588 · Cited by 945
Theory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880 · cited 1×
“It is plausible that after the subjects had been exposed to the two means repeatedly they inferred the causal structure of the task [4,7,16,17].”
BackgroundChoice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Decision-making with multiple alternatives
Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008) · Nature Neuroscience · doi:10.1038/nn.2123 · Cited by 671
Relevance of Error: What Drives Motor Adaptation?
Wei, K., & Körding, K. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90545.2008 · Cited by 422 · cited 1×
“It is plausible that after the subjects had been exposed to the two means repeatedly they inferred the causal structure of the task [4,7,16,17].”
BackgroundThe statistical determinants of adaptation rate in human reaching
Burge, J., Ernst, M. O., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.4.20 · Cited by 400 · cited 1×
“These representations of uncertainty may allow the nervous system to learn relatively rapidly at the outset of the experiment, when subjects are generally uncertain of the task [24].”
BackgroundExperience can change the 'light-from-above' prior
Adams, W. J., Graf, E. W., & Ernst, M. O. (2004) · Nature Neuroscience · doi:10.1038/nn1312 · Cited by 377
Estimating the sources of motor errors for adaptation and generalization
Berniker, M., & Kording, K. (2008) · Nature Neuroscience · doi:10.1038/nn.2229 · Cited by 316 · cited 1×
“In particular, the Bayesian use of prior information has been observed in tasks such as the perception of visual movement [1,2], cue combination [3,4], visuomotor integration [5,6] movement planning [7] and motor adaptation [8].”
MethodSelf-citationExplicit neural signals reflecting reward uncertainty
Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., & Bossaerts, P. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.0152 · Cited by 239 · cited 2×
“Other studies have found that uncertainty (variance) may be represented in the Basal ganglia and area LIP (e.g., [21,22]).”
BackgroundDima, D., Roiser, J. P., Dietrich, D. E., Bonnemann, C., Lanfermann, H., Emrich, H. M., & Dillo, W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.033 · Cited by 192 · cited 1×
“Some recent models of neurological diseases such as schizophrenia are now applying the quantitative strategies of Bayesian statistics [28,29].”
Research works printed but not linked: 12
- AA Stocker, 2006, Noise characteristics and prior expectations in human visual speed perception., Nat Neurosci, 9, 578, 10.1038/nn1669 · DOI · Paper page
- RA Jacobs, 1999, Optimal integration of texture and motion cues to depth., Vision Res, 39, 3621, 10.1016/S0042-6989(99)00088-7 · DOI · Paper page
- KP Kording, 2004, Bayesian integration in sensorimotor learning., Nature, 427, 244, 10.1038/nature02169 · DOI · Paper page
- M Miyazaki, 2005, Testing Bayesian models of human coincidence timing., J Neurophysiol, 94, 395, 10.1152/jn.01168.2004 · DOI · Paper page
- TE Hudson, 2007, Movement planning with probabilistic target information., J Neurophysiol, 98, 3034, 10.1152/jn.00858.2007 · DOI · Paper page
- H Tassinari, 2006, Combining priors and noisy visual cues in a rapid pointing task., J Neurosci, 26, 10154, 10.1523/JNEUROSCI.2779-06.2006 · DOI · Paper page
- M Kawato, 1987, A hierarchical neural-network model for control and learning of voluntary movement., Biol Cybern, 57, 169, 10.1007/BF00364149 · DOI · Paper page
- H Chen, 2006, Effects of human cerebellar thalamus disruption on adaptive control of reaching., Cereb Cortex, 16, 1462, 10.1093/cercor/bhj087 · DOI · Paper page
- R Nezafat, 2001, Long-term adaptation to dynamics of reaching movements: a PET study., Exp Brain Res, 140, 66, 10.1007/s002210100787 · DOI
- RF Lewis, 2001, Cerebellar lesions impair context-dependent adaptation of reaching movements in primates., Exp Brain Res, 138, 263, 10.1007/s002210100719 · doi:10.1007/s002210100719
- M DeWeese, 1998, Asymmetric Dynamics in Optimal Variance Adaptation., Neural Computation, 10, 1179, 10.1162/089976698300017403 · DOI
- AL Fairhall, 2001, Efficiency and ambiguity in an adaptive neural code., Nature, 412, 787, 10.1038/35090500 · DOI · Paper page
Cited by
A Bayesian perspective on magnitude estimation
Petzschner, F. H., Glasauer, S., & Stephan, K. E. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.03.002 · Cited by 327
Optimal Encoding of Interval Timing in Expert Percussionists
Cicchini, G. M., Arrighi, R., Cecchetti, L., Giusti, M., & Burr, D. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3411-11.2012 · Cited by 261
Learning what to expect (in visual perception)
Seriès, P., & Seitz, A. R. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00668 · Cited by 194
Petzschner, F. H., Weber, L. A. E., Gard, T., & Stephan, K. E. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.012 · Cited by 181
Arousal-related adjustments of perceptual biases optimize perception in dynamic environments
Krishnamurthy, K., Nassar, M. R., Sarode, S., & Gold, J. I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0107 · Cited by 117
Metadata
- Authors
- Berniker, M., Voss, M., & Kording, K.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-09-10
- Volume
- 5
- Issue
- 9
- Pages
- e12686
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2009954135
- Cited by
- 152
- References
- 17
- FWCI
- 3.98
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.