Neural signals encoding shifts in beliefs
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Dopamine is implicated in a diverse range of cognitive functions including cognitive flexibility, task switching, signalling novel or unexpected stimuli as well as advance information. There is also longstanding line of thought that links dopamine with belief formation and, crucially, aberrant belief formation in psychosis. Integrating these strands of evidence would suggest that dopamine plays a central role in belief updating and more specifically in encoding of meaningful information content in observations. The precise nature of this relationship has remained unclear. To directly address this question we developed a paradigm that allowed us to decompose two distinct types of information content, information-theoretic surprise that reflects the unexpectedness of an observation, and epistemic value that induces shifts in beliefs or, more formally, Bayesian surprise. Using functional magnetic-resonance imaging in humans we show that dopamine-rich midbrain regions encode shifts in beliefs whereas surprise is encoded in prefrontal regions, including the pre-supplementary motor area and dorsal cingulate cortex. By linking putative dopaminergic activity to belief updating these data provide a link to false belief formation that characterises hyperdopaminergic states associated with idiopathic and drug induced psychosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483 · cited 1×
“This is in keepingwith the general idea of the brain as a predictive organ (Dayan et al., 1995; Rao and Ballard, 1999), and supports a distinction between the neuronal processing of meaningful information and simple surprise.”
BackgroundKapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · cited 4×
“It has long been proposed that dopamine plays an important role in belief formation and, crucially, in aberrant belief formation in psychosis (Corlett et al., 2009; Howes et al., 2009; Howes et al., 2011a, 2011b; Kapur, 2003; Roiser et al., 2013; Shaner, 1999).”
BackgroundResultInfluentialThe Dopamine Hypothesis of Schizophrenia: Version III--The Final Common Pathway
Howes, O. D., & Kapur, S. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp006 · Cited by 2,693 · cited 2×
“In particular, it is widely hypothesised that dysregulated dopaminergic function leads to increased salience being conferred on sensory stimuli, a step in a path leading to psychosis (Howes and Kapur, 2009) (though the precise mechanisms by which this might occur remain to be mapped out).”
BackgroundDopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · cited 2×
“It also resonates with observations showing dopamine neurons respond to both novel and unexpected stimuli (Bromberg-Martin et al., 2010; Bunzeck and Düzel, 2006; Horvitz, 2000; Iglesias et al., 2013) and reflect preferences for advance information (Bromberg-Martin and Hikosaka, 2009).”
BackgroundThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“Finally, we tested for monetary outcome and reward prediction error effects at outcome time, which are typically associated with activity in the dopaminergic midbrain and its targets such as the ventral striatum(O'Doherty et al., 2004; Schultz, 2012; Schultz et al., 1997).”
MethodSelf-citationDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour
Duncan, J. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.004 · Cited by 1,846 · cited 1×
“Thus, in keeping with prior work, we show that informationtheoretic surprise was encoded in regions typically associated with internal conflict and task difficulty, such as the pre-SMA and dorsal cingulate cortex (Duncan, 2010; Kool and Botvinick, 2013).”
ResultBayesian surprise attracts human attention
Itti, L., & Baldi, P. (2009) · Vision Research · doi:10.1016/j.visres.2008.09.007 · Cited by 1,224
Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. S. (1995) · Neural Computation · doi:10.1162/neco.1995.7.5.889 · Cited by 1,207
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Self-citationMesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · cited 2×
“In particular, it is widely hypothesised that dysregulated dopaminergic function leads to increased salience being conferred on sensory stimuli, a step in a path leading to psychosis (Howes and Kapur, 2009) (though the precise mechanisms by which this might occur remain to be mapped out).”
BackgroundTheory-based Bayesian models of inductive learning and reasoning
Tenenbaum, J. B., Griffiths, T. L., & Kemp, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.009 · Cited by 880 · cited 2×
“Adaptive behaviour mandates agents build models of their environment and use these to appropriately update their beliefs about the causes of sensory information, a process formalised within Bayesian brain theories (Dolan and Dayan, 2013; Friston et al., 2014b; Friston, 2010; Körding and Wolpert, 2004; Tenenbaum et al.…”
BackgroundOptimized EPI for fMRI studies of the orbitofrontal cortex
Deichmann, R., Gottfried, J. A., Hutton, C., & Turner, R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00073-9 · Cited by 821 · cited 1×
“We acquired a partial volume consisting of 42 3-mm slices in descending order (echo time: 0.065 ms, repetition time: 2.940ms) at an angle of 30° in the anterior–posterior axis to optimize sensitivity to prefrontal regions (Deichmann et al., 2003).”
MethodInfluentialThe short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · cited 2×
“, 1997), motivational salience (Berridge, 2007), exploration (DeYoung, 2013; Redgrave and Gurney, 2006) and the precision of action selection (Friston et al.”
BackgroundElevated Striatal Dopamine Function Linked to Prodromal Signs of Schizophrenia
Howes, O. D., Montgomery, A. J., Asselin, M.-C., Murray, R. M., Valli, I., Tabraham, P., Bramon-Bosch, E., Valmaggia, L., Johns, L., Broome, M., et al. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2008.514 · Cited by 744 · cited 2×
“It has long been proposed that dopamine plays an important role in belief formation and, crucially, in aberrant belief formation in psychosis (Corlett et al., 2009; Howes et al., 2009; Howes et al., 2011a, 2011b; Kapur, 2003; Roiser et al., 2013; Shaner, 1999).”
BackgroundActive inference and epistemic value
Friston, K., Rigoli, F., Ognibene, D., Mathys, C., Fitzgerald, T., & Pezzulo, G. (2015) · Cognitive Neuroscience · doi:10.1080/17588928.2015.1020053 · Cited by 731
Self-citationUpdating dopamine reward signals
Schultz, W. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.012 · Cited by 651
Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards
Bromberg-Martin, E. S., & Hikosaka, O. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.009 · Cited by 548
Computational psychiatry: the brain as a phantastic organ
Friston, K. J., Stephan, K. E., Montague, R., & Dolan, R. J. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70275-5 · Cited by 531
Self-citationAbsolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503
Barto, A., Mirolli, M., & Baldassarre, G. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00907 · Cited by 397 · cited 1×
“Published by Elsevier Inc a b s t r a c t a r t i c l e i n f o”
BackgroundThe neuromodulator of exploration: A unifying theory of the role of dopamine in personality
DeYoung, C. G. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00762 · Cited by 387
From drugs to deprivation: A Bayesian framework for understanding models of psychosis
Corlett, P. R., Frith, C. D., & Fletcher, P. C. (2009) · Psychopharmacology · doi:10.1007/s00213-009-1561-0 · Cited by 367 · cited 1×
“It has long been proposed that dopamine plays an important role in belief formation and, crucially, in aberrant belief formation in psychosis (Corlett et al., 2009; Howes et al., 2009; Howes et al., 2011a, 2011b; Kapur, 2003; Roiser et al., 2013; Shaner, 1999).”
BackgroundFrontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350
Dopamine Synthesis Capacity Before Onset of Psychosis: A Prospective [ 18 F]-DOPA PET Imaging Study
Howes, O. D., Bose, S. K., Turkheimer, F., Valli, I., Egerton, A., Valmaggia, L. R., Murray, R. M., & McGuire, P. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11010160 · Cited by 343
Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning
Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E. M., & Stephan, K. E. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.009 · Cited by 342
Howes, O., Bose, S., Turkheimer, F., Valli, I., Egerton, A., Stahl, D., Valmaggia, L., Allen, P., Murray, R., & McGuire, P. (2011) · Molecular Psychiatry · doi:10.1038/mp.2011.20 · Cited by 292
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289
Self-citationThe dopaminergic midbrain encodes the expected certainty about desired outcomes
Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu159 · Cited by 219
Self-citationFunctional imaging of the human dopaminergic midbrain
Düzel, E., Bunzeck, N., Guitart-Masip, M., Wittmann, B., Schott, B. H., & Tobler, P. N. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.02.005 · Cited by 216 · cited 1×
“Our findings also resonate with previous work showing that dopamine neurons encode reward uncertainty, displaying highest sensitivity for maximal uncertainty, i.e. a probability of 0.5 for receiving a reward (Fiorillo et al., 2003).”
ResultInfluentialNeural and Behavioral Correlates of Aberrant Salience in Individuals at Risk for Psychosis
Roiser, J. P., Howes, O. D., Chaddock, C. A., Joyce, E. M., & McGuire, P. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs147 · Cited by 205
Prediction error demarcates the transition from retrieval, to reconsolidation, to new learning
Sevenster, D., Beckers, T., & Kindt, M. (2014) · Learning & Memory · doi:10.1101/lm.035493.114 · Cited by 161 · cited 2×
“…in the context of memory reconsolidation, such that prediction error or surprisal has been shown to control the balance between memory reconsolidation and newmemory formation (Sevenster et al., 2014), highlighting the important interplay between memory reconsolidation and dopamine function.”
BackgroundPlanning to be surprised: optimal bayesian exploration in dynamic environments
Sun, Y., Gomez, F., & Schmidhuber, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_5 · Cited by 134 · cited 1×
“This quantity has previously been used successfully to model visual search behaviour (Itti and Baldi, 2009) and exploration (Sun et al., 2011).”
MethodDissociable reward and timing signals in human midbrain and ventral striatum
Klein-Flügge, M. C., Hunt, L. T., Bach, D. R., Dolan, R. J., & Behrens, T. E. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.024 · Cited by 75
Self-citation
Cited by
Computational mechanisms of curiosity and goal-directed exploration
Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H., Kronbichler, M., & Friston, K. J. (2019) · eLife · doi:10.7554/elife.41703 · Cited by 254
Self-citationFouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200
“A dependence on internal beliefs has also been observed for more conventional value-based error signals (Lak et al., 2017; Schwartenbeck et al., 2016).”
BackgroundPredictive processing, source monitoring, and psychosis
Griffin, J. D., & Fletcher, P. C. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045145 · Cited by 133
Interoception as modeling, allostasis as control
Sennesh, E., Theriault, J., Brooks, D., van de Meent, J.-W., Barrett, L. F., & Quigley, K. S. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108242 · Cited by 107
Metadata
- Authors
- Schwartenbeck, P., FitzGerald, T. H. B., & Dolan, R.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2016-01
- Volume
- 125
- Pages
- 578-586
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2211680833
- Cited by
- 82
- References
- 36
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.