Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 301–400 of 1,013
Alexander, W. H., & Brown, J. W. (2015) · Neural Computation · doi:10.1162/neco_a_00779 · Cited by 116
Jakobs, O., Wang, L. E., Dafotakis, M., Grefkes, C., Zilles, K., & Eickhoff, S. B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.065 · Cited by 114
The interpretation of computational model parameters depends on the context
Eckstein, M. K., Master, S. L., Xia, L., Dahl, R. E., Wilbrecht, L., & Collins, A. G. (2022) · eLife · doi:10.7554/elife.75474 · Cited by 112
Silvetti, M., Alexander, W., Verguts, T., & Brown, J. W. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.003 · Cited by 127
Parietal Cortex and Insula Relate to Evidence Seeking Relevant to Reward-Related Decisions
Furl, N., & Averbeck, B. B. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4236-11.2011 · Cited by 113
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112
“The consequences of allowing model parameters to vary slowly have been considered in compelling ways elsewhere (Behrens et al., 2007; Mathys et al., 2011; Diaconescu et al., 2014), and it would be interesting to include this within our scheme (by treating parameters as slowly fluctuating states).”
BackgroundWhat Decision Neuroscience Teaches Us About Financial Decision Making
Bossaerts, P. L. (2008) · Annual Review of Financial Economics · doi:10.1146/annurev-financial-102708-141514 · Cited by 116
The rat-a-gorical imperative: Moral intuition and the limits of affective learning
Greene, J. D. (2017) · Cognition · doi:10.1016/j.cognition.2017.03.004 · Cited by 137
Transdiagnostic Phenotyping Reveals a Host of Metacognitive Deficits Implicated in Compulsivity
Seow, T. X. F., & Gillan, C. M. (2020) · Scientific Reports · doi:10.1038/s41598-020-59646-4 · Cited by 84
Morriss, J., Zuj, D. V., & Mertens, G. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.05.011 · Cited by 112
A Diversity of Intrinsic Timescales Underlie Neural Computations
Cavanagh, S. E., Hunt, L. T., & Kennerley, S. W. (2020) · Frontiers in Neural Circuits · doi:10.3389/fncir.2020.615626 · Cited by 135
The geometry of domain-general performance monitoring in the human medial frontal cortex
Fu, Z., Beam, D., Chung, J. M., Reed, C. M., Mamelak, A. N., Adolphs, R., & Rutishauser, U. (2022) · Science · doi:10.1126/science.abm9922 · Cited by 109
Choice variability and suboptimality in uncertain environments
Wyart, V., & Koechlin, É. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.07.003 · Cited by 121
Neural pattern change during encoding of a narrative predicts retrospective duration estimates
Lositsky, O., Chen, J., Toker, D., Honey, C. J., Shvartsman, M., Poppenk, J. L., Hasson, U., & Norman, K. A. (2016) · eLife · doi:10.7554/elife.16070 · Cited by 109
A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
Wilson, R. C., Nassar, M. R., & Gold, J. I. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003150 · Cited by 107
Eckstein, M. K., Wilbrecht, L., & Collins, A. G. E. (2021) · PsyArXiv (OSF Preprints) · doi:10.1016/j.cobeha.2021.06.004 · Cited by 150
Cortical and subcortical contributions to context-control learning
Chiu, Y., & Egner, T. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.01.019 · Cited by 116
Adolescent risk-taking in the context of exploration and social influence
Ciranka, S., & van den Bos, W. (2021) · Developmental Review · doi:10.1016/j.dr.2021.100979 · Cited by 106
Adaptive coding of action values in the human rostral cingulate zone
Jocham, G., Neumann, J., Klein, T. A., Danielmeier, C., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0349-09.2009 · Cited by 106
The perception of probability.
Gallistel, C. R., Krishan, M., Liu, Y., Miller, R., & Latham, P. E. (2014) · Psychological Review · doi:10.1037/a0035232 · Cited by 105
Jakobs, O., Langner, R., Caspers, S., Roski, C., Cieslik, E. C., Zilles, K., Laird, A. R., Fox, P. T., & Eickhoff, S. B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.037 · Cited by 106
Purcell, B. A., & Kiani, R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1524685113 · Cited by 106
The Known Unknowns: Neural Representation of Second-Order Uncertainty, and Ambiguity
Bach, D. R., Hulme, O., Penny, W. D., & Dolan, R. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1452-10.2011 · Cited by 105
Neural Basis of Strategic Decision Making
Lee, D., & Seo, H. (2016) · Trends in Neurosciences · doi:10.1016/j.tins.2015.11.002 · Cited by 105
Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex
Ebitz, R. B., Albarran, E., & Moore, T. (2018) · Neuron · doi:10.1016/j.neuron.2017.12.007 · Cited by 104
The neural substrate of prior information in perceptual decision making: a model-based analysis
Forstmann, B. U., Brown, S., Dutilh, G., Neumann, J., & Wagenmakers, E.-J. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00040 · Cited by 122
Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data
Gläscher, J. P., & O'Doherty, J. P. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.57 · Cited by 104
Subjective confidence reflects representation of Bayesian probability in cortex
Geurts, L. S., Cooke, J. R. H., van Bergen, R. S., & Jehee, J. F. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01247-w · Cited by 104
Bayesian modeling of flexible cognitive control
Jiang, J., Heller, K., & Egner, T. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.06.001 · Cited by 123
Embodied Medicine: Mens Sana in Corpore Virtuale Sano
Riva, G., Serino, S., Di Lernia, D., Pavone, E. F., & Dakanalis, A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00120 · Cited by 104
Reward prediction errors create event boundaries in memory
Rouhani, N., Norman, K. A., Niv, Y., & Bornstein, A. M. (2020) · Cognition · doi:10.1016/j.cognition.2020.104269 · Cited by 128
Advances in modeling learning and decision-making in neuroscience
Collins, A. G. E., & Shenhav, A. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01126-y · Cited by 125
Children on the autism spectrum update their behaviour in response to a volatile environment
Manning, C., Kilner, J., Neil, L., Karaminis, T., & Pellicano, E. (2017) · Developmental Science · doi:10.1111/desc.12435 · Cited by 103
“fluctuating over blocks of trials), people weight their recent experience more strongly than their distant experience (Behrens et al., 2007). The relative weighting given to recent and distant trials is reflected in a person’s learning rate (Dayan, Kakade & Montague, 2000). In a stable environment, neurotypical adults…”
BackgroundMethodInfluentialNeural Computations Mediating One-Shot Learning in the Human Brain
Lee, S. W., O’Doherty, J. P., & Shimojo, S. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002137 · Cited by 103
Reiter, A. M. F., Heinze, H., Schlagenhauf, F., & Deserno, L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.95 · Cited by 109
Contextual inference in learning and memory
Heald, J. B., Lengyel, M., & Wolpert, D. M. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.10.004 · Cited by 95
Stress modulates reinforcement learning in younger and older adults.
Lighthall, N. R., Gorlick, M. A., Schoeke, A., Frank, M. J., & Mather, M. (2013) · Psychology and Aging · doi:10.1037/a0029823 · Cited by 103
Dopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia
Nour, M. M., Dahoun, T., Schwartenbeck, P., Adams, R. A., FitzGerald, T. H. B., Coello, C., Wall, M. B., Dolan, R. J., & Howes, O. D. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1809298115 · Cited by 101
Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty
Farashahi, S., Donahue, C. H., Khorsand, P., Seo, H., Lee, D., & Soltani, A. (2017) · Neuron · doi:10.1016/j.neuron.2017.03.044 · Cited by 101
Neural computations of threat in the aftermath of combat trauma
Homan, P., Levy, I., Feltham, E., Gordon, C., Hu, J., Li, J., Pietrzak, R. H., Southwick, S., Krystal, J. H., Harpaz-Rotem, I., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-018-0315-x · Cited by 101
Statistical context dictates the relationship between feedback-related EEG signals and learning
Nassar, M. R., Bruckner, R., & Frank, M. J. (2019) · eLife · doi:10.7554/elife.46975 · Cited by 110
Cisler, J. M., Steele, J. S., Lenow, J. K., Smitherman, S., Everett, B., Messias, E., & Kilts, C. D. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2013.09.013 · Cited by 100
“Indeed, the dACC is also implicated in tracking prediction errors and volatility of expected outcomes (Behrens et al., 2007; Rushworth and Behrens, 2008); thus, the ‘conflict’ during fear extinction to traumatic memories may involve changes in the discrepancy between actual and expected threat outcomes.”
BackgroundNeural Systems Underlying Decisions about Affective Odors
Rolls, E. T., Grabenhorst, F., & Parris, B. A. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21231 · Cited by 100
Adaptive properties of differential learning rates for positive and negative outcomes
Cazé, R. D., & van der Meer, M. A. A. (2013) · Biological Cybernetics · doi:10.1007/s00422-013-0571-5 · Cited by 120
Cortical coupling reflects Bayesian belief updating in the deployment of spatial attention
Vossel, S., Mathys, C., Stephan, K. E., & Friston, K. J. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1382-15.2015 · Cited by 99
“…inference process can be plausibly represented by hierarchical Bayesian models that provide a principled/normative description of how beliefs are updated optimally in the presence of new data (Behrens et al., 2007; Nassar et al., 2010; Payzan-LeNestour and Bossaerts, 2011; Iglesias et al., 2013).”
BackgroundCisler, J. M., Elton, A., Kennedy, A. P., Young, J., Smitherman, S., Andrew James, G., & Kilts, C. D. (2013) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2013.02.007 · Cited by 99
“Other regions implicate the anterior insula as critical in mediating uncertainty processing and tracking variance in risk (Behrens et al., 2007; Bossaerts, 2010; Preuschoff et al., 2008; Rushworth and Behrens, 2008).”
BackgroundDay, J. J., Jones, J. L., & Carelli, R. M. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07531.x · Cited by 99
State anxiety biases estimates of uncertainty and impairs reward learning in volatile environments
Hein, T. P., de Fockert, J., & Ruiz, M. H. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117424 · Cited by 99
The Computation of Stimulus Values in Simple Choice
Rangel, A., & Clithero, J. A. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00008-5 · Cited by 124
Novelty and Inductive Generalization in Human Reinforcement Learning
Gershman, S. J., & Niv, Y. (2015) · Topics in Cognitive Science · doi:10.1111/tops.12138 · Cited by 98
Nakao, T., Ohira, H., & Northoff, G. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00031 · Cited by 98
Visual Decision-Making in an Uncertain and Dynamic World
Gold, J. I., & Stocker, A. A. (2017) · Annual Review of Vision Science · doi:10.1146/annurev-vision-111815-114511 · Cited by 98
A simple model for learning in volatile environments
Piray, P., & Daw, N. D. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007963 · Cited by 96
The structure of reinforcement-learning mechanisms in the human brain
O’Doherty, J. P., Lee, S. W., & McNamee, D. (2014) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.004 · Cited by 115
Inferring subjective states through the observation of actions
Patel, D., Fleming, S. M., & Kilner, J. M. (2012) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2012.1847 · Cited by 97
Dopamine blockade impairs the exploration-exploitation trade-off in rats
Cinotti, F., Fresno, V., Aklil, N., Coutureau, É., Girard, B., Marchand, A. R., & Khamassi, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-43245-z · Cited by 111
Anxiety Impedes Adaptive Social Learning Under Uncertainty
Lamba, A., Frank, M. J., & FeldmanHall, O. (2020) · Psychological Science · doi:10.1177/0956797620910993 · Cited by 99
Deconstructing risk: Separable encoding of variance and skewness in the brain
Symmonds, M., Wright, N. D., Bach, D. R., & Dolan, R. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.06.087 · Cited by 96
The Role of the Anterior Cingulate Cortex in Choices based on Reward Value and Reward Contingency
Chudasama, Y., Daniels, T. E., Gorrin, D. P., Rhodes, S. E. V., Rudebeck, P. H., & Murray, E. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs266 · Cited by 97
Relating Pupil Dilation and Metacognitive Confidence during Auditory Decision-Making
Lempert, K. M., Chen, Y. L., & Fleming, S. M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126588 · Cited by 96
Levy, I., & Schiller, D. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.11.007 · Cited by 95
Robot Cognitive Control with a Neurophysiologically Inspired Reinforcement Learning Model
Khamassi, M., Lallée, S., Enel, P., Procyk, E., & Dominey, P. F. (2011) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2011.00001 · Cited by 95
Learning Reward Uncertainty in the Basal Ganglia
Mikhael, J. G., & Bogacz, R. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005062 · Cited by 95
Kong, L., Sun, J., Qian, C., Fu, Y., Wang, J., Yang, J., & Gao, Y. (2017) · Organic Electronics · doi:10.1016/j.orgel.2017.05.017 · Cited by 97
How pupil responses track value-based decision-making during and after reinforcement learning
Slooten, J. C. V., Jahfari, S., Knapen, T. H. J., & Theeuwes, J. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006632 · Cited by 116
Toward a comprehensive understanding of the neural mechanisms of decoded neurofeedback
Shibata, K., Lisi, G., Cortese, A., Watanabe, T., Sasaki, Y., & Kawato, M. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.12.022 · Cited by 123
Adaptive Regulation of Motor Variability
Dhawale, A. K., Miyamoto, Y. R., Smith, M. A., & Ölveczky, B. P. (2019) · Current Biology · doi:10.1016/j.cub.2019.08.052 · Cited by 97
Debates on the dorsomedial prefrontal/dorsal anterior cingulate cortex: insights for future research
Clairis, N., & Lopez‐Persem, A. (2023) · Brain · doi:10.1093/brain/awad263 · Cited by 122
Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons
Bromberg-Martin, E. S., Matsumoto, M., Nakahara, H., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.031 · Cited by 94
Affective bias as a rational response to the statistics of rewards and punishments
Pulcu, E., & Browning, M. (2017) · eLife · doi:10.7554/elife.27879 · Cited by 93
Zhao, S., Chait, M., Dick, F., Dayan, P., Furukawa, S., & Liao, H. (2019) · Nature Communications · doi:10.1038/s41467-019-12048-1 · Cited by 118
Perez, O. D., & Dickinson, A. (2020) · Psychological Review · doi:10.1037/rev0000201 · Cited by 91
Crawley, D., Zhang, L., Jones, E. J. H., Ahmad, J., Oakley, B. F. M., Cáceres, A. S. J., Charman, T., Buitelaar, J. K., Murphy, D., Chatham, C. H., et al. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000908 · Cited by 96
Atlas, L. Y., Doll, B. B., Li, J., Daw, N. D., & Phelps, E. A. (2016) · eLife · doi:10.7554/elife.15192 · Cited by 93
A quantitative reward prediction error signal in the ventral pallidum
Ottenheimer, D. J., Bari, B. A., Sutlief, E., Fraser, K. M., Kim, T. H., Richard, J. M., Cohen, J. Y., & Janak, P. H. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-0688-5 · Cited by 92
Adaptive circuit dynamics across human cortex during evidence accumulation in changing environments
Murphy, P. R., Wilming, N., Hernandez-Bocanegra, D. C., Prat-Ortega, G., & Donner, T. H. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00839-z · Cited by 92
Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
Jepma, M., Murphy, P. R., Nassar, M. R., Rangel-Gomez, M., Meeter, M., & Nieuwenhuis, S. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005171 · Cited by 91
Sevgi, M., Diaconescu, A. O., Tittgemeyer, M., & Schilbach, L. (2016) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.11.025 · Cited by 91
RetractedFranklin, N. T., & Frank, M. J. (2015) · eLife · doi:10.7554/elife.12029 · Cited by 95
Sevgi, M., Diaconescu, A. O., Henco, L., Tittgemeyer, M., & Schilbach, L. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.09.032 · Cited by 91
Bornstein, A. M., & Daw, N. D. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003387 · Cited by 91
Social stress reactivity alters reward and punishment learning
Cavanagh, J. F., Frank, M. J., & Allen, J. J. B. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq041 · Cited by 90
How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making
Monosov, I. E. (2020) · Trends in Neurosciences · doi:10.1016/j.tins.2020.06.009 · Cited by 90
Lawson, R. P., Bisby, J., Nord, C. L., Burgess, N., & Rees, G. (2021) · Current Biology · doi:10.1016/j.cub.2020.10.043 · Cited by 90
The anterior cingulate cortex directs exploration of alternative strategies
Tervo, D. G. R., Kuleshova, E., Manakov, M., Proskurin, M., Karlsson, M., Lustig, A., Behnam, R., & Karpova, A. Y. (2021) · Neuron · doi:10.1016/j.neuron.2021.03.028 · Cited by 97
Deserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 88
Computational neuroscience approaches to social cognition
Hackel, L. M., & Amodio, D. M. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2018.09.001 · Cited by 95
Khamassi, M., Quilodran, R., Enel, P., Dominey, P. F., & Procyk, E. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhu114 · Cited by 89
Monitoring demands for executive control: shared functions between human and nonhuman primates
Mansouri, F. A., Egner, T., & Buckley, M. J. (2017) · Trends in Neurosciences · doi:10.1016/j.tins.2016.11.001 · Cited by 89
Decision-making in a changing world: a study in autism spectrum disorders
Robic, S., Sonié, S., Fonlupt, P., Henaff, M.-A., Touil, N., Coricelli, G., Mattout, J., & Schmitz, C. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2311-7 · Cited by 88
Silvestrini, N., Musslick, S., Berry, A. S., & Vassena, E. (2023) · Psychological Review · doi:10.1037/rev0000372 · Cited by 103
How can a Bayesian approach inform neuroscience?
O’Reilly, J. X., Jbabdi, S., & Behrens, T. E. J. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08010.x · Cited by 88
Self-citationErpelding, N., & Davis, K. D. (2013) · Pain · doi:10.1016/j.pain.2013.06.030 · Cited by 87
Making Decisions with Unknown Sensory Reliability
Deneve, S. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00075 · Cited by 86
Handbook of Reward and Decision Making
Dreher, J., & Tremblay, L. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374620-7.x0001-5 · Cited by 94
Vinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Learning to Represent a Multi-Context Environment: More than Detecting Changes
Qian, T., Jaeger, T. F., & Aslin, R. Ν. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00228 · Cited by 94
Volatility Estimates Increase Choice Switching and Relate to Prefrontal Activity in Schizophrenia
Deserno, L., Boehme, R., Mathys, C. D., Katthagen, T., Kaminski, J. A., Stephan, K. E., Heinz, A., & Schlagenhauf, F. (2019) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.10.007 · Cited by 103
Neurobehavioral meaning of pupil size
Grujic, N., Polanía, R., & Burdakov, D. (2024) · Neuron · doi:10.1016/j.neuron.2024.05.029 · Cited by 121
Normative development of ventral striatal resting state connectivity in humans
Fareri, D. S., Gabard-Durnam, L., Goff, B., Flannery, J., Gee, D. G., Lumian, D. S., Caldera, C., & Tottenham, N. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.022 · Cited by 87
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.