Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 201–300 of 1,013
A brain network supporting social influences in human decision-making
Zhang, L., & Gläscher, J. (2020) · Science Advances · doi:10.1126/sciadv.abb4159 · Cited by 160
Jiang, J., Beck, J., Heller, K., & Egner, T. (2015) · Nature Communications · doi:10.1038/ncomms9165 · Cited by 160
Exploring a latent cause theory of classical conditioning
Gershman, S. J., & Niv, Y. (2012) · Learning & Behavior · doi:10.3758/s13420-012-0080-8 · Cited by 149
Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex
Domenech, P., Rheims, S., & Koechlin, E. (2020) · Science · doi:10.1126/science.abb0184 · Cited by 159
Pharmacological Fingerprints of Contextual Uncertainty
Marshall, L., Mathys, C., Ruge, D., de Berker, A. O., Dayan, P., Stephan, K. E., & Bestmann, S. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002575 · Cited by 158
Reinstated episodic context guides sampling-based decisions for reward
Bornstein, A. M., & Norman, K. A. (2017) · Nature Neuroscience · doi:10.1038/nn.4573 · Cited by 193
The lateral prefrontal cortex and complex value-based learning and decision making
Dixon, M. L., & Christoff, K. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.04.011 · Cited by 179
The Misestimation of Uncertainty in Affective Disorders
Pulcu, E., & Browning, M. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.007 · Cited by 156
“We have also described studies in which the simple Rescorla–Wagner learning rule was used to obtain separate estimates of learning rate when uncertainty was high versus low [7,8,10,11].”
InfluentialInduction and Relief of Curiosity Elicit Parietal and Frontal Activity
van Lieshout, L. L. F., Vandenbroucke, A. R. E., Müller, N. C. J., Cools, R., & de Lange, F. P. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2816-17.2018 · Cited by 154
Uncertainty and Cognitive Control
Mushtaq, F., Bland, A. R., & Schaefer, A. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00249 · Cited by 149
Gentsch, A., Ullsperger, P., & Ullsperger, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.064 · Cited by 177
Bestmann, S., Harrison, L. M., Blankenburg, F., Mars, R. B., Haggard, P., Friston, K. J., & Rothwell, J. C. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.051 · Cited by 153
A model for learning based on the joint estimation of stochasticity and volatility
Piray, P., & Daw, N. D. (2021) · Nature Communications · doi:10.1038/s41467-021-26731-9 · Cited by 153
Learning Priors for Bayesian Computations in the Nervous System
Berniker, M., Voss, M., & Kording, K. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012686 · Cited by 152
Hillman, K. L., & Bilkey, D. K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1273-10.2010 · Cited by 152
Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction
Li, J., & Daw, N. D. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6316-10.2011 · Cited by 152
Bayesian Online Learning of the Hazard Rate in Change-Point Problems
Wilson, R. C., Nassar, M. R., & Gold, J. I. (2010) · Neural Computation · doi:10.1162/neco_a_00007 · Cited by 150
Efficient Coding and Risky Choice
Frydman, C., & Jin, L. J. (2021) · The Quarterly Journal of Economics · doi:10.1093/qje/qjab031 · Cited by 198
Error effects in anterior cingulate cortex reverse when error likelihood is high
Jessup, R. K., Busemeyer, J. R., & Brown, J. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4130-09.2010 · Cited by 151
“…feedback, so it is unlikely that any rapid corrective response would account for error effects as predicted by the sequence detection theory (Steinhauser et al., 2008), although error effects based on internal detection rather than external feedback might still be accounted for by such a mechanism.”
Compulsivity reveals a novel dissociation between action and confidence
Vaghi, M. M., Luyckx, F., Sule, A., Fineberg, N. A., Robbins, T. W., & De Martino, B. (2017) · Neuron · doi:10.1016/j.neuron.2017.09.006 · Cited by 145
Inferring Relevance in a Changing World
Wilson, R. C., & Niv, Y. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00189 · Cited by 148
The Behavioral and Neural Mechanisms Underlying the Tracking of Expertise
Boorman, E. D., O’Doherty, J. P., Adolphs, R., & Rangel, A. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.024 · Cited by 150
Neural Correlates of Variations in Event Processing during Learning in Basolateral Amygdala
Roesch, M. R., Calu, D. J., Esber, G. R., & Schoenbaum, G. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5781-09.2010 · Cited by 150
Choice, difficulty, and confidence in the brain
Rolls, E. T., Grabenhorst, F., & Deco, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.073 · Cited by 148
“Decision-making, and our confidence in the decisionswemake, are important areas in neuroscience in the new field of neuroeconomics (Behrens et al., 2007; Deco and Rolls, 2006; Glimcher, 2003; Hampton and O'Doherty, 2007; Heekeren et al., 2004; Kepecs et al., 2008; Kiani and Shadlen, 2009; Kim and Shadlen, 1999; Knutso…”
Chemistry of the Adaptive Mind: Lessons from Dopamine
Cools, R. (2019) · Neuron · doi:10.1016/j.neuron.2019.09.035 · Cited by 164
Effects of Direct Social Experience on Trust Decisions and Neural Reward Circuitry
Fareri, D. S., Chang, L. J., & Delgado, M. R. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00148 · Cited by 147
Spatial attention, precision, and Bayesian inference: a study of saccadic response speed
Vossel, S., Mathys, C., Daunizeau, J., Bauer, M., Driver, J., Friston, K. J., & Stephan, K. E. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs418 · Cited by 146
“We imagine that neuroimaging studies could use the time series of the states of our perceptual model as predictor variables to identify their neuronal correlates (cf. Behrens et al. 2007; den Ouden et al. 2010).”
BackgroundMethodInfluentialRisk and risk prediction error signals in anterior insula
Bossaerts, P. (2010) · Brain Structure and Function · doi:10.1007/s00429-010-0253-1 · Cited by 146
Sales, A. C., Friston, K. J., Jones, M. W., Pickering, A. E., & Moran, R. J. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006267 · Cited by 145
Human Scalp Electroencephalography Reveals that Repetition Suppression Varies with Expectation
Summerfield, C., Wyart, V., Johnen, V. M., & de Gardelle, V. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00067 · Cited by 145
Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior
Noonan, M. P., Mars, R. B., & Rushworth, M. F. S. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6456-10.2011 · Cited by 145
Self-citationWhite matter brain and trigeminal nerve abnormalities in temporomandibular disorder
Moayedi, M., Weissman-Fogel, I., Salomons, T. V., Crawley, A. P., Goldberg, M. B., Freeman, B. V., Tenenbaum, H. C., & Davis, K. D. (2012) · Pain · doi:10.1016/j.pain.2012.04.003 · Cited by 144
“Although we did not perform cardiac gating during the DTI acquisition, we visually checked our dataset and verified that it did not contain corrupt images.”
MethodZaki, J., Hennigan, K., Weber, J., & Ochsner, K. N. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0382-10.2010 · Cited by 121
Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes
Groman, S. M., Keistler, C., Keip, A. J., Hammarlund, E., DiLeone, R. J., Pittenger, C., Lee, D., & Taylor, J. R. (2019) · Neuron · doi:10.1016/j.neuron.2019.05.042 · Cited by 142
Downregulation of the Posterior Medial Frontal Cortex Prevents Social Conformity
Klucharev, V., Munneke, M. A. M., Smidts, A., & Fernández, G. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1869-11.2011 · Cited by 139
Wittmann, M. K., Kolling, N., Akaishi, R., Chau, B. K. H., Brown, J. W., Nelissen, N., & Rushworth, M. F. S. (2016) · Nature Communications · doi:10.1038/ncomms12327 · Cited by 140
Self-citationHuman Inferences about Sequences: A Minimal Transition Probability Model
Meyniel, F., Maheu, M., & Dehaene, S. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005260 · Cited by 142
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
“Finally, Behrens et al. (2007) proposed that ACC is sensitive to the volatility of environmental outcomes.”
BackgroundSilvetti, M., Seurinck, R., & Verguts, T. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00075 · Cited by 140
Social learning through prediction error in the brain
Joiner, J., Piva, M., Turrin, C., & Chang, S. W. C. (2017) · npj Science of Learning · doi:10.1038/s41539-017-0009-2 · Cited by 138
Brain networks for confidence weighting and hierarchical inference during probabilistic learning
Meyniel, F., & Dehaene, S. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1615773114 · Cited by 138
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136
“Within the current hypothesis, we posit that increased dopamine facilitates greater energy expenditure and exploration, i.e., less biasing of behavioral choice by reward, favoring less energy storage and providing protection from obesity, consistent with the well-known effects of psychostimulants…”
BackgroundResultHierarchical prediction errors in midbrain and septum during social learning
Diaconescu, A. O., Mathys, C., Weber, L. A. E., Kasper, L., Mauer, J., & Stephan, K. E. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw171 · Cited by 134
Dissociable effects of surprising rewards on learning and memory.
Rouhani, N., Norman, K. A., & Niv, Y. (2018) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000518 · Cited by 135
Predictive processing, source monitoring, and psychosis
Griffin, J. D., & Fletcher, P. C. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-045145 · Cited by 133
Principles of cognitive control over task focus and task switching
Egner, T. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00234-4 · Cited by 180
Intention, Choice, and the Medial Frontal Cortex
Rushworth, M. F. S. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1440.014 · Cited by 134
Self-citationAdding prediction risk to the theory of reward learning
PREUSCHOFF, K., & BOSSAERTS, P. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.005 · Cited by 133
Offline replay supports planning in human reinforcement learning
Momennejad, I., Otto, A. R., Daw, N. D., & Norman, K. A. (2018) · eLife · doi:10.7554/elife.32548 · Cited by 131
Positive reward prediction errors during decision-making strengthen memory encoding
Jang, A. I., Nassar, M. R., Dillon, D. G., & Frank, M. J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0597-3 · Cited by 146
Computational and dynamic models in neuroimaging
Friston, K. J., & Dolan, R. J. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.068 · Cited by 131
Do learning rates adapt to the distribution of rewards?
Gershman, S. J. (2015) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0790-3 · Cited by 156
Klein-Flügge, M. C., Barron, H. C., Brodersen, K. H., Dolan, R. J., & Behrens, T. E. J. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2532-12.2013 · Cited by 130
Self-citationDopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2020) · eLife · doi:10.7554/elife.51260 · Cited by 128
Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice?
Haker, H., Schneebeli, M., & Stephan, K. E. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00107 · Cited by 130
Moral Learning: Conceptual foundations and normative relevance
Railton, P. (2016) · Cognition · doi:10.1016/j.cognition.2016.08.015 · Cited by 154
Theory and measurement of environmental unpredictability
Young, E. S., Frankenhuis, W. E., & Ellis, B. J. (2020) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2020.08.006 · Cited by 142
A neural network for information seeking
White, J. K., Bromberg-Martin, E. S., Heilbronner, S. R., Zhang, K., Pai, J., Haber, S. N., & Monosov, I. E. (2019) · Nature Communications · doi:10.1038/s41467-019-13135-z · Cited by 129
Different Varieties of Uncertainty in Human Decision-Making
Bland, A. R., & Schaefer, A. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00085 · Cited by 129
O’Doherty, J. P. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.03.027 · Cited by 129
Beyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 125
The computational roots of positivity and confirmation biases in reinforcement learning
Palminteri, S., & Lebreton, M. P. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.04.005 · Cited by 162
Stress habituation, body shape and cardiovascular mortality
Peters, A., & McEwen, B. S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.07.001 · Cited by 129
Episodic Memory Encoding Interferes with Reward Learning and Decreases Striatal Prediction Errors
Wimmer, G. E., Braun, E. K., Daw, N. D., & Shohamy, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.0204-14.2014 · Cited by 128
The temporal dynamics of opportunity costs: A normative account of cognitive fatigue and boredom.
Agrawal, M., Mattar, M. G., Cohen, J. D., & Daw, N. D. (2022) · Psychological Review · doi:10.1037/rev0000309 · Cited by 154
Neural Basis of Motivational and Cognitive Control
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/9780262016438.001.0001 · Cited by 128
Tolerance to ambiguous uncertainty predicts prosocial behavior
Vives, M.-L., & FeldmanHall, O. (2018) · Nature Communications · doi:10.1038/s41467-018-04631-9 · Cited by 125
Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
Silvetti, M., Vassena, E., Abrahamse, E. L., & Verguts, T. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006370 · Cited by 158
Making predictions in a changing world—inference, uncertainty, and learning
O'Reilly, J. X. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00105 · Cited by 126
Fu, Z., Wu, D.-A. J., Ross, I., Chung, J. M., Mamelak, A. N., Adolphs, R., & Rutishauser, U. (2019) · Neuron · doi:10.1016/j.neuron.2018.11.016 · Cited by 126
The role of the midcingulate cortex in monitoring others' decisions
Apps, M. A. J., Lockwood, P. L., & Balsters, J. H. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00251 · Cited by 126
Reinhart, R. M. G., & Woodman, G. F. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5421-13.2014 · Cited by 124
Decision Threshold Modulation in the Human Brain
Domenech, P., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2371-10.2010 · Cited by 125
Social rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124
“As such, a complementary question is whether the valuation of social outcomes, or social rewards, relies on neural structures implicated in coding the value of primary and secondary non-social rewards, and how members of one’s social network may further influence reward valuation processes.”
BackgroundGold, J. I., Law, C.-T., Connolly, P., & Bennur, S. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90629.2008 · Cited by 124
From affective value to decision‐making in the prefrontal cortex
Grabenhorst, F., Rolls, E. T., & Parris, B. A. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06489.x · Cited by 124
Dissociating hippocampal and striatal contributions to sequential prediction learning
Bornstein, A. M., & Daw, N. D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07920.x · Cited by 124
Quantum reinforcement learning during human decision-making
Li, J., Dong, D., Wei, Z., Liu, Y., Pan, Y., Nori, F., & Zhang, X. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0804-2 · Cited by 140
Neural encoding of competitive effort in the anterior cingulate cortex
Hillman, K. L., & Bilkey, D. K. (2012) · Nature Neuroscience · doi:10.1038/nn.3187 · Cited by 138
A Novel Neural Prediction Error Found in Anterior Cingulate Cortex Ensembles
Hyman, J. M., Holroyd, C. B., & Seamans, J. K. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.021 · Cited by 131
Structuring Memory Through Inference‐Based Event Segmentation
Shin, Y. S., & DuBrow, S. (2021) · Topics in Cognitive Science · doi:10.1111/tops.12505 · Cited by 119
Functional Connectivity between Amygdala and Cingulate Cortex for Adaptive Aversive Learning
Klavir, O., Genud-Gabai, R., & Paz, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.035 · Cited by 121
Nassar, M. R., Bruckner, R., Gold, J. I., Li, S.-C., Heekeren, H. R., & Eppinger, B. (2016) · Nature Communications · doi:10.1038/ncomms11609 · Cited by 121
How many neurons are sufficient for perception of cortical activity?
Dalgleish, H. W. P., Russell, L. E., Packer, A. M., Roth, A., Gauld, O. M., Greenstreet, F., Thompson, E., & Häusser, M. (2020) · eLife · doi:10.7554/elife.58889 · Cited by 126
Iigaya, K., Fonseca, M. S., Murakami, M., Mainen, Z. F., & Dayan, P. (2018) · Nature Communications · doi:10.1038/s41467-018-04840-2 · Cited by 120
Victor, T. A., Khalsa, S. S., Simmons, W. K., Feinstein, J. S., Savitz, J., Aupperle, R. L., Yeh, H.-W., Bodurka, J., & Paulus, M. P. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-016620 · Cited by 120
General mechanisms for making decisions?
Rushworth, M. F. S., Mars, R. B., & Summerfield, C. (2009) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2009.02.005 · Cited by 133
Self-citationDynamics of attentional selection under conflict: Toward a rational Bayesian account.
Yu, A. J., Dayan, P., & Cohen, J. D. (2009) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0013553 · Cited by 119
Temporal dynamics of prediction error processing during reward-based decision making
Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., & Heekeren, H. R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.052 · Cited by 144
Equality bias impairs collective decision-making across cultures
Mahmoodi, A., Bang, D., Olsen, K., Zhao, Y. A., Shi, Z., Broberg, K., Safavi, S., Han, S., Nili Ahmadabadi, M., Frith, C. D., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1421692112 · Cited by 119
Adaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Bell, A. H., Summerfield, C., Morin, E. L., Malecek, N. J., & Ungerleider, L. G. (2016) · Current Biology · doi:10.1016/j.cub.2016.07.007 · Cited by 118
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118
“We tested our hypotheses concerning decomposition using the chosen action value (rather than, say, the option-specific action value for some particular option such as the triangle) since this is the value most often reported to correlate with BOLD signaling (Daw et al., 2006a; Behrens et al., 2007; Gläscher et al., 20…”
BackgroundMethodInfluentialDevelopment of directed and random exploration in children
Meder, B., Wu, C. M., Schulz, E., & Ruggeri, A. (2021) · Developmental Science · doi:10.1111/desc.13095 · Cited by 148
Arousal-related adjustments of perceptual biases optimize perception in dynamic environments
Krishnamurthy, K., Nassar, M. R., Sarode, S., & Gold, J. I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0107 · Cited by 117
Flexible combination of reward information across primates
Farashahi, S., Donahue, C. H., Hayden, B. Y., Lee, D., & Soltani, A. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0714-3 · Cited by 112
Boorman, E. D., Rajendran, V. G., O’Reilly, J. X., & Behrens, T. E. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.014 · Cited by 117
Self-citationHeinz, A., Murray, G. K., Schlagenhauf, F., Sterzer, P., Grace, A. A., & Waltz, J. A. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sby154 · Cited by 116
Impaired adaptation of learning to contingency volatility in internalizing psychopathology
Gagne, C., Zika, O., Dayan, P., & Bishop, S. J. (2020) · eLife · doi:10.7554/elife.61387 · Cited by 116
Kunisato, Y., Okamoto, Y., Ueda, K., Onoda, K., Okada, G., Yoshimura, S., Suzuki, S.-I., Samejima, K., & Yamawaki, S. (2012) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2012.05.007 · Cited by 134
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.