Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 501–600 of 1,013
Theoretical and Empirical Studies of Learning
Niv, Y., & Montague, P. R. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00022-1 · Cited by 73
Decisions reduce sensitivity to subsequent information
Bronfman, Z. Z., Brezis, N., Moran, R., Tsetsos, K., Donner, T., & Usher, M. (2015) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2015.0228 · Cited by 63
Arbitration between action strategies in obsessive-compulsive disorder
Gruner, P., Anticevic, A., Lee, D., & Pittenger, C. (2016) · The Neuroscientist · doi:10.1177/1073858414568317 · Cited by 62
Counterfactual Reasoning Underlies the Learning of Priors in Decision Making
Zylberberg, A., Wolpert, D. M., & Shadlen, M. N. (2018) · Neuron · doi:10.1016/j.neuron.2018.07.035 · Cited by 62
Neurobiology of placebo effects: expectations or learning?
Peciña, M., Stohler, C. S., & Zubieta, J.-K. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst079 · Cited by 62
Decision neuroscience: neuroeconomics
Smith, D. V., & Huettel, S. A. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.73 · Cited by 79
Knutson, B. D., & Huettel, S. A. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.10.012 · Cited by 73
Volatility Facilitates Value Updating in the Prefrontal Cortex
Massi, B., Donahue, C. H., & Lee, D. (2018) · Neuron · doi:10.1016/j.neuron.2018.06.033 · Cited by 62
Multiple timescales of normalized value coding underlie adaptive choice behavior
Zimmermann, J., Glimcher, P. W., & Louie, K. (2018) · Nature Communications · doi:10.1038/s41467-018-05507-8 · Cited by 65
Fouragnan, E., Queirazza, F., Retzler, C., Mullinger, K. J., & Philiastides, M. G. (2017) · Scientific Reports · doi:10.1038/s41598-017-04507-w · Cited by 61
“…functional roles, recent studies in animals and humans have observed distinct neural signals aligning both with RPE valence and surprise within a distributed network of areas, including the midbrain 21, 22 , the striatum 18, 23, 24 , the cingulate cortex and the anterior insula 7, 9, 25, 26 .”
Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking
Naudé, J., Tolu, S., Dongelmans, M., Torquet, N., Valverde, S., Rodriguez, G., Pons, S., Maskos, U., Mourot, A., Marti, F., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4223 · Cited by 61
Neuroscience and Human Motivation
Reeve, J., & Lee, W. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195399820.013.0021 · Cited by 67
Momentary subjective well-being depends on learning and not reward
Blain, B., & Rutledge, R. B. (2020) · eLife · doi:10.7554/elife.57977 · Cited by 61
Response-based outcome predictions and confidence regulate feedback processing and learning
Frömer, R., Nassar, M. R., Bruckner, R., Stürmer, B., Sommer, W., & Yeung, N. (2021) · eLife · doi:10.7554/elife.62825 · Cited by 70
Learning in a changing environment.
Speekenbrink, M., & Shanks, D. R. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0018620 · Cited by 62
Ridder, D. D., Congedo, M., & Vanneste, S. (2015) · Brain and Behavior · doi:10.1002/brb3.331 · Cited by 68
Woodward, T. S., Metzak, P. D., Meier, B., & Holroyd, C. B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.12.049 · Cited by 70
Altered Medial Frontal Feedback Learning Signals in Anorexia Nervosa
Bernardoni, F., Geisler, D., King, J. A., Javadi, A., Ritschel, F., Murr, J., Reiter, A. M. F., Roessner, V., Smolka, M. N., Kiebel, S. J., et al. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.07.024 · Cited by 67
Piray, P., Ly, V., Roelofs, K., Cools, R., & Toni, I. (2019) · The Journal of Neuroscience · doi:10.1523/jneurosci.1394-18.2018 · Cited by 61
Stress-sensitive inference of task controllability
Ligneul, R., Mainen, Z. F., Ly, V., & Cools, R. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01306-w · Cited by 60
“For example, the ACC and the anterior insula, which encoded controllability prediction errors, play an established role in the signalling of state uncertainty or task volatility, both of which may participate in controllability estimation 28,50,51 .”
Timescales of cognition in the brain
Soltani, A., Murray, J. D., Seo, H., & Lee, D. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.003 · Cited by 74
Scenario Thinking: A Historical Evolution of Strategic Foresight
MacKay, B., & McKiernan, P. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108571494 · Cited by 76
Structure Learning in Human Sequential Decision-Making
Acuña, D. E., & Schrater, P. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001003 · Cited by 60
Neurobiology of apathy in Alzheimer's disease
Guimarães, H. C., Levy, R., Teixeira, A. L., Beato, R. G., & Caramelli, P. (2008) · Arquivos de Neuro-Psiquiatria · doi:10.1590/s0004-282x2008000300035 · Cited by 60
Yu, R., Zhou, W., & Zhou, X. (2011) · PLoS ONE · doi:10.1371/journal.pone.0029633 · Cited by 60
The brain, obesity and addiction: an EEG neuroimaging study
De Ridder, D., Manning, P., Leong, S. L., Ross, S., Sutherland, W., Horwath, C., & Vanneste, S. (2016) · Scientific Reports · doi:10.1038/srep34122 · Cited by 60
Boredom, Information-Seeking and Exploration.
Geana, A., Wilson, R. C., Daw, N. D., & Cohen, J. D. (2016) · eScholarship (California Digital Library) · Cited by 108
Conserved features of anterior cingulate networks support observational learning across species
Burgos-Robles, A., Gothard, K. M., Monfils, M., Morozov, A., & Vicentic, A. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.09.009 · Cited by 66
Morris, R. W., Dezfouli, A., Griffiths, K. R., & Balleine, B. W. (2014) · Nature Communications · doi:10.1038/ncomms5390 · Cited by 59
Distinct regions of anterior cingulate cortex signal prediction and outcome evaluation
Jahn, A., Nee, D. E., Alexander, W. H., & Brown, J. W. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.050 · Cited by 63
Fan, J., Van Dam, N. T., Gu, X., Liu, X., Wang, H., Tang, C. Y., & Hof, P. R. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00554 · Cited by 59
Electrophysiological indicators of surprise and entropy in dynamic task-switching environments
Kopp, B., & Lange, F. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00300 · Cited by 67
Cortical Signals for Rewarded Actions and Strategic Exploration
Donahue, C. H., Seo, H., & Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.040 · Cited by 58
Neural Mechanisms of Credit Assignment in a Multicue Environment
Akaishi, R., Kolling, N., Brown, J. W., & Rushworth, M. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.3159-15.2016 · Cited by 58
Self-citationScholl, J., Kolling, N., Nelissen, N., Browning, M., Rushworth, M. F. S., & Harmer, C. J. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000756 · Cited by 58
Self-citation(Reinforcement?) Learning to forage optimally
Kolling, N., & Akam, T. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.008 · Cited by 81
Iigaya, K., Ahmadian, Y., Sugrue, L. P., Corrado, G. S., Loewenstein, Y., Newsome, W. T., & Fusi, S. (2019) · Nature Communications · doi:10.1038/s41467-019-09388-3 · Cited by 71
The neural correlates of hierarchical predictions for perceptual decisions
Weilnhammer, V. A., Stuke, H., Sterzer, P., & Schmack, K. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.2901-17.2018 · Cited by 57
“Bayesian theories propose that our brain entertains a predictive model of the environment, enabling inference and learning under uncertainty (Knill and Pouget, 2004; Yu and Dayan, 2005; Behrens et al., 2007; Hohwy et al., 2008; Nassar et al., 2010; Payzan-LeNestour et al., 2013).”
BackgroundStudying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56
Functional brain network reconfiguration during learning in a dynamic environment
Kao, C.-H., Khambhati, A. N., Bassett, D. S., Nassar, M. R., McGuire, J. T., Gold, J. I., & Kable, J. W. (2020) · Nature Communications · doi:10.1038/s41467-020-15442-2 · Cited by 65
A taxonomy of surprise definitions
Modirshanechi, A., Brea, J., & Gerstner, W. (2022) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2022.102712 · Cited by 84
Extrapolative Beliefs in Perceptual and Economic Decisions: Evidence of a Common Mechanism
Frydman, C., & Nave, G. (2016) · Management Science · doi:10.1287/mnsc.2016.2453 · Cited by 62
de Boer, L., Axelsson, J., Riklund, K., Nyberg, L. H., Dayan, P., Bäckman, L., & Guitart‐Masip, M. (2017) · eLife · doi:10.7554/elife.26424 · Cited by 61
Ballard, I. C., & McClure, S. M. (2019) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2019.01.006 · Cited by 68
Li, V., Michael, E., Balaguer, J., Castañón, S. H., & Summerfield, C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1805224115 · Cited by 59
Violations of Core Knowledge Shape Early Learning
Stahl, A. E., & Feigenson, L. (2019) · Topics in Cognitive Science · doi:10.1111/tops.12389 · Cited by 55
Adaptive learning is structure learning in time
Yu, L. Q., Wilson, R. C., & Nassar, M. R. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.024 · Cited by 68
Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters
Khamassi, M., Enel, P., Dominey, P. F., & Procyk, E. (2013) · Progress in brain research · doi:10.1016/b978-0-444-62604-2.00022-8 · Cited by 73
Supplementary Eye Field Encodes Reward Prediction Error
So, N., & Stuphorn, V. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4419-11.2012 · Cited by 56
Unifying treatments for depression: an application of the free energy principle
Chekroud, A. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00153 · Cited by 55
“Behaviorally, it has been shown that healthy human subjects assess volatility in an optimal manner—that is, increase their learning rate when the environment is more volatile (Behrens et al., 2007).”
BackgroundA general theory of intertemporal decision-making and the perception of time
Namboodiri, V. M. K., Mihalaş, Ş., Marton, T. M., & Shuler, M. G. H. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00061 · Cited by 67
Electrophysiological correlates of decision making under varying levels of uncertainty
Bland, A. R., & Schaefer, A. (2011) · Brain Research · doi:10.1016/j.brainres.2011.08.031 · Cited by 63
Aging and electrocortical response to error feedback during a spatial learning task
Mathewson, K. J., Dywan, J., Snyder, P. J., Tays, W. J., & Segalowitz, S. J. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00699.x · Cited by 63
Observing the Observer (II): Deciding When to Decide
Daunizeau, J., den Ouden, H. E. M., Pessiglione, M., Kiebel, S. J., Friston, K. J., & Stephan, K. E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015555 · Cited by 56
Bayesian Integration and Non-Linear Feedback Control in a Full-Body Motor Task
Stevenson, I. H., Fernandes, H. L., Vilares, I., Wei, K., & Kording, K. P. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000629 · Cited by 58
Payzan-LeNestour, É., & Bossaerts, P. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00150 · Cited by 54
Wang, B., Wu, C., Huang, L., & Kang, L. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.11.181 · Cited by 68
Prefrontal mechanisms combining rewards and beliefs in human decision-making
Rouault, M., Drugowitsch, J., & Koechlin, É. (2019) · Nature Communications · doi:10.1038/s41467-018-08121-w · Cited by 67
Confidence resets reveal hierarchical adaptive learning in humans
Heilbron, M., & Meyniel, F. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006972 · Cited by 62
With an eye on uncertainty: Modelling pupillary responses to environmental volatility
Vincent, P., Parr, T., Benrimoh, D., & Friston, K. J. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007126 · Cited by 54
Brain control of energy homeostasis: implications for anti-obesity pharmacotherapy
Johansen, V. B. I., Petersen, J., Lund, J., Mathiesen, C. V., Fenselau, H., & Clemmensen, C. (2025) · Cell · doi:10.1016/j.cell.2025.06.010 · Cited by 53
Goris, J., Silvetti, M., Verguts, T., Wiersema, J. R., Braß, M., & Braem, S. (2020) · Autism · doi:10.1177/1362361320962237 · Cited by 57
Pupil diameter reflects uncertainty in attentional selection during visual search
Geng, J. J., Blumenfeld, Z., Tyson, T. L., & Minzenberg, M. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00435 · Cited by 67
Esber, G. R., Roesch, M. R., Bali, S., Trageser, J., Bissonette, G. B., Puche, A. C., Holland, P. C., & Schoenbaum, G. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.05.023 · Cited by 53
Woolrich, M. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.047 · Cited by 59
Self-citationSocial Cognition as Reinforcement Learning: Feedback Modulates Emotion Inference
Zaki, J., Kallman, S., Wimmer, G. E., Ochsner, K. N., & Shohamy, D. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00978 · Cited by 58
Development of MPFC function mediates shifts in self-protective behavior provoked by social feedback
Yoon, L., Somerville, L. H., & Kim, H. (2018) · Nature Communications · doi:10.1038/s41467-018-05553-2 · Cited by 57
Reinforcement learning in social interaction: The distinguishing role of trait inference
Hackel, L. M., Mende‐Siedlecki, P., & Amodio, D. M. (2020) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.103948 · Cited by 61
Uncertainty-driven regulation of learning and exploration in adolescents: A computational account
Jepma, M., Schaaf, J. V., Visser, I., & Huizenga, H. M. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008276 · Cited by 53
Galea, J. M., Bestmann, S., Beigi, M., Jahanshahi, M., & Rothwell, J. C. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3621-11.2012 · Cited by 52
Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty
Kobayashi, K., & Hsu, M. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0535-17.2017 · Cited by 52
It’s new, but is it good? How generalization and uncertainty guide the exploration of novel options.
Stojić, H., Schulz, E., Analytis, P. P., & Speekenbrink, M. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000749 · Cited by 62
Redundancy in synaptic connections enables neurons to learn optimally
Hiratani, N., & Fukai, T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1803274115 · Cited by 67
Frömer, R., & Shenhav, A. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.12.006 · Cited by 66
Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty
Sandhu, T. R., Xiao, B., & Lawson, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105123 · Cited by 51
Brain dynamics for confidence-weighted learning
Meyniel, F. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007935 · Cited by 61
Monosov, I. E., & Rushworth, M. F. S. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01079-2 · Cited by 55
Self-citationNeurocomputational mechanisms of reinforcement-guided learning in humans: A review
Cohen, M. X. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.2.113 · Cited by 55
Towards a neuro-computational account of prism adaptation
Petitet, P., O’Reilly, J. X., & O’Shea, J. (2017) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.021 · Cited by 57
Representations of uncertainty: where art thou?
Koblinger, Á., Fiser, J., & Lengyel, M. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.03.009 · Cited by 61
Combining fMRI and behavioral measures to examine the process of human learning
Karuza, E. A., Emberson, L. L., & Aslin, R. N. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.09.012 · Cited by 50
Stochastic Models of Evidence Accumulation in Changing Environments
Veliz‐Cuba, A., Kilpatrick, Z. P., & Josić́, K. (2016) · SIAM Review · doi:10.1137/15m1028443 · Cited by 66
Hezemans, F. H., Wolpe, N., O’Callaghan, C., Ye, R., Rua, C., Jones, P. S., Murley, A. G., Holland, N., Regenthal, R., Tsvetanov, K. A., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010079 · Cited by 53
Naturalistic reinforcement learning
Wise, T., Emery, K. J., & Radulescu, A. (2023) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2023.08.016 · Cited by 71
Distributional reinforcement learning in prefrontal cortex
Müller, T., Butler, J. L., Veselič, S., Miranda, B., Wallis, J. D., Dayan, P., Behrens, T. E. J., Kurth-Nelson, Z. L., & Kennerley, S. W. (2024) · Nature Neuroscience · doi:10.1038/s41593-023-01535-w · Cited by 73
Self-citationCompetition between learned reward and error outcome predictions in anterior cingulate cortex
Alexander, W. H., & Brown, J. W. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.065 · Cited by 50
The influence of the noradrenergic system on optimal control of neural plasticity
Silvetti, M., Seurinck, R., van Bochove, M. E., & Verguts, T. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00160 · Cited by 50
Simon, N. W., Wood, J., & Moghaddam, B. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00884.2015 · Cited by 49
A simple hypothesis of executive function
Kopp, B. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00159 · Cited by 49
Functional neural correlates of fluid and crystallized analogizing
Geake, J. G., & Hansen, P. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.008 · Cited by 50
Brown, J. W., & Alexander, W. H. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01140 · Cited by 49
Model-based analyses: Promises, pitfalls, and example applications to the study of cognitive control
Mars, R. B., Shea, N. J., Kolling, N., & Rushworth, M. F. S. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470211003668272 · Cited by 49
Self-citationBrain Systems for Probabilistic and Dynamic Prediction: Computational Specificity and Integration
O'Reilly, J. X., Jbabdi, S., Rushworth, M. F. S., & Behrens, T. E. J. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001662 · Cited by 48
Self-citationAdolescents Adapt More Slowly than Adults to Varying Reward Contingencies
Javadi, A. H., Schmidt, D. H. K., & Smolka, M. N. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00677 · Cited by 48
The influence of emotions on cognitive control: feelings and beliefs—where do they meet?
Harlé, K. M., Shenoy, P., & Paulus, M. P. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00508 · Cited by 62
Neural Mechanisms Behind Identification of Leptokurtic Noise and Adaptive Behavioral Response
d’Acremont, M., & Bossaerts, P. L. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw013 · Cited by 60
Anterior cingulate cortex encoding of effortful behavior
Porter, B. S., Hillman, K. L., & Bilkey, D. K. (2019) · Journal of Neurophysiology · doi:10.1152/jn.00654.2018 · Cited by 50
Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior
Rudebeck, P. H., & Izquierdo, A. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-021-01140-0 · Cited by 60
Browning, M. D., Carter, C. S., Chatham, C. H., den Ouden, H. E. M., Gillan, C. M., Baker, J. T., Chekroud, A. M., Cools, R., Dayan, P., Gold, J. M., et al. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.12.026 · Cited by 55
Gibbs-Dean, T., Katthagen, T., Tsenkova, I., Ali, R., Liang, X., Spencer, T. J., & Diederen, K. M. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105087 · Cited by 58
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.