Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 601–700 of 1,013
Harris, D., Wilkinson, S., & Ellmers, T. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105115 · Cited by 60
Temporally Dissociable Contributions of Human Medial Prefrontal Subregions to Reward-Guided Learning
Hauser, T. U., Hunt, L. T., Iannaccone, R., Walitza, S., Brandeis, D., Brem, S., & Dolan, R. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0560-15.2015 · Cited by 46
Beyond Conflict Monitoring: Cognitive Control and the Neural Basis of Thinking Before You Act
Brown, J. W. (2013) · Current Directions in Psychological Science · doi:10.1177/0963721412470685 · Cited by 59
Wilk, H. A., Ezekiel, F., & Morton, J. B. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.011 · Cited by 55
Reinhart, R. M. G., Zhu, J., Park, S., & Woodman, G. F. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.1717-15.2015 · Cited by 46
Bezalel, V., Paz, R., & Tal, A. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.016 · Cited by 47
Pulcu, E., Shkreli, L., Holst, C. G., Woud, M. L., Craske, M. G., Browning, M. D., & Reinecke, A. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.04.010 · Cited by 52
Fineberg, S. K., Leavitt, J., Stahl, D. S., Kronemer, S. I., Landry, C. D., Alexander‐Bloch, A. F., Hunt, L. T., & Corlett, P. R. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.05.020 · Cited by 55
Reinforcement learning signals in the anterior cingulate cortex code for others’ false beliefs
Apps, M. A. J., Green, R., & Ramnani, N. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.010 · Cited by 51
Jepma (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00170 · Cited by 45
Trait anxiety is associated with hidden state inference during aversive reversal learning
Zika, O., Wiech, K., Reinecke, A., Browning, M. D., & Schuck, N. W. (2023) · Nature Communications · doi:10.1038/s41467-023-39825-3 · Cited by 54
Computational processes of simultaneous learning of stochasticity and volatility in humans
Piray, P., & Daw, N. D. (2024) · Nature Communications · doi:10.1038/s41467-024-53459-z · Cited by 45
“This work builds directly upon a substantial body of research that has investigated the processes involved in estimating volatility in both behavior and the brain 6,8,12,20,27,54,55 .”
InfluentialCook, J. L., den Ouden, H. E. M., Heyes, C. M., & Cools, R. (2014) · Current Biology · doi:10.1016/j.cub.2014.10.014 · Cited by 53
Medial prefrontal cortex predicts and evaluates the timing of action outcomes
Förster, S., & Brown, J. W. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.035 · Cited by 52
Effects of Category-Specific Costs on Neural Systems for Perceptual Decision-Making
Fleming, S. M., Whiteley, L., Hulme, O. J., Sahani, M., & Dolan, R. J. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01084.2009 · Cited by 45
Advanced Reinforcement Learning
Daw, N. D. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00016-4 · Cited by 54
Model-Based Approaches to Active Perception and Control
Pezzulo, G., Donnarumma, F., Iodice, P., Maisto, D., & Stoianov, I. (2017) · Entropy · doi:10.3390/e19060266 · Cited by 45
Hainguerlot, M., Vergnaud, J.-C., & de Gardelle, V. (2018) · Scientific Reports · doi:10.1038/s41598-018-23936-9 · Cited by 45
Imprecise neural computations as a source of adaptive behaviour in volatile environments
Findling, C., Chopin, N., & Koechlin, É. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00971-z · Cited by 61
Iglesias, S., Kasper, L., Harrison, S. J., Manka, R., Mathys, C., & Stephan, K. E. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117590 · Cited by 45
An empirical evaluation of active inference in multi-armed bandits
Marković, D., Stojić, H., Schwöbel, S., & Kiebel, S. J. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.018 · Cited by 45
Corticolimbic mechanisms in the control of trial and error learning
Luu, P., Shane, M. S., Pratt, N. L., & Tucker, D. M. (2008) · Brain Research · doi:10.1016/j.brainres.2008.09.084 · Cited by 49
Valuation for Risky and Uncertain Choices
Tobler, P. N., & Weber, E. U. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00009-7 · Cited by 58
Curiosity: primate neural circuits for novelty and information seeking
Monosov, I. E. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00784-9 · Cited by 44
“…uncertainty 94 (for example, by measuring total uncertainty from the frequency and magnitude of all surprising rewards and then attempting to infer which are attributable to a lack of knowledge 95 ), others avoid uncertainty measurements and use different strategies to guide behaviour 15,87,96–98 .”
Surprise! A unifying model of dorsal anterior cingulate function?
Egner, T. (2011) · Nature Neuroscience · doi:10.1038/nn.2932 · Cited by 44
Attention as foraging for information and value
Manohar, S., & Husain, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00711 · Cited by 58
Converging prefrontal pathways support associative and perceptual features of conditioned stimuli
Howard, J. D., Kahnt, T., & Gottfried, J. A. (2016) · Nature Communications · doi:10.1038/ncomms11546 · Cited by 47
Learning, the P3, and the Locus Coeruleus-Norepinephrine System
Nieuwenhuis, S. (2011) · Neural Basis of Motivational and Cognitive Control · doi:10.7551/mitpress/9780262016438.003.0012 · Cited by 44
D’Astolfo, L., & Rief, W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01253 · Cited by 43
Cisler, J. M., Esbensen, K., Sellnow, K., Ross, M., Weaver, S., Sartin-Tarm, A., Herringa, R. J., & Kilts, C. D. (2019) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2018.08.014 · Cited by 44
Human online adaptation to changes in prior probability
Norton, E. H., Acerbi, L., Ma, W. J., & Landy, M. S. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006681 · Cited by 43
A computational account of threat-related attentional bias
Wise, T., Michely, J., Dayan, P., & Dolan, R. J. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007341 · Cited by 42
Catecholaminergic modulation of meta-learning
Cook, J. L., Swart, J. C., Froböse, M. I., Diaconescu, A. O., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2019) · eLife · doi:10.7554/elife.51439 · Cited by 58
Neural surprise in somatosensory Bayesian learning
Gijsen, S., Grundei, M., Lange, R. T., Ostwald, D., & Blankenburg, F. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008068 · Cited by 48
An examination of active inference in autistic adults using immersive virtual reality
Arthur, T., Harris, D., Buckingham, G., Brosnan, M., Wilson, M., Williams, G., & Vine, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-99864-y · Cited by 44
Emotion and reasoning in human decision-making
Rolls, E. T. (2019) · Economics · doi:10.5018/economics-ejournal.ja.2019-39 · Cited by 90
Models of Dynamic Belief Updating in Psychosis—A Review Across Different Computational Approaches
Katthagen, T., Fromm, S. P., Wieland, L., & Schlagenhauf, F. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.814111 · Cited by 53
Kuwabara, M., Mansouri, F. A., Buckley, M. J., & Tanaka, K. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3405-13.2014 · Cited by 43
Cognitive Control: Easy to Identify But Hard to Define
Morton, J. B., Ezekiel, F., & Wilk, H. A. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2011.01139.x · Cited by 42
Iigaya, K. (2016) · eLife · doi:10.7554/elife.18073 · Cited by 43
Neurons in the primate dorsal striatum signal the uncertainty of object–reward associations
White, J. K., & Monosov, I. E. (2016) · Nature Communications · doi:10.1038/ncomms12735 · Cited by 43
Beyond trial-by-trial adaptation: A quantification of the time scale of cognitive control.
Aben, B., Verguts, T., & den Bussche, E. V. (2017) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000324 · Cited by 48
Breaking human social decision making into multiple components and then putting them together again
Suzuki, S., & O’Doherty, J. P. (2020) · Cortex · doi:10.1016/j.cortex.2020.02.014 · Cited by 51
Interacting with volatile environments stabilizes hidden-state inference and its brain signatures
Weiss, A., Chambon, V., Lee, J. K., Drugowitsch, J., & Wyart, V. (2021) · Nature Communications · doi:10.1038/s41467-021-22396-6 · Cited by 49
Regional Gray Matter Volume Is Associated with Empathizing and Systemizing in Young Adults
Takeuchi, H., Taki, Y., Sassa, Y., Hashizume, H., Sekiguchi, A., Fukushima, A., & Kawashima, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084782 · Cited by 43
Corticostriatal Circuits Encode the Subjective Value of Perceived Control
Wang, K. S., & Delgado, M. R. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz045 · Cited by 42
Integrating computation into the mechanistic hierarchy in the cognitive and neural sciences
Elber‐Dorozko, L., & Shagrir, O. (2019) · Synthese · doi:10.1007/s11229-019-02230-9 · Cited by 44
Adaptive Engagement of Cognitive Control in Context-Dependent Decision Making
Waskom, M., Frank, M. C., & Wagner, A. D. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv333 · Cited by 52
On the origins of logarithmic number-to-position mapping.
Dotan, D., & Dehaene, S. (2016) · Psychological Review · doi:10.1037/rev0000038 · Cited by 46
Causal Evidence for Learning-Dependent Frontal Lobe Contributions to Cognitive Control
Muhle-Karbe, P. S., Jiang, J., & Egner, T. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1467-17.2017 · Cited by 46
Real-world unexpected outcomes predict city-level mood states and risk-taking behavior
Otto, A. R., & Eichstaedt, J. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0206923 · Cited by 46
Brown, V. M., Price, R. B., & Dombrovski, A. Y. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01080-w · Cited by 69
What are the Odds? The Neural Correlates of Active Choice during Gambling
Studer, B., Apergis-Schoute, A. M., Robbins, T. W., & Clark, L. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00046 · Cited by 49
Scholl, J., Günthner, J., Kolling, N., Favaron, E., Rushworth, M. F. S., Harmer, C. J., & Reinecke, A. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.144 · Cited by 43
Self-citationSchiffer, A.-M., Siletti, K., Waszak, F., & Yeung, N. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.08.057 · Cited by 41
Ninomiya, T., Noritake, A., Ullsperger, M., & Isoda, M. (2018) · Neuroscience Research · doi:10.1016/j.neures.2018.04.004 · Cited by 40
Dopamine, inference, and uncertainty
Gershman, S. J. (2017) · Neural Computation · doi:10.1162/neco_a_01023 · Cited by 40
“, 1982), as well as to more recent Bayesian incarnations (Behrens et al., 2007; Mathys et al., 2011; Nassar et al., 2010; Yu and Dayan, 2005).”
BackgroundChoice-confirmation bias and gradual perseveration in human reinforcement learning.
Palminteri, S. (2022) · Behavioral Neuroscience · doi:10.1037/bne0000541 · Cited by 54
Nassar, M. R., & Gold, J. I. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003015 · Cited by 46
Cisler, J. M., Bush, K., Steele, J., Lenow, J. K., Smitherman, S., & Kilts, C. D. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.02.014 · Cited by 50
Harlé, K. M., Zhang, S., Schiff, M. L., Mackey, S., Paulus, M. P., & Yu, A. J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01910 · Cited by 48
Neuroanatomical Substrates for Risk Behavior
Levy, I. (2016) · The Neuroscientist · doi:10.1177/1073858416672414 · Cited by 44
Stolyarova, A., & Izquierdo, A. (2017) · eLife · doi:10.7554/elife.27483 · Cited by 39
Altered neural encoding of prediction errors in assault-related posttraumatic stress disorder
Ross, M. C., Lenow, J. K., Kilts, C. D., & Cisler, J. M. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.05.008 · Cited by 46
Corrêa, C. M. C., Noorman, S., Jiang, J., Palminteri, S., Cohen, M. X., Lebreton, M. P., & van Gaal, S. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0457-18.2018 · Cited by 43
Pain Control by Co-adaptive Learning in a Brain-Machine Interface
Zhang, S., Yoshida, W., Mano, H., Yanagisawa, T., Mancini, F., Shibata, K., Kawato, M., & Seymour, B. (2020) · Current Biology · doi:10.1016/j.cub.2020.07.066 · Cited by 39
Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making
He, X., Modirshanechi, A., Lehmann, M. P., Gerstner, W., & Herzog, M. H. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009070 · Cited by 62
Integrated Bayesian models of learning and decision making for saccadic eye movements
Brodersen, K. H., Penny, W. D., Harrison, L. M., Daunizeau, J., Ruff, C. C., Duzel, E., Friston, K. J., & Stephan, K. E. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.08.007 · Cited by 40
Ullsperger, M. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.06.009 · Cited by 46
Hedging Your Bets by Learning Reward Correlations in the Human Brain
Wunderlich, K., Symmonds, M., Bossaerts, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.025 · Cited by 40
Noradrenergic and Cholinergic Modulation of Belief Updating
Jepma, M., Brown, S. B. R. E., Murphy, P. R., Koelewijn, S. C., de Vries, B., van den Maagdenberg, A. M., & Nieuwenhuis, S. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01317 · Cited by 39
Electroencephalographic correlates of temporal Bayesian belief updating and surprise
Visalli, A., Capizzi, M., Ambrosini, E., Kopp, B., & Vallesi, A. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.117867 · Cited by 46
Computational perspectives on human fear and anxiety
Yamamori, Y., & Robinson, O. J. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104959 · Cited by 46
An Active-Inference Approach to Second-Person Neuroscience
Lehmann, K., Bolis, D., Friston, K. J., Schilbach, L., Ramstead, M. J. D., & Kanske, P. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231188000 · Cited by 62
Altered Neural Processing of the Need to Stop in Young Adults at Risk for Stimulant Dependence
Harlé, K. M., Shenoy, P., Stewart, J. L., Tapert, S. F., Yu, A. J., & Paulus, M. P. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.2297-13.2014 · Cited by 42
Neural Evidence for Adaptive Strategy Selection in Value-Based Decision-Making
Gluth, S., Rieskamp, J., & Büchel, C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht049 · Cited by 46
Anchors aweigh: The impact of overlearning on entrenchment effects in statistical learning.
Bulgarelli, F., & Weiss, D. J. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000263 · Cited by 52
Coupled Decision Processes Update and Maintain Saccadic Priors in a Dynamic Environment
Kim, T. D., Kabir, M., & Gold, J. I. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.3078-16.2017 · Cited by 37
Unrealistic optimism in advice taking: A computational account.
Leong, Y. C., & Zaki, J. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000382 · Cited by 46
High reward enhances perceptual learning
Zhang, P., Hou, F., Yan, F.-F., Xi, J., Lin, B.-R., Zhao, J., Yang, J., Ge, C., Zhang, M.-Y., He, Q., et al. (2018) · Journal of Vision · doi:10.1167/18.8.11 · Cited by 49
Learning in Volatile Environments With the Bayes Factor Surprise
Liakoni, V., Modirshanechi, A., Gerstner, W., & Brea, J. (2021) · Neural Computation · doi:10.1162/neco_a_01352 · Cited by 46
Isoda, M. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-101420-011820 · Cited by 43
Modeling changes in probabilistic reinforcement learning during adolescence
Xia, L., Master, S. L., Eckstein, M. K., Baribault, B., Dahl, R. E., Wilbrecht, L., & Collins, A. G. E. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008524 · Cited by 47
Choosing Where to Attend and the Medial Frontal Cortex: An fMRI Study
Taylor, P. C. J., Rushworth, M. F. S., & Nobre, A. C. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90241.2008 · Cited by 44
Self-citationAnterior insula activity predicts the influence of positively framed messages on decision making
Krawitz, A., Fukunaga, R., & Brown, J. W. (2010) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.10.3.392 · Cited by 39
Value dynamics affect choice preparation during decision-making
Balewski, Z. Z., Elston, T. W., Knudsen, E. B., & Wallis, J. D. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01407-3 · Cited by 45
Implicit Value Updating Explains Transitive Inference Performance: The Betasort Model
Jensen, G., Muñoz, F., Alkan, Y., Ferrera, V. P., & Terrace, H. S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004523 · Cited by 38
Neural systems mediating recognition of changes in statistical regularities
Tobia, M. J., Iacovella, V., Davis, B., & Hasson, U. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.017 · Cited by 41
Shared Mechanisms for Confidence Judgements and Error Detection in Human Decision Making
Yeung, N., & Summerfield, C. (2014) · Springer eBooks · doi:10.1007/978-3-642-45190-4_7 · Cited by 43
O’Doherty, J. P. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08074.x · Cited by 38
Enhanced Population Coding for Rewarded Choices in the Medial Frontal Cortex of the Mouse
Siniscalchi, M. J., Wang, H., & Kwan, A. C. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhy292 · Cited by 37
A Developmental Cognitive Architecture for Trust and Theory of Mind in Humanoid Robots
Patacchiola, M., & Cangelosi, A. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3002892 · Cited by 42
Hester, R., Murphy, K., Brown, F. L., & Skilleter, A. J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2565-10.2010 · Cited by 37
Functional brain networks underlying detection and integration of disconfirmatory evidence
Lavigne, K. M., Metzak, P. D., & Woodward, T. S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.043 · Cited by 46
Hämmerer, D., Bonaiuto, J. J., Klein-Flügge, M. C., Bikson, M., & Bestmann, S. (2016) · Scientific Reports · doi:10.1038/srep25160 · Cited by 46
Model-based cognitive neuroscience: Multifield mechanistic integration in practice
Povich, M. (2019) · Theory & Psychology · doi:10.1177/0959354319863880 · Cited by 41
Uncertainty alters the balance between incremental learning and episodic memory
Nicholas, J., Daw, N. D., & Shohamy, D. (2022) · eLife · doi:10.7554/elife.81679 · Cited by 49
Temporal prediction errors modulate cingulate–insular coupling
Limongi, R., Sutherland, S. C., Zhu, J. M., Young, M. E., & Habib, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.078 · Cited by 36
The human prefrontal cortex mediates integration of potential causes behind observed outcomes
Wunderlich, K., Beierholm, U. R., Bossaerts, P., & O'Doherty, J. P. (2011) · Journal of Neurophysiology · doi:10.1152/jn.01051.2010 · Cited by 37
Prior preferences beneficially influence social and non-social learning
Tarantola, T., Kumaran, D., Dayan, P., & Martino, B. D. (2017) · Nature Communications · doi:10.1038/s41467-017-00826-8 · Cited by 49
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.