Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 801–900 of 1,013
Jia, W., Zhu, H., Ni, Y., Su, J., Xu, R., Jia, H., & Wan, X. (2019) · Human Brain Mapping · doi:10.1002/hbm.24887 · Cited by 34
The stability flexibility tradeoff and the dark side of detail
Nassar, M. R., & Troiani, V. (2020) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00848-8 · Cited by 33
Flexibility in valenced reinforcement learning computations across development
Nussenbaum, K., Velez, J. A., Washington, B. T., Hamling, H. E., & Hartley, C. A. (2022) · Child Development · doi:10.1111/cdev.13791 · Cited by 36
Expectancy and surprise predict neural and behavioral measures of attention to threatening stimuli
Browning, M. D., & Harmer, C. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.007 · Cited by 32
Attenuated behavioral and brain responses to trust violations among assaulted adolescent girls
Lenow, J. K., Steele, J., Smitherman, S., Kilts, C. D., & Cisler, J. M. (2014) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2014.04.005 · Cited by 28
Bayesian neural adjustment of inhibitory control predicts emergence of problem stimulant use
Harlé, K. M., Stewart, J. L., Zhang, S., Tapert, S. F., Yu, A. J., & Paulus, M. P. (2015) · Brain · doi:10.1093/brain/awv246 · Cited by 32
Aberg, K. C., Doell, K. C., & Schwartz, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0166675 · Cited by 32
Bayesian reinforcement learning: A basic overview
Kang, P., Tobler, P. N., & Dayan, P. (2024) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2024.107924 · Cited by 33
Learning bundles of stimuli renders stimulus order as a cue, not a confound
Qian, T., & Aslin, R. Ν. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416109111 · Cited by 26
Bubb, E. J., Aggleton, J. P., O’Mara, S. M., & Nelson, A. J. D. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa353 · Cited by 32
Mixing memory and desire: How memory reactivation supports deliberative decision‐making
Wang, S., Feng, S. F., & Bornstein, A. M. (2021) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1581 · Cited by 30
Relative salience signaling within a thalamo-orbitofrontal circuit governs learning rate
Namboodiri, V. M. K., Hobbs, T. G., Trujillo‐Pisanty, I., Simon, R. C., Hjort, M. M., & Stuber, G. D. (2021) · Current Biology · doi:10.1016/j.cub.2021.09.037 · Cited by 27
Harris, D., Arthur, T., Vine, S. J., Liu, J., Rahman, H. R. A., Han, F., & Wilson, M. (2022) · Scientific Reports · doi:10.1038/s41598-022-26544-w · Cited by 48
Cognitive Model Discovery via Disentangled RNNs
Miller, K. J., Eckstein, M. K., Botvinick, M., & Kurth-Nelson, Z. L. (2023) · neural information processing systems · doi:10.52202/075280-2682 · Cited by 53
Proactive Action Preparation: Seeing Action Preparation as a Continuous and Proactive Process
Pezzulo, G., & Ognibene, D. (2012) · Motor Control · doi:10.1123/mcj.16.3.386 · Cited by 28
Rationalizing Decision-Making: Understanding the Cost and Perception of Time
Namboodiri, V. M. K., Mihalaş, Ş., & Shuler, M. G. H. (2014) · Timing & Time Perception Reviews · doi:10.1163/24054496-00101004 · Cited by 29
Emulation as an integrating principle for cognition
Colder, B. W. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00054 · Cited by 31
Reward Sharpens Orientation Coding Independently of AttentionPreprint
Baldassi, S., & Simoncini, C. (2009) · Nature Precedings · doi:10.3389/fnins.2011.00013 · Cited by 31
Jung, Y., Schulte, T., Müller‐Oehring, E. M., Hawkes, W., Namkoong, K., Pfefferbaum, A., & Sullivan, E. V. (2013) · Cerebral Cortex · doi:10.1093/cercor/bht008 · Cited by 29
Neural substrates of updating the prediction through prediction error during decision making
Wang, Y., Ma, N., He, X., Li, N., Wei, Z., Yang, L., Zha, R., Han, L., Li, X., Zhang, D., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.05.041 · Cited by 27
Dissociable roles of medial and lateral PFC in rule learning
Cao, B., Li, W., Li, F., & Li, H. (2016) · Brain and Behavior · doi:10.1002/brb3.551 · Cited by 28
Models of neuromodulation for computational psychiatry
Iglesias, S., Tomiello, S., Schneebeli, M., & Stephan, K. E. (2017) · WIREs Cognitive Science · doi:10.1002/wcs.1420 · Cited by 26
Jung, E.-S., Dong, S.-Y., & Lee, S. Y. (2019) · Scientific Reports · doi:10.1038/s41598-019-46098-8 · Cited by 39
Weber, L. A. E., Tomiello, S., Schöbi, D., Wellstein, K. V., Mueller, D. R., Iglesias, S., & Stephan, K. E. (2022) · eLife · doi:10.7554/elife.74835 · Cited by 29
Surprise and novelty in the brain
Modirshanechi, A., Becker, S., Brea, J., & Gerstner, W. (2023) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2023.102758 · Cited by 39
Psychophysiological correlates of interpersonal cooperation and aggression
Wang, Y., Roberts, K., Yuan, B., Zhang, W., Shen, D., & Simons, R. F. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2013.04.008 · Cited by 29
Behavioral Game Theory and the Neural Basis of Strategic Choice
Camerer, C. F. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00013-0 · Cited by 32
Optimal structure of metaplasticity for adaptive learning
Khorsand, P., & Soltani, A. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005630 · Cited by 26
Flannery, J. S., Riedel, M. C., Bottenhorn, K. L., Poudel, R., Salo, T., Hill-Bowen, L. D., Laird, A. R., & Sutherland, M. T. (2019) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-019-00763-7 · Cited by 27
Integrating Media Selection and Media Effects Using Decision Theory
Fisher, J. T., & Hamilton, K. A. (2021) · Journal of Media Psychology Theories Methods and Applications · doi:10.1027/1864-1105/a000315 · Cited by 31
Emberson, L. L. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15002496 · Cited by 26
A Bayesian model of context-sensitive value attribution
Rigoli, F., Friston, K. J., Martinelli, C., Selaković, M., Shergill, S. S., & Dolan, R. J. (2016) · eLife · doi:10.7554/elife.16127 · Cited by 28
Using the past to estimate sensory uncertainty
Beierholm, U., Rohe, T., Ferrari, A., Stegle, O., & Noppeney, U. (2020) · eLife · doi:10.7554/elife.54172 · Cited by 31
Neurocomputational mechanisms underlying the subjective value of information
Goh, A. X.-A., Bennett, D., Bode, S., & Chong, T. T. ‐. (2021) · Communications Biology · doi:10.1038/s42003-021-02850-3 · Cited by 29
Never run a changing system: Action-effect contingency shapes prospective agency
Schwarz, K. A., Klaffehn, A. L., Hauke-Forman, N., Muth, F. V., & Pfister, R. (2022) · Cognition · doi:10.1016/j.cognition.2022.105250 · Cited by 27
Lee, C. T., Palacios, J., Richards, D., Hanlon, A. K., Lynch, K., Harty, S., Claus, N., Swords, L., O’Keane, V., Stephan, K. E., et al. (2023) · BMC Psychiatry · doi:10.1186/s12888-022-04462-5 · Cited by 25
Distinct value computations support rapid sequential decisions
Mah, A., Schiereck, S. S., Bossio, V., & Constantinople, C. M. (2023) · Nature Communications · doi:10.1038/s41467-023-43250-x · Cited by 26
Psychopathy-related traits and the use of reward and social information: a computational approach
Brazil, I. A., Hunt, L. T., Bulten, B. H., Kessels, R. P. C., de Bruijn, E. R. A., & Mars, R. B. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00952 · Cited by 31
Theta oscillations integrate functionally segregated sub-regions of the medial prefrontal cortex
Herrero, E. M., & Marco‐Pallarés, J. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.08.024 · Cited by 27
Weiss, A. R., Gillies, M. J., Philiastides, M. G., Apps, M. A. J., Whittington, M. A., FitzGerald, J. J., Boccard, S., Aziz, T. Z., & Green, A. L. (2018) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2018.00203 · Cited by 29
Computing Value from Quality and Quantity in Human Decision-Making
de Berker, A. O., Kurth-Nelson, Z. L., Rutledge, R. B., Bestmann, S., & Dolan, R. J. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0706-18.2018 · Cited by 26
Cingulate-centered large-scale networks: Normal functions, aging, and neurodegenerative disease
Touroutoglou, A., & Dickerson, B. C. (2019) · Handbook of clinical neurology · doi:10.1016/b978-0-444-64196-0.00008-x · Cited by 24
Marković, D., Goschke, T., & Kiebel, S. J. (2020) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00837-x · Cited by 29
Change is in the eye of the beholder
Yu, A. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3150 · Cited by 24
The bivalency effect: Evidence for flexible adjustment of cognitive control.
Rey-Mermet, A., & Meier, B. (2011) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0026024 · Cited by 24
Animal social learning: associations and adaptations
Reader, S. M. (2016) · F1000Research · doi:10.12688/f1000research.7922.1 · Cited by 31
Model-based estimation of subjective values using choice tasks with probabilistic feedback
Katahira, K., Yuki, S., & Okanoya, K. (2017) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2017.05.005 · Cited by 24
What is optimal in optimal inference?
Tavoni, G., Balasubramanian, V., & Gold, J. I. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.07.008 · Cited by 28
Harris, D., North, J. S., & Runswick, O. R. (2022) · Psychological Research · doi:10.1007/s00426-022-01687-7 · Cited by 29
Pulcu, E., Saunders, K., Harmer, C. J., Harrison, P. J., Goodwin, G. M., Geddes, J. R., & Browning, M. D. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2202983119 · Cited by 28
Joint Modelling of Latent Cognitive Mechanisms Shared Across Decision-Making Domains
Stevenson, N., Innes, R. J., Boag, R. J., Miletić, S., Isherwood, S. J., Trutti, A. C., Heathcote, A., & Forstmann, B. U. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-023-00192-3 · Cited by 33
Funamizu, A., Ito, M., Doya, K., Kanzaki, R., & Takahashi, H. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08025.x · Cited by 27
The impact of subjective cognitive decline on Iowa Gambling Task performance.
Smart, C. M., & Krawitz, A. (2015) · Neuropsychology · doi:10.1037/neu0000204 · Cited by 24
Morton, J. B. (2010) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.87 · Cited by 31
Conceptual representations in goal-directed decision making
Shea, N. J., Krug, K., & Tobler, P. N. (2008) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.8.4.418 · Cited by 29
Eickhoff, S. B., Pomjanski, W., Jakobs, O., Zilles, K., & Langner, R. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq188 · Cited by 24
Learned helplessness and generalization
Lieder, F., Goodman, N. D., & Huys, Q. J. M. (2013) · eScholarship (California Digital Library) · doi:10.5167/uzh-91430 · Cited by 21
Davis, B., & Hasson, U. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.001 · Cited by 25
Walentowska, W., Paul, K., Severo, M. C., Moors, A., & Pourtois, G. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2017.11.005 · Cited by 31
Klaming, R., Harlé, K. M., Infante, M. A., Bomyea, J. A., Kim, C., & Spadoni, A. D. (2018) · Neurobiology of Stress · doi:10.1016/j.ynstr.2018.09.009 · Cited by 35
Deterministic response strategies in a trial-and-error learning task
Mohr, H., Zwosta, K., Marković, D., Bitzer, S., Wolfensteller, U., & Ruge, H. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006621 · Cited by 31
Learning and forgetting using reinforced Bayesian change detection
Moens, V., & Zénon, A. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006713 · Cited by 27
Csifcsák, G., Melsæter, E., & Mittner, M. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01515 · Cited by 25
Human decision making anticipates future performance in motor learning
Moskowitz, J. B., Gale, D. J., Gallivan, J. P., Wolpert, D. M., & Flanagan, J. R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007632 · Cited by 24
Causal Role of the Dorsolateral Prefrontal Cortex in Belief Updating under Uncertainty
Schulreich, S., & Schwabe, L. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhaa219 · Cited by 28
Arthur, T., & Harris, D. (2021) · Cortex · doi:10.1016/j.cortex.2021.09.017 · Cited by 26
Ma, I., Westhoff, B., & van Duijvenvoorde, A. C. K. (2022) · Scientific Reports · doi:10.1038/s41598-022-09477-2 · Cited by 43
Natural Code of Subjective Experience
Суров, И. А. (2022) · Biosemiotics · doi:10.1007/s12304-022-09487-7 · Cited by 24
Chasing Unknown Bandits: Uncertainty Guidance in Learning and Decision Making
Speekenbrink, M. (2022) · Current Directions in Psychological Science · doi:10.1177/09637214221105051 · Cited by 34
Understanding the development of reward learning through the lens of meta-learning
Nussenbaum, K., & Hartley, C. A. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00304-1 · Cited by 42
Functional mechanisms of probabilistic inference in feature- and space-based attentional systems
Dombert, P. L., Kuhns, A. B., Mengotti, P., Fink, G. R., & Vossel, S. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.08.010 · Cited by 27
Li, P., Peng, W., Li, H., & Holroyd, C. B. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-0615-3 · Cited by 29
Statistical Learning and Inference Is Impaired in the Nonclinical Continuum of Psychosis
Dzafic, I., Randeniya, R., Harris, C. D., Bammel, M., & Garrido, M. I. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0315-20.2020 · Cited by 26
Dopaminergic challenge dissociates learning from primary versus secondary sources of information
Rybicki, A. J., Sowden, S., Schuster, B. A., & Cook, J. L. (2022) · eLife · doi:10.7554/elife.74893 · Cited by 25
Bayesian mixed-effects inference on classification performance in hierarchical datasets
Brodersen, K. H., Mathys, C. D., Chumbley, J. R., Daunizeau, J., Ong, C. S., Buchmann, J. M., & Stephan, K. E. (2012) · Journal of Machine Learning Research · doi:10.5167/uzh-71594 · Cited by 30
Walasek, N., Frankenhuis, W. E., & Panchanathan, K. (2022) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.2623 · Cited by 22
The orbitofrontal cortex represents advantageous choice in the Iowa gambling task
Zha, R., Li, P., Liu, Y., Li, N., Gao, M., Fan, Y., Aili, R., Liu, Y., Zhang, X., & Li, J. (2022) · Human Brain Mapping · doi:10.1002/hbm.25887 · Cited by 21
Natural General Intelligence: How understanding the brain can help us build AI
Summerfield, C. (2022) · doi:10.1093/oso/9780192843883.001.0001 · Cited by 40
Pramipexole Enhances Reward Learning by Preserving Value Estimates
Halahakoon, D. C., Kaltenboeck, A., Martens, M., Geddes, J. R., Harmer, C. J., Cowen, P. J., & Browning, M. D. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2023.05.023 · Cited by 29
Neural mechanisms of information seeking
Kobayashi, K., & Kable, J. W. (2024) · Neuron · doi:10.1016/j.neuron.2024.04.008 · Cited by 30
Neuropsychopharmacology of Cognitive Flexibility
Cools, R. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-397025-1.00253-0 · Cited by 28
Choice modulates the neural dynamics of prediction error processing during rewarded learning
Peterson, D. A., Lotz, D. T., Halgren, E., B, T. J. S. A., & Poizner, H. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.051 · Cited by 25
Social Expectations Bias Decision-Making in Uncertain Inter-Personal Situations
Ruz, M., Moser, A., & Webster, K. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0015762 · Cited by 27
Song, S., Gotts, S. J., Dayan, E., & Cohen, L. G. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00796 · Cited by 20
Excessive state switching underlies reversal learning deficits in cocaine users
Patzelt, E. H., Kurth-Nelson, Z. L., Lim, K. O., & MacDonald, A. W. (2013) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2013.09.029 · Cited by 30
An affective social tie mechanism: Theory, evidence, and implications
Bault, N., Fahrenfort, J. J., Pelloux, B., Ridderinkhof, K. R., & van Winden, F. A. A. M. (2017) · Journal of Economic Psychology · doi:10.1016/j.joep.2017.04.004 · Cited by 23
Stochastic feeding dynamics arise from the need for information and energy
Scholz, M., Dinner, A. R., Levine, E., & Biron, D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1703958114 · Cited by 25
State-change decisions and dorsomedial prefrontal cortex: the importance of time
Kolling, N., & O’Reilly, J. X. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.06.017 · Cited by 30
Neural signatures underlying deliberation in human foraging decisions
Abram, S. V., Hanke, M., Redish, A. D., & MacDonald, A. W. (2019) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-019-00733-z · Cited by 23
What Is the True Value of Forecasts?
Millner, A. (2009) · Weather Climate and Society · doi:10.1175/2009wcas1001.1 · Cited by 23
Understanding learning through uncertainty and bias
Bruckner, R., Heekeren, H. R., & Nassar, M. R. (2025) · Communications Psychology · doi:10.1038/s44271-025-00203-y · Cited by 49
Incremental implicit learning of bundles of statistical patterns
Qian, T., Jaeger, T. F., & Aslin, R. Ν. (2016) · Cognition · doi:10.1016/j.cognition.2016.09.002 · Cited by 25
Smith, R. S., Ahern, G. L., & Lane, R. D. (2019) · Handbook of clinical neurology · doi:10.1016/b978-0-444-64196-0.00006-6 · Cited by 30
Reduced Primacy Bias in Autism during Early Sensory Processing
Goris, J., Braem, S., Herck, S. V., Simoens, J., Deschrijver, E., Wiersema, J. R., Paton, B., Brass, M., & Todd, J. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.3088-20.2022 · Cited by 26
Brain Systems Underlying Fundamental Motivations of Human Social Conformity
Chen, X., Liu, J., Luo, Y., & Feng, C. (2022) · Neuroscience Bulletin · doi:10.1007/s12264-022-00960-4 · Cited by 33
Neural activity tracking identity and confidence in social information
Trudel, N., Lockwood, P. L., Rushworth, M. F. S., & Wittmann, M. K. (2023) · eLife · doi:10.7554/elife.71315 · Cited by 18
Self-citationAdaptive tuning of human learning and choice variability to unexpected uncertainty
Lee, J. K., Rouault, M., & Wyart, V. (2023) · Science Advances · doi:10.1126/sciadv.add0501 · Cited by 26
Whitman, J. C., Metzak, P. D., Lavigne, K. M., & Woodward, T. S. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.02.016 · Cited by 21
Adapting to change: The role of the right hemisphere in mental model building and updating.
Filipowicz, A., Anderson, B., & Danckert, J. A. (2016) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000078 · Cited by 27
Motivational deficits in schizophrenia relate to abnormalities in cortical learning rate signals
Hernaus, D., Xu, Z., Brown, E. C., Ruiz, R., Frank, M. J., Gold, J. M., & Waltz, J. A. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-0643-z · Cited by 29
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.