Learning the value of information in an uncertain world
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Our decisions are guided by outcomes that are associated with decisions made in the past. However, the amount of influence each past outcome has on our next decision remains unclear. To ensure optimal decision-making, the weight given to decision outcomes should reflect their salience in predicting future outcomes, and this salience should be modulated by the volatility of the reward environment. We show that human subjects assess volatility in an optimal manner and adjust decision-making accordingly. This optimal estimate of volatility is reflected in the fMRI signal in the anterior cingulate cortex (ACC) when each trial outcome is observed. When a new piece of information is witnessed, activity levels reflect its salience for predicting future outcomes. Furthermore, variations in this ACC signal across the population predict variations in subject learning rates. Our results provide a formal account of how we weigh our different experiences in guiding our future actions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the environment is volatile people should give more weight to recent sensory outcomes in building expectations about what they will see next (e.g. adopt a high α), in contrast they should give information from the distant past more weight when the environment is stable (e.g. adopt a low α) 8,9.”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“While computational studies of decision-making about rewards and punishments show that participants adapt their rate of learning about action-outcome contingencies in response to changes in environmental volatility 8–10”
From Adults with autism overestimate the volatility of the sensory environment (2017) · cites this paper as [8]
In the citing paper
“Previous work has shown that human learners indeed adjust their learning rate according to experimentally manipulated levels of volatility (Behrens et al., 2007).”
From The generalized Hierarchical Gaussian Filter (2026) · cites this paper as Behrens et al., 2007
In the citing paper
“This is known as hierarchical filtering and emphasizes the importance of taking into account the volatility of the environment, i.e., the temporal instability of its statistical structure, such as the probabilities by which one event causes another (Behrens et al., 2007; Mathys et al., 2011).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Behrens et al., 2007
In the citing paper
“The causal structure of the world, with its nested spatial and temporal scales, implies that the brain’s internal model also possesses a hierarchical structure, which is a natural form for Bayesian inference: hierarchical models allow to encode information about the precision of beliefs at one level by values of hierarchically higher levels (81–83) (Figure 3D).”
From Can Bayesian Theories of Autism Spectrum Disorder Help Improve Clinical Practice? (2016) · cites this paper as [82]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Engle, R. F. (1982) · Econometrica · doi:10.2307/1912773 · Cited by 20,795
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationKahneman, D., & Tversky, A. (1984) · American Psychologist · doi:10.1037/0003-066x.39.4.341 · Cited by 6,544
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Pearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023
Cited by
Items 901–1,000 of 1,013
Temporal chunking as a mechanism for unsupervised learning of task-sets
Bouchacourt, F., Palminteri, S., Koechlin, É., & Ostojic, S. (2020) · eLife · doi:10.7554/elife.50469 · Cited by 25
Humans adapt their anticipatory eye movements to the volatility of visual motion properties
Pasturel, C., Montagnini, A., & Perrinet, L. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007438 · Cited by 21
The interpretation of behavior-model correlations in unidentified cognitive models
van Maanen, L., & Miletić, S. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01783-y · Cited by 24
Lloyd, A., McKay, R., Hartman, T. K., Vincent, B. T., Murphy, J., Miller, J. G., Levita, L., Bennett, K. M., McBride, O., Martínez, A. P., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-98772-5 · Cited by 23
Investigating how Explicit Contextual Cues Affect Predictive Sensorimotor Control in Autistic Adults
Arthur, T., Brosnan, M., Harris, D., Buckingham, G., Wilson, M., Williams, G., & Vine, S. (2023) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-022-05718-5 · Cited by 20
A salience misattribution model for addictive-like behaviors
Kalhan, S., Redish, A. D., Hester, R., & Garrido, M. I. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.02.039 · Cited by 24
Moughrabi, N., Botsford, C., Gruichich, T. S., Azar, A., Heilicher, M. O., Hiser, J., Crombie, K. M., Dunsmoor, J. E., Stowe, Z. N., & Cisler, J. M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119709 · Cited by 23
Belief Updating in Subclinical and Clinical Delusions
Fromm, S. P., Katthagen, T., Deserno, L., Heinz, A., Kaminski, J. A., & Schlagenhauf, F. (2022) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgac074 · Cited by 27
Woo, J. H., Aguirre, C. G., Bari, B. A., Tsutsui, K., Grabenhorst, F., Cohen, J. Y., Schultz, W., Izquierdo, A., & Soltani, A. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01059-z · Cited by 25
Kreis, I. V., Zhang, L., Mittner, M., Syla, L., Lamm, C., & Pfuhl, G. (2023) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-023-01088-2 · Cited by 23
Rosenblau, G., Frolichs, K., & Korn, C. W. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105181 · Cited by 21
Neural and computational underpinnings of biased confidence in human reinforcement learning
Ting, C.-C., Salem-Garcia, N., Palminteri, S., Engelmann, J. B., & Lebreton, M. P. (2023) · Nature Communications · doi:10.1038/s41467-023-42589-5 · Cited by 26
Timing along the cardiac cycle modulates neural signals of reward-based learning
Fouragnan, E. F., Hosking, B., Cheung, Y. B., Prakash, B. A., Rushworth, M. F. S., & Sel, A. (2024) · Nature Communications · doi:10.1038/s41467-024-46921-5 · Cited by 27
Self-citationReward salience and risk aversion underlie differential ACC activity in substance dependence
Alexander, W. H., Fukunaga, R., Finn, P., & Brown, J. W. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.02.025 · Cited by 25
Differential representation of feedback and decision in adolescents and adults
Javadi, A., Schmidt, D. H. K., & Smolka, M. N. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.01.021 · Cited by 23
Tops, M., & Boksem, M. A. S. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00021 · Cited by 22
Learning and Generalization under Ambiguity: An fMRI Study
Chumbley, J. R., Flandin, G., Bach, D. R., Daunizeau, J., Fehr, E., Dolan, R. J., & Friston, K. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002346 · Cited by 20
Computational dissection of human episodic memory reveals mental process-specific genetic profiles
Lukšys, G., Fastenrath, M., Coynel, D., Freytag, V., Gschwind, L., Heck, A., Jessen, F., Maier, W., Milnik, A., Riedel-Heller, S. G., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1500860112 · Cited by 25
Caracheo, B. F., Emberly, E. G., Hadizadeh, S., Hyman, J. M., & Seamans, J. K. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00074 · Cited by 24
Temporal trade-offs in psychophysics
Barack, D. L., & Gold, J. I. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2016.01.015 · Cited by 23
Marshall, A. T., & Kirkpatrick, K. (2017) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000141 · Cited by 20
Differentiating between Models of Perceptual Decision Making Using Pupil Size Inferred Confidence
Kawaguchi, K., Clery, S., Pourriahi, P., Seillier, L., Haefner, R. M., & Nienborg, H. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.0735-18.2018 · Cited by 25
Beyond the average: The role of variable reward sensitivity in eating disorders
Neuser, M. P., Kühnel, A., Svaldi, J., & Kroemer, N. B. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.112971 · Cited by 22
Individual differences in learning positive affective value
Wuensch, L., Pool, E. R., & Sander, D. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.11.001 · Cited by 19
Differential neural mechanisms for early and late prediction error detection
Malekshahi, R., Seth, A. K., Papanikolaou, A., Mathews, Z., Birbaumer, N., Verschure, P. F. M. J., & Carìa, A. (2016) · Scientific Reports · doi:10.1038/srep24350 · Cited by 29
Integrating Benefits and Costs in Decision Making
Wallis, J. D., & Rushworth, M. F. S. (2013) · Elsevier eBooks · doi:10.1016/b978-0-12-416008-8.00022-x · Cited by 22
Self-citationKahnt, T., & Tobler, P. N. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-805308-9.00009-9 · Cited by 27
Dollé, L., Chavarriaga, R., Guillot, A., & Khamassi, M. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006092 · Cited by 25
Strategies for navigating a dynamic world
Kumar, S., & Gläscher, J. P. (2020) · Science · doi:10.1126/science.abd7258 · Cited by 20
Aubert‐Teillaud, B., Bran, A., & Vaidis, D. C. (2023) · European Journal of Social Psychology · doi:10.1002/ejsp.2981 · Cited by 19
Barnaveli, I., Viganò, S., Reznik, D., Haggard, P., & Doeller, C. F. (2025) · Nature Communications · doi:10.1038/s41467-025-59153-y · Cited by 25
Computational models as statistical tools
Durstewitz, D., Koppe, G., & Toutounji, H. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.07.004 · Cited by 24
Decision-making in brains and robots — the case for an interdisciplinary approach
Lee, S. W., & Seymour, B. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.12.012 · Cited by 22
van Geen, C., & Gerraty, R. T. (2021) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2021.102602 · Cited by 22
Armbruster‐Genc, D., Valton, V., Neil, L., Vuong, V., Freeman, Z., Packer, K. C., Kiffin, M. J., Roiser, J. P., Viding, E. M., & McCrory, E. J. P. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-022-01284-7 · Cited by 22
General Pavlovian-to-instrumental transfer in humans: Evidence from Bayesian inference
Degni, L., Dalbagno, D., Starita, F., Benassi, M., di Pellegrino, G., & Garofalo, S. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.945503 · Cited by 25
Paradoxical choice and the reinforcing value of information
Ajuwon, V., Ojeda, A., Murphy, R. A., Monteiro, T., & Kacelnik, A. (2022) · Animal Cognition · doi:10.1007/s10071-022-01698-2 · Cited by 23
Experiential values are underweighted in decisions involving symbolic options
Garcia, B., Lebreton, M. P., Bourgeois‐Gironde, S., & Palminteri, S. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01496-3 · Cited by 38
Having multiple selves helps learning agents explore and adapt in complex changing worlds
Dulberg, Z., Dubey, R., Berwian, I. M., & Cohen, J. D. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2221180120 · Cited by 35
Ger, Y., Nachmani, E., Wolf, L., & Shahar, N. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011678 · Cited by 26
Tracking subjects’ strategies in behavioural choice experiments at trial resolution
Maggi, S., Hock, R. M., O’Neill, M. J., Buckley, M. J., Moran, P. M., Bast, T., Sami, M. B., & Humphries, M. D. (2024) · eLife · doi:10.7554/elife.86491 · Cited by 25
Clairis, N., & Pessiglione, M. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1176-23.2024 · Cited by 31
Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
Tanaka, S., Pan, X., Oguchi, M., Taylor, J. E., & Sakagami, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00995 · Cited by 22
Multiple cognitive control effects of error likelihood and conflict
Brown, J. W. (2008) · Psychological Research · doi:10.1007/s00426-008-0198-7 · Cited by 21
BAIAP2 Is Related to Emotional Modulation of Human Memory Strength
Lukšys, G., Ackermann, S., Coynel, D., Fastenrath, M., Gschwind, L., Heck, A., Rasch, B., Spalek, K., Vogler, C., Papassotiropoulos, A., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0083707 · Cited by 18
Task-Specific Response Strategy Selection on the Basis of Recent Training Experience
Fulvio, J. M., Green, C. S., & Schrater, P. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003425 · Cited by 19
Congruence of Inherent and Acquired Values Facilitates Reward-Based Decision-Making
Chien, S., Wiehler, A., Spezio, M., & Gläscher, J. P. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.3084-15.2016 · Cited by 19
Paliwal, S., Mosley, P. E., Breakspear, M. J., Coyne, T. J., Silburn, P. A., Aponte, E. A., Mathys, C. D., & Stephan, K. E. (2019) · Scientific Reports · doi:10.1038/s41598-019-51164-2 · Cited by 21
Confluence of Timing and Reward Biases in Perceptual Decision-Making Dynamics
Shinn, M., Ehrlich, D. B., Lee, D., Murray, J. D., & Seo, H. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0544-20.2020 · Cited by 20
Porter, B. S., Li, K., & Hillman, K. L. (2020) · eNeuro · doi:10.1523/eneuro.0243-20.2020 · Cited by 18
Self-Controlled Choice Arises from Dynamic Prefrontal Signals That Enable Future Anticipation
Tanaka, D., Aoki, R., Suzuki, S., Takeda, M., Nakahara, K., & Jimura, K. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1702-20.2020 · Cited by 20
Dynamic Representation of the Subjective Value of Information
Kobayashi, K., Lee, S., Filipowicz, A. L. S., McGaughey, K. D., Kable, J. W., & Nassar, M. R. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.0423-21.2021 · Cited by 21
Independent and interacting value systems for reward and information in the human brain
Dezza, I. C., Cleeremans, A., & Alexander, W. H. (2022) · eLife · doi:10.7554/elife.66358 · Cited by 26
Wischnewski, M., & Compen, B. (2022) · Behavioural Brain Research · doi:10.1016/j.bbr.2022.113840 · Cited by 20
Bayesian computational markers of relapse in methamphetamine dependence
Harlé, K. M., Yu, A. J., & Paulus, M. P. (2019) · NeuroImage Clinical · doi:10.1016/j.nicl.2019.101794 · Cited by 20
O’Doherty, J. P., & Bossaerts, P. L. (2008) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2008.00560.x · Cited by 25
Zhang, Y., Paik, J., & Pirolli, P. (2015) · Topics in Cognitive Science · doi:10.1111/tops.12143 · Cited by 18
Frontostriatal contribution to the interplay of flexibility and stability in serial prediction
Trempler, I., Schiffer, A.-M., El-Sourani, N., Ahlheim, C., Fink, G. R., & Schubotz, R. I. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01040 · Cited by 18
Combrisson, E., Basanisi, R., Neri, M., Auzias, G., Petri, G., Marinazzo, D., Panzeri, S., & Brovelli, A. (2025) · Nature Communications · doi:10.1038/s41467-025-62507-1 · Cited by 23
Rapidly Measuring the Speed of Unconscious Learning: Amnesics Learn Quickly and Happy People Slowly
Dienes, Z. P., Baddeley, R., & Jansari, A. S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033400 · Cited by 18
Evidence Neutrality and the Moral Value of Information
Askell, A. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780198841364.003.0003 · Cited by 19
Isomorphic decisional biases across perceptual tasks
Treviño, M., Castiello, S., Arias-Carrión, Ó., de la Torre-Valdovinos, B., & Leon, R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245890 · Cited by 18
Peters, A., Sprengell, M., & Kubera, B. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104847 · Cited by 20
Ez‐zizi, A., Farrell, S., Leslie, D. S., Malhotra, G., & Ludwig, C. J. H. (2023) · Computational Brain & Behavior · doi:10.1007/s42113-022-00165-y · Cited by 21
Toyama, A., Katahira, K., & Kunisato, Y. (2023) · Computational Brain & Behavior · doi:10.1007/s42113-023-00175-4 · Cited by 22
Pupil Size Encodes Uncertainty during Exploration
Fan, H., Burke, T. D., Sambrano, D. C., Dial, E., Phelps, E. A., & Gershman, S. J. (2023) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02025 · Cited by 26
Beyond peaks and troughs: Multiplexed performance monitoring signals in the EEG
Ullsperger, M. (2024) · Psychophysiology · doi:10.1111/psyp.14553 · Cited by 24
Dopamine transients encode reward prediction errors independent of learning rates
Mah, A., Golden, C. E. M., & Constantinople, C. M. (2024) · Cell Reports · doi:10.1016/j.celrep.2024.114840 · Cited by 23
Mullette-Gillman, O. A., & Huettel, S. A. (2009) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.023.2009 · Cited by 20
Prospective and Pavlovian mechanisms in aversive behaviour
Rigoli, F., Pezzulo, G., & Dolan, R. J. (2015) · Cognition · doi:10.1016/j.cognition.2015.10.017 · Cited by 18
Analyzing dynamic decision-making models using Chapman-Kolmogorov equations
Barendregt, N. W., Josić́, K., & Kilpatrick, Z. P. (2019) · Journal of Computational Neuroscience · doi:10.1007/s10827-019-00733-5 · Cited by 21
The neural correlates of exploration
Hassall, C. D. (2019) · Neuroscience · Cited by 18
An association between prediction errors and risk-seeking: Theory and behavioral evidence
Möller, M., Grohn, J., Manohar, S., & Bogacz, R. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009213 · Cited by 20
Maximizing masquerading as matching in human visual search choice behavior.
Yu, A. J., & Huang, H. (2014) · Decision · doi:10.1037/dec0000013 · Cited by 25
The Role of Reward in Dynamic Decision Making
Osman, M. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00035 · Cited by 21
To prevent means to know: Explicit but no implicit agency for prevention behavior
Pfister, R., Tonn, S., Weller, L., Kunde, W., & Schwarz, K. A. (2020) · Cognition · doi:10.1016/j.cognition.2020.104489 · Cited by 21
Wroblewski, A., Hollandt, M., Yang, Y., Ridderbusch, I. C., Pietzner, A., Szeska, C., Lotze, M., Wïttchen, H., Heinig, I., Pittig, A., et al. (2022) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2022.09.001 · Cited by 21
Suzuki, S., Zhang, X., Dezfouli, A., Braganza, L., Fulcher, B., Parkes, L., Fontenelle, L. F., Harrison, B. J., Murawski, C., Yücel, M., et al. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002031 · Cited by 21
P3-like signatures of temporal predictions: a computational EEG study
Visalli, A., Capizzi, M., Ambrosini, E., Kopp, B., & Vallesi, A. (2023) · Experimental Brain Research · doi:10.1007/s00221-023-06656-z · Cited by 20
Directional uncertainty in chase and escape dynamics.
Treviño, M., y León, R. M., Támez, S., Beltrán-Navarro, B., & Verdugo, J. (2023) · Journal of Experimental Psychology General · doi:10.1037/xge0001510 · Cited by 16
Striatal and Behavioral Responses to Reward Vary by Socioeconomic Status in Adolescents
Decker, A. L., Meisler, S. L., Hubbard, N. A., Bauer, C. C. C., Leonard, J., Grotzinger, H., Giebler, M. A., Torres, Y. C., Imhof, A., Romeo, R. R., et al. (2024) · Journal of Neuroscience · doi:10.1523/jneurosci.1633-23.2023 · Cited by 18
Hierarchical control over foraging behavior by anterior cingulate cortex
Alejandro, R. J., & Holroyd, C. B. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105623 · Cited by 18
Lloyd, A., Roiser, J. P., Skeen, S., Freeman, Z., Badalova, A., Agunbiade, A., Busakhwe, C., DeFlorio, C., Marcu, A., Pirie, H., et al. (2024) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-024-01186-9 · Cited by 17
Uncertainty and expectancy deviations require cortico-subcortical cooperation
Mestres-Missé, A., Trampel, R., Turner, R., & Kotz, S. A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.05.069 · Cited by 22
Kwok, S. C., & Macaluso, E. (2015) · Scientific Reports · doi:10.1038/srep11248 · Cited by 19
A Computational Role for Top–Down Modulation from Frontal Cortex in Infancy
Jaffe‐Dax, S., Boldin, A. M., Daw, N. D., & Emberson, L. L. (2019) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01497 · Cited by 19
Dey, A., & Bugg, J. M. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-020-00853-x · Cited by 18
Electrophysiological Signatures of Hierarchical Learning
Liu, M., Dong, W., Qin, S., Verguts, T., & Chen, Q. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab245 · Cited by 17
Feedback-related EEG dynamics separately reflect decision parameters, biases, and future choices
Kirschner, H., Fischer, A. G., & Ullsperger, M. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119437 · Cited by 19
Tecilla, M., Großbach, M., Gentile, G., Holland, P. W. H., Sporn, S., Antonini, A., & Ruiz, M. H. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.1583-22.2022 · Cited by 20
Stubborn Predictions in Primary Visual Cortex
Yon, D., Thomas, E. R., Gilbert, S. J., de Lange, F. P., Kok, P., & Press, C. (2023) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01997 · Cited by 21
Reinforcement Learning, High-Level Cognition, and the Human Brain
Silvetti, M., & Verguts, T. (2012) · InTech eBooks · doi:10.5772/23471 · Cited by 20
Posterior Weighted Reinforcement Learning with State Uncertainty
Larsen, T., Leslie, D. S., Collins, E. J., & Bogacz, R. (2010) · Neural Computation · doi:10.1162/neco.2010.01-09-948 · Cited by 19
Altered Trust Learning Mechanisms Among Female Adolescent Victims of Interpersonal Violence
Lenow, J. K., Cisler, J. M., & Bush, K. (2015) · Journal of Interpersonal Violence · doi:10.1177/0886260515604411 · Cited by 19
CACNA1C gene regulates behavioral strategies in operant rule learning
Koppe, G., Mallien, A. S., Berger, S. M., Bartsch, D., Gass, P., Vollmayr, B., & Durstewitz, D. (2017) · PLoS Biology · doi:10.1371/journal.pbio.2000936 · Cited by 19
Orbital Frontal Cortex Projections to Secondary Motor Cortex Mediate Exploitation of Learned Rules
Schreiner, D. C., & Gremel, C. M. (2018) · Scientific Reports · doi:10.1038/s41598-018-29285-x · Cited by 17
Neural Mechanisms of Reward Prediction Error in Autism Spectrum Disorder
Mosner, M. G., McLaurin, R. E., Kinard, J. L., Hakimi, S., Parelman, J. M., Shah, J. S., Bizzell, J., Greene, R. K., Cernasov, P., Walsh, E. C., et al. (2019) · Autism Research and Treatment · doi:10.1155/2019/5469191 · Cited by 27
Cerebral reorganization in Parkinson's disease.
Helmich, R. C. G. (2011) · Radboud Repository (Radboud University) · Cited by 111
Computational neuroimaging: localising Greek letters? Comment on Forstmann et al.
O’Reilly, J. X., & Mars, R. B. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.07.012 · Cited by 21
Neural Bases of Performance Monitoring
Ullsperger, M. (2017) · Wiley eBooks · doi:10.1002/9781118920497.ch17 · Cited by 18
Metadata
- Authors
- Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S.
- Affiliations
- John Radcliffe Hospital (GB)
- University of Oxford (GB)
- Corresponding author
- Behrens, Timothy E J
- Venue
- Nature Neuroscience
- Published
- 2007-08-05
- Volume
- 10
- Issue
- 9
- Pages
- 1214-1221
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2123429050
- Cited by
- 2,053
- References
- 52
- Citations by year
- 2026: 122 · 2025: 163 · 2024: 156 · 2023: 135 · 2022: 139 · 2021: 128 · 2020: 133 · 2019: 134 · 2018: 108 · 2017: 108 · 2016: 121 · 2015: 101 · 2014: 87 · 2013: 91 · 2012: 88
- FWCI
- 27.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Wellcome Trust
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- value of information, uncertainty, optimal learning, anterior cingulate cortex, learning rate, Bayesian decision making, human learning, fMRI decoding
- MeSH terms
- Adolescent, Adult, Bayes Theorem, Brain Mapping, Decision Making, Female, Gyrus Cinguli, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Oxygen, Pattern Recognition, Visual, Photic Stimulation, Probability, Reaction Time, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.