Neural Mechanisms of Foraging
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Behavioral economic studies involving limited numbers of choices have provided key insights into neural decision-making mechanisms. By contrast, animals' foraging choices arise in the context of sequences of encounters with prey or food. On each encounter, the animal chooses whether to engage or, if the environment is sufficiently rich, to search elsewhere. The cost of foraging is also critical. We demonstrate that humans can alternate between two modes of choice, comparative decision-making and foraging, depending on distinct neural mechanisms in ventromedial prefrontal cortex (vmPFC) and anterior cingulate cortex (ACC) using distinct reference frames; in ACC, choice variables are represented in invariant reference to foraging or searching for alternatives. Whereas vmPFC encodes values of specific well-defined options, ACC encodes the average value of the foraging environment and cost of foraging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The study reported here extends this notion by showing that this region not only processes the SV of an offer but also integrates effort and reward information independent of the nature of the effort cost [50, 52, 54].”
From Neurocomputational mechanisms underlying subjective valuation of effort costs (2017) · cites this paper as [52]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although the neural mechanisms computing relevance are very poorly understood, lesion studies in monkeys and rats suggests that they depend on the frontal lobes. The studies implicate the dorsolateral prefrontal cortex, the anterior cingulate cortex and the orbital frontal cortex in this computation (sometimes referred to as a “credit assignment” computation) (Kolling et al., 2012; Rossi et al., 2”
From Attention, learning, and the value of information (2012) · cites this paper as Kolling et al., 2012
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in functional and structural MR image analysis and implementation as FSL
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., Bannister, P. R., De Luca, M., Drobnjak, I., Flitney, D. E., et al. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.051 · Cited by 13,630
Self-citationFast robust automated brain extraction
Smith, S. M. (2002) · Human Brain Mapping · doi:10.1002/hbm.10062 · Cited by 10,496
Optimal foraging, the marginal value theorem
Charnov, E. L. (1976) · Theoretical Population Biology · doi:10.1016/0040-5809(76)90040-x · Cited by 5,374
Psychophysiological and Modulatory Interactions in Neuroimaging
Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., & Dolan, R. J. (1997) · NeuroImage · doi:10.1006/nimg.1997.0291 · Cited by 3,097
Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0931 · Cited by 2,852
Can cognitive processes be inferred from neuroimaging data?
POLDRACK, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.004 · Cited by 2,249
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Multilevel linear modelling for FMRI group analysis using Bayesian inference
Woolrich, M. W., Behrens, T. E. J., Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.023 · Cited by 1,728
Self-citationGeneral multilevel linear modeling for group analysis in FMRI
Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00435-x · Cited by 1,476
Conflict monitoring and decision making: Reconciling two perspectives on anterior cingulate function
BOTVINICK, M. M. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.356 · Cited by 1,117
Research works printed but not linked: 1
- Stephens DW Krebs JR Foraging Theory 1986 Princeton University Press Princeton, NJ
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
“For instance, Kolling et al. (2012) had participants make a series of choices between pairs of options that yielded probabilistic payoffs with known means.”
Emotion and the prefrontal cortex: an integrative review
Dixon, M. L., Thiruchselvam, R., Todd, R., & Christoff, K. (2017) · Psychological Bulletin · doi:10.1037/bul0000096 · Cited by 745
Neurophysiology of performance monitoring and adaptive behavior
Ullsperger, M., Danielmeier, C., & Jocham, G. (2014) · Physiological Reviews · doi:10.1152/physrev.00041.2012 · Cited by 634
Dorsal anterior cingulate cortex and the value of control
Shenhav, A., Cohen, J. D., & Botvinick, M. M. (2016) · Nature Neuroscience · doi:10.1038/nn.4384 · Cited by 565
Distinct behavioural and network correlates of two interneuron types in prefrontal cortex
Kvitsiani, D., Ranade, S., Hangya, B., Taniguchi, H., Huang, J. Z., & Kepecs, A. (2013) · Nature · doi:10.1038/nature12176 · Cited by 516
Dorsal Anterior Cingulate Cortex: A Bottom-Up View
Heilbronner, S. R., & Hayden, B. Y. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013952 · Cited by 455
“…evidence has suggested that the dACC preferentially represents the value of the nondefault option, and the vmPFC represents the value of the default (Blanchard & Hayden 2014, Boorman et al. 2013, Kolling et al. 2012, Strait et al. www.annualreviews.org • Dorsal Anterior Cingulate Cortex 159 A nn u.”
Value, search, persistence and model updating in anterior cingulate cortex
Kolling, N., Wittmann, M. K., Behrens, T. E. J., Boorman, E. D., Mars, R. B., & Rushworth, M. F. S. (2016) · Nature Neuroscience · doi:10.1038/nn.4382 · Cited by 444
Self-citationThe Structure of Cognition: Attentional Episodes in Mind and Brain
Duncan, J. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.015 · Cited by 471
The hippocampal–prefrontal pathway: The weak link in psychiatric disorders?
Godsil, B. P., Kiss, J. P., Spedding, M., & Jay, T. M. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.10.018 · Cited by 434
Foundations of human reasoning in the prefrontal cortex
Donoso, M., Collins, A. G. E., & Koechlin, E. (2014) · Science · doi:10.1126/science.1252254 · Cited by 406
Decision Making and Sequential Sampling from Memory
Shadlen, M. N., & Shohamy, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.036 · Cited by 418
A computational model of inhibitory control in frontal cortex and basal ganglia.
Wiecki, T. V., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0031542 · Cited by 404
“Thus our model synthesizes the popular account of dACC in terms of response conflict (Bot-vinick, Braver, Barch, Carter, & Cohen, 2001) with recent studies suggesting that dACC rather reflects the value of the alternative action (Kolling et al., 2012).”
BackgroundMethodNeurocomputational mechanisms underlying subjective valuation of effort costs
Chong, T. T.-J., Apps, M., Giehl, K., Sillence, A., Grima, L. L., & Husain, M. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002598 · Cited by 415
Dissociable effects of surprise and model update in parietal and anterior cingulate cortex
O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305373110 · Cited by 378
Self-citationNeubert, F.-X., Mars, R. B., Sallet, J., & Rushworth, M. F. S. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1410767112 · Cited by 375
“The fMRI coupling pattern associated with the more dorsal of these, area d32, resembled the coupling pattern of the dorsal pgACC area linked to cost-benefit decision making during foraging (10).”
BackgroundInfluentialSelf-citationA labor/leisure tradeoff in cognitive control.
Kool, W., & Botvinick, M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0031048 · Cited by 320
“…tradeoff demonstrated in our experiments may address a high-level instantiation of the exploitation/exploration tradeoff that arises in reinforcement-learning models of reward-based decision making (Cohen, McClure, & Yu, 2007) and of foraging (Kolling, Behrens, Mars, & Rushworth, 2012).”
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380
Valuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309
“com Although ACC activity was always positively correlated with the value of searching, regardless of the choice taken, the search signal increased more rapidly when subjects chose to search [38] (Figure 3d).”
BackgroundResultInfluentialSelf-citationAction Monitoring and Medial Frontal Cortex: Leading Role of Supplementary Motor Area
Bonini, F., Burle, B., Liégeois-Chauvel, C., Régis, J., Chauvel, P., & Vidal, F. (2014) · Science · doi:10.1126/science.1247412 · Cited by 272
Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value
Shenhav, A., Straccia, M. A., Cohen, J. D., & Botvinick, M. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3771 · Cited by 277
“Color maps represent t statistics, ranging from 2.6 to 8.0. a Experiment 2, stage 1 P re di ct ed d A C C a ct iv ity RVs tested in Exp 1, Exp 2, and Kolling et al., 2012 RVs tested in Exp 2 only Relative value of foraging RVforage = 0 RVforage-C = 0 Foraging value account Choice difficulty…”
MethodInfluentialModel-based choices involve prospective neural activity
Doll, B. B., Duncan, K. D., Simon, D. A., Shohamy, D., & Daw, N. D. (2015) · Nature Neuroscience · doi:10.1038/nn.3981 · Cited by 283
Polanía, R., Krajbich, I., Grueschow, M., & Ruff, C. C. (2014) · Neuron · doi:10.1016/j.neuron.2014.03.014 · Cited by 265
“Although the relatively low spatial resolution of EEG recordings does not allow us to conclude the involvement of specific prefrontal sites, the ACC and dmPFC are certainly candidate regions that may generate the fronto-central beta-band activity that negatively followed the predicted EA signal, possibly reflecting va…”
InfluentialForaging for foundations in decision neuroscience: insights from ethology
Mobbs, D., Trimmer, P. C., Blumstein, D. T., & Dayan, P. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0010-7 · Cited by 264
Computational mechanisms of curiosity and goal-directed exploration
Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H., Kronbichler, M., & Friston, K. J. (2019) · eLife · doi:10.7554/elife.41703 · Cited by 254
“…choices and information gain have been correlated with activity in the insula and dorsal anterior cingulate cortex ( Blanchard and Gershman, 2018 ; Kolling et al., 2012 ; Muller et al., 2019 ; van Lieshout et al., 2018 ) as well as the rostrolateral prefrontal cortex ( Badre et al., 2012 ; Daw et…”
BackgroundKragel, P. A., Kano, M., Van Oudenhove, L., Ly, H. G., Dupont, P., Rubio, A., Delon-Martin, C., Bonaz, B. L., Manuck, S. B., Gianaros, P. J., et al. (2018) · Nature Neuroscience · doi:10.1038/s41593-017-0051-7 · Cited by 272
Klein-Flügge, M. C., Kennerley, S. W., Friston, K., & Bestmann, S. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.0292-16.2016 · Cited by 243
Dopamine modulates novelty seeking behavior during decision making.
Costa, V. D., Tran, V. L., Turchi, J., & Averbeck, B. B. (2014) · Behavioral Neuroscience · doi:10.1037/a0037128 · Cited by 263
Executive control and decision-making in the prefrontal cortex
Domenech, P., & Koechlin, E. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2014.10.007 · Cited by 236
Learning the opportunity cost of time in a patch-foraging task
Constantino, S. M., & Daw, N. D. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0350-y · Cited by 236
“The two sorts of choices have been most directly contrasted in a recent fMRI study (Kolling et al., 2012), supporting this anatomical dissociation, although another study using the task has argued for a different intepretation of the ACC response (Shenhav, Straccia, Cohen, & Botvinick, 2014).”
InfluentialNetwork Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty
Karlsson, M. P., Tervo, D. G. R., & Karpova, A. Y. (2012) · Science · doi:10.1126/science.1226518 · Cited by 236
Multiple signals in anterior cingulate cortex
Kolling, N., Behrens, T., Wittmann, M., & Rushworth, M. (2016) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.12.007 · Cited by 249
“(b) Previous reports [19] of search value related activity emphasized a similar ACC location [MNI, 4, 28, 30, yellow].”
BackgroundInfluentialSelf-citationGeneralization guides human exploration in vast decision spaces
Wu, C. M., Schulz, E., Speekenbrink, M., Nelson, J. D., & Meder, B. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0467-4 · Cited by 242
A distributed, hierarchical and recurrent framework for reward-based choice
Hunt, L. T., & Hayden, B. Y. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2017.7 · Cited by 244
Medial and orbital frontal cortex in decision-making and flexible behavior
Klein-Flügge, M. C., Bongioanni, A., & Rushworth, M. F. S. (2022) · Neuron · doi:10.1016/j.neuron.2022.05.022 · Cited by 244
Self-citationAttention, learning, and the value of information
Gottlieb, J. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.034 · Cited by 241
“…the anterior cingulate cortex, and the orbital frontal cortex in this computation (sometimes referred to as a ‘‘credit assignment’’ computation) (Kolling et al., 2012; Rossi et al., 2009; Rushworth et al., 2011; Walton et al., 2011) and suggest that these areas may convey the results to…”
ResultIdentity-specific coding of future rewards in the human orbitofrontal cortex
Howard, J. D., Gottfried, J. A., Tobler, P. N., & Kahnt, T. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1503550112 · Cited by 221
Inferences on a multidimensional social hierarchy use a grid-like code
Park, S. A., Miller, D. S., & Boorman, E. D. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00916-3 · Cited by 207
“13 Zhou, J. et al. (2019) ‘Complementary Task Structure Representations in Hippocampus and Orbitofrontal Cortex during an Odor Sequence Task’, Current Biology.”
BackgroundHaber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
“Indeed, imaging data suggest that, as the context changes, different cortical regions may exert different levels of influence over behavior on a trialby-trial basis (Hunt et al., 2013; Kolling et al., 2012; Lee et al., 2014).”
BackgroundSelf-citationAn Agent Independent Axis for Executed and Modeled Choice in Medial Prefrontal Cortex
Nicolle, A., Klein-Flügge, M. C., Hunt, L. T., Vlaev, I., Dolan, R. J., & Behrens, T. E. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.07.023 · Cited by 224
“This latter region is commonly implicated in valuation and choice, with opposing coding to vmPFC (Hare et al., 2011; Kolling et al., 2012; Wunder-lich et al., 2009).”
BackgroundSelf-citationFouragnan, E. F., Chau, B. K. H., Folloni, D., Kolling, N., Verhagen, L., Klein-Flügge, M., Tankelevitch, L., Papageorgiou, G. K., Aubry, J.-F., Sallet, J., et al. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0375-6 · Cited by 213
Self-citationComputational noise in reward-guided learning drives behavioral variability in volatile environments
Findling, C., Skvortsova, V., Dromnelle, R., Palminteri, S., & Wyart, V. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0518-9 · Cited by 196
Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model.
Holroyd, C. B., & McClure, S. M. (2015) · Psychological Review · doi:10.1037/a0038339 · Cited by 198
The algorithmic architecture of exploration in the human brain
Schulz, E., & Gershman, S. J. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.11.003 · Cited by 184
Decision Making: The Neuroethological Turn
Pearson, J. M., Watson, K. K., & Platt, M. L. (2014) · Neuron · doi:10.1016/j.neuron.2014.04.037 · Cited by 190
Boorman, E. D., Rushworth, M. F., & Behrens, T. E. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3022-12.2013 · Cited by 164
“Notably, a comparison between the best two options would also be predicted by a recent computational account of trinary choice (Krajbich and Rangel, 2011).”
BackgroundSelf-citationFouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176
Organization of the inputs and outputs of the mouse superior colliculus
Benavidez, N. L., Bienkowski, M. S., Zhu, M., Garcia, L. H., Fayzullina, M., Gao, L., Bowman, I., Gou, L., Khanjani, N., Cotter, K. R., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-24241-2 · Cited by 156
Prefrontal executive function and adaptive behavior in complex environments
Koechlin, É. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.11.004 · Cited by 190
Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex
Domenech, P., Rheims, S., & Koechlin, E. (2020) · Science · doi:10.1126/science.abb0184 · Cited by 159
Noonan, M. P., Chau, B. K. H., Rushworth, M. F. S., & Fellows, L. K. (2017) · The Journal of Neuroscience · doi:10.1523/jneurosci.0692-17.2017 · Cited by 167
Self-citationThe costs and benefits of brain dopamine for cognitive control
Cools, R. (2016) · WIREs Cognitive Science · doi:10.1002/wcs.1401 · Cited by 120
Anterior cingulate is a source of valence-specific information about value and uncertainty
Monosov, I. E. (2017) · Nature Communications · doi:10.1038/s41467-017-00072-y · Cited by 163
Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network
Balaguer, J., Spiers, H., Hassabis, D., & Summerfield, C. (2016) · Neuron · doi:10.1016/j.neuron.2016.03.037 · Cited by 163
“, 2013), the dmPFCmay thus encode both the identity and value of a contextual variable over which a particular policy applies, for example, when foraging from different patches (Hayden et al., 2011; Kolling et al., 2012).”
BackgroundFreezing revisited: coordinated autonomic and central optimization of threat coping
Roelofs, K., & Dayan, P. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00608-2 · Cited by 174
Neuroethological studies of fear, anxiety, and risky decision-making in rodents and humans
Mobbs, D., & Kim, J. J. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.06.005 · Cited by 149
“Other foraging studies have proposed that the vmPFC encodes the value of clear options and the dACC encodes the cost of foraging and average value of the foraging environment ([49], c.”
Multiple Neural Mechanisms of Decision Making and Their Competition under Changing Risk Pressure
Kolling, N., Wittmann, M., & Rushworth, M. F. S. (2014) · Neuron · doi:10.1016/j.neuron.2014.01.033 · Cited by 150
“In many neuroimaging studies, it carries a value difference signal like that seen in the vmPFC (Boorman et al., 2013; FitzGerald et al., 2009; Kolling et al., 2012).”
BackgroundMethodInfluentialSelf-citationNeuroethology of primate social behavior
Chang, S. W. C., Brent, L. J. N., Adams, G. K., Klein, J. T., Pearson, J. M., Watson, K. K., & Platt, M. L. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301213110 · Cited by 157
“This model has been remarkably successful at describing the foraging behavior of a wide variety of organisms (40) and recently has been applied to understand neural correlates of foraging decisions (41, 42).”
BackgroundNeural mediators of changes of mind about perceptual decisions
Fleming, S. M., van der Putten, E. J., & Daw, N. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0104-6 · Cited by 155
The Role of the Anterior Cingulate Cortex in Prediction Error and Signaling Surprise
Alexander, W. H., & Brown, J. W. (2017) · Topics in Cognitive Science · doi:10.1111/tops.12307 · Cited by 162
Chemistry of the Adaptive Mind: Lessons from Dopamine
Cools, R. (2019) · Neuron · doi:10.1016/j.neuron.2019.09.035 · Cited by 164
Neurons in Dorsal Anterior Cingulate Cortex Signal Postdecisional Variables in a Foraging Task
Blanchard, T. C., & Hayden, B. Y. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3151-13.2014 · Cited by 141
Wittmann, M. K., Kolling, N., Akaishi, R., Chau, B. K. H., Brown, J. W., Nelissen, N., & Rushworth, M. F. S. (2016) · Nature Communications · doi:10.1038/ncomms12327 · Cited by 140
Self-citationSeparate mesocortical and mesolimbic pathways encode effort and reward learning signals
Hauser, T. U., Eldar, E., & Dolan, R. J. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705643114 · Cited by 145
The Versatile Wayfinder: Prefrontal Contributions to Spatial Navigation
Patai, E. Z., & Spiers, H. J. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.010 · Cited by 133
“This is consistent with work showing that dACC processes new information linked with uncertainty and updating beliefs or behaviour [132], choosing future options [133], increased foraging behaviour [67], and the ability to switch and maintain new strategies [134].”
BackgroundComputational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
“Aspects of the RL-ERN theory have received strong empirical support (Walsh and Anderson, 2012; Sambrook and Goslin, 2015; Holroyd and Umemoto, 2016) and are compatible with evidence of ACC encoding action values in uncertain environments (e.g., during foraging, Kolling et al., 2012, 2016b).”
BackgroundMethodMedial Prefrontal Cortex Predicts Internally Driven Strategy Shifts
Schuck, N. W., Gaschler, R., Wenke, D., Heinzle, J., Frensch, P. A., Haynes, J.-D., & Reverberi, C. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.015 · Cited by 134
“Finally, the same brain area has also been linked to foraging (Hayden et al., 2011; Kolling et al., 2012; but see Shenhav et al., 2014) and exploration (Karlsson et al., 2012), suggesting that ACC encodes the ‘‘value of switching to a course of action alternative to that which is taken or is the…”
BackgroundResultInfluentialAnimal to human translational paradigms relevant for approach avoidance conflict decision making
Kirlic, N., Young, J., & Aupperle, R. L. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.04.010 · Cited by 130
Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner
Silvetti, M., Vassena, E., Abrahamse, E. L., & Verguts, T. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006370 · Cited by 158
The role of the midcingulate cortex in monitoring others' decisions
Apps, M. A. J., Lockwood, P. L., & Balsters, J. H. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00251 · Cited by 126
“Furthermore, it has been argued that such a response-outcome functional property allows the region to play a role in monitoring the extent to which behaviors are meeting higher order needs or goals (Behrens et al., 2007; Botvinick, 2012; Holroyd and Yeung, 2012; Kolling et al., 2012).”
BackgroundSocial learning in humans and other animals
Gariépy, J.-F., Watson, K. K., Du, E., Xie, D. L., Erb, J., Amasino, D., & Platt, M. L. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00058 · Cited by 118
“Masaki Isoda, Kansai Medical University, Japan Steve W. C. Chang, Duke University, USA”
BackgroundMoral Learning: Conceptual foundations and normative relevance
Railton, P. (2016) · Cognition · doi:10.1016/j.cognition.2016.08.015 · Cited by 154
Confidence modulates exploration and exploitation in value-based learning
Boldt, A., Blundell, C., & De Martino, B. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz004 · Cited by 121
“Here, we are focusing on higher-order action selection, the so-called “exploration– exploitation trade-off” (Schumpeter 1934; Sutton and Barto 1998; Cohen et al. 2007; Kolling et al. 2012).”
MethodDopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2020) · eLife · doi:10.7554/elife.51260 · Cited by 128
Making predictions in a changing world—inference, uncertainty, and learning
O'Reilly, J. X. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00105 · Cited by 126
“…of reward (Quilodran et al., 2008), or to forage for new reward options rather than choosing between those options immediately available to them (Kolling et al., 2012)—again, these are cases in which estimation uncertainty in the brain’s internal models could be actively raised, to facilitate…”
Tang, W., Jbabdi, S., Zhu, Z., Cottaar, M., Grisot, G., Lehman, J. F., Yendiki, A., & Haber, S. N. (2019) · eLife · doi:10.7554/elife.43761 · Cited by 123
“Alternatively, different functional processing may be integrated in a central location, or hub (Cisek, 2012; Hunt et al., 2013; Kolling et al., 2012; Lee et al., 2014; Rushworth et al., 2012).”
BackgroundMemory Effects on Movement Behavior in Animal Foraging
Bracis, C., Gurarie, E. D., Moorter, B. F. A. V., & Goodwin, R. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0136057 · Cited by 143
“Two memory streams are a common feature of cognitivelybased ecological models [24, 30–32] and reflect evidence for multiple parallel memory systems that interact [47, 48].”
BackgroundA neural mechanism underlying failure of optimal choice with multiple alternatives
Chau, B. K. H., Kolling, N., Hunt, L. T., Walton, M. E., & Rushworth, M. F. S. (2014) · Nature Neuroscience · doi:10.1038/nn.3649 · Cited by 127
Self-citationComputational Psychiatry of ADHD: Neural Gain Impairments across Marrian Levels of Analysis
Hauser, T. U., Fiore, V. G., Moutoussis, M., & Dolan, R. J. (2016) · Trends in Neurosciences · doi:10.1016/j.tins.2015.12.009 · Cited by 121
“Agents not only have to exploit the option it estimates as the best, but must also explore the value of alternative options so as to gather more information [35,36].”
BackgroundConfidence Is the Bridge between Multi-stage Decisions
van den Berg, R., Zylberberg, A., Kiani, R., Shadlen, M. N., & Wolpert, D. M. (2016) · Current Biology · doi:10.1016/j.cub.2016.10.021 · Cited by 125
Neurocomputational account of how the human brain decides when to have a break
Meyniel, F., Sergent, C., Rigoux, L., Daunizeau, J., & Pessiglione, M. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1211925110 · Cited by 107
I endeavor to make it: Effort increases valuation of subsequent monetary reward
Ma, Q., Meng, L., Wang, L., & Shen, Q. (2014) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.11.045 · Cited by 121
“Ecological theories assert that we would recognize he role prior effort plays when we process the subsequent outome, due to the fact that a better comprehension would lead o better decisions in the future [1,2].”
BackgroundSilvetti, M., Alexander, W., Verguts, T., & Brown, J. W. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.11.003 · Cited by 127
Alexander, W. H., & Brown, J. W. (2015) · Neural Computation · doi:10.1162/neco_a_00779 · Cited by 116
Systems Neuroscience of Natural Behaviors in Rodents
Dennis, E. J., Hady, A. E., Michaiel, A. M., Clemens, A. M., Tervo, D. G. R., Voigts, J., & Datta, S. R. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.1877-20.2020 · Cited by 126
Anterior Cingulate Cortex and the Control of Dynamic Behavior in Primates
Monosov, I. E., Haber, S. N., Leuthardt, E. C., & Jezzini, A. (2020) · Current Biology · doi:10.1016/j.cub.2020.10.009 · Cited by 118
Choice variability and suboptimality in uncertain environments
Wyart, V., & Koechlin, É. (2016) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2016.07.003 · Cited by 121
Theory of Choice in Bandit, Information Sampling and Foraging Tasks
Averbeck, B. B. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004164 · Cited by 104
“For this task [18], we only modeled the foraging stage.”
BackgroundMethodInfluentialDebates on the dorsomedial prefrontal/dorsal anterior cingulate cortex: insights for future research
Clairis, N., & Lopez‐Persem, A. (2023) · Brain · doi:10.1093/brain/awad263 · Cited by 122
“Following the 2012 study 31 that proposed the FVT theory and showed that the dmPFC/dACC reflected search value in the context of foraging rather than difficulty or conflict, a 2014 study 162 challenged this view.”
BackgroundResultInfluentialNeural Basis for Economic Saving Strategies in Human Amygdala-Prefrontal Reward Circuits
Zangemeister, L., Grabenhorst, F., & Schultz, W. (2016) · Current Biology · doi:10.1016/j.cub.2016.09.016 · Cited by 110
How prior preferences determine decision-making frames and biases in the human brain
Lopez‐Persem, A., Domenech, P., & Pessiglione, M. (2016) · eLife · doi:10.7554/elife.20317 · Cited by 119
“Several studies investigated such stay/switch decisions and implicated the dorsal anterior cingulate cortex in promoting a shift away from the default option (Hayden et al., 2011; Kolling et al., 2012; Kvitsiani et al., 2013), while others induced default policies by manipulating prior probabilities of being correct (…”
BackgroundInfluentialThe Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards
Apps, M. A. J., & Ramnani, N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2701-13.2014 · Cited by 109
A novel ecological account of prefrontal cortex functional development.
Werchan, D. M., & Amso, D. (2017) · Psychological Review · doi:10.1037/rev0000078 · Cited by 114
How Expert Advice Influences Decision Making
Meshi, D., Biele, G., Korn, C. W., & Heekeren, H. R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049748 · Cited by 107
Anterior cingulate cortex is necessary for adaptation of action plans
Brockett, A. T., Tennyson, S. S., deBettencourt, C. A., Gaye, F., & Roesch, M. R. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919303117 · Cited by 116
Effort increases sensitivity to reward and loss magnitude in the human brain
Hernandez Lallement, J., Kuss, K., Trautner, P., Weber, B., Falk, A., & Fliessbach, K. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss147 · Cited by 98
“Ecological theories hold that effort is incorporated into the processing of the resulting outcome to guide future decisions (Stephens and Anderson, 2001; Kolling et al., 2012).”
BackgroundSubjective confidence reflects representation of Bayesian probability in cortex
Geurts, L. S., Cooke, J. R. H., van Bergen, R. S., & Jehee, J. F. M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-021-01247-w · Cited by 104
Calhoun, A. J., & Hayden, B. Y. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.07.003 · Cited by 113
“In such contexts, decision makers generally frame the foreground option as the default and the background as the nondefault option; this frame in turn determines how and where the brain represents the offers [6,23 ,24].”
BackgroundReward-related activity in the medial prefrontal cortex is driven by consumption
Horst, N. K., & Laubach, M. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00056 · Cited by 108
“A recent human study reported ACC activity being greater when participants search for alternative options, and ventromedial PFC activity corresponds better with the final decision (Kolling et al., 2012).”
BackgroundArulpragasam, A. R., Cooper, J. A., Nuutinen, M. R., & Treadway, M. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800444115 · Cited by 95
“We also found evidence that lower subjective value was associated with elevated dACC activity, which is consistent with prior reports (36, 57).”
BackgroundMethodResultInfluentialToward a neuroscience of natural behavior
Cisek, P., & Green, A. M. (2024) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2024.102859 · Cited by 105
Metadata
- Authors
- Kolling, N., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Kolling, Nils
- Venue
- Science
- Published
- 2012-04-06
- Volume
- 336
- Issue
- 6077
- Pages
- 95-98
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC3440844
- OpenAlex
- W1965647411
- Cited by
- 629
- References
- 36
- Citations by year
- 2026: 37 · 2025: 45 · 2024: 36 · 2023: 41 · 2022: 35 · 2021: 49 · 2020: 57 · 2019: 50 · 2018: 44 · 2017: 52 · 2016: 51 · 2015: 35 · 2014: 47 · 2013: 32 · 2012: 17
- FWCI
- 21.48
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Wellcome Trust (089280, 088312, 89549)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- foraging, decision-making, ventromedial prefrontal cortex, anterior cingulate cortex, reference frames, foraging costs, search behavior, behavioral economics
- MeSH terms
- Adult, Brain Mapping, Choice Behavior, Decision Making, Female, Gyrus Cinguli, Humans, Male, Reward, Logistic Models, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.