Attention for Learning Signals in Anterior Cingulate Cortex
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Learning theory suggests that animals attend to pertinent environmental cues when reward contingencies unexpectedly change so that learning can occur. We have previously shown that activity in basolateral nucleus of amygdala (ABL) responds to unexpected changes in reward value, consistent with unsigned prediction error signals theorized by Pearce and Hall. However, changes in activity were present only at the time of unexpected reward delivery, not during the time when the animal needed to attend to conditioned stimuli that would come to predict the reward. This suggested that a different brain area must be signaling the need for attention necessary for learning. One likely candidate to fulfill this role is the anterior cingulate cortex (ACC). To test this hypothesis, we recorded from single neurons in ACC as rats performed the same behavioral task that we have used to dissociate signed from unsigned prediction errors in dopamine and ABL neurons. In this task, rats chose between two fluid wells that produced varying magnitudes of and delays to reward. Consistent with previous work, we found that ACC detected errors of commission and reward prediction errors. We also found that activity during cue sampling encoded reward size, but not expected delay to reward. Finally, activity in ACC was elevated during trials in which attention was increased following unexpected upshifts and downshifts in value. We conclude that ACC not only signals errors in reward prediction, as previously reported, but also signals the need for enhanced neural resources during learning on trials subsequent to those errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Holroyd, C. B., & Coles, M. G. H. (2002) · Psychological Review · doi:10.1037/0033-295x.109.4.679 · Cited by 4,027
MacDonald, A. W., Cohen, J. D., Stenger, V. A., & Carter, C. S. (2000) · Science · doi:10.1126/science.288.5472.1835 · Cited by 3,666
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273 · cited 4×
“…has been shown to be positively correlated with the degree of conflict in a number of different tasks (Pardo et al., 1990; Badgaiyan and Posner, 1998; Carter et al., 1998; Botvinick et al., 2001; Braver et al., 2001; Paus, 2001; van Veen et al., 2001; De Martino et al., 2006; Magno et al., 2006).”
InfluentialPearce, J. M., & Hall, G. (1980) · Psychological Review · doi:10.1037/0033-295x.87.6.532 · Cited by 3,023 · cited 2×
“When outcomes of behavior are uncertain, attention for learning signals, theorized by Pearce and Hall (1980), are thought to focus neural processing on events that predict those outcomes so learning can occur.”
Primate anterior cingulate cortex: Where motor control, drive and cognition interface
Paus, T. (2001) · Nature Reviews Neuroscience · doi:10.1038/35077500 · Cited by 1,722 · cited 5×
“Activity in ACC has been shown to be positively correlated with the degree of conflict in a number of different tasks (Pardo et al., 1990; Badgaiyan and Posner, 1998; Carter et al., 1998; Botvinick et al., 2001; Braver et al., 2001; Paus, 2001; van Veen et al., 2001; De Martino et al., 2006; Magno et al., 2006).”
InfluentialPardo, J. V., Pardo, P. J., Janer, K. W., & Raichle, M. E. (1990) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.87.1.256 · Cited by 1,495 · cited 2×
“Activity in ACC has been shown to be positively correlated with the degree of conflict in a number of different tasks (Pardo et al., 1990; Badgaiyan and Posner, 1998; Carter et al., 1998; Botvinick et al., 2001; Braver et al., 2001; Paus, 2001; van Veen et al., 2001; De Martino et al., 2006; Magno et al., 2006).”
Frontal cortex and reward-guided learning and decision-making
Rushworth, M. F. S., Noonan, M. P., Boorman, E. D., Walton, M. E., & Behrens, T. E. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.014 · Cited by 1,111
Anterior Cingulate Cortex and Response Conflict: Effects of Frequency, Inhibition and Errors
Braver, T. S. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.825 · Cited by 1,016
Action sets and decisions in the medial frontal cortex
RUSHWORTH, M., WALTON, M., KENNERLEY, S., & BANNERMAN, D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.009 · Cited by 1,004 · cited 2×
“However, this result does fit well with several papers that have suggested that ACC might not account for delays the same as it does other variables, such as effort, when computing the value of predicted rewards (Rushworth et al., 2004, 2007; Walton et al., 2004, 2006, 2007; Rudebeck et al., 2008).”
Medial prefrontal cortex as an action-outcome predictor
Alexander, W. H., & Brown, J. W. (2011) · Nature Neuroscience · doi:10.1038/nn.2921 · Cited by 1,000
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 4×
“More recent work has suggested that ACC does not simply detect errors, but is also important for signaling positive feedback (Kennerley et al., 2006; Oliveira et al., 2007; Rothé et al., 2011).”
InfluentialLearned predictions of error likelihood in the anterior cingulate cortex
Brown, J. W., & Braver, T. S. (2005) · Science · doi:10.1126/science.1105783 · Cited by 928 · cited 1×
“Finally, several studies have suggested that ACC activity is particularly high during general arousal or attention (MacDonald et al., 2000; Paus, 2001; Brown and Braver, 2005; Totah et al., 2009).”
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Anterior cingulate cortex, conflict monitoring, and levels of processing
van Veen, V., Cohen, J. D., Botvinick, M. M., Stenger, V. A., & Carter, C. S. (2001) · NeuroImage · doi:10.1006/nimg.2001.0923 · Cited by 656 · cited 1×
“…has been shown to be positively correlated with the degree of conflict in a number of different tasks (Pardo et al., 1990; Badgaiyan and Posner, 1998; Carter et al., 1998; Botvinick et al., 2001; Braver et al., 2001; Paus, 2001; van Veen et al., 2001; De Martino et al., 2006; Magno et al., 2006).”
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Self-citationPerformance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 1×
“Specifically, it has been shown that rats with lesions of ACC are impaired on effort- but not delay-discounting tasks (Rudebeck et al., 2006), suggesting a critical role for ACC in signaling how much effort, but not time, is required to achieve reward.”
Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour
Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H., & Walton, M. E. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.01.004 · Cited by 507 · cited 2×
“However, this result does fit well with several papers that have suggested that ACC might not account for delays the same as it does other variables, such as effort, when computing the value of predicted rewards (Rushworth et al., 2004, 2007; Walton et al., 2004, 2006, 2007; Rudebeck et al., 2008).”
Scheffers, M. K., & Coles, M. G. H. (2000) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.26.1.141 · Cited by 493 · cited 2×
“, 1998; Holroyd and Coles, 2002); has been shown to be involved in encoding errors of commission, reward prediction errors, and positive and negative trial feedback; and is thought to be critical for functions related to attention, decision making, and reinforcement learning (Carter et al., 1998; Scheffers and Coles,…”
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453 · cited 3×
“…Finally, we asked whether activity in ACC might encode predictive value during odor sampling as reported during presentation of reward-predicting cues in previous studies (Oliveira et al., 2007; Sallet et al., 2007; Kennerley and Wallis, 2009; Kennerley et al., 2009; Hillman and Bilkey, 2010).”
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · cited 6×
“…al., 2004; Amiez et al., 2005; Kennerley et al., 2006; Magno et al., 2006; Matsumoto et al., 2007; Quilodran et al., 2008; Rudebeck et al., 2008; Rushworth and Behrens, 2008; Kennerley and Wallis, 2009; Totah et al., 2009; Hillman and Bilkey, 2010; Wallis and Kennerley, 2010; Hayden et al., 2011).”
InfluentialExpectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349
Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation
Roesch, M. R., Taylor, A. R., & Schoenbaum, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.027 · Cited by 297
Self-citationNeurons in anterior cingulate cortex multiplex information about reward and action
Hayden, B. Y., & Platt, M. L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4874-09.2010 · Cited by 236 · cited 1×
“It has been reported that activity during presentation of conditioned stimuli is modulated by the reward it predicts (Shidara and Richmond, 2002; Amiez et al., 2006; Kennerley et al., 2009; Hayden and Platt, 2010; Hillman and Bilkey, 2010; Rushworth et al., 2011).”
Heterogeneous reward signals in prefrontal cortex
Wallis, J. D., & Kennerley, S. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.02.009 · Cited by 186 · cited 2×
“…al., 2004; Amiez et al., 2005; Kennerley et al., 2006; Magno et al., 2006; Matsumoto et al., 2007; Quilodran et al., 2008; Rudebeck et al., 2008; Rushworth and Behrens, 2008; Kennerley and Wallis, 2009; Totah et al., 2009; Hillman and Bilkey, 2010; Wallis and Kennerley, 2010; Hayden et al., 2011).”
Cited by
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Dorsal Anterior Cingulate Cortex: A Bottom-Up View
Heilbronner, S. R., & Hayden, B. Y. (2016) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-070815-013952 · Cited by 455
Valuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309
“Other authors have emphasized other differences between these regions, for example, emphasizing that ACC may have a greater role in reward-guided learning because of the prominence of prediction errors in this brain region [5 ], the presence of reward outcome-related activity reflecting different mnemonic time constan…”
BackgroundAnterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value
Shenhav, A., Straccia, M. A., Cohen, J. D., & Botvinick, M. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3771 · Cited by 277
Grounding cognitive control in associative learning
Abrahamse, E., Braem, S., Notebaert, W., & Verguts, T. (2016) · Psychological Bulletin · doi:10.1037/bul0000047 · Cited by 276
Metadata
- Authors
- Bryden, D. W., Johnson, E. E., Tobia, S. C., Kashtelyan, V., & Roesch, M. R.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2011-12-14
- Volume
- 31
- Issue
- 50
- Pages
- 18266-18274
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2167821068
- Cited by
- 147
- References
- 25
- FWCI
- 4.52
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.