Dissociable roles for lateral orbitofrontal cortex and lateral prefrontal cortex during preference driven reversal learning
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
One of the archetypal task manipulations known to depend on frontal-lobe function is reversal learning, where a dominant response must be overridden due to changes in the contingencies relating stimuli, responses, and environmental feedback. Previous studies have indicated that the lateral prefrontal cortex (LPFC), the lateral orbitofrontal cortex (LOFC), the anterior cingulate cortex (ACC), and the caudate nucleus (CN) all contribute to reversal learning. However, the exact contributions that they make during this cognitively complex task remain poorly defined. Here, using functional magnetic resonance imaging, we examine which of the cognitive processes that contribute to the performance of a reversal best predicts the pattern of activation within distinct sub-regions of the frontal lobes. We demonstrate that during reversal learning the LOFC is particularly sensitive to the implementation of the reversal, whereas the LPFC is recruited more generally during attentional control. By contrast, the ACC and CN respond when new searches are initiated regardless of whether the previous response is available, whilst medial orbitofrontal cortex (MOFC) activity is correlated with the positive affect of feedback. These results accord well with the hypothesis that distinct components of adaptable behaviour are supported by anatomically distinct components of the executive system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
The human orbitofrontal cortex: linking reward to hedonic experience
Kringelbach, M. L. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1747 · Cited by 2,180 · cited 9×
“This correlation adds to the wealth of evidence supporting a role for the MOFC in the processing (Elliott et al., 2000; Hampshire and Owen, 2006; Kringelbach, 2005; Kringelbach et al., 2003; O'Doherty, 2003; O'Doherty et al., 2001, 2003, 2004 ) and evaluation (FitzGerald et al., 2009;…”
InfluentialDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 3×
“An alternative is that the LOFC is involved in re-evaluating current expectations about the reinforcer contingencies (Kringelbach, 2005; O'Doherty et al., 2001, 2004).”
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527 · cited 3×
“, 2004), monkeys (Dias et al., 1996; Iversen and Mishkin, 1970; Izquierdo et al., 2004) and rats (Chudasama and Robbins, 2003; Schoenbaum et al.”
Self-citationPlacebo and Opioid Analgesia-- Imaging a Shared Neuronal Network
Petrovic, P., Kalso, E., Petersson, K. M., & Ingvar, M. (2002) · Science · doi:10.1126/science.1067176 · Cited by 1,488 · cited 1×
“It has previously been reported that both the ACC and the CN play a role in reversal learning and it has been suggested that the ACC and LOFC have a strong functional correlation (Kringelbach, 2005; Petrovic et al., 2002).”
The role of the right inferior frontal gyrus: inhibition and attentional control
Hampshire, A., Chamberlain, S. R., Monti, M. M., Duncan, J., & Owen, A. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.109 · Cited by 1,327 · cited 4×
“Conversely, more posterior regions may play a direct role when effortful control is applied in general (Hampshire et al., 2010), in this case to modulate the weights of competing stimulus–response mappings (Greening et al., 2011) so as to override a routine response.”
InfluentialSelf-citationThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness
O’Doherty, J., Winston, J., Critchley, H., Perrett, D., Burt, D. M., & Dolan, R. J. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00145-8 · Cited by 898
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Rubia, K., Smith, A. B., Brammer, M. J., & Taylor, E. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00275-1 · Cited by 852 · cited 2×
“More broadly, a similar area has often been reported in task manipulations that involve no obvious reward component at all— for example, response inhibition in the stop signal task (Aron et al., 2004; Dodds et al., 2011; Hampshire et al., 2010; Rubia et al., 2003), simple target detection (Hampshire et al.”
Kringelbach, M. L. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.10.1064 · Cited by 824
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 2×
“The finding of activity in the CN in response switching is consistent with findings from lesion and electrophysiological recording studies in animals (Pasupathy and Miller, 2005; Yin et al., 2005) and imaging in humans (Arana et al.”
Fellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631 · cited 2×
“…it is now well established that damage to the ventral prefrontal cortex leads to impairments in visual discrimination reversal learning in humans (Fellows and Farah, 2003; Hornak et al., 2004), monkeys (Dias et al., 1996; Iversen and Mishkin, 1970; Izquierdo et al., 2004) and rats (Chudasama and…”
Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Motivation and cognitive control in the human prefrontal cortex
Kouneiher, F., Charron, S., & Koechlin, E. (2009) · Nature Neuroscience · doi:10.1038/nn.2321 · Cited by 590 · cited 1×
“Such a role may accord better with the recently proposed hypothesis that medial frontal-lobe areas work to innervate lateral regions (Kouneiher et al., 2009), with the ACC working to update the representation within those frontal-lobe areas that are believed to code for the overarching task schema.”
Izquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588
Dias, R., Robbins, T. W., & Roberts, A. C. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-23-09285.1997 · Cited by 555 · cited 1×
“This result supports previous studies that have reported a functional dissociation between the LPFC and the LOFC during reversal leaning (Dias et al., 1996, 1997; Greening et al., 2011; Hampshire and Owen, 2006; Mitchell and Bryan, 2010; Rygula et al., 2010).”
Self-citationChamberlain, S. R., Menzies, L., Hampshire, A., Suckling, J., Fineberg, N. A., del Campo, N., Aitken, M., Craig, K., Owen, A. M., Bullmore, E. T., et al. (2008) · Science · doi:10.1126/science.1154433 · Cited by 550 · cited 4×
“Similarly, patients with obsessive–compulsive disorder (OCD) have both structural and functional abnormalities within the LOFC (Chamberlain et al., 2008) and are characterised by behavioural rigidity when plans must be adapted.”
InfluentialSelf-citationChudasama, Y., & Robbins, T. W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08771.2003 · Cited by 543
Rogers, R. D., Andrews, T. C., Grasby, P. M., Brooks, D. J., & Robbins, T. W. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900561931 · Cited by 458
Anterior cingulate cortex and response conflict: Effects of response modality and processing domain
Barch, D. M. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.837 · Cited by 359
Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., & Rushworth, M. F. S. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012246107 · Cited by 340 · cited 4×
“Indeed, this latter hypothesis of a role in contingency evaluation is supported by both lesion studies in rhesus monkeys (Noonan et al., 2010) and human imaging studies (Windmann et al., 2006).”
InfluentialFractionating Attentional Control Using Event-Related fMRI
Hampshire, A., & Owen, A. M. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj116 · Cited by 329 · cited 12×
“…the fact that the LPFC is recruited in a more consistent manner during all switching events, accords well with findings from our previous study (Hampshire and Owen, 2006), in which more dorsal regions of the lateral prefrontal cortex, including the inferior triangularis, showed generally…”
InfluentialSelf-citationThe Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects
FitzGerald, T. H. B., Seymour, B., & Dolan, R. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0717-09.2009 · Cited by 279
Dodds, C. M., Morein-Zamir, S., & Robbins, T. W. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq187 · Cited by 270 · cited 2×
“More broadly, a similar area has often been reported in task manipulations that involve no obvious reward component at all— for example, response inhibition in the stop signal task (Aron et al., 2004; Dodds et al., 2011; Hampshire et al., 2010; Rubia et al., 2003), simple target detection (Hampshire et al.”
Clarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263 · cited 2×
“…of other regions outside of the ventral prefrontal cortex that have also been implicated in visual discrimination reversal learning, in particular, the anterior cingulate cortex (ACC) and the caudate nucleus (CN) (Clarke et al., 2008; Cools et al., 2002; Rogers et al., 2000) remain unclear.”
Self-citationSpontaneous confabulation and the adaptation of thought to ongoing reality
Schnider, A. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1179 · Cited by 238 · cited 1×
“Such lesions are associated with a tendency to keep behaving according to one set of beliefs even when it is clear from environmental feedback that those predictions no longer reflect the reality of the situation (Schnider, 2003).”
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180 · cited 19×
“Functionally dissociating the LOFC and the LPFC The most important result from the current study is the difference in the profile of the BOLD response in sub-regions of the inferiorfrontal cortex.”
InfluentialRygula, R., Walker, S. C., Clarke, H. F., Robbins, T. W., & Roberts, A. C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2631-10.2010 · Cited by 136 · cited 3×
“…have shown that the effects on reversal learning of excitotoxic lesions of area 12 (LPFC and LOFC) and areas 11 and anterior 13 (anteromedial OFC) in the new world monkey, the common marmoset, can be differentiated according to the level of prior reversal learning experience (Rygula et al., 2010).”
Self-citation
Research works printed but not linked: 25
- Aharon, 2001, Beautiful faces have variable reward value: fMRI and behavioral evidence, Neuron, 32, 537, 10.1016/S0896-6273(01)00491-3 · DOI · Paper page
- Arana, 2003, Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection, J. Neurosci., 23, 9632, 10.1523/JNEUROSCI.23-29-09632.2003 · DOI · Paper page
- Aron, 2004, Inhibition and the right inferior frontal cortex, Trends Cogn. Sci., 8, 170, 10.1016/j.tics.2004.02.010 · DOI · Paper page
- Budhani, 2007, Neural correlates of response reversal: considering acquisition, NeuroImage, 34, 1754, 10.1016/j.neuroimage.2006.08.060 · DOI
- Bush, 2000, Cognitive and emotional influences in anterior cingulate cortex, Trends Cogn. Sci., 4, 215, 10.1016/S1364-6613(00)01483-2 · DOI · Paper page
- Carter, 1998, Anterior cingulate cortex, error detection, and the online monitoring of performance, Science, 280, 747, 10.1126/science.280.5364.747 · DOI · Paper page
- Cools, 2002, Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging, J. Neurosci., 22, 4563, 10.1523/JNEUROSCI.22-11-04563.2002 · DOI · Paper page
- Cusack, 2003, An evaluation of the use of magnetic field maps to undistort echo-planar images, NeuroImage, 18, 127, 10.1006/nimg.2002.1281 · DOI · Paper page
- Elliott, 2000, Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies, Cereb. Cortex, 10, 308, 10.1093/cercor/10.3.308 · DOI · Paper page
- Grahn, 2008, The cognitive functions of the caudate nucleus, Prog. Neurobiol., 86, 141, 10.1016/j.pneurobio.2008.09.004 · DOI · Paper page
- Greening, 2011, Parsing decision making processes in prefrontal cortex: response inhibition, overcoming learned avoidance, and reversal learning, NeuroImage, 54, 1432, 10.1016/j.neuroimage.2010.09.017 · DOI
- Hampshire, 2008, Inefficiency in self-organized attentional switching in the normal aging population is associated with decreased activity in the ventrolateral prefrontal cortex, J. Cogn. Neurosci., 20, 1670, 10.1162/jocn.2008.20115 · DOI · Paper page
- Hampshire, 2008, The target selective neural response—similarity, ambiguity, and learning effects, PLoS One, 3, e2520, 10.1371/journal.pone.0002520 · DOI · Paper page
- Hampshire, 2009, Selective tuning of the right inferior frontal gyrus during target detection, Cogn. Affect. Behav. Neurosci., 9, 103, 10.3758/CABN.9.1.103 · DOI · Paper page
- Iversen, 1970, Perseverative interference in monkeys following selective lesions of inferior prefrontal convexity, Exp. Brain Res., 11, 376-&, 10.1007/BF00237911 · DOI · Paper page
- Koechlin, 2003, The architecture of cognitive control in the human prefrontal cortex, Science, 302, 1181, 10.1126/science.1088545 · DOI · Paper page
- Linden, 1999, The functional neuroanatomy of target detection: An fMRI study of visual and auditory oddball tasks, Cereb. Cortex, 9, 815, 10.1093/cercor/9.8.815 · DOI · Paper page
- Liu, 2007, Functional dissociation in frontal and striatal areas for processing of positive and negative reward information, J. Neurosci., 27, 4587, 10.1523/JNEUROSCI.5227-06.2007 · DOI · Paper page
- Mitchell, 2010, Anti-angiogenic therapy: adapting strategies to overcome resistant tumors, J. Cell. Biochem., 111, 543, 10.1002/jcb.22764 · DOI
- Nahum, 2009, Disorientation, confabulation, and extinction capacity: clues on how the brain creates reality, Biol. Psychiatry, 65, 966, 10.1016/j.biopsych.2009.01.007 · DOI
- O'Doherty, 2003, Can't learn without you: predictive value coding in orbitofrontal cortex requires the basolateral amygdala, Neuron, 39, 731, 10.1016/S0896-6273(03)00525-7 · DOI
- Schoenbaum, 2002, Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations, NeuroReport, 13, 885, 10.1097/00001756-200205070-00030 · DOI · Paper page
- Tricomi, 2004, Modulation of caudate activity by action contingency, Neuron, 41, 281, 10.1016/S0896-6273(03)00848-1 · DOI · Paper page
- Tzourio-Mazoyer, 2002, Automated anatomical labelling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single subject brain, NeuroImage, 15, 273, 10.1006/nimg.2001.0978 · DOI · Paper page
- Windmann, 2006, On framing effects in decision making: linking lateral versus medial orbitofrontal cortex activation to choice outcome processing, J. Cogn. Neurosci., 18, 1198, 10.1162/jocn.2006.18.7.1198 · DOI · Paper page
Cited by
Explicit and implicit emotion regulation: a multi-level framework
Braunstein, L. M., Gross, J. J., & Ochsner, K. N. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx096 · Cited by 539
“…repeated/serial reversals, which foster the development and application of rules, find that the vlPFC is involved in both human fMRI (Cools et al., 2002; Remijnse et al., 2005; Mitchell et al., 2008; Hampshire et al., 2012) and animal lesion studies (Rygula et al., 2010; Rudebeck et al., 2013).”
BackgroundMorris, L. S., Kundu, P., Dowell, N., Mechelmans, D. J., Favre, P., Irvine, M. A., Robbins, T. W., Daw, N., Bullmore, E. T., Harrison, N. A., et al. (2016) · Cortex · doi:10.1016/j.cortex.2015.11.004 · Cited by 198
“…of frontal cortical involvement; lateral OFC is required for the implementation of reversal (Hampshire, Chaudhry, Owen, & Roberts, 2012) whereas attentional shifting implicates dorsolateral prefrontal cortex (dlPFC) (Dias, Robbins, & Roberts, 1996; Hampshire et al., 2012; Manes et al., 2002).”
BackgroundThe social evaluation of faces: a meta-analysis of functional neuroimaging studies
Mende-Siedlecki, P., Said, C. P., & Todorov, A. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr090 · Cited by 193
Neural and behavioral responses to attractiveness in adult and infant faces
Hahn, A. C., & Perrett, D. I. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.08.015 · Cited by 167
Wallace, A., Pehrson, A. L., Sánchez, C., & Morilak, D. A. (2014) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145714000571 · Cited by 97
“Studies of performance deficits in patients with focal cortical lesions, and neuroimaging studies in healthy volunteers have confirmed an important role for the OFC in reversal learning in humans (Fellows and Farah, 2003; Hampshire and Owen, 2006; Hampshire et al., 2012).”
Background
Metadata
- Authors
- Hampshire, A., Chaudhry, A. M., Owen, A. M., & Roberts, A. C.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2012-02
- Volume
- 59
- Issue
- 4
- Pages
- 4102-4112
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2119413842
- Cited by
- 78
- References
- 31
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- creativecommons.org/licenses/by/3.0/ (vor, 531 d)
- Funders
- MRC
- Cambridge University Behavioural and Clinical Neuroscience Institute
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.