Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Open accessAbstract
The ability to flexibly respond to changes in the environment is critical for adaptive behavior. Reversal learning (RL) procedures test adaptive response updating when contingencies are altered. We used functional magnetic resonance imaging to examine brain areas that support specific RL components. We compared neural responses to RL and initial learning (acquisition) to isolate reversal-related brain activation independent of cognitive control processes invoked during initial feedback-based learning. Lateral orbitofrontal cortex (OFC) was more activated during reversal than acquisition, suggesting its relevance for reformation of established stimulus-response associations. In addition, the dorsal anterior cingulate (dACC) and right inferior frontal gyrus (rIFG) correlated with change in postreversal accuracy. Because optimal RL likely requires suppression of a prior learned response, we hypothesized that similar regions serve both response inhibition (RI) and inhibition of learned associations during reversal. However, reversal-specific responding and stopping (requiring RI and assessed via the stop-signal task) revealed distinct frontal regions. Although RI-related regions do not appear to support inhibition of prepotent learned associations, a subset of these regions, dACC and rIFG, guide actions consistent with current reward contingencies. These regions and lateral OFC represent distinct neural components that support behavioral flexibility important for adaptive learning.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Neuroimaging indicates that the dorsal anterior cingulate cortex and inferior frontal gyrus contribute to suppressing previously learned responses and inhibiting responses during reversal learning.
“Neuroimaging additionally reveals the role of the dorsal anterior cingulate cortex and the inferior frontal gyrus in suppression of prior learned responses and response inhibition during reversal learning40.”
From Cognitive and behavioural flexibility: Neural mechanisms and clinical considerations (2021) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
A global optimisation method for robust affine registration of brain images
Jenkinson, M., & Smith, S. M. (2001) · Medical Image Analysis · doi:10.1016/s1361-8415(01)00036-6 · Cited by 6,806 · see citing works
Inhibition and the right inferior frontal cortex
Aron, A. R., Robbins, T. W., & Poldrack, R. A. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.010 · Cited by 3,197 · see citing works
Self-citationTemporal Autocorrelation in Univariate Linear Modeling of FMRI Data
Woolrich, M. W., Ripley, B. D., Brady, M., & Smith, S. M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0931 · Cited by 2,859 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Repetition and the brain: neural models of stimulus-specific effects
Grill-Spector, K., Henson, R., & Martin, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.006 · Cited by 2,256 · see citing works
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036 · see citing works
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003 · see citing works
Valid conjunction inference with the minimum statistic
Nichols, T. E., Brett, M., Andersson, J., Wager, T. D., & Poline, J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.005 · Cited by 1,885 · see citing works
Multilevel linear modelling for FMRI group analysis using Bayesian inference
Woolrich, M. W., Behrens, T. E. J., Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.12.023 · Cited by 1,719 · see citing works
Aron, A. R., & Poldrack, R. A. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4682-05.2006 · Cited by 1,630 · see citing works
Self-citationDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527 · see citing works
General multilevel linear modeling for group analysis in FMRI
Beckmann, C. F., Jenkinson, M., & Smith, S. M. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00435-x · Cited by 1,464 · see citing works
Jovicich, J., Czanner, S., Greve, D. N., Haley, E., van der Kouwe, A. J. W., Gollub, R. L., Kennedy, D. N., Schmitt, F., Brown, G. G., MacFall, J. R., et al. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.09.046 · Cited by 1,269 · see citing works
Picard, N., & Strick, P. L. (2001) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(01)00266-5 · Cited by 1,184 · see citing works
Aron, A. R., Behrens, T. E., Smith, S., Frank, M. J., & Poldrack, R. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0519-07.2007 · Cited by 982 · see citing works
Self-citationElliott, R. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.308 · Cited by 887 · see citing works
Limbic lesions and the problem of stimulus--reinforcement associations.
Jones, B., & Mishkin, M. (1972) · Experimental Neurology · doi:10.1016/0014-4886(72)90030-1 · Cited by 864 · see citing works
Cools, R., Clark, L., Owen, A. M., & Robbins, T. W. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04563.2002 · Cited by 784 · see citing works
Iversen, S., & Mishkin, M. (1970) · Experimental Brain Research · doi:10.1007/bf00237911 · Cited by 765 · see citing works
Rolls, E. T. (1996) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1996.0128 · Cited by 755 · see citing works
BOLD responses reflecting dopaminergic signals in the human ventral tegmental area
D'Ardenne, K., McClure, S. M., Nystrom, L. E., & Cohen, J. D. (2008) · Science · doi:10.1126/science.1150605 · Cited by 661 · see citing works
Fellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631 · see citing works
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611 · see citing works
Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603 · see citing works
Izquierdo, A., Suda, R. K., & Murray, E. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-04.2004 · Cited by 588 · see citing works
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 578 · see citing works
Chamberlain, S. R., Menzies, L., Hampshire, A., Suckling, J., Fineberg, N. A., del Campo, N., Aitken, M., Craig, K., Owen, A. M., Bullmore, E. T., et al. (2008) · Science · doi:10.1126/science.1154433 · Cited by 550 · see citing works
The Human Brain: Surface, Three-Dimensional Sectional Anatomy with MRI, and Blood Supply
Duvernoy, H. M., Bourgouin, P. M., & Vannson, J. L. (1999) · Cited by 520 · see citing works
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · see citing works
RAGOZZINO, M. E. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.013 · Cited by 482 · see citing works
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451 · see citing works
Deficits on conditional associative-learning tasks after frontal- and temporal-lobe lesions in man
Petrides, M. (1985) · Neuropsychologia · doi:10.1016/0028-3932(85)90062-4 · Cited by 441 · see citing works
Mapping structural brain alterations in obsessive-compulsive disorder
Pujol, J., Soriano-Mas, C., Alonso, P., Cardoner, N., Menchón, J. M., Deus, J., & Vallejo, J. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.7.720 · Cited by 429 · see citing works
Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder
Remijnse, P. L., Nielen, M. M. A., van Balkom, A. J. L. M., Cath, D. C., van Oppen, P., Uylings, H. B. M., & Veltman, D. J. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1225 · Cited by 408 · see citing works
Butter, C. M. (1969) · Physiology & Behavior · doi:10.1016/0031-9384(69)90075-4 · Cited by 395 · see citing works
Cools, R., Frank, M. J., Gibbs, S. E. B., Miyakawa, A., Jagust, W. J., & D’Esposito, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4467-08.2009 · Cited by 365 · see citing works
Frontal cortex subregions play distinct roles in choices between actions and stimuli
Rudebeck, P. H., Behrens, T. E., Kennerley, S. W., Baxter, M. G., Buckley, M. J., Walton, M. E., & Rushworth, M. F. S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3541-08.2008 · Cited by 350 · see citing works
Arana, F. S., Parkinson, J. A., Hinton, E. C., Holland, A. J., Owen, A. M., & Roberts, A. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-29-09632.2003 · Cited by 342 · see citing works
Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations
Schoenbaum, G. M., Nugent, S. L., Saddoris, M. P., & Setlow, B. (2002) · Neuroreport · doi:10.1097/00001756-200205070-00030 · Cited by 320 · see citing works
Subliminal Instrumental Conditioning Demonstrated in the Human Brain
Pessiglione, M., Petrovic, P., Daunizeau, J., Palminteri, S., Dolan, R. J., & Frith, C. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.005 · Cited by 308 · see citing works
Neural correlates of rapid reversal learning in a simple model of human social interaction
Kringelbach, M. L., & Rolls, E. T. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00393-8 · Cited by 306 · see citing works
Reversal learning in Parkinson's disease depends on medication status and outcome valence
Cools, R., Altamirano, L. J., & D’Esposito, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.03.030 · Cited by 286 · see citing works
Takahashi, Y. K., Roesch, M. R., Stalnaker, T. A., Haney, R. Z., Calu, D. J., Taylor, A. R., Burke, K. A., & Schoenbaum, G. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.03.005 · Cited by 284 · see citing works
Cavedini, P., Riboldi, G., D'Annucci, A., Belotti, P., Cisima, M., & Bellodi, L. (2002) · Neuropsychologia · doi:10.1016/s0028-3932(01)00077-x · Cited by 277 · see citing works
Clarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263 · see citing works
Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention
Nobre, A. C., Coull, J. T., Frith, C., & Mesulam, M. M. (1999) · Nature Neuroscience · doi:10.1038/4513 · Cited by 249 · see citing works
Murray, E. A., O'Doherty, J. P., & Schoenbaum, G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-07.2007 · Cited by 238 · see citing works
Automatic independent component labeling for artifact removal in fMRI
Tohka, J., Foerde, K., Aron, A. R., Tom, S. M., Toga, A. W., & Poldrack, R. A. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.013 · Cited by 217 · see citing works
Self-citationMnemonic functions of the basal ganglia
White, N. M. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80004-9 · Cited by 204 · see citing works
Visuo-motor conditional associative learning after frontal and temporal lesions in the human brain
Petrides, M. (1997) · Neuropsychologia · doi:10.1016/s0028-3932(97)00026-2 · Cited by 179 · see citing works
Dopamine DRD2 Polymorphism Alters Reversal Learning and Associated Neural Activity
Jocham, G., Klein, T. A., Neumann, J., von Cramon, D. Y., Reuter, M., & Ullsperger, M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5195-08.2009 · Cited by 178 · see citing works
Tremblay, L., & Schultz, W. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.4.1877 · Cited by 167 · see citing works
REMIJNSE, P., NIELEN, M., UYLINGS, H., & VELTMAN, D. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.009 · Cited by 163 · see citing works
The Role of Orbitofrontal Cortex in Decision Making
Fellows, L. K. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.023 · Cited by 133 · see citing works
Windmann, S., Kirsch, P., Mier, D. U., Stark, R. M., Walter, B., Güntürkün, O., & Vaitl, D. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.7.1198 · Cited by 123 · see citing works
Neural correlates of response reversal: Considering acquisition
Budhani, S., Marsh, A. A., Pine, D. S., & Blair, J. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.060 · Cited by 120 · see citing works
The human ventromedial frontal lobe is critical for learning from negative feedback
Wheeler, E. Z., & Fellows, L. K. (2008) · Brain · doi:10.1093/brain/awn041 · Cited by 94 · see citing works
Focal basal ganglia lesions are associated with impairments in reward-based reversal learning
Bellebaum, C., Koch, B., Schwarz, M., & Daum, I. (2008) · Brain · doi:10.1093/brain/awn011 · Cited by 88 · see citing works
Neural Substrates for Reversing Stimulus–Outcome and Stimulus–Response Associations
Xue, G., Ghahremani, D. G., & Poldrack, R. A. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4001-08.2008 · Cited by 47 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 7
- 2002, 40, 205
- 2006, 44, 1663
- Cools, 2002, Journal of Neuroscience, 22, 4563
- 2008, 59, 561
- 1985, 23, 601
- 1997, 35, 989
- 2002, 36, 241
Cited by
Sorted by citations
Cognitive and behavioural flexibility: Neural mechanisms and clinical considerations
Uddin, L. Q. (2021) · Nature Reviews Neuroscience · doi:10.1038/s41583-021-00428-w · Cited by 698 · see citing works
The neural basis of reversal learning: An updated perspective
Izquierdo, A., Brigman, J. L., Radke, A. K., Rudebeck, P. H., & Holmes, A. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2016.03.021 · Cited by 670 · see citing works
“Neuroimaging studies report increased activity in orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) in human subjects performing reversals (Nagahama et al., 2001; Cools et al., 2002; Kringelbach and Rolls, 2003; Remijnse et al., 2005; Ghahremani et al., 2010), and patients with lesions of these regions ex…”
BackgroundDyne, L. V., Ang, S., Ng, K., Rockstuhl, T., Tan, M. L., & Koh, C. S. K. (2012) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2012.00429.x · Cited by 544 · see citing works
Fineberg, N. A., Chamberlain, S. R., Goudriaan, A. E., Stein, D. J., Vanderschuren, L. J. M. J., Gillan, C. M., Shekar, S., Gorwood, P. A. P. M., Voon, V., Morein-Zamir, S., et al. (2014) · CNS Spectrums · doi:10.1017/s1092852913000801 · Cited by 488 · see citing works
Irritability in Youths: A Translational Model
Brotman, M. A., Kircanski, K., Stringaris, A. K., Pine, D. S., & Leibenluft, E. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16070839 · Cited by 366 · see citing works
“The cingulate, inferior frontal gyrus, and caudate mediate the response to errors (70, 77, 78, 82, 83).”
BackgroundDoss, M. K., Považan, M., Rosenberg, M. D., Sepeda, N. D., Davis, A. K., Finan, P. H., Smith, G. S., Pekar, J. J., Barker, P. B., Griffiths, R. R., et al. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01706-y · Cited by 356 · see citing works
“Activity of the anterior cingulate cortex (ACC) and its interactions with other regions [39, 40] are known to support cognitive flexibility, and single units of the ACC are involved in search for new rules to promote adaptive behavior [41].”
BackgroundNeural correlates of maintaining one’s political beliefs in the face of counterevidence
Kaplan, J., Gimbel, S. I., & Harris, S. (2016) · Scientific Reports · doi:10.1038/srep39589 · Cited by 350 · see citing works
Reversal learning as a measure of impulsive and compulsive behavior in addictions
Izquierdo, A., & Jentsch, J. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2579-7 · Cited by 306 · see citing works
“2006) and healthy controls (O’Doherty et al. 2001; Ghahremani et al. 2010) all show that this region is important for accurate performance across a variety of reversal learning paradigms.”
InfluentialSelf-citationDissecting impulsivity and its relationships to drug addictions
Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., & Pennington, Z. T. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12388 · Cited by 281 · see citing works
Self-citationReduced behavioral flexibility in autism spectrum disorders.
D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Shrestha, S., Cook, E. H., & Sweeney, J. A. (2013) · Neuropsychology · doi:10.1037/a0031721 · Cited by 279 · see citing works
“In particular, frontostriatal pathways including dorsal and ventral striatum, anterior cingulate cortex, and dorsolateral and orbital prefrontal cortex are known to support reversal learning (Cools, Clark, Owen, & Robbins, 2002; D’Cruz, Ragozzino, Mosconi, Pavuluri, & Sweeney, 2011; Ghahremani et al., 2010; O’Doherty,…”
BackgroundCognitive inflexibility in Obsessive-Compulsive Disorder
Gruner, P., & Pittenger, C. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2016.07.030 · Cited by 261 · see citing works
“Recent work has demonstrated that prefrontal activity associated with inhibition differs during reversal learning and the SSRT (Ghahremani et al., 2010).”
BackgroundNeural circuitry underlying affective response to peer feedback in adolescence
Guyer, A. E., Choate, V. R., Pine, D. S., & Nelson, E. E. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr043 · Cited by 236 · see citing works
“Previous work has shown a key role of the IFG/BA47 in response flexibility in other feedback-based contexts (Rolls, 2004; Remijnse et al., 2005; Ghahremani et al., 2010).”
BackgroundNeuromodulation of reward‐based learning and decision making in human aging
Eppinger, B., Hämmerer, D., & Li, S. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06230.x · Cited by 228 · see citing works
Reinforcement learning across development: What insights can we draw from a decade of research?
Nussenbaum, K., & Hartley, C. A. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100733 · Cited by 203 · see citing works
Dopaminergic control of cognitive flexibility in humans and animals
Klanker, M., Feenstra, M., & Denys, D. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00201 · Cited by 209 · see citing works
“…primate: caudate nucleus; functional equivalent rodent area: dorsomedial striatum) are implicated in reversal learning (Divac, 1971; Dias et al., 1996a; Rogers et al., 2000; McAlonan and Brown, 2003; Bellebaum et al., 2008; Clarke et al., 2008; Castane et al., 2010; Ghahremani et al., 2010).”
BackgroundSpecializations for reward-guided decision-making in the primate ventral prefrontal cortex
Murray, E. A., & Rudebeck, P. H. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0013-4 · Cited by 169 · see citing works
Chau, B. K. H., Sallet, J., Papageorgiou, G. K., Noonan, M. P., Bell, A. H., Walton, M. E., & Rushworth, M. F. S. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.018 · Cited by 159 · see citing works
“, 2015) was also found to be active in human fMRI ODR experiments (Ghahremani et al., 2010; O’Doherty et al., 2001).”
Nicotine exposure of male mice produces behavioral impairment in multiple generations of descendants
McCarthy, D. M., Morgan, T. J., Lowe, S. E., Williamson, M. J., Spencer, T. J., Biederman, J., & Bhide, P. G. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2006497 · Cited by 140 · see citing works
Frontal Hyperconnectivity Related to Discounting and Reversal Learning in Cocaine Subjects
Camchong, J., MacDonald, A. W., Nelson, B. G., Bell, C., Mueller, B. A., Specker, S. M., & Lim, K. O. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.01.008 · Cited by 122 · see citing works
“The number of trials needed to perform a reversal in the reversal learning task was significantly higher (t(1,47)=3.”
BackgroundGhahremani, D. G., Tabibnia, G., Monterosso, J. R., Hellemann, G., Poldrack, R. A., & London, E. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.233 · Cited by 119 · see citing works
“As activation of the anterior insula and ventrolateral prefrontal cortex is commonly observed in studies of cognitive control (eg, Cools et al, 2002; Ghahremani et al, 2010), and as MA subjects show neurocognitive deficits associated with this region (London et al, 2005; Tabibnia et al, in press),…”
BackgroundMethodInfluentialSelf-citationHarms, M. B., Shannon, K. E., Hanson, J. L., & Pollak, S. D. (2017) · Developmental Science · doi:10.1111/desc.12596 · Cited by 125 · see citing works
Effects of chronic stress on cognitive function – From neurobiology to intervention
Girotti, M., Bulin, S. E., & Carreno, F. R. (2024) · Neurobiology of Stress · doi:10.1016/j.ynstr.2024.100670 · Cited by 142 · see citing works
“Human imaging studies show increased activity in medial prefrontal areas (Boehme et al., 2017; Cools et al., 2002), orbitofrontal areas (Ghahremani et al., 2010; Remijnse et al., 2006), parietal cortex, insula and cingulate cortex during reversal tasks (Yaple and Yu 2019).”
The role of the orbitofrontal cortex in alcohol use, abuse, and dependence
Moorman, D. E. (2018) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2018.01.010 · Cited by 109 · see citing works
“through the role of the OFC in controlling reversal learning (Boulougouris et al., 2007; Dalton et al., 2016; Dias et al., 1996; Fellows and Farah, 2003; Ghahremani et al., 2010; Ghods-Sharifi et al., 2008; Graybeal et al., 2011; Groman et al., 2013; Hamilton and Brigman, 2015; Iversen and Mishkin, 1970; Izquierdo et…”
Neural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106 · see citing works
Resting‐State Synchrony in Long‐Term Abstinent Alcoholics
Camchong, J., Stenger, A., & Fein, G. (2012) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2012.01859.x · Cited by 95 · see citing works
“Because fMRI studies that examined set shifting performance have found increased DLPFC activity related to cognitive flexibility (Freyer et al. 2009; Ghahremani et al. 2010; Remijnse et al. 2005), clusters involving DLPFC in which LTAA showed significant RSS differences when compared to NSAC were…”
Reversal Learning Task in Children with Autism Spectrum Disorder: A Robot-Based Approach
Costescu, C. A., Vanderborght, B., & David, D. O. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2319-z · Cited by 87 · see citing works
Groman, S. M., Lee, B., London, E. D., Mandelkern, M. A., James, A. S., Feiler, K., Rivera, R. J., Dahlbom, M. L., Sossi, V., Vandervoort, E., et al. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.0363-11.2011 · Cited by 86 · see citing works
“Moreover, activation of the dorsal striatum is observed in human subjects, studied with functional MRI, during a discrimination reversal task (Ghahremani et al., 2010).”
BackgroundSelf-citationBertoux, M., Emmanuelle Volle, C., Funkiewiez, A., de Souza, L. C., Leclercq, D., & Dubois, B. (2012) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617712001300 · Cited by 85 · see citing works
“…the anterior cingulate cortex has been found to be especially involved during the reversal phase (Ghahremani, Monterosso, Jentsch, Bilder, & Poldrack, 2010; O’Doherty et al., 2001) and may accelerate and stabilize relearning via the inhibition of prior incorrect responses (Ghahremani et al., 2010).”
BackgroundMadden, J. R., Langley, E., Whiteside, M., Beardsworth, C. E., & van Horik, J. O. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0297 · Cited by 83 · see citing works
Dopamine and reward: a view from the prefrontal cortex
Chau, B. K. H., Jarvis, H., Law, C.-K., & Chong, T. T. ‐. (2018) · Behavioural Pharmacology · doi:10.1097/fbp.0000000000000424 · Cited by 84 · see citing works
“Human fMRI studies of reinforcement learning have consistently reported strong activity at the OFC when participants reverse their choices (Monchi et al., 2001; O’Doherty et al., 2001; Kringelbach and Rolls, 2003; Ghahremani et al., 2010; Hampshire et al., 2012).”
BackgroundCognitive flexibility: Impact on entrepreneurial intentions
Dheer, R. J. S., & Lenartowicz, T. (2019) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2019.103339 · Cited by 85 · see citing works
D'Cruz, A.-M., Mosconi, M. W., Ragozzino, M. E., Cook, E. H., & Sweeney, J. A. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.161 · Cited by 77 · see citing works
Gilmour, G., Arguello, A., Bari, A., Brown, V., Carter, C., Floresco, S., Jentsch, D., Tait, D. S., Young, J., & Robbins, T. (2013) · Neuroscience and Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.04.006 · Cited by 91 · see citing works
Self-citationHampshire, A., Chaudhry, A. M., Owen, A. M., & Roberts, A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.072 · Cited by 80 · see citing works
“Functionally dissociating the LOFC and the LPFC The most important result from the current study is the difference in the profile of the BOLD response in sub-regions of the inferiorfrontal cortex.”
InfluentialBehavioral flexibility and problem solving in an invasive bird
Logan, C. (2016) · PeerJ · doi:10.7717/peerj.1975 · Cited by 77 · see citing works
“…flexibility by requiring birds to change preferences using four experiments involving two preference changes, similar to reversal learning experiments, which are considered tests of behavioral flexibility (e.g., Bond et al. 2007, Tebbich et al. 2010, Ghahremani et al. 2010, Buckner 2013).”
MethodTemporal dynamics of brain activation during 40 minutes of pleasant touch
Sailer, U., Triscoli, C., Häggblad, G., Hamilton, J. P., Olausson, H., & Croy, I. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.031 · Cited by 77 · see citing works
Hervig, M. E., Fiddian, L., Piilgaard, L., Božič, T., Blanco-Pozo, M., Knudsen, C., Olesen, S. F., Alsiö, J., & Robbins, T. W. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhz144 · Cited by 65 · see citing works
“1999) and included serial reversals as also used in human imaging studies (Cools et al. 2009; Ghahremani et al. 2010) to establish the principle or rule of reversal learning (Rygula et al.”
BackgroundMethodGentili, R. J., Shewokis, P. A., Ayaz, H., & Contreras-Vidal, J. L. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00277 · Cited by 64 · see citing works
“The role of such frontally mediated functions is reduced during late learning and thus leads to a smaller activation of these prefrontal regions (Ghahremani et al., 2010).”
BackgroundSubcortical Dopamine and Cognition in Schizophrenia: Looking Beyond Psychosis in Preclinical Models
Conn, K., Burne, T. H. J., & Kesby, J. P. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00542 · Cited by 63 · see citing works
“The OFC is particularly important in reversal learning as increased activity has been observed while participants perform reversals (as opposed to during the initial discrimination) which indicates the OFC’s role in the reformation of established associations (Ghahremani et al., 2010).”
BackgroundChantiluke, K., Barrett, N., Giampietro, V., Brammer, M., Simmons, A., Murphy, D. G., & Rubia, K. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht365 · Cited by 59 · see citing works
“…interesting as this region is closely interconnected with the mPFC (Small et al. 2003) and plays a key role in reversal learning (Dodds et al. 2008; Ghahremani et al. 2010), reward evaluation (McCoy and Platt 2005; Liu et al. 2011), and visual–spatial attention to saliency, in particular error…”
BackgroundDubois, M., Lapinte, N., Villier, V., Lecointre, C., Roy, V., Tonon, M., Gandolfo, P., Joly, F., Hilber, P., & Castel, H. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.11.012 · Cited by 61 · see citing works
Groman, S. M., James, A. S., Seu, E., Crawford, M. A., Harpster, S. N., & Jentsch, J. D. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.12.002 · Cited by 58 · see citing works
“Neuroimaging studies in humans have found increased activation during reversal learning in both the putamen (17) and in the caudate (9).”
BackgroundSelf-citationAddicott, M. A., Baranger, D. A. A., Kozink, R. V., Smoski, M. J., Dichter, G. S., & McClernon, F. J. (2011) · Psychopharmacology · doi:10.1007/s00213-011-2404-3 · Cited by 55 · see citing works
“The OFC is involved in reward-based learning and is thought to maintain and update stimulus-reward associations (Schoenbaum et al. 2003; Ghahremani et al. 2010), it has also been implicated in altering behavior when in response to a change in environmental reinforcement contingencies (for review,…”
Beylergil, S. B., Beck, A., Deserno, L., Lorenz, R. C., Rapp, M. A., Schlagenhauf, F., Heinz, A., & Obermayer, K. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.04.010 · Cited by 54 · see citing works
Wu, H., Yan, H., Yang, Y., Xu, M., Shi, Y., Zeng, W., Li, J., Zhang, J., Chang, C., & Wang, N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00215 · Cited by 55 · see citing works
Human reversal learning under conditions of certain versus uncertain outcomes
D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Pavuluri, M. N., & Sweeney, J. A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.068 · Cited by 54 · see citing works
“This increased processing in reward circuitry may have facilitated the enhanced activation in higher-order cognitive systems that are crucial for reversal learning, including dorsal frontal regions that support the updating of response-outcome relationships and flexible behavior (Ghahremani et al., 2010; O'Doherty et…”
InfluentialRelationship between emotional experience and resilience: An fMRI study in fire-fighters
Reynaud, E., Guedj, É., Souville, M., Trousselard, M., Zendjidjian, X. Y., Khoury-Malhame, M. E., Fakra, É., Nazarian, B., Blin, O. J., Canini, F., et al. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.01.007 · Cited by 53 · see citing works
Kleen, J. K., Sesqué, A., Wu, E. X., Miller, F. A., Hernan, A. E., Holmes, G. L., & Scott, R. C. (2011) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2011.07.022 · Cited by 50 · see citing works
“Behavioral flexibility refers to the ability to adaptively adjust acquired responses upon a change in environmental conditions [32].”
BackgroundBayesian mapping reveals that attention boosts neural responses to predicted and unpredicted stimuli
Garrido, M. I., Rowe, E. G., Halász, V., & Mattingley, J. B. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx087 · Cited by 44 · see citing works
Vagal nerve activity as a moderator of brain-immune relationships
Ohira, H., Matsunaga, M., Osumi, T., Fukuyama, S., Shinoda, J., Yamada, J., & Gidron, Y. (2013) · Journal of Neuroimmunology · doi:10.1016/j.jneuroim.2013.04.011 · Cited by 47 · see citing works
“Subtraction analyses of initial/reversal learning minus the control task indicated activation of the dorsal ACC and medial OFC, which is consistent with previous studies using similar tasks (Ghahremani et al., 2010; Hampshire et al., 2012).”
ResultWolfensteller, U., & Ruge, H. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00192 · Cited by 48 · see citing works
“In reversal learning, subjects have to learn that given a particular stimulus, the previously correct response needs to be replaced by an alternative response which had previously been associated with another stimulus (e.g., Cools et al., 2002; Ghahremani et al., 2010).”
BackgroundResultStress modulation of cognitive and affective processes
Campeau, S., Liberzon, I., Morilak, D. A., & Ressler, K. J. (2011) · Stress · doi:10.3109/10253890.2011.596864 · Cited by 47 · see citing works
“Given the extensive association of the prefrontal cortex with the expression of behavioral and cognitive flexibility and executive functions on one hand (Ragozzino et al. 1999; Dalley et al. 2004; Ghahremani et al. 2010), and the abnormal prefrontal cortical activity noted in stress-related clinical disorders on the o…”
BackgroundMoreno-López, L., Perales, J. C., Son, D. V., Albein‐Urios, N., Soriano‐Mas, C., Martínez-González, J. M., Wiers, R. W. H. J., & Verdejo‐García, A. (2014) · Addiction Biology · doi:10.1111/adb.12143 · Cited by 46 · see citing works
“2002; Ghahremani et al .”
BackgroundCarey, S. E., Nestor, L. J., Jones, J. L., Garavan, H., & Hester, R. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.07.671 · Cited by 45 · see citing works
Common Neural Mechanisms Underlying Reversal Learning by Reward and Punishment
Xue, G., Xue, F., Droutman, V., Lu, Z., Bechara, A., & Read, S. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0082169 · Cited by 45 · see citing works
“To address this issue, several studies have tried to either compare reversal errors with probabilistic errors and nonreversal errors in a serial reversal task [24], or compare reversal errors with acquisition errors [22,41].”
BackgroundResultInfluentialIntentional and Incidental Self-Control in Ventrolateral PFC
Cohen, J. R., Berkman, E. T., & Lieberman, M. D. (2011) · Cited by 44 · see citing works
The anterior claustrum and spatial reversal learning in rats
Grasby, K. L., & Talk, A. C. (2013) · Brain Research · doi:10.1016/j.brainres.2013.01.014 · Cited by 46 · see citing works
Group social rank is associated with performance on a spatial learning task
Langley, E., van Horik, J. O., Whiteside, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.171475 · Cited by 43 · see citing works
“The ability to flexibly respond to changes when contingencies are altered is governed by separate neuronal pathways to acquisition learning [18].”
BackgroundSex Differences in Cognitive Flexibility and Resting Brain Networks in Middle-Aged Marmosets
LaClair, M., Febo, M., Nephew, B. C., Gervais, N. J., Poirier, G. L., Workman, K. P., Chumachenko, S. Y., Payne, L., Moore, M. C., King, J. A., et al. (2019) · eNeuro · doi:10.1523/eneuro.0154-19.2019 · Cited by 43 · see citing works
“…imaging studies in humans have shown increased activation in the OFC during reversal learning paradigms (Nagahama et al., 2001; Cools et al., 2002; Ghahremani et al., 2010) and studies in NHPs have shown that lesions to the OFC cause disruptions in reversal, but not in the initial stimulus-reward…”
BackgroundCognitive control and the dopamine D2-like receptor: a dimensional understanding of addiction
Groman, S. M., & Jentsch, J. D. (2011) · Depression and Anxiety · doi:10.1002/da.20897 · Cited by 41 · see citing works
“Indeed, functional imaging studies have reported activation of several corticostriatal–brain nuclei during tasks of working memory[102] and behavioral flexibility,[103,104] providing evidence that these processes rely on a large network of corticostriatal brain nuclei.”
BackgroundSelf-citationConsideration of species differences in developing novel molecules as cognition enhancers
Young, J. W., Jentsch, J. D., Bussey, T. J., Wallace, T. L., & Hutcheson, D. M. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.10.002 · Cited by 42 · see citing works
“, 2010), while human studies are beginning to involve deterministic feedback (Ghahremani et al., 2010).”
Self-citationComplexity and Competition in Appetitive and Aversive Neural Circuits
Barberini, C. L., Morrison, S. E., Saez, A., Lau, B., & Salzman, C. D. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00170 · Cited by 41 · see citing works
“Neuroscientists have long believed that the prefrontal cortex, and OFC in particular, drives reversal learning (Iversen and Mishkin, 1970; Thorpe et al., 1983; O’Doherty et al., 2001; Schoenbaum et al., 2002; Chudasama and Robbins, 2003; Fellows and Farah, 2003; Hornak et al., 2004; Izquierdo et al., 2004; Chamberlain…”
BackgroundDecision-making (in)flexibility in gambling disorder
Perandrés‐Gómez, A., Navas, J. F., van Timmeren, T., & Perales, J. C. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106534 · Cited by 39 · see citing works
Gebregergis, W. T., Huang, F., & Hong, J. (2019) · Journal of International Students · doi:10.32674/jis.v9i2.964 · Cited by 38 · see citing works
Cognitive impairment and gene expression alterations in a rodent model of binge eating disorder
Chawla, A., Cordner, Z. A., Boersma, G. J., & Moran, T. H. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.08.004 · Cited by 38 · see citing works
The human prefrontal cortex mediates integration of potential causes behind observed outcomes
Wunderlich, K., Beierholm, U., Bossaerts, P. L., & O’Doherty, J. P. (2011) · Journal of Neurophysiology · doi:10.1152/jn.01051.2010 · Cited by 37 · see citing works
“It is also important to consider the relationship between the present results and previous trial based analyses (Cools et al. 2002; Ghahremani et al. 2010; Hampton et al. 2006; O’Doherty et al. 2001) and neurochemical investigations (e.”
The fraction of an action is more than a movement: Neural signatures of event segmentation in fMRI
Schubotz, R. I., Korb, F. M., Schiffer, A., Stadler, W., & von Cramon, D. Y. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.008 · Cited by 34 · see citing works
“Moreover, prefrontal cortex has been associated with the suppression of dominant but currently unwarranted decisions/actions (Frank and Claus, 2006; Ghahremani et al., 2010; Kuhl et al., 2007; Miller and Cohen, 2001; Ridderinkhof et al., 2004b), a function that would be required when preceding…”
Sato, K., Kirino, E., & Tanaka, S. (2015) · Behavioural Neurology · doi:10.1155/2015/274919 · Cited by 33 · see citing works
“More broadly, the IFG has been associated with cognitive control of memory [25], response selection/inhibition and other self-control functions [26], and cognitive flexibility [27].”
BackgroundCerebellar contributions to a brainwide network for flexible behavior in mice
Verpeut, J. L., Bergeler, S., Kislin, M., Townes, F. W., Klibaite, U., Dhanerawala, Z. M., Hoag, A., Janarthanan, S. R., Jung, C., Lee, J., et al. (2023) · Communications Biology · doi:10.1038/s42003-023-04920-0 · Cited by 34 · see citing works
The orbitofrontal cortex and its role in the assignment of behavioural significance
Diekhof, E. K., Falkai, P., & Gruber, O. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.01.032 · Cited by 32 · see citing works
Chronic stress modulates neural and cardiovascular responses during reversal learning
Ohira, H., Matsunaga, M., Kimura, K., Murakami, H., Osumi, T., Isowa, T., Fukuyama, S., Shinoda, J., & Yamada, J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.07.014 · Cited by 31 · see citing works
“In addition, midbrain activity revealed during reversal learning in the low job-stress group was consistent with previous findings (Jocham et al., 2009; Ghahremani et al., 2010).”
BackgroundResultFractionating adaptive learning: A meta-analysis of the reversal learning paradigm
Yaple, Z. A., & Yu, R. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.006 · Cited by 28 · see citing works
Sallet, J., Noonan, M. P., Thomas, A. G., O’Reilly, J. X., Anderson, J., Papageorgiou, G., Neubert, F. X., Ahmed, B., Smith, J. E. T., Bell, A. H., et al. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000605 · Cited by 29 · see citing works
“It is also possible to link the present results with fMRI activity recorded in a nearby region when monkeys learn to use specific choice–reward outcomes to guide decision-making [9] and reversal learning or task switching in humans [71,72], reinforcing the idea of a similar structural–functional organization of the OF…”
ResultHampshire, A., Daws, R. E., das Neves, I., Soreq, E., Sandrone, S., & Violante, I. R. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.002 · Cited by 29 · see citing works
“The most widely studied is reinforcement learning (RL), where the participant formulates a provisional program for performing a task, applies it and when necessary updates it based on the outcome (Boettiger and D'Esposito, 2005; Brovelli et al., 2011; Collins and Frank, 2018; Eliassen et al., 2003; Ghahremani et al.,…”
Backgroundd-Cycloserine facilitates extinction learning and enhances extinction-related brain activation
Klass, A., Glaubitz, B., Tegenthoff, M., & Lissek, S. (2017) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2017.08.003 · Cited by 27 · see citing works
Cortico-limbic–striatal contribution after response and reversal learning: A metabolic mapping study
Fidalgo, C., Conejo, N. M., González‐Pardo, H., & Arias, J. L. (2010) · Brain Research · doi:10.1016/j.brainres.2010.10.066 · Cited by 28 · see citing works
Aljadeff, N., & Lotem, A. (2021) · Animal Behaviour · doi:10.1016/j.anbehav.2021.07.002 · Cited by 28 · see citing works
Learning and memory deficits produced by aspartame are heritable via the paternal lineage
Jones, S. K., McCarthy, D. M., Stanwood, G. D., Schatschneider, C. W., & Bhide, P. G. (2023) · Scientific Reports · doi:10.1038/s41598-023-41213-2 · Cited by 27 · see citing works
Lim, J., Kim, E., Noh, H. J., Kang, S., Phillips, B. U., Kim, D. G., Bussey, T. J., Saksida, L. M., Heath, C. J., & Kim, C. H. (2019) · Molecular Brain · doi:10.1186/s13041-019-0441-8 · Cited by 27 · see citing works
Animal Models for OCD Research
Chamberlain, B. L., & Ahmari, S. E. (2021) · Current topics in behavioral neurosciences · doi:10.1007/7854_2020_196 · Cited by 26 · see citing works
Neural mechanisms mediating association of sympathetic activity and exploration in decision-making
Ohira, H., Matsunaga, M., Murakami, H., Osumi, T., Fukuyama, S., Shinoda, J., & Yamada, J. (2013) · Neuroscience · doi:10.1016/j.neuroscience.2013.04.050 · Cited by 28 · see citing works
“Finally, subtraction analyses of PET images of initial/ reversal learning minus the control task showed robust activation of the dorsal ACC, medial OFC, and striatum, which is consistent with previous studies using similar tasks (Ghahremani et al., 2010; Hampshire et al., 2012).”
ResultINTENTIONAL AND INCIDENTAL SELF-CONTROL IN VENTROL ATERAL PREFRONTAL CORTE X
Cohen, J. R., Berkman, E., & Lieberman, M. D. (2012) · Oxford University Press eBooks · doi:10.1093/med/9780199837755.003.0030 · Cited by 25 · see citing works
Rapid Association Learning in the Primate Prefrontal Cortex in the Absence of Behavioral Reversals
Cromer, J. A., Machon, M., & Miller, E. K. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21555 · Cited by 25 · see citing works
Dissociable roles of medial and lateral PFC in rule learning
Cao, B., Li, W., Li, F., & Li, H. (2016) · Brain and Behavior · doi:10.1002/brb3.551 · Cited by 26 · see citing works
Using rodents to model abnormal sensitivity to feedback in depression
Ryguła, R., Noworyta, K., Drozd, R., & Kozub, A. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.10.008 · Cited by 25 · see citing works
“Processing of negative feedback has been found to be lateralized to the right OFC (Ghahremani et al., 2010; O’Doherty et al., 2001; Sobotka et al., 1992), whereas processing of rewards has been found to activate the left OFC (Damasio, 1996; Sobotka et al.”
InfluentialRuge, H., & Wolfensteller, U. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.005 · Cited by 24 · see citing works
“Ghahremani et al. (2010) showed that the posterior lOFC was more strongly engaged during deterministic reversal learning than during initial learning.”
InfluentialNeural changes when actions change: Adaptation of strong and weak expectations
Schiffer, A., Ahlheim, C., Ulrichs, K., & Schubotz, R. I. (2012) · Human Brain Mapping · doi:10.1002/hbm.22023 · Cited by 24 · see citing works
“Both, hypothesis generation and suppression have been discussed as potential OFC functions [Elliott et al., 2000; Ghahremani et al., 2009; Vartanian and Goel, 2005].”
BackgroundResultWang, X., Qiao, Y., Dai, Z., Sui, N., Shen, F., Zhang, J., & Liang, J. (2018) · Brain Structure and Function · doi:10.1007/s00429-018-1780-4 · Cited by 22 · see citing works
Yin, Y., Yu, H., Su, Z., Zhang, Y., & Zhou, X. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13653 · Cited by 21 · see citing works
“This interpretation is in line with lOFC’s role in mediating task switch ability and reversal learning, where the agent has to inhibit a familiar behavioral rule and adjust to a new one (Ghahremani et al., 2010; Kehagia et al., 2010).”
BackgroundResultObstruction increases activation in the right inferior frontal gyrus
Liu, T., Saito, H., & Oi, M. (2015) · Social Neuroscience · doi:10.1080/17470919.2015.1088469 · Cited by 18 · see citing works
Bailey, L. S., Bagley, J. R., Dodd, R., Olson, A., Bolduc, M., Philip, V. M., Reinholdt, L. G., Rizzo, S. J. S., Tarantino, L. M., Gagnon, L. H., et al. (2021) · Genes Brain & Behavior · doi:10.1111/gbb.12773 · Cited by 16 · see citing works
“Reversal learning requires function of the orbitofrontal cortex and dorsomedial striatum for optimal inhibitory control, also showed by a functional neuroimaging study in human adults.(81) Conversely, tests of impulsive choice rely less robustly on the orbitofrontal cortex and are more strongly associated with activat…”
BackgroundDifferential Brain Activity during Emotional versus Nonemotional Reversal Learning
Nashiro, K., Sakaki, M., Nga, L., & Mather, M. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00245 · Cited by 18 · see citing works
“Thus, consistent with previous research (Ghahremani et al., 2010; Tsuchida et al., 2010; Rolls & Grabenhorst, 2008; Kringelbach & Rolls, 2003), the OFC showed greater activity during reversal than acquisition trials, indicating a critical role of the OFC in reversal learning.”
InfluentialDevelopmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach
Weiß, E. O., Kruppa, J. A., Fink, G. R., Herpertz‐Dahlmann, B., Konrad, K., & Schulte‐Rüther, M. (2021) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.536596 · Cited by 17 · see citing works
Manet, M. W. E., Kliphuis, S., Rodenburg, T. B., Goerlich, V. C., Tuyttens, F., & Nordquist, R. E. (2022) · Animal Behavior and Cognition · doi:10.26451/abc.09.01.03.2022 · Cited by 14 · see citing works
Endophenotype trait domains for advancing gene discovery in autism spectrum disorder
Mosconi, M. W., Stevens, C. J., Unruh, K. E., Shafer, R. L., & Elison, J. T. (2023) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-023-09511-y · Cited by 16 · see citing works
“Increased rates of antisaccade errors have been repeatedly documented in autistic individuals [130, 131, 187, 192, 193]. and their unaffected first-degree relatives [111], and shown to be associated with reduced activations across frontal and parietal eye fields [132] that are important for…”
BackgroundLearning and memory processes in behavioural addiction: A systematic review
Ngetich, R. K., Villalba-García, C., Soborun, Y., Vékony, T., Czakó, A., Demetrovics, Z., & Németh, D. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105747 · Cited by 20 · see citing works
Inertia in value-driven attentionPreprint
Liao, M., & Anderson, B. A. (2020) · Learning & Memory · doi:10.1101/lm.052027.120 · Cited by 15 · see citing works
“Humans can rapidly adapt to new reward structures and even to frequently changing reward contingencies (e.g., Behrens et al. 2007; Ghahremani et al. 2010; Lee and Keramati 2017).”
BackgroundZeuner, K. E., Knutzen, A., Granert, O., Sablowsky, S., Götz, J., Wolff, S., Jansen, O., Dressler, D. W., Schneider, S. A., Klein, C., et al. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.11.006 · Cited by 16 · see citing works
“It seems to be important in correcting responses via inhibition of prior incorrect responses (Ghahremani et al., 2010).”
BackgroundAdler, S. M., Girotti, M., & Morilak, D. A. (2020) · Neurobiology of Stress · doi:10.1016/j.ynstr.2020.100258 · Cited by 15 · see citing works
“Lateral OFC lesions were sufficient to impair reversal learning (Kim and Ragozzino, 2005), and human subjects exhibit increased activity in lateral OFC during reversal learning (Ghahremani et al., 2010).”
Backgroundde Oliveira, A. R., Reimer, A. E., Simandl, G. J., Nagrale, S. S., & Widge, A. S. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01448-x · Cited by 14 · see citing works
“that includes OFC, prefrontal cortex and dorsal anterior cingulate cortex (47-50).”
Background
- Authors
- Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A.
- Affiliations
- University of California, Los Angeles (US)
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-11-13
- Volume
- 20
- Issue
- 8
- Pages
- 1843-1852
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- PMC
- PMC2901019
- OpenAlex
- W2027568409
- Cited by
- 180
- References
- 62
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 6 · 2023: 14 · 2022: 9 · 2021: 17 · 2020: 9 · 2019: 13 · 2018: 10 · 2017: 12 · 2016: 10 · 2015: 9 · 2014: 8 · 2013: 16 · 2012: 13
- FWCI
- 6.13
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (0223843)
- National Institutes of Health (RR020750)
- National Institute of Mental Health (PL1MH083271)
- National Institute on Drug Abuse (RL1DA024853, P20DA022539)
- National Center for Research Resources (UL1RR024911, P20RR020750, 1P20-RR020750)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reversal learning, behavioral flexibility, lateral orbitofrontal cortex, dorsal anterior cingulate cortex, right inferior frontal gyrus, response inhibition, stop-signal task, stimulus-response associations, adaptive learning, reward contingency
- MeSH terms
- Adaptation, Psychological, Adolescent, Adult, Association Learning, Biofeedback, Psychology, Brain Mapping, Cognition, Dominance, Cerebral, Female, Gyrus Cinguli, Humans, Functional Laterality, Learning, Male, Nerve Net, Psychomotor Performance, Reward, Prefrontal Cortex, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
