Human reversal learning under conditions of certain versus uncertain outcomes
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to nonreinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Motor Areas of the Medial Wall: A Review of Their Location and Functional Activation
Picard, N., & Strick, P. L. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.3.342 · Cited by 1,712 · cited 2×
“The cingulate region that was more active in the 4-relative to the 2-choice task was the motor cingulate cortex (Picard and Strick, 1996).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · cited 2×
“The neural response to unexpected non-reinforcement is known to scale with dimensions that are directly related to intrinsic properties of rewards themselves, such as the magnitude of a reward and its physical salience (for a review, see Schultz, 2010).”
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 1×
“Reversal learning tasks are a widely used tool for assessing behavioral flexibility (Ghahremani et al., 2010; Gläscher et al., 2009; Ragozzino et al., 2009).”
Neural circuits subserving behavioral flexibility and their relevance to schizophrenia
Floresco, S. B., Zhang, Y., & Enomoto, T. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.001 · Cited by 298 · cited 2×
“Reduced cognitive flexibility is characteristic of several psychiatric and neurologic disorders, including schizophrenia (Floresco et al., 2009), obsessive-compulsive disorder (Rosenberg et al.”
Velanova, K., Wheeler, M. E., & Luna, B. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn012 · Cited by 277
Clarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263 · cited 2×
“, repeated selection of previously rewarded responses, despite these responses no longer being reinforced (Clarke et al., 2008; Ferry et al., 2000).”
InfluentialNeurons in anterior cingulate cortex multiplex information about reward and action
Hayden, B. Y., & Platt, M. L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4874-09.2010 · Cited by 236
Mosconi, M. W., Kay, M., D'Cruz, A.-M., Seidenfeld, A., Guter, S., Stanford, L. D., & Sweeney, J. A. (2009) · Psychological Medicine · doi:10.1017/s0033291708004984 · Cited by 222 · cited 2×
“, 1997), autism (Mosconi et al., 2009), Parkinson's disease (Cools et al.”
Self-citationBoulougouris, V., Glennon, J. C., & Robbins, T. W. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301584 · Cited by 219
Neural Components Underlying Behavioral Flexibility in Human Reversal Learning
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., & Poldrack, R. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp247 · Cited by 180 · cited 7×
“This increased processing in reward circuitry may have facilitated the enhanced activation in higher-order cognitive systems that are crucial for reversal learning, including dorsal frontal regions that support the updating of response-outcome relationships and flexible behavior (Ghahremani et al., 2010; O'Doherty et…”
InfluentialOculomotor Response Inhibition Abnormalities in Pediatric Obsessive-Compulsive Disorder
Rosenberg, D. R. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830210075008 · Cited by 114 · cited 2×
“, 2009), obsessive-compulsive disorder (Rosenberg et al., 1997), autism (Mosconi et al.”
Ferry, A. T., Lu, X.-C. M., & Price, J. L. (2000) · Experimental Brain Research · doi:10.1007/s002219900240 · Cited by 109
Short-Term Temporal Discounting of Reward Value in Human Ventral Striatum
Gregorios-Pippas, L., Tobler, P. N., & Schultz, W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90730.2008 · Cited by 101
Inhibitory motor control in response stopping and response switching
Kenner, N. M., Mumford, J. A., Hommer, R. E., Skup, M., Leibenluft, E., & Poldrack, R. A. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.1096-10.2010 · Cited by 92
Cited by
Dissecting impulsivity and its relationships to drug addictions
Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., & Pennington, Z. T. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12388 · Cited by 281
Reduced behavioral flexibility in autism spectrum disorders.
D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Shrestha, S., Cook, E. H., & Sweeney, J. A. (2013) · Neuropsychology · doi:10.1037/a0031721 · Cited by 279
Self-citationWang, J., Ethridge, L. E., Mosconi, M. W., White, S. P., Binder, D. K., Pedapati, E. V., Erickson, C. A., Byerly, M. J., & Sweeney, J. A. (2017) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-017-9191-z · Cited by 176
“tory control of behavior, behavioral flexibility, and error monitoring [53, 54].”
BackgroundSelf-citationMiller, H. L., Ragozzino, M. E., Cook, E. H., Sweeney, J. A., & Mosconi, M. W. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2244-1 · Cited by 131
Self-citationNeural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106
Metadata
- Authors
- D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Pavuluri, M. N., & Sweeney, J. A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-05
- Volume
- 56
- Issue
- 1
- Pages
- 315-322
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2006028921
- Cited by
- 54
- References
- 18
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.