Human reversal learning under conditions of certain versus uncertain outcomes
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to nonreinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Motor Areas of the Medial Wall: A Review of Their Location and Functional Activation
Picard, N., & Strick, P. L. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.3.342 · Cited by 1,712 · cited 2×
“The cingulate region that was more active in the 4-relative to the 2-choice task was the motor cingulate cortex (Picard and Strick, 1996).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · cited 2×
“The neural response to unexpected non-reinforcement is known to scale with dimensions that are directly related to intrinsic properties of rewards themselves, such as the magnitude of a reward and its physical salience (for a review, see Schultz, 2010).”
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 1×
“Reversal learning tasks are a widely used tool for assessing behavioral flexibility (Ghahremani et al., 2010; Gläscher et al., 2009; Ragozzino et al., 2009).”
Neural circuits subserving behavioral flexibility and their relevance to schizophrenia
Floresco, S. B., Zhang, Y., & Enomoto, T. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.001 · Cited by 298 · cited 2×
“Reduced cognitive flexibility is characteristic of several psychiatric and neurologic disorders, including schizophrenia (Floresco et al., 2009), obsessive-compulsive disorder (Rosenberg et al.”
Velanova, K., Wheeler, M. E., & Luna, B. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn012 · Cited by 277
Clarke, H. F., Robbins, T. W., & Roberts, A. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1521-08.2008 · Cited by 263 · cited 2×
“, repeated selection of previously rewarded responses, despite these responses no longer being reinforced (Clarke et al., 2008; Ferry et al., 2000).”
Influential
Cited by
Dissecting impulsivity and its relationships to drug addictions
Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., & Pennington, Z. T. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12388 · Cited by 281
Reduced behavioral flexibility in autism spectrum disorders.
D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Shrestha, S., Cook, E. H., & Sweeney, J. A. (2013) · Neuropsychology · doi:10.1037/a0031721 · Cited by 279
Self-citationWang, J., Ethridge, L. E., Mosconi, M. W., White, S. P., Binder, D. K., Pedapati, E. V., Erickson, C. A., Byerly, M. J., & Sweeney, J. A. (2017) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-017-9191-z · Cited by 176
“tory control of behavior, behavioral flexibility, and error monitoring [53, 54].”
BackgroundSelf-citationMiller, H. L., Ragozzino, M. E., Cook, E. H., Sweeney, J. A., & Mosconi, M. W. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2244-1 · Cited by 131
Self-citationNeural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106
Metadata
- Authors
- D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Pavuluri, M. N., & Sweeney, J. A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-05
- Volume
- 56
- Issue
- 1
- Pages
- 315-322
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2006028921
- Cited by
- 54
- References
- 18
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Human reversal learning under conditions of certain versus uncertain outcomes. https://app.cochat.ai/papers/10.1016/j.neuroimage.2011.01.068
- The paper
- D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Pavuluri, M. N., & Sweeney, J. A. (2011). Human reversal learning under conditions of certain versus uncertain outcomes. NeuroImage. https://doi.org/10.1016/j.neuroimage.2011.01.068
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.