Human reversal learning under conditions of certain versus uncertain outcomes
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to nonreinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Motor Areas of the Medial Wall: A Review of Their Location and Functional Activation
Picard, N., & Strick, P. L. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.3.342 · Cited by 1,712 · cited 2×
“The cingulate region that was more active in the 4-relative to the 2-choice task was the motor cingulate cortex (Picard and Strick, 1996).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · cited 1×
“The selection and implementation of alternative motor responses is dependent upon the dorsomedial striatum (Balleine et al., 2007), motor cingulate (Picard and Strick, 1996), and the supplementary motor area (Matsuzaka and Tanji, 1996).”
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Paus, T., Petrides, M., Evans, A. C., & Meyer, E. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.2.453 · Cited by 834
Human insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · cited 2×
“The neural response to unexpected non-reinforcement is known to scale with dimensions that are directly related to intrinsic properties of rewards themselves, such as the magnitude of a reward and its physical salience (for a review, see Schultz, 2010).”
O'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Behavioral Neuroscience · doi:10.1037/0735-7044.110.5.872 · Cited by 476
Gläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 1×
“Reversal learning tasks are a widely used tool for assessing behavioral flexibility (Ghahremani et al., 2010; Gläscher et al., 2009; Ragozzino et al., 2009).”
Cited by
Dissecting impulsivity and its relationships to drug addictions
Jentsch, J. D., Ashenhurst, J. R., Cervantes, M. C., Groman, S. M., James, A. S., & Pennington, Z. T. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12388 · Cited by 281
Reduced behavioral flexibility in autism spectrum disorders.
D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Shrestha, S., Cook, E. H., & Sweeney, J. A. (2013) · Neuropsychology · doi:10.1037/a0031721 · Cited by 279
Self-citationWang, J., Ethridge, L. E., Mosconi, M. W., White, S. P., Binder, D. K., Pedapati, E. V., Erickson, C. A., Byerly, M. J., & Sweeney, J. A. (2017) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-017-9191-z · Cited by 176
“tory control of behavior, behavioral flexibility, and error monitoring [53, 54].”
BackgroundSelf-citationMiller, H. L., Ragozzino, M. E., Cook, E. H., Sweeney, J. A., & Mosconi, M. W. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2244-1 · Cited by 131
“…between the dorsal striatal circuits that support maintenance of a new set following a shift in response set (Brown et al. 2010; Floresco et al. 2006; Shafritz et al. 2008) and ventral striatal circuits that support initial set shifting (Bissonette et al. 2008; D’Cruz et al. 2011; Ranier 2007).”
BackgroundMethodInfluentialSelf-citationNeural correlates of reversal learning in severe mood dysregulation and pediatric bipolar disorder
Adleman, N. E., Kayser, R., Dickstein, D., Blair, R. J. R., Pine, D., & Leibenluft, E. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.011 · Cited by 106
Chamberlain, P. D., Rodgers, J., Crowley, M. J., White, S. E., Freeston, M. H., & South, M. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-31 · Cited by 99
D'Cruz, A.-M., Mosconi, M. W., Ragozzino, M. E., Cook, E. H., & Sweeney, J. A. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.161 · Cited by 77
Self-citationNeural correlates of feedback processing in obsessive-compulsive disorder
Endrass, T., Koehne, S., Riesel, A., & Kathmann, N. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0031496 · Cited by 44
“Because the aim of this study was to examine alterations of feedback processing in OCD in relation to behavioral reversal and to new response selection, a modified deterministic four-choice object reversal task was used (D’Cruz, Ragozzino, Mosconi, Pavuluri, & Sweeney, 2011).”
Method
Metadata
- Authors
- D'Cruz, A.-M., Ragozzino, M. E., Mosconi, M. W., Pavuluri, M. N., & Sweeney, J. A.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-05
- Volume
- 56
- Issue
- 1
- Pages
- 315-322
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2006028921
- Cited by
- 54
- References
- 21
- FWCI
- 1.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.