Reinforcement and Reversal Learning in First-Episode Psychosis
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Abnormalities in reinforcement learning and reversal learning have been reported in psychosis, possibly secondary to subcortical dopamine abnormalities. METHODS: We studied simple discrimination (SD) learning and reversal learning in a sample of 119 first-episode psychosis patients from the Cambridge early psychosis service (CAMEO) and 107 control participants. We used data on reinforcement learning and reversal learning extracted from the Cambridge Neuropsychological Test Automated Battery Intradimensional-Extradimensional shift task, which measures cognitive flexibility but also involves simple reinforcement learning (SD learning) and reversal learning stages. We also gathered diagnostic information to examine whether there were any differences between patients ultimately diagnosed with schizophrenia-spectrum disorders and those diagnosed with affective psychosis. RESULTS: Psychosis patients demonstrated deficits in simple reinforcement learning (SD learning) and in reversal learning, with no differences between affective psychosis and schizophrenia-spectrum psychosis. There was a significant modest correlation between reversal errors and negative symptoms (Spearman rho = 0.3, P = .02). CONCLUSIONS: There are reinforcement learning abnormalities in first-episode psychosis, which correlate with negative symptoms, suggesting a possible role for orbitofrontal cortex and ventral striatal pathology in the pathogenesis of motivational deficits in psychosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dementia Praecox or the Group of Schizophrenias
(1951) · Journal of the American Medical Association · doi:10.1001/jama.1951.02920270079043 · Cited by 4,407
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527
Self-citationLaruelle, M., Abi-Dargham, A., van Dyck, C. H., Gil, R., D'Souza, C. D., Erdos, J., McCance, E., Rosenblatt, W., Fingado, C., Zoghbi, S. S., et al. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.17.9235 · Cited by 1,291 · cited 1×
“Age (y) 24.5 (4.7) 23.3 (5.4) 23.6 (5.6) 24.2 (1.1) 1.6 224 .1 NART 112 (13) 109 ( 8 ) 108 (8.2) 111 (7.8) 1.9 175 .1”
InfluentialCools, R. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.12.1136 · Cited by 906 · cited 1×
“Waltz and Gold(20) showed profound reversal deficits in 34 patients with chronic schizophrenia using a different method; they employed a probabilistic reversal task adapted from Robbins and colleagues.(33,34) Our results demonstrate that reversal learning deficits are also present in many patients near the time of ini…”
MethodCognitive Inflexibility After Prefrontal Serotonin Depletion
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., & Roberts, A. C. (2004) · Science · doi:10.1126/science.1094987 · Cited by 632
Self-citationFellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631 · cited 1×
“Moreover, this evidence is corroborated from human functional imaging studies(33,54,55) and from studies of human patients with orbitofrontal lesions.(56,57) These regions are critical for motivational and goal-directed processing(10); thus, the present study suggests that there is dysfunction of orbitofrontal/ventral…”
ResultHornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322926791 · Cited by 603
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · cited 2×
“Finally, we have, in recent studies, demonstrated behavioral and physiological abnormalities during tests of reinforcement learning and motivational modulations in unmedicated first-episode psychosis patients.(13,15) Future studies should examine reversal learning in unmedicated patients with psychosis, its relation t…”
ResultDisrupted prediction-error signal in psychosis: Evidence for an associative account of delusions
Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R. F., Shanks, D. R., Robbins, T. W., Bullmore, E. T., Dickinson, A., & Fletcher, P. C. (2007) · Brain · doi:10.1093/brain/awm173 · Cited by 460
Self-citationRogers, R. D., Andrews, T. C., Grasby, P. M., Brooks, D. J., & Robbins, T. W. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900561931 · Cited by 458
Self-citationThe neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439 · cited 1×
“Suchmedications act on dopaminergic and serotonergic systems, and ascending serotonin and dopamine neurotransmitter systems are known to play a modulatory role in reinforcement learning processes.(51,52,58) There are, however, a number of reasons why our current results are unlikely to be secondary to medication effec…”
BackgroundSelf-citationClarke, H., Walker, S., Dalley, J., Robbins, T., & Roberts, A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj120 · Cited by 351
Self-citationWaltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Neuropsychological evidence for frontostriatal dysfunction in schizophrenia
Elliott, R., McKenna, P. J., Robbins, T. W., & Sahakian, B. J. (1995) · Psychological Medicine · doi:10.1017/s0033291700033523 · Cited by 267
Self-citationRelationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs
ROBBINS, T. W. (1976) · Nature · doi:10.1038/264057a0 · Cited by 241
Self-citationBasal-corticofrontal circuits in schizophrenia and obsessive-compulsive disorder
Cavallaro, R., Cavedini, P., Mistretta, P., Bassi, T., Angelone, S. M., Ubbiali, A., & Bellodi, L. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01814-0 · Cited by 140
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002157 · Cited by 119
Self-citationDodds, C. M., Muller, U., Clark, L., van Loon, A., Cools, R., & Robbins, T. W. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.1153-08.2008 · Cited by 113 · cited 1×
“First, we note that in a recent functional magnetic resonance imaging study in healthy volunteers, a low dose of the dopamine D2/D3 receptor antagonist, sulpiride, did not modulate brain activations during reversal learning or impair behavioral reversal performance.(59) Secondly, we observed a correlation between the…”
ResultSelf-citationSchizophrenic psychology, associative learning and the role of forebrain dopamine
Miller, R. (1976) · Medical Hypotheses · doi:10.1016/0306-9877(76)90040-2 · Cited by 67
Cited by
Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation
Kehagia, A. A., Murray, G. K., & Robbins, T. W. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.01.007 · Cited by 398
“Reversal learning Deficits in reversal learning, the ability to switch responding to a previously non-reinforced stimulus, are present not just in chronic illness but also in the early stages of disorders such as Parkinson’s disease (PD) [20], schizophrenia and bipolar disorder [21 ,22 ].”
BackgroundSelf-citationEpidemiology-driven neurodevelopmental animal models of schizophrenia
Meyer, U., & Feldon, J. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.10.018 · Cited by 372
Bussey, T. J., Holmes, A., Lyon, L., Mar, A. C., McAllister, K. A. L., Nithianantharajah, J., Oomen, C. A., & Saksida, L. M. (2012) · Neuropharmacology · doi:10.1016/j.neuropharm.2011.04.011 · Cited by 299
Neural circuits subserving behavioral flexibility and their relevance to schizophrenia
Floresco, S. B., Zhang, Y., & Enomoto, T. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.001 · Cited by 298
Review of the operational definition for first‐episode psychosis
Breitborde, N. J. K., Srihari, V. H., & Woods, S. W. (2009) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2009.00148.x · Cited by 282
Metadata
- Authors
- Murray, G. K., Cheng, F., Clark, L., Barnett, J. H., Blackwell, A. D., Fletcher, P. C., Robbins, T. W., Bullmore, E. T., & Jones, P. B.
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-07-21
- Volume
- 34
- Issue
- 5
- Pages
- 848-855
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- OpenAlex
- W2106995489
- Cited by
- 160
- References
- 22
- FWCI
- 8.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.