Probabilistic Reinforcement Learning in Patients With Schizophrenia: Relationships to Anhedonia and Avolition
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Background Anhedonia (a reduced experience of pleasure) and avolition (a reduction in goal-directed activity) are common features of schizophrenia that have substantial effects on functional outcome, but are poorly understood and treated. Here, we examined whether alterations in reinforcement learning may contribute to these symptoms in schizophrenia by impairing the translation of reward information into goal-directed action. Methods 38 stable outpatients with schizophrenia or schizoaffective disorder and 37 healthy controls underwent fMRI during a probabilistic stimulus selection reinforcement learning task with dissociated choice- and feedback-related activation, followed by a behavioral transfer task allowing separate assessment of learning from positive versus negative outcomes. A Q-learning algorithm was used to examine functional activation relating to prediction error at the time of feedback and to expected value at the time of choice. Results Behavioral results suggested a reduction in learning from positive feedback in patients; however, this reduction was unrelated to anhedonia/avolition severity. On fMRI analysis, prediction error-related activation at the time of feedback was highly similar between patients and controls. During early learning, patients activated regions in the cognitive control network to a lesser extent than controls. Correlation analyses revealed reduced responses to positive feedback in dorsolateral prefrontal cortex and caudate among those patients higher in anhedonia/avolition. Conclusions Together, these results suggest that anhedonia/avolition are as strongly related to cortical learning or higher-level processes involved in goal-directed behavior such as effort computation and planning as to striatally mediated learning mechanisms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · cited 1×
“unmedicated); among other possible differences, our patients had lower positive symptom severity than many published reports, and there is evidence in the literature that aberrant PE activity is related to positive symptoms in patients with schizophrenia (46).”
BackgroundBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · cited 1×
“PEs are thought to be coded by dopaminergic projections to the basal ganglia, which signal the difference between predicted and received rewards and drive learning by iteratively updating reward predictions (14).”
BackgroundSubstantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · cited 1×
“Our findings of significant striatal activation at the group level in patients with schizophrenia during learning, with no significant differences from control subjects, contrast with the findings of several studies in the literature showing reduced striatal PEs in patients with schizophrenia (17,21,41).”
ResultExpected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485 · cited 1×
“The lack of significant relationships between anhedonia/ avolition scores and striatal responses specifically to PE differs from some reports in the literature (17,44), although at least one other study did not find such relationships (16) and”
ResultZhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355
Waltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Self-citationMessinger, J. W., Trémeau, F., Antonius, D., Mendelsohn, E., Prudent, V., Stanford, A. D., & Malaspina, D. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.09.002 · Cited by 271
Cited by
Ten simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Self-citationNonsocial and social cognition in schizophrenia: current evidence and future directions
Green, M. F., Horan, W. P., & Lee, J. (2019) · World Psychiatry · doi:10.1002/wps.20624 · Cited by 612
Ermakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91
Apathy in schizophrenia: A review of neuropsychological and neuroanatomical studies
Bortolon, C., Macgregor, A., Capdevielle, D., & Raffard, S. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.09.033 · Cited by 69
Pushkarskaya, H., Sobowale, K., Henick, D., Tolin, D. F., Anticevic, A., Pearlson, G. D., Levy, I., Harpaz-Rotem, I., & Pittenger, C. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.11.029 · Cited by 30
Metadata
- Authors
- Dowd, E. C., Frank, M. J., Collins, A., Gold, J. M., & Barch, D. M.
- Venue
- Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
- Publisher
- Elsevier BV
- Published
- 2016-09
- Volume
- 1
- Issue
- 5
- Pages
- 460-473
- ISSN
- 2451-9022 (ISSN-L)
- OpenAlex
- W2432457035
- Cited by
- 101
- References
- 17
- FWCI
- 10.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Probabilistic Reinforcement Learning in Patients With Schizophrenia: Relationships to Anhedonia and Avolition. https://app.cochat.ai/papers/10.1016/j.bpsc.2016.05.005
- The paper
- Dowd, E. C., Frank, M. J., Collins, A., Gold, J. M., & Barch, D. M. (2016). Probabilistic Reinforcement Learning in Patients With Schizophrenia: Relationships to Anhedonia and Avolition. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging. https://doi.org/10.1016/j.bpsc.2016.05.005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.