Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
According to current concepts, major depressive disorder is strongly related to dysfunctional neural processing of motivational information, entailing impairments in reinforcement learning. While computational modelling can reveal the precise nature of neural learning signals, it has not been used to study learning-related neural dysfunctions in unmedicated patients with major depressive disorder so far. We thus aimed at comparing the neural coding of reward and punishment prediction errors, representing indicators of neural learning-related processes, between unmedicated patients with major depressive disorder and healthy participants. To this end, a group of unmedicated patients with major depressive disorder (n = 28) and a group of age- and sex-matched healthy control participants (n = 30) completed an instrumental learning task involving monetary gains and losses during functional magnetic resonance imaging. The two groups did not differ in their learning performance. Patients and control participants showed the same level of prediction error-related activity in the ventral striatum and the anterior insula. In contrast, neural coding of reward prediction errors in the medial orbitofrontal cortex was reduced in patients. Moreover, neural reward prediction error signals in the medial orbitofrontal cortex and ventral striatum showed negative correlations with anhedonia severity. Using a standard instrumental learning paradigm we found no evidence for an overall impairment of reinforcement learning in medication-free patients with major depressive disorder. Importantly, however, the attenuated neural coding of reward in the medial orbitofrontal cortex and the relation between anhedonia and reduced reward prediction error-signalling in the medial orbitofrontal cortex and ventral striatum likely reflect an impairment in experiencing pleasure from rewarding events as a key mechanism of anhedonia in major depressive disorder.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“In an instrumental reinforcement learning task, unmedicated individuals with MDD showed increasingly blunted medial OFC and ventral striatal RPE that correlated with anhedonia [126].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“it was found that positive reward prediction error in the medial OFC is reduced in depression, and was correlated with anhedonia, but the learning was intact, in 28 drug-naive patients with depression (Rothkirch et al., 2017).”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Rothkirch et al., 2017
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundWhat is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 1×
“This is also in line with several previous functional MRI studies using a fixed set of learning parameters across participants (e.g. Daw et al., 2006; Schönberg et al., 2007).”
ResultThe mesolimbic dopamine reward circuit in depression
Nestler, E. J., & Carlezon, W. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.018 · Cited by 2,059 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundThe brain reward circuitry in mood disorders
Russo, S. J., & Nestler, E. J. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3381 · Cited by 1,870 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundA scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale
Snaith, R. P., Hamilton, M., Morley, S., Humayan, A., Hargreaves, D., & Trigwell, P. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.167.1.99 · Cited by 1,778 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundJudgment of contingency in depressed and nondepressed students: Sadder but wiser?
Alloy, L. B., & Abramson, L. Y. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.4.441 · Cited by 1,692 · cited 1×
“…of reward and punishment learning are impaired in depression: while patients with MDD show reduced behavioural biases towards appetitive stimuli, their ability to discriminate between advantageous and less advantageous options is unimpaired (Alloy and Abramson, 1979; Pizzagalli et al., 2008).”
BackgroundDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 1×
“Based on previous work (Pessiglione et al., 2006), we specifically focused on neural coding of reward PE in ventral striatum and medial orbitofrontal cortex (mOFC) as well as punishment PE in anterior insula.”
MethodThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · cited 1×
“While the mOFC is particularly involved in the representation and storage of values and the subjective experience of pleasure (Levy and Glimcher, 2012), the ventral striatum could be critical for stimulus-response learning to optimize behaviour, similar to the known distinction between ‘wanting’…”
BackgroundPizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · cited 4×
“Several previous studies probed the relation between depressive symptoms and reward processing using reaction time tasks (Knutson et al., 2008; Pizzagalli et al., 2009; Cléry-Melin et al., 2011).”
BackgroundInfluential
Cited by
Items 101–132 of 132
The prefrontal–striatal signatures of reduced model-based learning in depressed patients
Wang, X., Zhou, X., Zhang, D., Zhang, Z., Gong, Y., Feng, Z., & Hou, J. M. (2026) · Annals of General Psychiatry · doi:10.1186/s12991-026-00630-z · Cited by 1
“First , this study found reduced RPE MF signal of VTA in the depressed patients, which is consistent with previous studies [31, 60].”
Guo, M., Fan, T., Li, Y., Yi, W., Wang, J., Hu, Y., Yan, F., Huang, Y., Gong, Y., Chen, C., et al. (2026) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2026.106491 · Cited by 2
Wang, Y., Peng, Y., Steele, J. D., & Tolomeo, S. (2026) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2026.112196 · Cited by 2
Associations with monetary values do not influence access to awareness for faces
Rothkirch, M., Wieser, M., & Sterzer, P. (2021) · PeerJ · doi:10.7717/peerj.10875
Self-citationFunctional Impairment and Presentations of Anhedonia in Major Depressive Disorder
Chow, T. K. (2020) · TSpace (University of Toronto) · Cited by 1
Cui, Z. (2021) · VTechWorks (Virginia Tech)
Basic Hypothesis and Therapeutics Targets of Depression: A Review
Kumar, A. (2021) · Archives in Neurology & Neuroscience · doi:10.33552/ann.2021.10.000738
“Depression may be caused due to neurotransmitter imbalances [2], increased oxidative and nitrosative damage in brain, HPA disturbances, impairment in glucose metabolism, and mitochondrial dysfunction, etc [3].”
BackgroundComputational principles of adaptive coding in healthy and impaired reinforcement learning
Bavard, S. (2021) · theses.fr (ABES) · doi:10.70675/23e9dabcz6cc1z4188z9646z5a919495ba54
Computational Phenotyping of Treatment-Resistant Depression prior to Electroconvulsive TherapyPreprint
Jones, R. E., Sands, L. P., Trattner, J. D., Jiang, A., Johnson, C. K., Farkas, E. B., Gligorovic, P. V., Douglas, H. E., Ramos, R., & Kishida, K. T. (2024) · medRxiv · doi:10.1101/2024.10.02.24314360
“Notably, computational reinforcement learning (RL) models have been used to reveal connections between moment-to-moment decisions, neural responses, momentary ‘happiness’, and depression symptoms 11–14 .”
BackgroundAnhedonia: a unifying symptom and a transdiagnostic therapeutic target
Rosso, G., Pesci, N. R., PERACCHIA, S., Garrone, C., Salvo, G. D., & Maina, G. (2025) · Minerva Psychiatry · doi:10.23736/s2724-6612.24.02572-7
Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Tonn, J. (2018) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-9145
Self-citationBellaert, N., & Cassioli, F. (2025) · ORBi UMONS · doi:10.17605/osf.io/97wks
Inzidenz und Risikofaktoren von depressiven Störungen bei Hochaltrigen
Durrant-Finn, C. (2024) · Qucosa (Saxon State and University Library Dresden)
Crawley, D. (2023) · UCL Discovery (University College London) · Cited by 3
Spaeth, A. M., Koenig, S., Everaert, J., Glombiewski, J. A., & Κube, T. (2026) · Behaviour Research and Therapy · doi:10.1016/j.brat.2026.104985
Sustained consummatory reward processing deficits in remitted melancholic depression
Cheng, C., Liu, M., Zhou, Z., Wei, L., & Liu, Q. (2026) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2026.02.032
Tang, X., Zheng, Y., Chen, F., Lin, B., Fu, Y., Zhang, H., & Ding, Z. (2026) · Research Square · doi:10.21203/rs.3.rs-8778572/v1
Reward learning mechanisms in anhedonia and dynamic modulation of perceived control
Zhang, L., ZHANG, Y., Long, Y., Xinyu, T. I. A. N., Xiang, Y., Liwen, J. I. A. N., & Wang, Z. (2026) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2026.0779
From Neural Circuits to Behavior: Examining the Central Role of Anhedonia in Major Depression
Ghanayem, L. K., Kumar, P., & Rizvi, S. J. (2026) · Advances in experimental medicine and biology · doi:10.1007/978-981-95-6872-7_8
Hietpas, A. J. (2026) · e-Publications@Marquette (Marquette University)
Wigg, C. (2026) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-do19v6jpe
Thase, M. E., Earley, W. R., Kozauer, S. G., Chen, C., Lakkis, H. D., & Durgam, S. (2026) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s594893
Neurosurgery for treatment-resistant depression: valuation and decision making
Suveges, S., Gilbertson, T., & Steele, J. D. (2026) · Brain · doi:10.1093/brain/awag258
Novick, A. M., Love, T., Johnson, R. L., Page, C. E., Effinger, D. P., Sukenik, D., Bishop, K., Calderone, J., Scott, J. L., Haller, H., et al. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.122676
Metadata
- Authors
- Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P.
- Affiliations
- Charité – Universitätsmedizin Berlin (DE)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-20
- Volume
- 140
- Issue
- 4
- Pages
- 1147-1157
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2598570532
- Cited by
- 124
- References
- 63
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 15 · 2023: 9 · 2022: 15 · 2021: 23 · 2020: 17 · 2019: 12 · 2018: 11 · 2017: 1
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- major depressive disorder, reinforcement learning, reward prediction error, anhedonia, medial orbitofrontal cortex, ventral striatum, anterior insula, operant conditioning, monetary rewards, unmedicated patients
- MeSH terms
- Adult, Depressive Disorder, Major, Major Depressive Disorder, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Psychiatric Status Rating Scales, Psychomotor Performance, Punishment, Reinforcement, Psychology, Reward, Prefrontal Cortex, Anhedonia, Ventral Striatum
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.