The DOI matches its Crossref record; the references it cites are not checked yet.
Abnormal temporal difference reward-learning signals in major depression
Abstract
Anhedonia is a core symptom of major depressive disorder (MDD), long thought to be associated with reduced dopaminergic function. However, most antidepressants do not act directly on the dopamine system and all antidepressants have a delayed full therapeutic effect. Recently, it has been proposed that antidepressants fail to alter dopamine function in antidepressant unresponsive MDD. There is compelling evidence that dopamine neurons code a specific phasic (short duration) reward-learning signal, described by temporal difference (TD) theory. There is no current evidence for other neurons coding a TD reward-learning signal, although such evidence may be found in time. The neuronal substrates of the TD signal were not explored in this study. Phasic signals are believed to have quite different properties to tonic (long duration) signals. No studies have investigated phasic reward-learning signals in MDD. Therefore, adults with MDD receiving long-term antidepressant medication, and comparison controls both unmedicated and acutely medicated with the antidepressant citalopram, were scanned using fMRI during a reward-learning task. Three hypotheses were tested: first, patients with MDD have blunted TD reward-learning signals; second, controls given an antidepressant acutely have blunted TD reward-learning signals; third, the extent of alteration in TD signals in major depression correlates with illness severity ratings. The results supported the hypotheses. Patients with MDD had significantly reduced reward-learning signals in many non-brainstem regions: ventral striatum (VS), rostral and dorsal anterior cingulate, retrosplenial cortex (RC), midbrain and hippocampus. However, the TD signal was increased in the brainstem of patients. As predicted, acute antidepressant administration to controls was associated with a blunted TD signal, and the brainstem TD signal was not increased by acute citalopram administration. In a number of regions, the magnitude of the abnormal signals in MDD correlated with illness severity ratings. The findings highlight the importance of phasic reward-learning signals, and are consistent with the hypothesis that antidepressants fail to normalize reward-learning function in antidepressant-unresponsive MDD. Whilst there is evidence that some antidepressants acutely suppress dopamine function, the long-term action of virtually all antidepressants is enhanced dopamine agonist responsiveness. This distinction might help to elucidate the delayed action of antidepressants. Finally, analogous to recent work in schizophrenia, the finding of abnormal phasic reward-learning signals in MDD implies that an integrated understanding of symptoms and treatment mechanisms is possible, spanning physiology, phenomenology and pharmacology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, depressed patients exhibit both hyposensitivity to rewards and oversensitivity to punishments 96,97 , attributed to alterations in mesolimbic prediction error signaling 97-99 , and may exhibit a constrained option space ('tunnel vision') during decision-making 100 .”
From Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model (2020) · cites this paper as [99]
In the citing paper
“Consistent with this view, the depressed show substantially reduced aMCC activity during reward learning tasks (Kumar et al., 2008).”
From Motivation in the Service of Allostasis: The Role of Anterior Mid-Cingulate Cortex (2019) · cites this paper as Kumar et al., 2008
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [122]
In the citing paper
“Functional neuroimaging studies in MDD have consistently indicated hypoactivation in reward-processing regions, including the dorsal and ventral striatum [210-214] and a host of other reward structures, including the medial prefrontal cortex [215,216], the pregenual and subgenual anterior cingulate, and the medial frontal gyrus [217,218].”
From Reward circuitry dysfunction in psychiatric and neurodevelopmental disorders and genetic syndromes: animal models and clinical findings (2012) · cites this paper as [212]
In the citing paper
“Several studies showed a disruption of striatal activity during reward learning, prediction-error encoding, and rewarding outcomes (Table 1) (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
From Circuit Mechanisms of Reward, Anhedonia, and Depression (2019) · cites this paper as Kumar et al., 2008
Citations
The citation lists are queued
They are fetched later and appear here then.
References 52 · Cited by 374
Research works printed but not linked: 6
- APA., 2000, Practice guideline for the treatment of patients with major depression
- Beck, 1979, Cognitive theory of depression
- Dayan, 2001, Theoretical neuroscience: computational and mathematical modelling of neural systems
- Friston, 2004, Introduction to statistical parametric mapping
- Nelson, 1991, The revised national adult reading test – test manual
- Spielberger, 1983, State-trait anxiety inventory for adults, STAI Form Y-1
Metadata
- Authors
- Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D.
- Affiliations
- University of Aberdeen (GB)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-06-25
- Volume
- 131
- Issue
- 8
- Pages
- 2084-2093
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2021295182
- Cited by
- 374
- References
- 52
- Citations by year
- 2026: 8 · 2025: 15 · 2024: 11 · 2023: 16 · 2022: 17 · 2021: 44 · 2020: 31 · 2019: 29 · 2018: 24 · 2017: 25 · 2016: 21 · 2015: 32 · 2014: 23 · 2013: 18 · 2012: 15
- FWCI
- 6.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Discovery Research Portal (University of Dundee) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- major depressive disorder, anhedonia, temporal difference learning, reward learning, dopamine, citalopram, antidepressant response, ventral striatum, anterior cingulate cortex, retrosplenial cortex, hippocampus, brainstem, disease severity
- MeSH terms
- Adult, Antidepressive Agents, Brain, Major Depressive Disorder, Female, Humans, Image Processing, Computer-Assisted, Learning, Magnetic Resonance Imaging, Male, Middle Aged, Neuropsychological Tests, Reinforcement, Psychology, Reward, Thirst, Time Factors, Citalopram, Treatment Failure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Abnormal temporal difference reward-learning signals in major depression. https://app.cochat.ai/papers/10.1093/brain/awn136
- The paper
- Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008). Abnormal temporal difference reward-learning signals in major depression. Brain. https://doi.org/10.1093/brain/awn136
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.