Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
According to current concepts, major depressive disorder is strongly related to dysfunctional neural processing of motivational information, entailing impairments in reinforcement learning. While computational modelling can reveal the precise nature of neural learning signals, it has not been used to study learning-related neural dysfunctions in unmedicated patients with major depressive disorder so far. We thus aimed at comparing the neural coding of reward and punishment prediction errors, representing indicators of neural learning-related processes, between unmedicated patients with major depressive disorder and healthy participants. To this end, a group of unmedicated patients with major depressive disorder (n = 28) and a group of age- and sex-matched healthy control participants (n = 30) completed an instrumental learning task involving monetary gains and losses during functional magnetic resonance imaging. The two groups did not differ in their learning performance. Patients and control participants showed the same level of prediction error-related activity in the ventral striatum and the anterior insula. In contrast, neural coding of reward prediction errors in the medial orbitofrontal cortex was reduced in patients. Moreover, neural reward prediction error signals in the medial orbitofrontal cortex and ventral striatum showed negative correlations with anhedonia severity. Using a standard instrumental learning paradigm we found no evidence for an overall impairment of reinforcement learning in medication-free patients with major depressive disorder. Importantly, however, the attenuated neural coding of reward in the medial orbitofrontal cortex and the relation between anhedonia and reduced reward prediction error-signalling in the medial orbitofrontal cortex and ventral striatum likely reflect an impairment in experiencing pleasure from rewarding events as a key mechanism of anhedonia in major depressive disorder.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“In an instrumental reinforcement learning task, unmedicated individuals with MDD showed increasingly blunted medial OFC and ventral striatal RPE that correlated with anhedonia [126].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“it was found that positive reward prediction error in the medial OFC is reduced in depression, and was correlated with anhedonia, but the learning was intact, in 28 drug-naive patients with depression (Rothkirch et al., 2017).”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Rothkirch et al., 2017
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundWhat is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 1×
“This is also in line with several previous functional MRI studies using a fixed set of learning parameters across participants (e.g. Daw et al., 2006; Schönberg et al., 2007).”
ResultThe mesolimbic dopamine reward circuit in depression
Nestler, E. J., & Carlezon, W. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.018 · Cited by 2,059 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundThe brain reward circuitry in mood disorders
Russo, S. J., & Nestler, E. J. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3381 · Cited by 1,870 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundA scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale
Snaith, R. P., Hamilton, M., Morley, S., Humayan, A., Hargreaves, D., & Trigwell, P. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.167.1.99 · Cited by 1,778 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundJudgment of contingency in depressed and nondepressed students: Sadder but wiser?
Alloy, L. B., & Abramson, L. Y. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.4.441 · Cited by 1,692 · cited 1×
“…of reward and punishment learning are impaired in depression: while patients with MDD show reduced behavioural biases towards appetitive stimuli, their ability to discriminate between advantageous and less advantageous options is unimpaired (Alloy and Abramson, 1979; Pizzagalli et al., 2008).”
BackgroundDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 1×
“Based on previous work (Pessiglione et al., 2006), we specifically focused on neural coding of reward PE in ventral striatum and medial orbitofrontal cortex (mOFC) as well as punishment PE in anterior insula.”
MethodThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · cited 1×
“While the mOFC is particularly involved in the representation and storage of values and the subjective experience of pleasure (Levy and Glimcher, 2012), the ventral striatum could be critical for stimulus-response learning to optimize behaviour, similar to the known distinction between ‘wanting’…”
BackgroundPizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · cited 4×
“Several previous studies probed the relation between depressive symptoms and reward processing using reaction time tasks (Knutson et al., 2008; Pizzagalli et al., 2009; Cléry-Melin et al., 2011).”
BackgroundInfluentialDopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,117 · cited 4×
“resenting the difference between expected and actual outcomes (Hollerman and Schultz, 1998; Waelti et al., 2001).”
BackgroundInfluentialDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 4×
“resenting the difference between expected and actual outcomes (Hollerman and Schultz, 1998; Waelti et al., 2001).”
BackgroundInfluentialAssociative learning of social value
Behrens, T. E. J., Hunt, L. T., Woolrich, M. W., & Rushworth, M. F. S. (2008) · Nature · doi:10.1038/nature07538 · Cited by 925 · cited 4×
“…between the reward PE time courses and the sequence of reward magnitudes, which—at least for reward trials—precluded a meaningful decomposition of the PE signal into its underlying constituents as suggested previously (Behrens et al., 2008; Chowdhury et al., 2013) (Supplementary material).”
BackgroundMethodInfluentialA causal link between prediction errors, dopamine neurons and learning
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., & Janak, P. H. (2013) · Nature Neuroscience · doi:10.1038/nn.3413 · Cited by 869 · cited 1×
“The identification of PE-related brain activity is thus central to the understanding of learning processes (Steinberg et al., 2013).”
BackgroundSescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.02.002 · Cited by 782
Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780
Toward an objective characterization of an anhedonic phenotype: A signal-detection approach
Pizzagalli, D. A., Jahn, A. L., & O’Shea, J. P. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.11.026 · Cited by 738 · cited 3×
“…to adjust behaviour in accordance with previously experienced outcomes, espe- cially with respect to positive feedback (Henriques and Davidson, 2000; Pizzagalli et al., 2005; Vrieze et al., 2013), others did not observe such performance differences between participants with and without MDD (Shah…”
BackgroundResultThe Neural Correlates of Anhedonia in Major Depressive Disorder
Keedwell, P. A., Andrew, C., Williams, S. C. R., Brammer, M. J., & Phillips, M. L. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.05.019 · Cited by 650 · cited 2×
“In a similar vein, previous research has pinpointed individual levels of anhedonia as the strongest predictor for approach and avoidance learning as well as for the neural processing of emotional stimuli, independent of depression severity per se (Keedwell et al., 2005; Chase et al., 2010; Greenberg et al., 2015).”
BackgroundReward and Punishment Processing in Depression
Eshel, N., & Roiser, J. P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.027 · Cited by 575 · cited 1×
“…from functional MRI that the anticipation and delivery of rewards and penalties in depression is related to altered neural responses in these areas (Eshel and Roiser, 2010; Stoy et al., 2012; Zhang et al., 2013), pointing to dysfunctional processing of reinforcers as a central mechanism underlying…”
BackgroundSubstantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · cited 1×
“…on the specific characteristics of a particular task (e.g. number of different stimuli, reward contingency), we would like to point out that other studies have found similarly low levels of reward learning rates in the range between 0.04 to 0.06 (Murray et al., 2008; Valentin and O’Doherty, 2009).”
ResultInfluentialNeural Responses to Monetary Incentives in Major Depression
Knutson, B., Bhanji, J. P., Cooney, R. E., Atlas, L. Y., & Gotlib, I. H. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.07.023 · Cited by 496 · cited 3×
“Several previous studies probed the relation between depressive symptoms and reward processing using reaction time tasks (Knutson et al., 2008; Pizzagalli et al., 2009; Cléry-Melin et al., 2011).”
BackgroundExpected value and prediction error abnormalities in depression and schizophrenia
Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D. (2011) · Brain · doi:10.1093/brain/awr059 · Cited by 485 · cited 4×
“model-based functional MRI has shown blunted reward PE signals in the striatum for instrumental (Gradin et al., 2011; Dombrovski et al., 2015) as well as Pavlovian conditioning (Kumar et al.”
BackgroundInfluentialMapping anhedonia onto reinforcement learning: a behavioural meta-analysis
Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-12 · Cited by 480 · cited 3×
“However, it can also be interpreted as the individual’s sensitivity for reward or punishment (Huys et al., 2013).”
BackgroundTrial-by-trial data analysis using computational models
Daw, N. D. (2011) · Decision Making, Affect, and Learning · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 456 · cited 1×
“Computational modelling of learning behaviour A standard Q-learning algorithm (Daw, 2011) generated trialby-trial estimates of Q-values and PEs.”
MethodReduced Reward Learning Predicts Outcome in Major Depressive Disorder
Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P., de Boer, P., Schmidt, M., & Claes, S. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.10.014 · Cited by 441 · cited 3×
“…work has shown impaired learning of reinforcement contingencies in MDD, resulting in a failure to adjust behaviour appropriately in response to rewards and punishments (Henriques and Davidson, 2000; Pizzagalli et al., 2005; Taylor Tavares et al., 2008; Whitmer et al., 2012; Vrieze et al., 2013).”
BackgroundResultPrediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 438 · cited 2×
“In healthy individuals, model-based functional MRI has shown that activity in the striatum and prefrontal cortex correlates with reward PEs, whereas punishment PEs are reflected by insular activity (Garrison et al., 2013).”
BackgroundGo and no-go learning in reward and punishment: Interactions between affect and effect
Guitart-Masip, M., Huys, Q. J. M., Fuentemilla, L., Dayan, P., Duzel, E., & Dolan, R. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.024 · Cited by 421 · cited 1×
“While previous work has shown the relevance of the Pavlovian and instrumental component for the success of avoidance learning (Guitart-Masip et al., 2012), our task design does not allow for a distinction between the two.”
ResultDecreased responsiveness to reward in depression
Henriques, J. B., & Davidson, R. J. (2000) · Cognition & Emotion · doi:10.1080/02699930050117684 · Cited by 399 · cited 2×
“…work has shown impaired learning of reinforcement contingencies in MDD, resulting in a failure to adjust behaviour appropriately in response to rewards and punishments (Henriques and Davidson, 2000; Pizzagalli et al., 2005; Taylor Tavares et al., 2008; Whitmer et al., 2012; Vrieze et al., 2013).”
BackgroundResultPsychomotor retardation in depression: Biological underpinnings, measurement, and treatment
Buyukdura, J. S., McClintock, S. M., & Croarkin, P. E. (2011) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2010.10.019 · Cited by 398 · cited 1×
“As psychomotor retardation is a relevant component of depressive symptomatology (Buyukdura et al., 2011), the failure of MDD patients to adjust behaviour to reinforcing feedback may be largely restricted to situations necessitating fast or laborious reactions.”
BackgroundSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Abnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374 · cited 5×
“As pharmacological interventions, for instance with selective serotonin reuptake inhibitors (SSRIs), reduce neural responses to motivational and affective information (Kumar et al., 2008; McCabe et al., 2010) and hamper learning from feedback (Herzallah et al.”
BackgroundInfluentialAnticipatory pleasure predicts motivation for reward in major depression.
Sherdell, L., Waugh, C. E., & Gotlib, I. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0024945 · Cited by 367 · cited 2×
“Thus, despite intact reinforcement learning, the reduced responses in the mOFC in patients with MDD could indicate attenuated levels of experienced pleasure from positive outcomes, corresponding to the previous finding that liking and expended effort are dissociated in depression (Sherdell et al., 2012).”
ResultMcCabe, C., Mishor, Z., Cowen, P. J., & Harmer, C. J. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.11.001 · Cited by 365 · cited 4×
“…with selective serotonin reuptake inhibitors (SSRIs), reduce neural responses to motivational and affective information (Kumar et al., 2008; McCabe et al., 2010) and hamper learning from feedback (Herzallah et al., 2013), such reduced PE signals observed in depression cannot be…”
InfluentialEmotional side-effects of selective serotonin reuptake inhibitors: qualitative study
Price, J., Cole, V., & Goodwin, G. M. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.051110 · Cited by 362 · cited 5×
“Whether the chronic administra- tion of SSRIs, which is the case for the majority of the previous work mentioned above, has similar effects on reward- and punishment-related responses in MDD, how- ever, remains to be investigated.”
ResultInfluentialZhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355 · cited 2×
“altered neural responses in these areas (Eshel and Roiser, 2010; Stoy et al., 2012; Zhang et al., 2013), pointing to”
BackgroundDysfunctional reward processing in depression
Admon, R., & Pizzagalli, D. A. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2014.12.011 · Cited by 343 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundStringaris, A., Vidal-Ribas Belil, P., Artiges, E., Lemaitre, H., Gollier-Briant, F., Wolke, S., Vulser, H., Miranda, R., Penttilä, J., Struve, M., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14101298 · Cited by 322
MURPHY, F. C., MICHAEL, A., ROBBINS, T. W., & SAHAKIAN, B. J. (2003) · Psychological Medicine · doi:10.1017/s0033291702007018 · Cited by 298 · cited 1×
“Similarly, while patients with depression exhibit augmented sensitivity to irrelevant negative feedback, their learning performance is not disrupted by accurate negative feedback (Murphy et al., 2003) as used in our study.”
BackgroundStoy, M., Schlagenhauf, F., Sterzer, P., Bermpohl, F., Hägele, C., Suchotzki, K., Schmack, K., Wrase, J., Ricken, R., Knutson, B., et al. (2012) · Journal of Psychopharmacology · doi:10.1177/0269881111416686 · Cited by 279 · cited 4×
“Similarly, attenuated striatal reward signals in individuals with MDD were found in a variety (Pizzagalli et al., 2009; Robinson et al., 2012; Stoy et al., 2012; Hall et al., 2014), albeit not all studies (Knutson et al., 2008).”
BackgroundInfluentialSelf-citationDopamine restores reward prediction errors in old age
Chowdhury, R., Guitart-Masip, M., Lambert, C., Dayan, P., Huys, Q., Düzel, E., & Dolan, R. J. (2013) · Nature Neuroscience · doi:10.1038/nn.3364 · Cited by 273 · cited 4×
“…between the reward PE time courses and the sequence of reward magnitudes, which—at least for reward trials—precluded a meaningful decomposition of the PE signal into its underlying constituents as suggested previously (Behrens et al., 2008; Chowdhury et al., 2013) (Supplementary material).”
BackgroundMethodInfluentialThe role of the brain reward system in depression
Naranjo, C. A., Tremblay, L. K., & Busto, U. E. (2001) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/s0278-5846(01)00156-7 · Cited by 245 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundReinforcement learning in depression: a review of computational research
Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.05.005 · Cited by 233 · cited 2×
“tributing to deficits in MDD or anhedonia in particular (Huys et al., 2013; Chen et al., 2015).”
BackgroundTwo-factor learning theory: Summary and comment
Mowrer, O. H. (1951) · Psychological Review · doi:10.1037/h0058956 · Cited by 233 · cited 1×
“According to the influential two-factor theory (Mowrer, 1951), avoidance learning comprises two aspects: first, the association between a stimulus and an aversive D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 outcome on the basis…”
BackgroundRobinson, O. J., Cools, R., Carlisi, C. O., Sahakian, B. J., & Drevets, W. C. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11010137 · Cited by 232 · cited 2×
“Similarly, attenuated striatal reward signals in individuals with MDD were found in a variety (Pizzagalli et al., 2009; Robinson et al., 2012; Stoy et al., 2012; Hall et al., 2014), albeit not all studies (Knutson et al., 2008).”
BackgroundNeural basis of abnormal response to negative feedback in unmedicated mood disorders
Taylor Tavares, J. V., Clark, L., Furey, M. L., Williams, G. B., Sahakian, B. J., & Drevets, W. C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.049 · Cited by 229 · cited 2×
“In line with this concept, previous work has shown impaired learning of reinforcement contingencies in MDD, resulting in a failure to adjust behaviour appropriately in response to rewards and punishments (Henriques and Davidson, 2000; Pizzagalli et al., 2005; Taylor Tavares et al., 2008; Whitmer et al., 2012; Vrieze e…”
BackgroundMeasuring hedonic capacity in depression: A psychometric analysis of three anhedonia scales
Leventhal, A. M., Chasson, G. S., Tapia, E., Miller, E. K., & Pettit, J. W. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20327 · Cited by 212 · cited 1×
“Interestingly, anhedonia is supposed to reflect a separate entity that is to some extent independent of the overall severity of depression (Schrader, 1997; Leventhal et al., 2006).”
BackgroundDifferential Effect of Reward and Punishment on Procedural Learning
Wächter, T., Lungu, O. V., Liu, T., Willingham, D. T., & Ashe, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4132-08.2009 · Cited by 205 · cited 2×
“primarily dedicated to the processing of aversive information (Wächter et al., 2009; Sescousse et al., 2013).”
BackgroundWhy Don't You Try Harder? An Investigation of Effort Production in Major Depression
Cléry-Melin, M.-L., Schmidt, L., Lafargue, G., Baup, N., Fossati, P., & Pessiglione, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023178 · Cited by 195 · cited 2×
“Several previous studies probed the relation between depressive symptoms and reward processing using reaction time tasks (Knutson et al., 2008; Pizzagalli et al., 2009; Cléry-Melin et al., 2011).”
BackgroundChase, H. W., Frank, M. J., Michael, A., Bullmore, E. T., Sahakian, B. J., & Robbins, T. W. (2010) · Psychological Medicine · doi:10.1017/s0033291709990468 · Cited by 174 · cited 4×
“In a similar vein, previous research has pinpointed individual levels of anhedonia as the strongest predictor for approach and avoidance learning as well as for the neural processing of emotional stimuli, independent of depression severity per se (Keedwell et al., 2005; Chase et al., 2010; Greenberg et al., 2015).”
BackgroundInfluentialChase, H. W., Nusslock, R., Almeida, J. R., Forbes, E. E., LaBarbara, E. J., & Phillips, M. L. (2013) · Bipolar Disorders · doi:10.1111/bdi.12132 · Cited by 157 · cited 2×
“There is substantial evidence that at least the acute administration of psychopharmacological medication, especially SSRIs, impair learning performance and reduce PE-related neural activity in ventral striatum and anterior insula in MDD patients (McCabe et al., 2010; Chase et al., 2013; Herzallah et al., 2013) and hea…”
BackgroundBiased information processing as a vulnerability factor for depression
Gotlib, I. H., & Krasnoperova, E. (1998) · Behavior Therapy · doi:10.1016/s0005-7894(98)80020-8 · Cited by 133 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundValentin, V. V., & O'Doherty, J. P. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91195.2008 · Cited by 117 · cited 1×
“…on the specific characteristics of a particular task (e.g. number of different stimuli, reward contingency), we would like to point out that other studies have found similarly low levels of reward learning rates in the range between 0.04 to 0.06 (Murray et al., 2008; Valentin and O’Doherty, 2009).”
ResultInfluentialSegarra, N., Metastasio, A., Ziauddeen, H., Spencer, J., Reinders, N. R., Dudas, R. B., Arrondo, G., Robbins, T. W., Clark, L., Fletcher, P. C., et al. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2015.370 · Cited by 96 · cited 1×
“Notably, however, decreased neural responses to rewarding information in patients with MDD have also been observed in tasks that did not require speeded responses (Segarra et al., 2016).”
BackgroundYip, S. W., Worhunsky, P. D., Rogers, R. D., & Goodwin, G. M. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.215 · Cited by 95 · cited 2×
“Similarly, the influence of pharmacological medication on reward- and punishment-related neural processes has recently been demonstrated in bipolar disorder (Yip et al., 2015), questioning the previously assumed ‘reward hypersensitivity’ theory in bipolar disorder.”
BackgroundGreenberg, T., Chase, H. W., Almeida, J. R., Stiffler, R., Zevallos, C. R., Aslam, H. A., Deckersbach, T., Weyandt, S., Cooper, C., Toups, M., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050594 · Cited by 93 · cited 2×
“In a similar vein, previous research has pinpointed individual levels of anhedonia as the strongest predictor for approach and avoidance learning as well as for the neural processing of emotional stimuli, independent of depression severity per se (Keedwell et al., 2005; Chase et al., 2010; Greenberg et al., 2015).”
BackgroundDeutsche Version der Snaith-Hamilton-Pleasure-Scale (SHAPS-D)
Franz, M., Lemke, M., Meyer, T., Ulferts, J., Puhl, P., & Snaith, R. (1998) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/s-2007-995279 · Cited by 86 · cited 1×
“All participants completed two self-ratings: the Beck Depression Inventory (BDI; Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
Does anhedonia correlate with depression severity in chronic depression?
Schrader, G. D. (1997) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(97)90057-2 · Cited by 83 · cited 1×
“Interestingly, anhedonia is supposed to reflect a separate entity that is to some extent independent of the overall severity of depression (Schrader, 1997; Leventhal et al., 2006).”
BackgroundHerzallah, M. M., Moustafa, A. A., Natsheh, J. Y., Abdellatif, S. M., Taha, M. B., Tayem, Y. I., Sehwail, M. A., Amleh, I., Petrides, G., Myers, C. E., et al. (2013) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2013.00067 · Cited by 77 · cited 4×
“There is substantial evidence that at least the acute administration of psychopharmacological medication, especially SSRIs, impair learning performance and reduce PE-related neural activity in ventral striatum and anterior insula in MDD patients (McCabe et al., 2010; Chase et al., 2013; Herzallah et al., 2013) and hea…”
BackgroundInfluentialSafety out of control: dopamine and defence
Lloyd, K., & Dayan, P. (2016) · Behavioral and Brain Functions · doi:10.1186/s12993-016-0099-7 · Cited by 59 · cited 2×
“While there is abundant previous work on the mechanisms of reward learning, the mechanisms underlying punishment learning, i.e. learning to avoid punishment, is far less well understood (Lloyd and Dayan, 2016).”
BackgroundWhitmer, A. J., Frank, M. J., & Gotlib, I. H. (2012) · Cognition & Emotion · doi:10.1080/02699931.2012.682973 · Cited by 56 · cited 1×
“…work has shown impaired learning of reinforcement contingencies in MDD, resulting in a failure to adjust behaviour appropriately in response to rewards and punishments (Henriques and Davidson, 2000; Pizzagalli et al., 2005; Taylor Tavares et al., 2008; Whitmer et al., 2012; Vrieze et al., 2013).”
BackgroundAn fMRI study of reward circuitry in patients with minimal or extensive history of major depression
Hall, G. B., Milne, A. M., & MacQUEEN, G. M. (2013) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-013-0437-9 · Cited by 49 · cited 2×
“Similarly, attenuated striatal reward signals in individuals with MDD were found in a variety (Pizzagalli et al., 2009; Robinson et al., 2012; Stoy et al., 2012; Hall et al., 2014), albeit not all studies (Knutson et al., 2008).”
BackgroundAbnormal response to negative feedback in depression
SHAH, P. J., O'CARROLL, R. E., ROGERS, A., MOFFOOT, A. P. R., & EBMEIER, K. P. (1999) · Psychological Medicine · doi:10.1017/s0033291798007880 · Cited by 43 · cited 2×
“, 2013), others did not observe such performance differences between participants with and without MDD (Shah et al., 1999; Chase et al., 2010; Gradin et al., 2011).”
BackgroundCorticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41 · cited 2×
“model-based functional MRI has shown blunted reward PE signals in the striatum for instrumental (Gradin et al., 2011; Dombrovski et al., 2015) as well as Pavlovian conditioning (Kumar et al.”
Background
Cited by
Prefrontal cortex and depression
Pizzagalli, D. A., & Roberts, A. C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01101-7 · Cited by 667
“In an instrumental reinforcement learning task, unmedicated individuals with MDD showed increasingly blunted medial OFC and ventral striatal RPE that correlated with anhedonia [126].”
BackgroundThe orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
“Also within the reinforcement learning framework, it was found that positive reward prediction error in the medial OFC is reduced in depression, and was correlated with anhedonia, but the learning was intact, in 28 drugnaive patients with depression (Rothkirch et al., 2017).”
BackgroundDistorted Cognitive Processes in Major Depression: A Predictive Processing Perspective
Kube, T., Schwarting, R., Rozenkrantz, L., Glombiewski, J. A., & Rief, W. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.07.017 · Cited by 234
Halahakoon, D. C., Kieslich, K., O’Driscoll, C., Nair, A., Lewis, G., & Roiser, J. P. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.2139 · Cited by 222
Pizzagalli, D. A. (2022) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20220423 · Cited by 199
“Abnormalities that do not normalize include blunted OFC activation to rewards (58), reduced ability to sustain ventral striatal activation to positive cues (56), and greater reward prediction error in theVTA (42).”
BackgroundInfluential
Metadata
- Authors
- Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P.
- Affiliations
- Charité – Universitätsmedizin Berlin (DE)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-20
- Volume
- 140
- Issue
- 4
- Pages
- 1147-1157
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2598570532
- Cited by
- 124
- References
- 63
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 15 · 2023: 9 · 2022: 15 · 2021: 23 · 2020: 17 · 2019: 12 · 2018: 11 · 2017: 1
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- major depressive disorder, reinforcement learning, reward prediction error, anhedonia, medial orbitofrontal cortex, ventral striatum, anterior insula, operant conditioning, monetary rewards, unmedicated patients
- MeSH terms
- Adult, Depressive Disorder, Major, Major Depressive Disorder, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Psychiatric Status Rating Scales, Psychomotor Performance, Punishment, Reinforcement, Psychology, Reward, Prefrontal Cortex, Anhedonia, Ventral Striatum
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.