Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
According to current concepts, major depressive disorder is strongly related to dysfunctional neural processing of motivational information, entailing impairments in reinforcement learning. While computational modelling can reveal the precise nature of neural learning signals, it has not been used to study learning-related neural dysfunctions in unmedicated patients with major depressive disorder so far. We thus aimed at comparing the neural coding of reward and punishment prediction errors, representing indicators of neural learning-related processes, between unmedicated patients with major depressive disorder and healthy participants. To this end, a group of unmedicated patients with major depressive disorder (n = 28) and a group of age- and sex-matched healthy control participants (n = 30) completed an instrumental learning task involving monetary gains and losses during functional magnetic resonance imaging. The two groups did not differ in their learning performance. Patients and control participants showed the same level of prediction error-related activity in the ventral striatum and the anterior insula. In contrast, neural coding of reward prediction errors in the medial orbitofrontal cortex was reduced in patients. Moreover, neural reward prediction error signals in the medial orbitofrontal cortex and ventral striatum showed negative correlations with anhedonia severity. Using a standard instrumental learning paradigm we found no evidence for an overall impairment of reinforcement learning in medication-free patients with major depressive disorder. Importantly, however, the attenuated neural coding of reward in the medial orbitofrontal cortex and the relation between anhedonia and reduced reward prediction error-signalling in the medial orbitofrontal cortex and ventral striatum likely reflect an impairment in experiencing pleasure from rewarding events as a key mechanism of anhedonia in major depressive disorder.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“In an instrumental reinforcement learning task, unmedicated individuals with MDD showed increasingly blunted medial OFC and ventral striatal RPE that correlated with anhedonia [126].”
From Prefrontal cortex and depression (2022) · cites this paper as [126]
In the citing paper
“it was found that positive reward prediction error in the medial OFC is reduced in depression, and was correlated with anhedonia, but the learning was intact, in 28 drug-naive patients with depression (Rothkirch et al., 2017).”
From The orbitofrontal cortex: reward, emotion and depression (2020) · cites this paper as Rothkirch et al., 2017
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundWhat is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224 · cited 1×
“This is also in line with several previous functional MRI studies using a fixed set of learning parameters across participants (e.g. Daw et al., 2006; Schönberg et al., 2007).”
ResultThe mesolimbic dopamine reward circuit in depression
Nestler, E. J., & Carlezon, W. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.018 · Cited by 2,059 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundThe brain reward circuitry in mood disorders
Russo, S. J., & Nestler, E. J. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3381 · Cited by 1,870 · cited 1×
“It is commonly held that the symptoms of MDD and in particular anhedonia are caused by dysfunctional processing of affective and motivational information (Gotlib and Krasnoperova, 1998; Naranjo et al., 2001; Nestler and Carlezon, 2006; Russo and Nestler, 2013; Admon and Pizzagalli, 2015).”
BackgroundA scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale
Snaith, R. P., Hamilton, M., Morley, S., Humayan, A., Hargreaves, D., & Trigwell, P. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.167.1.99 · Cited by 1,778 · cited 1×
“…the Beck Depression Inventory (BDI; D ow nloaded from https://academ ic.oup.com /brain/article-abstract/140/4/1147/3038009 by guest on 16 M arch 2020 Beck et al., 1961) and the Snaith-Hamilton-Pleasure-Scale (SHAPS-D; Snaith et al., 1995; Franz et al., 1998), assessing the severity of anhedonia.”
BackgroundJudgment of contingency in depressed and nondepressed students: Sadder but wiser?
Alloy, L. B., & Abramson, L. Y. (1979) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.108.4.441 · Cited by 1,692 · cited 1×
“…of reward and punishment learning are impaired in depression: while patients with MDD show reduced behavioural biases towards appetitive stimuli, their ability to discriminate between advantageous and less advantageous options is unimpaired (Alloy and Abramson, 1979; Pizzagalli et al., 2008).”
BackgroundDopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 1×
“Based on previous work (Pessiglione et al., 2006), we specifically focused on neural coding of reward PE in ventral striatum and medial orbitofrontal cortex (mOFC) as well as punishment PE in anterior insula.”
MethodThe root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · cited 1×
“While the mOFC is particularly involved in the representation and storage of values and the subjective experience of pleasure (Levy and Glimcher, 2012), the ventral striatum could be critical for stimulus-response learning to optimize behaviour, similar to the known distinction between ‘wanting’…”
BackgroundPizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · cited 4×
“Several previous studies probed the relation between depressive symptoms and reward processing using reaction time tasks (Knutson et al., 2008; Pizzagalli et al., 2009; Cléry-Melin et al., 2011).”
BackgroundInfluential
Cited by
Prefrontal cortex and depression
Pizzagalli, D. A., & Roberts, A. C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01101-7 · Cited by 667
“In an instrumental reinforcement learning task, unmedicated individuals with MDD showed increasingly blunted medial OFC and ventral striatal RPE that correlated with anhedonia [126].”
BackgroundThe orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
“Also within the reinforcement learning framework, it was found that positive reward prediction error in the medial OFC is reduced in depression, and was correlated with anhedonia, but the learning was intact, in 28 drugnaive patients with depression (Rothkirch et al., 2017).”
BackgroundDistorted Cognitive Processes in Major Depression: A Predictive Processing Perspective
Kube, T., Schwarting, R., Rozenkrantz, L., Glombiewski, J. A., & Rief, W. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.07.017 · Cited by 234
Halahakoon, D. C., Kieslich, K., O’Driscoll, C., Nair, A., Lewis, G., & Roiser, J. P. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.2139 · Cited by 222
Pizzagalli, D. A. (2022) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20220423 · Cited by 199
“Abnormalities that do not normalize include blunted OFC activation to rewards (58), reduced ability to sustain ventral striatal activation to positive cues (56), and greater reward prediction error in theVTA (42).”
BackgroundInfluentialBorsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-020-00804-6 · Cited by 207
Wang, S., Leri, F., & Rizvi, S. J. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110289 · Cited by 160
Anhedonia in depression and schizophrenia: A transdiagnostic challenge
Lambert, C., Da Silva, S., Ceniti, A. K., Rizvi, S. J., Foussias, G., & Kennedy, S. H. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.12854 · Cited by 155
Positive affect and reward processing in the treatment of depression, anxiety and trauma
Craske, M. G., Dunn, B. D., Meuret, A. E., Rizvi, S. J., & Taylor, C. T. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00355-4 · Cited by 122
“…error signals in the striatum, anterior cingulate cortex and medial orbitofrontal cortex have been observed in patients with major depressive disorder when compared to healthy individuals 126 , with striatal signals correlating with anhedonia cross-sectionally 127 and 6 months later 128 .”
Brown, V. M., Zhu, L., Solway, A., Wang, J. M., McCurry, K. L., King-Casas, B., & Chiu, P. H. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.1844 · Cited by 112
Roles of the medial and lateral orbitofrontal cortex in major depression and its treatment
Zhang, B., Rolls, E., Wang, X., Xie, C., Cheng, W., & Feng, J.-F. (2024) · Molecular Psychiatry · doi:10.1038/s41380-023-02380-w · Cited by 69
“Using a standard reinforcement learning task, a group of unmedicated MDD patients had attenuated activations in the medial OFC compared to healthy controls when unexpected rewards were obtained [106].”
BackgroundMethodAnhedonia in Depression and Schizophrenia: Brain Reward and Aversion Circuits
Liang, S., Wu, Y., Hanxiaoran, L., Greenshaw, A. J., & Li, T. (2022) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s367839 · Cited by 93
“46 Moreover, reduced activation in the ventral striatum during reward anticipation is correlated with anhedonia and depression severity in patients with MDD. 16,52 Reward anticipation is assessed by measuring prediction error, which is defined as the response to the discrepancy between anticipated and received rewards.”
InfluentialZhang, D., Shen, J., Bi, R., Zhang, Y., Zhou, F., Feng, C., & Gu, R. (2020) · Psychological Medicine · doi:10.1017/s0033291720003967 · Cited by 87
Blunted medial prefrontal cortico-limbic reward-related effective connectivity and depression
Rupprechter, S., Romaniuk, L., Series, P., Hirose, Y., Hawkins, E., Sandu, A.-L., Waiter, G. D., McNeil, C. J., Shen, X., Harris, M. A., et al. (2020) · Brain · doi:10.1093/brain/awaa106 · Cited by 80
“In conclusion, using an RDoC positive valence system approach with a large community-based sample, we found evidence that depressive symptom severity was related to blunting of reward-linked striatal activity, consistent with a series of case-control studies on MDD. Decreased striatal activity may be due to decreased…”
MethodResultInfluentialAnhedonia in depression and bipolar disorder
Whitton, A. E., & Pizzagalli, D. A. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_323 · Cited by 80
“…expected value and RPEs in MDD have generally reported reduced RPE in the ventral and dorsal striatum (Gradin et al. 2011; Kumar et al. 2008, 2018), ACC (Rupprechter et al. 2020; Ubl et al. 2015) and medial OFC (Rothkirch et al. 2017), although null findings have emerged (Rutledge et al. 2017).”
BackgroundHird, E. J., Slanina-Davies, A., Lewis, G., Hamer, M., & Roiser, J. P. (2024) · Translational Psychiatry · doi:10.1038/s41398-024-02922-y · Cited by 79
“…of studies have reported associations between anhedonia and reward processing that survive controlling for overall symptom severity; although this has been shown in some cases, for example reward prediction error in the striatum [62], reward learning [61] and reward response over time [44].”
ResultStriatal Dopamine and Reward Prediction Error Signaling in Unmedicated Schizophrenia Patients
Katthagen, T., Kaminski, J., Heinz, A., Buchert, R., & Schlagenhauf, F. (2020) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaa055 · Cited by 79
Psychological Treatments for Anhedonia
Sandman, C. F., & Craske, M. G. (2021) · Current topics in behavioral neurosciences · doi:10.1007/7854_2021_291 · Cited by 82
Learning and Choice in Mood Disorders: Searching for the Computational Parameters of Anhedonia
Robinson, O. J., & Chase, H. W. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00009 · Cited by 70
Reward systems and cognitions in Major Depressive Disorder
Cléry-Melin, M.-L., Jollant, F., & Gorwood, P. A. P. M. (2018) · CNS Spectrums · doi:10.1017/s1092852918001335 · Cited by 83
“in both reward and punishment, has inconsistently been detected in MDD patients, depending on several factors (ie, specific paradigms and patient characteristics).(6,27) Moreover, in a meta-analysis of studies that implemented reinforcement learning tasks, Huys et al (2013) concluded that depression, as well as subcli…”
BackgroundResultWang, L., Wei, Q., Wang, C., Xu, J., Wang, K., Tian, Y., & Wang, J. (2019) · Brain Imaging and Behavior · doi:10.1007/s11682-018-0013-z · Cited by 80
Impaired reward-related learning signals in remitted unmedicated patients with recurrent depression
Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., Servaas, M. N., Steele, J. D., Schene, A. H., & Ruhé, H. G. (2019) · Brain · doi:10.1093/brain/awz167 · Cited by 67
Biased belief updating in depression
Kube, T. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102298 · Cited by 61
Tian, H., Wang, Z., Meng, Y., Geng, L., Lian, H., Shi, Z., Zhuang, Z., Cai, W., & He, M. (2024) · Behavioural Brain Research · doi:10.1016/j.bbr.2024.115218 · Cited by 62
“…fMRI, this study investigated neural processing of motivational information in 28 un-medicated Major Depressive Disorder (MDD) patients and 30 healthy controls, finding diminished neural encoding of reward prediction errors in the medial OFC, correlating negatively with anhedonia severity [111].”
Bakker, J. M., Goossens, L., Kumar, P., Lange, I., Michielse, S., Schruers, K. R. J., Bastiaansen, J. A., Lieverse, R., Marcelis, M. C., van Amelsvoort, T., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718003446 · Cited by 58
“A recent study suggested that earlier findings regarding altered RPE signals in MDD might have been due to medication use (Rothkirch et al., 2017).”
BackgroundPleasure, Reward Value, Prediction Error and Anhedonia
Kieslich, K., Valton, V., & Roiser, J. P. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2021_295 · Cited by 63
Gibbs-Dean, T., Katthagen, T., Tsenkova, I., Ali, R., Liang, X., Spencer, T. J., & Diederen, K. M. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105087 · Cited by 58
Presentation and Neurobiology of Anhedonia in Mood Disorders: Commonalities and Distinctions
Rizvi, S. J., Lambert, C. M., & Kennedy, S. H. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0877-z · Cited by 53
Frey, A.-L., Frank, M. J., & McCabe, C. (2019) · Psychological Medicine · doi:10.1017/s0033291719003222 · Cited by 51
Stress to inflammation and anhedonia: Mechanistic insights from preclinical and clinical models
Boyle, C. C., Bower, J. E., Eisenberger, N. I., & Irwin, M. R. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105307 · Cited by 48
Beta activity in human anterior cingulate cortex mediates reward biases
Xiao, J., Adkinson, J. A., Myers, J. C., Allawala, A. B., Mathura, R. K., Pirtle, V., Najera, R. A., Provenza, N. R., Bartoli, E., Watrous, A. J., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-49600-7 · Cited by 48
Moutoussis, M., Rutledge, R. B., Prabhu, G., Hrynkiewicz, L., Lam, J., Ousdal, O. T., Guitart‐Masip, M., Fonagy, P., & Dolan, R. J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0201451 · Cited by 51
“Our study suggests that the basic neurobiological machinery of motivated action emission and inhibition is largely preserved in moderate MDD, consistent with studies that have found other aspects of reinforcement learning to be, slightly unexpectedly, preserved or even improved in this disorder (19,38,39).”
ResultBlunted reward prediction error signals in internet gaming disorder
Lei, W., Liu, K., Chen, G., Tolomeo, S., Liu, C., Peng, Z., Liu, B., Liang, X., Huang, C., Xiang, B., et al. (2020) · Psychological Medicine · doi:10.1017/s003329172000402x · Cited by 48
Zhang, T., He, K., Bai, T., Lv, H., Xie, X., Nie, J., Xie, W., Zhu, C., Wang, K., & Tian, Y. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.110193 · Cited by 44
Zhang, X., Han, L.-R., Liu, J., Xu, Q., Guo, Y., Zheng, W., Wang, J., Huang, X., & Ren, P. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.00131 · Cited by 44
“Depression is a common mental disorder, with the main clinical features of atypical behaviors, low mood and loss of interest (Rothkirch et al., 2017).”
BackgroundMiles, A., Andiappan, M., Upenieks, L., & Orfanidis, C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272152 · Cited by 52
Depressive symptoms are associated with blunted reward learning in social contexts
Safra, L., Chevallier, C., & Palminteri, S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007224 · Cited by 40
A predictive coding framework for understanding major depression
Gilbert, J. R., Wusinich, C., & Zarate, C. A. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.787495 · Cited by 38
Frey, A.-L., & McCabe, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.049 · Cited by 41
Common neural deficits across reward functions in major depression: a meta-analysis of fMRI studies
Zhao, X., Wu, S., Li, X., Liu, Z., Lu, W., Lin, K., & Shao, R. (2024) · Psychological Medicine · doi:10.1017/s0033291724001235 · Cited by 35
Decreased reward circuit connectivity during reward anticipation in major depression
Geugies, H., Groenewold, N. A., Meurs, M., Doornbos, B., de Klerk‐Sluis, J. M., van Eijndhoven, P., Roest, A. M., & Ruhé, H. G. (2022) · NeuroImage Clinical · doi:10.1016/j.nicl.2022.103226 · Cited by 37
“PEs have been predominantly used in fMRI related reinforcement learning models in order to capture reward learning signals (Dombrovski et al., 2015; Geugies et al., 2019; Gradin et al., 2011; Kumar et al., 2008; Rothkirch et al., 2017).”
Abnormal prediction error processing in schizophrenia and depression
Yaple, Z. A., Tolomeo, S., & Yu, R. (2021) · Human Brain Mapping · doi:10.1002/hbm.25453 · Cited by 29
“Moreover, enhanced striatal activity was demonstrated in unmedicated patients (Liu et al., 2017), while no differences in striatum activity were found between medicated (Chase et al., 2013) or unmedicated (Rothkirch et al., 2017) depression and healthy control groups.”
BackgroundBrolsma, S. C. A., Vrijsen, J. N., Vassena, E., Kandroodi, M. R., Bergman, M. A., van Eijndhoven, P., Collard, R. M., den Ouden, H. E. M., Schene, A. H., & Cools, R. (2020) · Psychological Medicine · doi:10.1017/s0033291720001956 · Cited by 36
“Prior studies that have attempted to clarify the neurobiological and cognitive mechanisms underlying depression, mainly focused on selected patient samples, that either did not have comorbid psychiatric disorders or these disorders were not described (Admon et al., 2017; Elliott, Sahakian, Herrod, Robbins, and Paykel,…”
Chakraborty, S., Tripathi, S. J., Srikumar, B. N., Raju, T. R., & Rao, B. S. S. (2019) · Brain stimulation · doi:10.1016/j.brs.2019.01.020 · Cited by 30
Vandendriessche, H., Demmou, A., Bavard, S., Yadak, J., Lemogne, C., Mauras, T., & Palminteri, S. (2022) · Psychological Medicine · doi:10.1017/s0033291722001593 · Cited by 30
“…been obtained until very recently from studies with sample size comparable to ours (Chase et al., 2010; Frank et al., 2004; Henriques & Davidson, 2000; Huys et al., 2016; Moutoussis et al., 2018; Murphy et al., 2003; Rothkirch et al., 2017; Rupprechter, Stankevicius, Huys, Steele, & Seriès, 2018).”
ResultComputational Underpinnings of Neuromodulation in Humans
Montague, P. R., & Kishida, K. T. (2018) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.2018.83.038166 · Cited by 29
“…and Roache 2005; Jovanovic et al. 2010), and mood disorders (Pizzagalli 2014; also see Beevers et al. 2013; Chiu and Deldin 2007; Dayan and Huys 2008; Kumar et al. 2008; Chase et al. 2010; Gradin et al. 2011; Kunisato et al. 2012; Huys et al. 2013; Greenberg et al. 2015; Rothkirch et al. 2017).”
BackgroundSensitivity to intrinsic rewards is domain general and related to mental health
Blain, B., Pinhorn, I., & Sharot, T. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00116-x · Cited by 32
Neural signatures of saliency-mapping in anhedonia: A narrative review
Pisoni, A., Davis, S. W., & Smoski, M. J. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114123 · Cited by 28
Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders
Liebenow, B., Jones, R., DiMarco, E. K., Trattner, J. D., Humphries, J. B., Sands, L. P., Spry, K. P., Johnson, C. K., Farkas, E. B., Jiang, A., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.886297 · Cited by 26
The neuroanatomy of social trust predicts depression vulnerability
Fermin, A. S. R., Kiyonari, T., Matsumoto, Y., Takagishi, H., Li, Y., Kanai, R., Sakagami, M., Akaishi, R., Ichikawa, N., Takamura, M., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-20443-w · Cited by 23
Decreased Connection Between Reward Systems and Paralimbic Cortex in Depressive Patients
Bai, T., Zu, M., Chen, Y., Xie, W., Cai, C., Wei, Q., Ji, G., Tian, Y., & Wang, K. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00462 · Cited by 26
“Depressive patients also exhibit hypoactivation of medial OFC in the neural coding for reward prediction (Rothkirch et al., 2017), as well as the decreased activity in NAcc (Ubl et al.”
BackgroundHe, Z., Ao, X., Muhlert, N., Elliott, R., & Zhang, D. (2020) · Psychological Medicine · doi:10.1017/s0033291720003864 · Cited by 22
Depression im Alter und Frailty – epidemiologische, klinische und neurobiologische Zusammenhänge
Depping, M. S., Köhler-Ipek, L., Ullrich, P., Hauer, K. A., & Wolf, R. C. (2023) · Der Nervenarzt · doi:10.1007/s00115-023-01444-0 · Cited by 19
“Anreizwerte [32] sowieaufdysfunktionaler Entscheidungsfindung, wenn antizipierte”
Is the encoding of Reward Prediction Error reliable during development?
Keren, H., Chen, G., Benson, B. E., Ernst, M., Leibenluft, E., Fox, N. A., Pine, D. S., & Stringaris, A. K. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.05.039 · Cited by 20
“In psychopathology, alterations in the processing of RPEs have been proposed to be centrally involved in a range of psychiatric disorders (Murray et al., 2008; Moutoussis et al., 2015; Radua et al., 2015; Ubl et al., 2015; Schmidt et al., 2016; Rothkirch et al., 2017; White et al., 2017), including depression and schi…”
Katahira, K., & Toyama, A. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008738 · Cited by 19
“Other studies reported comparable response to RPEs between healthy controls and patients with major depressive disorder [27, 28].”
BackgroundResultZühlsdorff, K., López‐Cruz, L., Dutcher, E. G., Jones, J. A., Pama, C., Sawiak, S. J., Khan, S., Milton, A. L., Robbins, T. W., Bullmore, E. T., et al. (2022) · Neurobiology of Stress · doi:10.1016/j.ynstr.2022.100507 · Cited by 20
“After fitting RL models to performance on a probabilistic reversal task (PRL) task in humans, lower learning rates and lower reinforcement sensitivity in MDD patients have been reported.”
InfluentialBarch, D. M., Pagliaccio, D., Luking, K. R., Moran, E. K., & Culbreth, A. J. (2019) · Nebraska Symposium on Motivation/The Nebraska symposium on motivation · doi:10.1007/978-3-030-27473-3_5 · Cited by 18
Impact of depression on cooperation: An fNIRS hyperscanning study
Zhang, D., Ju, W. A. N. G., Jun, Z. H. A. O., Shumei, C. H. E. N., Huang, Y., & Gao, Q. (2020) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2020.00609 · Cited by 20
Effects of subclinical depression on prefrontal–striatal model-based and model-free learning
Heo, S., Sung, Y., & Lee, S. W. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009003 · Cited by 19
Can Understanding Reward Help Illuminate Anhedonia?
Kaya, S., & McCabe, C. (2019) · Current Behavioral Neuroscience Reports · doi:10.1007/s40473-019-00186-1 · Cited by 17
Sex difference in the weighting of expected uncertainty under chronic stress
Lei, H., Mochizuki, Y., Chen, C., Hagiwara, K., Hirotsu, M., Matsubara, T., & Nakagawa, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-88155-1 · Cited by 17
Contributors of Functional Impairment in Major Depressive Disorder: a Biopsychosocial Approach
Chow, T. K., Bowie, C. R., Morton, M., Lalovic, A., McInerney, S. J., & Rizvi, S. J. (2022) · Current Behavioral Neuroscience Reports · doi:10.1007/s40473-022-00247-y · Cited by 17
Brolsma, S. C. A., Vassena, E., Vrijsen, J. N., Sescousse, G., Collard, R. M., van Eijndhoven, P., Schene, A. H., & Cools, R. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.08.011 · Cited by 18
Zhou, Z., Gao, Y., Feng, R., Zhuo, L., Bao, W., Liang, K., Qiu, H., Cao, L., Tang, M., Li, H., et al. (2022) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-022-02086-4 · Cited by 13
“HIP hippocampus; OFC orbitofrontal cortex; mOFC medial OFC; lOFC lateral OFC; INS insula; aINS anterior insula; pINS posterior insula; ITG inferior temporal gyrus; L left; R : right reward-related external/interoceptive information and are probably related to anhedonia in MDD [64, 65].”
BackgroundGreenwald, M. K., Moses, T. E. H., Lundahl, L. H., & Roehrs, T. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1103739 · Cited by 14
“Anhedonia has been associated with impaired reinforcement learning (82, 109, 110).”
BackgroundFarahbakhsh, Z. Z., Song, K., Branthwaite, H. E., Erickson, K. R., Mukerjee, S., Nolan, S. O., & Siciliano, C. A. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01547-x · Cited by 13
Macoveanu, J., Meluken, I., Chase, H. W., Phillips, M. L., Kessing, L. V., Siebner, H. R., Vinberg, M., & Miskowiak, K. W. (2021) · Psychological Medicine · doi:10.1017/s0033291720000367 · Cited by 12
“, 2013) and medial orbitofrontal cortex (Rothkirch et al., 2017) in Fig.”
BackgroundSpaeth, A. M., Koenig, S., Everaert, J., Glombiewski, J. A., & Κube, T. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1253045 · Cited by 12
Asymmetrical learning and memory for acquired gain versus loss associations
Lin, Z., Cabrera-Haro, L. E., & Reuter‐Lorenz, P. A. (2020) · Cognition · doi:10.1016/j.cognition.2020.104318 · Cited by 12
Increased cortical structural covariance correlates with anhedonia in schizophrenia
Yu, L., Wu, Z., Wang, D., Guo, C., Teng, X., Zhang, G., Fang, X., & Zhang, C. (2023) · Schizophrenia · doi:10.1038/s41537-023-00350-3 · Cited by 10
Bai, Y., Song, L., Zhang, Y., Dai, G., Zhang, W., Song, S., Sun, H. L., Wen, J., Xu, M., & Ju, W. (2019) · Biomedical Chromatography · doi:10.1002/bmc.4542 · Cited by 10
Werlen, E., Shin, S.-L., Gastambide, F., François, J., Tricklebank, M. D., Marston, H. M., Huxter, J. R., Gilmour, G., & Walton, M. E. (2019) · Neuropsychopharmacology · doi:10.1038/s41386-019-0564-8 · Cited by 11
Czekalla, N., Schröder, A., Mayer, A. V., Stierand, J., Stolz, D. S., Κube, T., Korn, C. W., Wilhelm, I., Klein, J. P., Paulus, F. M., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.09.593087 · Cited by 10
Tully, J., Pereira, A. C., Sethi, A., Griem, J., Cross, B., Williams, S., Blair, J., Murphy, D., & Blackwood, N. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02437-4 · Cited by 10
Hou, Z., Liu, X., Jiang, W., Hou, Z., Yin, Y., Xie, C., Zhang, H., Zhang, H., Zhang, Z., & Yuan, Y. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113310 · Cited by 7
Guo, Z., Han, X., Kong, T., Wu, Y., Kang, Y., Liu, Y., & Wang, F. (2025) · BMC Psychiatry · doi:10.1186/s12888-024-06415-6 · Cited by 6
Treatment-resistant recurrent unipolar and bipolar depression: associative learning abnormalities
Suveges, S., Wang, Y., Tolomeo, S., Gilbertson, T., & Steele, J. D. (2025) · Brain · doi:10.1093/brain/awaf280 · Cited by 6
“Another a potential limitation might have been lack of performance-related payments, but many previous studies 14,15,17,21,22 have demonstrated the feasibility of using binary outcome feedback.”
InfluentialTargeting Positive Affect as a Way to Improve Social Anhedonia in Schizophrenia
Catalano, L. T., Patel, P. K., Weittenhiller, L. P., & Green, M. F. (2025) · Schizophrenia Bulletin · doi:10.1093/schbul/sbaf117 · Cited by 7
Targeting the complement-mTOR-autophagy axis: the role of apolipoprotein E in depression
Li, Y., Xu, C., Liu, J., Guo, M., Wang, J., Bai, X., Cheng, Y., Luan, X., Pei, H., Zhang, C., et al. (2025) · BMC Biology · doi:10.1186/s12915-025-02301-z · Cited by 5
“Despite progress in physical and psychological treatments, therapeutic outcomes remain unsatisfactory, with many patients experiencing relapses that severely impact their quality of life [2, 3].”
Mao, J., & Yuan, J. (2020) · Stress and Brain · doi:10.26599/sab.2020.9060002 · Cited by 7
“But recent studies on unmedicated MDD patients and medicationfree remitted recurrent depression patients all failed to replicate this impairment [86, 87].”
Aberrant Striatal Value Representation in Huntington's Disease Gene Carriers 25 Years Before Onset
Nair, A., Johnson, E. B., Gregory, S., Osborne‐Crowley, K., Zeun, P., Scahill, R. I., Lowe, J., Papoutsi, M., Palminteri, S., Rutledge, R. B., et al. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.12.015 · Cited by 5
Lee, S. W., Seo, H. S., Choi, M., & Lee, S. J. (2025) · Psychiatry Investigation · doi:10.30773/pi.2025.0093 · Cited by 4
“36-38 In fact, previous studies have consistently documented a robust association between experiential avoidance and depressive symptoms in individuals with depression.”
Czekalla, N., Schröder, A., Mayer, A. V., Stierand, J., Stolz, D. S., Κube, T., Korn, C. W., Wilhelm, I., Klein, J. P., Paulus, F. M., et al. (2026) · Translational Psychiatry · doi:10.1038/s41398-026-04341-7 · Cited by 4
Computationale Psychiatrie: Datengetriebene vs. mechanistische Ansätze
Kaminski, J. A., Katthagen, T., & Schlagenhauf, F. (2019) · Der Nervenarzt · doi:10.1007/s00115-019-00796-w · Cited by 4
Why do valence asymmetries emerge in value learning? A reinforcement learning account
Hao, C., Cabrera-Haro, L. E., Lin, Z., Reuter‐Lorenz, P. A., & Lewis, R. L. (2022) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-022-01050-8 · Cited by 4
“The monetary outcome for win and loss trials (5 cents) occurred with a probability of either 0.8 or 0.2 (Rothkirch et al., 2017).”
BackgroundMethodInfluentialOu, J., Wu, Y., Liu, J., & Hong, L. (2020) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2020.00111 · Cited by 5
Stewart, J. L., White, E. J., Kuplicki, R., Akeman, E., Bodurka, J., Cha, Y., Feinstein, J. S., Khalsa, S. S., Savitz, J. B., Victor, T. A., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.04.064 · Cited by 5
“Planned contrast analyses evaluated group, hemisphere, and MID anticipation condition (win, loss, none) differences for four frontal regions of interest (ROIs: SFG, MFG, IFG, OFC).”
BackgroundInfluentialSubcomponents of reward processing in adolescent anhedonia
Ma, X., Sahni, A., & McCabe, C. (2026) · Nature Reviews Psychology · doi:10.1038/s44159-026-00534-5 · Cited by 3
Singh, S., Cunningham, J. E. A., Uher, R., Becker, S., & Nunes, A. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106652 · Cited by 3
Intact modulation of response vigor in major depressive disorder
Bakbani-Elkayam, S., Dolev‐Amit, T., Hemed, E., Zilcha‐Mano, S., & Eitam, B. (2024) · Motivation and Emotion · doi:10.1007/s11031-024-10059-0 · Cited by 4
“…have failed to provide robust evidence for reduced reward responsiveness and/ or motivation in individuals with MDD (e.g., Moutoussis et al., 2018; Rothkirch et al., 2017; Winter et al., 2021), there is a growing consensus that MDD is linked to substantial impairment in some but not other facets…”
Disorders of compulsivity: Deficits in arbitrating learning strategies
Ruan, Z., Liu, S., Liu, Y. A., Yang, Q., & Peng, Z. (2024) · Addiction Biology · doi:10.1111/adb.13433 · Cited by 5
“Only MDD patients without comorbidity of AUD and OCD and with an OCI-R scores less than 21 were included.”
BackgroundInfluentialModelling Pavlovian biases in depressed and healthy young adults
Embrey, J. R., Garner, K., Salim, J., & Watson, P. (2025) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2025.108092 · Cited by 3
Bellaert, N., Cassioli, F., Crowley, M. J., Lim, Y. W., Rossignol, M., Deveney, C. M., & Tseng, W. (2026) · Psychophysiology · doi:10.1111/psyp.70260 · Cited by 2
Disabato, D. J., Gawlik, E. A., Aurora, P., & Coifman, K. G. (2024) · Emotion · doi:10.1037/emo0001416 · Cited by 2
Neuroimaging and Circuit Mechanisms of Depression
Romer, A. L., Bertocci, M. A., Phillips, M. L., & Pizzagalli, D. A. (2025) · Oxford University Press eBooks · doi:10.1093/med/9780197640654.003.0029 · Cited by 2
Magbri, A. (2021) · Archives in Neurology & Neuroscience · doi:10.33552/ann.2021.10.000739 · Cited by 3
“PRESS is generally reversible, both radiographically and clinically, and usually has a favorable prognosis [3].”
BackgroundZhang, Y., Wei, M., Huang, R., Jia, S., & Li, L. (2024) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2024.101980 · Cited by 1
Simulated synapse loss induces depression-like behaviors in deep reinforcement learning
Chalmers, E., Duarte, S., Al-Hejji, X., Devoe, D. J. A., Gruber, A. J., & McDonald, R. J. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1466364 · Cited by 1
From memory disorders to the development of depression: A system approach
Grigoryan, G. A. (2025) · Biosystems · doi:10.1016/j.biosystems.2025.105440 · Cited by 1
Aberrant Aversive Learning Signals in the Habenula in Remitted Patients With Recurrent Depression
de Klerk‐Sluis, J. M., Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., van Eijndhoven, P., Geurts, D. E. M., & Ruhé, H. G. (2025) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2025.04.006 · Cited by 1
Metadata
- Authors
- Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P.
- Affiliations
- Charité – Universitätsmedizin Berlin (DE)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-20
- Volume
- 140
- Issue
- 4
- Pages
- 1147-1157
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2598570532
- Cited by
- 124
- References
- 63
- Citations by year
- 2026: 11 · 2025: 10 · 2024: 15 · 2023: 9 · 2022: 15 · 2021: 23 · 2020: 17 · 2019: 12 · 2018: 11 · 2017: 1
- FWCI
- 6.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- major depressive disorder, reinforcement learning, reward prediction error, anhedonia, medial orbitofrontal cortex, ventral striatum, anterior insula, operant conditioning, monetary rewards, unmedicated patients
- MeSH terms
- Adult, Depressive Disorder, Major, Major Depressive Disorder, Female, Humans, Learning, Magnetic Resonance Imaging, Male, Psychiatric Status Rating Scales, Psychomotor Performance, Punishment, Reinforcement, Psychology, Reward, Prefrontal Cortex, Anhedonia, Ventral Striatum
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.