Expected value and prediction error abnormalities in depression and schizophrenia
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
The dopamine system has been linked to anhedonia in depression and both the positive and negative symptoms of schizophrenia, but it remains unclear how dopamine dysfunction could mechanistically relate to observed symptoms. There is considerable evidence that phasic dopamine signals encode prediction error (differences between expected and actual outcomes), with reinforcement learning theories being based on prediction error-mediated learning of associations. It has been hypothesized that abnormal encoding of neural prediction error signals could underlie anhedonia in depression and negative symptoms in schizophrenia by disrupting learning and blunting the salience of rewarding events, and contribute to psychotic symptoms by promoting aberrant perceptions and the formation of delusions. To test this, we used model based functional magnetic resonance imaging and an instrumental reward-learning task to investigate the neural correlates of prediction errors and expected-reward values in patients with depression (n=15), patients with schizophrenia (n=14) and healthy controls (n=17). Both patient groups exhibited abnormalities in neural prediction errors, but the spatial pattern of abnormality differed, with the degree of abnormality correlating with syndrome severity. Specifically, reduced prediction errors in the striatum and midbrain were found in depression, with the extent of signal reduction in the bilateral caudate, nucleus accumbens and midbrain correlating with increased anhedonia severity. In schizophrenia, reduced prediction error signals were observed in the caudate, thalamus, insula and amygdala-hippocampal complex, with a trend for reduced prediction errors in the midbrain, and the degree of blunting in the encoding of prediction errors in the insula, amygdala-hippocampal complex and midbrain correlating with increased severity of psychotic symptoms. Schizophrenia was also associated with disruption in the encoding of expected-reward values in the bilateral amygdala-hippocampal complex and parahippocampal gyrus, with the degree of disruption correlating with psychotic symptom severity. Neural signal abnormalities did not correlate with negative symptom severity in schizophrenia. These findings support the suggestion that a disruption in the encoding of prediction error signals contributes to anhedonia symptoms in depression. In schizophrenia, the findings support the postulate of an abnormality in error-dependent updating of inferences and beliefs driving psychotic symptoms. Phasic dopamine abnormalities in depression and schizophrenia are suggested by our observation of prediction error abnormalities in dopamine-rich brain areas, given the evidence for dopamine encoding prediction errors. The findings are consistent with proposals that psychiatric syndromes reflect different disorders of neural valuation and incentive salience formation, which helps bridge the gap between biological and phenomenological levels of understanding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, depressed patients exhibit both hyposensitivity to rewards and oversensitivity to punishments 96,97 , attributed to alterations in mesolimbic prediction error signaling 97-99 , and may exhibit a constrained option space ('tunnel vision') during decision-making 100 .”
From Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model (2020) · cites this paper as [98]
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [124]
In the citing paper
“Dopamine signaling to the basal ganglia, including the nucleus accumbens, also plays a role in what is known as the reward prediction error, a subconstruct of approach motivation.”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“The reward prediction error, in which changes in dopamine firing encode differences between an expected vs. actual reward outcome, allows for dynamic learning from experience and updates in reward expectations (Gradin et al., 2011; Schultz, 2016).”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“Several studies showed a disruption of striatal activity during reward learning, prediction-error encoding, and rewarding outcomes (Table 1) (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
From Circuit Mechanisms of Reward, Anhedonia, and Depression (2019) · cites this paper as Gradin et al., 2011
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“All subjects completed the Beck depression inventory (Beck et al., 1961) and Spielberger State Anxiety scale (Spielberger, 1983).”
MethodHamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 2×
“Patients with major depressive disorder were assessed with the 21-item Hamilton depression rating scale (Hamilton, 1960) and patients with schizophrenia were assessed with the Positive and Negative Syndrome Scale (Kay et al.”
MethodThe Positive and Negative Syndrome Scale (PANSS) for schizophrenia.
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987) · Schizophrenia Bulletin · doi:10.1093/schbul/13.2.261 · Cited by 21,378 · cited 3×
“1C) measured using relevant subscales of the Positive and Negative Syndrome Scale.”
MethodA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Since dopamine has been hypothesized to be the neural substrate of prediction errors in dopamine-rich brain areas (Montague et al., 1996; Schultz et al., 1997; Dayan and Abbott, 2001; Tobler et al., 2006), our findings give strong support to the hypothesis of abnormal dopamine-mediated prediction…”
ResultHow do you feel — now? The anterior insula and human awareness
(Bud) Craig, A. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2555 · Cited by 6,657 · cited 1×
“Furthermore, the insula has also been linked to the feeling of 'agency' (self-generation) during motor activity (Craig, 2009).”
BackgroundPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · cited 6×
“Furthermore, all effective anti-psychotic medications block D 2 receptors (Kapur, 2003).”
BackgroundResultInfluentialThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · cited 2×
“…reduced dopamine function and major depressive disorder has long been proposed (Dunlop and Nemeroff, 2007), but it is important to note that our current study specifically investigated prediction errors that have been linked to salience (Berridge, 2007) and potentially, therefore, anhedonia.”
Background
Research works printed but not linked: 4
- Dayan, 2001, Theoretical neuroscience: computational and mathematical modelling of neural systems Cambridge, MA: The MIT Press
- Friston, 2004, Introduction to statistical parametric mapping
- Sims, 2005, Symptoms in the mind
- Spielberger, 1983, State-trait anxiety inventory for adults, STAI Form Y-1
Cited by
Items 101–200 of 525
Kong, F., Ding, K., Yang, Z., Dang, X., Hu, S., Song, Y., & Liu, J. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu144 · Cited by 77
Wang, Z., Fang, J., Liu, J., Rong, P., Jorgenson, K., Park, J., Lang, C., Hong, Y., Zhu, B., & Kong, J. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.12.018 · Cited by 77
“These brain regions have repeatedly shown abnormal activation in MDD patients [70, 75, 76].”
BackgroundBrain structures implicated in inflammation-associated depression
Harrison, N. A. (2016) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2016_30 · Cited by 74
Han, S., Zheng, R., Li, S., Liu, L., Wang, C., Jiang, Y. B., Wen, M., Zhou, B., Wei, Y., Pang, J., et al. (2021) · Psychological Medicine · doi:10.1017/s0033291721003986 · Cited by 71
Pain Perception in Schizophrenia: Evidence of a Specific Pain Response Profile
Lévesque, M., Potvin, S., Marchand, S., Stip, É., Grignon, S., Lalonde, P., Lipp, O., & Goffaux, P. (2012) · Pain Medicine · doi:10.1111/j.1526-4637.2012.01505.x · Cited by 71
Abnormal brain responses to social fairness in depression: an fMRI study using the Ultimatum Game
Gradin, V. B., Pérez, A., MacFarlane, J. A., Cavin, I., Waiter, G., Engelmann, J., Dritschel, B., Pomi, A., Matthews, K., & Steele, J. D. (2015) · Psychological Medicine · doi:10.1017/s0033291714002347 · Cited by 61
“In turn, the reduced striatal response to fairness in the depression group is consistent with studies reporting reduced striatal activation in response to rewarding events in this population (Eshel & Roiser, 2010; Gradin et al. 2011).”
BackgroundResultSelf-citationYang, J., Hou, X., Wei, D., Wang, K., Li, Y., & Qiu, J. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-016-9530-9 · Cited by 70
Psychopathic traits from an RDoC perspective
Blair, R. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.09.011 · Cited by 69
Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System
Lee, J. S., Jung, S., Park, I. H., & Kim, J. (2015) · Current Neuropharmacology · doi:10.2174/1570159x13666150612230333 · Cited by 69
“The abnormal encoding of prediction errors that comes from impairments in learning in patients with schizophrenia leads to decreased attribution of salience to potentially rewarding occasions (either externally or internally), thus increasing anhedonia and amotivation [42].”
BackgroundSubcortical Dopamine and Cognition in Schizophrenia: Looking Beyond Psychosis in Preclinical Models
Conn, K., Burne, T. H. J., & Kesby, J. P. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00542 · Cited by 68
“The mesolimbic dopamine system encodes signals that allow the prediction of reward outcomes and are thought to mediate reward-related adaptation and learning (Gradin et al., 2011; Hauser et al., 2017).”
BackgroundImpaired reward-related learning signals in remitted unmedicated patients with recurrent depression
Geugies, H., Mocking, R. J. T., Figueroa, C. A., Groot, P. F. C., Marsman, J.-B. C., Servaas, M. N., Steele, J. D., Schene, A. H., & Ruhé, H. G. (2019) · Brain · doi:10.1093/brain/awz167 · Cited by 67
“Following previous studies, 1⁄4 1:0 was used (Kumar et al., 2008; Gradin et al., 2011).”
MethodResultInfluentialSelf-citationSzczypiński, J., & Gola, M. K. (2018) · Reviews in the Neurosciences · doi:10.1515/revneuro-2017-0091 · Cited by 68
Depression, Risk Preferences, and Risk-Taking Behavior
Cobb‐Clark, D. A., Dahmann, S. C., & Kettlewell, N. (2020) · The Journal of Human Resources · doi:10.3368/jhr.58.1.0419-10183r1 · Cited by 68
Neuropharmacological modulation of the aberrant bodily self through psychedelics
Ho, J. T., Preller, K. H., & Lenggenhager, B. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.12.006 · Cited by 59
Dynamic influences on the neural encoding of social valence
Padilla-Coreano, N., Tye, K. M., & Zelikowsky, M. (2022) · Nature reviews. Neuroscience · doi:10.1038/s41583-022-00609-1 · Cited by 67
Failure of hippocampal deactivation during loss events in treatment-resistant depression
Johnston, B. A., Tolomeo, S., Gradin, V., Christmas, D., Matthews, K., & Douglas Steele, J. (2015) · Brain · doi:10.1093/brain/awv177 · Cited by 54
“Previously we reported underactive striatal responses to rewarding events in MDD (Steele et al., 2007; Kumar et al., 2008; Gradin et al., 2011) supported by a recent neuroimaging (Zhang et al.”
BackgroundResultInfluentialSelf-citationNeuronal coding of implicit emotion categories in the subcallosal cortex in patients with depression
Laxton, A. W., Neimat, J. S., Davis, K. D., Womelsdorf, T., Hutchison, W. D., Dostrovsky, J. O., Hamani, C., Mayberg, H. S., & Lozano, A. M. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.03.029 · Cited by 62
Wotruba, D., Heekeren, K., Michels, L., Buechler, R., Simon, J. J., Theodoridou, A., Kollias, S., Rössler, W., & Kaiser, S. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00382 · Cited by 61
“1 University Hospital of Psychiatry Zurich, the Zurich Program for Sustainable Development of Mental Health Services (ZInEP), Zurich, Switzerland 2 Department of Neuroradiology, University Hospital of Zurich, Zurich, Switzerland 3 Collegium Helveticum, A Joint Research Institute between the University of Zurich and th…”
BackgroundResultPleasure, Reward Value, Prediction Error and Anhedonia
Kieslich, K., Valton, V., & Roiser, J. P. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2021_295 · Cited by 63
Boehme, R., Deserno, L., Gleich, T., Katthagen, T., Pankow, A., Behr, J., Buchert, R., Roiser, J. P., Heinz, A., & Schlagenhauf, F. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0805-15.2015 · Cited by 52
Bruijniks, S. J. E., DeRubeis, R. J., Hollon, S. D., & Huibers, M. J. H. (2019) · Clinical Psychological Science · doi:10.1177/2167702619830391 · Cited by 55
“Shall I compare thee”: The neural basis of literary awareness, and its benefits to cognition
O’Sullivan, N., Davis, P. M., Billington, J., González‐Díaz, V., & Corcoran, R. (2015) · Cortex · doi:10.1016/j.cortex.2015.08.014 · Cited by 61
Rentzsch, J., Shen, C., Jockers-Scherübl, M. C., Gallinat, J., & Neuhaus, A. H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126775 · Cited by 47
“Taking into account increasing evidence for prediction error deficits in schizophrenia [5,6,15], we hypothesized that the same correlation should be considerably lower in schizophrenia.”
Liu, C., Liu, C., Zhang, J., Yuan, Z., Tang, L., Tie, C.-L., Fan, J., & Liu, Q. (2016) · Brain Research · doi:10.1016/j.brainres.2016.07.024 · Cited by 59
Organic psychosis: The pathobiology and treatment of delusions
Joyce, E. M. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.12973 · Cited by 60
Lawford‐Smith, H. (2015) · Journal of Social Ontology · doi:10.1515/jso-2015-0008 · Cited by 59
Test–retest reliability of reinforcement learning parameters
Schaaf, J. V., Weidinger, L., Molleman, L., & van den Bos, W. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02203-4 · Cited by 60
“…errors in various psychiatric disorders, including psychosis (Corlett et al., 2007; Murray et al., 2008), obsessive–compulsive disorder (Hauser et al., 2017), ADHD (Hauser et al., 2014), depression (Gradin et al., 2011), gambling addiction (Linnet, 2014), and substance abuse (Tanabe et al., 2013).”
BackgroundResultBakker, J. M., Goossens, L., Kumar, P., Lange, I., Michielse, S., Schruers, K. R. J., Bastiaansen, J. A., Lieverse, R., Marcelis, M. C., van Amelsvoort, T., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291718003446 · Cited by 58
“The current paper used a dimensional approach, with which we found significantly reduced striatal activation during unexpected rewards with increasing self-reported depression severity, which complements previous case-control analyses (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
BackgroundResultInfluentialSelf-citationTerminology and assessment tools of psychosis: A systematic narrative review
Seiler, N., Nguyen, T., Yung, A. R., & O'Donoghue, B. N. (2020) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12966 · Cited by 57
Annual Research Review: Developmental computational psychiatry
Hauser, T. U., Will, G., Dubois, M., & Dolan, R. J. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12964 · Cited by 57
Guessoum, S. B., Strat, Y. L., Dubertret, C., & Mallet, J. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109862 · Cited by 56
Neural Circuitry of Salience and Reward Processing in Psychosis
Kesby, J. P., Murray, G. K., & Knolle, F. (2023) · Biological Psychiatry Global Open Science · doi:10.1016/j.bpsgos.2021.12.003 · Cited by 55
Unifying treatments for depression: an application of the free energy principle
Chekroud, A. M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00153 · Cited by 55
“…no study has specifically investigated the ability of depressed patients to optimally update learning rate according to their environment, one study showed that controls— but not patients—significantly activated the ACC when given negative feedback during a gambling task (Gradin et al., 2011).”
BackgroundGibbs-Dean, T., Katthagen, T., Tsenkova, I., Ali, R., Liang, X., Spencer, T. J., & Diederen, K. M. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105087 · Cited by 58
“parameters derived from the task to be validated in concordance with real-life phenomena they are argued to capture (Gradin et al., 2011; Scholl & Klein-Flügge, 2018).”
MethodReward processing as a common diathesis for chronic pain and depression
Rizvi, S. J., Gandhi, W., & Salomons, T. V. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.04.033 · Cited by 55
Chambon, V., Pacherie, E., Barbalat, G., Jacquet, P., Franck, N., & Farrer, C. (2011) · Brain · doi:10.1093/brain/awr306 · Cited by 54
“A disturbance in this error-dependent updating mechanism, possibly caused by alterations in the dopaminergic circuitry (Gradin et al., 2011), may result in patients having an abnormal degree of certainty in their beliefs about other people’s intentions.”
BackgroundNeurobiological Correlates of Delusion: Beyond the Salience Attribution Hypothesis
Pankow, A., Knobel, A., Voss, M., & Heinz, A. (2012) · Neuropsychobiology · doi:10.1159/000337132 · Cited by 54
The developmental psychopathology of motivation in adolescence
Fairchild, G. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.07.009 · Cited by 53
Ang, Y.-S., Kaiser, R., Deckersbach, T., Almeida, J., Phillips, M. L., Chase, H. W., Webb, C. A., Parsey, R., Fava, M., McGrath, P., et al. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.04.009 · Cited by 43
Bridging Levels of Understanding in Schizophrenia Through Computational Modeling
Anticevic, A., Murray, J. D., & Barch, D. M. (2015) · Clinical Psychological Science · doi:10.1177/2167702614562041 · Cited by 53
“These models can generate predictions about both behavior and brain-behavior relationships in schizophrenia (Gold et al., 2012; Gradin et al., 2011; G. K. Murray et al., 2008; Schlagenhauf et al., 2014).”
BackgroundInfluentialNeural mechanisms of reward processing associated with depression-related personality traits
Umemoto, A., & Holroyd, C. B. (2017) · Clinical Neurophysiology · doi:10.1016/j.clinph.2017.03.049 · Cited by 53
“…by these regions, which are often seen to be hypoactive in depression, would therefore result in the dopamine system carrying abnormal RPE signals to the ACC (Holroyd and Umemoto, 2016)—as appears to be the case in clinically depressed individuals (Gradin et al., 2011; Kumar et al., 2008).”
ResultPresentation and Neurobiology of Anhedonia in Mood Disorders: Commonalities and Distinctions
Rizvi, S. J., Lambert, C. M., & Kennedy, S. H. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0877-z · Cited by 54
Queirazza, F., Fouragnan, E. F., Steele, J. D., Cavanagh, J., & Philiastides, M. G. (2019) · Science Advances · doi:10.1126/sciadv.aav4962 · Cited by 53
Self-citationInfluence of depression symptoms on history-independent reward and punishment processing
Beevers, C. G., Worthy, D. A., Gorlick, M. A., Nix, B., Chotibut, T., & Todd Maddox, W. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2012.09.054 · Cited by 47
“Trial-by-trial analyses indicated that depressed individuals were less likely than controls to rely on past reinforcement history to guide current decision-making, particularly in the absence of an immediate reward (Pizzagalli et al., 2008; Gradin et al., 2011).”
Spano, M. C., Lorusso, M., Pettorruso, M., Zoratto, F., Di Giuda, D., Martinotti, G., & di Giannantonio, M. (2019) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.13230 · Cited by 52
Liraglutide restores impaired associative learning in individuals with obesity
Hanssen, R., Rigoux, L., Kuzmanovic, B., Iglesias, S., Kretschmer, A. C., Schlamann, M., Albus, K., Edwin Thanarajah, S., Sitnikow, T., Melzer, C., et al. (2023) · Nature Metabolism · doi:10.1038/s42255-023-00859-y · Cited by 52
“4Faculty of Medicine and University Hospital Cologne, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf (CIO ABCD) and Excellence Center for Medical Mycology (ECMM), University of Cologne, Cologne, Germany.”
MethodInfluentialMisaki, M., Suzuki, H., Savitz, J., Drevets, W. C., & Bodurka, J. (2016) · Scientific Reports · doi:10.1038/srep21227 · Cited by 46
The roles of valuation and reward processing in cognitive function and psychiatric disorders
Hélie, S., Shamloo, F., Novak, K. D., & Foti, D. (2017) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13327 · Cited by 51
Greenberg, T., Fournier, J. C. J., Stiffler, R. S., Chase, H. W., Almeida, J., Aslam, H. A., Deckersbach, T., Cooper, C. M., Toups, M. S. P., Carmody, T., et al. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0490-5 · Cited by 51
D’Astolfo, L., & Rief, W. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01253 · Cited by 43
Chen, X., Liu, C., He, H., Chang, X., Jiang, Y., Li, Y., Duan, M., Li, J., Luo, C., & Yao, D. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.001 · Cited by 49
High Reward Makes Items Easier to Remember, but Harder to Bind to a New Temporal Context
Madan, C. R., Fujiwara, E., Gerson, B. C., & Caplan, J. B. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00061 · Cited by 47
“, 1968; Allen and Estes, 1972; Medin, 1972a,b) as well several more recent reward-learning studies (e.g., Johnsrude et al., 1999, 2000; Frank et al., 2004, 2006; Bayley et al., 2005; Pessiglione et al., 2006; Valentin and O’Doherty, 2009; Voon et al., 2010; Gradin et al., 2011).”
BackgroundKrawczyk, M. C., Fernández, R. S., Pedreira, M. E., & Boccia, M. M. (2016) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2016.12.011 · Cited by 48
“Accordingly, there might be a loss of high level precision in the brain schemas which might lead in generalized cognitive problem and overattention to sensory stimuli (Corlett et al., 2007; Gradin et al., 2011).”
Multiple Facets of Value-Based Decision Making in Major Depressive Disorder
Mukherjee, D., Lee, S., Kazinka, R., Satterthwaite, T. D., & Kable, J. W. (2020) · Scientific Reports · doi:10.1038/s41598-020-60230-z · Cited by 49
Rouhani, N., & Niv, Y. (2019) · Psychopharmacology · doi:10.1007/s00213-019-05322-z · Cited by 47
Beta activity in human anterior cingulate cortex mediates reward biases
Xiao, J., Adkinson, J. A., Myers, J. C., Allawala, A. B., Mathura, R. K., Pirtle, V., Najera, R. A., Provenza, N. R., Bartoli, E., Watrous, A. J., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-49600-7 · Cited by 48
Intact Ventral Striatal Prediction Error Signaling in Medicated Schizophrenia Patients
Culbreth, A. J., Westbrook, A., Xu, Z., Barch, D. M., & Waltz, J. A. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.07.007 · Cited by 44
“What may explain the discrepancies between our group level results and previous reports of abnormal VS RPE signals in SZ patients (18–20,22)? First, several previous reports (18,19,21,22) of VS RPE signaling involved tasks without contingency reversals [although see Schlagenhauf et al.”
BackgroundResultAnhedonia, positive affect dysregulation, and risk and maintenance of binge‐eating disorder
Mason, T. B., Smith, K. E., Anderson, L. M., & Hazzard, V. M. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23433 · Cited by 47
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript Pavlovian and instrumental conditioning tasks (Gradin et al., 2011; Kumar et al., 2008).”
Stress to inflammation and anhedonia: Mechanistic insights from preclinical and clinical models
Boyle, C. C., Bower, J. E., Eisenberger, N. I., & Irwin, M. R. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105307 · Cited by 48
Harlé, K. M., Guo, D., Zhang, S., Paulus, M. P., & Yu, A. J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0186473 · Cited by 36
Motivational Context Modulates Prediction Error Response in Schizophrenia
Reinen, J. M., Van Snellenberg, J. X., Horga, G., Abi-Dargham, A., Daw, N. D., & Shohamy, D. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw045 · Cited by 43
L’anhédonie dans la dépression
Gaillard, R., Gourion, D., & Llorca, P. (2013) · L Encéphale · doi:10.1016/j.encep.2013.07.001 · Cited by 47
Yan, C., Wang, Y., Su, L., Xu, T., Yin, D., Fan, M., Deng, C., Wang, Z., Lui, S. S. Y., Cheung, E. F. C., et al. (2016) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2016.06.014 · Cited by 44
“Moreover, our findings are also consistent with a number of imaging studies suggesting that patients with schizophrenia (Gradin et al., 2011; Walter et al., 2009; Waltz et al., 2009; White et al., 2015) and people at risk of developing psychosis (de Leeuw et al., 2015; Grimm et al., 2014; Wotruba…”
Reward anticipation in schizophrenia: A coordinate-based meta-analysis
Leroy, A., Amad, A., D'Hondt, F., Pins, D., Jaafari, N., Thomas, P., & Jardri, R. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2019.12.041 · Cited by 39
Maddox, W. T., Gorlick, M. A., Worthy, D. A., & Beevers, C. G. (2012) · Cognition · doi:10.1016/j.cognition.2012.06.011 · Cited by 45
“However, these deficits have been observed only under gain-maximization conditions (Gradin et al., 2011; Pizzagalli et al., 2008).”
InfluentialValuation in major depression is intact and stable in a non-learning environment
Chung, D., Kadlec, K., Aimone, J. A., McCurry, K., King-Casas, B., & Chiu, P. H. (2017) · Scientific Reports · doi:10.1038/srep44374 · Cited by 37
Kittleson, A. R., Woodward, N. D., Heckers, S., & Sheffield, J. M. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105643 · Cited by 44
“Significantly altered prediction error signaling has been found in schizophrenia compared to both other psychiatric illnesses and healthy populations, and this may represent aberrant error-dependent updating of inferences and beliefs which drives psychotic symptoms (Gradin et al., 2011).”
Prefrontal mechanisms of comorbidity from a transdiagnostic and ontogenic perspective
MacDonald, A. N., Goines, K., Novacek, D. M., & Walker, E. F. (2016) · Development and Psychopathology · doi:10.1017/s0954579416000742 · Cited by 44
“, 2010), impulsivity, and increased frustration, as well as reduced approach behaviors (Gradin et al., 2011).”
BackgroundDuprat, R., Wu, G.-R., De Raedt, R., & Baeken, C. (2018) · The World Journal of Biological Psychiatry · doi:10.1080/15622975.2017.1355472 · Cited by 39
“Similarly, Gradin et al. (2011) found reduced neural activity in the caudate of depressed patients during a reward-learning task.”
BackgroundTrait and State Positive Emotional Experience in Schizophrenia: A Meta-Analysis
Yan, C., Cao, Y., Zhang, Y., Song, L.-L., Cheung, E. F. C., & Chan, R. C. K. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040672 · Cited by 43
“However, a number of these studies reported that patients with schizophrenia had abnormal neural activation in the amygdala, the hippocampal gyrus, the ventral striatum, the putamen, the insula, and the medial prefrontal cortex while processing positive facial expression [27,50,51,52], IAPS pictures [27,53], drink [54…”
BackgroundRevisiting the role of computational neuroimaging in the era of integrative neuroscience
Loosen, A. M., Kato, A., & Gu, X. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01946-8 · Cited by 42
“Examples include attenuated PEs linked to depression (e.g., [67 – 69]; although not ubiquitously so [70]), heightened error processing associated with obsessive-compulsive disorder (OCD; e.g., [71, 72], and alterations in PEs playing a key role in psychosis (e.g., [73 – 77]) and addiction (e.g.,…”
BackgroundChung, Y. S., & Barch, D. M. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000137 · Cited by 38
Griffiths, O., Langdon, R. A., Pelley, M. E. L., & Coltheart, M. (2014) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2014.897601 · Cited by 41
Smith, R. S., Alkozei, A., Killgore, W. D. S., & Lane, R. D. (2017) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2017.09.011 · Cited by 42
“…such as neurodegeneration, obesity, metabolic syndrome, cardiovascular disease, chronic pain, rheumatoid arthritis, and asthma (Barton, 2008; Bruce, 2008; Calder, 2006; Graff et al., 2009; Grippo and Johnson, 2009; Himmerich et al., 2008; Katon et al., 2005; Onitilo et al., 2006; Whooley, 2006).”
BackgroundDifferential neural reward mechanisms in treatment-responsive and treatment-resistant schizophrenia
Vanes, L. D., Mouchlianitis, E. D., Collier, T., Averbeck, B. B., & Shergill, S. S. (2018) · Psychological Medicine · doi:10.1017/s0033291718000041 · Cited by 42
“2013) and dysfunctions in schizophrenia have also been observed in both striatum and thalamus (Gradin et al. 2011).”
InfluentialCorticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41
“In human imaging, the degree of co-variation between model-estimated reward prediction errors and blood oxygen-level dependent (BOLD) responses is typically assumed to reflect individual differences in corticostriatothalamic prediction error signals (Kumar et al. 2008; Gradin et al. 2011; Dombrovski et al. 2013).”
Neural correlates of social exchanges during the Prisoner’s Dilemma game in depression
Gradin, V. B., Pérez, A., Macfarlane, J. A., Cavin, I., Waiter, G., Tone, E. B., Dritschel, B., Maiche, A., & Steele, J. D. (2016) · Psychological Medicine · doi:10.1017/s0033291715002834 · Cited by 41
“First, several studies indicate reduced activation in reward-related brain regions, particularly the striatum, in depression; this reduction may be linked to anhedonia (Eshel & Roiser, 2010; Gradin et al. 2011; Zhang et al. 2013).”
BackgroundSelf-citationExplaining delusional beliefs: a hybrid model
Miyazono, K., & McKay, R. (2019) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2019.1664443 · Cited by 41
Frey, A.-L., & McCabe, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.049 · Cited by 43
A Novel Role of CD38 and Oxytocin as Tandem Molecular Moderators of Human Social Behavior
Tolomeo, S., Chiao, B., Lei, Z., Chew, S. H., & Ebstein, R. P. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.013 · Cited by 41
“schizophrenia, depression, and attention deficit disorder (Gradin et al., 2011; Kumar et al., 2008).”
Improper activation of D1 and D2 receptors leads to excess noise in prefrontal cortex
Avery, M. C., & Krichmar, J. L. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00031 · Cited by 40
Engelmann, J. B., Berns, G. S., & Dunlop, B. W. (2017) · Psychological Medicine · doi:10.1017/s0033291717001428 · Cited by 33
“…stage, by biasing attention to negative potential outcomes; at the valuation stage, by diminishing the influences of rewarding outcomes on value computations; and, finally, by blunting reinforcement learning about the outcomes of decisions as shown previously (Gradin et al. 2011; Ubl et al. 2015).”
BackgroundA mechanism-oriented approach to psychopathology: The role of Pavlovian conditioning
Nees, F., Heinrich, A., & Flor, H. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.05.005 · Cited by 42
Schneider, M., Elbau, I., Nantawisarakul, T., Pöhlchen, D., Brückl, T. M., BeCOME working group, Czisch, M., Saemann, P. G., Lee, M. D., Binder, E. B., et al. (2020) · Brain Sciences · doi:10.3390/brainsci10120906 · Cited by 39
Psychiatric Neural Networks and Precision Therapeutics by Machine Learning
Komatsu, H., Watanabe, E., & Fukuchi, M. (2021) · Biomedicines · doi:10.3390/biomedicines9040403 · Cited by 40
“Consistent with these results, activity involved in reward prediction error in striatum and the frontal cortex is attenuated in patients with schizophrenia [50,51].”
ResultDogs are more pessimistic if their owners use two or more aversive training methods
Casey, R. A., Naj-Oleari, M., Campbell, S., Mendl, M., & Blackwell, E. J. (2021) · Scientific Reports · doi:10.1038/s41598-021-97743-0 · Cited by 39
Probabilistic Reinforcement Learning and Anhedonia
Kangas, B. D., Der‐Avakian, A., & Pizzagalli, D. A. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_349 · Cited by 40
Trost, S., Diekhof, E. K., Mohr, H., Vieker, H., Krämer, B., Wolf, C., Keil, M., Dechent, P., Binder, E. B., & Gruber, O. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.70 · Cited by 39
“The finding of an attenuated brain activation in response to reward cues in mesolimbic dopaminergic regions has been multiply replicated in schizophrenia, but is also found in affective disorders (Bogdan et al, 2013; Deserno et al, 2013; Gradin et al, 2011; Hall et al, 2014; Trost et al, 2014).”
BackgroundSchmidt, A., Antoniades, M., Allen, P., Egerton, A., Chaddock, C. A., Borgwardt, S., Fusar-Poli, P., Roiser, J. P., Howes, O., & McGuire, P. (2017) · Psychological Medicine · doi:10.1017/s0033291716002439 · Cited by 38
Lin, P., Wang, X., Zhang, B., Kirkpatrick, B. W., Öngür, D., Levitt, J. J., Jovicich, J., Yao, S., & Wang, X. (2017) · Human Brain Mapping · doi:10.1002/hbm.23879 · Cited by 39
“However, the exact clinical relevance of altered VS activation in psychosis is unclear and the results of studies examining the potential relationship between VS activation and negative symptoms have been inconsistent (de Leeuw et al., 2015; Gradin et al., 2011; Radua et al., 2015; Roiser, Howes, Chaddock, Joyce, & Mc…”
ResultDisrupted attentional learning in high schizotypy: Evidence of aberrant salience
Haselgrove, M., Pelley, M. E. L., Singh, N. K., Teow, H. Q., Morris, R. W., Green, M. J., Griffiths, O., & Killcross, S. (2015) · British Journal of Psychology · doi:10.1111/bjop.12175 · Cited by 37
Decreased reward circuit connectivity during reward anticipation in major depression
Geugies, H., Groenewold, N. A., Meurs, M., Doornbos, B., de Klerk‐Sluis, J. M., van Eijndhoven, P., Roest, A. M., & Ruhé, H. G. (2022) · NeuroImage Clinical · doi:10.1016/j.nicl.2022.103226 · Cited by 37
“, 2008) and decreased VS (Gradin et al., 2011; Kumar et al., 2008) and DS (Gradin et al.”
Thoma, P., Norra, C., Juckel, G., Suchan, B., & Bellebaum, C. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.06.002 · Cited by 37
Anhedonia is associated with reduced incentive cue related activation in the basal ganglia
Chung, Y. S., & Barch, D. M. (2015) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-015-0366-3 · Cited by 38
Mild Reinforcement Learning Deficits in Patients With First-Episode Psychosis
Chang, W. C., Waltz, J. A., Gold, J. M., Chan, T. C. W., & Chen, E. Y. H. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbw060 · Cited by 37
Knolle, F., Ermakova, A. O., Justicia, A., Fletcher, P. C., Bunzeck, N., Düzel, E., & Murray, G. K. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0250-3 · Cited by 37
Prefrontal cortex, dopamine, and jealousy endophenotype
Marazziti, D., Poletti, M., Dell’Osso, L., Baroni, S., & Bonuccelli, U. (2012) · CNS Spectrums · doi:10.1017/s1092852912000740 · Cited by 36
A translational perspective on the anti-anhedonic effect of ketamine and its neural underpinnings
Pulcu, E., Guinea, C., Cowen, P. J., Murphy, S. E., & Harmer, C. J. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01183-1 · Cited by 35
Exploring causal mechanisms of psychosis risk
Oliver, D., Chesney, E., Cullen, A. E., Davies, C., Englund, A., Gifford, G., Kerins, S., Lalousis, P. A., Logeswaran, Y., Merritt, K., et al. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105699 · Cited by 35
“…during tasks assessing reward consumption (Forbes et al., 2006; Pizzagalli et al., 2009), reward anticipation (Borsini et al., 2020; Pizzagalli, 2014; Pizzagalli et al., 2009; Zhang et al., 2013), and reward learning (Gradin et al., 2011; Kumar et al., 2018, 2008; Rupprechter et al., 2020).”
BackgroundYan, C., Yang, T., Yu, Q., Jin, Z. H., Cheung, E. F. C., Liu, X., & Chan, R. C. K. (2015) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2015.01.001 · Cited by 35
“See citations of appendix references (Crespo-Facorro et al., 2001; da Silva Alves et al., 2013; Gradin et al., 2011; Gur et al., 2002; Holt et al., 2011; Juckel et al., 2006; Koch et al., 2010; Lakis, Mendrek 2013; Li et al., 2010; Morris et al., 2012; Paradiso et al., 2003; Reske et al., 2007; Schlagenhauf et al., 20…”
Influential
Metadata
- Authors
- Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D.
- Affiliations
- University of Dundee (GB)
- Warneford Hospital (GB)
- University of Aberdeen (GB)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-04-09
- Volume
- 134
- Issue
- 6
- Pages
- 1751-1764
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2144683341
- Cited by
- 485
- References
- 59
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 27 · 2023: 28 · 2022: 47 · 2021: 55 · 2020: 33 · 2019: 22 · 2018: 31 · 2017: 31 · 2016: 43 · 2015: 45 · 2014: 27 · 2013: 36 · 2012: 18
- FWCI
- 13.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Discovery Research Portal (University of Dundee) (submittedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- prediction error, expected value, anhedonia, depression, schizophrenia, dopamine, reinforcement learning, reward valuation, incentive salience, psychotic symptoms, negative symptoms, caudate nucleus, nucleus accumbens, midbrain, insula, parahippocampal gyrus, model-based fMRI
- MeSH terms
- Adult, Antidepressive Agents, Brain, Brain Mapping, Conditioning, Operant, Depression, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Neuropsychological Tests, Oxygen, Predictive Value of Tests, Psychiatric Status Rating Scales, Reinforcement, Psychology, Schizophrenia, Schizophrenic Psychology, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.