Expected value and prediction error abnormalities in depression and schizophrenia
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
The dopamine system has been linked to anhedonia in depression and both the positive and negative symptoms of schizophrenia, but it remains unclear how dopamine dysfunction could mechanistically relate to observed symptoms. There is considerable evidence that phasic dopamine signals encode prediction error (differences between expected and actual outcomes), with reinforcement learning theories being based on prediction error-mediated learning of associations. It has been hypothesized that abnormal encoding of neural prediction error signals could underlie anhedonia in depression and negative symptoms in schizophrenia by disrupting learning and blunting the salience of rewarding events, and contribute to psychotic symptoms by promoting aberrant perceptions and the formation of delusions. To test this, we used model based functional magnetic resonance imaging and an instrumental reward-learning task to investigate the neural correlates of prediction errors and expected-reward values in patients with depression (n=15), patients with schizophrenia (n=14) and healthy controls (n=17). Both patient groups exhibited abnormalities in neural prediction errors, but the spatial pattern of abnormality differed, with the degree of abnormality correlating with syndrome severity. Specifically, reduced prediction errors in the striatum and midbrain were found in depression, with the extent of signal reduction in the bilateral caudate, nucleus accumbens and midbrain correlating with increased anhedonia severity. In schizophrenia, reduced prediction error signals were observed in the caudate, thalamus, insula and amygdala-hippocampal complex, with a trend for reduced prediction errors in the midbrain, and the degree of blunting in the encoding of prediction errors in the insula, amygdala-hippocampal complex and midbrain correlating with increased severity of psychotic symptoms. Schizophrenia was also associated with disruption in the encoding of expected-reward values in the bilateral amygdala-hippocampal complex and parahippocampal gyrus, with the degree of disruption correlating with psychotic symptom severity. Neural signal abnormalities did not correlate with negative symptom severity in schizophrenia. These findings support the suggestion that a disruption in the encoding of prediction error signals contributes to anhedonia symptoms in depression. In schizophrenia, the findings support the postulate of an abnormality in error-dependent updating of inferences and beliefs driving psychotic symptoms. Phasic dopamine abnormalities in depression and schizophrenia are suggested by our observation of prediction error abnormalities in dopamine-rich brain areas, given the evidence for dopamine encoding prediction errors. The findings are consistent with proposals that psychiatric syndromes reflect different disorders of neural valuation and incentive salience formation, which helps bridge the gap between biological and phenomenological levels of understanding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, depressed patients exhibit both hyposensitivity to rewards and oversensitivity to punishments 96,97 , attributed to alterations in mesolimbic prediction error signaling 97-99 , and may exhibit a constrained option space ('tunnel vision') during decision-making 100 .”
From Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model (2020) · cites this paper as [98]
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [124]
In the citing paper
“Dopamine signaling to the basal ganglia, including the nucleus accumbens, also plays a role in what is known as the reward prediction error, a subconstruct of approach motivation.”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“The reward prediction error, in which changes in dopamine firing encode differences between an expected vs. actual reward outcome, allows for dynamic learning from experience and updates in reward expectations (Gradin et al., 2011; Schultz, 2016).”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“Several studies showed a disruption of striatal activity during reward learning, prediction-error encoding, and rewarding outcomes (Table 1) (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
From Circuit Mechanisms of Reward, Anhedonia, and Depression (2019) · cites this paper as Gradin et al., 2011
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“All subjects completed the Beck depression inventory (Beck et al., 1961) and Spielberger State Anxiety scale (Spielberger, 1983).”
MethodHamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 2×
“Patients with major depressive disorder were assessed with the 21-item Hamilton depression rating scale (Hamilton, 1960) and patients with schizophrenia were assessed with the Positive and Negative Syndrome Scale (Kay et al.”
MethodThe Positive and Negative Syndrome Scale (PANSS) for schizophrenia.
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987) · Schizophrenia Bulletin · doi:10.1093/schbul/13.2.261 · Cited by 21,378 · cited 3×
“1C) measured using relevant subscales of the Positive and Negative Syndrome Scale.”
MethodA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Since dopamine has been hypothesized to be the neural substrate of prediction errors in dopamine-rich brain areas (Montague et al., 1996; Schultz et al., 1997; Dayan and Abbott, 2001; Tobler et al., 2006), our findings give strong support to the hypothesis of abnormal dopamine-mediated prediction…”
ResultHow do you feel — now? The anterior insula and human awareness
(Bud) Craig, A. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2555 · Cited by 6,657 · cited 1×
“Furthermore, the insula has also been linked to the feeling of 'agency' (self-generation) during motor activity (Craig, 2009).”
BackgroundPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · cited 6×
“Furthermore, all effective anti-psychotic medications block D 2 receptors (Kapur, 2003).”
BackgroundResultInfluentialThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · cited 2×
“…reduced dopamine function and major depressive disorder has long been proposed (Dunlop and Nemeroff, 2007), but it is important to note that our current study specifically investigated prediction errors that have been linked to salience (Berridge, 2007) and potentially, therefore, anhedonia.”
Background
Research works printed but not linked: 4
- Dayan, 2001, Theoretical neuroscience: computational and mathematical modelling of neural systems Cambridge, MA: The MIT Press
- Friston, 2004, Introduction to statistical parametric mapping
- Sims, 2005, Symptoms in the mind
- Spielberger, 1983, State-trait anxiety inventory for adults, STAI Form Y-1
Cited by
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 739
Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028813 · Cited by 733
“Prior studies have found associations between depression and sensitivity to reward probability (Forbes, Shaw, & Dahl, 2007; Gradin et al., 2011; Pizzagalli, Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M., 2008).”
Prefrontal cortex and depression
Pizzagalli, D. A., & Roberts, A. C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01101-7 · Cited by 667
Assessing anhedonia in depression: potentials and pitfalls
Rizvi, S. J., Pizzagalli, D. A., Sproule, B. A., & Kennedy, S. H. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.004 · Cited by 571
“…Error - Reward expectation - Reward association learning - Feedback integration Money, water Kumar et al, 2008 Forbes et al, 2009 Cohen et al, 2009 Gradin et al, 2011 Chase et al, 2013 Probabilistic Reversal Learning - Feedback integration Money Murphy et al, 2003 Taylor Tavares et al, 2008…”
BackgroundMethodResultInfluentialCognitive Mechanisms of Treatment in Depression
Roiser, J. P., Elliott, R., & Sahakian, B. J. (2012) · Neuropsychopharmacology · doi:10.1038/npp.2011.183 · Cited by 535
Reward Processing in Depression: A Conceptual and Meta-Analytic Review Across fMRI and EEG Studies
Keren, H., O’Callaghan, G., Vidal-Ribas, P., Buzzell, G. A., Brotman, M. A., Leibenluft, E., Pan, P. M., Meffert, L., Kaiser, A., Wolke, S., et al. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17101124 · Cited by 521
Rive, M. M., van Rooijen, G., Veltman, D. J., .Phillips, M. L., Schene, A. H., & Ruhé, H. G. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.018 · Cited by 481
“, 2008) or an instrumental reward learning paradigm (Gradin et al., 2011) were used; and (2) Tasks involving reappraisal of emotional stimuli, requiring subjects to cognitively reframe the meaning of an emotional stimulus in order to diminish any evoked emotion (Heller et al.”
BackgroundMethodResultThe orbitofrontal cortex: reward, emotion and depression
Rolls, E. T., Cheng, W., & Feng, J. (2020) · Brain Communications · doi:10.1093/braincomms/fcaa196 · Cited by 474
“In earlier studies, it was reported that depression reduces prediction errors during reinforcement learning (Kumar et al., 2008; Gradin et al., 2011), but Rutledge et al.”
BackgroundA Review of Reward Processing and Motivational Impairment in Schizophrenia
Strauss, G. P., Waltz, J. A., & Gold, J. M. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt197 · Cited by 452
Craske, M. G., Meuret, A. E., Ritz, T., Treanor, M., Dour, H., & Rosenfield, D. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000396 · Cited by 451
“For reward learning, blunted ventral striatal responses to instrumental conditioning tasks correlate with anhedonic symptoms (Gradin et al., 2011; Whitton, Treadway, & Pizzagalli, 2015).”
Inflammation Effects on Motivation and Motor Activity: Role of Dopamine
Felger, J. C., & Treadway, M. T. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.143 · Cited by 442
“…studies comparing groups of patients with schizophrenia and depression have found similar decreases relative to controls for both reward anticipation (Arrondo et al, 2015) and prediction error signaling (Gradin et al, 2011), with little evidence of clear differences between patient groups.”
ResultPrediction error in reinforcement learning: A meta-analysis of neuroimaging studies
Garrison, J., Erdeniz, B., & Done, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.023 · Cited by 438
“…et al. (2008) RW 14 Cohen et al. (2007) RW 17 Delgado et al. (2008) TD 11 Gläscher et al. (2010) SARSA 18 Gläscher et al. (2009) RW 20 Gradin et al. (2011) SARSA 17 Hampton et al. (2006) RW 16 Howard-Jones et al. (2010) RW 16 Jocham et al. (2011) RW 16 Kahnt et al. (2011) RW 20 Kahnt…”
Craske, M. G., Meuret, A. E., Ritz, T., Treanor, M., & Dour, H. J. (2016) · Depression and Anxiety · doi:10.1002/da.22490 · Cited by 387
“[69] There is some evidence for blunted ventral striatal responses to Pavlovian[118] and instrumental conditioning tasks[120] in depression with neural responses correlating with self-reported anhedonia.[120] In terms of behavioral indices, the propensity to develop a response bias to stimuli that are more frequently…”
BackgroundManoliu, A., Meng, C., Brandl, F., Doll, A., Tahmasian, M., Scherr, M., Schwerthöffer, D., Zimmer, C., Förstl, H., Bäuml, J., et al. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00930 · Cited by 382
“…DMN, SN, and CEN might be linked to anomalies beyond these networks (Williamson and Allman, 2012), such as aberrant reinforcement prediction error (Gradin et al., 2011), striatal reward processing (Robinson et al., 2012) and connectivity (Meng et al., 2013), or aberrant medial temporal lobe…”
BackgroundZhang, W.-N., Chang, S.-H., Guo, L.-Y., Zhang, K.-L., & Wang, J. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.039 · Cited by 355
The motivation and pleasure dimension of negative symptoms: Neural substrates and behavioral outputs
Kring, A. M., & Barch, D. M. (2014) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2013.06.007 · Cited by 351
“By contrast, Gradin found reduced prediction error responses in the caudate, but increased activation associated with expected reward value in the ventral striatum (Gradin et al., 2011).”
Motivation and cognitive control in depression
Grahek, I., Shenhav, A., Musslick, S., Krebs, R. M., & Koster, E. H. W. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.04.011 · Cited by 348
Millan, M. J., Fone, K., Steckler, T., & Horan, W. P. (2014) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2014.03.008 · Cited by 347
“Faulty encoding of expected reward in schizophrenia (implicated in apathy) involves, then, dysfunction of an OFCstriatal network, though other DA-rich regions may also be involved, like the insular cortex, amgydala and hippocampus (Gradin et al., 2011; Kring and Barch, 2014; Levy and Dubois, 2006).”
BackgroundInfluentialVentral Striatal Activation During Reward Processing in Psychosis: A Neurofunctional Meta-Analysis
Radua, J., Schmidt, A., Borgwardt, S., Heinz, A., Schlagenhauf, F., McGuire, P., & Fusar-Poli, P. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2196 · Cited by 342
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
“Consistent with the impairment in Go learning, medicated patients show blunted neural responses for positive PEs in the striatum, midbrain, and other limbic regions (53,60,68,69), which correlate with negative symptoms (60,68).”
Reward Signals, Attempted Suicide, and Impulsivity in Late-Life Depression
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., & Siegle, G. J. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.75 · Cited by 289
Computational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285
“26 51 – 54 Third are studies using a probabilistic response bias task.”
MethodRizvi, S. J., Quilty, L. C., Sproule, B. A., Cyriac, A., Michael Bagby, R., & Kennedy, S. H. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.07.062 · Cited by 274
“…MDD patients have reduced ability to detect reward compared to healthy controls and exhibit reduced brain activity when a reward has occurred, which suggests individuals with MDD do not experience the same level of feedback from rewards as healthy controls (Gradin et al., 2011; Kumar et al., 2008).”
BackgroundPhillips, M. L., Chase, H. W., Sheline, Y. I., Etkin, A., Almeida, J. R. C., Deckersbach, T., & Trivedi, M. H. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14010076 · Cited by 267
“Some studies have indicated significantly reduced ventral striatal activity to rewarding stimuli and during reward learning in depressed compared with healthy adults (7, 10, 43, 108, 109), and increasedhabituation of ventral striatal activity to reward (110).”
BackgroundResultStriatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253
“…rewards in a monetary incentive delay task (Juckel et al., 2006a; Schlagenhauf et al., 2009), and reduced VS correlates of reward prediction errors in instrumental conditioning (Gradin et al., 2011; Morris et al., 2011; Murray et al., 2008b; Nielsen et al., 2012b but see; Romaniuk et al., 2010).”
Circuit Mechanisms of Reward, Anhedonia, and Depression
Höflich, A., Michenthaler, P., Kasper, S., & Lanzenberger, R. (2019) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyy081 · Cited by 253
“Several studies showed a disruption of striatal activity during reward learning, prediction-error encoding, and rewarding outcomes (Table 1) (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
BackgroundResultDistorted Cognitive Processes in Major Depression: A Predictive Processing Perspective
Kube, T., Schwarting, R., Rozenkrantz, L., Glombiewski, J. A., & Rief, W. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2019.07.017 · Cited by 234
Reinforcement learning in depression: a review of computational research
Chen, C., Takahashi, T., Nakagawa, S., Inoue, T., & Kusumi, I. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.05.005 · Cited by 233
Chase, H. W., Kumar, P., Eickhoff, S. B., & Dombrovski, A. Y. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0338-7 · Cited by 231
“…–84 –8 –24 –88 –16 –24 –82 –8 147 Chowdhury et al., 2013 (23.64) van den Bos et al., 2012 (17.92) Bellebaum et al., 2012 (13.15) Schonberg et al., 2010 (11.75) Gradin et al., 2011 (9.43) Madlon-Kay et al., 2013 (8.96) Howard-Jones et al., 2010 (7.83) O’Sullivan et al., 2011 (6.48) Metereau &…”
InfluentialSelf-citationRømer Thomsen, K., Whybrow, P. C., & Kringelbach, M. L. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00049 · Cited by 229
Halahakoon, D. C., Kieslich, K., O’Driscoll, C., Nair, A., Lewis, G., & Roiser, J. P. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.2139 · Cited by 222
Depression: a decision-theoretic analysis
Huys, Q. J. M., Daw, N. D., & Dayan, P. (2015) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-071714-033928 · Cited by 221
“The interpretation of these results is further complicated by the lack of behavioral differences between patients and controls in these studies, even though the tasks are sensitive enough to show differences between controls and other patient groups (Gradin et al. 2011, Schlagenhauf et al. 2014).”
BackgroundResultImpaired reward prediction error encoding and striatal-midbrain connectivity in depression
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., Brooks, N. H., & Pizzagalli, D. A. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0032-x · Cited by 219
“Correlation with clinical variables Unlike prior studies [21, 22, 26], RPE signal in the right striatum did not correlate with anhedonia scores within the MDD group.”
ResultSelf-citationBarch, D. M., Pagliaccio, D., & Luking, K. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_376 · Cited by 218
Association of neural and emotional impacts of reward prediction errors with major depression
Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., Lam, J., Skandali, N., Siegel, J. Z., Ousdal, O. T., et al. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.1713 · Cited by 209
Borsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-020-00804-6 · Cited by 207
Pizzagalli, D. A. (2022) · American Journal of Psychiatry · doi:10.1176/appi.ajp.20220423 · Cited by 199
Howes, O. D., Williams, M., Ibrahim, K., Leung, G., Egerton, A., McGuire, P. K., & Turkheimer, F. (2013) · Brain · doi:10.1093/brain/awt264 · Cited by 198
“…in schizophrenia and its prodrome in the context of reward/conditioning tasks (Murray et al., 2008; Waltz et al., 2009; Romaniuk et al., 2010; Gradin et al., 2011; Allen et al., 2012a, b; Nielsen et al., 2012; Roiser et al., 2012; Yoon et al., 2013) and the consistent evidence for increased…”
InfluentialAmotivation in Schizophrenia: Integrated Assessment With Behavioral, Clinical, and Imaging Measures
Wolf, D. H., Satterthwaite, T. D., Kantrowitz, J. J., Katchmar, N., Vandekar, L., Elliott, M. A., & Ruparel, K. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu026 · Cited by 197
The effects of early life stress on reward processing
Novick, A. M., Levandowski, M. L., Laumann, L. E., Philip, N. S., Price, L. H., & Tyrka, A. R. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.02.002 · Cited by 192
“actual reward outcome, allows for dynamic learning from experience and updates in reward expectations (Gradin et al., 2011; Schultz, 2016).”
BackgroundDimensional psychiatry: reward dysfunction and depressive mood across psychiatric disorders
Hägele, C., Schlagenhauf, F., Rapp, M., Sterzer, P., Beck, A., Bermpohl, F., Stoy, M., Ströhle, A., Wittchen, H.-U., Dolan, R. J., et al. (2015) · Psychopharmacology · doi:10.1007/s00213-014-3662-7 · Cited by 191
“Indeed, apathy and anhedonia, clinical correlations of (striatal) dopamine dysfunction (Gradin et al. 2011; Heinz et al. 1994), are key symptoms of depression (according to ICD-10 and DSM-IV).”
BackgroundAnhedonia in depression and schizophrenia: A transdiagnostic challenge
Lambert, C., Da Silva, S., Ceniti, A. K., Rizvi, S. J., Foussias, G., & Kennedy, S. H. (2018) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.12854 · Cited by 155
Deficits in predictive coding underlie hallucinations in schizophrenia
Horga, G., Schatz, K. C., Abi-Dargham, A., & Peterson, B. S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0200-14.2014 · Cited by 176
Chase, H. W., Nusslock, R., Almeida, J. R., Forbes, E. E., LaBarbara, E. J., & Phillips, M. L. (2013) · Bipolar Disorders · doi:10.1111/bdi.12132 · Cited by 157
“There is some prior evidence that such activation is disrupted in MDD (17, 19).”
Positive affect treatment targets reward sensitivity: A randomized controlled trial.
Craske, M. G., Meuret, A. E., Echiverri-Cohen, A. M., Rosenfield, D., & Ritz, T. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000805 · Cited by 171
Translational perspectives for computational neuroimaging
Stephan, K. E., Iglesias, S., Heinzle, J., & Diaconescu, A. O. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.008 · Cited by 169
“Additionally, midbrain PE responses correlated with psychotic symptom ratings (Gradin et al., 2011; Romaniuk et al., 2010).”
BackgroundMethodPike, A. C., & Robinson, O. J. (2022) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.0051 · Cited by 167
Decision Making: From Neuroscience to Psychiatry
Lee, D. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.008 · Cited by 166
“Consistent with these behavioral results, activity related to reward prediction error in the frontal cortex and striatum is attenuated in patients with schizophrenia (Corlett et al., 2007; Gradin et al., 2011).”
Computational neuroimaging strategies for single patient predictions
Stephan, K. E., Schlagenhauf, F., Huys, Q. J. M., Raman, S., Aponte, E. A., Brodersen, K. H., Rigoux, L., Moran, R. J., Daunizeau, J., Dolan, R. J., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.038 · Cited by 166
“with schizophrenia (Gradin et al., 2011; Murray et al., 2008; Romaniuk et al., 2010) have contributed empirical evidence for the”
Altered neural reward and loss processing and prediction error signalling in depression
Ubl, B., Kuehner, C., Kirsch, P., Ruttorf, M., Diener, C., & Flor, H. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu158 · Cited by 165
“In addition, PE-signals have been detected in non-dopamine rich brain systems including the insula and amygdala (Seymour et al., 2004, 2005; Gradin et al., 2011).”
BackgroundInfluentialPavlovian Reward Prediction and Receipt in Schizophrenia: Relationship to Anhedonia
Dowd, E. C., & Barch, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035622 · Cited by 154
“Some studies have shown blunted striatal reward responses or prediction errors (responses to outcomes that do not match expectation) [14,15,16,17,18], while others have shown intact responses [12,13].”
BackgroundSacchet, M. D., & Gotlib, I. H. (2017) · Scientific Reports · doi:10.1038/s41598-017-02062-y · Cited by 147
Mapping anhedonia-specific dysfunction in a transdiagnostic approach: an ALE meta-analysis
Zhang, B., Lin, P., Shi, H., Öngür, D., Auerbach, R. P., Wang, X., Yao, S., & Wang, X. (2016) · Brain Imaging and Behavior · doi:10.1007/s11682-015-9457-6 · Cited by 152
“…MDD patients viewing positive valence pictures (Epstein et al. 2006; Mitterschiffthaler et al. 2003; Osuch et al. 2009), which was highly consistent with the correlations between dysfunctional BOLD signals and anhedonia in a consummatory anhedonia task (Gradin et al. 2011; Pizzagalli et al. 2009).”
BackgroundFulford, D., Campellone, T., & Gard, D. E. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.05.007 · Cited by 137
Differential effects of acute stress on anticipatory and consummatory phases of reward processing
Kumar, P., Berghorst, L. H., Nickerson, L. D., Dutra, S. J., Goer, F. K., Greve, D. N., & Pizzagalli, D. A. (2014) · Neuroscience · doi:10.1016/j.neuroscience.2014.01.058 · Cited by 139
Self-citationArrondo, G., Segarra, N., Metastasio, A., Ziauddeen, H., Spencer, J., Reinders, N. R., Dudas, R. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01280 · Cited by 129
Leung, M.-K., Chan, C. C. H., Yin, J., Lee, C.-F., So, K.-F., & Lee, T. M. C. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss076 · Cited by 144
“Abnormalities such as decreased gray matter volume or altered activity in these two regions are linked with various conditions of emotional dysfunction, such as depression (Gilbert et al., 2010), bipolar disorder (Chen et al., 2011) and schizophrenia (Gradin et al., 2011).”
BackgroundPrediction error, ketamine and psychosis: An updated model
Corlett, P. R., Honey, G. D., & Fletcher, P. C. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116650087 · Cited by 142
“Others have similarly observed aberrant PE signals in striatum, amygdala and frontal cortex in patients with psychotic illness that correlate with the severity of delusions (Gradin et al., 2011; Romaniuk et al., 2010; Schlagenhauf et al., 2009; Waltz et al., 2010).”
BackgroundComputational neuroscience approach to biomarkers and treatments for mental disorders
Yahata, N., Kasai, K., & Kawato, M. (2017) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12502 · Cited by 111
Identification of the Cortical Neurons that Mediate Antidepressant Responses
Schmidt, E. F., Warner-Schmidt, J. L., Otopalik, B. G., Pickett, S. B., Greengard, P., & Heintz, N. (2012) · Cell · doi:10.1016/j.cell.2012.03.038 · Cited by 125
“In particular, reduced prediction error signals in both the bilateral caudate and the NAc correlate with increased anhedonia (a core feature of MDD) in depressed subjects (Gradin et al., 2011).”
Shen, X., Reus, L. M., Cox, S. R., Adams, M. J., Liewald, D. C., Bastin, M. E., Smith, D. J., Deary, I. J., Whalley, H. C., & McIntosh, A. M. (2017) · Scientific Reports · doi:10.1038/s41598-017-05507-6 · Cited by 129
“22 regulation(53–55), reward processing (56; 57) and executive control (31) in MDD populations.”
BackgroundMoran, E. K., Culbreth, A. J., & Barch, D. M. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000240 · Cited by 111
Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder
Rothkirch, M., Tonn, J., Köhler, S., & Sterzer, P. (2017) · Brain · doi:10.1093/brain/awx025 · Cited by 124
“model-based functional MRI has shown blunted reward PE signals in the striatum for instrumental (Gradin et al., 2011; Dombrovski et al., 2015) as well as Pavlovian conditioning (Kumar et al.”
BackgroundInfluentialSonuga-Barke, E. J. S., & Fairchild, G. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.04.004 · Cited by 124
Bernard, J. A., Russell, C. E., Newberry, R. E., Goen, J. R. M., & Mittal, V. A. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.01.034 · Cited by 118
The influence of depression symptoms on exploratory decision-making
Blanco, N. J., Otto, A. R., Maddox, W. T., Beevers, C. G., & Love, B. C. (2013) · Cognition · doi:10.1016/j.cognition.2013.08.018 · Cited by 96
“…(Elderkin-Thompson, Mintz, Haroon, Lavretsky, & Kumar, 2006), planning (Elliott et al., 1997), and decision-making tasks (Clark, Chamberlain, & Sahakian , 2009; Gradin et al., 2011; Maddox, Gorlick, Worthy, & Beevers, 2012; Murphy et al., 2001; Pizzagalli, Iosifescu, Hallett, Ratner, & Fava, 2008).”
Rethinking post-traumatic stress disorder – A predictive processing perspective
Κube, T., Berg, M., Kleim, B., & Herzog, P. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.014 · Cited by 114
Brown, V. M., Zhu, L., Solway, A., Wang, J. M., McCurry, K. L., King-Casas, B., & Chiu, P. H. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.1844 · Cited by 112
Dowd, E. C., Frank, M. J., Collins, A., Gold, J. M., & Barch, D. M. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.05.005 · Cited by 101
“The lack of significant relationships between anhedonia/ avolition scores and striatal responses specifically to PE differs from some reports in the literature (17,44), although at least one other study did not find such relationships (16) and”
ResultBrain and behavioral correlates of insulin resistance in youth with depression and obesity
Singh, M. K., Leslie, S. M., Packer, M. M., Zaiko, Y. V., Phillips, O. R., Weisman, E. F., Wall, D. M., Jo, B., & Rasgon, N. (2019) · Hormones and Behavior · doi:10.1016/j.yhbeh.2018.03.009 · Cited by 99
Segarra, N., Metastasio, A., Ziauddeen, H., Spencer, J., Reinders, N. R., Dudas, R. B., Arrondo, G., Robbins, T. W., Clark, L., Fletcher, P. C., et al. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2015.370 · Cited by 96
“However, abnormal neural correlates of prediction error associated learning signals may reflect dysfunction of the learning mechanism (e.g. failure to update in response to prediction error signals during learning), not necessarily to the prediction error signalling mechanism per se.”
InfluentialIdentifying Transdiagnostic Mechanisms in Mental Health Using Computational Factor Modeling
Wise, T., Robinson, O. J., & Gillan, C. M. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.09.034 · Cited by 108
“Using functional magnetic resonance imaging, reduced neural Computational Factor Modeling signatures of reward prediction errors were also seen in both depression (42,43) and schizophrenia (42).”
Yip, S. W., Worhunsky, P. D., Xu, J., Morie, K. P., Constable, R. T., Malison, R. T., Carroll, K. M., & Potenza, M. N. (2018) · Addiction Biology · doi:10.1111/adb.12492 · Cited by 103
“In addition to their well-documented roles in emotion regulatory processes (Paulus & Stein 2006; Hartley & Phelps 2010), these regions are critically involved in key aspects of reward processing including incentive salience and prediction-error encoding (Gradin et al. 2011; Paulus & Stewart 2014).”
BackgroundReward Network Modulation as a Mechanism of Change in Behavioral Activation
Nagy, G. A., Cernasov, P., Pisoni, A., Walsh, E. C., Dichter, G. S., & Smoski, M. J. (2018) · Behavior Modification · doi:10.1177/0145445518805682 · Cited by 107
“The NAc is considered a central hub of this frontos-triatal circuit, critical for computing reward value and encoding prediction errors (Gradin et al., 2011).”
BackgroundFunctional neuroimaging in psychiatry and the case for failing better
Nour, M. M., Liu, Y., & Dolan, R. J. (2022) · Neuron · doi:10.1016/j.neuron.2022.07.005 · Cited by 104
Impaired Activation in Cognitive Control Regions Predicts Reversal Learning in Schizophrenia
Culbreth, A. J., Gold, J. M., Cools, R., & Barch, D. M. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv075 · Cited by 92
Deserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 88
Cognitive Control in Depression: Toward Clinical Models Informed by Cognitive Neuroscience
Grahek, I., Everaert, J., Krebs, R. M., & Koster, E. H. W. (2018) · Clinical Psychological Science · doi:10.1177/2167702618758969 · Cited by 101
“For example, one of the proposals which we have described links reward prediction errors and reinforcement learning, known to be altered in depression (Gradin et al., 2011; Kumar et al., 2008; Pizzagalli, 2014), to adaptation of gating policies underlying cognitive control processes.”
BackgroundComputational Neuroscience Approach to Psychiatry: A Review on Theory-driven Approaches
Khaleghi, A., Mohammadi, M. R., Shahi, K., & Nasrabadi, A. M. (2022) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.2022.20.1.26 · Cited by 99
“[54-57]; relapse prediction in alcohol-dependence with conditioned stimulus-related activation in the nucleus accumbens [58]; impulsivity in ADHD with reduced delay”
BackgroundHo, N., & Sommers, M. (2013) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2013.02.001 · Cited by 81
Greenberg, T., Chase, H. W., Almeida, J. R., Stiffler, R., Zevallos, C. R., Aslam, H. A., Deckersbach, T., Weyandt, S., Cooper, C., Toups, M., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050594 · Cited by 93
“Furthermore, while these previous studies reported attenuated prediction error-related ventral striatal reactivity in depressed individuals when using temporal difference (10), or similar (15, 33) modeling approaches, cue-outcome contingency learning was captured by a fixed (10, 15) or individually determined (15, 33)…”
InfluentialDopamine, cognitive biases and assessment of certainty: A neurocognitive model of delusions
Broyd, A., Balzan, R. P., Woodward, T. S., & Allen, P. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.04.006 · Cited by 94
“S Furthermore, the extent of prediction-error disruption in people diagnosed with schizophrenia also seems to be significantly associated with the tendency to form delusions (Corlett et al., 2007; Gradin et al., 2011).”
BackgroundErmakova, A. O., Knolle, F., Justicia, A., Bullmore, E. T., Jones, P. B., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0056-2 · Cited by 91
“Therefore, our findings extend previous findings reporting abnormal reward prediction-error signalling in the midbrain, striatum and cortex in a partly medicated sample of FEP patients (in which results held in a very small unmedicated subsample) [12], in medicated samples of schizophrenia patients [10, 11], and in th…”
BackgroundResultComprehensive review: Computational modelling of schizophrenia
Valton, V., Romaniuk, L., Steele, J. D., Lawrie, S. M., & Seriès, P. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.08.022 · Cited by 91
“Using associative learning and functional magnetic resonance imaging (fMRI), multiple studies have identified strong distortions in the expected reward prediction-error signal of patients (Corlett et al., 2007b; Gradin et al., 2011; Murray et al., 2008; Roiser et al., 2009, 2013).”
InfluentialSelf-citationAnhedonia in Depression and Schizophrenia: Brain Reward and Aversion Circuits
Liang, S., Wu, Y., Hanxiaoran, L., Greenshaw, A. J., & Li, T. (2022) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s367839 · Cited by 93
“105,106 Depression and schizophrenia likely reflect illness-specific neural valuation and incentive salience formation associated with reward and aversion processing.”
InfluentialMotivational Deficits in Schizophrenia and the Representation of Expected Value
Waltz, J. A., & Gold, J. M. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_385 · Cited by 76
“In the MRI study of learning from Gradin et al. (2011), SZ patients were found to show abnormal outcome-related brain responses in the midbrain and caudate.”
BackgroundMethodInfluentialHenco, L., Diaconescu, A. O., Lahnakoski, J. M., Brandi, M.-L., Hörmann, S., Hennings, J., Hasan, A., Papazova, I., Strube, W., Bolis, D., et al. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008162 · Cited by 78
Reward and punishment reversal-learning in major depressive disorder.
Mukherjee, D., Filipowicz, A. L. S., Vo, K. D., Satterthwaite, T. D., & Kable, J. W. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000641 · Cited by 90
Neural substrates underlying effort computation in schizophrenia
Fervaha, G., Foussias, G., Agid, O., & Remington, G. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.09.001 · Cited by 88
Vinckier, F., Gaillard, R., Palminteri, S., Rigoux, L., Salvador, A., Fornito, A., Adapa, R., Krebs, M. O., Pessiglione, M., & Fletcher, P. C. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.73 · Cited by 87
Predictive and Reactive Mechanisms in Smile Reciprocity
Heerey, E. A., & Crossley, H. M. (2013) · Psychological Science · doi:10.1177/0956797612472203 · Cited by 84
“Because healthy social partners find violations of social expectations unpleasant or confusing, such violations may damage social outcomes among, for example, people with neuropsychiatric conditions that interfere with reward-learning processes (Gradin et al., 2011).”
Learning and Choice in Mood Disorders: Searching for the Computational Parameters of Anhedonia
Robinson, O. J., & Chase, H. W. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00009 · Cited by 70
“…studies, particularly by Steele and colleagues (2007), have successfully used these or similar models to describe blood oxygenation level–dependent signal changes in the VS, finding that activation coupled to appetitive PEs is altered in major depression (Gradin et al., 2011; Kumar et al., 2008).”
Scholl, J., & Klein-Flügge, M. C. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.09.050 · Cited by 83
Atypical processing of uncertainty in individuals at risk for psychosis
Cole, D. M., Diaconescu, A. O., Pfeiffer, U. J., Brodersen, K. H., Mathys, C. D., Julkowski, D., Ruhrmann, S., Schilbach, L., Tittgemeyer, M., Vogeley, K., et al. (2020) · NeuroImage: Clinical · doi:10.1016/j.nicl.2020.102239 · Cited by 72
“This is motivated by the putative relation of outcomerelated PEs to phasic DA release and possible involvement in dysfunctional learning in psychosis and schizophrenia (Schultz et al., 1997; Pessiglione et al., 2006; Corlett et al., 2007, 2009a, 2010; Murray et al., 2008; Gradin et al., 2011; Adams et al., 2013; Ermak…”
BackgroundBlunted medial prefrontal cortico-limbic reward-related effective connectivity and depression
Rupprechter, S., Romaniuk, L., Series, P., Hirose, Y., Hawkins, E., Sandu, A.-L., Waiter, G. D., McNeil, C. J., Shen, X., Harris, M. A., et al. (2020) · Brain · doi:10.1093/brain/awaa106 · Cited by 80
“Previous independent clinical studies have reported RPE abnormalities in MDD (Kumar et al., 2008, 2018; Gradin et al., 2011; Dombrovski et al., 2013).”
MethodResultInfluentialSelf-citationAnhedonia in depression and bipolar disorder
Whitton, A. E., & Pizzagalli, D. A. (2022) · Current topics in behavioral neurosciences · doi:10.1007/7854_2022_323 · Cited by 80
“…using computational modeling to quantify expected value and RPEs in MDD have generally reported reduced RPE in the ventral and dorsal striatum (Gradin et al. 2011; Kumar et al. 2008, 2018), ACC (Rupprechter et al. 2020; Ubl et al. 2015) and medial OFC (Rothkirch et al. 2017), although null…”
BackgroundEmotion prediction errors guide socially adaptive behaviour
Heffner, J., Son, J.-Y., & FeldmanHall, O. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01213-6 · Cited by 79
Andreou, C., Moritz, S., Veith, K., Veckenstedt, R., & Naber, D. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt064 · Cited by 72
Bernacer, J., Corlett, P. R., Ramachandra, P., McFarlane, B., Turner, D. C., Clark, L., Robbins, T. W., Fletcher, P. C., & Murray, G. K. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12070978 · Cited by 77
Metadata
- Authors
- Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D.
- Affiliations
- University of Dundee (GB)
- Warneford Hospital (GB)
- University of Aberdeen (GB)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-04-09
- Volume
- 134
- Issue
- 6
- Pages
- 1751-1764
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2144683341
- Cited by
- 485
- References
- 59
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 27 · 2023: 28 · 2022: 47 · 2021: 55 · 2020: 33 · 2019: 22 · 2018: 31 · 2017: 31 · 2016: 43 · 2015: 45 · 2014: 27 · 2013: 36 · 2012: 18
- FWCI
- 13.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Discovery Research Portal (University of Dundee) (submittedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- prediction error, expected value, anhedonia, depression, schizophrenia, dopamine, reinforcement learning, reward valuation, incentive salience, psychotic symptoms, negative symptoms, caudate nucleus, nucleus accumbens, midbrain, insula, parahippocampal gyrus, model-based fMRI
- MeSH terms
- Adult, Antidepressive Agents, Brain, Brain Mapping, Conditioning, Operant, Depression, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Neuropsychological Tests, Oxygen, Predictive Value of Tests, Psychiatric Status Rating Scales, Reinforcement, Psychology, Schizophrenia, Schizophrenic Psychology, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.