Expected value and prediction error abnormalities in depression and schizophrenia
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
The dopamine system has been linked to anhedonia in depression and both the positive and negative symptoms of schizophrenia, but it remains unclear how dopamine dysfunction could mechanistically relate to observed symptoms. There is considerable evidence that phasic dopamine signals encode prediction error (differences between expected and actual outcomes), with reinforcement learning theories being based on prediction error-mediated learning of associations. It has been hypothesized that abnormal encoding of neural prediction error signals could underlie anhedonia in depression and negative symptoms in schizophrenia by disrupting learning and blunting the salience of rewarding events, and contribute to psychotic symptoms by promoting aberrant perceptions and the formation of delusions. To test this, we used model based functional magnetic resonance imaging and an instrumental reward-learning task to investigate the neural correlates of prediction errors and expected-reward values in patients with depression (n=15), patients with schizophrenia (n=14) and healthy controls (n=17). Both patient groups exhibited abnormalities in neural prediction errors, but the spatial pattern of abnormality differed, with the degree of abnormality correlating with syndrome severity. Specifically, reduced prediction errors in the striatum and midbrain were found in depression, with the extent of signal reduction in the bilateral caudate, nucleus accumbens and midbrain correlating with increased anhedonia severity. In schizophrenia, reduced prediction error signals were observed in the caudate, thalamus, insula and amygdala-hippocampal complex, with a trend for reduced prediction errors in the midbrain, and the degree of blunting in the encoding of prediction errors in the insula, amygdala-hippocampal complex and midbrain correlating with increased severity of psychotic symptoms. Schizophrenia was also associated with disruption in the encoding of expected-reward values in the bilateral amygdala-hippocampal complex and parahippocampal gyrus, with the degree of disruption correlating with psychotic symptom severity. Neural signal abnormalities did not correlate with negative symptom severity in schizophrenia. These findings support the suggestion that a disruption in the encoding of prediction error signals contributes to anhedonia symptoms in depression. In schizophrenia, the findings support the postulate of an abnormality in error-dependent updating of inferences and beliefs driving psychotic symptoms. Phasic dopamine abnormalities in depression and schizophrenia are suggested by our observation of prediction error abnormalities in dopamine-rich brain areas, given the evidence for dopamine encoding prediction errors. The findings are consistent with proposals that psychiatric syndromes reflect different disorders of neural valuation and incentive salience formation, which helps bridge the gap between biological and phenomenological levels of understanding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, depressed patients exhibit both hyposensitivity to rewards and oversensitivity to punishments 96,97 , attributed to alterations in mesolimbic prediction error signaling 97-99 , and may exhibit a constrained option space ('tunnel vision') during decision-making 100 .”
From Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model (2020) · cites this paper as [98]
In the citing paper
“These studies have generally linked MDD to blunted RPE in the ventral and dorsal striatum [122-124] (but see [125,126] for important lack of replication), pgACC [127] and medial OFC [126], and greater RPE in the ventral striatum predicted reductions in anhedonia 6 months later [128].”
From Prefrontal cortex and depression (2022) · cites this paper as [124]
In the citing paper
“Dopamine signaling to the basal ganglia, including the nucleus accumbens, also plays a role in what is known as the reward prediction error, a subconstruct of approach motivation.”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“The reward prediction error, in which changes in dopamine firing encode differences between an expected vs. actual reward outcome, allows for dynamic learning from experience and updates in reward expectations (Gradin et al., 2011; Schultz, 2016).”
From The effects of early life stress on reward processing (2018) · cites this paper as Gradin et al., 2011
In the citing paper
“Several studies showed a disruption of striatal activity during reward learning, prediction-error encoding, and rewarding outcomes (Table 1) (Kumar et al., 2008; Gradin et al., 2011; Robinson et al., 2012).”
From Circuit Mechanisms of Reward, Anhedonia, and Depression (2019) · cites this paper as Gradin et al., 2011
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“All subjects completed the Beck depression inventory (Beck et al., 1961) and Spielberger State Anxiety scale (Spielberger, 1983).”
MethodHamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 2×
“Patients with major depressive disorder were assessed with the 21-item Hamilton depression rating scale (Hamilton, 1960) and patients with schizophrenia were assessed with the Positive and Negative Syndrome Scale (Kay et al.”
MethodThe Positive and Negative Syndrome Scale (PANSS) for schizophrenia.
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987) · Schizophrenia Bulletin · doi:10.1093/schbul/13.2.261 · Cited by 21,378 · cited 3×
“1C) measured using relevant subscales of the Positive and Negative Syndrome Scale.”
MethodA neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · cited 1×
“Since dopamine has been hypothesized to be the neural substrate of prediction errors in dopamine-rich brain areas (Montague et al., 1996; Schultz et al., 1997; Dayan and Abbott, 2001; Tobler et al., 2006), our findings give strong support to the hypothesis of abnormal dopamine-mediated prediction…”
ResultHow do you feel — now? The anterior insula and human awareness
(Bud) Craig, A. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2555 · Cited by 6,657 · cited 1×
“Furthermore, the insula has also been linked to the feeling of 'agency' (self-generation) during motor activity (Craig, 2009).”
BackgroundPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813 · cited 6×
“Furthermore, all effective anti-psychotic medications block D 2 receptors (Kapur, 2003).”
BackgroundResultInfluentialThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347 · cited 2×
“…reduced dopamine function and major depressive disorder has long been proposed (Dunlop and Nemeroff, 2007), but it is important to note that our current study specifically investigated prediction errors that have been linked to salience (Berridge, 2007) and potentially, therefore, anhedonia.”
BackgroundDissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“This is consistent with previous work comparing Pavlovian and instrumental paradigm patterns of neural activity, in healthy subjects (O’Doherty et al., 2004).”
ResultA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 3×
“…modulation of neuronal plasticity (Berke and Hyman, 2000; Andrzejewski et al., 2005; Dalley et al., 2005), it has been proposed that dopamine neuronal firing acts as a teaching signal, mediating the learning of stimulus–outcomes and stimulus–response–outcome associations (Montague et al., 1996).”
BackgroundResult(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Frackowiak, R. S. J. (1997) · Cited by 1,795
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · cited 5×
“As in previous studies (Pessiglione et al., 2006; Murray et al., 2007), a single set of parameters was fitted across all groups and subjects since it has been noticed that multi-subject functional MRI results are more robust if a single set of parameters is used to generate regressors for all subjects (Daw, 2009).”
BackgroundMethodResultInfluentialTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia
Fletcher, P. C., & Frith, C. D. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2536 · Cited by 1,462 · cited 2×
“More recently, Fletcher and Frith (2009) have proposed a broader theory linking prediction errors and psychosis that postulates that a disturbance in error-dependent updating of inferences and beliefs about the world underlies psychotic symptoms.”
BackgroundResultThe role of dopamine in the pathophysiology of depression
Dunlop, B. W., & Nemeroff, C. B. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.327 · Cited by 1,244 · cited 5×
“A link between reduced dopamine function and major depressive disorder has long been proposed (Dunlop and Nemeroff, 2007), but it is important to note that our current study specifically investigated prediction errors that have been linked to salience (Berridge, 2007) and potentially, therefore,…”
BackgroundInfluentialPizzagalli, D. A., Holmes, A. J., Dillon, D. G., Goetz, E. L., Birk, J. L., Bogdan, R., Dougherty, D. D., Iosifescu, D. V., Rauch, S. L., & Fava, M. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08081201 · Cited by 1,232 · cited 7×
“Consistent with previous work (Huys, 2009; Pizzagalli et al., 2009), anhedonia was investigated using a Beck depression inventory derived anhedonia subscore (questions 4, loss of pleasure; 12, loss of interest; 15, loss of energy; 21, loss of libido).”
BackgroundMethodResultInfluentialAddiction, Dopamine, and the Molecular Mechanisms of Memory
Berke, J. D., & Hyman, S. E. (2000) · Neuron · doi:10.1016/s0896-6273(00)81056-9 · Cited by 1,181
Encoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165 · cited 1×
“Neural correlates of expected-reward value have been found in the amygdala (Gottfried et al., 2003; Hampton et al., 2006) and amygdala–hippocampal complex (Glascher et al., 2009).”
BackgroundTemporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · cited 2×
“…between expected and actual outcome) is used for improving predictions of future reward, such that, in the long term, expectations converge to actual outcomes with a minimization of prediction error, and for biasing action selection so long-term future reward is maximized (McClure et al., 2003a).”
BackgroundMethodHuman insula activation reflects risk prediction errors as well as risk
Preuschoff, K., Quartz, S. R., & Bossaerts, P. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4286-07.2008 · Cited by 784 · cited 1×
“In gambling tasks, insula activation has been reported to reflect risk prediction and risk prediction error (Preuschoff et al., 2008).”
BackgroundReduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780
Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes
Slotnick, S. D., Moo, L. R., Segal, J. B., & Hart, J. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00082-x · Cited by 654 · cited 1×
“In order to correct for multiple comparisons, a cluster extent threshold determined by Monte Carlo simulations was applied (Slotnick et al., 2003).”
MethodThe Neural Correlates of Anhedonia in Major Depressive Disorder
Keedwell, P. A., Andrew, C., Williams, S. C. R., Brammer, M. J., & Phillips, M. L. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.05.019 · Cited by 650 · cited 1×
“In major depressive disorder, various functional MRI studies have investigated the functioning of the reward system, with most reporting abnormalities of the basal ganglia (Elliott et al., 1998; Keedwell et al., 2005; Epstein et al., 2006; Steele et al., 2007; Pizzagalli et al., 2009).”
BackgroundO'Doherty, J., Critchley, H., Deichmann, R., & Dolan, R. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-21-07931.2003 · Cited by 611
Dysfunction of ventral striatal reward prediction in schizophrenia
Juckel, G., Schlagenhauf, F., Koslowski, M., Wüstenberg, T., Villringer, A., Knutson, B., Wrase, J., & Heinz, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.051 · Cited by 578 · cited 7×
“…in the encoding of prediction errors could result in dysfunctional learning and/or a reduced attribution of salience to rewarding events, which in turn could explain anhedonia symptoms in major depressive disorder and negative symptoms in schizophrenia (Juckel et al., 2006b; Kumar et al., 2008).”
BackgroundInfluentialSubstantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · cited 5×
“In another study (Murray et al., 2007), patients with psychosis exhibited attenuated and augmented prediction errors on reward and neutral trials, respectively, in the midbrain.”
BackgroundResultInfluentialOlshausen, B. A. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321107891 · Cited by 499
Hampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498 · cited 1×
“Neural correlates of expected-reward value have been found in the amygdala (Gottfried et al., 2003; Hampton et al., 2006) and amygdala–hippocampal complex (Glascher et al., 2009).”
BackgroundLack of Ventral Striatal Response to Positive Stimuli in Depressed Versus Normal Subjects
Epstein, J., Pan, H., Kocsis, J. H., Yang, Y., Butler, T., Chusid, J., Hochberg, H., Murrough, J., Strohmayer, E., Stern, E., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.10.1784 · Cited by 464 · cited 1×
“In major depressive disorder, various functional MRI studies have investigated the functioning of the reward system, with most reporting abnormalities of the basal ganglia (Elliott et al., 1998; Keedwell et al., 2005; Epstein et al., 2006; Steele et al., 2007; Pizzagalli et al., 2009).”
BackgroundDisrupted prediction-error signal in psychosis: Evidence for an associative account of delusions
Corlett, P. R., Murray, G. K., Honey, G. D., Aitken, M. R. F., Shanks, D. R., Robbins, T. W., Bullmore, E. T., Dickinson, A., & Fletcher, P. C. (2007) · Brain · doi:10.1093/brain/awm173 · Cited by 460 · cited 3×
“…signals may occur in major depressive disorder (Dunlop and Nemeroff, 2007), it has been hypothesized that increased noise corruption in the dopamine system in schizophrenia could interfere with normal phasic responses to events (Juckel et al., 2006b; Corlett et al., 2007; Roiser et al., 2009).”
BackgroundResultTrial-by-trial data analysis using computational models
Daw, N. D. (2011) · Decision Making, Affect, and Learning · doi:10.1093/acprof:oso/9780199600434.003.0001 · Cited by 456
Kim, H., Shimojo, S., & O'Doherty, J. P. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040233 · Cited by 453 · cited 2×
“Our reported pattern of positive and negative correlations with expected-reward value in controls is similar to previous reports (Kim et al., 2006; Glascher et al., 2009 ).”
BackgroundResultOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · cited 3×
“…(O'Doherty et al., 2003b, 2004; Pessiglione et al., 2006; Glascher et al., 2009), orbito-frontal cortex (O'Doherty et al., 2003b), amygdala (Seymour et al., 2005; Kumar et al., 2008) and midbrain (Murray et al., 2007) plus in non-dopamine rich regions such as the insula (Seymour et al.,…”
BackgroundMethodA computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Read Montague, P. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 422 · cited 2×
“…between expected and actual outcome) is used for improving predictions of future reward, such that, in the long term, expectations converge to actual outcomes with a minimization of prediction error, and for biasing action selection so long-term future reward is maximized (McClure et al., 2003a).”
BackgroundMethodGläscher, J., Hampton, A. N., & O'Doherty, J. P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn098 · Cited by 387 · cited 3×
“…decision-making paradigms, in dopamine-rich brain regions such as the striatum (O'Doherty et al., 2003b, 2004; Pessiglione et al., 2006; Glascher et al., 2009), orbito-frontal cortex (O'Doherty et al., 2003b), amygdala (Seymour et al., 2005; Kumar et al., 2008) and midbrain (Murray et…”
BackgroundResultAbnormal temporal difference reward-learning signals in major depression
Kumar, P., Waiter, G., Ahearn, T., Milders, M., Reid, I., & Steele, J. D. (2008) · Brain · doi:10.1093/brain/awn136 · Cited by 374 · cited 10×
“…in the encoding of prediction errors could result in dysfunctional learning and/or a reduced attribution of salience to rewarding events, which in turn could explain anhedonia symptoms in major depressive disorder and negative symptoms in schizophrenia (Juckel et al., 2006b; Kumar et al., 2008).”
BackgroundMethodResultInfluentialSelf-citationNeurobiology of Dopamine in Schizophrenia
Guillin, O., Abi‐Dargham, A., & Laruelle, M. (2007) · International Review of Neurobiology · doi:10.1016/s0074-7742(06)78001-1 · Cited by 365 · cited 1×
“'Negative' symptoms of schizophrenia (e.g. affective flattening , apathy, social withdrawal) have also been linked to abnormalities in the dopamine system, with a similar rationale to that of anhedonia in depression (Juckel et al., 2006b; Guillin et al., 2007).”
BackgroundJuckel, G., Schlagenhauf, F., Koslowski, M., Filonov, D., Wüstenberg, T., Villringer, A., Knutson, B., Kienast, T., Gallinat, J., Wrase, J., et al. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0405-4 · Cited by 323 · cited 7×
“…in the encoding of prediction errors could result in dysfunctional learning and/or a reduced attribution of salience to rewarding events, which in turn could explain anhedonia symptoms in major depressive disorder and negative symptoms in schizophrenia (Juckel et al., 2006b; Kumar et al., 2008).”
BackgroundInfluentialDo patients with schizophrenia exhibit aberrant salience?
Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Barnes, T. R. E., Friston, K. J., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708003863 · Cited by 262 · cited 4×
“While truly diminished dopamine phasic signals may occur in major depressive disorder (Dunlop and Nemeroff, 2007), it has been hypothesized that increased noise corruption in the dopamine system in schizophrenia could interfere with normal phasic responses to events (Juckel et al., 2006b; Corlett et al., 2007; Roiser…”
BackgroundInfluentialBlunted response to feedback information in depressive illness
Steele, J. D., Kumar, P., & Ebmeier, K. P. (2007) · Brain · doi:10.1093/brain/awm150 · Cited by 261 · cited 2×
“These striatal findings are consistent with previous studies (Elliott et al., 1998; Steele et al., 2007; Kumar et al., 2008; Pizzagalli et al., 2009), suggesting dysfunction of the striatum when processing rewarding events.”
BackgroundResultSelf-citationDalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214 · cited 1×
“…plus molecular biology studies of the mechanisms of dopamine modulation of neuronal plasticity (Berke and Hyman, 2000; Andrzejewski et al., 2005; Dalley et al., 2005), it has been proposed that dopamine neuronal firing acts as a teaching signal, mediating the learning of stimulus–outcomes and…”
BackgroundHuman neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209 · cited 2×
“…model we used does reflect dopamine activity in dopamine-rich brain areas (Schultz, 1998; Dayan and Abbott, 2001; McClure et al., 2003b; Pessiglione et al., 2006; Tobler et al., 2006), it is possible that other neuronal systems contributed to the observed reward related brain activity.”
MethodResultWaltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186 · cited 5×
“The insular cortex has been implicated in the encoding of prediction errors (Seymour et al., 2005; Waltz et al., 2009) and decision making (O’Doherty et al., 2003a).”
BackgroundMethodResultInfluentialTakahashi, A. (1998) · International Clinical Psychopharmacology · doi:10.1097/00004850-199801000-00048 · Cited by 183
Amphetamine modulates human incentive processing
Knutson, B., Bjork, J. M., Fong, G. W., Hommer, D., Mattay, V. S., & Weinberger, D. R. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.030 · Cited by 174 · cited 1×
“This is consistent with an functional MRI study (Knutson et al., 2004) which reported that amphetamine administration blunted ventral striatal responses to reward-indicating cues.”
ResultELLIOTT, R., SAHAKIAN, B. J., MICHAEL, A., PAYKEL, E. S., & DOLAN, R. J. (1998) · Psychological Medicine · doi:10.1017/s0033291798006709 · Cited by 168 · cited 2×
“These striatal findings are consistent with previous studies (Elliott et al., 1998; Steele et al., 2007; Kumar et al., 2008; Pizzagalli et al., 2009), suggesting dysfunction of the striatum when processing rewarding events.”
BackgroundResultStimulant Psychosis: Symptom Profile and Acute Clinical Course
Harris, D. S., & Batki, S. L. (2000) · American Journal on Addictions · doi:10.1080/10550490050172209 · Cited by 154 · cited 1×
“…linked to a putative dopamine disturbance since repeated administration of stimulant drugs that release dopamine can elicit psychotic symptoms in healthy subjects (Harris and Batki, 2000) and markedly worsen pre-existing psychotic symptoms in patients with schizophrenia (Frith and Johnstone, 2003).”
BackgroundSchizophrenia: A Very Short Introduction
Frith, C., & Johnstone, E. C. (2003) · Oxford University Press eBooks · doi:10.1093/actrade/9780192802217.001.0001 · Cited by 139
Midbrain activation during pavlovian conditioning and delusional symptoms in schizophrenia
Romaniuk, L., Honey, G. D., King, J. R. L., Whalley, H. C., McIntosh, A. M., Levita, L., Hughes, M., Johnstone, E. C., Day, M., Lawrie, S. M., et al. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.169 · Cited by 113 · cited 2×
“They obtained significantly less water delivery than controls, which is consistent with previous studies indicating impairments in reinforcement learning in schizophrenia (Hall et al., 2009; Koch et al., 2010; Romaniuk et al., 2010 ).”
ResultSelf-citationKoch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101 · cited 1×
“They obtained significantly less water delivery than controls, which is consistent with previous studies indicating impairments in reinforcement learning in schizophrenia (Hall et al., 2009; Koch et al., 2010; Romaniuk et al., 2010).”
ResultSchizophrenia: A Very Short Introduction
Frith, C., & Johnstone, E. C. (2003) · UCL Discovery (University College London) · Cited by 83
Niv, Y., Daw, N. D., & Dayan, P. (2006) · Nature Neuroscience · doi:10.1038/nn0806-987 · Cited by 82 · cited 1×
“We used a one-step state action reward state action (SARSA) temporal difference model (Sutton and Barto, 1998), since actual dopamine firing seems most consistent with SARSA than alternative temporal difference models such as 'actor-critic' or 'Q learning' (Niv et al., 2006).”
MethodInstrumental learning, but not performance, requires dopamine D1-receptor activation in the amygdala
Andrzejewski, M. E., Spencer, R. C., & Kelley, A. E. (2005) · Neuroscience · doi:10.1016/j.neuroscience.2005.06.038 · Cited by 69 · cited 1×
“…prediction error signals, plus molecular biology studies of the mechanisms of dopamine modulation of neuronal plasticity (Berke and Hyman, 2000; Andrzejewski et al., 2005; Dalley et al., 2005), it has been proposed that dopamine neuronal firing acts as a teaching signal, mediating the learning…”
BackgroundAssociative learning and the genetics of schizophrenia
Hall, J., Romaniuk, L., McIntosh, A. M., Steele, J. D., Johnstone, E. C., & Lawrie, S. M. (2009) · Trends in Neurosciences · doi:10.1016/j.tins.2009.01.011 · Cited by 47 · cited 2×
“They obtained significantly less water delivery than controls, which is consistent with previous studies indicating impairments in reinforcement learning in schizophrenia (Hall et al., 2009; Koch et al., 2010; Romaniuk et al., 2010 ).”
ResultSelf-citationPoole, D. L., & Mackworth, A. K. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009258227.018 · Cited by 24
P: Psychiatry: Insights into depression through normative decision-making models
Huys, Q. J. M., Vogelstein, J. T., & Dayan, P. (2009) · UCL Discovery (University College London) · Cited by 22
Research works printed but not linked: 4
- Dayan, 2001, Theoretical neuroscience: computational and mathematical modelling of neural systems Cambridge, MA: The MIT Press
- Friston, 2004, Introduction to statistical parametric mapping
- Sims, 2005, Symptoms in the mind
- Spielberger, 1983, State-trait anxiety inventory for adults, STAI Form Y-1
Cited by
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model
Price, R. B., & Duman, R. (2020) · Molecular Psychiatry · doi:10.1038/s41380-019-0615-x · Cited by 739
Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028813 · Cited by 733
“Prior studies have found associations between depression and sensitivity to reward probability (Forbes, Shaw, & Dahl, 2007; Gradin et al., 2011; Pizzagalli, Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M., 2008).”
Prefrontal cortex and depression
Pizzagalli, D. A., & Roberts, A. C. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01101-7 · Cited by 667
Assessing anhedonia in depression: potentials and pitfalls
Rizvi, S. J., Pizzagalli, D. A., Sproule, B. A., & Kennedy, S. H. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.004 · Cited by 571
“…Error - Reward expectation - Reward association learning - Feedback integration Money, water Kumar et al, 2008 Forbes et al, 2009 Cohen et al, 2009 Gradin et al, 2011 Chase et al, 2013 Probabilistic Reversal Learning - Feedback integration Money Murphy et al, 2003 Taylor Tavares et al, 2008…”
BackgroundMethodResultInfluential
Metadata
- Authors
- Gradin, V. B., Kumar, P., Waiter, G., Ahearn, T., Stickle, C., Milders, M., Reid, I., Hall, J., & Steele, J. D.
- Affiliations
- University of Dundee (GB)
- Warneford Hospital (GB)
- University of Aberdeen (GB)
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-04-09
- Volume
- 134
- Issue
- 6
- Pages
- 1751-1764
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2144683341
- Cited by
- 485
- References
- 59
- Citations by year
- 2026: 12 · 2025: 25 · 2024: 27 · 2023: 28 · 2022: 47 · 2021: 55 · 2020: 33 · 2019: 22 · 2018: 31 · 2017: 31 · 2016: 43 · 2015: 45 · 2014: 27 · 2013: 36 · 2012: 18
- FWCI
- 13.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Discovery Research Portal (University of Dundee) (submittedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Keywords
- prediction error, expected value, anhedonia, depression, schizophrenia, dopamine, reinforcement learning, reward valuation, incentive salience, psychotic symptoms, negative symptoms, caudate nucleus, nucleus accumbens, midbrain, insula, parahippocampal gyrus, model-based fMRI
- MeSH terms
- Adult, Antidepressive Agents, Brain, Brain Mapping, Conditioning, Operant, Depression, Female, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Middle Aged, Neuropsychological Tests, Oxygen, Predictive Value of Tests, Psychiatric Status Rating Scales, Reinforcement, Psychology, Schizophrenia, Schizophrenic Psychology, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.