Explicit and implicit reinforcement learning across the psychosis spectrum.
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Motivational and hedonic impairments are core features of a variety of types of psychopathology. An important aspect of motivational function is reinforcement learning (RL), including implicit (i.e., outside of conscious awareness) and explicit (i.e., including explicit representations about potential reward associations) learning, as well as both positive reinforcement (learning about actions that lead to reward) and punishment (learning to avoid actions that lead to loss). Here we present data from paradigms designed to assess both positive and negative components of both implicit and explicit RL, examine performance on each of these tasks among individuals with schizophrenia, schizoaffective disorder, and bipolar disorder with psychosis, and examine their relative relationships to specific symptom domains transdiagnostically. None of the diagnostic groups differed significantly from controls on the implicit RL tasks in either bias toward a rewarded response or bias away from a punished response. However, on the explicit RL task, both the individuals with schizophrenia and schizoaffective disorder performed significantly worse than controls, but the individuals with bipolar did not. Worse performance on the explicit RL task, but not the implicit RL task, was related to worse motivation and pleasure symptoms across all diagnostic categories. Performance on explicit RL, but not implicit RL, was related to working memory, which accounted for some of the diagnostic group differences. However, working memory did not account for the relationship of explicit RL to motivation and pleasure symptoms. These findings suggest transdiagnostic relationships across the spectrum of psychotic disorders between motivation and pleasure impairments and explicit RL. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Rating Scale for Mania: Reliability, Validity and Sensitivity
Young, R. C., Biggs, J. T., Ziegler, V. E., & Meyer, D. A. (1978) · British Journal of Psychiatry · doi:10.1192/bjp.133.5.429 · Cited by 8,744
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067
The variable nature of cognitive control: a dual mechanisms framework
Braver, T. S. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.010 · Cited by 2,482 · cited 1×
“By cognitive control, we mean the ability to maintain goal or task representations in working memory in order to guide behavior, focusing attentional resources on task-relevant information while filtering out task-irrelevant information (Braver, 2012; Miller & Cohen, 2001).”
BackgroundComparing correlated correlation coefficients
Meng, X.-L., Rosenthal, R., & Rubin, D. B. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.1.172 · Cited by 2,472 · cited 3×
“In addition, using the formulas from Meng, Rosenthal and Rubin (Meng, Rosenthal, & Rubin, 1992), BPRS Mania was significantly more strongly correlated with average IPILT-P bias than with average IPILT-N bias (Z 2.81, p .05), with a similar trend for YMRS (Z 1.34, p .09).”
MethodInfluentialBy Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
The NIMH Research Domain Criteria (RDoC) Project: Precision Medicine for Psychiatry
Insel, T. R. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14020138 · Cited by 1,472 · cited 1×
“Given the centrality of motivational and hedonic systems to psychopathology, the RDoC initiative (T. Insel et al., 2010; T. R. Insel, 2014) includes a “positive valence” systems domain outlining a number of constructs that may be key to understanding the nature and mechanisms of motivational and…”
BackgroundMultiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · cited 3×
“RL is thought to be mediated by midbrain dopamine (DA) projections to ventral and dorsal regions of the basal ganglia (Berridge, 2004; Schultz, 2007).”
BackgroundFMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879 · cited 1×
“These more explicit forms of RL also engage neural systems involved in cognitive control and value representations, such as dorsal frontal and parietal regions and the OFC (Frank et al., 2001; Frank & O’Reilly, 2006; Gold, Waltz, et al., 2012; Hazy, Frank, & O’Reilly, 2007).”
BackgroundReduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task
Pizzagalli, D. A., Iosifescu, D., Hallett, L. A., Ratner, K. G., & Fava, M. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2008.03.001 · Cited by 780
Self-citationToward an objective characterization of an anhedonic phenotype: A signal-detection approach
Pizzagalli, D. A., Jahn, A. L., & O’Shea, J. P. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.11.026 · Cited by 738
Self-citationThe clinical assessment interview for negative symptoms (CAINS): Final development and validation
Kring, A. M., Gur, R. E., Blanchard, J. J., Horan, W. P., & Reise, S. P. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12010109 · Cited by 726
Self-citationNeural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642
Schultz, W. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.03.017 · Cited by 517
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376
Acute stress reduces reward responsiveness: Implications for depression
Bogdan, R., & Pizzagalli, D. A. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.03.037 · Cited by 364
Self-citationWaltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Self-citationBari, A., Theobald, D. E., Caprioli, D., Mar, A. C., Aidoo-Micah, A., Dalley, J. W., & Robbins, T. W. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.233 · Cited by 325
Neuropsychological evidence for frontostriatal dysfunction in schizophrenia
Elliott, R., McKenna, P. J., Robbins, T. W., & Sahakian, B. J. (1995) · Psychological Medicine · doi:10.1017/s0033291700033523 · Cited by 267
Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011) · Neuropsychology · doi:10.1037/a0020882 · Cited by 132
Self-citationDeficits on a Probabilistic Response-Reversal Task in Patients With Pediatric Bipolar Disorder
Gorrindo, T., Blair, R. J. R., Budhani, S., Dickstein, D. P., Pine, D. S., & Leibenluft, E. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.10.1975 · Cited by 111 · cited 2×
“…Goetz, Ostacher, Iosifescu, & Perlis, 2008) and explicit (Dickstein, Finger, Brotman, et al., 2010; Dickstein, Finger, Skup, et al., 2010; Gorrindo et al., 2005; McKirdy et al., 2009; Murray et al., 2008; Shamay-Tsoory, Harari, Szepsenwol, & Levkovitz, 2009) RL in bipolar disorder (for…”
Impaired probabilistic reversal learning in youths with mood and anxiety disorders
Dickstein, D. P., Finger, E. C., Brotman, M. A., Rich, B. A., Pine, D. S., Blair, J. R., & Leibenluft, E. (2010) · Psychological Medicine · doi:10.1017/s0033291709991462 · Cited by 105
Koch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101 · cited 2×
“…about stimulus-reward contingencies, individuals with schizophrenia show more consistently impaired RL (Cicero, Martin, Becker, & Kerns, 2014; Gold, Waltz, et al., 2012; Koch et al., 2010; Morris, Heerey, Gold, & Holroyd, 2008; Waltz, Frank, Robinson, & Gold, 2007; Yilmaz, Simsek, & Gonul, 2012).”
BackgroundGeneral functioning predicts reward and punishment learning in schizophrenia
Somlai, Z., Moustafa, A. A., Kéri, S., Myers, C. E., & Gluck, M. A. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.028 · Cited by 45 · cited 2×
“…in schizophrenia are correlated with motivation/pleasure negative symptoms (Farkas et al., 2008; Murray et al., 2008; Polgar et al., 2008; Somlai et al., 2011; Strauss et al., 2011; Waltz, Frank, Wiecki, & Gold, 2011) and that negative symptoms more broadly are related to positive as…”
BackgroundPerturbed reward processing in pediatric bipolar disorder: an antisaccade study
Mueller, S. C., Ng, P., Temple, V., Hardin, M. G., Pine, D. S., Leibenluft, E., & Ernst, M. (2010) · Journal of Psychopharmacology · doi:10.1177/0269881109353462 · Cited by 42 · cited 2×
“, 2010), a number of studies suggest impairments in both implicit (Mueller et al., 2010; Pizzagalli, Goetz, Ostacher, Iosifescu, & Perlis, 2008) and explicit (Dickstein, Finger, Brotman, et al.”
Background
Cited by
Reward-driven decision-making impairments in schizophrenia
Saperia, S., Da Silva, S., Siddiqui, I., Agid, O., Daskalakis, Z. J., Ravindran, A., Voineskos, A. N., Zakzanis, K. K., Remington, G., & Foussias, G. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2018.11.004 · Cited by 41
Translational Assessments of Reward and Anhedonia: A Tribute to Athina Markou
Der-Avakian, A., & Pizzagalli, D. A. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.02.008 · Cited by 36
Self-citationPushkarskaya, H., Sobowale, K., Henick, D., Tolin, D. F., Anticevic, A., Pearlson, G. D., Levy, I., Harpaz-Rotem, I., & Pittenger, C. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.11.029 · Cited by 30
Moran, E. K., Culbreth, A. J., & Barch, D. M. (2022) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2022_321 · Cited by 30
Self-citationWhitton, A. E., Lewandowski, K. E., & Hall, M.-H. (2021) · Brain Sciences · doi:10.3390/brainsci11121581 · Cited by 4
Metadata
- Authors
- Barch, D. M., Carter, C. S., Gold, J. M., Johnson, S. L., Kring, A. M., MacDonald, A. W., Pizzagalli, D. A., Ragland, J. D., Silverstein, S. M., & Strauss, M. E.
- Venue
- Journal of Abnormal Psychology
- Published
- 2017-07
- Volume
- 126
- Issue
- 5
- Pages
- 694-711
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- OpenAlex
- W2606898583
- Cited by
- 94
- References
- 29
- FWCI
- 7.77
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.