The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia
Open accessAbstract
Previous research has shown that patients with schizophrenia are impaired in reinforcement learning tasks. However, behavioral learning curves in such tasks originate from the interaction of multiple neural processes, including the basal ganglia- and dopamine-dependent reinforcement learning (RL) system, but also prefrontal cortex-dependent cognitive strategies involving working memory (WM). Thus, it is unclear which specific system induces impairments in schizophrenia. We recently developed a task and computational model allowing us to separately assess the roles of RL (slow, cumulative learning) mechanisms versus WM (fast but capacity-limited) mechanisms in healthy adult human subjects. Here, we used this task to assess patients' specific sources of impairments in learning. In 15 separate blocks, subjects learned to pick one of three actions for stimuli. The number of stimuli to learn in each block varied from two to six, allowing us to separate influences of capacity-limited WM from the incremental RL system. As expected, both patients (n= 49) and healthy controls (n= 36) showed effects of set size and delay between stimulus repetitions, confirming the presence of working memory effects. Patients performed significantly worse than controls overall, but computational model fits and behavioral analyses indicate that these deficits could be entirely accounted for by changes in WM parameters (capacity and reliability), whereas RL processes were spared. These results suggest that the working memory system contributes strongly to learning impairments in schizophrenia.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Brief Psychiatric Rating Scale.
Overall, J. E., & Gorham, D. R. (1962) · Psychological Reports · doi:10.2466/pr0.1962.10.3.799 · Cited by 11,090
A capacity theory of comprehension: individual differences in working memory
Just, M. A., & Carpenter, P. A. (1992) · Psychological Review · doi:10.1037/0033-295x.99.1.122 · Cited by 4,153 · cited 1×
“Indeed, one reason working memory has been such a focus of the schizophrenia literature is that it is a critical resource for many other aspects of cognition, ranging from fluid reasoning to language comprehension (Just and Carpenter, 1992; Johnson et al., 2013).”
The Dopamine Hypothesis of Schizophrenia: Version III--The Final Common Pathway
Howes, O. D., & Kapur, S. (2009) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp006 · Cited by 2,693 · cited 2×
“…dopamine (Abi-Dargham et al., 1998; Howes et al., 2012), has led to a renewed focus on the role of reward-related dopaminergic mechanisms in both the positive and negative symptoms of schizophrenia (Kapur et al., 2005; Howes and Kapur, 2009; Ziauddeen and Murray, 2010; Deserno et al., 2013).”
BackgroundBayesian model selection for group studies
Stephan, K. E., Penny, W. D., Daunizeau, J., Moran, R. J., & Friston, K. J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.03.025 · Cited by 1,423
Gogos, J. A., Morgan, M., Luine, V., Santha, M., Ogawa, S., Pfaff, D., & Karayiorgou, M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.17.9991 · Cited by 864 · cited 1×
“Conversely, WM capacity estimates were related to COMT, a gene that preferentially affects prefrontal function (Gogos et al., 1998; Huotari et al., 2002; Matsumoto et al., 2003; Frank et al., 2007; Slifstein et al., 2008).”
BackgroundDecision theory, reinforcement learning, and the brain
Dayan, P., & Daw, N. D. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.4.429 · Cited by 580
Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making
Collins, A., & Koechlin, E. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001293 · Cited by 558 · cited 2×
“where U is the uniform random policy (U(a) 1/nA, nA 3) and the parameter 0 1 controls the amount of noise (Collins and Koechlin, 2012; Guitart-Masip et al., 2012; Collins and Frank, 2013).”
BackgroundSelf-citationSubstantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · cited 3×
“Our basic behavioral result that patients are overall less able than controls to use feedback to guide optimal response selection is consistent with many other reports in the literature (Waltz and Gold, 2007; Polli et al., 2008; Murray et al., 2008b; Somlai et al., 2011).”
BackgroundResultFrom dopamine to salience to psychosis—Linking biology, pharmacology and phenomenology of psychosis
Kapur, S., Mizrahi, R., & Li, M. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.01.003 · Cited by 512
Cognitive control over learning: Creating, clustering, and generalizing task-set structure.
Collins, A. G. E., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0030852 · Cited by 426 · cited 2×
“where U is the uniform random policy (U(a) 1/nA, nA 3) and the parameter 0 1 controls the amount of noise (Collins and Koechlin, 2012; Guitart-Masip et al., 2012; Collins and Frank, 2013).”
BackgroundSelf-citationWaltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Self-citationStriatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253 · cited 1×
“…(RL; Gold et al., 2008; Deserno et al., 2013) paradigms, including the Iowa Gambling Task (Shurman et al., 2005), the Wisconsin Card Sorting Test (Prentice et al., 2008), probabilistic reinforcement, and reversal learning (Waltz and Gold, 2007; Waltz et al., 2007, 2011; Schlagenhauf et al., 2013).”
MethodWaltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Jo Salmeron, B., Rose, E. J., McClure, S. M., & Stein, E. A. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.214 · Cited by 186
Self-citationWaltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011) · Neuropsychology · doi:10.1037/a0020882 · Cited by 132
Self-citationKoch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichenbach, J. R., Sauer, H., & Schlösser, R. G. M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.031 · Cited by 101 · cited 1×
“…evidence suggesting abnormalities in the signaling of prediction errors in both cortical (Corlett et al., 2007) and striatal (Murray et al., 2008a; Koch et al., 2010) regions and abnormal striatal dopamine (Abi-Dargham et al., 1998; Howes et al., 2012), has led to a renewed focus on the role of…”
BackgroundGeneral functioning predicts reward and punishment learning in schizophrenia
Somlai, Z., Moustafa, A. A., Kéri, S., Myers, C. E., & Gluck, M. A. (2011) · Schizophrenia Research · doi:10.1016/j.schres.2010.07.028 · Cited by 45
Cited by
Ten simple rules for the computational modeling of behavioral data
Wilson, R. C., & Collins, A. G. (2019) · eLife · doi:10.7554/elife.49547 · Cited by 710
Self-citationNeuroscience of apathy and anhedonia: a transdiagnostic approach
Husain, M., & Roiser, J. P. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0029-9 · Cited by 640
Reinforcement learning and episodic memory in humans and animals: an integrative framework
Gershman, S. J., & Daw, N. D. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033625 · Cited by 446
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
“Indeed, schizophrenia patients overgeneralize (139), and some of their reinforcement-learning deficits may be due to working-memory disturbances (140).”
Computational psychiatry: towards a mathematically informed understanding of mental illness
Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2015-310737 · Cited by 285
“104 Figure 2 Effects of a hierarchical precision imbalance in schizophrenia.”
Background
Metadata
- Authors
- Collins, A. G. E., Brown, J. K., Gold, J. M., Waltz, J. A., & Frank, M. J.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2014-10-08
- Volume
- 34
- Issue
- 41
- Pages
- 13747-13756
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2014767017
- Cited by
- 212
- References
- 16
- FWCI
- 11.45
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.