Schizophrenia: A Computational Reinforcement Learning Perspective
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
As one of the most complex neurocognitive disorders, schizophrenia (SZ) is a devastating condition for which the underlying sources are far from being fully understood. Indeed, it is likely that there are multiple etiologies to the disease and heterogeneity within the population. Moreover, it is impossible to understand from a purely mechanistic basis how a patient would come to believe so strongly in delusions as to, for example, gouge out his own eyes. Nevertheless, science marches forward, and the last 30 years or so have produced a wealth of knowledge regarding some of the risk factors, genetics, pharmacology, cognitive deficits, and underlying neurobiology associated with the disease.1–4 In part because of the efficacy of antipsychotic treatments via dopamine D2 receptor blockade,5 the majority of this research focuses on dysfunctions of the dopaminergic system, in both frontal cortex and basal ganglia, thought to be related to negative and positive symptoms, respectively.6 At the neurocognitive level, much of the focus has been on dysfunction within dorsolateral prefrontal cortical circuits and their contributions to working memory, cognitive control, and attentional shifting.7,8 While dopamine plays a critical role in all these processes, it is perhaps more centrally related to aspects of motivational processing, which is surprisingly understudied in SZ.9,10 Indeed, it is possible to account for many of the frontal-dependent cognitive deficits in SZ by positing a more core deficit in the motivational “gating” system for determining which information patients should “care” about and what they might ignore.11 Given the complexity of neural circuits involved in both cognitive and motivational functions, it becomes dauntingly difficult to capture the possible interactions of these circuits, and particularly how they are disrupted in SZ, with simple verbal depictions and static anatomical diagrams. Here I consider the potential application of computational neural network models as a principled and dynamic tool for exploring these interactions and psychopathology associated with dopaminergic dysfunction in SZ and which can lead to new testable predictions at both the neural and behavioral levels. These models enable one to simulate various anatomical and physiological pieces of data, using mathematical equations that capture how groups of neurons communicate activity to other neurons within and between brain areas. By incorporating aspects of neuronal physiology, connectivity, and synaptic plasticity within the basal ganglia–frontal cortical system, one can examine dynamics of this circuitry and how it may go awry. At the same time, it is not tractable to try to incorporate every known biological detail into a model, particularly when the goal is to discover how an entire system of brain regions interact to produce behavior. Thus, the models are also constrained by the need to account for existing data at these higher levels, such as effects of focal lesions or pharmacological manipulation on behavior. Critically, the models make new predictions about how the system works that would likely not have emerged otherwise and often were not conceived by the modeler prior to being built. Models can then be tested and refined and their implications explored in neurological conditions.12 To sum up a large body of basic research, models of frontostriatal function have generally suggested that these circuits support the following—(1) action selection: as in when making a choice among multiple competing alternatives and (2) reinforcement learning: as in modifying expectations and behavior following positive and negative outcomes.13–19 For the former process, “actions” to be selected include both lower level motor programs, consistent with the traditionally ascribed role of the basal ganglia in motor control, and higher level cognitive actions, such as when and when not to update/manipulate the contents of working memory.17,20–22 Reinforcement learning then operates on these actions such that adaptive actions are more likely to be repeated, whereas maladaptive actions are suppressed. Critically, according to both the models and available electrophysiological evidence, positive outcomes are reflected in terms of deviations from current expectations, a term referred to as a “positive prediction error,” and are encoded by phasic bursts of dopamine.14,19,23,24 Similarly, negative prediction errors are encoded by phasic dips or pauses in dopaminergic activity. These phasic bursts and dips modify corticostriatal synaptic plasticity, allowing the system to incrementally become more likely to produce actions that are adaptive and to avoid those that are maladaptive. Importantly, these models have generated several testable predictions for clinical populations and pharmacological manipulations. In brief, cognitive experiments have provided much support for the idea that dopamine manipulation can affect reinforcement learning an
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Kapur, S. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.13 · Cited by 2,813
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Schizophrenia as a Complex Trait: Evidence From a Meta-analysis of Twin Studies
Sullivan, P. F., Kendler, K. S., & Neale, M. C. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.12.1187 · Cited by 2,356
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Self-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Dichotomous dopaminergic control of striatal synaptic plasticity
Shen, W., Flajolet, M., Greengard, P., & Surmeier, D. J. (2008) · Science · doi:10.1126/science.1160575 · Cited by 1,190
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Prefrontal cortex and basal ganglia control access to working memory
McNab, F., & Klingberg, T. (2008) · Nature Neuroscience · doi:10.1038/nn2024 · Cited by 989
Cited by
A Bayesian foundation for individual learning under uncertainty
Mathys, C. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00039 · Cited by 655
Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000037 · Cited by 327
Deficits in predictive coding underlie hallucinations in schizophrenia
Horga, G., Schatz, K. C., Abi-Dargham, A., & Peterson, B. S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0200-14.2014 · Cited by 176
The promises and pitfalls of applying computational models to neurological and psychiatric disorders
Teufel, C., & Fletcher, P. C. (2016) · Brain · doi:10.1093/brain/aww209 · Cited by 64
Striatal dopamine, reward, and decision making in schizophrenia
Deserno, L., Schlagenhauf, F., & Heinz, A. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/ldeserno · Cited by 58
Metadata
- Authors
- Frank, M. J.
- Venue
- Schizophrenia Bulletin
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-08-20
- Volume
- 34
- Issue
- 6
- Pages
- 1008-1011
- ISSN
- 0586-7614 (ISSN-L)
- 1745-1701
- OpenAlex
- W2164517887
- Cited by
- 37
- References
- 17
- FWCI
- 1.25
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Schizophrenia: A Computational Reinforcement Learning Perspective. https://app.cochat.ai/papers/10.1093/schbul/sbn123
- The paper
- Frank, M. J. (2008). Schizophrenia: A Computational Reinforcement Learning Perspective. Schizophrenia Bulletin. https://doi.org/10.1093/schbul/sbn123
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.