The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Reduced model-based decision-making in schizophrenia.
Open accessAbstract
Individuals with schizophrenia have a diminished ability to use reward history to adaptively guide behavior. However, tasks traditionally used to assess such deficits often rely on multiple cognitive and neural processes, leaving etiology unresolved. In the current study, we adopted recent computational formalisms of reinforcement learning to distinguish between model-based and model-free decision-making in hopes of specifying mechanisms associated with reinforcement-learning dysfunction in schizophrenia. Under this framework, decision-making is model-free to the extent that it relies solely on prior reward history, and model-based if it relies on prospective information such as motivational state, future consequences, and the likelihood of obtaining various outcomes. Model-based and model-free decision-making was assessed in 33 schizophrenia patients and 30 controls using a 2-stage 2-alternative forced choice task previously demonstrated to discern individual differences in reliance on the 2 forms of reinforcement-learning. We show that, compared with controls, schizophrenia patients demonstrate decreased reliance on model-based decision-making. Further, parameter estimates of model-based behavior correlate positively with IQ and working memory measures, suggesting that model-based deficits seen in schizophrenia may be partially explained by higher-order cognitive deficits. These findings demonstrate specific reinforcement-learning and decision-making deficits and thereby provide valuable insights for understanding disordered behavior in schizophrenia. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The literature suggests alterations in the distinct reinforcement learning systems that underlie model-free and model-based decision-making processes in OCD, MDD, and schizophrenia. 59,63,69–74”
From Investigating disorder-specific and transdiagnostic alterations in model-based and model-free decision-making (2024) · cites this paper as [63]
Citations
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
Dementia Praecox or the Group of Schizophrenias
(1951) · Journal of the American Medical Association · doi:10.1001/jama.1951.02920270079043 · Cited by 4,407
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationModel-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779
Self-citationA scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale
Snaith, R. P., Hamilton, M., Morley, S., Humayan, A., Hargreaves, D., & Trigwell, P. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.167.1.99 · Cited by 1,778
International Consensus Study of Antipsychotic Dosing
Gardner, D. M., Murphy, A. L., O'Donnell, H., Centorrino, F., & Baldessarini, R. J. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09060802 · Cited by 1,328
Pantelis, C., Velakoulis, D., McGorry, P. D., Wood, S. J., John Suckling, A., Phillips, L., Yung, A. R., Bullmore, E. T., Brewer, W. J., Soulsby, B., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12323-9 · Cited by 1,309
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166
Self-citationMeta-analysis of 41 functional neuroimaging studies of executive function in schizophrenia
Minzenberg, M. J., Laird, A. R., Thelen, S., Carter, C. S., & Glahn, D. C. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.91 · Cited by 1,158
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,020
Corrections for extreme proportions and their biasing effects on estimated values ofd′
Hautus, M. J. (1995) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203619 · Cited by 941
The brief negative symptom scale: Psychometric properties
Kirkpatrick, B., Strauss, G. P., Nguyen, L., Fischer, B. A., Daniel, D. G., Cienfuegos, A., & Marder, S. R. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbq059 · Cited by 895
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
Cognition in schizophrenia: core psychological and neural mechanisms
Barch, D. M., & Ceaser, A. E. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.015 · Cited by 792
Self-citationThorndike, E. L. (1927) · The American Journal of Psychology · doi:10.2307/1415413 · Cited by 659
Disorders of compulsivity: A common bias towards learning habits
Voon, V, Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., Schreiber, L. R. N., Gillan, C., Fineberg, N. A., Sahakian, B. J., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.44 · Cited by 643
Self-citationNeural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586
Self-citationDysfunction of ventral striatal reward prediction in schizophrenia
Juckel, G., Schlagenhauf, F., Koslowski, M., Wüstenberg, T., Villringer, A., Knutson, B., Wrase, J., & Heinz, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.051 · Cited by 578
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521
Working-memory capacity protects model-based learning from stress
Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., & Daw, N. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312011110 · Cited by 490
Self-citationA Review of Reward Processing and Motivational Impairment in Schizophrenia
Strauss, G. P., Waltz, J. A., & Gold, J. M. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt197 · Cited by 474
IQ and risk for schizophrenia: a population-based cohort study
David, A. S., Malmberg, A., Brandt, L. J., Allebeck, P., & Lewis, G. (1997) · Psychological Medicine · doi:10.1017/s0033291797005680 · Cited by 467
Reduced dorsal and orbital prefrontal gray matter volumes in schizophrenia
Gur, R. E., Cowell, P. E., Latshaw, A., Turetsky, B. I., Grossman, R. I., Arnold, S. E., Bilker, W. B., & Gur, R. C. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.8.761 · Cited by 368
Waltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331
Juckel, G., Schlagenhauf, F., Koslowski, M., Filonov, D., Wüstenberg, T., Villringer, A., Knutson, B., Kienast, T., Gallinat, J., Wrase, J., et al. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0405-4 · Cited by 323
Negative Symptoms and the Failure to Represent the Expected Reward Value of Actions
Gold, J. M. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1269 · Cited by 319
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294
Wechsler Test of Adult Reading
Hill, A. K., Venegas, J., & Clark, E. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_1500-2 · Cited by 254
Striatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253
Woodward, T. S., Moritz, S., Cuttler, C., & Whitman, J. C. (2006) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390590949511 · Cited by 251
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244
Shurman, B., Horan, W. P., & Nuechterlein, K. H. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.03.020 · Cited by 237
Deserno, L., Huys, Q. J. M., Boehme, R., Buchert, R., Heinze, H.-J., Grace, A. A., Dolan, R. J., Heinz, A., & Schlagenhauf, F. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417219112 · Cited by 233
Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia
Collins, A. G. E., Brown, J. K., Gold, J. M., Waltz, J. A., & Frank, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0989-14.2014 · Cited by 223
High school yearbooks: A reply to Schwarz.
Meehl, P. E. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0030750 · Cited by 221
McDannald, M. A., Lucantonio, F., Burke, K. A., Niv, Y., & Schoenbaum, G. M. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5499-10.2011 · Cited by 216
Decision-Making Impairments in the Context of Intact Reward Sensitivity in Schizophrenia
Heerey, E. A., Bell-Warren, K. R., & Gold, J. M. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.02.015 · Cited by 207
Cognitive Control Predicts Use of Model-based Reinforcement Learning
Otto, A. R., Skatova, A., Madlon‐Kay, S., & Daw, N. D. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00709 · Cited by 202
Self-citationCorticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia
Morris, R. W., Quail, S., Griffiths, K. R., Green, M. J., & Balleine, B. W. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.06.005 · Cited by 197
Working and long-term memory deficits in schizophrenia: Is there a common prefrontal mechanism?
Barch, D. M., Csernansky, J. G., Conturo, T., & Snyder, A. Z. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.3.478 · Cited by 176
Self-citationAssessment of executive dysfunction during activities of daily living in schizophrenia
Semkovska, M., Bédard, M., Godbout, L., Limoge, F., & Stip, É. (2003) · Schizophrenia Research · doi:10.1016/j.schres.2003.07.005 · Cited by 160
Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011) · Neuropsychology · doi:10.1037/a0020882 · Cited by 132
Weickert, T. W., Terrazas, A., Bigelow, L. B., Malley, J. D., Hyde, T. M., Egan, M. F., Weinberger, D. R., & Goldberg, T. E. (2002) · Learning & Memory · doi:10.1101/lm.49102 · Cited by 111
Hooker, C. I., Bruce, L., Lincoln, S. H., Fisher, M., & Vinogradov, S. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.07.027 · Cited by 103
Multiple memory systems as substrates for multiple decision systems
Doll, B. B., Shohamy, D., & Daw, N. D. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.04.014 · Cited by 101
Self-citationDeserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 95
Impaired Activation in Cognitive Control Regions Predicts Reversal Learning in Schizophrenia
Culbreth, A. J., Gold, J. M., Cools, R., & Barch, D. M. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv075 · Cited by 92
Self-citationReduced Kamin blocking in non paranoid schizophrenia: associations with schizotypy
Moran, P. M., Al-Uzri, M. M., Watson, J., & Reveley, M. A. (2003) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(02)00099-7 · Cited by 83
Schizophrenics know more than they can tell: probabilistic classification learning in schizophrenia
Kéri, S., Kelemen, O., Szekeres, G., Bagóczky, N., Erdélyi, R., Antal, A., Benedek, G., & Janka, Z. (2000) · Psychological Medicine · doi:10.1017/s0033291799001403 · Cited by 78
Plailly, J., d’Amato, T., Saoud, M., & Royet, J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.056 · Cited by 75
Computational psychiatry (vol 16, pg 72, 2012)
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · UCL Discovery (University College London) · Cited by 64
Park, I. H., Park, H., Chun, J., Kim, E. Y., & Kim, J. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2008.05.094 · Cited by 58
Agnew‐Blais, J. C., Buka, S. L., Fitzmaurice, G. M., Smoller, J. W., Goldstein, J. M., & Seidman, L. J. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv027 · Cited by 53
Apathy in schizophrenia as a deficit in the generation of options for action.
Hartmann-Riemer, M. N., Kluge, A., Kalis, A., Mojzisch, A., Tobler, P. N., & Kaiser, S. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000048 · Cited by 45
High school yearbooks: Further explication and reply to Meehl.
Schwarz, J. C. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0031999 · Cited by 28
Strauss, G. P., Thaler, N. S., Matveeva, T. M., Vogel, S. J., Sutton, G. P., Lee, B. G., & Allen, D. N. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000039 · Cited by 27
Adolescent with Tourette Syndrome and Bipolar Disorder: A Case Report
Shim, S.-H., & Kwon, Y. (2014) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.2014.12.3.235 · Cited by 9
Flagged first, then by citations
Cited by
Sorted by citations
A Transdiagnostic Review of Negative Symptom Phenomenology and Etiology
Strauss, G. P., & Cohen, A. S. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx066 · Cited by 238
Advances in the computational understanding of mental illness
Huys, Q. J. M., Browning, M. D., Paulus, M. P., & Frank, M. J. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0746-4 · Cited by 204
Shahar, N., Hauser, T. U., Moutoussis, M., Moran, R., Keramati, M., & Dolan, R. J. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006803 · Cited by 152
Beyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 147
Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs
Patzelt, E. H., Kool, W., Millner, A. J., & Gershman, S. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.06.018 · Cited by 94
Metadata
- Authors
- Culbreth, A. J., Westbrook, A., Daw, N. D., Botvinick, M., & Barch, D. M.
- Affiliations
- Princeton University (US)
- Venue
- Journal of Abnormal Psychology
- Published
- 2016-08
- Volume
- 125
- Issue
- 6
- Pages
- 777-787
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- PMC
- PMC4980177
- OpenAlex
- W2379192565
- Cited by
- 104
- References
- 60
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 14 · 2023: 10 · 2022: 16 · 2021: 5 · 2020: 7 · 2019: 11 · 2018: 12 · 2017: 8 · 2016: 4
- FWCI
- 10.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Journal of Abnormal Psychology (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01 MH066031)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- schizophrenia, model-based decision making, reinforcement learning, reward history, computational psychiatry, working memory, IQ, cognitive impairment
- MeSH terms
- Adult, Decision Making, Female, Humans, Individuality, Male, Models, Psychological, Reward, Schizophrenic Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
