Reduced model-based decision-making in schizophrenia.
Open accessAbstract
Individuals with schizophrenia have a diminished ability to use reward history to adaptively guide behavior. However, tasks traditionally used to assess such deficits often rely on multiple cognitive and neural processes, leaving etiology unresolved. In the current study, we adopted recent computational formalisms of reinforcement learning to distinguish between model-based and model-free decision-making in hopes of specifying mechanisms associated with reinforcement-learning dysfunction in schizophrenia. Under this framework, decision-making is model-free to the extent that it relies solely on prior reward history, and model-based if it relies on prospective information such as motivational state, future consequences, and the likelihood of obtaining various outcomes. Model-based and model-free decision-making was assessed in 33 schizophrenia patients and 30 controls using a 2-stage 2-alternative forced choice task previously demonstrated to discern individual differences in reliance on the 2 forms of reinforcement-learning. We show that, compared with controls, schizophrenia patients demonstrate decreased reliance on model-based decision-making. Further, parameter estimates of model-based behavior correlate positively with IQ and working memory measures, suggesting that model-based deficits seen in schizophrenia may be partially explained by higher-order cognitive deficits. These findings demonstrate specific reinforcement-learning and decision-making deficits and thereby provide valuable insights for understanding disordered behavior in schizophrenia. (PsycINFO Database Record
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The literature suggests alterations in the distinct reinforcement learning systems that underlie model-free and model-based decision-making processes in OCD, MDD, and schizophrenia.
“The literature suggests alterations in the distinct reinforcement learning systems that underlie model-free and model-based decision-making processes in OCD, MDD, and schizophrenia. 59,63,69–74”
From Investigating disorder-specific and transdiagnostic alterations in model-based and model-free decision-making (2024) · cites this paper as [63]
Cites
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641 · see citing works
Dementia Praecox or the Group of Schizophrenias
(1951) · Journal of the American Medical Association · doi:10.1001/jama.1951.02920270079043 · Cited by 4,407 · see citing works
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Self-citationModel-based influences on humans’ choices and striatal prediction errors
Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works
Self-citationA scale for the assessment of hedonic tone the Snaith-Hamilton pleasure scale
Snaith, R. P., Hamilton, M., Morley, S., Humayan, A., Hargreaves, D., & Trigwell, P. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.167.1.99 · Cited by 1,778 · see citing works
Pantelis, C., Velakoulis, D., McGorry, P. D., Wood, S. J., John Suckling, A., Phillips, L., Yung, A. R., Bullmore, E. T., Brewer, W. J., Soulsby, B., et al. (2003) · The Lancet · doi:10.1016/s0140-6736(03)12323-9 · Cited by 1,309 · see citing works
International Consensus Study of Antipsychotic Dosing
Gardner, D. M., Murphy, A. L., O'Donnell, H., Centorrino, F., & Baldessarini, R. J. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09060802 · Cited by 1,302 · see citing works
Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works
Self-citationMeta-analysis of 41 functional neuroimaging studies of executive function in schizophrenia
Minzenberg, M. J., Laird, A. R., Thelen, S., Carter, C. S., & Glahn, D. C. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.91 · Cited by 1,158 · see citing works
Neuroeconomics: decision making and the brain
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5702 · Cited by 1,020 · see citing works
Corrections for extreme proportions and their biasing effects on estimated values ofd′
Hautus, M. J. (1995) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203619 · Cited by 941 · see citing works
The brief negative symptom scale: Psychometric properties
Kirkpatrick, B., Strauss, G. P., Nguyen, L., Fischer, B. A., Daniel, D. G., Cienfuegos, A., & Marder, S. R. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbq059 · Cited by 895 · see citing works
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809 · see citing works
Cognition in schizophrenia: core psychological and neural mechanisms
Barch, D. M., & Ceaser, A. E. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.015 · Cited by 752 · see citing works
Self-citationDisorders of compulsivity: A common bias towards learning habits
Voon, V, Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., Schreiber, L. R. N., Gillan, C., Fineberg, N. A., Sahakian, B. J., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.44 · Cited by 643 · see citing works
Self-citationNeural computations underlying arbitration between model-based and model-free learning
Lee, S. W., Shimojo, S., & O’Doherty, J. P. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.028 · Cited by 642 · see citing works
Thorndike, E. L. (1927) · The American Journal of Psychology · doi:10.2307/1415413 · Cited by 613 · see citing works
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586 · see citing works
Self-citationDysfunction of ventral striatal reward prediction in schizophrenia
Juckel, G., Schlagenhauf, F., Koslowski, M., Wüstenberg, T., Villringer, A., Knutson, B., Wrase, J., & Heinz, A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.07.051 · Cited by 578 · see citing works
Substantia nigra/ventral tegmental reward prediction error disruption in psychosis
Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., & Fletcher, P. C. (2008) · Molecular Psychiatry · doi:10.1038/sj.mp.4002058 · Cited by 532 · see citing works
Reward Processing in Schizophrenia: A Deficit in the Representation of Value
Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., & Heerey, E. A. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn068 · Cited by 521 · see citing works
Working-memory capacity protects model-based learning from stress
Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A., & Daw, N. D. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312011110 · Cited by 472 · see citing works
Self-citationIQ and risk for schizophrenia: a population-based cohort study
David, A. S., Malmberg, A., Brandt, L. J., Allebeck, P., & Lewis, G. (1997) · Psychological Medicine · doi:10.1017/s0033291797005680 · Cited by 467 · see citing works
A Review of Reward Processing and Motivational Impairment in Schizophrenia
Strauss, G. P., Waltz, J. A., & Gold, J. M. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbt197 · Cited by 447 · see citing works
Reduced dorsal and orbital prefrontal gray matter volumes in schizophrenia
Gur, R. E., Cowell, P. E., Latshaw, A., Turetsky, B. I., Grossman, R. I., Arnold, S. E., Bilker, W. B., & Gur, R. C. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.8.761 · Cited by 368 · see citing works
Waltz, J. A., & Gold, J. M. (2007) · Schizophrenia Research · doi:10.1016/j.schres.2007.03.010 · Cited by 331 · see citing works
Juckel, G., Schlagenhauf, F., Koslowski, M., Filonov, D., Wüstenberg, T., Villringer, A., Knutson, B., Kienast, T., Gallinat, J., Wrase, J., et al. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0405-4 · Cited by 323 · see citing works
Negative Symptoms and the Failure to Represent the Expected Reward Value of Actions
Gold, J. M. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1269 · Cited by 319 · see citing works
Dopamine enhances model-based over model-free choice behavior
Wunderlich, K., Smittenaar, P., & Dolan, R. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.042 · Cited by 294 · see citing works
Wechsler Test of Adult Reading
Hill, A. K., Venegas, J., & Clark, E. (2017) · Springer eBooks · doi:10.1007/978-3-319-56782-2_1500-2 · Cited by 254 · see citing works
Striatal dysfunction during reversal learning in unmedicated schizophrenia patients
Schlagenhauf, F., Huys, Q. J. M., Deserno, L., Rapp, M. A., Beck, A., Heinze, H.-J., Dolan, R., & Heinz, A. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.034 · Cited by 253 · see citing works
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244 · see citing works
Woodward, T. S., Moritz, S., Cuttler, C., & Whitman, J. C. (2006) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390590949511 · Cited by 239 · see citing works
Shurman, B., Horan, W. P., & Nuechterlein, K. H. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.03.020 · Cited by 237 · see citing works
Deserno, L., Huys, Q. J. M., Boehme, R., Buchert, R., Heinze, H.-J., Grace, A. A., Dolan, R. J., Heinz, A., & Schlagenhauf, F. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417219112 · Cited by 233 · see citing works
High school yearbooks: A reply to Schwarz.
Meehl, P. E. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0030750 · Cited by 221 · see citing works
McDannald, M. A., Lucantonio, F., Burke, K. A., Niv, Y., & Schoenbaum, G. M. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5499-10.2011 · Cited by 215 · see citing works
Working Memory Contributions to Reinforcement Learning Impairments in Schizophrenia
Collins, A. G. E., Brown, J. K., Gold, J. M., Waltz, J. A., & Frank, M. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0989-14.2014 · Cited by 214 · see citing works
Corticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia
Morris, R. W., Quail, S., Griffiths, K. R., Green, M. J., & Balleine, B. W. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.06.005 · Cited by 197 · see citing works
Decision-Making Impairments in the Context of Intact Reward Sensitivity in Schizophrenia
Heerey, E. A., Bell-Warren, K. R., & Gold, J. M. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.02.015 · Cited by 197 · see citing works
Cognitive Control Predicts Use of Model-based Reinforcement Learning
Otto, A. R., Skatova, A., Madlon‐Kay, S., & Daw, N. D. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00709 · Cited by 186 · see citing works
Self-citationWorking and long-term memory deficits in schizophrenia: Is there a common prefrontal mechanism?
Barch, D. M., Csernansky, J. G., Conturo, T., & Snyder, A. Z. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.3.478 · Cited by 172 · see citing works
Self-citationAssessment of executive dysfunction during activities of daily living in schizophrenia
Semkovska, M., Bédard, M., Godbout, L., Limoge, F., & Stip, É. (2003) · Schizophrenia Research · doi:10.1016/j.schres.2003.07.005 · Cited by 154 · see citing works
Waltz, J. A., Frank, M. J., Wiecki, T. V., & Gold, J. M. (2011) · Neuropsychology · doi:10.1037/a0020882 · Cited by 132 · see citing works
Weickert, T. W., Terrazas, A., Bigelow, L. B., Malley, J. D., Hyde, T. M., Egan, M. F., Weinberger, D. R., & Goldberg, T. E. (2002) · Learning & Memory · doi:10.1101/lm.49102 · Cited by 110 · see citing works
Hooker, C. I., Bruce, L., Lincoln, S. H., Fisher, M., & Vinogradov, S. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.07.027 · Cited by 103 · see citing works
Multiple memory systems as substrates for multiple decision systems
Doll, B. B., Daphna Shohamy, A., & Daw, N. D. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.04.014 · Cited by 92 · see citing works
Self-citationImpaired Activation in Cognitive Control Regions Predicts Reversal Learning in Schizophrenia
Culbreth, A. J., Gold, J. M., Cools, R., & Barch, D. M. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv075 · Cited by 92 · see citing works
Self-citationDeserno, L., Boehme, R., Heinz, A., & Schlagenhauf, F. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00172 · Cited by 89 · see citing works
Reduced Kamin blocking in non paranoid schizophrenia: associations with schizotypy
Moran, P. M., Al-Uzri, M. M., Watson, J., & Reveley, M. A. (2003) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(02)00099-7 · Cited by 83 · see citing works
Schizophrenics know more than they can tell: probabilistic classification learning in schizophrenia
Kéri, S., Kelemen, O., Szekeres, G., Bagóczky, N., Erdélyi, R., Antal, A., Benedek, G., & Janka, Z. (2000) · Psychological Medicine · doi:10.1017/s0033291799001403 · Cited by 78 · see citing works
Plailly, J., d’Amato, T., Saoud, M., & Royet, J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.056 · Cited by 75 · see citing works
Computational psychiatry (vol 16, pg 72, 2012)
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · UCL Discovery (University College London) · Cited by 64 · see citing works
Park, I. H., Park, H., Chun, J., Kim, E. Y., & Kim, J. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2008.05.094 · Cited by 58 · see citing works
Agnew‐Blais, J. C., Buka, S. L., Fitzmaurice, G. M., Smoller, J. W., Goldstein, J. M., & Seidman, L. J. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv027 · Cited by 47 · see citing works
Apathy in schizophrenia as a deficit in the generation of options for action.
Hartmann-Riemer, M. N., Kluge, A., Kalis, A., Mojzisch, A., Tobler, P. N., & Kaiser, S. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000048 · Cited by 41 · see citing works
High school yearbooks: Further explication and reply to Meehl.
Schwarz, J. C. (1971) · Journal of Abnormal Psychology · doi:10.1037/h0031999 · Cited by 28 · see citing works
Strauss, G. P., Thaler, N. S., Matveeva, T. M., Vogel, S. J., Sutton, G. P., Lee, B. G., & Allen, D. N. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000039 · Cited by 25 · see citing works
Adolescent with Tourette Syndrome and Bipolar Disorder: A Case Report
Shim, S.-H., & Kwon, Y. (2014) · Clinical Psychopharmacology and Neuroscience · doi:10.9758/cpn.2014.12.3.235 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A Transdiagnostic Review of Negative Symptom Phenomenology and Etiology
Strauss, G. P., & Cohen, A. S. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx066 · Cited by 222 · see citing works
Advances in the computational understanding of mental illness
Huys, Q. J. M., Browning, M. D., Paulus, M. P., & Frank, M. J. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0746-4 · Cited by 184 · see citing works
Shahar, N., Hauser, T. U., Moutoussis, M., Moran, R., Keramati, M., & Dolan, R. J. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006803 · Cited by 144 · see citing works
Beyond dichotomies in reinforcement learning
Collins, A. G. E., & Cockburn, J. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0355-6 · Cited by 128 · see citing works
Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs
Patzelt, E. H., Kool, W., Millner, A. J., & Gershman, S. J. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.06.018 · Cited by 94 · see citing works
Model-Based Control in Dimensional Psychiatry
Voon, V., Reiter, A. M. F., Sebold, M., & Groman, S. M. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.04.006 · Cited by 112 · see citing works
Identifying Transdiagnostic Mechanisms in Mental Health Using Computational Factor Modeling
Wise, T., Robinson, O. J., & Gillan, C. M. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.09.034 · Cited by 108 · see citing works
“But a problem for this theory soon followed; other conditions with less characteristic compulsive features - social anxiety (23,24), autism (24,25), schizophrenia (26,27), and Tourette’s Syndrome (28) - also showed deficits relative to controls.”
Ambrus, G. G., Vékony, T., Janacsek, K., Trimborn, A. B. C., Kovács, G., & Németh, D. (2020) · Journal of Memory and Language · doi:10.1016/j.jml.2020.104144 · Cited by 91 · see citing works
Brown, V. M., Chen, J.-Z., Gillan, C., & Price, R. (2020) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.12.019 · Cited by 90 · see citing works
Moutoussis, M., Bullmore, E. T., Goodyer, I. M., Fonagy, P., Jones, P. B., Dolan, R. J., & Dayan, P. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006679 · Cited by 79 · see citing works
Amygdala-cortical collaboration in reward learning and decision making
Wassum, K. M. (2022) · eLife · doi:10.7554/elife.80926 · Cited by 76 · see citing works
Reduced model-based decision-making in gambling disorder
Wyckmans, F., Otto, A. R., Sebold, M., Daw, N. D., Bechara, A., Saeremans, M., Kornreich, C., Chatard, A., Jaafari, N., & Noël, X. (2019) · Scientific Reports · doi:10.1038/s41598-019-56161-z · Cited by 71 · see citing works
Self-citationModel-Free and Model-Based Influences in Addiction-Related Behaviors
Groman, S. M., Massi, B., Mathias, S. R., Lee, D., & Taylor, J. R. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.12.017 · Cited by 74 · see citing works
Sias, A. C., Jafar, Y., Goodpaster, C. M., Ramírez-Armenta, K., Wrenn, T. M., Griffin, N. K., Patel, K., Lamparelli, A. C., Sharpe, M. J., & Wassum, K. M. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01586-7 · Cited by 73 · see citing works
Patzelt, E. H., Hartley, C. A., & Gershman, S. J. (2018) · Personality Neuroscience · doi:10.1017/pen.2018.14 · Cited by 71 · see citing works
Anhedonia in chronic pain and prescription opioid misuse
Garland, E. L., Trøstheim, M., Eikemo, M., Ernst, G., & Leknes, S. (2019) · Psychological Medicine · doi:10.1017/s0033291719002010 · Cited by 72 · see citing works
Modeling other minds: Bayesian inference explains human choices in group decision-making
Khalvati, K., Park, S. A., Mirbagheri, S., Philippe, R., Sestito, M., Dreher, J., & Rao, R. P. N. (2019) · Science Advances · doi:10.1126/sciadv.aax8783 · Cited by 61 · see citing works
Ney, L. J., Wade, M., Reynolds, A., Zuj, D. V., Dymond, S., Matthews, A. J., & Felmingham, K. (2018) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2018.10.010 · Cited by 54 · see citing works
Sjoerds, Z., Dietrich, A., Deserno, L., de Wit, S., Villringer, A., Heinze, H., Schlagenhauf, F., & Horstmann, A. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00234 · Cited by 52 · see citing works
Explicit knowledge of task structure is a primary determinant of human model-based action
Castro-Rodrigues, P., Akam, T., Snorasson, I., Camacho, M., Paixão, V., Maia, A., Barahona-Corrêa, B., Dayan, P., Simpson, H. B., Costa, R. M., et al. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01346-2 · Cited by 48 · see citing works
A staggered edge: End-of-life care in patients with severe mental illness
Shalev, D., Brewster, K., Arbuckle, M. R., & Levenson, J. A. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2016.10.004 · Cited by 45 · see citing works
Intact Ventral Striatal Prediction Error Signaling in Medicated Schizophrenia Patients
Culbreth, A. J., Westbrook, A., Xu, Z., Barch, D. M., & Waltz, J. A. (2016) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.07.007 · Cited by 44 · see citing works
Self-citationOverharvesting in human patch foraging reflects rational structure learning and adaptive planning
Harhen, N. C., & Bornstein, A. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2216524120 · Cited by 40 · see citing works
Neurochemical and Behavioral Dissections of Decision-Making in a Rodent Multistage Task
Groman, S. M., Massi, B., Mathias, S. R., Curry, D. W., Lee, D., & Taylor, J. R. (2018) · Journal of Neuroscience · doi:10.1523/jneurosci.2219-18.2018 · Cited by 40 · see citing works
Sleep homeostasis, habits and habituation
Vyazovskiy, V. V., Walton, M. E., Peirson, S. N., & Bannerman, D. M. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.05.002 · Cited by 37 · see citing works
Computational approaches to schizophrenia: A perspective on negative symptoms
Deserno, L., Heinz, A., & Schlagenhauf, F. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2016.10.004 · Cited by 31 · see citing works
Combined model-free and model-sensitive reinforcement learning in non-human primates
Miranda, B., Malalasekera, W. M. N., Behrens, T. E. J., Dayan, P., & Kennerley, S. W. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007944 · Cited by 33 · see citing works
Structural Brain Alterations in Youth With Psychosis and Bipolar Spectrum Symptoms
Jalbrzikowski, M., Freedman, D., Hegarty, C. E., Mennigen, E., Karlsgodt, K. H., Loohuis, L. M. O., Ophoff, R. A., Gur, R. E., & Bearden, C. E. (2019) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.11.012 · Cited by 32 · see citing works
Corpus callosum morphology in major mental disorders: a magnetic resonance imaging study
Piras, F., Vecchio, D., Kurth, F., Piras, F., Banaj, N., Ciullo, V., Eileen Luders, A., & Spalletta, G. (2021) · Brain Communications · doi:10.1093/braincomms/fcab100 · Cited by 31 · see citing works
Taking others into account: combining directly experienced and indirect information in schizophrenia
Simonsen, A., Fusaroli, R., Petersen, M. L., Vermillet, A., Bliksted, V., Mors, O. N., Roepstorff, A., & Campbell-Meiklejohn, D. K. (2021) · Brain · doi:10.1093/brain/awab065 · Cited by 27 · see citing works
Recent developments in the habit hypothesis of OCD and compulsive disorders
Gillan, C. M. (2021) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2020_199 · Cited by 27 · see citing works
Ohmura, Y., Iwami, K., Chowdhury, S., Sasamori, H., Sugiura, C., Bouchekioua, Y., Nishitani, N., Yamanaka, A., & Yoshioka, M. (2021) · Current Biology · doi:10.1016/j.cub.2021.03.048 · Cited by 28 · see citing works
Wagner, B., Mathar, D., & Peters, J. (2022) · Computational Psychiatry · doi:10.5334/cpsy.84 · Cited by 24 · see citing works
Hernaus, D., Gold, J. M., Waltz, J. A., & Frank, M. J. (2018) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2018.03.014 · Cited by 28 · see citing works
Age-related variability in decision-making: Insights from neurochemistry
Berry, A. S., Jagust, W. J., & Hsu, M. (2018) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-018-00678-9 · Cited by 28 · see citing works
Negative symptoms, striatal dopamine and model-free reward decision-making in schizophrenia
Brandl, F., Knolle, F., Avram, M., Leucht, C., Yakushev, I., Priller, J., Leucht, S., Ziegler, S., Wunderlich, K., & Sorg, C. (2023) · Brain · doi:10.1093/brain/awac268 · Cited by 24 · see citing works
Barch, D. M., Gold, J. M., & Kring, A. M. (2017) · Schizophrenia Bulletin · doi:10.1093/schbul/sbx063 · Cited by 25 · see citing works
Self-citationTo Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity
Beeler, J. A., & Mourra, D. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00006 · Cited by 27 · see citing works
Cameron, C. D., Scheffer, J. A., Hadjiandreou, E., & Anderson, S. (2022) · Advances in experimental social psychology · doi:10.1016/bs.aesp.2022.04.005 · Cited by 23 · see citing works
A Theoretical Framework for Evaluating Psychiatric Research Strategies
Katahira, K., & Yamashita, Y. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00008 · Cited by 22 · see citing works
Wyckmans, F., Banerjee, N., Saeremans, M., Otto, R., Kornreich, C., Vanderijst, L., Gruson, D., Carbone, V., Bechara, A., Buchanan, T. W., et al. (2022) · Journal of Behavioral Addictions · doi:10.1556/2006.2022.00059 · Cited by 20 · see citing works
Belief Updating in Subclinical and Clinical Delusions
Fromm, S. P., Katthagen, T., Deserno, L., Heinz, A., Kaminski, J. A., & Schlagenhauf, F. (2022) · Schizophrenia Bulletin Open · doi:10.1093/schizbullopen/sgac074 · Cited by 20 · see citing works
Maladaptive explore/exploit trade-offs in schizophrenia
Speers, L. J., & Bilkey, D. K. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2023.02.001 · Cited by 17 · see citing works
Transdiagnostic inflexible learning dynamics explain deficits in depression and schizophrenia
Kirschner, H., Nassar, M. R., Fischer, A. G., Frodl, T., Meyer-Lotz, G., Froböse, S., Seidenbecher, S., Klein, T. A., & Ullsperger, M. (2023) · Brain · doi:10.1093/brain/awad362 · Cited by 20 · see citing works
Dexter, T. D., Roberts, B. Z., Ayoub, S. M., Noback, M. N., Barnes, S. A., & Young, J. W. (2024) · Journal of Neurochemistry · doi:10.1111/jnc.16243 · Cited by 19 · see citing works
When decisions talk: computational phenotyping of motivation disorders
Pessiglione, M., Bouc, R. L., & Vinckier, F. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.12.014 · Cited by 20 · see citing works
Mathar, D., Abdoust, M. E., Marrenbach, T., Tuzsus, D., & Peters, J. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010785 · Cited by 20 · see citing works
The Effect of Reduced Learning Ability on Avoidance in Psychopathy: A Computational Approach
Oba, T., Katahira, K., & Ohira, H. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02432 · Cited by 18 · see citing works
Goal-directed and habitual decision making under stress in gambling disorder: An fMRI study
van Timmeren, T., Piray, P., Goudriaan, A. E., & van Holst, R. J. (2023) · Addictive Behaviors · doi:10.1016/j.addbeh.2023.107628 · Cited by 16 · see citing works
Nissan, N., Hertz, U., Shahar, N., & Gabay, Y. (2023) · Behavioral and Brain Functions · doi:10.1186/s12993-023-00207-w · Cited by 16 · see citing works
Appearance‐based trust processing in schizophrenia
Sutherland, C. A. M., Rhodes, G., Williams, N., Connaughton, E., Ewing, L., Caruana, N., & Langdon, R. A. (2019) · British Journal of Clinical Psychology · doi:10.1111/bjc.12234 · Cited by 16 · see citing works
Barch, D. M., Pagliaccio, D., Luking, K. R., Moran, E. K., & Culbreth, A. J. (2019) · Nebraska Symposium on Motivation/The Nebraska symposium on motivation · doi:10.1007/978-3-030-27473-3_5 · Cited by 15 · see citing works
Self-citationYang, X., Song, Y. Y., Zou, Y., Li, Y., & Zeng, J. (2023) · Cerebral Cortex · doi:10.1093/cercor/bhad471 · Cited by 16 · see citing works
Cognitive maps and schizophrenia
Nour, M. M., Liu, Y., El-Gaby, M., McCutcheon, R. A., & Dolan, R. J. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.09.011 · Cited by 18 · see citing works
Psychological Dimensions Relevant to Motivation and Pleasure in Schizophrenia
Abram, S. V., Weittenhiller, L. P., Bertrand, C., McQuaid, J. R., Mathalon, D., Ford, J., & Fryer, S. (2022) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.827260 · Cited by 13 · see citing works
Theory of mind deficits partly mediate impaired social decision-making in schizophrenia
Yang, L., Li, P., Mao, H., Wang, H., Shu, C., Bliksted, V., & Zhou, Y. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1313-3 · Cited by 15 · see citing works
Computational psychiatry and the evolving concept of a mental disorder
Genin, K., Grote, T., & Wolfers, T. (2024) · Synthese · doi:10.1007/s11229-024-04741-6 · Cited by 13 · see citing works
Grosskurth, E. D., Bach, D. R., Economides, M., Huys, Q. J. M., & Holper, L. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007443 · Cited by 10 · see citing works
Ambrus, G. G., Vékony, T., Janacsek, K., Trimborn, A. B. C., Kovács, G., & Németh, D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/198515 · Cited by 10 · see citing works
On the Importance of Power Analyses for Cognitive Modeling
Gluth, S., & Jarecki, J. B. (2019) · Computational Brain & Behavior · doi:10.1007/s42113-019-00039-w · Cited by 9 · see citing works
Letkiewicz, A. M., Cochran, A. L., Privratsky, A. A., James, G. A., & Cisler, J. M. (2021) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-021-00943-4 · Cited by 10 · see citing works
Brain Functional Connectivity Mapping of Behavioral Flexibility in Rhesus Monkeys
Grant, K. A., Newman, N., Lynn, C., Davenport, C., Gonzales, S. W., Carlson, V. C. C., & Kroenke, C. D. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.0816-21.2022 · Cited by 7 · see citing works
Mathar, D., Wiebe, A., Tuzsus, D., Knauth, K., & Peters, J. (2023) · Psychophysiology · doi:10.1111/psyp.14381 · Cited by 8 · see citing works
Knolle, F., Sen, P., Culbreth, A., Koch, K., Schmitz-Koep, B., Gürsel, D. A., Wunderlich, K., Avram, M., Berberich, G., Sorg, C., et al. (2024) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.240020 · Cited by 9 · see citing works
Self-citationSignatures of heuristic-based directed exploration in two-step sequential decision task behaviour
Brands, A. M. A., Mathar, D., & Peters, J. (2025) · Computational Psychiatry · doi:10.5334/cpsy.101 · Cited by 7 · see citing works
Systems Level Modeling of Cognitive Control in Psychiatric Disorders
Barch, D. M., Culbreth, A. J., & Sheffield, J. M. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809825-7.00006-7 · Cited by 7 · see citing works
Self-citationAfshar, N. M., Cinotti, F., Martin, D. A., Khamassi, M., Calu, D. J., Taylor, J. R., & Groman, S. M. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1113-22.2022 · Cited by 7 · see citing works
Cognitive Control in Schizophrenia: Advances in Computational Approaches
Barch, D. M., Culbreth, A. J., & Sheffield, J. M. (2023) · Current Directions in Psychological Science · doi:10.1177/09637214231205220 · Cited by 7 · see citing works
Self-citationCulbreth, A. J., Waltz, J. A., Frank, M. J., & Gold, J. M. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.05.009 · Cited by 6 · see citing works
Self-citationPersonalized Cognitive Health in Psychiatry: Current State and the Promise of Computational Methods
Chen, C. S., & Vinogradov, S. (2024) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae108 · Cited by 6 · see citing works
Bayesian Inference of Other Minds Explains Human Choices in Group Decision MakingPreprint
Khalvati, K., Park, S. A., Mirbagheri, S., Philippe, R., Sestito, M., Dreher, J., & Rao, R. P. N. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/419515 · Cited by 7 · see citing works
Culbreth, A. J., Schwartz, E. K., Frank, M. J., Brown, E. C., Xu, Z., Chen, S., Gold, J. M., & Waltz, J. A. (2023) · Psychological Medicine · doi:10.1017/s0033291722003993 · Cited by 5 · see citing works
Self-citationComplementary roles of serotonin and dopamine in model-based learning
Taira, M., & Sharpe, M. J. (2024) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2024.101464 · Cited by 6 · see citing works
Bauer, C. C. C., Zhang, J., Morfini, F., Hinds, O., Wighton, P., Lee, Y. J., Stone, L., Awad, A., Okano, K., Hwang, M., et al. (2025) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2025.112050 · Cited by 5 · see citing works
Working Memory Guides Action Valuation in Model-based Decision-making Strategy
Zuo, Z., Yang, L., Wang, H., & Li, H. (2024) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_02237 · Cited by 4 · see citing works
Computational Modelling for Alcohol Use Disorder
Colombo, M. (2022) · Erkenntnis · doi:10.1007/s10670-022-00533-x · Cited by 4 · see citing works
Goal-Directed Deficits in Schizophrenia
Morris, R. W. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812098-9.00017-6 · Cited by 4 · see citing works
Mathar, D., Abdoust, M. E., Tuszus, D., Marrenbach, T., & Peters, J. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.02.09.479693 · Cited by 4 · see citing works
On the effects of impulsivity and compulsivity on neural correlates of model-based performance
Dück, K., Dieterich, R., Overmeyer, R., & Endraß, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-71692-w · Cited by 3 · see citing works
Leathem, L. D., Barch, D. M., Moran, E. K., Patel, P. K., Green, M. F., & Wynn, J. K. (2025) · Psychiatry Research · doi:10.1016/j.psychres.2025.116629 · Cited by 3 · see citing works
Self-citationEvidence for shallow cognitive maps in schizophrenia
Karagoz, A. B., Moran, E. K., Barch, D. M., Kool, W., & Reagh, Z. M. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01283-3 · Cited by 3 · see citing works
Self-citationOguchi, M., Li, Y., Matsumoto, Y., Kiyonari, T., Yamamoto, K., Sugiura, S., & Sakagami, M. (2023) · Scientific Reports · doi:10.1038/s41598-023-27609-0 · Cited by 3 · see citing works
Hamroun, S., Lebreton, M. P., & Palminteri, S. (2022) · doi:10.31234/osf.io/2uw85 · Cited by 3 · see citing works
Omlor, W., Cecere, G., Huang, G.-Y., Spiller, T., Misra, A., Rabe, F., Kallen, N., Kirschner, M., Surbeck, W., Burrer, A., et al. (2025) · BMC Medicine · doi:10.1186/s12916-025-04004-2 · Cited by 2 · see citing works
Higher motivation and pleasure scores predict more reliance on model-free decision making
Karthik, S., Pereira, K. I. R., Culbreth, A. J., Barch, D. M., & Moran, E. K. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01302-3 · Cited by 2 · see citing works
Self-citationBetter Than Maximum Likelihood Estimation of Model-Based And Model-Free Learning StylePreprint
Yazdani, S., Vahabie, A., Araabi, B. N., & Ahmadabadi, M. N. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/296335 · Cited by 2 · see citing works
Post-Decision Gaze as a Behavioral Manifestation of Decision ConfidencePreprint
Stern, Y., Netzer, O., Goldsmith, M., Koren, D., Zvilichovsky, Y., Hertz, U., & Salomon, R. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.08.28.610145 · Cited by 3 · see citing works
Omlor, W., Cecere, G., Misra, A. R., Huang, G.-Y., Wu, X., Edkins, V., Pergola, G., Quednow, B. B., Tobler, P. N., & Homan, P. (2025) · medRxiv · doi:10.1101/2025.07.02.25330758 · Cited by 2 · see citing works
Herms, E. N., Brown, J. W., Wisner, K., Hetrick, W. P., Zald, D. H., & Purcell, J. R. (2024) · Schizophrenia Bulletin · doi:10.1093/schbul/sbae144 · Cited by 1 · see citing works
Wyckmans, F., Chatard, A., Kornreich, C., Gruson, D., Jaafari, N., & Noël, X. (2024) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2024.100574 · Cited by 1 · see citing works
The prefrontal–striatal signatures of reduced model-based learning in depressed patients
Wang, X., Zhou, X., Zhang, D., Zhang, Z., Gong, Y., Feng, Z., & Hou, J. M. (2026) · Annals of General Psychiatry · doi:10.1186/s12991-026-00630-z · Cited by 1 · see citing works
Effect of prior beliefs and cognitive deficits on learning in first-episode schizophrenia patients
Núñez, D. E., Rodríguez-Delgado, J., Castillo, R. D., Yupanqui, J., & Kloos, H. (2024) · Schizophrenia Research Cognition · doi:10.1016/j.scog.2024.100318 · Cited by 1 · see citing works
Conserved reward-mediated, reinforcement-learning mechanisms in Pavlovian and instrumental tasksPreprint
Afshar, N. M., Cinotti, F., Martin, D., Khamassi, M., Calu, D. J., Taylor, J. R., & Groman, S. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.12.495805 · Cited by 1 · see citing works
Brands, A. M. A., Knauth, K., Mathar, D., Lee, S., Kuzmanovic, B., Tittgemeyer, M., & Peters, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.07.18.665478 · Cited by 1 · see citing works
The neurocognitive correlates of compulsivity
Seow, X. F. T. (2020) · Arrow@dit (Dublin Institute of Technology)
Omlor, W., Cecere, G., Huang, G.-Y., Rabe, F., Kallen, N., Kirschner, M., Surbeck, W., Burrer, A., Spiller, T., Garibaldi, G., et al. (2024) · medRxiv · doi:10.1101/2024.04.13.24305575
Explore-exploit instability reveals computational decision-making heterogeneity in early psychosisPreprint
Chen, C. S., Knep, E., Laurie, V.-J., Calvin, O. L., Ebitz, R. B., Fisher, M., Schallmo, M., Sponheim, S. R., Chafee, M. V., Heilbronner, S. R., et al. (2025) · medRxiv · doi:10.1101/2025.04.29.25326698
Sex Differences in Model free and Model based BehaviorPreprint
Lukežić, M., Chen, H., Gilger, M., Neukam, P. T., Deza-Lougovski, Y. L., & Smolka, M. N. (2025) · Research Square · doi:10.21203/rs.3.rs-7021287/v1
Better than Maximum Likelihood Estimation of Model-based and Model-free Learning Styles
Yazdani, S., Vahabie, A., Araabi, B. N., & Ahmadabadi, M. N. (2025) · Basic and Clinical Neuroscience Journal · doi:10.32598/bcn.2024.5883.1
Zhou, T., Ho, Y.-Y., Hartley, N. D., Lee, R. X., Fath, A. B., He, K., Yuan, X., Merrow, S., Scott, J., Bajwa, N., et al. (2026) · Nature Neuroscience · doi:10.1038/s41593-026-02237-9
- Authors
- Culbreth, A. J., Westbrook, A., Daw, N. D., Botvinick, M., & Barch, D. M.
- Affiliations
- Princeton University (US)
- Venue
- Journal of Abnormal Psychology
- Published
- 2016-08
- Volume
- 125
- Issue
- 6
- Pages
- 777-787
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- PMC
- PMC4980177
- OpenAlex
- W2379192565
- Cited by
- 104
- References
- 60
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 14 · 2023: 10 · 2022: 16 · 2021: 5 · 2020: 7 · 2019: 11 · 2018: 12 · 2017: 8 · 2016: 4
- FWCI
- 10.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Journal of Abnormal Psychology (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01 MH066031)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Keywords
- schizophrenia, model-based decision making, reinforcement learning, reward history, computational psychiatry, working memory, IQ, cognitive impairment
- MeSH terms
- Adult, Decision Making, Female, Humans, Individuality, Male, Models, Psychological, Reward, Schizophrenic Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
