Predicting Motivation: Computational Models of PFC Can Explain Neural Coding of Motivation and Effort-based Decision-making in Health and Disease
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Human behavior is strongly driven by the pursuit of rewards. In daily life, however, benefits mostly come at a cost, often requiring that effort be exerted to obtain potential benefits. Medial PFC (MPFC) and dorsolateral PFC (DLPFC) are frequently implicated in the expectation of effortful control, showing increased activity as a function of predicted task difficulty. Such activity partially overlaps with expectation of reward and has been observed both during decision-making and during task preparation. Recently, novel computational frameworks have been developed to explain activity in these regions during cognitive control, based on the principle of prediction and prediction error (predicted response–outcome [PRO] model [Alexander, W. H., & Brown, J. W. Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338–1344, 2011], hierarchical error representation [HER] model [Alexander, W. H., & Brown, J. W. Hierarchical error representation: A computational model of anterior cingulate and dorsolateral prefrontal cortex. Neural Computation, 27, 2354–2410, 2015]). Despite the broad explanatory power of these models, it is not clear whether they can also accommodate effects related to the expectation of effort observed in MPFC and DLPFC. Here, we propose a translation of these computational frameworks to the domain of effort-based behavior. First, we discuss how the PRO model, based on prediction error, can explain effort-related activity in MPFC, by reframing effort-based behavior in a predictive context. We propose that MPFC activity reflects monitoring of motivationally relevant variables (such as effort and reward), by coding expectations and discrepancies from such expectations. Moreover, we derive behavioral and neural model-based predictions for healthy controls and clinical populations with impairments of motivation. Second, we illustrate the possible translation to effort-based behavior of the HER model, an extended version of PRO model based on hierarchical error prediction, developed to explain MPFC–DLPFC interactions. We derive behavioral predictions that describe how effort and reward information is coded in PFC and how changing the configuration of such environmental information might affect decision-making and task performance involving motivation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expected value of control: an integrative theory of anterior cingulate cortex function
Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.07.007 · Cited by 2,321
Ridderinkhof, K. R., van den Wildenberg, W. P. M., Segalowitz, S. J., & Carter, C. S. (2004) · Brain and Cognition · doi:10.1016/j.bandc.2004.09.016 · Cited by 1,407
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
Decision making and the avoidance of cognitive demand
Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0020198 · Cited by 1,141
Action sets and decisions in the medial frontal cortex
RUSHWORTH, M., WALTON, M., KENNERLEY, S., & BANNERMAN, D. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.07.009 · Cited by 1,004
Medial prefrontal cortex as an action-outcome predictor
Alexander, W. H., & Brown, J. W. (2011) · Nature Neuroscience · doi:10.1038/nn.2921 · Cited by 1,000
Self-citationCognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes
Badre, D. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.004 · Cited by 980
Motivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769
Treadway, M. T., Bossaller, N. A., Shelton, R. C., & Zald, D. H. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028813 · Cited by 733
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532
Separate Valuation Subsystems for Delay and Effort Decision Costs
Prévost, C., Pessiglione, M., Météreau, E., Cléry-Melin, M.-L., & Dreher, J.-C. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.2752-10.2010 · Cited by 499
Neurons in the frontal lobe encode the value of multiple decision variables
Kennerley, S. W., Dahmubed, A. F., Lara, A. H., & Wallis, J. D. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21100 · Cited by 453
Neurocomputational mechanisms underlying subjective valuation of effort costs
Chong, T. T.-J., Apps, M., Giehl, K., Sillence, A., Grima, L. L., & Husain, M. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002598 · Cited by 415
The role of rat medial frontal cortex in effort-based decision making
Walton, M. E., Bannerman, D. M., & Rushworth, M. F. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10996.2002 · Cited by 364
Barch, D. M., Treadway, M. T., & Schoen, N. (2014) · Journal of Abnormal Psychology · doi:10.1037/a0036299 · Cited by 323
Neural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310
Valuation and decision-making in frontal cortex: one or many serial or parallel systems?
Rushworth, M. F., Kolling, N., Sallet, J., & Mars, R. B. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.04.011 · Cited by 309
The MAGE protein family and cancer
Weon, J. L., & Potts, P. R. (2015) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2015.08.002 · Cited by 257
The will to persevere Induced by electrical stimulation of the human cingulate gyrus
Parvizi, J., Rangarajan, V., Shirer, W. R., Desai, N., & Greicius, M. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.057 · Cited by 254
Barch, D. M., Pagliaccio, D., & Luking, K. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_376 · Cited by 218
Overlapping neural systems represent cognitive effort and reward anticipation
Vassena, E., Silvetti, M., Boehler, C. N., Achten, E., Fias, W., & Verguts, T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091008 · Cited by 200
Self-citationParabolic discounting of monetary rewards by physical effort
Hartmann, M. N., Hager, O. M., Tobler, P. N., & Kaiser, S. (2013) · Behavioural Processes · doi:10.1016/j.beproc.2013.09.014 · Cited by 169
Klein-Flügge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004116 · Cited by 163
Diminished effort on a progressive ratio task in both unipolar and bipolar depression
Hershenberg, R., Satterthwaite, T. D., Daldal, A., Katchmar, N., Moore, T. M., Kable, J. W., & Wolf, D. H. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.02.003 · Cited by 157
The role of cognitive effort in subjective reward devaluation and risky decision-making
Apps, M. A. J., Grima, L. L., Manohar, S., & Husain, M. (2015) · Scientific Reports · doi:10.1038/srep16880 · Cited by 145 · cited 1×
“These behavioral predictions are consistent with empirical findings of previous studies (Klein-Flügge, Kennerley, Friston, & Bestmann, 2016; Apps et al., 2015).”
ResultComputational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
Self-citationNee, D. E., Kastner, S., & Brown, J. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.08.027 · Cited by 139
Separate and overlapping brain areas encode subjective value during delay and effort discounting
Massar, S. A. A., Libedinsky, C., Weiyan, C., Huettel, S. A., & Chee, M. W. L. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.080 · Cited by 123
Adaptive effort investment in cognitive and physical tasks: A neurocomputational model
Verguts, T., Vassena, E., & Silvetti, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00057 · Cited by 118
Self-citation
Cited by
Dopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142
Computational Models of Anterior Cingulate Cortex: At the Crossroads between Prediction and Effort
Vassena, E., Holroyd, C. B., & Alexander, W. H. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00316 · Cited by 140
Self-citationSurprise, value and control in anterior cingulate cortex during speeded decision-making
Vassena, E., Deraeve, J., & Alexander, W. H. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0801-5 · Cited by 87
Self-citation
Metadata
- Authors
- Vassena, E., Deraeve, J., & Alexander, W. H.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press
- Published
- 2017-10-01
- Volume
- 29
- Issue
- 10
- Pages
- 1633-1645
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2732599491
- Cited by
- 47
- References
- 32
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.