Neural substrates underlying effort, time, and risk-based decision making in motivated behavior
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism’s environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (Nacc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat
Hoover, W. B., & Vertes, R. P. (2007) · Brain Structure and Function · doi:10.1007/s00429-007-0150-4 · Cited by 1,365
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817
Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675
Progressive parkinsonism in mice with respiratory-chain-deficient dopamine neurons
Ekstrand, M. I., Terzioglu, M., Galter, D., Zhu, S., Hofstetter, C., Lindqvist, E., Thams, S., Bergstrand, A., Hansson, F. S., Trifunovic, A., et al. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0605208103 · Cited by 605
Separate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580
Ventral pallidum roles in reward and motivation
Smith, K. S., Tindell, A. J., Aldridge, J. W., & Berridge, K. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.038 · Cited by 548
Kellendonk, C., Simpson, E. H., Polan, H. J., Malleret, G., Vronskaya, S., Winiger, V., Moore, H., & Kandel, E. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.01.023 · Cited by 520
Self-citationAnimal behavior and internal drives.
Richter, C. P. (1927) · The Quarterly Review of Biology · doi:10.1086/394279 · Cited by 474
Naleid, A. M., Grace, M. K., Cummings, D. E., & Levine, A. S. (2005) · Peptides · doi:10.1016/j.peptides.2005.04.025 · Cited by 409
Hong, W., Kim, D.-W., & Anderson, D. J. (2014) · Cell · doi:10.1016/j.cell.2014.07.049 · Cited by 405
Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016) · Brain · doi:10.1093/brain/aww050 · Cited by 350
Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats
de Wit, H., Wade, T. R., & Richards, J. B. (2000) · Psychopharmacology · doi:10.1007/s002130000402 · Cited by 333
Amygdala-prefrontal cortical circuitry regulates effort based decision making
Floresco, S. B., & Ghods-Sharifi, S. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj143 · Cited by 316
Hypothalamic Survival Circuits: Blueprints for Purposive Behaviors
Sternson, S. M. (2013) · Neuron · doi:10.1016/j.neuron.2013.02.018 · Cited by 313
Salamone, J. D. (1992) · Psychopharmacology · doi:10.1007/bf02245133 · Cited by 291
Aberman, J. E., & Salamone, J. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00004-4 · Cited by 263
Fundamental contribution by the basolateral amygdala to different forms of decision making
Ghods-Sharifi, S., St. Onge, J. R., & Floresco, S. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.0315-09.2009 · Cited by 257
Cousins, M. S., Atherton, A., Turner, L., & Salamone, J. D. (1996) · Behavioural Brain Research · doi:10.1016/0166-4328(95)00151-4 · Cited by 236
Increasing dopamine D2 receptor expression in the adult nucleus accumbens enhances motivation
Trifilieff, P., Feng, B., Urizar, E., Winiger, V, Ward, R. D., Taylor, K. M., Martinez, D., Moore, H., Balsam, P. D., Simpson, E. H., et al. (2013) · Molecular Psychiatry · doi:10.1038/mp.2013.57 · Cited by 206
Self-citationMesolimbic Dopamine and the Regulation of Motivated Behavior
Salamone, J. D., Pardo, M., Yohn, S. E., López-Cruz, L., SanMiguel, N., & Correa, M. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_383 · Cited by 204
Hosking, J. G., Cocker, P. J., & Winstanley, C. A. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.27 · Cited by 119
Selective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice
Stopper, C. M., Green, E. B., & Floresco, S. B. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs297 · Cited by 117
Kheramin, S., Body, S., Ho, M.-Y., Vel�zquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2004) · Psychopharmacology · doi:10.1007/s00213-004-1813-y · Cited by 117
Chambers, R. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(02)00365-2 · Cited by 111
Wallace, M., Singer, G., Finlay, J., & Gibson, S. (1983) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(83)90262-9 · Cited by 96
Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Bradshaw, C. M., Szabadi, E., Anderson, I. M., & Deakin, J. F. W. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.03.041 · Cited by 37
McGinty, V. B., Hayden, B. Y., Heilbronner, S. R., Dumont, E. C., Graves, S. M., Mirrione, M. M., du Hoffmann, J., Sartor, G. C., España, R. A., Millan, E. Z., et al. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.07.036 · Cited by 36
Cited by
History of winning remodels thalamo-PFC circuit to reinforce social dominance
Zhou, T., Zhu, H., Fan, Z., Wang, F., Chen, Y., Liang, H., Yang, Z., Zhang, L., Lin, L., Zhan, Y., et al. (2017) · Science · doi:10.1126/science.aak9726 · Cited by 358
Dopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142
Advances in understanding neural mechanisms of social dominance
Zhou, T., Sandi, C., & Hu, H. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.01.006 · Cited by 133
Pastor, V., & Medina, J. H. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15168 · Cited by 50
Disordered Decision Making: A Cognitive Framework for Apathy and Impulsivity in Huntington’s Disease
Morris, L., O'Callaghan, C., & Le Heron, C. (2022) · Movement Disorders · doi:10.1002/mds.29013 · Cited by 36
Metadata
- Authors
- Bailey, M. R., Simpson, E. H., & Balsam, P. D.
- Venue
- Neurobiology of Learning and Memory
- Publisher
- Elsevier BV
- Published
- 2016-09
- Volume
- 133
- Pages
- 233-256
- ISSN
- 1074-7427 (ISSN-L)
- OpenAlex
- W2467498519
- Cited by
- 123
- References
- 31
- FWCI
- 9.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.