Deciphering Decision Making: Variation in Animal Models of Effort- and Uncertainty-Based Choice Reveals Distinct Neural Circuitries Underlying Core Cognitive Processes
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Maladaptive decision-making is increasingly recognized to play a significant role in numerous psychiatric disorders, such that therapeutics capable of ameliorating core impairments in judgment may be beneficial in a range of patient populations. The field of “decision neuroscience” is therefore in its ascendancy, with researchers from diverse fields bringing their expertise to bear on this complex and fascinating problem. In addition to the advances in neuroimaging and computational neuroscience that contribute enormously to this area, an increase in the complexity and sophistication of behavioral paradigms designed for nonhuman laboratory animals has also had a significant impact on researchers' ability to test the causal nature of hypotheses pertaining to the neural circuitry underlying the choice process. Multiple such decision-making assays have been developed to investigate the neural and neurochemical bases of different types of cost/benefit decisions. However, what may seem like relatively trivial variation in behavioral methodologies can actually result in recruitment of distinct cognitive mechanisms, and alter the neurobiological processes that regulate choice. Here we focus on two areas of particular interest, namely, decisions that involve an assessment of uncertainty or effort, and compare some of the most prominent behavioral paradigms that have been used to investigate these processes in laboratory rodents. We illustrate how an appreciation of the diversity in the nature of these tasks can lead to important insights into the circumstances under which different neural regions make critical contributions to decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497
Insensitivity to future consequences following damage to human prefrontal cortex
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994) · Cognition · doi:10.1016/0010-0277(94)90018-3 · Cited by 6,128 · cited 6×
“Signaling loss: rodent analogs of the Iowa Gambling Task (IGT) and related behavioral tasks The IGT (Bechara et al., 1994) is one of the best known and widely used decision-making tasks.”
BackgroundInfluentialDifferent contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001 · cited 2×
“…(van Honk et al., 2002), substance use disorders (Bechara and Damasio, 2002), and the presence of suicidal features (Jollant et al., 2005), to name just a few, and has been associated with damage to the amygdala and areas of frontal cortex (Bechara et al., 1999; Fellows and Farah, 2003).”
BackgroundUncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329 · cited 1×
“However, dopaminergic innervation of frontostriatal circuits is clearly implicated in attention and impulsivity (Dalley et al., 2004), yet dopamine antagonists did not alter choice on the rCET.”
BackgroundDecision making and the avoidance of cognitive demand
Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0020198 · Cited by 1,141
Distinct roles for direct and indirect pathway striatal neurons in reinforcement
Kravitz, A. V., Tye, L. D., & Kreitzer, A. C. (2012) · Nature Neuroscience · doi:10.1038/nn.3100 · Cited by 972
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · cited 2×
“Thus, even though neurophysiological studies suggest that ACC neural activity encodes information regarding effort cost (Kennerley et al., 2006; Cowen et al., 2012), it is apparent that the ACC does not play a ubiquitous role in effort-related 12074 • J.”
BackgroundRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 1×
“While we have focused on rodent studies, the importance of nonhuman primate research in delineating key brain mechanisms underlying choice, such as parsing action-value versus stimulus-value computations, cannot be understated (Samejima et al., 2005; Lau and Glimcher, 2008; Morris et al., 2014).”
BackgroundCell type-specific loss of BDNF signaling mimics optogenetic control of cocaine reward
Lobo, M. K., Covington, H. E., Chaudhury, D., Friedman, A. K., Sun, H., Damez-Werno, D., Dietz, D. M., Zaman, S., Koo, J. W., Kennedy, P. J., et al. (2010) · Science · doi:10.1126/science.1188472 · Cited by 880
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006598 · Cited by 769
Fellows, L. K. (2003) · Brain · doi:10.1093/brain/awg180 · Cited by 631 · cited 1×
“…(van Honk et al., 2002), substance use disorders (Bechara and Damasio, 2002), and the presence of suicidal features (Jollant et al., 2005), to name just a few, and has been associated with damage to the amygdala and areas of frontal cortex (Bechara et al., 1999; Fellows and Farah, 2003).”
BackgroundSeparate neural pathways process different decision costs
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1756 · Cited by 580 · cited 2×
“With respect to prefrontal involvement, a number of groups have shown that lesions of the rat dorsal ACC (but not the PrL or OFC) also reduce choice of high effort options on the T-maze barrier task (Walton et al., 2002, 2003; Schweimer and Hauber, 2005; Rudebeck et al., 2006; Floresco and Ghods-Sharifi, 2007; Hauber…”
BackgroundEffort-Based Cost–Benefit Valuation and the Human Brain
Croxson, P. L., Walton, M. E., O'Reilly, J. X., Behrens, T. E. J., & Rushworth, M. F. S. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4515-08.2009 · Cited by 560
Impaired decision making in suicide attempters
Jollant, F., Bellivier, F., Leboyer, M., Astruc, B., Torres, S., Verdier, R., Castelnau, D., Malafosse, A., & Courtet, P. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.2.304 · Cited by 541
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · cited 1×
“A singular theory of OFC function has been notoriously difficult to establish (Stal- naker et al., 2015).”
BackgroundDopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385
The role of rat medial frontal cortex in effort-based decision making
Walton, M. E., Bannerman, D. M., & Rushworth, M. F. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10996.2002 · Cited by 364
Amygdala-prefrontal cortical circuitry regulates effort based decision making
Floresco, S. B., & Ghods-Sharifi, S. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj143 · Cited by 316 · cited 3×
“Similarly, lesions or inactivation of the BLA induces a similar shift in preference away from high-cost options (Floresco and Ghods-Sharifi, 2007; Ghods-Sharifi et al., 2009; Ostrander et al., 2011).”
BackgroundSelf-citationFundamental contribution by the basolateral amygdala to different forms of decision making
Ghods-Sharifi, S., St. Onge, J. R., & Floresco, S. B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.0315-09.2009 · Cited by 257 · cited 1×
“Similarly, lesions or inactivation of the BLA induces a similar shift in preference away from high-cost options (Floresco and Ghods-Sharifi, 2007; Ghods-Sharifi et al., 2009; Ostrander et al., 2011).”
BackgroundThe will to persevere Induced by electrical stimulation of the human cingulate gyrus
Parvizi, J., Rangarajan, V., Shirer, W. R., Desai, N., & Greicius, M. D. (2013) · Neuron · doi:10.1016/j.neuron.2013.10.057 · Cited by 254
Choosing to make an effort: The role of striatum in signaling physical effort of a chosen action
Kurniawan, I. T., Seymour, B., Talmi, D., Yoshida, W., Chater, N., & Dolan, R. J. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00027.2010 · Cited by 225
Gee, S., Ellwood, I., Patel, T., Luongo, F., Deisseroth, K., & Sohal, V. S. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5835-11.2012 · Cited by 214 · cited 1×
“These findings highlight the complexity through which mesocortical DA transmission regulates different aspects of decision making by acting on different receptors and, presumably, distinct populations of PFC neurons (Gee et al., 2012; Seong and Carter, 2012).”
BackgroundEffortless control: Executive attention and conscious feeling of mental effort are dissociable
Naccache, L., Dehaene, S., Cohen, L., Habert, M.-O., Guichart-Gomez, E., Galanaud, D., & Willer, J.-C. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.11.024 · Cited by 211
Orsini, C. A., Moorman, D. E., Young, J. W., Setlow, B., & Floresco, S. B. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.04.009 · Cited by 153 · cited 4×
“Lesions to the orbitofrontal cortex made after extended training fail to alter choice on the rGT yet decrease risky choices associated with shock in the RDT (Zeeb and Winstanley, 2011; Orsini et al., 2015a).”
BackgroundInfluentialSelf-citationHosking, J. G., Cocker, P. J., & Winstanley, C. A. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.27 · Cited by 119
Self-citationSelective involvement by the medial orbitofrontal cortex in biasing risky, but not impulsive, choice
Stopper, C. M., Green, E. B., & Floresco, S. B. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs297 · Cited by 117 · cited 1×
“In contrast, inactivating the medial (but not lateral) OFC increased choice of the risky options, whereas inactivation of the insular cortex had no effect (St Onge and Floresco, 2010; Stopper et al., 2014).”
BackgroundSelf-citationBarrus, M. M., & Winstanley, C. A. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2225-15.2016 · Cited by 93 · cited 1×
“However, associating salient audiovisual cues with “wins” that increase in complexity with the magnitude of reward does render choice on the rGT sensitive to modulation by D3 receptors (Barrus and Winstanley, 2016).”
BackgroundSelf-citation
Cited by
The role of the medial prefrontal cortex in cognition, ageing and dementia
Jobson, D. D., Hase, Y., Clarkson, A. N., & Kalaria, R. N. (2021) · Brain Communications · doi:10.1093/braincomms/fcab125 · Cited by 338
Adaptive learning under expected and unexpected uncertainty
Soltani, A., & Izquierdo, A. (2019) · Nature reviews. Neuroscience · doi:10.1038/s41583-019-0180-y · Cited by 286
Müller, T., & Apps, M. A. J. (2019) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.04.030 · Cited by 229
“Lesions to dACC and VS in rodents reduce the willingness to exert effort in classical T-maze tasks where rodents make choices between a high amount of reward that requires additional effort and a low reward that does not (Salamone et al., 2016; Walton et al., 2006; Winstanley and Floresco, 2016).”
BackgroundDopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142
Decision-making behaviors: weighing ethology, complexity, and sensorimotor compatibility
Juavinett, A. L., Erlich, J. C., & Churchland, A. K. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.11.001 · Cited by 82
“a lever press or nose poke; [51,52]) and complete multistage decisions [53].”
Background
Metadata
- Authors
- Winstanley, C. A., & Floresco, S. B.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2016-11-30
- Volume
- 36
- Issue
- 48
- Pages
- 12069-12079
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2559125130
- Cited by
- 113
- References
- 30
- FWCI
- 6.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.