THE BEHAVIORAL PHARMACOLOGY OF EFFORT‐RELATED CHOICE BEHAVIOR: DOPAMINE, ADENOSINE AND BEYOND
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
For many years, it has been suggested that drugs that interfere with dopamine (DA) transmission alter the “rewarding” impact of primary reinforcers such as food. Research and theory related to the functions of mesolimbic DA are undergoing a substantial conceptual restructuring, with the traditional emphasis on hedonia and primary reward yielding to other concepts and lines of inquiry. The present review is focused upon the involvement of nucleus accumbens DA in effort‐related choice behavior. Viewed from the framework of behavioral economics, the effects of accumbens DA depletions and antagonism on food‐reinforced behavior are highly dependent upon the work requirements of the instrumental task, and DA‐depleted rats show a heightened sensitivity to response costs, especially ratio requirements. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort‐related choice behavior. Rats with accumbens DA depletions or antagonism reallocate their instrumental behavior away from food‐reinforced tasks that have high response requirements, and show increased selection of low reinforcement/low cost options. Nucleus accumbens DA and adenosine interact in the regulation of effort‐related functions, and other brain structures (anterior cingulate cortex, amygdala, ventral pallidum) also are involved. Studies of the brain systems regulating effort‐based processes may have implications for understanding drug abuse, as well as symptoms such as psychomotor slowing, fatigue or anergia in depression and other neurological disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · cited 3×
“…and reinforcement; with this usage, reinforcement refers more directly to instrumental learning mechanisms (Sanchis-Segura & Spanagel, 2006; Wise 2004), while reward tends to connote the primary motivational and emotional effects of reinforcing stimuli (Everitt & Robbins, 2005; Salamone et al.,”
BackgroundDopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 5×
“, 2007), it is unlikely that accumbens DA performs only one function, and evidence in favor of the hypothesis that DA is involved in the exertion of effort or effort-related choice behavior is not incompatible with the hypothesized involvement of this system in instrumental learning (Baldo & Kelley, 2007; Beninger & G…”
BackgroundResultInfluentialThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869
Reconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579 · cited 1×
“Furthermore, there is considerable overlap between the neural circuitry involved in effort-related functions in animals and the brain systems that have been implicated in psychomotor slowing and anergia in depression (Salamone et al. 2006, 2007, 2009, 2010; Treadway & Zald, 2011).”
BackgroundON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING 1
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · cited 2×
“These neurochemical changes are seen across varying time horizons (including tonic, slow phasic and fast phasic changes; Hauber 2010; Roitman et al., 2004; Salamone 1996; Salamone et al. 2007; Schultz 2007a, 2007b; Segovia et al., 2011).”
BackgroundAffective neuroscience of pleasure: reward in humans and animals
Berridge, K. C., & Kringelbach, M. L. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1099-6 · Cited by 1,254
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133
Schultz, W. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.007 · Cited by 1,028
Behavioral activation treatment for depression: returning to contextual roots
Jacobson, N. S., Martell, C. R., & Dimidjian, S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.3.255 · Cited by 1,011
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817
Self-citationDopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · cited 1×
“These neurochemical changes are seen across varying time horizons (including tonic, slow phasic and fast phasic changes; Hauber 2010; Roitman et al., 2004; Salamone 1996; Salamone et al. 2007; Schultz 2007a, 2007b; Segovia et al., 2011).”
BackgroundPruessner, J. C., Champagne, F., Meaney, M. J., & Dagher, A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3422-03.2004 · Cited by 709
Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems
EVERITT, B. J., PARKINSON, J. A., OLMSTEAD, M. C., ARROYO, M., ROBLEDO, P., & ROBBINS, T. W. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09280.x · Cited by 708 · cited 2×
“…responsiveness to the activating properties of Pavlovian conditioned stimuli (Day, Wheeler, Roitman, & Carelli, 2006; Di Ciano, Cardinal, Cowell, Little, & Everitt, 2001; Everitt et al., 1999; Everitt & Robbins, 2005; Parkinson et al., 2002; Robbins & Everitt, 2007; Salamone et al., 2007).”
BackgroundThe involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584
Self-citationDirect Activation of the Ventral Striatum in Anticipation of Aversive Stimuli
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., & Kapur, S. (2003) · Neuron · doi:10.1016/s0896-6273(03)00724-4 · Cited by 455 · cited 1×
“…that the human nucleus accumbens also responds to stress, aversion and hyperarousal/irritability (Delgado et al., 2008; Delgado, Jou, & Phelps, 2011; Jensen et al., 2003; Levita et al., 2009; Liberzon et al., 1999; Pavic, 2003; Phan et al., 2004; Pruessner, Champagne, Meaney, & Dagher, 2004).”
BackgroundWyvell, C. L., & Berridge, K. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07831.2001 · Cited by 436 · cited 1×
“…(Baldo & Kelley, 2007; Beninger & Gerdjikov, 2004; Kelley et al., 2005; Segovia et al., 2011; Wise, 2004), aspects of incentive motivation (e.g. reinforcer ‘‘wanting’’; Berridge 2007; Berridge & Robinson, 2003; Wyvell & Berridge, 2001) or Pavlovian-instrumental transfer (Everitt & Robbins, 2005).”
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416
Neural correlates of individual ratings of emotional salience: A trial-related fMRI study
Phan, K. L., Taylor, S. F., Welsh, R. C., Ho, S.-H., Britton, J. C., & Liberzon, I. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.072 · Cited by 416 · cited 1×
“…that the human nucleus accumbens also responds to stress, aversion and hyperarousal/irritability (Delgado et al., 2008; Delgado, Jou, & Phelps, 2011; Jensen et al., 2003; Levita et al., 2009; Liberzon et al., 1999; Pavic, 2003; Phan et al., 2004; Pruessner, Champagne, Meaney, & Dagher, 2004).”
BackgroundDi Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., & Everitt, B. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-23-09471.2001 · Cited by 354
Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats
de Wit, H., Wade, T. R., & Richards, J. B. (2000) · Psychopharmacology · doi:10.1007/s002130000402 · Cited by 333
Amygdala-prefrontal cortical circuitry regulates effort based decision making
Floresco, S. B., & Ghods-Sharifi, S. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj143 · Cited by 316
Salamone, J. D. (1992) · Psychopharmacology · doi:10.1007/bf02245133 · Cited by 291
Self-citationThe many faces of fatigue in major depressive disorder
Demyttenaere, K., De Fruyt, J., & Stahl, S. M. (2005) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145704004729 · Cited by 288
Aberman, J. E., & Salamone, J. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00004-4 · Cited by 263 · cited 5×
“…& Koob, 1980; Robbins et al., 1983; Salamone 1988; Wallace et al., 1983), and to respond to the work-related challenges imposed by ratio schedules (Aberman & Salamone,1999; Correa et al. 2002; Mingote et al., 2005; Salamone et al., 2002, 2003, 2005; Salamone, Correa, Mingote, Weber, & Farrar,…”
BackgroundResultInfluentialSelf-citationCousins, M. S., Atherton, A., Turner, L., & Salamone, J. D. (1996) · Behavioural Brain Research · doi:10.1016/0166-4328(95)00151-4 · Cited by 236 · cited 4×
“…and to respond to the work-related challenges imposed by ratio schedules (Aberman & Salamone,1999; Correa et al. 2002; Mingote et al., 2005; Salamone et al., 2002, 2003, 2005; Salamone, Correa, Mingote, Weber, & Farrar, 2006) and barriers in mazes (Cousins et al., 1996; Salamone et al., 1994).”
BackgroundMethodInfluentialSelf-citationSensitization of Midbrain Dopamine Neuron Reactivity Promotes the Pursuit of Amphetamine
Vezina, P., Lorrain, D. S., Arnold, G. M., Austin, J. D., & Suto, N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-11-04654.2002 · Cited by 206 · cited 1×
“Addiction is characterized by a reorganization of the preference structure of the person, dramatic changes in the allocation of behavioral resources towards the addictive substance (Heyman, 2009; Vezina et al., 2002), and inelasticity of demand (Heyman, 2000).”
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201
Faure, A., Reynolds, S. M., Richard, J. M., & Berridge, K. C. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4961-07.2008 · Cited by 193
Restraint increases dopaminergic burst firing in awake rats
Anstrom, K. K., & Woodward, D. J. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300730 · Cited by 181 · cited 1×
“…footshock, tailshock, tail pinch, restraint stress, aversive conditioned stimuli, aversive drugs, social defeat stress) and appetitive conditions (Anstrom & Woodward 2005; Brischoux, Chakraborty, Brierley, & Ungless, 2009; Broom & Yamamoto 2005; Guarraci & Kapp 1999; Marinelli, Pascucci,…”
BackgroundAdenosine A1-A2A receptor heteromers: New targets for caffeine in the brain
Ferre, S. (2008) · Frontiers in bioscience · doi:10.2741/2852 · Cited by 149 · cited 2×
“Caffeine and other methylxanthines, which are nonselective adenosine antagonists, act as minor stimulants (Ferré et al., 2008; Randall, Nunez, et al., 2011).”
BackgroundNeural systems underlying aversive conditioning in humans with primary and secondary reinforcers
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00071 · Cited by 141
Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm
Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04654.x · Cited by 140
Wachtel, S. R., Ortengren, A., & Wit, H. D. (2002) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(02)00104-7 · Cited by 138
Wallace, M., Singer, G., Finlay, J., & Gibson, S. (1983) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(83)90262-9 · Cited by 96 · cited 2×
“…in schedule-induced activities (McCullough & Salamone, 1992; Robbins & Everitt, 2007; Robbins & Koob, 1980; Robbins et al., 1983; Salamone 1988; Wallace et al., 1983), and to respond to the work-related challenges imposed by ratio schedules (Aberman & Salamone,1999; Correa et al. 2002; Mingote…”
BackgroundBeninger, R. J., Cheng, M., Hahn, B. L., Hoffman, D. C., Mazurski, E. J., Morency, M. A., Ramm, P., & Stewart, R. J. (1987) · Psychopharmacology · doi:10.1007/bf00210842 · Cited by 93 · cited 2×
“…it has been suggested that the ‘‘reward-related’’ actions of low doses of DA antagonists or nucleus accumbens DA depletions should produce effects that closely resemble extinction (e.g. Beninger et al., 1987; Wise, Spindler, de Wit, & Gerberg, 1978), there are several problems with this hypothesis.”
BackgroundVenugopalan, V. V., Casey, K. F., O'Hara, C., O'Loughlin, J., Benkelfat, C., Fellows, L. K., & Leyton, M. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2011.135 · Cited by 70 · cited 2×
“…have reported that DA antagonists failed to blunt the subjectively rated euphoria produced by drugs of abuse (Brauer & de Wit, 1997; Gawin, 1986; Haney, Ward, Foltin, & Fischman, 2001; Nann-Vernotica, Donny, Bigelow, & Walsh, 2001; Venugopalan et al., 2011; Wachtel, Ortengren, & de Wit, 2002).”
BackgroundSegovia, K. N., Correa, M., & Salamone, J. D. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.07.078 · Cited by 44 · cited 3×
“…with the hypothesized involvement of this system in instrumental learning (Baldo & Kelley, 2007; Beninger & Gerdjikov, 2004; Kelley et al., 2005; Segovia et al., 2011; Wise, 2004), aspects of incentive motivation (e.g. reinforcer ‘‘wanting’’; Berridge 2007; Berridge & Robinson, 2003; Wyvell &…”
BackgroundResultSelf-citation
Cited by
Inhibition and impulsivity: behavioral and neural basis of response control
Bari, A., & Robbins, T. W. (2013) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2013.06.005 · Cited by 1,921
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418
“…tend to be relatively preferred, or to elicit approach, goal-directed, or consummatory behavior, or generate a high degree of demand, and that these effects are a fundamental aspect of positive reinforcement (Dickinson and Balleine, 1994; Salamone and Correa, 2002; Salamone et al., 2012).”
InfluentialSelf-citationMotivation and cognitive control: from behavior to neural mechanism
Botvinick, M., & Braver, T. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015044 · Cited by 909
Cognitive effort: A neuroeconomic approach
Westbrook, A., & Braver, T. S. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0334-y · Cited by 606
Metadata
- Authors
- Salamone, J. D., Correa, M., Nunes, E. J., Randall, P. A., & Pardo, M.
- Venue
- Journal of the Experimental Analysis of Behavior
- Publisher
- Wiley
- Published
- 2012-01
- Volume
- 97
- Issue
- 1
- Pages
- 125-146
- ISSN
- 0022-5002 (ISSN-L)
- 1938-3711
- OpenAlex
- W2104869715
- Cited by
- 153
- References
- 40
- FWCI
- 7.93
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.