Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine

Phillips, Paul E. M.; Walton, Mark E.; Jhou, Thomas C.

doi:10.1007/s00213-006-0626-6

Cited by 237Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesDecision-Making and Behavioral Economics

Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine

Phillips, Paul E. M., Walton, Mark E., Jhou, Thomas C.·2007·Psychopharmacology

DOI 10.1007/s00213-006-0626-6

Open this paper in CoChat — free account

Abstract

Rationale Throughout our lives we constantly assess the costs and benefits of the possible future outcomes of our actions and use this information to guide behavior. There is accumulating evidence that dopamine contributes to a fundamental component of this computation-how rewards are compared with the costs incurred when obtaining them.Objective We review the evidence for dopamine's role in cost-benefit decision making and outline a simple mathematical framework in which to represent the interactions between rewards, costs, behavioral state and dopamine.Conclusions Dopamine's effects on cost-benefit decision making can be modeled using simple utility-function curves. This approach provides a useful framework for modeling existing data and generating experimental hypotheses that can be objectively and quantitatively tested by observing choice behavior without the necessity to account for subjective psychological states such as pleasure or desire. We suggest that dopamine plays a key role in overcoming response costs and enabling high-effort behaviors. A particularly important anatomical site of this action is the core of the nucleus accumbens. Here, dopamine is able to modulate activity originating from the frontal cortical systems that also assess costs and rewards. Internal deprivation states (e.g., hunger and thirst) also help to energize goal-seeking behaviors, probably in part by their rich influence on dopamine, which can in turn modify decision making policies.

Integrity signals

Registry

Crossref · 10.1007/s00213-006-0626-6

Cites

114 of 114 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The comparison of apparent risks or costs to possible reward is a computation performed by circuits supporting motivated behavior, critically including the nucleus accumbens and the mesocorticolimbic dopamine system.
“The comparison of apparent risks or costs to possible reward is a computation performed by circuits supporting motivated behavior, critically including the NAc and the mesocorti-colimbic dopamine system (reviewed in depth elsewhere123-125).”
From Resolving the neural circuits of anxiety (2015) · cites this paper as [125]

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379 · cited 4× · see citing works
“Although the classical formulation of dopamine release providing a signal mediating the hedonic pleasure of primary rewards such as food, water and sex was largely refuted (Berridge and Robinson 1998; Salamone and Correa 2002; Wise 2004), there is a large body of evidence demonstrating a prominent role for mesocortico…”
BackgroundInfluential
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001 · see citing works
Advances in Neural Information Processing Systems 18
Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927 · see citing works
Parsing reward
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869 · see citing works
The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking
Ikemoto, S., & Panksepp, J. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00023-5 · Cited by 1,450 · see citing works
Neuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · see citing works
Neural systems responding to degrees of uncertainty in human decision-making
Hsu, M., Bhatt, M., Adolphs, R., Tranel, D., & Camerer, C. F. (2005) · Science · doi:10.1126/science.1115327 · Cited by 1,411 · see citing works
Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
The Neural Basis of Financial Risk Taking
Kuhnen, C. M., & Knutson, B. (2005) · Neuron · doi:10.1016/j.neuron.2005.08.008 · Cited by 1,182 · see citing works
Evidence for Addiction-like Behavior in the Rat
Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004) · Science · doi:10.1126/science.1099020 · Cited by 1,135 · see citing works
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113 · see citing works
Self-citation
The patterns of afferent innervation of the core and shell in the “Accumbens” part of the rat ventral striatum: Immunohistochemical detection of retrogradely transported fluoro‐gold
Brog, J. S., Salyapongse, A., Deutch, A. Y., & Zahm, D. S. (1993) · Journal of Comparative Neurology · doi:10.1002/cne.903380209 · Cited by 1,102 · see citing works
Dissociable Deficits in the Decision-Making Cognition of Chronic Amphetamine Abusers, Opiate Abusers, Patients with Focal Damage to Prefrontal Cortex, and Tryptophan-Depleted Normal Volunteers Evidence for Monoaminergic Mechanisms
Rogers, R. (1999) · Neuropsychopharmacology · doi:10.1016/s0893-133x(98)00091-8 · Cited by 1,101 · see citing works
Expression of ghrelin receptor mRNA in the rat and the mouse brain
Zigman, J. M., Jones, J. E., Lee, C. E., Saper, C. B., & Elmquist, J. K. (2006) · The Journal of Comparative Neurology · doi:10.1002/cne.20823 · Cited by 1,074 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning
Kelley, A. E. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.11.015 · Cited by 942 · see citing works
Impulsive choice induced in rats by lesions of the nucleus accumbens core
Cardinal, R. N., Pennicott, D. R., Lakmali, C., Sugathapala, Robbins, T. W., & Everitt, B. J. (2001) · Science · doi:10.1126/science.1060818 · Cited by 923 · see citing works
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855 · see citing works
Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area
Sesack, S. R., & Pickel, V. M. (1992) · Journal of Comparative Neurology · doi:10.1002/cne.903200202 · Cited by 820 · see citing works
Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine
Salamone, J. D., & Correa, M. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00282-6 · Cited by 817 · see citing works
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · see citing works
Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration
Vanderschuren, L. J. M. J., & Everitt, B. J. (2004) · Science · doi:10.1126/science.1098975 · Cited by 733 · see citing works
Dopamine-deficient mice are severely hypoactive, adipsic, and aphagic
Zhou, Q.-Y., & Palmiter, R. D. (1995) · Cell · doi:10.1016/0092-8674(95)90145-0 · Cited by 731 · see citing works
Measuring hedonic impact in animals and infants: microstructure of affective taste reactivity patterns
Berridge, K. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(99)00072-x · Cited by 721 · see citing works
Orexin A in the VTA Is Critical for the Induction of Synaptic Plasticity and Behavioral Sensitization to Cocaine
Borgland, S. L., Taha, S. A., Sarti, F., Fields, H. L., & Bonci, A. (2006) · Neuron · doi:10.1016/j.neuron.2006.01.016 · Cited by 718 · see citing works
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · see citing works
Self-citation
Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675 · see citing works
Neuroleptic-Induced "Anhedonia" in Rats: Pimozide Blocks Reward Quality of Food
Wise, R. A., Spindler, J., de Wit, H., & Gerberg, G. J. (1978) · Science · doi:10.1126/science.566469 · Cited by 636 · see citing works
Pathological Gambling Caused by Drugs Used to Treat Parkinson Disease
Dodd, M. L., Klos, K. J., Bower, J. H., Geda, Y. E., Josephs, K. A., & Ahlskog, J. E. (2005) · Archives of Neurology · doi:10.1001/archneur.62.9.noc50009 · Cited by 563 · see citing works
Erratum to: “Parsing reward” [Trends Neurosci. 26 (2003) 507–513]
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/j.tins.2003.09.001 · Cited by 559 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions
Berlin, H. A. (2004) · Brain · doi:10.1093/brain/awh135 · Cited by 541 · see citing works
Direct Involvement of Orexinergic Systems in the Activation of the Mesolimbic Dopamine Pathway and Related Behaviors Induced by Morphine
Narita, M., Nagumo, Y., Hashimoto, S., Narita, M., Khotib, J., Miyatake, M., Sakurai, T., Yanagisawa, M., Nakamachi, T., Shioda, S., et al. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.2761-05.2006 · Cited by 516 · see citing works
Functional Specialization within Medial Frontal Cortex of the Anterior Cingulate for Evaluating Effort-Related Decisions
Walton, M. E., Bannerman, D. M., Alterescu, K., & Rushworth, M. F. S. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-16-06475.2003 · Cited by 495 · see citing works
Self-citation
Expression of receptors for insulin and leptin in the ventral tegmental area/substantia nigra (VTA/SN) of the rat
Figlewicz, D. P., Evans, S. B., Murphy, J., Hoen, M., & Baskin, D. G. (2003) · Brain Research · doi:10.1016/s0006-8993(02)04087-8 · Cited by 482 · see citing works
Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure
Salamone, J. D., Cousins, M. S., & Bucher, S. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90108-2 · Cited by 460 · see citing works
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Montague, P. R. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 416 · see citing works
Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement
S., M., S., B., M.-Y., H., C., B., E., S., J., D., & I., A. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0983-0 · Cited by 409 · see citing works
The role of rat medial frontal cortex in effort-based decision making
Walton, M. E., Bannerman, D. M., & Rushworth, M. F. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-24-10996.2002 · Cited by 364 · see citing works
Self-citation
Voltammetry in brain tissue — a new neurophysiological measurement
Kissinger, P. T., Hart, J. B., & Adams, R. N. (1973) · Brain Research · doi:10.1016/0006-8993(73)90503-9 · Cited by 357 · see citing works
Taste reactivity analysis of 6-hydroxydopamine-induced aphagia: Implications for arousal and anhedonia hypotheses of dopamine function.
Berridge, K. C., Venier, I. L., & Robinson, T. E. (1989) · Behavioral Neuroscience · doi:10.1037/0735-7044.103.1.36 · Cited by 356 · cited 2× · see citing works
“While global dopamine depleting lesions (Berridge et al. 1989) or high-dose systemic dopamine receptor antagonists (Pecina et al. 1997) disrupt feeding, they do not change these orofacial responses.”
Background
Properties and opioid inhibition of mesolimbic dopamine neurons vary according to target location
Ford, C. P., Mark, G. P., & Williams, J. T. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4331-05.2006 · Cited by 339 · see citing works
The effects of d -amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats
Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000) · Psychopharmacology · doi:10.1007/s002130000536 · Cited by 339 · see citing works
Morphine reward in dopamine-deficient mice
Hnasko, T. S., Sotak, B. N., & Palmiter, R. D. (2005) · Nature · doi:10.1038/nature04172 · Cited by 338 · see citing works
Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats
de Wit, H., Wade, T. R., & Richards, J. B. (2000) · Psychopharmacology · doi:10.1007/s002130000402 · Cited by 333 · see citing works
Interactions between Serotonin and Dopamine in the Control of Impulsive Choice in Rats: Therapeutic Implications for Impulse Control Disorders
Winstanley, C. A., Theobald, D. E. H., Dalley, J. W., & Robbins, T. W. (2005) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300610 · Cited by 331 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
κ opioids selectively control dopaminergic neurons projecting to the prefrontal cortex
Margolis, E. B., Lock, H., Chefer, V. I., Shippenberg, T. S., Hjelmstad, G. O., & Fields, H. L. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0511159103 · Cited by 326 · see citing works
Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making
Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E. M., & Rushworth, M. F. S. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.005 · Cited by 305 · see citing works
Self-citation
Corticotropin-Releasing Factor Requires CRF Binding Protein to Potentiate NMDA Receptors via CRF Receptor 2 in Dopamine Neurons
Ungless, M. A., Singh, V., Crowder, T. L., Yaka, R., Ron, D., & Bonci, A. (2003) · Neuron · doi:10.1016/s0896-6273(03)00461-6 · Cited by 297 · see citing works
Dopaminergic correlates of motivated behavior: importance of drive
Wilson, C., Nomikos, G., Collu, M., & Fibiger, H. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-07-05169.1995 · Cited by 294 · see citing works
Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort
Denk, F., Walton, M. E., Jennings, K. A., Sharp, T., Rushworth, M. F. S., & Bannerman, D. M. (2004) · Psychopharmacology · doi:10.1007/s00213-004-2059-4 · Cited by 294 · see citing works
Self-citation
Reward without dopamine
Cannon, C. M., & Palmiter, R. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-34-10827.2003 · Cited by 280 · see citing works
Double Dissociation between Serotonergic and Dopaminergic Modulation of Medial Prefrontal and Orbitofrontal Cortex during a Test of Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi088 · Cited by 279 · see citing works
Ghrelin amplifies dopamine signaling by cross talk involving formation of growth hormone secretagogue receptor/dopamine receptor subtype 1 heterodimers.
Jiang, H., Betancourt, L., & Smith, R. G. (2006) · Molecular Endocrinology · doi:10.1210/me.2005-0084 · Cited by 279 · see citing works
Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement
Aberman, J. E., & Salamone, J. D. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00004-4 · Cited by 263 · see citing works
Enhanced Vulnerability to Cocaine Self-Administration Is Associated with Elevated Impulse Activity of Midbrain Dopamine Neurons
Marinelli, M., & White, F. J. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08876.2000 · Cited by 254 · see citing works
Dopamine gating of forebrain neural ensembles
O’Donnell, P. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02463.x · Cited by 253 · see citing works
Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards
Robinson, S., Sandstrom, S. M., Denenberg, V. H., & Palmiter, R. D. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.5 · Cited by 247 · see citing works
The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues
Yun, I. A., Wakabayashi, K. T., Fields, H. L., & Nicola, S. M. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.5282-03.2004 · Cited by 238 · see citing works
Regional and temporal differences in real-time dopamine efflux in the nucleus accumbens during free-choice novelty
Rebec, G. V., Christensen, J. R. C., Guerra, C., & Bardo, M. T. (1997) · Brain Research · doi:10.1016/s0006-8993(97)01004-4 · Cited by 235 · see citing works
Will Travel for Food: Spatial Discounting in Two New World Monkeys
Stevens, J. R., Rosati, A. G., Ross, K. R., & HAUSER, M. D. (2005) · Current Biology · doi:10.1016/j.cub.2005.09.016 · Cited by 228 · see citing works
D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption
Nowend, K. L., Arizzi, M. N., Carlson, B. B., & Salamone, J. D. (2001) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(01)00524-x · Cited by 223 · see citing works
Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions.
Ikemoto, S., & Panksepp, J. (1996) · Behavioral Neuroscience · doi:10.1037//0735-7044.110.2.331 · Cited by 216 · see citing works
Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats
Richards, J. B., Sabol, K. E., & de Wit, H. (1999) · Psychopharmacology · doi:10.1007/pl00005488 · Cited by 203 · see citing works
Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement
Salamone, J. D., Wisniecki, A., Carlson, B. B., & Correa, M. (2001) · Neuroscience · doi:10.1016/s0306-4522(01)00249-4 · Cited by 198 · see citing works
Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress?
Peciña, S., Schulkin, J., & Berridge, K. C. (2006) · BMC Biology · doi:10.1186/1741-7007-4-8 · Cited by 194 · see citing works
Ventrolateral striatal dopamine depletions impair feeding and food handling in rats
Salamone, J. D., Mahan, K., & Rogers, S. (1993) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(93)90174-r · Cited by 173 · see citing works
Basal and feeding-evoked dopamine release in the rat nucleus accumbens is depressed by leptin
Krügel, U., Schraft, T., Kittner, H., Kieß, W., & Illés, P. (2003) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2003.09.047 · Cited by 171 · see citing works
State-Dependent Learned Valuation Drives Choice in an Invertebrate
Pompilio, L., Kacelnik, A., & Behmer, S. T. (2006) · Science · doi:10.1126/science.1123924 · Cited by 170 · see citing works
Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions.
Ikemoto, S., & Panksepp, J. (1996) · Behavioral Neuroscience · doi:10.1037/0735-7044.110.2.331 · Cited by 170 · see citing works
Extinction of Cocaine Self-Administration Reveals Functionally and Temporally Distinct Dopaminergic Signals in the Nucleus Accumbens
Stuber, G. D., Wightman, R. M., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.036 · Cited by 168 · see citing works
The Role of Accumbens Dopamine in Lever Pressing and Response Allocation: Effects of 6-OHDA Injected into Core and Dorsomedial Shell
Sokolowski, J. D., & Salamone, J. D. (1998) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(97)00544-3 · Cited by 166 · see citing works
Cost can increase preference in starlings
Kacelnik, A., & Marsh, B. (2002) · Animal Behaviour · doi:10.1006/anbe.2001.1900 · Cited by 164 · see citing works
The behavioral neurochemistry of motivation: methodological and conceptual issues in studies of the dynamic activity of nucleus accumbens dopamine
Salamone, J. D. (1996) · Journal of Neuroscience Methods · doi:10.1016/0165-0270(95)00125-5 · Cited by 156 · see citing works
Framing effects and risky decisions in starlings
Marsh, B., & Kacelnik, A. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.042491999 · Cited by 154 · see citing works
Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancyPreprint
Schweimer, J. V., & Hauber, W. (2005) · Learning & Memory · doi:10.1101/lm.90605 · Cited by 149 · see citing works
Pimozide Does Not Shift Palatability: Separation of Anhedonia from Sensorimotor Suppression by Taste Reactivity
Peciña, S. (1997) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(97)00044-0 · Cited by 148 · see citing works
EFFECTS OF MESOLIMBIC DOPAMINE DEPLETION ON RESPONDING MAINTAINED BY COCAINE AND FOOD
Caine, S. B., & Koob, G. F. (1994) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1994.61-213 · Cited by 147 · see citing works
Sub-second changes in accumbal dopamine during sexual behavior in male rats
Robinson, D. L., Phillips, P. E. M., Budygin, E. A., Trafton, B. J., Garris, P. A., & Wightman, R. M. (2001) · Neuroreport · doi:10.1097/00001756-200108080-00051 · Cited by 147 · see citing works
Self-citation
Nucleus accumbens dopamine and work requirements on interval schedules
Correa, M., Carlson, B. B., Wisniecki, A., & Salamone, J. D. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00292-9 · Cited by 130 · see citing works
To walk or to fly? How birds choose among foraging modes
Bautista, L. M., Tinbergen, J. M., & Kacelnik, A. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.98.3.1089 · Cited by 128 · see citing works
Augmentation of cocaine hyperactivity in rats by systemic ghrelin
Wellman, P. J., Davis, K. W., & Nation, J. R. (2004) · Regulatory Peptides · doi:10.1016/j.regpep.2004.08.013 · Cited by 117 · see citing works
Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis
Kheramin, S., Body, S., Ho, M.-Y., Vel�zquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2004) · Psychopharmacology · doi:10.1007/s00213-004-1813-y · Cited by 117 · see citing works
Critical guidelines for validation of the selectivity of in-vivo chemical microsensors
Phillips, P. E. M., & Wightman, R. M. (2003) · TrAC Trends in Analytical Chemistry · doi:10.1016/s0165-9936(03)00907-5 · Cited by 110 · see citing works
Self-citation
Nucleus Accumbens Dopamine and the Forebrain Circuitry Involved in Behavioral Activation and Effort-Related Decision Making: Implications for Understanding Anergia and Psychomotor Slowing in Depression
Salamone, J. D., Correa, M., Mingote, S., Weber, S. M., & Farrar, A. M. (2006) · Current Psychiatry Reviews · doi:10.2174/157340006776875914 · Cited by 104 · see citing works
How fast to work: Response vigor, motivation and tonic dopamine
Niv, Y., Daw, N. D., & Dayan, P. (2005) · MPG.PuRe (Max Planck Society) · Cited by 102 · see citing works
Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making.
Schweimer, J. V., Saft, S., & Hauber, W. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.6.1687 · Cited by 101 · see citing works
Ratio and time requirements on operant schedules: effort‐related effects of nucleus accumbens dopamine depletions
Mingote, S., Weber, S. M., Ishiwari, K., Correa, M., & Salamone, J. D. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.03972.x · Cited by 101 · see citing works
Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward
Wakabayashi, K. T., Fields, H. L., & Nicola, S. M. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.01.013 · Cited by 94 · see citing works
Non-psychostimulant drugs of abuse and anxiogenic drugs activate with differential selectivity dopamine transmission in the nucleus accumbens and in the medial prefrontal cortex of the rat
Bassareo, V., Tanda, G., Petromilli, P., Giua, C., & Chiara, G. D. (1996) · Psychopharmacology · doi:10.1007/bf02247433 · Cited by 93 · see citing works
The Mind Through Chick Eyes : Memory, Cognition and Anticipation
Matsushima, T., Izawa, E., Aoki, N., & Yanagihara, S. (2003) · ZOOLOGICAL SCIENCE · doi:10.2108/zsj.20.395 · Cited by 78 · see citing works
Contrast enhancement: a physiological effect of striatal dopamine?
Nicola, S. M., Hopf, F. W., & Hjelmstad, G. O. (2004) · Cell and Tissue Research · doi:10.1007/s00441-004-0929-z · Cited by 68 · see citing works
In vivo neurochemical monitoring and the study of behaviour
Fillenz, M. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.02.003 · Cited by 66 · see citing works
Pathological gambling in two patients on dopamine replacement therapy for Parkinson?s disease
Avanzi, M., Uber, E., & Bonf�, F. (2004) · Neurological Sciences · doi:10.1007/s10072-004-0238-z · Cited by 63 · see citing works
The Mesocortical Dopamine Projection to Anterior Cingulate Cortex Plays No Role in Guiding Effort-Related Decisions.
Walton, M. E., Croxson, P. L., Rushworth, M. F. S., & Bannerman, D. M. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.1.323 · Cited by 59 · see citing works
Self-citation
Association Between Pathologic Gambling and Parkinsonian Therapy as Detected in the Food and Drug Administration Adverse Event Database
Szarfman, A., Doraiswamy, P. M., Tonning, J. M., & Levine, J. G. (2006) · Archives of Neurology · doi:10.1001/archneur.63.2.299-b · Cited by 39 · see citing works
Effects of pimozide on the hedonic properties of sucrose: Analysis by the taste reactivity test
Leeb, K., Parker, L. A., & Eikelboom, R. (1991) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(91)90050-c · Cited by 32 · see citing works
Interaction of CRH and energy balance in the modulation of brain stimulation reward.
Fulton, S. E., Richard, D., Woodside, B. C., & Shizgal, P. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.4.651 · Cited by 18 · see citing works
Decision Making: The Virtue of Patience in Primates
Long, A., & Platt, M. L. (2005) · Current Biology · doi:10.1016/j.cub.2005.10.024 · Cited by 15 · see citing works

Flagged first, then by citations

Sorted by citations

Reconsidering anhedonia in depression: Lessons from translational neuroscience
Treadway, M. T., & Zald, D. H. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.06.006 · Cited by 1,579 · see citing works
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418 · see citing works
Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits
Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0668-9 · Cited by 1,000 · see citing works
Resolving the neural circuits of anxiety
Calhoon, G. G., & Tye, K. M. (2015) · Nature Neuroscience · doi:10.1038/nn.4101 · Cited by 766 · see citing works
The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses.
Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., & Holland, P. C. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.001 · Cited by 696 · see citing works
Self-citation
Dopaminergic mechanisms of individual differences in human effort-based decision-making
Treadway, M. T., Buckholtz, J. W., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., Baldwin, R. M., Schwartzman, A. N., Kessler, R. M., & Zald, D. H. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6459-11.2012 · Cited by 385 · see citing works
The anatomy of apathy: a neurocognitive framework for amotivated behaviour
Le Heron, C., Apps., M. A. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.07.003 · Cited by 380 · see citing works
“A key component of motivation appears to be that prior to performing a behaviour people engage in a cost-benefit evaluation (Phillips et al., 2007; Salamone et al., 2016).”
Background
Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology
Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016) · Brain · doi:10.1093/brain/aww050 · Cited by 350 · see citing works
The mesoaccumbens dopamine in coping with stress
Cabib, S., & Puglisi-Allegra, S. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.04.012 · Cited by 329 · see citing works
Neural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310 · see citing works
Dopamine, behavioral economics, and effort
Salamone, J. D. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.013.2009 · Cited by 277 · see citing works
Corticotropin‐releasing factor increases mouse ventral tegmental area dopamine neuron firing through a protein kinase C‐dependent enhancement ofIh
Wanat, M. J., Hopf, F. W., Stuber, G. D., Phillips, P. E. M., & Bonci, A. (2008) · The Journal of Physiology · doi:10.1113/jphysiol.2007.150078 · Cited by 256 · see citing works
Self-citation
Striatal Dopamine and the Interface between Motivation and Cognition
Aarts, E., van Holstein, M., & Cools, R. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00163 · Cited by 211 · see citing works
Dopamine signaling in the nucleus accumbens of animals self-administering drugs of abuse
Willuhn, I., Wanat, M. J., Clark, J. J., & Phillips, P. E. M. (2010) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2009_27 · Cited by 193 · see citing works
Self-citation
Phasic dopamine release in appetitive behaviors and drug addiction
Wanat, M., Willuhn, I., Clark, J., & Phillips, P. (2009) · Current Drug Abuse Reviewse · doi:10.2174/1874473710902020195 · Cited by 177 · see citing works
Self-citation
Parabolic discounting of monetary rewards by physical effort
Hartmann, M. N., Hager, O. M., Tobler, P. N., & Kaiser, S. (2013) · Behavioural Processes · doi:10.1016/j.beproc.2013.09.014 · Cited by 169 · see citing works
Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation
Klein-Flügge, M. C., Kennerley, S. W., Saraiva, A. C., Penny, W. D., & Bestmann, S. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004116 · Cited by 163 · see citing works
The role of cognitive effort in subjective reward devaluation and risky decision-making
Apps, M. A. J., Grima, L. L., Manohar, S., & Husain, M. (2015) · Scientific Reports · doi:10.1038/srep16880 · Cited by 145 · see citing works
Dopamine, effort-based choice, and behavioral economics: basic and translational research.
Salamone, J. D., Correa, M., Yang, J.-H., Rotolo, R., & Presby, R. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00052 · Cited by 142 · see citing works
Phasic Nucleus Accumbens Dopamine Encodes Risk-Based Decision-Making Behavior
Sugam, J. A., Day, J. J., Wightman, R. M., & Carelli, R. M. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.09.029 · Cited by 142 · see citing works
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136 · see citing works
Food restriction markedly increases dopamine D2 receptor (D2R) in a rat model of obesity as assessed with in‐vivo μPET imaging ([11C] raclopride) and in‐vitro ([3H] spiperone) autoradiography
Thanos, P. K., Michaelides, M., Piyis, Y. K., Wang, G., & Volkow, N. D. (2008) · Synapse · doi:10.1002/syn.20468 · Cited by 135 · see citing works
Reward-centricity and attenuated aversions: an adolescent phenotype emerging from studies in laboratory animals
Doremus-Fitzwater, T. L., & Spear, L. P. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.015 · Cited by 125 · see citing works
Dopamine regulation of social choice in a monogamous rodent species
Aragona, B. J. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.015.2009 · Cited by 119 · see citing works
“…critical for important aspects of reward processing (Berridge and Robinson, 2003; Everitt and Robbins, 2005; Roitman et al., 2005, 2008; Salamone and Correa, 2002; Wheeler et al., 2008) that may underlie cost-benefi t analyses related to choice behavior and decision-making (Phillips et al., 2007).”
Background
The Anterior Cingulate Gyrus Signals the Net Value of Others' Rewards
Apps, M. A. J., & Ramnani, N. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2701-13.2014 · Cited by 109 · see citing works
Long-term risk preference and suboptimal decision making following adolescent alcohol use
Nasrallah, N. A., Yang, T. W. H., & Bernstein, I. L. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0906629106 · Cited by 94 · see citing works
Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning
Ostlund, S. B., Wassum, K. M., Murphy, N. P., Balleine, B. W., & Maidment, N. T. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4759-10.2011 · Cited by 94 · see citing works
Balancing reward and work: anticipatory brain activation in NAcc and VTA predict effort differentially
Kroemer, N. B., Guevara, A., Ciocanea Teodorescu, I., Wuttig, F., Kobiella, A., & Smolka, M. N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.060 · Cited by 64 · see citing works

The Nature of Pleasure: A Critique of Feldman
Mason, E. (2007) · Utilitas · doi:10.1017/s0953820807002646 · Cited by 50 · see citing works
The involvement of nucleus accumbens dopamine in appetitive and aversive motivation
Salamone, J. D. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90153-8 · Cited by 584 · see citing works
Food reward and cocaine increase extracellular dopamine in the nucleus accumbens as measured by microdialysis
Hernandez, L., & Hoebel, B. G. (1988) · Life Sciences · doi:10.1016/0024-3205(88)90036-7 · Cited by 627 · see citing works
Optogenetically-induced tonic dopamine release from VTA-nucleus accumbens projections inhibits reward consummatory behaviors
Mikhailova, M. A., Bass, C. E., Grinevich, V. P., Chappell, A. M., Deal, A. L., Bonin, K., Weiner, J. L., Gainetdinov, R. R., & Budygin, E. A. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.07.006 · Cited by 71 · see citing works
The role of the nucleus accumbens and ventral pallidum in feeding and obesity
Gendelis, S., Inbar, D., & Kupchik, Y. M. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110394 · Cited by 29 · see citing works

Authors: Phillips, P. E. M., Walton, M. E., & Jhou, T. C.
Affiliations: University of Washington (US)
Johns Hopkins University (US)
Corresponding author: Phillips, Paul E. M.
ORCID: Phillips, Paul E. M.
Walton, Mark E.
Jhou, Thomas C.
Venue: Psychopharmacology
Publisher: Springer Science and Business Media LLC
Published: 2006-11-22
Volume: 191
Issue: 3
Pages: 483-495
ISSN: 0033-3158 (ISSN-L)
1432-2072
DOI: 10.1007/s00213-006-0626-6
OpenAlex: W2145982623
Cited by: 237
References: 114
Citations by year: 2026: 4 · 2025: 6 · 2024: 6 · 2023: 4 · 2022: 9 · 2021: 15 · 2020: 8 · 2019: 7 · 2018: 16 · 2017: 9 · 2016: 13 · 2015: 11 · 2014: 20 · 2013: 15 · 2012: 25
FWCI: 1.25
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Psychopharmacology (publishedVersion)
PubMed (publishedVersion)
Funders: National Institutes of Health (5p01da015916-05)
National Institute on Drug Abuse (5 P01 DA015916-04)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Keywords: cost-benefit decision making, mesolimbic dopamine system, nucleus accumbens core, utility functions, effort-based decision making, goal seeking, frontal cortex
MeSH terms: Animals, Choice Behavior, Dopamine, Goals, Humans, Limbic System, Models, Psychological, Motivation, Reward, Prefrontal Cortex, Neurotransmitter Agents

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks