Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Yin, Henry H.; Ostlund, Sean B.; Balleine, Bernard W.

doi:10.1111/j.1460-9568.2008.06422.x

Cited by 416Neurotransmitter Receptor Influence on BehaviorNeural and Behavioral Psychology StudiesMemory and Neural Mechanisms

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Open access

Yin, Henry H., Ostlund, Sean B., Balleine, Bernard W.·2008·European Journal of Neuroscience

DOI 10.1111/j.1460-9568.2008.06422.xPMC PMC2756656

Open this paper in CoChat — free account Open PDF

Abstract

Here we challenge the view that reward‐guided learning is solely controlled by the mesoaccumbens pathway arising from dopaminergic neurons in the ventral tegmental area and projecting to the nucleus accumbens. This widely accepted view assumes that reward is a monolithic concept, but recent work has suggested otherwise. It now appears that, in reward‐guided learning, the functions of ventral and dorsal striata, and the cortico‐basal ganglia circuitry associated with them, can be dissociated. Whereas the nucleus accumbens is necessary for the acquisition and expression of certain appetitive Pavlovian responses and contributes to the motivational control of instrumental performance, the dorsal striatum is necessary for the acquisition and expression of instrumental actions. Such findings suggest the existence of multiple independent yet interacting functional systems that are implemented in iterating and hierarchically organized cortico‐basal ganglia networks engaged in appetitive behaviors ranging from Pavlovian approach responses to goal‐directed instrumental actions controlled by action‐outcome contingencies.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1111/j.1460-9568.2008.06422.x

Cites

170 of 170 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The ventral striatum guides performance of goal-directed behaviors.
“The VS guides performance of goal-directed behaviors (Cardinal et al., 2002a; Yin et al., 2008; Hart et al., 2014)”
From A framework for understanding the emerging role of corticolimbic-ventral striatal networks in OCD-associated repetitive behaviors (2015) · cites this paper as Yin et al., 2008
Strong evidence shows that the ventral striatum is essential for Pavlovian conditioning.
“Strong evidence shows that VS is essential for Pavlovian conditioning (Cardinal et al., 2002a; Yin et al., 2008)”
From A framework for understanding the emerging role of corticolimbic-ventral striatal networks in OCD-associated repetitive behaviors (2015) · cites this paper as Yin et al., 2008
The shift from goal-directed actions to stimulus-response habits typically occurs slowly as a result of extended training.
“The shift from goal-directed actions to stimulus-response (S-R) habits typically occurs slowly as a result of extended training [19], but lesions of the associative striatum can greatly speed this process.”
From Cortical and basal ganglia contributions to habit learning and automaticity (2010) · cites this paper as [19]
Striatal regions support dissociable associative learning strategies that may respectively dominate at various stages of training, depending on the task.
“a more parsimonious interpretation is that striatal regions support dissociable associative learning strategies that may respectively dominate at various stages of training, depending on the task [3,50,51].”
From Contributions of the striatum to learning, motivation, and performance: an associative account (2012) · cites this paper as [51]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The mouse brain in stereotaxic coordinates
Konsman, J. (2003) · Psychoneuroendocrinology · doi:10.1016/s0306-4530(03)00088-x · Cited by 16,796 · see citing works
The Mouse Brain in Stereotaxic Coordinates
Paxinos, G. (2001) · Cited by 12,859 · see citing works
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.09.030186.002041 · Cited by 8,527 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Principles of Behavior
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,061 · see citing works
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · see citing works
Behavior of Organisms
Skinner, B. F. (1938) · Cited by 3,184 · see citing works
NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory
Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647 · see citing works
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,631 · see citing works
The Psychology of Animal Learning
Hill, W. F., & Mackintosh, N. J. (1976) · The American Journal of Psychology · doi:10.2307/1421765 · Cited by 2,397 · see citing works
Handbook of operant behavior
Turner, R. M. (1978) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(78)90073-3 · Cited by 2,269 · see citing works
Reinforcement learning
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00007-6 · Cited by 2,129 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
The psychology of animal learning
Lea, S. E. G. (1975) · Animal Behaviour · doi:10.1016/0003-3472(75)90150-5 · Cited by 2,067 · see citing works
10. Reinforcement learning
Zhang, B., Li, C., & Lin, N. (2020) · De Gruyter eBooks · doi:10.1515/9783110595567-011 · Cited by 1,939 · see citing works
Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · see citing works
AUTO‐SHAPING OF THE PIGEON'S KEY‐PECK1
Brown, P. L., & Jenkins, H. M. (1968) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1968.11-1 · Cited by 1,544 · see citing works
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Self-citation
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · cited 2× · see citing works
“…many Pavlovian CRs are autonomic or consummatory, other CRs, such as approach behavior towards a reward, are not so conveniently characterized (Rescorla & Solomon, 1967); indeed, they can easily be mistaken for instrumental actions (Brown & Jenkins, 1968; Williams & Williams, 1969; Schwartz &…”
BackgroundMethod
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · see citing works
Integrative activity of the brain
Konorski, J. (1967) · Cited by 1,372 · see citing works
Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226 · see citing works
Self-citation
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
The psychology of learning
Guthrie, E. R. (1935) · Medical Entomology and Zoology · Cited by 1,186 · see citing works
Addiction, Dopamine, and the Molecular Mechanisms of Memory
Berke, J. D., & Hyman, S. E. (2000) · Neuron · doi:10.1016/s0896-6273(00)81056-9 · Cited by 1,167 · see citing works
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · see citing works
Animal intelligence; experimental studies
Thorndike, E. L. (1911) · doi:10.5962/bhl.title.55072 · Cited by 1,100 · see citing works
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · see citing works
Self-citation
Probability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · cited 3× · see citing works
“contingency, whereas Pavlovian responses are sensitive to manipulations of the stimulus–outcome contingency (Rescorla, 1968; Davis & Bitterman, 1971; Dickinson & Charnock, 1985).”
Background
Reinforcement, expectancy, and learning.
Bolles, R. C. (1972) · Psychological Review · doi:10.1037/h0033120 · Cited by 1,059 · see citing works
Regulation of firing of dopaminergic neurons and control of goal-directed behaviors
Grace, A. A., Floresco, S. B., Goto, Y., & Lodge, D. J. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.003 · Cited by 1,034 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Handbook of Operant Behavior
Honig, W. K., & Staddon, J. E. R. (2022) · Routledge eBooks · doi:10.4324/9781003256670 · Cited by 970 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Efferent connections and nigral afferents of the nucleus accumbens septi in the rat
Nauta, W. J. H., Smith, G. P., Faull, R. L. M., & Domesick, V. B. (1978) · Neuroscience · doi:10.1016/0306-4522(78)90041-6 · Cited by 876 · see citing works
Reward, Motivation, and Reinforcement Learning
Dayan, P., & Balleine, B. W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00963-7 · Cited by 855 · see citing works
Self-citation
Cerebral hemisphere regulation of motivated behavior
Swanson, L. W. (2000) · Brain Research · doi:10.1016/s0006-8993(00)02905-x · Cited by 846 · see citing works
Animal Intelligence. Experimental Studies
Thorndike, E. L., & Jelliffe (1912) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-191205000-00016 · Cited by 824 · see citing works
Handbook of Contemporary Learning Theories
Mowrer, R. R. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691 · Cited by 789 · see citing works
Intra-Accumbens Amphetamine Increases the Conditioned Incentive Salience of Sucrose Reward: Enhancement of Reward “Wanting” without Enhanced “Liking” or Response Reinforcement
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764 · cited 2× · see citing works
“As an initial step in this direction, we hope that the framework discussed here will serve as a useful starting point for future investigation.”
Background
Memory in the Cerebral Cortex
FOSTER, J. M. (1996) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199606000-00014 · Cited by 755 · see citing works
AUTO‐MAINTENANCE IN THE PIGEON: SUSTAINED PECKING DESPITE CONTINGENT NON‐REINFORCEMENT2
Williams, D. R., & Williams, H. G. (1969) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1969.12-511 · Cited by 717 · see citing works
Behavioral studies of Pavlovian conditioning
Rescorla, R. A. (1988) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.11.030188.001553 · Cited by 715 · see citing works
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · see citing works
Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum
Belin, D., & Everitt, B. J. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.019 · Cited by 697 · see citing works
Instrumental Responding following Reinforcer Devaluation
Adams, C. D., & Dickinson, A. (1981) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748108400816 · Cited by 687 · see citing works
Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation
Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 635 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Anatomy of motor learning. I. Frontal cortex and attention to action
Jueptner, M., Stephan, K. M., Frith, C. D., Brooks, D. J., Frackowiak, R. S. J., & Passingham, R. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.3.1313 · Cited by 624 · see citing works
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · see citing works
Self-citation
The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum
Joel, D., & Weiner, I. (2000) · Neuroscience · doi:10.1016/s0306-4522(99)00575-8 · Cited by 614 · see citing works
Nicotine amplifies reward-related dopamine signals in striatum
Rice, M. E., & Cragg, S. J. (2004) · Nature Neuroscience · doi:10.1038/nn1244 · Cited by 594 · see citing works
The learning curve: implications of a quantitative analysis.
Gallistel, C., Fairhurst, S. P., & Balsam, P. (2004) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.0404965101 · Cited by 587 · see citing works
Functional properties of monkey caudate neurons. III. Activities related to expectation of target and reward
Hikosaka, O., Sakamoto, M., & Usui, S. (1989) · Journal of Neurophysiology · doi:10.1152/jn.1989.61.4.814 · Cited by 579 · see citing works
Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior
Goto, Y., & Grace, A. A. (2005) · Nature Neuroscience · doi:10.1038/nn1471 · Cited by 576 · see citing works
Modulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 575 · see citing works
The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · see citing works
Self-citation
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 555 · see citing works
Dissociation in Effects of Lesions of the Nucleus Accumbens Core and Shell on Appetitive Pavlovian Approach Behavior and the Potentiation of Conditioned Reinforcement and Locomotor Activity byd-Amphetamine
Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W., & Everitt, B. J. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-06-02401.1999 · Cited by 555 · see citing works
Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning
YIN, H., KNOWLTON, B., & BALLEINE, B. (2006) · Behavioural Brain Research · doi:10.1016/j.bbr.2005.07.012 · Cited by 532 · see citing works
Self-citation
Dopamine-dependent plasticity of corticostriatal synapses
Reynolds, J. N. J., & Wickens, J. R. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00045-x · Cited by 528 · see citing works
Chapter 5 The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization
Groenewegen, H. J., Berendse, H. W., Wolters, J. G., & Lohman, A. H. M. (1991) · Progress in brain research · doi:10.1016/s0079-6123(08)62677-1 · Cited by 506 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens
Zahm, D. S. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(99)00065-2 · Cited by 487 · see citing works
Handbook of Implicit Cognition and Addiction
Wiers, R., & Stacy, A. (2006) · doi:10.4135/9781412976237 · Cited by 474 · see citing works
Reward Value Coding Distinct From Risk Attitude-Related Uncertainty Coding in Human Reward Systems
Tobler, P. N., O'Doherty, J. P., Dolan, R. J., & Schultz, W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00745.2006 · Cited by 472 · see citing works
Anatomy of Motor Learning. II. Subcortical Structures and Learning by Trial and Error
Jueptner, M., Frith, C., Brooks, D. J., Frackowiak, R. S. J., & Passingham, R. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.3.1325 · Cited by 466 · see citing works
Memory in the cerebral cortex
Fuster, J. M. (1999) · Cited by 456 · see citing works
Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output
Roitman, M. F., Wheeler, R. A., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.055 · Cited by 453 · see citing works
Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · see citing works
Self-citation
Hedonic Hot Spots in the Brain
Peciña, S., Smith, K. S., & Berridge, K. C. (2006) · The Neuroscientist · doi:10.1177/1073858406293154 · Cited by 441 · see citing works
Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning
Haruno, M., & Kawato, M. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00382.2005 · Cited by 433 · see citing works
The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated
Joel, D., & Weiner, I. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90536-3 · Cited by 430 · see citing works
The role of prelimbic cortex in instrumental conditioning
Corbit, L. H., & Balleine, B. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.023 · Cited by 423 · see citing works
Self-citation
Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · see citing works
Relations between Pavlovian-instrumental transfer and reinforcer devaluation
Holland, P. C. (2004) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.30.2.104 · Cited by 388 · see citing works
The Role of Learning in the Operation of Motivational Systems
Dickinson, A., & Balleine, B. W. (2002) · Wiley eBooks · doi:10.1002/0471214426.pas0312 · Cited by 387 · see citing works
Self-citation
Discrimination of cues in mazes: A resolution of the "place-vs.-response" question.
Restle, F. (1957) · Psychological Review · doi:10.1037/h0040678 · Cited by 386 · see citing works
Design for a Brain
Ashby, W. R. (1960) · Springer eBooks · doi:10.1007/978-94-015-1320-3 · Cited by 383 · see citing works
Influence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380 · see citing works
Differential roles of monkey striatum in learning of sequential hand movement
Miyachi, S., Hikosaka, O., Miyashita, K., Kárádi, Z., & Rand, M. K. (1997) · Experimental Brain Research · doi:10.1007/pl00005669 · Cited by 374 · see citing works
Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice
Costa, R. M., Cohen, D., & Nicolelis, M. A. L. (2004) · Current Biology · doi:10.1016/j.cub.2004.06.053 · Cited by 373 · see citing works
Differential involvement of NMDA, AMPA/kainate and dopamine receptors in the nucleus accumbens core in the acquisition and performance of pavlovian approach behavior
Di Ciano, P., Cardinal, R. N., Cowell, R. A., Little, S. J., & Everitt, B. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-23-09471.2001 · Cited by 354 · see citing works
Dopamine spillover after quantal release: Rethinking dopamine transmission in the nigrostriatal pathway
Rice, M. E., & Cragg, S. J. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2008.02.004 · Cited by 340 · see citing works
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 337 · see citing works
The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning.
Holland, P. C., & Rescorla, R. A. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.1.4.355 · Cited by 326 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Self-citation
Animal Learning and Cognition
(1994) · Elsevier eBooks · doi:10.1016/c2009-0-02316-2 · Cited by 325 · see citing works
Coincident Activation of NMDA and Dopamine D1Receptors within the Nucleus Accumbens Core Is Required for Appetitive Instrumental Learning
Smith‐Roe, S. L., & Kelley, A. E. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-20-07737.2000 · Cited by 321 · see citing works
Spatial Representation: Problems in Philosophy and Psychology
Eilan, N., McCarthy, R. A., & Brewer, B. (1999) · Cited by 316 · see citing works
Disconnection of the anterior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: further evidence for limbic cortical–ventral striatopallidal systems
Parkinson, J. A., Willoughby, P. J., Robbins, T. W., & Everitt, B. J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.1.42 · Cited by 314 · see citing works
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J. W., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 312 · see citing works
Disconnection of the anterior cingulate cortex and nucleus accumbens core impairs Pavlovian approach behavior: Further evidence for limbic cortical-ventral striatopallidal systems.
Parkinson, J. A., Willoughby, P. J., Robbins, T. W., & Everitt, B. J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.1.42 · Cited by 309 · see citing works
How the Basal Ganglia Use Parallel Excitatory and Inhibitory Learning Pathways to Selectively Respond to Unexpected Rewarding Cues
Brown, J. W., Bullock, D. H., & Grossberg, S. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-23-10502.1999 · Cited by 302 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · see citing works
THE EFFECT OF CONTINGENCY UPON THE APPETITIVE CONDITIONING OF FREE‐OPERANT BEHAVIOR
Hammond, L. J. (1980) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1980.34-297 · Cited by 291 · see citing works
Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: implications for mesoaccumbens dopamine function
Parkinson, J. A., Dalley, J. W., Cardinal, R. N., Bamford, A., Fehnert, B., Lachenal, G., Rudarakanchana, N., Halkerston, K. M., Robbins, T. W., & Everitt, B. J. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00291-7 · Cited by 288 · see citing works
The Experimental Analysis of Behavior.
Skinner, B. F. (2007) · Appleton-Century-Crofts eBooks · doi:10.1037/11324-008 · Cited by 269 · see citing works
Neural signature of fictive learning signals in a sequential investment task
Lohrenz, T. M., McCabe, K., Camerer, C. F., & Montague, P. R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0608842104 · Cited by 263 · see citing works
Differential activation of monkey striatal neurons in the early and late stages of procedural learning
Miyachi, S., Hikosaka, O., & Lu, X. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1213-7 · Cited by 262 · see citing works
Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus.
Lovibond, P. (1983) · Journal of experimental psychology. Animal behavior processes · doi:10.1037/0097-7403.9.3.225 · Cited by 257 · see citing works
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J. W., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.3.468 · Cited by 249 · see citing works
Motivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246 · see citing works
Associative Structures In Instrumental Learning
Colwill, R., & Rescorla, R. (1986) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60016-x · Cited by 242 · see citing works
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241 · see citing works
Contributions of Striatal Subregions to Place and Response Learning
Yin, H. H., & Knowlton, B. J. (2004) · Learning & Memory · doi:10.1101/lm.81004 · Cited by 238 · see citing works
Self-citation
The Nucleus Accumbens and Pavlovian Reward Learning
Day, J. J., & Carelli, R. M. (2007) · The Neuroscientist · doi:10.1177/1073858406295854 · Cited by 235 · see citing works
General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area
Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05934.x · Cited by 231 · see citing works
Self-citation
The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning.
Holland, P. C., & Rescorla, R. A. (1975) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.1.4.355 · Cited by 222 · see citing works
Encoding of Palatability and Appetitive Behaviors by Distinct Neuronal Populations in the Nucleus Accumbens
Taha, S. A., & Fields, H. L. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.3975-04.2005 · Cited by 217 · see citing works
The role of secondary reinforcement in delayed reward learning.
Spence, K. W. (1947) · Psychological Review · doi:10.1037/h0056533 · Cited by 214 · see citing works
Time-limited modulation of appetitive Pavlovian memory by D1 and NMDA receptors in the nucleus accumbens
Dalley, J. W., Lääne, K., Theobald, D. E. H., Armstrong, H. C., Corlett, P. R., Chudasama, Y., & Robbins, T. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502080102 · Cited by 214 · see citing works
Human neural learning depends on reward prediction errors in the blocking paradigm.
Tobler, P. N., O’Doherty, J. P., Dolan, R. J., & Schultz, W. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00762.2005 · Cited by 209 · see citing works
Coordinated Accumbal Dopamine Release and Neural Activity Drive Goal-Directed Behavior
Cheer, J. F., Aragona, B. J., Heien, M. L., Seipel, A. T., Carelli, R. M., & Wightman, R. M. (2007) · Neuron · doi:10.1016/j.neuron.2007.03.021 · Cited by 202 · see citing works
Instrumental Conditioning
Dickinson, A. (1994) · Animal Learning and Cognition · doi:10.1016/b978-0-08-057169-0.50009-7 · Cited by 200 · see citing works
Differential Involvement of the Basolateral Amygdala and Mediodorsal Thalamus in Instrumental Action Selection
Ostlund, S. B., & Balleine, B. W. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5472-07.2008 · Cited by 198 · see citing works
Self-citation
Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2003) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2003.02833.x · Cited by 186 · see citing works
Self-citation
Early consolidation of instrumental learning requires protein synthesis in the nucleus accumbens
Hernandez, P. J., Sadeghian, K., & Kelley, A. E. (2002) · Nature Neuroscience · doi:10.1038/nn973 · Cited by 186 · see citing works
Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive‐choice behaviour and salience learning in rats
Pothuizen, H. H. J., Jongen‐Rêlo, A. L., Feldon, J., & Yee, B. K. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04388.x · Cited by 183 · see citing works
Inhibitions of Nucleus Accumbens Neurons Encode a Gating Signal for Reward-Directed Behavior
Taha, S. A., & Fields, H. L. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3227-05.2006 · Cited by 171 · see citing works
The phasic reward signal of primate dopamine neurons
Schultz, W. (1997) · Advances in Pharmacology · doi:10.1016/s1054-3589(08)60841-8 · Cited by 169 · see citing works
A demonstration of observational learning in rats using a bidirectional control.
Heyes, C., & Gr, D. (1990) · PubMed · Cited by 166 · see citing works
Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix
WICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165 · see citing works
Behavior Theory and Learning: Selected Papers.
Spence, K. W. (1960) · Prentice-Hall, Inc eBooks · doi:10.1037/11444-000 · Cited by 158 · see citing works
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning
Haruno, M., & Kawato, M. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.06.007 · Cited by 152 · see citing works
Methamphetamine‐induced structural plasticity in the dorsal striatum
Jedynak, J., Uslaner, J. M., Esteban, J. A., & Robinson, T. E. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05316.x · Cited by 151 · see citing works
An approach through the looking-glass
Hershberger, W. A. (1986) · Animal Learning & Behavior · doi:10.3758/bf03200092 · Cited by 149 · see citing works
Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm
Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04654.x · Cited by 140 · see citing works
Dopamine Scales Performance in the Absence of New Learning
Cagniard, B., Beeler, J. A., Britt, J. P., McGehee, D. S., Marinelli, M., & Zhuang, X. (2006) · Neuron · doi:10.1016/j.neuron.2006.07.026 · Cited by 129 · see citing works
The evolving theory of basal forebrain functional—anatomical ‘macrosystems’
Zahm, D. S. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.06.003 · Cited by 128 · see citing works
Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats
de Borchgrave, R., Rawlins, J. N. P., Dickinson, A., & Balleine, B. W. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1031-y · Cited by 123 · see citing works
Self-citation
Inactivation of the Lateral But Not Medial Dorsal Striatum Eliminates the Excitatory Impact of Pavlovian Stimuli on Instrumental Responding
Corbit, L. H., & Janak, P. H. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.4097-07.2007 · Cited by 122 · see citing works
Contingency Effects with Maintained Instrumental Reinforcement
Dickinson, A., & Charnock, D. J. K. (1985) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748508401177 · Cited by 115 · see citing works
Dysregulation of dopamine signaling in the dorsal striatum inhibits feeding
Sotak, B. N., Hnasko, T. S., Robinson, S., Kremer, E. J., & Palmiter, R. D. (2005) · Brain Research · doi:10.1016/j.brainres.2005.08.053 · Cited by 113 · see citing works
Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats.
Holland, P. C. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.5.2.178 · Cited by 109 · see citing works
A functional hypothesis concerning the striatal matrix and patches: Mediation of SR memory and reward
White, N. M. (1989) · Life Sciences · doi:10.1016/0024-3205(89)90569-9 · Cited by 100 · see citing works
Incentive Processes in Instrumental Conditioning
Balleine, B. W. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691-14 · Cited by 99 · see citing works
Self-citation
Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat
Cardinal, R. N., & Cheung, T. H. C. (2005) · BMC Neuroscience · doi:10.1186/1471-2202-6-9 · Cited by 98 · see citing works
Inactivation of the ventral tegmental area abolished the general excitatory influence of Pavlovian cues on instrumental performancePreprint
Murschall, A., & Hauber, W. (2006) · Learning & Memory · doi:10.1101/lm.127106 · Cited by 97 · see citing works
Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats.
Holland, P. C. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.2.178 · Cited by 84 · see citing works
AMPA/kainate, NMDA, and dopamine D1 receptor function in the nucleus accumbens core: A context-limited role in the encoding and consolidation of instrumental memoryPreprint
Hernandez, P. J., Andrzejewski, M. E., Sadeghian, K., Panksepp, J. B., & Kelley, A. E. (2005) · Learning & Memory · doi:10.1101/lm.93105 · Cited by 79 · see citing works
Viral restoration of dopamine signaling to the dorsal striatum restores instrumental conditioning to dopamine-deficient mice
Robinson, S., Rainwater, A., Hnasko, T. S., & Palmiter, R. D. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0579-9 · Cited by 77 · see citing works
Instrumental learning in hyperdopaminergic mice
Yin, H. H., Zhuang, X., & Balleine, B. W. (2006) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2005.12.001 · Cited by 77 · see citing works
Self-citation
Neurology and Psychiatry--A Meeting of Minds
Ron, M. A. (1989) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.52.9.1120 · Cited by 72 · see citing works
Functional Domains in Dorsal Striatum of the Nonhuman Primate Are Defined by the Dynamic Behavior of Dopamine
Cragg, S. J., Hille, C. J., & Greenfield, S. A. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-13-05705.2002 · Cited by 66 · see citing works
Bidirectional Instrumental Conditioning
Dickinson, A., Campos, J., Varga, Z., & Balleine, B. (1996) · The Quarterly journal of experimental psychology. B, Comparative and physiological psychology · doi:10.1080/713932637 · Cited by 59 · see citing works
Self-citation
DIFFERENTIAL REINFORCEMENT OF OTHER BEHAVIOR (DRO): A YOKED‐CONTROL COMPARISON1
Davis, J., & Bitterman, M. E. (1971) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1971.15-237 · Cited by 53 · see citing works
Classical Conditioning
Mallea, J., Bustamante, J., Míguez, G., & Laborda, M. A. (2019) · Springer eBooks · doi:10.1007/978-3-319-47829-6_1214-1 · Cited by 51 · see citing works
Meaning and Purpose in the Intact Brain
Miller, R. A. (1981) · Cited by 48 · see citing works
Separation of the Salivary and Motor Responses in Instrumental Conditioning
Ellison, G. D., & Konorski, J. (1964) · Science · doi:10.1126/science.146.3647.1071 · Cited by 45 · see citing works
Reciprocal Links of the Corpus striatum with the Cerebral Cortex and Limbic System: A Common Substrate for Movement and Thought?
Nauta, W. J. K. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4684-7920-1_30 · Cited by 40 · see citing works
The influence of Pavlovian cues on instrumental performance is mediated by CaMKII activity in the striatum
Wiltgen, B., Law, M., Ostlund, S. B., Mayford, M., & Balleine, B. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05487.x · Cited by 34 · see citing works
Self-citation
Reinforcer devaluation abolishes conditioned cue preference: Evidence for stimulus-stimulus associations.
Yin, H. H., & Knowlton, B. J. (2002) · Behavioral Neuroscience · doi:10.1037//0735-7044.116.1.174 · Cited by 27 · see citing works
Self-citation
Neurophysiological aspects of the differential roles of the putamen and caudate nucleus in voluntary movement.
Kimura, M., Aosaki, T., & Ishida, A. (1993) · PubMed · Cited by 27 · see citing works
Design for a Brain, Second Edition
Smith, L. K. (1969) · Physical Therapy · doi:10.1093/ptj/49.2.217 · Cited by 25 · see citing works
The roles of event contingencies and reinforcement in human autoshaping and omission responding
Pithers, R. T. (1985) · Learning and Motivation · doi:10.1016/0023-9690(85)90013-x · Cited by 22 · see citing works
Reinforcement learning
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets60632 · Cited by 20 · see citing works
Reinforcer devaluation abolishes conditioned cue preference: Evidence for stimulus-stimulus associations.
Yin, H. H., & Knowlton, B. J. (2002) · Behavioral Neuroscience · doi:10.1037/0735-7044.116.1.174 · Cited by 15 · see citing works
Self-citation
Knowing without doing
Lerchner, A., Camera, G. L., & Richmond, B. J. (2006) · Nature Neuroscience · doi:10.1038/nn0107-15 · Cited by 13 · see citing works
Roles of dopamine and its receptors in generation of choreic movements.
Kanazawa, I., Murata, M., & Kimura, M. (1993) · PubMed · Cited by 9 · see citing works

Flagged first, then by citations

Research works printed but not linked: 1

Balleine BW Corbit LH Lesions of accumbens core and shell produce dissociable effects on the general and outcome-specific forms of Palovian-instrumental transfer Annual Meeting of the Society for Neuroscience 2005 PMC3208020 21849539

Sorted by citations

Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
Balleine, B. W., & O'Doherty, J. P. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.131 · Cited by 1,775 · see citing works
Self-citation
The mysterious motivational functions of mesolimbic dopamine
Salamone, J. D., & Correa, M. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.021 · Cited by 1,418 · see citing works
The glutamate homeostasis hypothesis of addiction
Kalivas, P. W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2515 · Cited by 1,350 · see citing works
Optimizing performance through intrinsic motivation and attention for learning: The OPTIMAL theory of motor learning
Wulf, G., & Lewthwaite, R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0999-9 · Cited by 1,238 · see citing works
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938 · see citing works
Cortico-Basal Ganglia Reward Network: Microcircuitry
Sesack, S. R., & Grace, A. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2009.93 · Cited by 985 · see citing works
Chronic Stress Causes Frontostriatal Reorganization and Affects Decision-Making
Dias-Ferreira, E., Sousa, J. C., Melo, I., Morgado, P., Mesquita, A. R., Cerqueira, J. J., Costa, R. M., & Sousa, N. (2009) · Science · doi:10.1126/science.1171203 · Cited by 858 · see citing works
The nucleus accumbens: a comprehensive review
Salgado, S., & Kaplitt, M. G. (2015) · Stereotactic and Functional Neurosurgery · doi:10.1159/000368279 · Cited by 489 · see citing works
Neurotransmitter roles in synaptic modulation, plasticity and learning in the dorsal striatum
Lovinger, D. M. (2010) · Neuropharmacology · doi:10.1016/j.neuropharm.2010.01.008 · Cited by 488 · see citing works
Cortical and basal ganglia contributions to habit learning and automaticity
Ashby, F. G., Turner, B. O., & Horvitz, J. C. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.02.001 · Cited by 481 · see citing works
Disentangling pleasure from incentive salience and learning signals in brain reward circuitry
Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101920108 · Cited by 464 · see citing works
The integrative function of the basal ganglia in instrumental conditioning
Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356 · see citing works
Self-citation
Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology
Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016) · Brain · doi:10.1093/brain/aww050 · Cited by 350 · see citing works
The neurobiology of social play and its rewarding value in rats
Vanderschuren, L. J. M. J., Achterberg, E. J. M., & Trezza, V. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.07.025 · Cited by 329 · see citing works
Contributions of the striatum to learning, motivation, and performance: an associative account
Liljeholm, M., & O’Doherty, J. P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.07.007 · Cited by 317 · see citing works
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297 · see citing works
Self-citation
Dopamine, behavioral economics, and effort
Salamone, J. D. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.013.2009 · Cited by 277 · see citing works
Internally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217 · see citing works
Mesolimbic Dopamine and the Regulation of Motivated Behavior
Salamone, J. D., Pardo, M., Yohn, S. E., López-Cruz, L., SanMiguel, N., & Correa, M. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_383 · Cited by 204 · see citing works
Going and stopping: dichotomies in behavioral control by the prefrontal cortex
Gourley, S. L., & Taylor, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4275 · Cited by 195 · see citing works
Binge-like consumption of a palatable food accelerates habitual control of behavior and is dependent on activation of the dorsolateral striatum
Furlong, T. M., Jayaweera, H. K., Balleine, B. W., & Corbit, L. H. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3707-13.2014 · Cited by 186 · see citing works
Self-citation
The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis
Mannella, F., Gurney, K., & Baldassarre, G. (2013) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2013.00135 · Cited by 166 · see citing works
The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental Simulation
Pezzulo, G., Rigoli, F., & Chersi, F. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00092 · Cited by 163 · see citing works
Inputs to the Dorsal Striatum of the Mouse Reflect the Parallel Circuit Architecture of the Forebrain
Pan, W. X., Mao, T., & Dudman, J. T. (2010) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2010.00147 · Cited by 150 · see citing works
Neurobiology of opioid dependence in creating addiction vulnerability
Evans, C. J., & Cahill, C. M. (2016) · F1000Research · doi:10.12688/f1000research.8369.1 · Cited by 146 · see citing works
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150 · see citing works
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136 · see citing works
Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement
DeRusso, A. L. (2010) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00017 · Cited by 111 · see citing works
The Acquisition of Goal-Directed Actions Generates Opposing Plasticity in Direct and Indirect Pathways in Dorsomedial Striatum
Shan, Q., Ge, M., Christie, M. J., & Balleine, B. W. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0313-14.2014 · Cited by 122 · see citing works
Self-citation
Operant self-stimulation of dopamine neurons in the substantia nigra
Rossi, M. A., Sukharnikova, T., Hayrapetyan, V. Y., Yang, L., & Yin, H. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065799 · Cited by 119 · see citing works
Self-citation
Human Dorsal Striatum Encodes Prediction Errors during Observational Learning of Instrumental Actions
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101 · see citing works
Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning
Ostlund, S. B., Wassum, K. M., Murphy, N. P., Balleine, B. W., & Maidment, N. T. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4759-10.2011 · Cited by 94 · see citing works
Self-citation
Endocannabinoid-mediated synaptic plasticity and addiction-related behavior
Sidhpura, N., & Parsons, L. H. (2011) · Neuropharmacology · doi:10.1016/j.neuropharm.2011.05.034 · Cited by 92 · see citing works
A framework for understanding the emerging role of corticolimbic-ventral striatal networks in OCD-associated repetitive behaviors
Wood, J., & Ahmari, S. E. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00171 · Cited by 85 · see citing works
“The Corticolimbic-Ventral Striatal Network Underlies Pavlovian Influences on Behavior Strong evidence shows that VS is essential for Pavlovian conditioning (Cardinal et al., 2002a; Yin et al., 2008), including studies demonstrating that lesions of the NAc core impair Pavlovian autoshaping (Parkinson et al.”
BackgroundInfluential
The roles of the nucleus accumbens core, dorsomedial striatum, and dorsolateral striatum in learning: Performance and extinction of Pavlovian fear-conditioned responses and instrumental avoidance responses
Wendler, E., Gaspar, J. C. C., Ferreira, T. L., Barbiero, J. K., Andreatini, R., Vital, M. A. B. F., Blaha, C. D., Winn, P., & Da Cunha, C. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.11.009 · Cited by 65 · see citing works
The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning
Lex, B., & Hauber, W. (2010) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2009.11.002 · Cited by 61 · see citing works
The neurobiology of social play behaviour: Past, present and future
Achterberg, E. J. M., & Vanderschuren, L. J. M. J. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105319 · Cited by 56 · see citing works
Exploring the neural basis of avatar identification in pathological Internet gamers and of self-reflection in pathological social network users
Leménager, T., Dieter, J., Hill, H., Hoffmann, S., Reinhard, I., Beutel, M., Vollstädt-Klein, S., Kiefer, F., & Mann, K. (2016) · Journal of Behavioral Addictions · doi:10.1556/2006.5.2016.048 · Cited by 55 · see citing works
Time-dependent effects of corticosterone on reward-based decision-making in a rodent model of the Iowa Gambling Task
Koot, S., Baars, A., Hesseling, P., van den Bos, R., & Joëls, M. (2013) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.02.008 · Cited by 46 · see citing works
Nicotinic alteration of decision-making
Naudé, J., Dongelmans, M., & Faure, P. (2015) · Neuropharmacology · doi:10.1016/j.neuropharm.2014.11.021 · Cited by 39 · see citing works
Central thalamic deep-brain stimulation alters striatal-thalamic connectivity in cognitive neural behavior
Lin, H.-C., Pan, H.-C., Lin, S.-H., Lo, Y.-C., Shen, E. T.-H., Liao, L.-D., Liao, P.-H., Chien, Y.-W., Liao, K.-D., Jaw, F.-S., et al. (2016) · Frontiers in Neural Circuits · doi:10.3389/fncir.2015.00087 · Cited by 29 · see citing works
Developmentally divergent effects of Rho-kinase inhibition on cocaine- and BDNF-induced behavioral plasticity
DePoy, L. M., Noble, B., Allen, A. G., & Gourley, S. L. (2013) · Behavioural Brain Research · doi:10.1016/j.bbr.2013.01.004 · Cited by 20 · see citing works

Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking
Mahler, S. V., Vazey, E. M., Beckley, J. T., Keistler, C., McGlinchey, E. M., Kaufling, J., Wilson, S. P., Deisseroth, K. A., Woodward, J. J., & Aston‐Jones, G. (2014) · Nature Neuroscience · doi:10.1038/nn.3664 · Cited by 344 · see citing works
Involvement of the ventral tegmental area opiate receptors in self-stimulation elicited from the ventral pallidum
Panagis, G., Kastellakis, A., & Spyraki, C. (1998) · Psychopharmacology · doi:10.1007/s002130050708 · Cited by 19 · see citing works
Faculty Opinions recommendation of Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking.
Shaham, Y., & Marchant, N. J. (2014) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.718293942.793494103
Ventral striatum and ventral pallidum
Heimer, L., Switzer, R. D., & Hoesen, G. W. V. (1982) · Trends in Neurosciences · doi:10.1016/0166-2236(82)90037-6 · Cited by 401 · see citing works
Faculty Opinions recommendation of Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking.
Berridge, K. C. (2014) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.718293942.793493335

Authors: Yin, H. H., Ostlund, S. B., & Balleine, B. W.
Affiliations: Duke University (US)
University of California, Los Angeles (US)
Corresponding author: Yin, Henry H.
ORCID: Yin, Henry H.
Ostlund, Sean B.
Balleine, Bernard W.
Venue: European Journal of Neuroscience
Publisher: Wiley
Published: 2008-10
Volume: 28
Issue: 8
Pages: 1437-1448
ISSN: 0953-816X (ISSN-L)
1460-9568
DOI: 10.1111/j.1460-9568.2008.06422.x
PMC: PMC2756656
OpenAlex: W2114586089
Cited by: 416
References: 170
Citations by year: 2026: 5 · 2025: 14 · 2024: 4 · 2023: 7 · 2022: 13 · 2021: 18 · 2020: 11 · 2019: 22 · 2018: 16 · 2017: 24 · 2016: 37 · 2015: 29 · 2014: 43 · 2013: 36 · 2012: 38
FWCI: 2.56
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: onlinelibrary.wiley.com/termsAndConditions#vor (vor)
Locations: European Journal of Neuroscience (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Institutes of Health
National Institute on Alcohol Abuse and Alcoholism (R01AA018014)
National Institute of Mental Health (R29MH056446, MH56446, R01MH056446, T32MH017140, MH 17140)
Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD059257, HD59257)
Topics: Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords: nucleus accumbens, ventral tegmental area, dopamine, dorsal striatum, ventral striatum, classical conditioning, operant conditioning, goal-directed behavior, action-outcome contingency, appetitive behavior, motivational control
MeSH terms: Animals, Cerebral Cortex, Conditioning, Psychological, Dopamine, Humans, Learning, Neural Pathways, Nucleus Accumbens, Reward, Volition, Neostriatum, Ventral Tegmental Area

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks