Reward, Motivation, and Reinforcement Learning
Open accessAbstract
There is substantial evidence that dopamine is involved in reward learning and appetitive conditioning. However, the major reinforcement learning-based theoretical models of classical conditioning (crudely, prediction learning) are actually based on rules designed to explain instrumental conditioning (action learning). Extensive anatomical, pharmacological, and psychological data, particularly concerning the impact of motivational manipulations, show that these models are unreasonable. We review the data and consider the involvement of a rich collection of different neural systems in various aspects of these forms of conditioning. Dopamine plays a pivotal, but complicated, role.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Self-citationAdvances in Neural Information Processing Systems 14
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 9,184 · see citing works
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035 · see citing works
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,406 · see citing works
The Psychology of Learning and Motivation
(2021) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(21)x0002-3 · Cited by 5,081 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131 · see citing works
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127 · see citing works
Neuronlike adaptive elements that can solve difficult learning control problems
Barto, A. G., Sutton, R. S., & Anderson, C. W. (1983) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1983.6313077 · Cited by 3,238 · see citing works
Gerfen, C. R., Engber, T. M., Mahan, L. C., Susel, Z., Chase, T. N., Monsma, F. J., & Sibley, D. R. (1990) · Science · doi:10.1126/science.2147780 · Cited by 2,967 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
The Psychology of Animal Learning
Hill, W. F., & Mackintosh, N. J. (1976) · The American Journal of Psychology · doi:10.2307/1421765 · Cited by 2,407 · see citing works
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Computational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122 · see citing works
The psychology of animal learning
Lea, S. E. G. (1975) · Animal Behaviour · doi:10.1016/0003-3472(75)90150-5 · Cited by 2,075 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Self-citationAn opponent-process theory of motivation. I. Temporal dynamics of affect
Solomon, R. L., & Corbit, J. D. (1974) · Psychological Review · doi:10.1037/h0036128 · Cited by 1,704 · see citing works
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · see citing works
The Orbitofrontal Cortex and Reward
Rolls, E. T. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.284 · Cited by 1,595 · see citing works
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Self-citationTwo-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · see citing works
The neostriatal mosaic: multiple levels of compartmental organization
Gerfen, C. R. (1992) · Trends in Neurosciences · doi:10.1016/0166-2236(92)90355-c · Cited by 1,471 · see citing works
Integrative activity of the brain
Konorski, J. (1967) · Cited by 1,372 · see citing works
The Basal Ganglia and Adaptive Motor Control
Graybiel, A. M., Aosaki, T., Flaherty, A. W., & Kimura, M. (1994) · Science · doi:10.1126/science.8091209 · Cited by 1,324 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Probability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · see citing works
5-HT and mechanisms of defence
Deakin, J. F. W., & Graeff, F. G. (1991) · Journal of Psychopharmacology · doi:10.1177/026988119100500414 · Cited by 1,011 · see citing works
Motivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995 · see citing works
Self-citationNeural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844 · see citing works
Self-citationHandbook of Contemporary Learning Theories
Mowrer, R. R. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691 · Cited by 789 · see citing works
Wyvell, C. L., & Berridge, K. C. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08122.2000 · Cited by 764 · see citing works
Dynamic Modeling in Behavioral Ecology.
Caraco, T. B., Newman, J. A., Mangel, M., & Clark, C. (1990) · Evolution · doi:10.2307/2409517 · Cited by 761 · see citing works
How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements
Bindra, D. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00059380 · Cited by 732 · see citing works
Neural Networks and Natural Intelligence
(1988) · The MIT Press eBooks · doi:10.7551/mitpress/4934.001.0001 · Cited by 720 · see citing works
Integrative activity of the brain : an interdisciplinary approach
Konorski, J. (1967) · University of Chicago Press eBooks · Cited by 716 · see citing works
Improving generalization for temporal difference learning: The successor representation
Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693 · see citing works
Self-citationConditioning factors in drug abuse: can they explain compulsion?
O’Brien, C. P., Childress, A. R., Ehrman, R. N., & Robbins, S. J. (1998) · Journal of Psychopharmacology · doi:10.1177/026988119801200103 · Cited by 680 · see citing works
Involvement of the amygdala in stimulus-reward associations: interaction with the ventral striatum
Cador, M., Robbins, T. W., & Everitt, B. J. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90354-0 · Cited by 652 · see citing works
Pettit, H. O., Ettenberg, A., Bloom, F. E., & Koob, G. F. (1984) · Psychopharmacology · doi:10.1007/bf00427441 · Cited by 651 · see citing works
Dynamic Modeling in Behavioral Ecology
Mangel, M., & Clark, C. (1989) · Princeton University Press eBooks · doi:10.1515/9780691206967 · Cited by 623 · see citing works
Bolles, R. C. (1967) · Medical Entomology and Zoology · Cited by 610 · see citing works
Test of optimal sampling by foraging great tits
Krebs, J. R., Kacelnik, A., & Taylor, P. (1978) · Nature · doi:10.1038/275027a0 · Cited by 599 · see citing works
A motivational view of learning, performance, and behavior modification.
Bindra, D. (1974) · Psychology Review · doi:10.1037/h0036330 · Cited by 580 · see citing works
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564 · see citing works
Self-citationGerfen, C. R. (1985) · The Journal of Comparative Neurology · doi:10.1002/cne.902360404 · Cited by 563 · see citing works
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 555 · see citing works
Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response.
Holland, P. C. (1977) · Journal of experimental psychology. Animal behavior processes · doi:10.1037/0097-7403.3.1.77 · Cited by 553 · see citing works
Chiara, G. D., & North, R. A. (1992) · Trends in Pharmacological Sciences · doi:10.1016/0165-6147(92)90062-b · Cited by 538 · see citing works
Conditioned stimulus as a determinant of the form of the Pavlovian conditioned response.
Holland, P. C. (1977) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.3.1.77 · Cited by 514 · see citing works
(1997) · The MIT Press eBooks · doi:10.7551/mitpress/3917.003.0017 · Cited by 497 · see citing works
Dopamine: generalization and bonuses
Kakade, S. M., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00048-5 · Cited by 477 · see citing works
Self-citationTaylor, J. R., & Robbins, T. W. (1984) · Psychopharmacology · doi:10.1007/bf00555222 · Cited by 440 · see citing works
Wyvell, C. L., & Berridge, K. C. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07831.2001 · Cited by 436 · see citing works
The cerebral cortex of the rat
(1991) · Comparative Biochemistry and Physiology Part A Physiology · doi:10.1016/0300-9629(91)90172-9 · Cited by 416 · see citing works
Peciña, S., & Berridge, K. C. (2000) · Brain Research · doi:10.1016/s0006-8993(00)02102-8 · Cited by 405 · see citing works
Rolls, E. T. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.599 · Cited by 347 · see citing works
Evolution of a Structured Connectionist Model of Pavlovian Conditioning (AESOP)
Klein, S. B., & Mowrer, R. R. (2014) · Psychology Press eBooks · doi:10.4324/9781315801896-13 · Cited by 330 · see citing works
(1994) · Elsevier eBooks · doi:10.1016/c2009-0-02316-2 · Cited by 325 · see citing works
Reward learning: reinforcement, incentives, and expectations
Berridge, K. C. (2000) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(00)80022-5 · Cited by 318 · see citing works
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J. W., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037//0735-7044.114.3.468 · Cited by 312 · see citing works
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
THE EFFECT OF CONTINGENCY UPON THE APPETITIVE CONDITIONING OF FREE‐OPERANT BEHAVIOR
Hammond, L. J. (1980) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1980.34-297 · Cited by 291 · see citing works
Taste responses and preferences for sweet high-fat foods: Evidence for opioid involvement☆
Drewnowski, A., Krahn, D. D., Demitrack, M. A., NAIRN, K., & Gosnell, B. A. (1992) · Physiology & Behavior · doi:10.1016/0031-9384(92)90155-u · Cited by 286 · see citing works
Motivational control after extended instrumental training
Dickinson, A., Balleine, B. W., Watt, A. A., González, F., & Boakes, R. A. (1995) · Animal Learning & Behavior · doi:10.3758/bf03199935 · Cited by 286 · see citing works
Self-citationGustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey
Rolls, E. T., Yaxley, S., & Sienkiewicz, Z. J. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.64.4.1055 · Cited by 282 · see citing works
McNamara, T. P. (1992) · Geoforum · doi:10.1016/0016-7185(92)90012-s · Cited by 282 · see citing works
Associations between the discriminative stimulus and the reinforcer in instrumental learning.
Colwill, R., & Rescorla, R. (1988) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.14.2.155 · Cited by 259 · see citing works
Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.
Dickinson, A., Smith, J. W., & Mirenowicz, J. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.3.468 · Cited by 249 · see citing works
Associative Structures In Instrumental Learning
Colwill, R., & Rescorla, R. (1986) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60016-x · Cited by 242 · see citing works
The neostriatal mosaic: multiple levels of compartmental organization
Gerfen, C. R. (1992) · Springer eBooks · doi:10.1007/978-3-7091-9211-5_4 · Cited by 232 · see citing works
Balleine, B. W., & Dickinson, A. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-23-08954.2000 · Cited by 218 · see citing works
Self-citationEveritt, B. J., & Stacey, P. (1987) · Journal of comparative psychology · doi:10.1037/0735-7036.101.4.407 · Cited by 210 · see citing works
Yaxley, S., Rolls, E. T., & Sienkiewicz, Z. J. (1988) · Physiology & Behavior · doi:10.1016/0031-9384(88)90074-1 · Cited by 206 · see citing works
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works
Kelley, A. E., Bless, E. P., & Swanson, C. J. (1996) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)20805-9 · Cited by 185 · see citing works
Instrumental performance following a shift in primary motivation depends on incentive learning.
Balleine, B. W. (1992) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.18.3.236 · Cited by 181 · see citing works
Self-citationTemporal Difference Model Reproduces Anticipatory Neural Activity
Suri, R. E., & Schultz, W. (2001) · Neural Computation · doi:10.1162/089976601300014376 · Cited by 166 · see citing works
Information processing in the taste system of primates
Rolls, E. T. (1989) · Journal of Experimental Biology · doi:10.1242/jeb.146.1.141 · Cited by 156 · see citing works
Howland, J. G., Taepavarapruk, P., & Phillips, A. G. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-03-01137.2002 · Cited by 155 · see citing works
An approach through the looking-glass
Hershberger, W. A. (1986) · Animal Learning & Behavior · doi:10.3758/bf03200092 · Cited by 149 · see citing works
Peciña, S. (1997) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(97)00044-0 · Cited by 148 · see citing works
Effects of ibotenic acid lesions of the Nucleus Accumbens on instrumental action
Balleine, B. W., & Killcross, S. (1994) · Behavioural Brain Research · doi:10.1016/0166-4328(94)90104-x · Cited by 142 · see citing works
Self-citationParker, L. A., Maier, S., Rennie, M., & Crebolder, J. (1992) · Behavioral Neuroscience · doi:10.1037//0735-7044.106.6.999 · Cited by 142 · see citing works
Learning, motivation, and cognition: The functional behaviorism of Robert C. Bolles.
(1997) · American Psychological Association eBooks · doi:10.1037/10223-000 · Cited by 140 · see citing works
TD models of reward predictive responses in dopamine neurons
Suri, R. E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00046-1 · Cited by 137 · see citing works
Gong, W., Neill, D. B., & Justice, J. B. (1996) · Brain Research · doi:10.1016/0006-8993(95)01222-2 · Cited by 134 · see citing works
Morphine enhances hedonic taste palatability in rats
Doyle, T. G., Berridge, K. C., & Gosnell, B. A. (1993) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(93)90572-b · Cited by 131 · see citing works
AppetiteNeural and Behavioural Bases
Legg, C. R., & Booth, D. (1994) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198547877.001.0001 · Cited by 130 · see citing works
Palatability shift of a salt-associated incentive during sodium depletion.
Berridge, K. C., & Schulkin, J. A. (1989) · PubMed · Cited by 127 · see citing works
Instrumental Performance following Reinforcer Devaluation Depends upon Incentive Learning
Balleine, B., & Dickinson, A. (1991) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640749108401271 · Cited by 126 · see citing works
Self-citationParker, L. A., Maier, S., Rennie, M., et al. (1992) · Behavioral Neuroscience · doi:10.1037/0735-7044.106.6.999 · Cited by 126 · see citing works
Contemporary Learning Theories
(2019) · Routledge eBooks · doi:10.4324/9781315788982 · Cited by 125 · see citing works
Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats
de Borchgrave, R., Rawlins, J. N. P., Dickinson, A., & Balleine, B. W. (2002) · Experimental Brain Research · doi:10.1007/s00221-002-1031-y · Cited by 123 · see citing works
Self-citationPavlovian Processes in the Motivational Control of Instrumental Performance
Dickinson, A., & Dawson, G. (1987) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748708402264 · Cited by 118 · see citing works
Motivational Control of Instrumental Action
Dickinson, A., & Balleine, B. W. (1995) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep11512272 · Cited by 116 · see citing works
Self-citationHollis, K. L., Pharr, V. L., Dumas, M. J., et al. (1997) · Journal of comparative psychology · doi:10.1037/0735-7036.111.3.219 · Cited by 112 · see citing works
Holland, P. C. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.5.2.178 · Cited by 109 · see citing works
Encoding of the unconditioned stimulus in Pavlovian conditioning
Colwill, R. M., & Motzkin, D. K. (1994) · Animal Learning & Behavior · doi:10.3758/bf03209158 · Cited by 107 · see citing works
Centrally administered opioid peptides stimulate saccharin intake in nondeprived rats
Gosnell, B. A., & Majchrzak, M. J. (1989) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(89)90474-7 · Cited by 101 · see citing works
Incentive Processes in Instrumental Conditioning
Balleine, B. W. (2000) · Psychology Press eBooks · doi:10.4324/9781410600691-14 · Cited by 99 · see citing works
Self-citationPhillips, A. G., LePiane, F. G., & Fibiger, H. C. (1983) · Life Sciences · doi:10.1016/0024-3205(83)90159-5 · Cited by 95 · see citing works
Omission Learning after Instrumental Pretraining
Dickinson, A. (2010) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/713932679 · Cited by 93 · see citing works
Simultaneous second-order conditioning produces S-S learning in conditioned suppression.
Rescorla, R. A. (1982) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.8.1.23 · Cited by 84 · see citing works
Holland, P. C. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.2.178 · Cited by 84 · see citing works
Naltrexone, an opioid blocker, alters taste perception and nutrient intake in humans
Bertino, M., Beauchamp, G. K., & Engelman, K. (1991) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.1991.261.1.r59 · Cited by 83 · see citing works
Johnson, P. I., Stellar, J. R., & Paul, A. D. (1993) · Neuropharmacology · doi:10.1016/0028-3908(93)90025-x · Cited by 81 · see citing works
Dworkin, S. I., Guerin, G. F., Co, C., Goeders, N. E., & Smith, J. E. (1988) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(88)90138-4 · Cited by 79 · see citing works
Asymmetrical interactions between thirst and hunger in Pavlovian-instrumental transfer.
Balleine, B. W. (1994) · PubMed · Cited by 75 · see citing works
Self-citationDeBold, R. C., Miller, N. E., & Jensen, D. D. (1965) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0021632 · Cited by 74 · see citing works
Contemporary Learning Theories
Koppel, P. D. (2024) · Springer Publishing Company eBooks · doi:10.1891/9780826188922.0003 · Cited by 73 · see citing works
Reinforcer specificity of the suppression of instrumental performance on a non-contingent schedule
Dickinson, A., & Mulatero, C. W. (1989) · Behavioural Processes · doi:10.1016/0376-6357(89)90039-9 · Cited by 67 · see citing works
Signalling and incentive processes in instrumental reinforcer devaluation.
Balleine, B. W., & Dickinson, A. (1992) · PubMed · Cited by 65 · see citing works
Self-citationSensory preconditioning of flavors with a formalin-produced sodium need.
Fudim, O. K. (1978) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.4.3.276 · Cited by 65 · see citing works
Cognitive aspects of classical conditioning
Holland, P. C. (1993) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(93)90215-k · Cited by 63 · see citing works
DIFFERENTIAL REINFORCEMENT OF OTHER BEHAVIOR (DRO): A YOKED‐CONTROL COMPARISON1
Davis, J., & Bitterman, M. E. (1971) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1971.15-237 · Cited by 53 · see citing works
Learning, Motivation, and Cognition
Estes, W. K. (2014) · doi:10.4324/9781315781075-14 · Cited by 53 · see citing works
Effects of naloxone on diurnal rhythms in mood and endocrine function: a dose-response study in man
del Campo, A. F. M., Dowson, J. H., Herbert, J., & Paykel, E. S. (1994) · Psychopharmacology · doi:10.1007/bf02244988 · Cited by 52 · see citing works
Motivational Control of Instrumental Performance: The Role of Prior Experience of The Reinforcer
Dickinson, A., & Dawson, G. (1988) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748808402313 · Cited by 52 · see citing works
Sensory preconditioning of flavors with a formalin-produced sodium need.
Fudim, O. K. (1978) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.4.3.276 · Cited by 51 · see citing works
Motivated Reinforcement Learning
Dayan, P. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0006 · Cited by 50 · see citing works
Self-citationThe Psychology of Learning and Motivation: Volume 30
Medin, D. L. (1993) · Cited by 49 · see citing works
Incentive learning and the motivational control of instrumental performance
Dickinson, A., & Dawson, G. R. (2018) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640748908401185 · Cited by 48 · see citing works
Cerebellar Substrates for Error Correction in Motor Conditioning
Gluck, M. A., Allen, M. T., Myers, C. E., & Thompson, R. F. (2001) · Neurobiology of Learning and Memory · doi:10.1006/nlme.2001.4031 · Cited by 46 · see citing works
Comparing motivational systems—an incentive motivation perspective
Toates, F. M. (1994) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198547877.003.0013 · Cited by 41 · see citing works
Mitchell, D. S., & Gormezano, I. (1970) · Learning and Motivation · doi:10.1016/0023-9690(70)90086-x · Cited by 39 · see citing works
"Innate recognition" aids rats in sodium regulation.
Krieckhaus, E. E. (1970) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0030020 · Cited by 39 · see citing works
Balleine, B. W., Ball, J. W., & Dickinson, A. (1994) · Behavioral Neuroscience · doi:10.1037//0735-7044.108.3.573 · Cited by 36 · see citing works
Self-citationBalleine, B. W., Ball, J. D., & Dickinson, A. (1994) · Behavioral Neuroscience · doi:10.1037/0735-7044.108.3.573 · Cited by 36 · see citing works
Self-citationAvoidance of heat by rats: Effects of thermal context on rapidity of extinction
Hendersen, R. W., & Graham, J. (1979) · Learning and Motivation · doi:10.1016/0023-9690(79)90038-9 · Cited by 33 · see citing works
Encoding and selective activation of "metabolic memories" in the rat.
Davidson, T. L., Altizer, A. M., Benoit, S. C., Walls, E. K., & Powley, T. L. (1997) · Behavioral Neuroscience · doi:10.1037//0735-7044.111.5.1014 · Cited by 33 · see citing works
Encoding and selective activation of "metabolic memories" in the rat.
Davidson, T. L., Altizer, A. M., Benoit, S. C., et al. (1997) · Behavioral Neuroscience · doi:10.1037/0735-7044.111.5.1014 · Cited by 29 · see citing works
Incentive learning and the motivational control of instrumental performance by thirst
López, M., Balleine, B. W., & Dickinson, A. (1992) · Animal Learning & Behavior · doi:10.3758/bf03197955 · Cited by 27 · see citing works
Self-citationMorphine-induced modification of quinine palatability: Effects of multiple morphine-quinine trials
Clarke, S. N. D. A., & Parker, L. A. (1995) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(95)00042-u · Cited by 26 · see citing works
Bolles's psychological syllogism.
Dickinson, A. (1997) · American Psychological Association eBooks · doi:10.1037/10223-017 · Cited by 22 · see citing works
The Learning of World Models By Connectionist Networks
Sutton, R. S., & Pinette, B. (1985) · eScholarship (California Digital Library) · Cited by 16 · see citing works
Sensitivity of instrumental responses to an upshift in water deprivation
López, M., & Paredes‐Olay, C. (1999) · Animal Learning & Behavior · doi:10.3758/bf03199726 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works
Self-citationA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Self-citationDissecting components of reward: ‘liking’, ‘wanting’, and learning
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2008.12.014 · Cited by 1,942 · see citing works
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869 · see citing works
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works
Empathic neural responses are modulated by the perceived fairness of others
Singer, T., Seymour, B., O'Doherty, J. P., Stephan, K. E., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature04271 · Cited by 1,726 · see citing works
Top-down versus bottom-up attentional control: a failed theoretical dichotomy
Awh, E., Belopolsky, A. V., & Theeuwes, J. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.06.010 · Cited by 1,557 · see citing works
A new look at habits and the habit-goal interface.
Wood, W., & Neal, D. T. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.843 · Cited by 1,470 · see citing works
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · see citing works
Self-citationEncoding Predictive Reward Value in Human Amygdala and Orbitofrontal Cortex
Gottfried, J. A., O'Doherty, J., & Dolan, R. J. (2003) · Science · doi:10.1126/science.1087919 · Cited by 1,165 · see citing works
The role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099 · see citing works
Self-citationIntrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126 · see citing works
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966 · see citing works
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
Benchenane, K., Peyrache, A., Khamassi, M., Tierney, P. L., Gioanni, Y., Battaglia, F. P., & Wiener, S. I. (2010) · Neuron · doi:10.1016/j.neuron.2010.05.013 · Cited by 872 · see citing works
From prediction error to incentive salience: mesolimbic computation of reward motivation.
Berridge, K. C. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.07990.x · Cited by 700 · see citing works
The Neuroscience of Mammalian Associative Learning
Fanselow, M. S., & Poulos, A. M. (2005) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070213 · Cited by 683 · see citing works
Parallel incentive processing: an integrated view of amygdala function
Balleine, B. W., & Killcross, S. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.03.002 · Cited by 622 · see citing works
Self-citationLayered reward signalling through octopamine and dopamine in Drosophila
Burke, C. J., Huetteroth, W., Owald, D., Perisse, E., Krashes, M. J., Das, G., Gohl, D., Silies, M., Certel, S., & Waddell, S. (2012) · Nature · doi:10.1038/nature11614 · Cited by 614 · see citing works
Performance monitoring by the anterior cingulate cortex during saccade countermanding
Ito, S., Stuphorn, V., Brown, J. W., & Schall, J. D. (2003) · Science · doi:10.1126/science.1087847 · Cited by 581 · see citing works
Corbit, L. H., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4507-04.2005 · Cited by 589 · see citing works
Self-citationRoesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597 · see citing works
Hyperdopaminergic mutant mice have higher "wanting" but not "liking" for sweet rewards
Peciña, S., Cagniard, B., Berridge, K. C., Aldridge, J. W., & Zhuang, X. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-28-09395.2003 · Cited by 551 · see citing works
Determining the neural substrates of goal-directed learning in the human brain
Valentin, V. V., Dickinson, A., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0564-07.2007 · Cited by 529 · see citing works
Choosing the greater of two goods: neural currencies for valuation and decision making
Sugrue, L. P., Corrado, G. S., & Newsome, W. T. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1666 · Cited by 536 · see citing works
Assessment of positive welfare: a review
Yeates, J. W., & Main, D. C. J. (2008) · The Veterinary Journal · doi:10.1016/j.tvjl.2007.05.009 · Cited by 504 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · see citing works
Self-citationOpponent appetitive-aversive neural processes underlie predictive learning of pain relief
Seymour, B., O'Doherty, J. P., Koltzenburg, M., Wiech, K., Frackowiak, R., Friston, K., & Dolan, R. (2005) · Nature Neuroscience · doi:10.1038/nn1527 · Cited by 439 · see citing works
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416 · see citing works
Self-citationSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390 · see citing works
Basal ganglia orient eyes to reward
Hikosaka, O., Nakamura, K., & Nakahara, H. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00458.2005 · Cited by 377 · see citing works
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376 · see citing works
Central and Peripheral Regulation of Food Intake and Physical Activity: Pathways and Genes
Lenard, N. R., & Berthoud, H. (2008) · Obesity · doi:10.1038/oby.2008.511 · Cited by 338 · see citing works
Rewards evoke learning of unconsciously processed visual stimuli in adult humans
Seitz, A. R., Kim, D., & Watanabe, T. (2009) · Neuron · doi:10.1016/j.neuron.2009.01.016 · Cited by 337 · see citing works
Learning to Attend and to Ignore Is a Matter of Gains and Losses
Della Libera, C., & Chelazzi, L. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02360.x · Cited by 329 · see citing works
Andersen, S. L., & Teicher, M. H. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.09.009 · Cited by 326 · see citing works
Emotion, decision making, and the amygdala.
Seymour, B., & Dolan, R. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.020 · Cited by 324 · see citing works
Kable, J. W., & Glimcher, P. W. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00177.2009 · Cited by 316 · see citing works
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Habits, action sequences and reinforcement learning
Dezfouli, A., & Balleine, B. W. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08050.x · Cited by 297 · see citing works
Self-citationDeep reinforcement learning and its neuroscientific implications
Botvinick, M., Wang, J. X., Dabney, W., Miller, K. J., & Kurth-Nelson, Z. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.014 · Cited by 269 · see citing works
Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces
Chavarriaga, R., & Millan, J. D. R. (2010) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2010.2053387 · Cited by 277 · see citing works
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Phillips, M. L., Chase, H. W., Sheline, Y. I., Etkin, A., Almeida, J. R. C., Deckersbach, T., & Trivedi, M. H. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14010076 · Cited by 267 · see citing works
Food reward, hyperphagia, and obesity
Berthoud, H.-R., Lenard, N. R., & Shin, A. C. (2011) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00028.2011 · Cited by 275 · see citing works
Kiss, M., Driver, J., & Eimer, M. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02281.x · Cited by 267 · see citing works
Tindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., & Aldridge, J. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04411.x · Cited by 268 · see citing works
Do patients with schizophrenia exhibit aberrant salience?
Roiser, J. P., Stephan, K. E., den Ouden, H. E. M., Barnes, T. R. E., Friston, K. J., & Joyce, E. M. (2009) · Psychological Medicine · doi:10.1017/s0033291708003863 · Cited by 262 · see citing works
Evolving the future: Toward a science of intentional change
Wilson, D. S., Hayes, S. C., Biglan, A., & Embry, D. D. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13001593 · Cited by 255 · see citing works
A normative perspective on motivation
NIV, Y., JOEL, D., & DAYAN, P. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.010 · Cited by 251 · see citing works
Self-citationSeparate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241 · see citing works
Dopamine release in the nucleus accumbens core signals perceived saliency
Kutlu, M. G., Zachry, J. E., Melugin, P. R., Cajigas, S. A., Chevee, M. F., Kelly, S. J., Kutlu, B., Tian, L., Siciliano, C. A., & Calipari, E. S. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.052 · Cited by 238 · see citing works
Calculating utility: preclinical evidence for cost–benefit analysis by mesolimbic dopamine
Phillips, P. E. M., Walton, M. E., & Jhou, T. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0626-6 · Cited by 237 · see citing works
Moment-to-moment tracking of state value in the amygdala
Belova, M. A., Paton, J. J., & Salzman, C. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1400-08.2008 · Cited by 221 · see citing works
Barch, D. M., Pagliaccio, D., & Luking, K. (2015) · Current Topics in Behavioral Neurosciences · doi:10.1007/7854_2015_376 · Cited by 218 · see citing works
The role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, A., Hare, T. A., Davidson, M., Spicer, J., Glover, G., & Casey, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2431-05.2005 · Cited by 207 · see citing works
Corticostriatal Control of Goal-Directed Action Is Impaired in Schizophrenia
Morris, R. W., Quail, S., Griffiths, K. R., Green, M. J., & Balleine, B. W. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.06.005 · Cited by 197 · see citing works
Self-citationFouragnan, E., Retzler, C., & Philiastides, M. G. (2018) · Human Brain Mapping · doi:10.1002/hbm.24047 · Cited by 176 · see citing works
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173 · see citing works
Distinct opioid circuits determine the palatability and the desirability of rewarding events
Wassum, K. M., Ostlund, S. B., Maidment, N. T., & Balleine, B. W. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905874106 · Cited by 182 · see citing works
Self-citationNeural coding of distinct statistical properties of reward information in humans
Dreher, J.-C., Kohn, P., & Berman, K. F. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj004 · Cited by 180 · see citing works
Still at the Choice‐Point: Action Selection and Initiation in Instrumental Conditioning
BALLEINE, B. W., & OSTLUND, S. B. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.006 · Cited by 184 · see citing works
Self-citationBroussard, J. I., Yang, K., Levine, A. T., Tsetsenis, T., Jenson, D., Cao, F., Garcia, I., Arenkiel, B. R., Zhou, F.-M., De Biasi, M., et al. (2016) · Cell Reports · doi:10.1016/j.celrep.2016.01.070 · Cited by 180 · see citing works
Skvortsova, V., Palminteri, S., & Pessiglione, M. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.1350-14.2014 · Cited by 177 · see citing works
Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits
Lingawi, N. W., & Balleine, B. W. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4806-11.2012 · Cited by 172 · see citing works
Self-citationThe human amygdala and orbital prefrontal cortex in behavioural regulation
Dolan, R. J. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2088 · Cited by 150 · see citing works
Reward-related processing in the human brain: developmental considerations
Fareri, D. S., Martin, L. N., & Delgado, M. R. (2008) · Development and Psychopathology · doi:10.1017/s0954579408000576 · Cited by 141 · see citing works
Goal-oriented searching mediated by ventral hippocampus early in trial-and-error learning
Ruediger, S., Spirig, D., Donato, F., & Caroni, P. (2012) · Nature Neuroscience · doi:10.1038/nn.3224 · Cited by 135 · see citing works
Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources
Beeler, J. A., Frazier, C. R. M., & Zhuang, X. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00049 · Cited by 136 · see citing works
Dynamic Computation of Incentive Salience: “Wanting” What Was Never “Liked”
Tindell, A. J., Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2499-09.2009 · Cited by 124 · see citing works
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101 · see citing works
Marsden, K. E., Ma, W. J., Deci, E. L., Ryan, R. M., & Chiu, P. H. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0324-5 · Cited by 75 · see citing works
Functional Connectivity of the Striatum Links Motivation to Action Control in Humans
Harsay, H. A., Cohen, M. X., Oosterhof, N. N., Forstmann, B. U., Mars, R. B., & Ridderinkhof, K. R. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5415-10.2011 · Cited by 75 · see citing works
Alvares, G. A., Balleine, B. W., & Guastella, A. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094778 · Cited by 63 · see citing works
Self-citationTricomi, E., & Fiez, J. A. (2012) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0077-3 · Cited by 64 · see citing works
The doxastic shear pin: Delusions as errors of learning and memory
Fineberg, S. K., & Corlett, P. R. (2016) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2015.1136206 · Cited by 48 · see citing works
Butz, M. V. (2021) · KI - Künstliche Intelligenz · doi:10.1007/s13218-021-00705-x · Cited by 42 · see citing works
Dopaminergic medication increases reliance on current information in Parkinson’s disease
Vilares, I., & Kording, K. P. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0129 · Cited by 33 · see citing works
The context repetition effect: Predicted events are remembered better, even when they don’t happen
Smith, T. A., Hasinski, A. E., & Sederberg, P. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034067 · Cited by 33 · see citing works
Conditioned associations and economic decision biases.
Guitart-Masip, M., Talmi, D., & Dolan, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.021 · Cited by 36 · see citing works
The Effect of Ratio and Interval Training on Pavlovian-Instrumental Transfer in Mice
Wiltgen, B. J., Sinclair, C., Lane, C., Barrows, F., Molina, M., & Chabanon-Hicks, C. (2012) · PLoS ONE · doi:10.1371/journal.pone.0048227 · Cited by 28 · see citing works
Surprise beyond prediction error
Chumbley, J. R., Burke, C. J., Stephan, K. E., Friston, K. J., Tobler, P. N., & Fehr, E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22513 · Cited by 23 · see citing works
Strategic cognitive sequencing: a computational cognitive neuroscience approach
Herd, S. A., Krueger, K. A., Kriete, T. E., Huang, T.-R., Hazy, T. E., & O'Reilly, R. C. (2013) · Computational Intelligence and Neuroscience · doi:10.1155/2013/149329 · Cited by 20 · see citing works
Methylphenidate affects task-switching and neural signaling in non-human primates
Rajala, A. Z., Populin, L. C., & Jenison, R. L. (2020) · Psychopharmacology · doi:10.1007/s00213-020-05478-z · Cited by 13 · see citing works
Della Libera, C., Calletti, R., Eštočinová, J., Chelazzi, L., & Santandrea, E. (2017) · Cognitive Neuroscience · doi:10.1080/17588928.2016.1213226 · Cited by 11 · see citing works
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6 · see citing works
D-MEM: Dopamine-Gated Agentic Memory via Reward Prediction Error Routing
Song, Y., & Xin, Q. (2026) · arXiv · doi:10.48550/arxiv.2603.14597 · Cited by 1 · see citing works
“In computational neuroscience and reinforcement learning, the Reward Prediction Error (RPE) —mediated by dopamine release from the Ventral Tegmental Area (VTA)—acts as the fundamental biological gate for memory consolidation [Schultz et al., 1997, Dayan and Balleine, 2002].”
- Authors
- Dayan, P., & Balleine, B. W.
- Affiliations
- Gatsby Computational Neuroscience Unit (GB)
- University of California, Los Angeles (US)
- Corresponding author
- Dayan, Peter
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2002-10
- Volume
- 36
- Issue
- 2
- Pages
- 285-298
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2043615441
- Semantic Scholar
- 9b393c7fd5ccc96e1f57655913b6322bb298080a
- Cited by
- 855
- References
- 140
- Citations by year
- 2026: 22 · 2025: 40 · 2024: 32 · 2023: 28 · 2022: 30 · 2021: 44 · 2020: 38 · 2019: 40 · 2018: 38 · 2017: 30 · 2016: 40 · 2015: 34 · 2014: 43 · 2013: 38 · 2012: 29
- FWCI
- 1.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Funders
- National Institute of Mental Health (MH56446)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- reward learning, motivation, reinforcement learning, dopamine, classical conditioning, operant conditioning, appetitive conditioning, prediction learning, action learning
- MeSH terms
- Animals, Humans, Motivation, Reinforcement, Psychology, Reward
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review