Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network
Open accessAbstract
Behavioral conditioning of cue-reward pairing results in a shift of midbrain dopamine (DA) cell activity from responding to the reward to responding to the predictive cue. However, the precise time course and mechanism underlying this shift remain unclear. Here, we report a combined single-unit recording and temporal difference (TD) modeling approach to this question. The data from recordings in conscious rats showed that DA cells retain responses to predicted reward after responses to conditioned cues have developed, at least early in training. This contrasts with previous TD models that predict a gradual stepwise shift in latency with responses to rewards lost before responses develop to the conditioned cue. By exploring the TD parameter space, we demonstrate that the persistent reward responses of DA cells during conditioning are only accurately replicated by a TD model with long-lasting eligibility traces (nonzero values for the parameter lambda) and low learning rate (alpha). These physiological constraints for TD parameters suggest that eligibility traces and low per-trial rates of plastic modification may be essential features of neural circuits for reward learning in the brain. Such properties enable rapid but stable initiation of learning when the number of stimulus-reward pairings is limited, conferring significant adaptive advantages in real-world environments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Dopaminergic neurons appear to fire not only in response to reward-related stimuli, but also those of potential importance such as loud noise.
“Indeed, dopaminergic neurons appear to fire not only in response to reward-related stimuli, but also those of potential importance such as loud noise (Kiyatkin, 1988; Pan et al., 2005).”
From Dopamine reward circuitry: Two projection systems from the ventral midbrain to the nucleus accumbens–olfactory tubercle complex (2007) · cites this paper as Pan et al., 2005
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564 · see citing works
AChE-stained horizontal sections of the rat brain in stereotaxic coordinates
Paxinos, G., WATSON, C. R. R., & Emson, P. C. (1980) · Journal of Neuroscience Methods · doi:10.1016/0165-0270(80)90021-7 · Cited by 4,497 · see citing works
Skinner, B. F., & Hull, C. L. (1944) · The American Journal of Psychology · doi:10.2307/1416955 · Cited by 4,061 · see citing works
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574 · see citing works
Barto, A. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,172 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · see citing works
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · see citing works
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Grace, A. A., & Bunney, B. S. (1983) · Neuroscience · doi:10.1016/0306-4522(83)90135-5 · Cited by 937 · see citing works
Practical issues in temporal difference learning
Tesauro, G. J. (1992) · Machine Learning · doi:10.1007/bf00992697 · Cited by 798 · see citing works
Temporal difference models describe higher-order learning in humans
Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenburg, M., Jones, A. K., Dolan, R. J., Friston, K. J., & Frackowiak, R. S. (2004) · Nature · doi:10.1038/nature02581 · Cited by 605 · see citing works
Reinforcement learning with replacing eligibility traces
Singh, S. P., & Sutton, R. S. (1996) · Machine Learning · doi:10.1007/bf00114726 · Cited by 581 · see citing works
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574 · see citing works
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 555 · see citing works
Aghajanian, G. K., & Bunney, B. S. (1977) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/bf00508803 · Cited by 548 · see citing works
Importance of unpredictability for reward responses in primate dopamine neurons
Mirenowicz, J., & Schultz, W. (1994) · Journal of Neurophysiology · doi:10.1152/jn.1994.72.2.1024 · Cited by 544 · see citing works
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 496 · see citing works
Firing modes of midbrain dopamine cells in the freely moving rat
Hyland, B. I., Reynolds, J. N. J., HAY, J. G., Perk, C. G., & Miller, R. (2002) · Neuroscience · doi:10.1016/s0306-4522(02)00267-1 · Cited by 487 · see citing works
Self-citationAdaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0018 · Cited by 466 · see citing works
Bunney, B. S., Aghajanian, G. K., & Roth, R. H. (1973) · Nature New Biology · doi:10.1038/newbio245123a0 · Cited by 434 · see citing works
Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey
Schultz, W. (1986) · Journal of Neurophysiology · doi:10.1152/jn.1986.56.5.1439 · Cited by 390 · cited 2× · see citing works
“…action potential Ͻ1 ms in duration, which represents the minimum cutoff between DA and slow-firing non-DA cells in recordings with the filter settings commonly used in recordings from conscious rats and monkeys (Schultz, 1986; Romo and Schultz, 1990; Ljungberg et al., 1992; Hyland et al., 2002).”
BackgroundRomo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 2× · see citing works
“…action potential Ͻ1 ms in duration, which represents the minimum cutoff between DA and slow-firing non-DA cells in recordings with the filter settings commonly used in recordings from conscious rats and monkeys (Schultz, 1986; Romo and Schultz, 1990; Ljungberg et al., 1992; Hyland et al., 2002).”
BackgroundA neuronal model of classical conditioning
Klopf, A. H. (1988) · Psychobiology · doi:10.3758/bf03333113 · Cited by 318 · see citing works
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Grace, A. A., & Bunney, B. S. (1980) · Science · doi:10.1126/science.7433992 · Cited by 241 · see citing works
Spike-Timing-Dependent Hebbian Plasticity as Temporal Difference Learning
Rao, R. P. N., & Sejnowski, T. J. (2001) · Neural Computation · doi:10.1162/089976601750541787 · Cited by 229 · see citing works
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198 · see citing works
Mesencephalic dopaminergic unit activity in the behaviorally conditioned rat
Miller, J. D., Sanghera, M. K., & German, D. C. (1981) · Life Sciences · doi:10.1016/0024-3205(81)90231-9 · Cited by 170 · see citing works
Temporal Difference Model Reproduces Anticipatory Neural Activity
Suri, R. E., & Schultz, W. (2001) · Neural Computation · doi:10.1162/089976601300014376 · Cited by 166 · see citing works
Simulation of anticipatory responses in classical conditioning by a neuron-like adaptive element
Barto, A. G., & Sutton, R. S. (1982) · Behavioural Brain Research · doi:10.1016/0166-4328(82)90001-8 · Cited by 106 · see citing works
Behavioral associations of neuronal activity in the ventral tegmental area of the rat
Kosobud, A., Harris, G. C. M., & Chapin, J. K. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-11-07117.1994 · Cited by 98 · see citing works
Takikawa, Y., Kawagoe, R., & Hikosaka, O. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00238.2004 · Cited by 82 · see citing works
Impulse activity of ventral tegmental area neurons during heroin self-administration in rats
Kiyatkin, E. A., & Rebec, G. V. (2001) · Neuroscience · doi:10.1016/s0306-4522(00)00492-9 · Cited by 66 · see citing works
Cichosz, P. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.135 · Cited by 56 · see citing works
The activity of pars compacta neurons of the monkey substantia nigra is depressed by apomorphine
Aebischer, P., & Schultz, W. (1984) · Neuroscience Letters · doi:10.1016/0304-3940(84)90456-7 · Cited by 34 · see citing works
Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model
Suri, R. E. (2001) · Experimental Brain Research · doi:10.1007/s002210100814 · Cited by 32 · see citing works
Timing and Partial Observability in the Dopamine System
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2002) · Cited by 20 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Pavlov IP (1927) Conditioned reflexes. Oxford: Oxford UP.
Cited by
Sorted by citations
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477 · see citing works
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
The Nucleus Accumbens: An Interface Between Cognition, Emotion, and Action
Floresco, S. B. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115159 · Cited by 938 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706 · see citing works
Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., & Holland, P. C. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.001 · Cited by 696 · see citing works
Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens
Day, J. J., Roitman, M. F., Wightman, R. M., & Carelli, R. M. (2007) · Nature Neuroscience · doi:10.1038/nn1923 · Cited by 710 · see citing works
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · see citing works
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597 · see citing works
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597 · see citing works
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585 · see citing works
Ventral pallidum roles in reward and motivation
Smith, K. S., Tindell, A. J., Aldridge, J. W., & Berridge, K. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.038 · Cited by 548 · see citing works
What the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
Opponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456 · see citing works
Ji, H., & Shepard, P. D. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.0958-07.2007 · Cited by 388 · see citing works
Striatal dopamine neurotransmission: Regulation of release and uptake
Sulzer, D., Cragg, S. J., & Rice, M. E. (2016) · Basal Ganglia · doi:10.1016/j.baga.2016.02.001 · Cited by 382 · see citing works
Stamatakis, A. M., Jennings, J. H., Ung, R. L., Blair, G. A., Weinberg, R. J., Neve, R. L., Boyce, F., Mattis, J., Ramakrishnan, C., Deisseroth, K., et al. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.023 · Cited by 364 · see citing works
Tripp, G., & Wickens, J. R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01851.x · Cited by 346 · see citing works
Self-citationGlutamatergic signaling by mesolimbic dopamine neurons in the nucleus accumbens
Tecuapetla, F., Patel, J. C., Xenias, H., English, D., Tadros, I., Shah, F., Berlin, J., Deisseroth, K., Rice, M. E., Tepper, J. M., et al. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0265-10.2010 · Cited by 310 · see citing works
The temporal precision of reward prediction in dopamine neurons
Fiorillo, C. D., Newsome, W. T., & Schultz, W. (2008) · Nature Neuroscience · doi:10.1038/nn.2159 · Cited by 310 · see citing works
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex
Takahashi, Y. K., Roesch, M. R., Wilson, R. C., Toreson, K., O'Donnell, P., Niv, Y., & Schoenbaum, G. (2011) · Nature Neuroscience · doi:10.1038/nn.2957 · Cited by 280 · see citing works
Gershman, S. J., & Uchida, N. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0220-7 · Cited by 236 · see citing works
Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats
Anstrom, K. K., Miczek, K. A., & Budygin, E. A. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.03.023 · Cited by 246 · see citing works
Basal ganglia circuit loops, dopamine and motivation: a review and enquiry
Ikemoto, S., Yang, C., & Tan, A. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.04.018 · Cited by 226 · see citing works
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200 · see citing works
Beyond working memory: the role of persistent activity in decision making
Curtis, C. E., & Lee, D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.03.006 · Cited by 191 · see citing works
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173 · see citing works
Phasic dopamine release in appetitive behaviors and drug addiction
Wanat, M., Willuhn, I., Clark, J., & Phillips, P. (2009) · Current Drug Abuse Reviewse · doi:10.2174/1874473710902020195 · Cited by 177 · see citing works
Gruber, A. J., & McDonald, R. J. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00050 · Cited by 173 · see citing works
WICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165 · see citing works
Self-citationStimulus representation and the timing of reward-prediction errors in models of the dopamine system
Ludvig, E. A., Sutton, R. S., & Kehoe, E. J. (2008) · Neural Computation · doi:10.1162/neco.2008.11-07-654 · Cited by 148 · see citing works
Temporally Extended Dopamine Responses to Perceptually Demanding Reward-Predictive Stimuli
Nomoto, K., Schultz, W., Watanabe, T., & Sakagami, M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4828-09.2010 · Cited by 158 · see citing works
Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity
Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150 · see citing works
Meta-analysis of human prediction error for incentives, perception, cognition, and action
Corlett, P. R., Mollick, J. A., & Kober, H. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01264-3 · Cited by 135 · see citing works
Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm
Day, J. J., Wheeler, R. A., Roitman, M. F., & Carelli, R. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04654.x · Cited by 140 · see citing works
Cell-based reporters reveal in vivo dynamics of dopamine and norepinephrine release in murine cortex
Muller, A., Joseph, V., Slesinger, P. A., & Kleinfeld, D. (2014) · Nature Methods · doi:10.1038/nmeth.3151 · Cited by 139 · see citing works
Dopamine, reward learning, and active inference
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00136 · Cited by 112 · see citing works
Cerebral Correlates of Salient Prediction Error for Different Rewards and Punishments
Metereau, E., & Dreher, J.-C. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs037 · Cited by 114 · see citing works
Wang, D. V., & Tsien, J. Z. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017047 · Cited by 116 · see citing works
Abnormal striatal BOLD responses to reward anticipation and reward delivery in ADHD
Furukawa, E., Bado, P., Tripp, G., Mattos, P., Wickens, J. R., Bramati, I. E., Alsop, B., Ferreira, F. M., Lima, D., Tovar-Moll, F., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089129 · Cited by 90 · see citing works
Self-citationvan der Oord, S., & Tripp, G. (2020) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-020-00327-z · Cited by 91 · see citing works
Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning
Hart, A. S., Clark, J. J., & Phillips, P. E. M. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.07.010 · Cited by 82 · see citing works
Bonci, A., & Borgland, S. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.07.024 · Cited by 64 · see citing works
Multiple functions of dopamine neurons
Schultz, W. (2010) · F1000 Biology Reports · doi:10.3410/b2-2 · Cited by 59 · see citing works
Klanker, M., Sandberg, T., Joosten, R., Willuhn, I., Feenstra, M., & Denys, D. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2015.08.011 · Cited by 37 · see citing works
Neural control of dopamine neurotransmission: implications for reinforcement learning
Aggarwal, M., Hyland, B. I., & Wickens, J. R. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08055.x · Cited by 32 · see citing works
Self-citation
- Authors
- Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I.
- Affiliations
- University of Otago (NZ)
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2005-06-29
- Volume
- 25
- Issue
- 26
- Pages
- 6235-6242
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- PMC
- PMC6725057
- OpenAlex
- W1973229581
- Cited by
- 429
- References
- 48
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 19 · 2023: 10 · 2022: 14 · 2021: 17 · 2020: 20 · 2019: 27 · 2018: 18 · 2017: 20 · 2016: 33 · 2015: 28 · 2014: 24 · 2013: 19 · 2012: 26
- FWCI
- 7.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Neuroscience (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Lotto New Zealand
- Marsden Fund
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Keywords
- midbrain dopamine, classical conditioning, eligibility traces, temporal difference learning, reward learning, learning rate, single-unit recording
- MeSH terms
- Action Potentials, Animals, Conditioning, Classical, Cues, Dopamine, Electrophysiology, Learning, Male, Nerve Net, Neurons, Reward, Rats, Wistar, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
