Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning
Open accessAbstract
Cue- and reward-evoked phasic dopamine activity during Pavlovian and operant conditioning paradigms is well correlated with reward-prediction errors from formal reinforcement learning models, which feature teaching signals in the form of discrepancies between actual and expected reward outcomes. Additionally, in learning tasks where conditioned cues probabilistically predict rewards, dopamine neurons show sustained cue-evoked responses that are correlated with the variance of reward and are maximal to cues predicting rewards with a probability of 0.5. Therefore, it has been suggested that sustained dopamine activity after cue presentation encodes the uncertainty of impending reward delivery. In the current study we examined the acquisition and maintenance of these neural correlates using fast-scan cyclic voltammetry in rats implanted with carbon fiber electrodes in the nucleus accumbens core during probabilistic Pavlovian conditioning. The advantage of this technique is that we can sample from the same animal and recording location throughout learning with single trial resolution. We report that dopamine release in the nucleus accumbens core contains correlates of both expected value and variance. A quantitative analysis of these signals throughout learning, and during the ongoing updating process after learning in probabilistic conditions, demonstrates that these correlates are dynamically encoded during these phases. Peak CS-evoked responses are correlated with expected value and predominate during early learning while a variance-correlated sustained CS signal develops during the post-asymptotic updating phase.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
One of the computational quantities encoded by variations in dopamine release is uncertainty (inverse precision).
“This is because various neurophysiological studies in humans and animals indicate that one of the computational quantities encoded by variations in dopamine release is uncertainty (inverse precision) (Fiorillo et al., 2003; de Lafuente and Romo, 2011; Hart et al., 2015; Schwartenbeck et al., 2015a; Tomassini et al., 2016).”
From Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression (2016) · cites this paper as Hart et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The rat brain in stereotaxic coordinates
Palkovits, M. (1983) · Neuropeptides · doi:10.1016/0143-4179(83)90049-5 · Cited by 28,959 · see citing works
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268 · see citing works
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · see citing works
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · see citing works
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · see citing works
Control Procedures for Residuals Associated With Principal Component Analysis
Jackson, J. E., & Mudholkar, G. S. (1979) · Technometrics · doi:10.1080/00401706.1979.10489779 · Cited by 1,189 · see citing works
A selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · see citing works
Nassar, M. R., Wilson, R. C., Heasly, B. S., & Gold, J. I. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0822-10.2010 · Cited by 564 · see citing works
Efflux of dopamine from the synaptic cleft in the nucleus accumbens of the rat brain
Garris, P. A., Ciolkowski, E. L., Pastore, P., & Wightman, R. M. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-10-06084.1994 · Cited by 475 · see citing works
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429 · see citing works
Chronic microsensors for longitudinal, subsecond dopamine detection in behaving animals
Clark, J. J., Sandberg, S. G., Wanat, M. J., Gan, J. O., Horne, E. A., Hart, A. S., Akers, C. A., Parker, J. G., Willuhn, I., Martinez, V., et al. (2010) · Nature Methods · doi:10.1038/nmeth.1412 · Cited by 378 · see citing works
Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain
Niv, Y., Edlund, J. A., Dayan, P., & O'Doherty, J. P. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5498-10.2012 · Cited by 356 · see citing works
Reward-Predictive Cues Enhance Excitatory Synaptic Strength onto Midbrain Dopamine Neurons
Stuber, G. D., Klanker, M., de Ridder, B., Bowers, M. S., Joosten, R. N. J. M. A., Feenstra, M. G. P., & Bonci, A. (2008) · Science · doi:10.1126/science.1160873 · Cited by 307 · see citing works
Dopamine Neurons Can Represent Context-Dependent Prediction Error
Nakahara, H., Itoh, H., Kawagoe, R., Takikawa, Y., & Hikosaka, O. (2004) · Neuron · doi:10.1016/s0896-6273(03)00869-9 · Cited by 276 · see citing works
Testing the Reward Prediction Error Hypothesis with an Axiomatic Model
Rutledge, R. B., Dean, M., Caplin, A., & Glimcher, P. W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1747-10.2010 · Cited by 244 · see citing works
Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine
Gan, J. O., Walton, M. E., & Phillips, P. E. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2460 · Cited by 235 · see citing works
Multivariate concentration determination using principal component regression with residual analysis
Keithley, R. B., Wightman, R. M., & Heien, M. L. (2009) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2009.07.002 · Cited by 205 · see citing works
Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate
Bayer, H. M., Lau, B., & Glimcher, P. W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01140.2006 · Cited by 184 · see citing works
Dopamine, uncertainty and TD learning
Niv, Y., Duff, M. O., & Dayan, P. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-6 · Cited by 153 · see citing works
Neural Correlates of Variations in Event Processing during Learning in Basolateral Amygdala
Roesch, M. R., Calu, D. J., Esber, G. R., & Schoenbaum, G. M. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5781-09.2010 · Cited by 150 · see citing works
Dopamine Encoding of Pavlovian Incentive Stimuli Diminishes with Extended Training
Clark, J. J., Collins, A. L., Sanford, C. A., & Phillips, P. E. M. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.5119-12.2013 · Cited by 94 · see citing works
Transient activation of midbrain dopamine neurons by reward risk
Fiorillo, C. D. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.037 · Cited by 90 · see citing works
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-7 · Cited by 65 · see citing works
Rank Estimation and the Multivariate Analysis of in Vivo Fast-Scan Cyclic Voltammetric Data
Keithley, R. B., Carelli, R. M., & Wightman, R. M. (2010) · Analytical Chemistry · doi:10.1021/ac100413t · Cited by 45 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Allostatic Self-efficacy: A Metacognitive Theory of Dyshomeostasis-Induced Fatigue and Depression
Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A. E., Paliwal, S., Gard, T., Tittgemeyer, M., Fleming, S. M., Haker, H., Seth, A. K., et al. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00550 · Cited by 437 · see citing works
“…studies in humans and animals indicate that one of the computational quantities encoded by variations in dopamine release is uncertainty (inverse precision) (Fiorillo et al., 2003; de Lafuente and Romo, 2011; Hart et al., 2015; Schwartenbeck et al., 2015a; Tomassini et al., 2016).”
BackgroundRodeberg, N. T., Sandberg, S. G., Johnson, J. A., Phillips, P. E. M., & Wightman, R. M. (2017) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.6b00393 · Cited by 226 · see citing works
The modulation of savouring by prediction error and its effects on choice
Iigaya, K., Story, G. W., Kurth-Nelson, Z. L., Dolan, R. J., & Dayan, P. (2016) · eLife · doi:10.7554/elife.13747 · Cited by 110 · see citing works
Robinson, M. J. F., Anselme, P., Suchomel, K., & Berridge, K. C. (2015) · Behavioral Neuroscience · doi:10.1037/bne0000064 · Cited by 111 · see citing works
Aitken, T. J., Greenfield, V. Y., & Wassum, K. M. (2015) · Journal of Neurochemistry · doi:10.1111/jnc.13494 · Cited by 106 · see citing works
How foraging works: Uncertainty magnifies food-seeking motivation
Anselme, P., & Güntürkün, O. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000948 · Cited by 103 · see citing works
Exposure to conditions of uncertainty promotes the pursuit of amphetamine
Mascia, P., Neugebauer, N. M., Brown, J., Bubula, N., Nesbitt, K. M., Kennedy, R. T., & Vezina, P. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0099-4 · Cited by 91 · see citing works
Redish, A. D., & Mizumori, S. J. Y. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.08.014 · Cited by 98 · see citing works
Anselme, P., & Robinson, M. J. F. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316823279.009 · Cited by 90 · see citing works
Electrochemistry at the Synapse
Shin, M., Wang, Y., Borgus, J. R., & Venton, B. (2019) · Annual Review of Analytical Chemistry · doi:10.1146/annurev-anchem-061318-115434 · Cited by 63 · see citing works
Motivational control of sign-tracking behaviour: A theoretical framework
Anselme, P. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.03.014 · Cited by 82 · see citing works
Hamilos, A. E., Spedicato, G., Hong, Y., Sun, F., Li, Y., & Assad, J. A. (2021) · eLife · doi:10.7554/elife.62583 · Cited by 79 · see citing works
“Wanting,” “liking,” and their relation to consciousness.
Anselme, P., & Robinson, M. J. F. (2015) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000090 · Cited by 73 · see citing works
Dopaminergic signaling of uncertainty and the aetiology of gambling addiction
Zack, M. H., George, R. S., & Clark, L. (2019) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2019.109853 · Cited by 54 · see citing works
A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli
van Elzelingen, W., Goedhoop, J. N., Warnaar, P., Denys, D. A. J. P., Arbab, T., & Willuhn, I. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2117270119 · Cited by 51 · see citing works
Venton, B. J., & DiScenza, D. J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-821203-5.00004-x · Cited by 51 · see citing works
Lloyd, K., & Dayan, P. (2015) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004622 · Cited by 49 · see citing works
Iglesias, S., Kasper, L., Harrison, S. J., Manka, R., Mathys, C. D., & Stephan, K. E. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117590 · Cited by 45 · see citing works
From sign-tracking to attentional bias: Implications for gambling and substance use disorders
Anselme, P., & Robinson, M. J. F. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109861 · Cited by 41 · see citing works
Dopamine, inference, and uncertainty
Gershman, S. J. (2017) · Neural Computation · doi:10.1162/neco_a_01023 · Cited by 40 · see citing works
Culture and Child Attachment Patterns: a Behavioral Systems Synthesis
Strand, P. S., Vossen, J. J., & Savage, E. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00220-3 · Cited by 36 · see citing works
Rational inattention and tonic dopamine
Mikhael, J. G., Lai, L., & Gershman, S. J. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008659 · Cited by 30 · see citing works
Sex Differences in Behavioral Responding and Dopamine Release during Pavlovian Learning
Lefner, M. J., Dejeux, M. I., & Wanat, M. J. (2022) · eNeuro · doi:10.1523/eneuro.0050-22.2022 · Cited by 29 · see citing works
Kalmbach, A., Winiger, V., Jeong, N., Asok, A., Gallistel, C. R., Balsam, P. D., & Simpson, E. H. (2022) · Nature Communications · doi:10.1038/s41467-022-31377-2 · Cited by 27 · see citing works
Models of neuromodulation for computational psychiatry
Iglesias, S., Tomiello, S., Schneebeli, M., & Stephan, K. E. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1420 · Cited by 26 · see citing works
Cross-talk between the epigenome and neural circuits in drug addiction
Mews, P., & Calipari, E. S. (2017) · Progress in brain research · doi:10.1016/bs.pbr.2017.08.012 · Cited by 25 · see citing works
A Shared Molecular and Genetic Basis for Food and Drug Addiction
Gold, M. S., Badgaiyan, R. D., & Blum, K. (2015) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2015.05.011 · Cited by 27 · see citing works
To Do or Not to Do: Dopamine, Affordability and the Economics of Opportunity
Beeler, J. A., & Mourra, D. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00006 · Cited by 27 · see citing works
Shared and unique neural circuitry underlying temporally unpredictable threat and reward processing
Radoman, M., Lieberman, L., Jimmy, J., & Gorka, S. M. (2021) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsab006 · Cited by 23 · see citing works
Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner
Fonzi, K. M., Lefner, M. J., Phillips, P. E. M., & Wanat, M. J. (2017) · Cell Reports · doi:10.1016/j.celrep.2017.07.076 · Cited by 22 · see citing works
How unpredictable access to food increases the body fat of small passerines: A mechanistic approach
Anselme, P., Otto, T., & Güntürkün, O. (2017) · Behavioural Processes · doi:10.1016/j.beproc.2017.08.013 · Cited by 22 · see citing works
Rat behavior and dopamine release are modulated by conspecific distress
Lichtenberg, N. T., Lee, B., Kashtelyan, V., Chappa, B. S., Girma, H. T., Green, E. A., Kantor, S., Lagowala, D. A., Myers, M. A., Potemri, D., et al. (2018) · eLife · doi:10.7554/elife.38090 · Cited by 21 · see citing works
Doherty, J. M., Schier, C. J., Vena, A. A., Dilly, G. A., & Gonzales, R. A. (2016) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13141 · Cited by 16 · see citing works
Mirror Self-Recognition in Pigeons: Beyond the Pass-or-Fail Criterion
Wittek, N., Matsui, H., Kessel, N., Oeksuez, F., Güntürkün, O., & Anselme, P. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.669039 · Cited by 15 · see citing works
Maladaptive consequences of repeated intermittent exposure to uncertainty
Mascia, P., Wang, Q., Brown, J., Nesbitt, K. M., Kennedy, R. T., & Vezina, P. (2020) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2020.109864 · Cited by 15 · see citing works
Probing the role of reward expectancy in Pavlovian-instrumental transfer
Ostlund, S. B., & Marshall, A. T. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.04.021 · Cited by 14 · see citing works
Acquiring competence from both extrinsic and intrinsic rewards
Anselme, P., & Hidi, S. E. (2024) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.101939 · Cited by 14 · see citing works
Evidence for motivational enhancement of sign-tracking behavior under reward uncertainty.
Anselme, P., & Robinson, M. J. F. (2019) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000213 · Cited by 11 · see citing works
Rewards interact with repetition‐dependent learning to enhance long‐term retention of motor memories
Hamel, R., Côté, K., Matte, A., Lepage, J., & Bernier, P. (2019) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14171 · Cited by 13 · see citing works
Effects of partial reinforcement on autoshaping in inbred Roman high- and low-avoidance rats
Fuentes-Verdugo, E., Pellón, R., Papini, M. R., Torres, C., Fernández‐Teruel, A., & Anselme, P. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.113111 · Cited by 12 · see citing works
Effort-motivated behavior resolves paradoxes in appetitive conditioning
Anselme, P. (2021) · Behavioural Processes · doi:10.1016/j.beproc.2021.104525 · Cited by 12 · see citing works
Contextual cues facilitate dynamic value encoding in the mesolimbic dopamine system
Fraser, K. M., Collins, V. L., Wolff, A. R., Ottenheimer, D. J., Bornhoft, K. N., Pat, F., Chen, B. J., Janak, P. H., & Saunders, B. T. (2025) · Current Biology · doi:10.1016/j.cub.2024.12.031 · Cited by 10 · see citing works
de Lima, B. F. C., Ramos, D. C., Barbiero, J. K., Pulido, L. N., Redgrave, P., Robinson, D. L., Gómez‐A, A., & Cunha, C. D. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.02.052 · Cited by 10 · see citing works
Foraging motivation favors the occurrence of Lévy walks
Anselme, P., Otto, T., & Güntürkün, O. (2017) · Behavioural Processes · doi:10.1016/j.beproc.2017.12.014 · Cited by 10 · see citing works
The Functions of Dopamine in Operant Conditioned Reflexes
Maiorov, V. I. (2019) · Neuroscience and Behavioral Physiology · doi:10.1007/s11055-019-00815-y · Cited by 10 · see citing works
Pavlovian-instrumental interactions in active avoidance: The bark of neutral trials
Lloyd, K., & Dayan, P. (2018) · Brain Research · doi:10.1016/j.brainres.2018.10.011 · Cited by 9 · see citing works
Stenner, M., Rutledge, R. B., Zaehle, T., Schmitt, F. C., Kopitzki, K., Kowski, A. B., Voges, J., Heinze, H., & Dolan, R. J. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00260.2015 · Cited by 9 · see citing works
Werlen, E., Shin, S.-L., Gastambide, F., François, J., Tricklebank, M. D., Marston, H. M., Huxter, J. R., Gilmour, G., & Walton, M. E. (2019) · Neuropsychopharmacology · doi:10.1038/s41386-019-0564-8 · Cited by 10 · see citing works
Exploratory Search: Information Matters More than Primary Reward
Anselme, P. (2023) · Animal Behavior and Cognition · doi:10.26451/abc.10.04.05.2023 · Cited by 8 · see citing works
Striatal Dopamine Represents Valence on Dynamic Regional Scales
Bornhoft, K. N., Prohofsky, J., O’Neal, T. J., Wolff, A. R., & Saunders, B. T. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.1551-24.2025 · Cited by 8 · see citing works
Reframing dopamine: A controlled controller at the limbic-motor interface
Lloyd, K., & Dayan, P. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011569 · Cited by 7 · see citing works
Punishments and rewards both modestly impair visuomotor memory retention
Hamel, R., Fontaine, É. D. L., Lepage, J., & Bernier, P. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107532 · Cited by 7 · see citing works
Incentive hope: A default psychological response to multiple forms of uncertainty
Anselme, P., & Güntürkün, O. (2019) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18002194 · Cited by 7 · see citing works
Dopamine Supports Reward Prediction to Shape Reward-Pursuit Strategy
Malvaez, M., Suarez, A., Griffin, N. K., Ramírez-Armenta, K., Ostlund, S. B., & Wassum, K. M. (2026) · Journal of Neuroscience · doi:10.1523/jneurosci.1636-25.2026 · Cited by 5 · see citing works
The Optimality of “Suboptimal” Choice
Anselme, P. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108768450.014 · Cited by 4 · see citing works
Fuentes-Verdugo, E., Pellón, R., Papini, M. R., Torres, C., & Anselme, P. (2021) · Psicologica · doi:10.2478/psicolj-2021-0005 · Cited by 4 · see citing works
Addiction as a Symptom of Failure Modes in the Machineries of Decision Making
Redish, A. D. (2015) · Wiley eBooks · doi:10.1002/9781118472415.ch7 · Cited by 4 · see citing works
Unconscious will as a neurobehavioral mechanism against adversity
Anselme, P. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105985 · Cited by 3 · see citing works
Reward uncertainty and the aversion-attraction dilemma
Anselme, P. (2022) · Advances in motivation science · doi:10.1016/bs.adms.2021.12.002 · Cited by 3 · see citing works
Cue-Evoked Dopamine Neuron Activity Helps Maintain but Does Not Encode Expected Value
Mendoza, J. A., Lafferty, C. K., Yang, A. K., & Britt, J. P. (2019) · Cell Reports · doi:10.1016/j.celrep.2019.09.077 · Cited by 3 · see citing works
Critical periods when dopamine controls behavioral responding during Pavlovian learning
Lefner, M. J., Stelly, C. E., Fonzi, K. M., Zurita, H., & Wanat, M. J. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06182-w · Cited by 2 · see citing works
Negrelli, B., Pochapski, J. A., Villas-Boas, C. A., Jessen, L. F., Teixeira, M. A. L., & Cunha, C. D. (2020) · Behavioural Brain Research · doi:10.1016/j.bbr.2020.112858 · Cited by 2 · see citing works
Contexts facilitate dynamic value encoding in the mesolimbic dopamine systemPreprint
Fraser, K. M., Collins, V. L., Wolff, A. R., Ottenheimer, D. J., Bornhoft, K. N., Pat, F., Chen, B. J., Janak, P. H., & Saunders, B. T. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.05.565687 · Cited by 2 · see citing works
Strand, P. S. (2022) · The Psychological Record · doi:10.1007/s40732-021-00501-x · Cited by 1 · see citing works
Robke, R., Arbab, T., Smith, R. J., & Willuhn, I. (2024) · eNeuro · doi:10.1523/eneuro.0223-24.2024 · Cited by 1 · see citing works
Voltammetry in Behaving Animals
Bunner, K. D., & Rebec, G. V. (2016) · Neuromethods · doi:10.1007/978-1-4939-3064-7_24 · Cited by 1 · see citing works
Do Religious Practices and Foraging Behavior Have a Common Motivational Basis?
Anselme, P. (2018) · Evolutionary Psychological Science · doi:10.1007/s40806-018-0182-4 · Cited by 1 · see citing works
A deeper and distributed search for culture
Strand, P. S. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x19002693 · Cited by 1 · see citing works
Voltammetry in Behaving Animals
Bunner, K. D., & Rebec, G. V. (2021) · Neuromethods · doi:10.1007/978-1-0716-1522-5_28 · Cited by 1 · see citing works
Reward uncertainty and the dorsomedial striatum: Comment on Torres et al. (2016)
Anselme, P. (2017) · Neuroscience · doi:10.1016/j.neuroscience.2017.03.013 · Cited by 1 · see citing works
Biological Basis of Motherhood and Effect of Stress on Maternal Psychophysiology
Minnick, E. L. (2015) · Scholarly and Creative Works from DePauw University (DePauw University)
Stereotaxic Surgery in Rodents for Stimulation of the Brain Reward System
Geiger, B. M., Irene, M., & Pothos, E. N. (2020) · Neuromethods · doi:10.1007/978-1-0716-1146-3_2
Evolution of Learning Processes
(2022) · Cambridge University Press eBooks · doi:10.1017/9781108768450.003
Ghrelin-dependent mechanisms of food reward. Part 1. Ghrelin and dopamine
Reikhardt, B. A., & Shabanov, P. D. (2022) · Reviews on Clinical Pharmacology and Drug Therapy · doi:10.17816/rcf20129-54
Motivation incitatrice : un aperçu historique des enjeux théoriques
Anselme, P. (2022) · L’Année psychologique · doi:10.3917/anpsy1.222.0339
Peden-Asarch, A. M., Kruse, L. C., Schindler, A. G., Phillips, P. E. M., & Clark, J. J. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1124979
Valence ambiguity dynamically shapes striatal dopamine heterogeneityPreprint
Bornhoft, K. N., Prohofsky, J., O’Neal, T. J., Wolff, A. R., & Saunders, B. T. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.17.594692
Nucleus Accumbens Dopamine Encodes the Trace Period during Appetitive Pavlovian Conditioning
Wanat, M. J., Garcia-Castañeda, B. I., Alducin-Martinez, C., Cedillo, L. G., Camacho, E. T., & Phillips, P. E. M. (2025) · eNeuro · doi:10.1523/eneuro.0016-25.2025
The effects of reward uncertainty and alcohol intoxication on human sign- and goal-tracking
Heck, M., Lesenfants, D., Didone, V., Anselme, P., & Quertemont, E. (2026) · Psychopharmacology · doi:10.1007/s00213-026-07039-2
Loss of precise auditory sampling as a sign of value-driven visual attentional capture
Harcevnicow, R. C., Sánchez‐Costa, T., Carboni, A., & Constantino, F. C. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121905
Dynamiques dopaminergiques dans la prise de décision : rôle dans la variabilité et l’exploration
Côme, M. (2023) · theses.fr (ABES) · doi:10.70675/a7b03d10z7e3cz45a1z817bza6c6344893af
- Authors
- Hart, A. S., Clark, J. J., & Phillips, P. E. M.
- Affiliations
- University of Washington (US)
- Corresponding author
- Phillips, Paul E.M.
- Venue
- Neurobiology of Learning and Memory
- Publisher
- Elsevier BV
- Published
- 2015-01
- Volume
- 117
- Pages
- 84-92
- ISSN
- 1074-7427 (ISSN-L)
- PMC
- PMC4293327
- OpenAlex
- W2084791965
- Cited by
- 82
- References
- 26
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 4 · 2023: 5 · 2022: 10 · 2021: 9 · 2020: 8 · 2019: 11 · 2018: 6 · 2017: 8 · 2016: 6 · 2015: 8 · 2014: 1
- FWCI
- 3.50
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Neurobiology of Learning and Memory (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- NIH (T32-DA007278, R01-AA021121, R01-DA027858, R01-AG044839, R01-MH079292)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- dopamine release, nucleus accumbens core, reward prediction error, expected value, reward variance, uncertainty encoding, reinforcement learning, conditioned stimulus, fast-scan cyclic voltammetry, learning dynamics
- MeSH terms
- Animals, Conditioning, Classical, Cues, Dopamine, Male, Nucleus Accumbens, Probability, Reinforcement, Psychology, Reward, Rats, Sprague-Dawley, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
