Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Uncertainty is a component of many gambling games and may play a role in incentive motivation and cue attraction. Uncertainty can increase the attractiveness for predictors of reward in the Pavlovian procedure of autoshaping, visible as enhanced sign-tracking (or approach and nibbles) by rats of a metal lever whose sudden appearance acts as a conditioned stimulus (CS+) to predict sucrose pellets as an unconditioned stimulus (UCS). Here we examined how reward uncertainty might enhance incentive salience as sign-tracking both in intensity and by broadening the range of attractive CS+s. We also examined whether initially-induced uncertainty enhancements of CS+ attraction can endure beyond uncertainty itself, and persist even when Pavlovian prediction becomes 100% certain. Our results show that uncertainty can broaden incentive salience attribution to make CS cues attractive that would otherwise not be (either because they are too distal from reward or too risky to normally attract sign-tracking). In addition, uncertainty enhancement of CS+ incentive salience, once induced by initial exposure, persisted even when Pavlovian CS-UCS correlations later rose toward 100% certainty in prediction. Persistence suggests an enduring incentive motivation enhancement potentially relevant to gambling, which in some ways resembles incentive-sensitization. Higher motivation to uncertain CS+s leads to more potent attraction to these cues when they predict the delivery of uncertain rewards. In humans, those cues might possibly include the sights and sounds associated with gambling, which contribute a major component of the play immersion experienced by problematic gamblers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346 · cited 1×
“The process of incentive sensitization denotes the fact that repeated drug consumption induces persistent neuroadaptations of the dopaminergic systems that progressively sensitize an individual to the drug as well as to Pavlovian incentive cues associated with drug taking [36].”
BackgroundPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Self-citationThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Self-citationDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 3×
“Several studies have highlighted the role of midbrain dopamine in coding reward uncertainty in primates [37,48], healthy humans [49,50], and pathological gamblers [27].”
BackgroundA selective role for dopamine in stimulus-reward learning
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., Akers, C. A., Clinton, S. M., Phillips, P. E. M., & Akil, H. (2011) · Nature · doi:10.1038/nature09588 · Cited by 1,026
Neural differentiation of expected reward and risk in human subcortical structures
Preuschoff, K., Bossaerts, P., & Quartz, S. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.024 · Cited by 692 · cited 1×
“Several studies have highlighted the role of midbrain dopamine in coding reward uncertainty in primates [37,48], healthy humans [49,50], and pathological gamblers [27].”
BackgroundPiazza, P. V., Deminiere, J. M., le Moal, M., & Simon, H. (1990) · Brain Research · doi:10.1016/0006-8993(90)90431-a · Cited by 565
Flagel, S. B., Akil, H., & Robinson, T. E. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.06.027 · Cited by 561 · cited 1×
“Consistent with this suggestion, it has been shown that in autoshaping, sign-trackers release more dopamine, and possess higher corticosterone levels, than goal-trackers [41,42], and microinjections of corticotropin-releasing factor – a stress-related neurotransmitter – into the shell region of the nucleus accumbens i…”
BackgroundDisentangling pleasure from incentive salience and learning signals in brain reward circuitry
Smith, K. S., Berridge, K. C., & Aldridge, J. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1101920108 · Cited by 464 · cited 1×
“For example, pharmacological/physiological manipulations of mesolimbic dopamine levels in the nucleus accumbens alter the incentive, but not the predictive, value of a CS in a reversible fashion [8,15-17].”
BackgroundSelf-citationRobinson, T. E., & Flagel, S. B. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.09.006 · Cited by 416 · cited 2×
“Finally, some other individuals show comparable amounts of both behavior types, and are considered to be intermediates [6-8].”
BackgroundInstant transformation of learned repulsion into motivational “wanting”
Robinson, M. J. F., & Berridge, K. C. (2013) · Current Biology · doi:10.1016/j.cub.2013.01.016 · Cited by 320
Self-citationTindell, A. J., Berridge, K. C., Zhang, J., Peciña, S., & Aldridge, J. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04411.x · Cited by 268
Self-citationMesolimbic dopamine release is linked to symptom severity in pathological gambling
Joutsa, J., Johansson, J., Niemelä, S., Ollikainen, A., Hirvonen, M. M., Piepponen, P., Arponen, E., Alho, H., Voon, V., Rinne, J. O., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.006 · Cited by 209 · cited 1×
“Human pathological gambling also has been related to striatal dopamine [27], and compulsive gambling severity is associated with larger dopamine responses [28].”
BackgroundPeciña, S., Schulkin, J., & Berridge, K. C. (2006) · BMC Biology · doi:10.1186/1741-7007-4-8 · Cited by 194
Self-citationReward uncertainty enhances incentive salience attribution as sign-tracking
Anselme, P., Robinson, M. J. F., & Berridge, K. C. (2013) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.10.006 · Cited by 170 · cited 3×
“As previously [25], we used a combination of a 50% probability and variable magnitude in order to induce uncertainty, but here we also incorporated location uncertainty: rats did not know which lever – among three possible – would be presented on a given trial.”
BackgroundMethodResultSelf-citationDopamine neurons code subjective sensory experience and uncertainty of perceptual decisions
de Lafuente, V., & Romo, R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1117636108 · Cited by 117 · cited 1×
“Several studies have highlighted the role of midbrain dopamine in coding reward uncertainty in primates [37,48], healthy humans [49,50], and pathological gamblers [27].”
BackgroundUnpredictable saccharin reinforcement enhances locomotor responding to amphetamine
Singer, B. F., Scott-Railton, J., & Vezina, P. (2012) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.09.003 · Cited by 117
Transient activation of midbrain dopamine neurons by reward risk
Fiorillo, C. D. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.037 · Cited by 90
Striatal dopamine release codes uncertainty in pathological gambling
Linnet, J., Mouridsen, K., Peterson, E., Møller, A., Doudet, D. J., & Gjedde, A. (2012) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2012.04.012 · Cited by 82
Cited by
Roles of "wanting" and "liking" in motivating behavior: gambling, food, and drug addictions
Robinson, M. J. F., Fischer, A. M., Ahuja, A., Lesser, E. N., & Maniates, H. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_387 · Cited by 247
Self-citationHellberg, S. N., Levit, J. D., & Robinson, M. J. F. (2018) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.09.036 · Cited by 70
Self-citationHellberg, S. N., Russell, T. I., & Robinson, M. J. F. (2019) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-018-00662-3 · Cited by 65
“For example, distal cues that are on the periphery of our attention are typically ignored under certain and predictable reward conditions, but when reward conditions are unpredictable, these cues attract more attention (M. J. F. Robinson et al., 2014a).”
Self-citationDeficits in context-dependent adaptive coding of reward in schizophrenia
Kirschner, M., Hager, O. M., Bischof, M., Hartmann-Riemer, M. N., Kluge, A., Seifritz, E., Tobler, P. N., & Kaiser, S. (2016) · npj Schizophrenia · doi:10.1038/npjschz.2016.20 · Cited by 43
Evidence accumulation and neural correlates of uncertainty in obsessive-compulsive disorder
Zhao, Y.-J., Zhang, Y., Wang, Q., Manssuer, L., Cui, H., Ding, Q., Sun, B., Liu, W., & Voon, V. (2023) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2023.05.011 · Cited by 8
Metadata
- Authors
- Robinson, M. J. F., Anselme, P., Fischer, A. M., & Berridge, K. C.
- Venue
- Behavioural Brain Research
- Publisher
- Elsevier BV
- Published
- 2014-06
- Volume
- 266
- Pages
- 119-130
- ISSN
- 0166-4328 (ISSN-L)
- OpenAlex
- W2148539500
- Cited by
- 123
- References
- 20
- FWCI
- 3.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.