Shifts in reinforcement signalling while playing slot-machines as a function of prior experience and impulsivity
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Electronic gaming machines (EGMs) offer significant revenue streams for mercantile gambling. However, limited clinical and experimental evidence suggests that EGMs are associated with heightened risks of clinically problematic patterns of play. Little is known about the neural structures that might mediate the transition from exploratory EGM play to the 'addictive' play seen in problem gamblers; neither is it known how personality traits associated with gambling activity (and gambling problems) influence reinforcement processing while playing EGMs. Using functional magnetic resonance imaging in healthy participants, we show that a single episode of slot-machine play is subsequently associated with reduced amplitudes of blood-oxygenation-level-dependent signals within reinforcement-related structures, such as the ventral striatum and caudate nucleus, following winning game outcomes; but increased amplitudes of anticipatory signals within the ventral striatum and amygdala while watching the game reels spin. Trait impulsivity enhanced positive signals within the ventral striatum and amygdala following the delivery of winning outcomes but diminished positive signals following the experience of almost-winning ('near-misses'). These results indicate that a single episode of slot-machine play engages the well-characterised reinforcement-learning mechanisms mediated by ascending dopamine mesolimbic and mesostriatal pathways, to shift reward value of EGMs away from game outcomes towards anticipatory states. Impulsivity, itself linked to problem gambling and heightened vulnerability to other addictive disorders, is associated with divergent coding of winning outcomes and almost-winning experiences within the ventral striatum and amygdala, potentially enhancing the reward value of successful slot-machine game outcomes but, at the same time, modulating the aversive motivational consequences of near-miss outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1987) · American Journal of Psychiatry · doi:10.1176/ajp.144.9.1184 · Cited by 2,948
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 2×
“According to these models, as learning proceeds, activity of dopamine neurones within the ventral tegmental area (VTA) elicited by rewards tends to diminish, whereas activity evoked by cues that signal the imminent delivery of rewards tends to increase,(13) implementing a form of temporal-difference learning.(14) Cons…”
Adaptive Coding of Reward Value by Dopamine Neurons
Tobler, P. N., Fiorillo, C. D., & Schultz, W. (2005) · Science · doi:10.1126/science.1105370 · Cited by 1,276 · cited 1×
“of rewards against their variances in a way that represents expected value.(43) Corresponding signals reflecting linear and non-linear subjective probabilities of reward can also be detected in the human striatum using fMRI;(44,45) representations that may mediate gambling behaviours in humans.”
Distributed Neural Representation of Expected Value
Knutson, B., Taylor, J., Kaufman, M., Peterson, R., & Glover, G. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0642-05.2005 · Cited by 955
Pathological gambling is linked to reduced activation of the mesolimbic reward system
Reuter, J., Raedler, T., Rose, M., Hand, I., Gläscher, J., & Büchel, C. (2005) · Nature Neuroscience · doi:10.1038/nn1378 · Cited by 734
Associative processes in addiction and reward. The role of amygdala-ventral striatal subsystems
EVERITT, B. J., PARKINSON, J. A., OLMSTEAD, M. C., ARROYO, M., ROBLEDO, P., & ROBBINS, T. W. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09280.x · Cited by 708 · cited 1×
“Amygdala activity allows these stimuli to sustain reward-seeking behaviours.(50,51) Thus, our findings that practice enhanced the BOLD amplitudes evoked while watching the reels spin are also consistent with the proposal”
Contrasting Roles of Basolateral Amygdala and Orbitofrontal Cortex in Impulsive Choice
Winstanley, C. A., Theobald, D. E. H., Cardinal, R. N., & Robbins, T. W. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5606-03.2004 · Cited by 675 · cited 1×
“Impulsivity—in the form of greater discounting of temporally-delayed rewards—is linked to heightened BOLD responses to monetary rewards within the ventral striatum(17,18) and to the representation of delayed rewards within the amygdala.(52) In humans, reduced midbrain D2/D3 receptor expression is associated with heigh…”
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653
Cited by
Atypical interoception as a common risk factor for psychopathology: A review
Brewer, R., Murphy, J., & Bird, G. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.036 · Cited by 180
Damage to insula abolishes cognitive distortions during simulated gambling
Clark, L., Studer, B., Bruss, J., Tranel, D., & Bechara, A. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322295111 · Cited by 117
Pathological choice: the neuroscience of gambling and gambling addiction
Clark, L., Averbeck, B., Payer, D., Sescousse, G., Winstanley, C. A., & Xue, G. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.3231-13.2013 · Cited by 116
“Specifically, these events recruited overlapping neural circuitry to the jackpot wins in the ventral striatum, amygdale, and anterior insula (Clark et al., 2009; Shao et al., 2013).”
BackgroundRaio, C. M., Konova, A. B., & Otto, A. R. (2020) · Scientific Reports · doi:10.1038/s41598-020-64540-0 · Cited by 52
Metadata
- Authors
- Shao, R., Read, J., Behrens, T. E. J., & Rogers, R. D.
- Venue
- Translational Psychiatry
- Published
- 2013-01-15
- Volume
- 3
- Issue
- 1
- Pages
- e213-e213
- ISSN
- 2158-3188 (ISSN-L)
- OpenAlex
- W1967377060
- Cited by
- 50
- References
- 27
- FWCI
- 9.17
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.