Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
Clinical and experimental observations show individual differences in the development of addiction. Increasing evidence supports the hypothesis that dopamine receptor availability in the nucleus accumbens (NAc) predisposes drug reinforcement. Here, modeling striatal-midbrain dopaminergic circuit, we propose a reinforcement learning model for addiction based on the actor-critic model of striatum. Modeling dopamine receptors in the NAc as modulators of learning rate for appetitive—but not aversive—stimuli in the critic—but not the actor—we define vulnerability to addiction as a relatively lower learning rate for the appetitive stimuli, compared to aversive stimuli, in the critic. We hypothesize that an imbalance in this learning parameter used by appetitive and aversive learning systems can result in addiction. We elucidate that the interaction between the degree of individual vulnerability and the duration of exposure to drug has two progressive consequences: deterioration of the imbalance and establishment of an abnormal habitual response in the actor. Using computational language, the proposed model describes how development of compulsive behavior can be a function of both degree of drug exposure and individual vulnerability. Moreover, the model describes how involvement of the dorsal striatum in addiction can be augmented progressively. The model also interprets other forms of addiction, such as obesity and pathological gambling, in a common mechanism with drug addiction. Finally, the model provides an answer for the question of why behavioral addictions are triggered in Parkinson's disease patients by D2 dopamine agonist treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“Both tasks require the same learning process, but only the former requires action selection (O’Doherty et al., 2004).”
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“gif" alt-version="no" mimetype="image" xlink:type="simple"> where w V (a) and w P (a) are the weights for a linear estimation of the critic's values and actor's preferences, respectively (McClure, Daw, & Montague, 2003 ; Montague, Dayan, & Sejnowski, 1996 ).”
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“These dissociated roles of striatal subdivisions are consistent with a wealth of evidence showing that while the ventral striatum underlies reward processing and motivation (Cardinal, Parkinson, Hall, & Everitt, 2002), the dorsal striatum is involved in motor control (Packard & Knowlton, 2002).”
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Synaptic plasticity and addiction
Kauer, J. A., & Malenka, R. C. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2234 · Cited by 1,397 · cited 2×
“Studies suggest a pivotal role for synaptic plasticity in the VTA that appears just 4 hours after a single exposure to cocaine and initiates plasticity in the NAc (Kauer & Malenka, 2007).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
Cited by
Drug addiction: updating actions to habits to compulsions ten years on
Everitt, B. J., & Robbins, T. W. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033457 · Cited by 1,225
Brain circuitry of compulsivity
van den Heuvel, O. A., van Wingen, G., Soriano-Mas, C., Alonso, P., Chamberlain, S. R., Nakamae, T., Denys, D., Goudriaan, A. E., & Veltman, D. J. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.005 · Cited by 374
“Computational models supported this idea (Piray et al., 2010; Egbert and Barandiaran, 2014).”
Everitt, B. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12644 · Cited by 318
“…we have suggested may occur as the result of repeated drug taking, may reflect a failure in the critic properly to direct action selection in the actor, so rendering choices and actions rigid and independent of the value of outcomes (Dezfouli et al., 2009; Piray et al., 2010; Belin et al., 2013).”
BackgroundAddiction: failure of control over maladaptive incentive habits
Belin, D., Belin-Rauscent, A., Murray, J. E., & Everitt, B. J. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.025 · Cited by 300
Dopamine Circuit Mechanisms of Addiction-Like Behaviors
Poisson, C. L., Engel, L., & Saunders, B. T. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.752420 · Cited by 75
Metadata
- Authors
- Piray, P., Keramati, M. M., Dezfouli, A., Lucas, C., & Mokri, A.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2010-09
- Volume
- 22
- Issue
- 9
- Pages
- 2334-2368
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2158895174
- Cited by
- 40
- References
- 63
- FWCI
- 1.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach. https://app.cochat.ai/papers/10.1162/neco_a_00009
- The paper
- Piray, P., Keramati, M. M., Dezfouli, A., Lucas, C., & Mokri, A. (2010). Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach. Neural Computation. https://doi.org/10.1162/neco_a_00009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.