A Neurocomputational Model for Cocaine Addiction
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Based on the dopamine hypotheses of cocaine addiction and the assumption of decrement of brain reward system sensitivity after long-term drug exposure, we propose a computational model for cocaine addiction. Utilizing average reward temporal difference reinforcement learning, we incorporate the elevation of basal reward threshold after long-term drug exposure into the model of drug addiction proposed by Redish. Our model is consistent with the animal models of drug seeking under punishment. In the case of nondrug reward, the model explains increased impulsivity after long-term drug exposure. Furthermore, the existence of a blocking effect for cocaine is predicted by our model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Neural Basis of Addiction: A Pathology of Motivation and Choice
Kalivas, P. W., & Volkow, N. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1403 · Cited by 2,757
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“It seems that PFC can be added to the model using the multiprocess frameworks of decision making (Doya, 1999 ; Rangel et al, 2008 ; Redish, Jensen, & Johnson, 2008 ) as in the computational framework proposed by Daw, Niv, and Dayan ( 2005 ).”
MethodA framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 1×
“It seems that PFC can be added to the model using the multiprocess frameworks of decision making (Doya, 1999; Rangel et al., 2008; Redish, Jensen, & Johnson, 2008) as in the computational framework proposed by Daw, Niv, and Dayan (2005).”
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“It is now a classic observation that the error signal, t , qualitatively corresponds to phasic activity of dopaminergic (DA) neurons in the ventral tegmental area (VTA) (Montague, Dayan, & Sejnowski, 1996 ; Schultz, Dayan, & Montague, 1997 ).”
BackgroundSynaptic plasticity and addiction
Kauer, J. A., & Malenka, R. C. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2234 · Cited by 1,397 · cited 1×
“Based on this property of TDRL and taking into account the observation that cocaine produces a transient increase in nucleus accumbens (NA) and other VTA DA (Aragona et al, 2008 ; Kauer & Malenka, 2007 ), Redish ( 2004 ) proposed that drug-induced alterations can be modeled by an additional term, D(s t ).”
Evidence for Addiction-like Behavior in the Rat
Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004) · Science · doi:10.1126/science.1099020 · Cited by 1,135 · cited 3×
“Based on unlimited access to drug SA, different animal models have been proposed for increased insensitivity towardpunishments associatedwithdrug seeking (Deroche-Gamonet et al., 2004; Mantsch et al., 2001; Paterson & Markou, 2003; Vanderschuren & Everitt, 2004). For example, Vanderschuren and Everitt (2004) studied h…”
BackgroundInfluentialTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 1×
“Daw proposed that the tonic level of DA codes the average reward (Daw, 2003 ; Daw & Touretzky, 2002 ; Niv, Daw, Joel, & Dayan, 2007 ).”
BackgroundDopamine in drug abuse and addiction: results from imaging studies and treatment implications
Volkow, N. D., Fowler, J. S., Wang, G.-J., & Swanson, J. M. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001507 · Cited by 1,101
Plasticity of reward neurocircuitry and the ‘dark side’ of drug addiction
Koob, G. F., & Le Moal, M. (2005) · Nature Neuroscience · doi:10.1038/nn1105-1442 · Cited by 963
Cue-induced cocaine craving: neuroanatomical specificity for drug users and drug stimuli
Garavan, H., Pankiewicz, J., Bloom, A., Cho, J.-K., Sperry, L., Ross, T. J., Salmeron, B. J., Risinger, R., Kelley, D., & Stein, E. A. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.11.1789 · Cited by 931 · cited 1×
“( 2000 ) found that experienced cocaine addicts show impaired prefrontal activity in response to sexually evocative visual stimuli compared to normal human subjects.”
Background
Cited by
Drug addiction: updating actions to habits to compulsions ten years on
Everitt, B. J., & Robbins, T. W. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033457 · Cited by 1,225
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Everitt, B. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12644 · Cited by 318
“…we have suggested may occur as the result of repeated drug taking, may reflect a failure in the critic properly to direct action selection in the actor, so rendering choices and actions rigid and independent of the value of outcomes (Dezfouli et al., 2009; Piray et al., 2010; Belin et al., 2013).”
BackgroundWang, X.-J., & Krystal, J. H. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.018 · Cited by 312
Addiction: failure of control over maladaptive incentive habits
Belin, D., Belin-Rauscent, A., Murray, J. E., & Everitt, B. J. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.025 · Cited by 300
Metadata
- Authors
- Dezfouli, A., Piray, P., Keramati, M. M., Ekhtiari, H., Lucas, C., & Mokri, A.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2009-10
- Volume
- 21
- Issue
- 10
- Pages
- 2869-2893
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2139452854
- Cited by
- 48
- References
- 23
- FWCI
- 1.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Neurocomputational Model for Cocaine Addiction. https://app.cochat.ai/papers/10.1162/neco.2009.10-08-882
- The paper
- Dezfouli, A., Piray, P., Keramati, M. M., Ekhtiari, H., Lucas, C., & Mokri, A. (2009). A Neurocomputational Model for Cocaine Addiction. Neural Computation. https://doi.org/10.1162/neco.2009.10-08-882
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.