The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Addiction as a Computational Process Gone Awry
Abstract
Addictive drugs have been hypothesized to access the same neurophysiological mechanisms as natural learning systems. These natural learning systems can be modeled through temporal-difference reinforcement learning (TDRL), which requires a reward-error signal that has been hypothesized to be carried by dopamine. TDRL learns to predict reward by driving that reward-error signal to zero. By adding a noncompensable drug-induced dopamine increase to a TDRL model, a computational model of addiction is constructed that over-selects actions leading to drug receipt. The model provides an explanation for important aspects of the addiction literature and provides a theoretic view-point with which to address other aspects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
A Theory of Rational Addiction
Becker, G. S., & Murphy, K. M. (1988) · Journal of Political Economy · doi:10.1086/261558 · Cited by 3,823
Drug Addiction, Dysregulation of Reward, and Allostasis
Koob, G. (2001) · Neuropsychopharmacology · doi:10.1016/s0893-133x(00)00195-0 · Cited by 2,953
Cocaine Receptors on Dopamine Transporters Are Related to Self-Administration of Cocaine
Ritz, M. C., Lamb, R. J., Goldberg, S. R., & Kuhar, M. J. (1987) · Science · doi:10.1126/science.2820058 · Cited by 2,180
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Context, ambiguity, and unlearning: sources of relapse after behavioral extinction
Bouton, M. E. (2002) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01546-9 · Cited by 1,662
Robinson, T. E., & Berridge, K. C. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145237 · Cited by 1,509
Evidence for Addiction-like Behavior in the Rat
Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004) · Science · doi:10.1126/science.1099020 · Cited by 1,135
Toward a behavioral economic understanding of drug dependence: delay discounting processes
Bickel, W. K., & Marsch, L. A. (2001) · Addiction · doi:10.1046/j.1360-0443.2001.961736.x · Cited by 1,117
Subsecond dopamine release promotes cocaine seeking
Phillips, P. E. M., Stuber, G. D., Heien, M. L. A. V., Wightman, R. M., & Carelli, R. M. (2003) · Nature · doi:10.1038/nature01476 · Cited by 1,113
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
The neuropsychological basis of addictive behaviour
Everitt, B. J., Dickinson, A., & Robbins, T. W. (2001) · Brain Research Reviews · doi:10.1016/s0165-0173(01)00088-1 · Cited by 808
Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
Nicotine activates and desensitizes midbrain dopamine neurons
Pidoplichko, V. I., DeBiasi, M., Williams, J. T., & Dani, J. A. (1997) · Nature · doi:10.1038/37120 · Cited by 769
Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration
Vanderschuren, L. J. M. J., & Everitt, B. J. (2004) · Science · doi:10.1126/science.1098975 · Cited by 733
Drug addiction as dopamine-dependent associative learning disorder
Di Chiara, G. (1999) · European Journal of Pharmacology · doi:10.1016/s0014-2999(99)00372-6 · Cited by 596
Neuroadaptations involved in amphetamine and cocaine addiction
White, F. J., & Kalivas, P. W. (1998) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(98)00072-6 · Cited by 509
A computational substrate for incentive salience
McClure, S. M., Daw, N. D., & Read Montague, P. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00177-2 · Cited by 422
Role of dopamine in drug reinforcement and addiction in humans: results from imaging studies
Volkow, N. D., Fowler, J. S., & Wang, G.-J. (2002) · Behavioural Pharmacology · doi:10.1097/00008877-200209000-00008 · Cited by 398
Clinical Implications of Reinforcement as a Determinant of Substance Use Disorders
Higgins, S. T., Heil, S. H., & Lussier, J. P. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142033 · Cited by 393
Suri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
The demand for cocaine by young adults: a rational addiction approach
Grossman, M., & Chaloupka, F. J. (1998) · Journal of Health Economics · doi:10.1016/s0167-6296(97)00046-5 · Cited by 284
Hyperbolic value addition and general models of animal choice.
Mazur, J. E. (2001) · Psychological Review · doi:10.1037//0033-295x.108.1.96 · Cited by 262
Nader, M. A., & Woolverton, W. L. (1991) · Psychopharmacology · doi:10.1007/bf02244304 · Cited by 251
Carroll, M. E., Lac, S. T., & Nygaard, S. L. (1989) · Psychopharmacology · doi:10.1007/bf00443407 · Cited by 251
Letchworth, S. R., Nader, M. A., Smith, H. R., Friedman, D. P., & Porrino, L. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02799.2001 · Cited by 239
Laviolette, S. R., Gallegos, R. A., Henriksen, S. J., & van der Kooy, D. (2004) · Nature Neuroscience · doi:10.1038/nn1182 · Cited by 203
Mechanisms by which Dopamine Receptors May Influence Synaptic Plasticity
Wolf, M. E., Mangiavacchi, S., & Sun, X. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1300.015 · Cited by 140
Common aspects of the action of nicotine and other drugs of abuse
Picciotto, M. R. (1998) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(98)00074-x · Cited by 117
Carroll, M. E. (1993) · Drug and Alcohol Dependence · doi:10.1016/0376-8716(93)90061-t · Cited by 75
Reinforcement learning models of the dopamine system and their behavioral implications
Daw, N. D., & Touretzky, D. S. (2003) · Cited by 68
Self‐titration of nicotine: evidence from the Scottish Heart Health Study
Woodward, M., & Tunstall‐Pedoe, H. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02096.x · Cited by 44
Book Review: Dynamics of Extracellular Dopamine in the Acute and Chronic Actions of Cocaine
Bradberry, C. W. (2002) · The Neuroscientist · doi:10.1177/107385840200800407 · Cited by 30
Cited by
NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory
Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647
The debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697
Paulus, M. P., & Stein, M. B. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.03.042 · Cited by 1,325
Metadata
- Authors
- Redish, A. D.
- Venue
- Science
- Published
- 2004-12-10
- Volume
- 306
- Issue
- 5703
- Pages
- 1944-1947
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2119631764
- Cited by
- 540
- References
- 36
- FWCI
- 8.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.