A Computational Model of Craving and Obsession
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
If addictions and problematic behaviors arise from interactions between drugs, reward sequences, and natural learning sytems, then an explanation of clinically problematic conditions (such as the self‐administration of drugs or problem gambling) requires an understanding of the neural systems that have evolved to allow an agent to make decisions. We hypothesize a unified decision‐making system consisting of three components—a situation recognition system, a flexible, planning‐capable system, and an inflexible, habit‐like system. In this article, we present a model of the planning‐capable system based on a planning process arising from experimentally observed look‐ahead dynamics in the hippocampus enabling a forward search of possibilities and an evaluation process in the nucleus accumbens. Based on evidence that opioid signaling can provide hedonic evalutation of an achieved outcome, we hypothesize that similar opioid‐signaling processes evaluate the value of expected outcomes. This leads to a model of craving, based on the recognition of a path to a high‐value outcome, and obsession, based on a value‐induced limitation of the search process. This theory can explain why opioid antagonists reduce both hedonic responses and craving.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
The Neural Basis of Addiction: A Pathology of Motivation and Choice
Kalivas, P. W., & Volkow, N. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1403 · Cited by 2,757
Spatial localization does not require the presence of local cues
Morris, R. G. M. (1981) · Learning and Motivation · doi:10.1016/0023-9690(81)90020-5 · Cited by 2,699
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
From motivation to action: Functional interface between the limbic system and the motor system
MOGENSON, G., JONES, D., & YIM, C. (1980) · Progress in Neurobiology · doi:10.1016/0301-0082(80)90018-0 · Cited by 2,331
Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective
Bechara, A. (2005) · Nature Neuroscience · doi:10.1038/nn1584 · Cited by 2,149
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Abstract reward and punishment representations in the human orbitofrontal cortex
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J., & Andrews, C. (2001) · Nature Neuroscience · doi:10.1038/82959 · Cited by 2,003
Remembrance of places passed: Spatial memory in rats.
Olton, D. S., & Samuelson, R. J. (1976) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.2.2.97 · Cited by 1,998
Berridge, K. C., & Robinson, T. E. (2003) · Trends in Neurosciences · doi:10.1016/s0166-2236(03)00233-9 · Cited by 1,869
Place units in the hippocampus of the freely moving rat
O'Keefe, J. (1976) · Experimental Neurology · doi:10.1016/0014-4886(76)90055-8 · Cited by 1,836
Matthes, H. W. D., Maldonado, R., Simonin, F., Valverde, O., Slowe, S., Kitchen, I., Befort, K., Dierich, A., Le Meur, M., Dollé, P., et al. (1996) · Nature · doi:10.1038/383819a0 · Cited by 1,722
Neurons in the orbitofrontal cortex encode economic value
Padoa-Schioppa, C., & Assad, J. A. (2006) · Nature · doi:10.1038/nature04676 · Cited by 1,598
Pavlovian conditioning: it's not what you think it is
Rescorla, R. A. (1988) · American Psychologist · doi:10.1037/0003-066x.43.3.151 · Cited by 1,542
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex
Volkow, N. D. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.3.318 · Cited by 1,240
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226
Theta rhythms coordinate hippocampal-prefrontal interactions in a spatial memory task
Jones, M. W., & Wilson, M. A. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030402 · Cited by 1,036
Activation of memory circuits during cue-elicited cocaine craving.
Grant, S., London, E. D., Newlin, D. B., Villemagne, V. L., Liu, X., Contoreggi, C., Phillips, R. L., Kimes, A. S., & Margolin, A. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.21.12040 · Cited by 936
Replay and Time Compression of Recurring Spike Sequences in the Hippocampus
Nádasdy, Z., Hirase, H., Czurkó, A., Csicsvari, J., & Buzsáki, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09497.1999 · Cited by 932
Kudrimoti, H. S., Barnes, C. A., & McNaughton, B. L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-04090.1999 · Cited by 753
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748
Unmanageable motivation in addiction: a pathology in prefrontal-accumbens glutamate transmission
Kalivas, P. W., Volkow, N., & Seamans, J. (2005) · Neuron · doi:10.1016/j.neuron.2005.02.005 · Cited by 657
Drug addiction: bad habits add up
Robbins, T. W., & Everitt, B. J. (1999) · Nature · doi:10.1038/19208 · Cited by 599
Schoenbaum, G., Chiba, A. A., & Gallagher, M. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-05-01876.1999 · Cited by 579
Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-09-03251.2001 · Cited by 564
Chudasama, Y., Passetti, F., Rhodes, S. E. V., Lopian, D., Desai, A., & Robbins, T. W. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.020 · Cited by 518
Orbitofrontal cortex, decision-making and drug addiction
Schoenbaum, G., Roesch, M. R., & Stalnaker, T. A. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2005.12.006 · Cited by 499
Ito, R., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-14-06247.2002 · Cited by 463
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
Anticraving Medications for Relapse Prevention: A Possible New Class of Psychoactive Medications
O’Brien, C. P. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1423 · Cited by 405
Orbitofrontal cortex, associative learning and expectancies
Schoenbaum, G., & Roesch, M. (2005) · Neuron · doi:10.1016/j.neuron.2005.07.018 · Cited by 404
Pennartz, C. M. A., Lee, E., Verheul, J., Lipa, P., Barnes, C. A., & McNaughton, B. L. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0575-04.2004 · Cited by 282
Neural Systems Underlying Opiate Addiction
De Vries, T. J., & Shippenberg, T. S. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-09-03321.2002 · Cited by 270
Owen, A. M. (1997) · Progress in Neurobiology · doi:10.1016/s0301-0082(97)00042-7 · Cited by 251
Letchworth, S. R., Nader, M. A., Smith, H. R., Friedman, D. P., & Porrino, L. J. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02799.2001 · Cited by 239
Contributions of Striatal Subregions to Place and Response Learning
Yin, H. H., & Knowlton, B. J. (2004) · Learning & Memory · doi:10.1101/lm.81004 · Cited by 238
Nonpeptidic δ-opioid Receptor Agonists Reduce Immobility in the Forced Swim Assay in Rats
Broom, D. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(01)00413-4 · Cited by 175
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173
Memory processes governing amphetamine-induced psychomotor sensitization
Anagnostaras, S. (2002) · Neuropsychopharmacology · doi:10.1016/s0893-133x(01)00402-x · Cited by 143
Cited by
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184
Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003
Self-citationA unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501
Self-citationCovert expectation-of-reward in rat ventral striatum at decision points
van der Meer, M. A. A. (2009) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.001.2009 · Cited by 296
Computational nosology and precision psychiatry
Friston, K. J., Redish, A. D., & Gordon, J. A. (2017) · Computational Psychiatry · doi:10.1162/cpsy_a_00001 · Cited by 126
“One of the key issues addressed by this group was the status of psychiatric nosology and how it might be informed by advances in computational neurobiology (Montague, Dolan, Friston, & Dayan, 2012; Redish & Johnson, 2007; Wang & Krystal, 2014).”
BackgroundSelf-citation
Metadata
- Authors
- REDISH, A. D., & JOHNSON, A.
- Venue
- Annals of the New York Academy of Sciences
- Publisher
- Wiley
- Published
- 2007-05
- Volume
- 1104
- Issue
- 1
- Pages
- 324-339
- ISSN
- 0077-8923 (ISSN-L)
- 1749-6632
- OpenAlex
- W2128822095
- Cited by
- 52
- References
- 45
- FWCI
- 1.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.