Transition from ‘model-based’ to ‘model-free’ behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Cocaine addiction is a complex and multidimensional process involving a number of behavioral and neural forms of plasticity. The behavioral transition from voluntary drug use to compulsive drug taking may be explained at the neural level by drug-induced changes in function or interaction between a flexible planning system, associated with prefrontal cortical regions, and a rigid habit system, associated with the striatum. The dichotomy between these two systems is operationalized in computational theory by positing model-based and model-free learning mechanisms, the former relying on an “internal model” of the environment and the latter on pre-computed or cached values to control behavior. In this review, we will suggest that model-free and model-based learning mechanisms appear to be differentially affected, at least in the case of psychostimulants such as cocaine, with the former being enhanced while the latter are disrupted. As a result, the behavior of long-term drug users becomes less flexible and responsive to the desirability of expected outcomes and more habitual, based on the long history of reinforcement. To support our specific proposal, we will review recent neural and behavioral evidence on the effect of psychostimulant exposure on orbitofrontal and dorsolateral striatum structure and function.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · cited 2×
“Interaction between these pavlovian and instrumental processes lead to the transition from voluntary drug use to compulsive drug taking (Everitt and Robbins, 2005).”
BackgroundDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“The dichotomy between these two systems is captured in computational neuroscience by the concepts of model-based and model-free reinforcement learning (Daw et al., 2005, Dayan and Daw, 2008).”
BackgroundA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“…learning underlies habitual behavior, and the dorsolateral striatum, already demonstrated to be involved in automatic behavior (Balleine et al., 2007), seems to be the most promising candidate as a neural correlate of exclusively model-free signals (Montague et al., 1996, Wunderlich et al., 2012).”
BackgroundDissecting components of reward: ‘liking’, ‘wanting’, and learning
Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2008.12.014 · Cited by 1,942
Jentsch, J. D., & Taylor, J. R. (1999) · Psychopharmacology · doi:10.1007/pl00005483 · Cited by 1,545 · cited 1×
“…use is mediated by the positive reinforcing effects of the drug, but the transition to addiction may be linked to a reduced behavioral control with a concomitant development of drug-seeking habits (Jentsch and Taylor, 1999, Volkow and Fowler, 2000, Everitt and Robbins, 2005, Berridge et al., 2009).”
BackgroundGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 1×
“A rich body of work using these computational tools has already broadened our understanding of the microstructure of behavior and the neural circuits underlying valuebased decision-making (O'Doherty et al., 2003, Seymour et al., 2004).”
BackgroundHow does stress increase risk of drug abuse and relapse?
Sinha, R. (2001) · Psychopharmacology · doi:10.1007/s002130100917 · Cited by 1,505 · cited 1×
“…between cocaine and stress effects on model-free and model-based learning mechanisms is extremely intriguing, especially because stress is a critical risk factor for the development of addiction as well as for relapse to drug seeking after abstinence (Piazza and Le Moal, 1996, Sinha, 2001).”
BackgroundThe Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · cited 2×
“…that model-free learning underlies habitual behavior, and the dorsolateral striatum, already demonstrated to be involved in automatic behavior (Balleine et al., 2007), seems to be the most promising candidate as a neural correlate of exclusively model-free signals (Montague et al., 1996,…”
BackgroundRelative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314 · cited 1×
“Furthermore anticipatory neuronal activity in OFC changes when the value of an outcome is reduced by satiety (Critchley and Rolls, 1996, Tremblay and Schultz, 1999) and functional studies demonstrate that the blood oxygen level-dependent activity in OFC correlates with changes in the value of…”
Background
Cited by
Story, G. W., Vlaev, I., Seymour, B., Darzi, A., & Dolan, R. J. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00076 · Cited by 286
Miller, K. J., Shenhav, A., & Ludvig, E. A. (2019) · Psychological Review · doi:10.1037/rev0000120 · Cited by 280
Going and stopping: dichotomies in behavioral control by the prefrontal cortex
Gourley, S. L., & Taylor, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4275 · Cited by 195
Pathological overeating: emerging evidence for a compulsivity construct
Moore, C. F., Sabino, V., Koob, G. F., & Cottone, P. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.269 · Cited by 126
“It is hypothesized that compulsive behavior may reflect a maladaptive stimulus– response habit that was once a flexible and voluntary goal-directed behavior (Everitt and Robbins, 2005; Halbout et al, 2016; Lucantonio et al, 2014; Ostlund and Balleine, 2008).”
Learning to lose control: A process-based account of behavioral addiction
Perales, J. C., King, D. L., Navas, J. F., Schimmenti, A., Sescousse, G., Starcevic, V., van Holst, R. J., & Billieux, J. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.12.025 · Cited by 101
Metadata
- Authors
- Lucantonio, F., Caprioli, D., & Schoenbaum, G.
- Venue
- Neuropharmacology
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 76
- Pages
- 407-415
- ISSN
- 0028-3908 (ISSN-L)
- OpenAlex
- W1975489711
- Cited by
- 78
- References
- 49
- FWCI
- 3.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Transition from ‘model-based’ to ‘model-free’ behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum. https://app.cochat.ai/papers/10.1016/j.neuropharm.2013.05.033
- The paper
- Lucantonio, F., Caprioli, D., & Schoenbaum, G. (2014). Transition from ‘model-based’ to ‘model-free’ behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum. Neuropharmacology. https://doi.org/10.1016/j.neuropharm.2013.05.033
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.