Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
The DOI matches its Crossref record; 102 of the 102 references it cites were found in a registry or an index.
Abstract
Drug addiction is increasingly viewed as the endpoint of a series of transitions from initial drug use--when a drug is voluntarily taken because it has reinforcing, often hedonic, effects--through loss of control over this behavior, such that it becomes habitual and ultimately compulsive. Here we discuss evidence that these transitions depend on interactions between pavlovian and instrumental learning processes. We hypothesize that the change from voluntary drug use to more habitual and compulsive drug use represents a transition at the neural level from prefrontal cortical to striatal control over drug seeking and drug taking behavior as well as a progression from ventral to more dorsal domains of the striatum, involving its dopaminergic innervation. These neural transitions may themselves depend on the neuroplasticity in both cortical and striatal structures that is induced by chronic self-administration of drugs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Thus, in later stages of addictive behaviors (Fig. 2B), stimuli-speci fi c inhibitory control processes may be in fl uenced by craving and urges related to encountering addiction-related stimuli, which may then make it more likely that an individual will behave habitually or seemingly automatically (Everitt and Robbins, 2005, 2013, 2016).”
From The Interaction of Person-Affect-Cognition-Execution (I-PACE) model for addictive behaviors: Update, generalization to addictive behaviors beyond internet-use disorders, and specification of the process character of addictive behaviors (2019) · cites this paper as Everitt and Robbins, 2005
In the citing paper
“The pathways include dopaminergic projections from the ventral tegmental area and substantia nigra to prefrontal areas, the ventral striatum, and anterior cingulate gyrus as well as serotonergic projections from raphé nuclei to prefrontal areas (mainly orbitofrontal regions) (Everitt and Robbins, 2005; Volkow et al., 2012, 2013).”
From The Interaction of Person-Affect-Cognition-Execution (I-PACE) model for addictive behaviors: Update, generalization to addictive behaviors beyond internet-use disorders, and specification of the process character of addictive behaviors (2019) · cites this paper as Everitt and Robbins, 2005
In the citing paper
“The mesolimbic dopamine system is an evolutionarily conserved set of circuits that plays a role in approach and avoidance, appetitive behavior, and reward processing (Wise, 2004; Everitt and Robbins, 2005; Alcantara et al., 2022).”
From Ventral striatum dopamine release encodes unique properties of visual stimuli in mice (2023) · cites this paper as Everitt and Robbins, 2005
In the citing paper
“Understanding drug addiction via biological mechanisms alone, however, is reductionist, considering many individuals continue to take substances in the absence of withdrawal symptoms or craving (Everitt & Robbins, 2005).”
From “I don’t want to take buprenorphine for the rest of my life”: Acceptance and Commitment Therapy for a Client Struggling to Reduce Low-Dose Buprenorphine (a Hermeneutic Single-Case Efficacy Design) (2023) · cites this paper as Everitt & Robbins, 2005
In the citing paper
“In later phases of addiction, habitual responses become important, with cues automatically triggering approach-reactions, outside voluntary control”
From Addiction, adolescence, and the integration of control and motivation (2011) · cites this paper as Everitt and Robbins, 2005
9 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The neural basis of drug craving: An incentive-sensitization theory of addiction
Robinson, T. (1993) · Brain Research Reviews · doi:10.1016/0165-0173(93)90013-p · Cited by 7,346 · cited 1×
“Therefore, it might logically be thought that pavlovian approach is involved in maladaptively attracting humans toward sources of addictive drug reinforcers, and that drug-associated CSs that occur unexpectedly invigorate their efforts to seek and take or 'want' drugs as emphasized in the incentive salience theory of…”
BackgroundNeural systems supporting interoceptive awareness
Critchley, H. D., Wiens, S., Rotshtein, P., Öhman, A., & Dolan, R. J. (2004) · Nature Neuroscience · doi:10.1038/nn1176 · Cited by 3,406
Dopamine, learning and motivation.
Wise, R. A. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1406 · Cited by 3,379
Drug Addiction, Dysregulation of Reward, and Allostasis
Koob, G. (2001) · Neuropsychopharmacology · doi:10.1016/s0893-133x(00)00195-0 · Cited by 2,953 · cited 1×
“Alternatively, as in the case of obsessive-compulsive disorder itself, which has similarly been associated with dysfunctional orbitofrontal-striatal circuitry, it may be necessary to postulate a source of negative reinforcement that maintains responding, for example, through opponent motivational systems also engaged…”
BackgroundGoldstein, R. Z., & Volkow, N. D. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.10.1642 · Cited by 2,667
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“They are broadly compatible with functional neuroimaging evidence in humans that the ventral striatum is implicated in pavlovian conditioning and the dorsal striatum with instrumental learnin”
BackgroundDiscrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · cited 1×
“but may also be active, at least in their tonic mode, under other circumstances in response to such factors as unpredictabilit”
BackgroundThe reinstatement model of drug relapse: history, methodology and major findings
Shaham, Y., Shalev, U., Lu, L., de Wit, H., & Stewart, J. (2003) · Psychopharmacology · doi:10.1007/s00213-002-1224-x · Cited by 1,615 · cited 1×
“Studies of the cued reinstatement of extinguished responding for cocaine ( Box 2 ) have been reviewed extensively elsewher”
BackgroundAddiction Is a Brain Disease, and It Matters
Leshner, A. I. (1997) · Science · doi:10.1126/science.278.5335.45 · Cited by 1,615
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610
Cited by
Items 201–300 of 1,062
Time to connect: bringing social context into addiction neuroscience
Heilig, M., Epstein, D. H., Nader, M. A., & Shaham, Y. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.67 · Cited by 298
The discovery of central monoamine neurons gave volume transmission to the wired brain
Fuxe, K., Dahlström, A. B., Jonsson, G., Marcellino, D., Guescini, M., Dam, M., Manger, P., & Agnati, L. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.10.012 · Cited by 285
Reversal of cocaine addiction by environmental enrichment
Solinas, M., Chauvet, C., Thiriet, N., El Rawas, R., & Jaber, M. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806889105 · Cited by 280
Inactivation of the Interoceptive Insula Disrupts Drug Craving and Malaise Induced by Lithium
Contreras, M., Ceric, F., & Torrealba, F. (2007) · Science · doi:10.1126/science.1145590 · Cited by 297
D2R striatopallidal neurons inhibit both locomotor and drug reward processes
Durieux, P. F., Bearzatto, B., Guiducci, S., Buch, T., Waisman, A., Zoli, M., Schiffmann, S. N., & de Kerchove d'Exaerde, A. (2009) · Nature Neuroscience · doi:10.1038/nn.2286 · Cited by 297
O'Sullivan, S. S., Wu, K., Politis, M., Lawrence, A. D., Evans, A. H., Bose, S. K., Djamshidian, A., Lees, A. J., & Piccini, P. (2011) · Brain · doi:10.1093/brain/awr003 · Cited by 297
“Since the dorsal striatum is implicated in habit and stimulus-response learning, this association has been thought to reflect the strengthening of habitual control over drug seeking/taking as addiction takes hold (Everitt and Robbins, 2005; Volkow et al., 2009).”
Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats
Zapata, A., Minney, V. L., & Shippenberg, T. S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4072-10.2010 · Cited by 296
“It has been suggested that compulsive drug seeking can be characterized as a maladaptive stimulus–response habit in which the ultimate goal of the behavior has been devalued, perhaps through tolerance to the rewarding effects of the drug and that the persisting quality of these habits is central to drug addiction (Eve…”
BackgroundInfluentialAddiction, adolescence, and the integration of control and motivation
Gladwin, T. E., Figner, B., Crone, E. A., & Wiers, R. W. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.06.008 · Cited by 296
“become important, with cues automatically triggering approach-reactions, outside voluntary control (Everitt and Robbins, 2005).”
Stress-induced modulation of instrumental behavior: From goal-directed to habitual control of action
Schwabe, L., & Wolf, O. T. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.12.038 · Cited by 269
Reimann, M., Castaño, R., Zaichkowsky, J., & Bechara, A. (2012) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2011.11.003 · Cited by 271
Goschke, T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1410 · Cited by 293
“…model-free) learning and valuation systems, it has been suggested that drug-induced changes in corticostriatal pathways lead to a transition from voluntary goal-directed to habitual and ultimately compulsive drugseeking and consumption behaviour (Everitt et al., 2008; Everitt and Robbins, 2005).”
BackgroundThe role of dopamine in bipolar disorder
Cousins, D. A., Butts, K., & Young, A. H. (2009) · Bipolar Disorders · doi:10.1111/j.1399-5618.2009.00760.x · Cited by 291
The role of habit in compulsivity
Gillan, C. M., Robbins, T. W., Sahakian, B. J., van den Heuvel, O. A., & van Wingen, G. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.033 · Cited by 292
“Probably the earliest disorder for which habit learning was considered a viable model was drug addiction (Robbins and Everitt, 1999; Gerdeman et al., 2003; Everitt and Robbins, 2005; Hogarth et al., 2013).”
BackgroundSelf-citationDistinct Subtypes of Apathy Revealed by the Apathy Motivation Index
Ang, Y.-S., Lockwood, P., Apps, M. A. J., Muhammed, K., & Husain, M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169938 · Cited by 255
Addiction as a brain disease revised: why it still matters, and the need for consilience
(2021) · doi:10.1038/s41386-020-00950-y · Cited by 290
Model-based choices involve prospective neural activity
Doll, B. B., Duncan, K. D., Simon, D. A., Shohamy, D., & Daw, N. D. (2015) · Nature Neuroscience · doi:10.1038/nn.3981 · Cited by 283
The hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287
Self-citationConnectivity-based segregation of the human striatum predicts personality characteristics
Cohen, M. X., Schoene-Bake, J.-C., Elger, C. E., & Weber, B. (2009) · Nature Neuroscience · doi:10.1038/nn.2228 · Cited by 281
Drugs as instruments: A new framework for non-addictive psychoactive drug use
Müller, C. P., & Schumann, G. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11000057 · Cited by 286
Uhl, G. R., Koob, G. F., & Cable, J. (2019) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13989 · Cited by 240
Impulse Control and Related Disorders in Parkinson's Disease
Weintraub, D., & Claassen, D. O. (2017) · International Review of Neurobiology · doi:10.1016/bs.irn.2017.04.006 · Cited by 272
O’Hara, C. B., Campbell, I. C., & Schmidt, U. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.02.012 · Cited by 274
Hogarth, L. (2020) · Neuropsychopharmacology · doi:10.1038/s41386-020-0600-8 · Cited by 281
Interoception and drug addiction
Paulus, M. P., & Stewart, J. L. (2014) · Neuropharmacology · doi:10.1016/j.neuropharm.2013.07.002 · Cited by 281
“systems (Everitt and Robbins, 2005; London et al., 2000), and molecular mechanisms (Kalivas and Volkow, 2005; Nestler and”
BackgroundMackey, S., Allgaier, N., Chaarani, B., Spechler, P., Orr, C., Bunn, J., Allen, N. B., Alia-Klein, N., Batalla, A., Blaine, S., et al. (2019) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17040415 · Cited by 266
The persistence of maladaptive memory: Addiction, drug memories and anti-relapse treatments
Milton, A. L., & Everitt, B. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.002 · Cited by 279
“Thus, briefly (see Cardinal et al., 2003; Everitt and Robbins, 2005, for more extensive review) the NAcbC and NAcbSh are required for different influences on pavlovian CSs on behaviour; lesions of the NAcbC lead to deficits in conditioned reinforcement and general PIT (Hall et al., 2001a; Parkinson…”
InfluentialSelf-citationPositive parenting predicts the development of adolescent brain structure: a longitudinal study
Whittle, S., Simmons, J. G., Dennison, M., Vijayakumar, N., Schwartz, O., Yap, M. B. H., Sheeber, L., & Allen, N. B. (2014) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.10.006 · Cited by 279
“The striatum is thought to play a central role in synchronizing different aspects of reward and learning (Everitt and Robbins, 2005).”
Beck, A., Wüstenberg, T., Genauck, A., Wrase, J., Schlagenhauf, F., Smolka, M. N., Mann, K., & Heinz, A. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.2026 · Cited by 270
Heidbreder, C. A., & Newman, A. H. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05149.x · Cited by 273
Dopamine, behavioral economics, and effort
Salamone, J. D. (2009) · Frontiers in Behavioral Neuroscience · doi:10.3389/neuro.08.013.2009 · Cited by 277
“…to maintain the distinction between the terms reward and reinforcement; with this usage, reinforcement refers more directly to instrumental learning mechanisms (Wise, 2004; Sanchis-Segura and Spanagel, 2006), while reward connotes the primary motivational Dopamine, behavioral economics, and effort”
BackgroundInfluentialGarland, E. L., Froeliger, B., Zeidan, F., Partin, K., & Howard, M. O. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.08.006 · Cited by 277
The clinical neurobiology of drug craving
Sinha, R. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.05.001 · Cited by 256
Sex differences in the neurobiology of drug addiction
Bobzean, S. A. M., DeNobrega, A. K., & Perrotti, L. I. (2014) · Experimental Neurology · doi:10.1016/j.expneurol.2014.01.022 · Cited by 262
“This reflects changes in activity of midbrain–forebrain systems specifically, from impulsive to compulsive use, which represents a shift from prefrontal regulatory control of behaviors to limbic/striatal control (Everitt and Robbins, 2005; Piazza and Deroche-Gamonet, 2013).”
A role for mesencephalic dopamine in activation: commentary on Berridge (2006)
Robbins, T. W., & Everitt, B. J. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0528-7 · Cited by 264
“We also surmise that other, possibly related “topdown” influences may explain why dopaminergic activation is reinforcing; the subject may be striving to attain a hypothetically optimal level of activation via the capacity for “self-medication” (also see Everitt and Robbins 2005).”
BackgroundInfluentialSelf-citationAMPA receptor plasticity in the nucleus accumbens after repeated exposure to cocaine
Wolf, M. E., & Ferrario, C. R. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.01.013 · Cited by 271
“situations, the the final common pathway for drug seeking involves glutamate inputs terminating on MSN in the NAc (Kalivas and McFarland, 2003; Kalivas and Volkow, 2005), although motor circuitry involving the dorsal striatum becomes more important as drug use becomes habitual (Everitt and Robbins, 2005).”
BackgroundShared and unique mechanisms underlying binge eating disorder and addictive disorders
Schulte, E. M., Grilo, C. M., & Gearhardt, A. N. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.02.001 · Cited by 271
“Specifically, addiction is thought to occur, in part, because addictive substances trigger hedonically pleasurable effects (Everitt & Robbins, 2005) and cause changes in reward-related neural systems (Dackis & O'Brien, 2001; Koob & Le Moal, 1997).”
BackgroundExley, R., & Cragg, S. J. (2008) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707510 · Cited by 250
“…and sensorimotor-related brain functions (for example, Albin et al., 1989; Haber et al., 2000; Gerdeman et al., 2003; Voorn et al., 2004; Everitt and Robbins, 2005; and Schultz, 2006), among which are the following commonly attributed (and not necessarily mutually exclusive) processes:…”
BackgroundDissociable Effects of Dopamine and Serotonin on Reversal Learning
den Ouden, H. E. M., Daw, N. D., Fernandez, G., Elshout, J. A., Rijpkema, M., Hoogman, M., Franke, B., & Cools, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.030 · Cited by 255
Exposure to the Taste of Alcohol Elicits Activation of the Mesocorticolimbic Neurocircuitry
Filbey, F. M., Claus, E., Audette, A. R., Niculescu, M., Banich, M. T., Tanabe, J., Du, Y. P., & Hutchison, K. E. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301513 · Cited by 270
“Alcoholic tastes and BOLD FM Filbey et al involved in the seeking of drugs (Everitt and Robbins, 2005).”
BackgroundPrevention and treatment of drug addiction by environmental enrichment
Solinas, M., Thiriet, N., Chauvet, C., & Jaber, M. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.08.002 · Cited by 253
Neural Circuit Motifs in Valence Processing
Tye, K. M. (2018) · Neuron · doi:10.1016/j.neuron.2018.10.001 · Cited by 247
Gambling Disorder and Other Behavioral Addictions: Recognition and Treatment
Yau, Y. H. C., & Potenza, M. N. (2015) · Harvard Review of Psychiatry · doi:10.1097/hrp.0000000000000051 · Cited by 267
Excessive cocaine use results from decreased phasic dopamine signaling in the striatum
Willuhn, I., Burgeno, L. M., Groblewski, P. A., & Phillips, P. E. M. (2014) · Nature Neuroscience · doi:10.1038/nn.3694 · Cited by 261
“In contrast to the VMS, response-contingent dopamine release in the DLS did not differ between escalated and non-escalated LgA animals (main effect of intake: F(1,48) = 0.”
BackgroundResultInfluentialKoya, E., Golden, S. A., Harvey, B. K., Guez-Barber, D. H., Berkow, A., Simmons, D. E., Bossert, J. M., Nair, S. G., Uejima, J. L., Marin, M. T., et al. (2009) · Nature Neuroscience · doi:10.1038/nn.2364 · Cited by 264
“Daun02 also attenuated cocaine-induced β-galactosidase expression (Figure 3C) in rats that previously received cocaine, but not saline, on induction day (interaction of Daun02 infusions with Induction day injection: F(1,53)=4.”
BackgroundInfluentialNucleus Accumbens μ-Opioid Receptors Mediate Social Reward
Trezza, V., Damsteegt, R., Achterberg, E. J. M., & Vanderschuren, L. J. M. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5492-10.2011 · Cited by 263
“Differences between the NAc core and shell in mediating the rewarding properties of food and drugs have been reported (Ikemoto and Wise, 2004; Kelley, 2004; Everitt and Robbins, 2005; Berridge and Kringelbach, 2008) whereby some studies show that -opioid neurotransmission enhances the hedonic impact of palatable food…”
BackgroundInfluentialErsche, K. D., Roiser, J. P., Robbins, T. W., & Sahakian, B. J. (2008) · Psychopharmacology · doi:10.1007/s00213-007-1051-1 · Cited by 252
“…from recreational drug use, motivated by the anticipation of the pleasurable effects of the drug, to habitual drug-taking and finally to compulsive drug-seeking behaviour is reflected in a progression from ventral-to-dorsal striatal involvement (see, for review, Everitt and Robbins 2005).”
Self-citationPrefrontal Cortex Fails to Learn from Reward Prediction Errors in Alcohol Dependence
Park, S. Q., Kahnt, T., Beck, A., Cohen, M. X., Dolan, R. J., Wrase, J., & Heinz, A. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5587-09.2010 · Cited by 258
“…in the dlPFC in substance abusers (Makris et al., 2008a,b) and the role of striatal dopamine in cue-induced craving (Heinz et al., 2004; Everitt and Robbins, 2005; Di Chiara and Bassareo, 2007), we hypothesized that frontostriatal coupling should be related to patients’ ability to…”
BackgroundMcCabe, C., Rolls, E. T., Bilderbeck, A., & McGlone, F. (2008) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn005 · Cited by 262
“This is of interest , for the ventral striatum is impli - cated in for example addiction ( Robbins and Everitt , 1996 ; Everitt and Robbins , 2005 ; Baler and Volkow , 2006 ) and food craving ( Rolls and McCabe , 2007 ) , and our finding shows that even word - level cognitive effects can modulate…”
BackgroundNeuroscience of Internet Pornography Addiction: A Review and Update
Love, T., Laier, C., Brand, M., Hatch, L., & Hajela, R. (2015) · Behavioral Sciences · doi:10.3390/bs5030388 · Cited by 262
“Everitt, B.J.; Robbins, T.W. Neural systems of reinforcement for drug addiction: From actions to habits to compulsion.”
BackgroundInfluentialRogers, R. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.165 · Cited by 249
“Dopamine is likely to exert a multi-faceted influence upon decision making through the activity of its forward afferents along the mesolimbic, striatal, and cortical pathways, with the nucleus accumbens playing a pivotal role in action selection (Everitt and Robbins, 2005).”
BackgroundSmartphone addiction and associated consequences: Role of loneliness and self-regulation
Mahapatra, S. (2019) · Behaviour & Information Technology · doi:10.1080/0144929x.2018.1560499 · Cited by 261
“Gradually, user falls into a pattern of repetitive behaviour as a means of mood enhancement and the level of psychological dependency increases once the repetitive behaviour is reinforced (Everitt and Robbins 2005).”
BackgroundAltered Impulse Control in Alcohol Dependence: Neural Measures of Stop Signal Performance
Li, C. R., Luo, X., Yan, P., Bergquist, K., & Sinha, R. (2009) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2008.00891.x · Cited by 252
“A number of investigators have hypothesized a critical association between drug and alcohol addiction and deficits in impulse control (Ernst and Paulus, 2005; Everitt and Robbins, 2005; Goldstein and Volkow, 2002; Kalivas and Volkow, 2005; Moeller et al., 2001; Volkow and Li, 2005).”
What is reinforced by phasic dopamine signals?
Redgrave, P., Gurney, K., & Reynolds, J. (2008) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 261
“…debilitating conditions including Parkinson's disease, Huntington's disease, Tourette's syndrome, schizophrenia, attention-deficit disorder, obsessive–compulsive disorder (Crossman, 2000; Fuxe et al., 2006; Ring and SerraMestres, 2002), and many of the addictions (Everitt and Robbins, 2005).”
BackgroundCompulsivity in obsessive–compulsive disorder and addictions
Figee, M., Pattij, T., Willuhn, I., Luigjes, J., van den Brink, W., Goudriaan, A., Potenza, M. N., Robbins, T. W., & Denys, D. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.003 · Cited by 246
“Although it has long been speculated that habits may be a hallmark of OCD, excessive habits were first demonstrated in animal models of addiction in association with defective goal-directed behaviors that are mediated by frontostriatal mechanisms (Everitt and Robbins 2005; Everitt et al., 2008).”
BackgroundSelf-citationHong, L. E., Gu, H., Yang, Y., Ross, T. J., Salmeron, B. J., Buchholz, B., Thaker, G. K., & Stein, E. A. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.2 · Cited by 260
“The progression of addiction is thought to be associated with initial medial frontal/anterior cingulate cortex executive control over ventral striatal reinforcement mechanisms, which, as the addictive processes continue, are replaced by more habit-driven, dorsal striatal activity.(54,55) The finding that more severe n…”
Neural substrates of cue reactivity: association with treatment outcomes and relapse
Courtney, K. E., Schacht, J. P., Hutchison, K., Roche, D. J. O., & Ray, L. A. (2016) · Addiction Biology · doi:10.1111/adb.12314 · Cited by 243
“Increasingly, addiction neurobiology has focused on the transition to habitualness of alcohol and drug intake (Everitt & Robbins 2005) as well negative reinforcement and alleviation of protracted withdrawal (Koob & Le Moal 2005).”
Carrots and sticks fail to change behavior in cocaine addiction
Ersche, K. D., Gillan, C. M., Jones, P. S., Williams, G. B., Ward, L. H. E., Luijten, M., de Wit, S., Sahakian, B. J., Bullmore, E. T., & Robbins, T. W. (2016) · Science · doi:10.1126/science.aaf3700 · Cited by 239
Self-citationEvolving the future: Toward a science of intentional change
Wilson, D. S., Hayes, S. C., Biglan, A., & Embry, D. D. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13001593 · Cited by 255
The drive to eat: comparisons and distinctions between mechanisms of food reward and drug addiction
DiLeone, R. J., Taylor, J. R., & Picciotto, M. R. (2012) · Nature Neuroscience · doi:10.1038/nn.3202 · Cited by 245
Griffiths, M., Pontes, H., & Kuss, D. (2015) · Neuroscience and Neuroeconomics · doi:10.2147/nan.s60982 · Cited by 223
“82 As a consequence, the individual becomes less sensitive to natural rewards, such as food and sex, and instead seeks the addictive behavior, 83,84 ultimately changing brain chemistry and leading to craving and tolerance.”
Fuxe, K., Dahlström, A., Höistad, M., Marcellino, D., Jansson, A., Rivera, A., Diaz-Cabiale, Z., Jacobsen, K., Tinner-Staines, B., Hagman, B., et al. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.02.009 · Cited by 250
“…have indicated that the striatal islands play a crucial role in motor learning responsible for the development of L-dopa induced dyskinesias (Graybiel et al., 2000; Agnati et al., 2003b) and habit acquisition in drug addiction (Graybiel et al., 2000; Everitt and Robbins, 2005; Canales, 2005).”
BackgroundNew technologies for examining the role of neuronal ensembles in drug addiction and fear
Cruz, F. C., Koya, E., Guez-Barber, D. H., Bossert, J. M., Lupica, C. R., Shaham, Y., & Hope, B. T. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3597 · Cited by 244
Willuhn, I., Burgeno, L. M., Everitt, B. J., & Phillips, P. E. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1213460109 · Cited by 249
“However, the progression of drug taking beyond recreational use is thought to reflect the engagement of different psychological processes mediated within several neural loci (10, 11), with a particular emphasis on the incorporation of the sensorimotor (dorsolateral) striatum (DLS) in the control of established drugsee…”
BackgroundSelf-citationThe endocannabinoid system in brain reward processes
Solinas, M., Goldberg, S. R., & Piomelli, D. (2008) · British Journal of Pharmacology · doi:10.1038/bjp.2008.130 · Cited by 244
“Drugs of abuse share the ability to elevate extracellular levels of dopamine in the shell of the NAcc, as measured by in vivo microdialysis, and this effect is believed to play an important role in their reinforcing effects (Koob, 2000; Di Chiara et al., 2004; Wise, 2004; Everitt and Robbins, 2005).”
BackgroundInfluentialErnst, M., Romeo, R. D., & Andersen, S. L. (2009) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2008.12.013 · Cited by 240
Leeman, R. F., & Potenza, M. N. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800503 · Cited by 228
Yücel, M., Oldenhof, E., Ahmed, S. H., Belin, D., Billieux, J., Bowden‐Jones, H., Carter, A., Chamberlain, S. R., Clark, L., Connor, J., et al. (2019) · Addiction · doi:10.1111/add.14424 · Cited by 229
Flagel, S. B., Watson, S. J., Akil, H., & Robinson, T. E. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2007.07.022 · Cited by 237
“Cues in the environment that are reliably associated with the presentation of rewards come to powerfully control behavior through the process of Pavlovian learning [11,22,39,52], in part because reward-associated cues acquire incentive value; i.”
A phosphatase cascade by which rewarding stimuli control nucleosomal response
Stipanovich, A., Valjent, E., Matamales, M., Nishi, A., Ahn, J.-H., Maroteaux, M., Bertran-Gonzalez, J., Brami-Cherrier, K., Enslen, H., Corbillé, A.-G., et al. (2008) · Nature · doi:10.1038/nature06994 · Cited by 240
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 237
“In contrast, ventromedial regions, including the nucleus accumbens, are more implicated in reinforcement-guided learning and addiction-related processes [28,52,93].”
BackgroundA theory of social media dependence: Evidence from microblog users
Wang, C., Lee, M. K. O., & Hua, Z. (2015) · Decision Support Systems · doi:10.1016/j.dss.2014.11.002 · Cited by 247
“Given the development of strengthening stimulus–response associations, the habitual usage pattern ultimately grows into addictive behavior [14].”
BackgroundCharacterizing the cognitive effects of cocaine: a comprehensive review.
Spronk, D. B., van Wel, J. H. P., Ramaekers, J. G., & Verkes, R. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.07.003 · Cited by 245
Reynolds, S. M., & Berridge, K. C. (2008) · Nature Neuroscience · doi:10.1038/nn2061 · Cited by 244
Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D., & Dolan, R. J. (2013) · Neuron · doi:10.1016/j.neuron.2013.08.009 · Cited by 244
“…most of us seamlessly switch between these modes of behavior, it has been suggested that a relative dominance of either habit-like or goal-directed modes of behavior underpin a range of disorders that span addictions (Everitt and Robbins, 2005) through to Parkinson’s disease (de Wit et al., 2011).”
BackgroundMcClernon, F. J., Kozink, R. V., Lutz, A. M., & Rose, J. E. (2009) · Psychopharmacology · doi:10.1007/s00213-008-1436-9 · Cited by 244
“The putamen connects motor and somatosenory areas with thalamus and is involved in sensorimotor integration, action selection, and movement (Everitt and Robbins 2005; Lawrence et al. 1998).”
Defining substance use disorders: do we really need more than heavy use?
Rehm, J., Marmet, S., Anderson, P., Gual, A., Kraus, L., Nutt, D. J., Room, R., Samokhvalov, A. V., Scafato, E., Trapencieris, M., et al. (2013) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt127 · Cited by 242
Strauss, G. P., Frank, M. J., Waltz, J. A., Kasanova, Z., Herbener, E. S., & Gold, J. M. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.10.015 · Cited by 233
Food addiction: a valid concept?
Fletcher, P. C., & Kenny, P. J. (2018) · Neuropsychopharmacology · doi:10.1038/s41386-018-0203-9 · Cited by 221
“Moreover, will amelioration of these adaptive responses in brain reward systems reduce the desire to use food and drugs in humans? Third, overconsumption of drugs of abuse can facilitate the emergence of habitual-like consummatory behaviors, characterized by their relative insensitivity to the current value of a reinf…”
BackgroundAlcaro, A., & Panksepp, J. (2011) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.03.002 · Cited by 240
Circuitry of self-control and its role in reducing addiction
Tang, Y.-Y., Posner, M. I., Rothbart, M. K., & Volkow, N. D. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.06.007 · Cited by 236
Krebs, R. M., Boehler, C. N., Roberts, K. C., Song, A. W., & Woldorff, M. G. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr134 · Cited by 212
Molecular psychiatry of zebrafish
Stewart, A. M., Ullmann, J. F. P., Norton, W. H. J., Parker, M. O., Brennan, C. H., Gerlai, R., & Kalueff, A. V. (2015) · Molecular Psychiatry · doi:10.1038/mp.2014.128 · Cited by 228
Unbalanced neuronal circuits in addiction
Volkow, N. D., Wang, G.-J., Tomasi, D., & Baler, R. D. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.002 · Cited by 218
“Compulsive behaviors, like addiction, can take hold when the neural circuitry that instantiates adaptive habits [9] is thrown off balance by exposure to drugs or other positive (food, sex, and gambling) or negative reinforcers (stress) in vulnerable individuals [10].”
Aragona, B. J., Cleaveland, N. A., Stuber, G. D., Day, J. J., Carelli, R. M., & Wightman, R. M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2225-08.2008 · Cited by 228
“The reinforcing properties of cocaine are significantly mediated by enhanced dopamine transmission (Kelley, 2004; Wise, 2004; Everitt and Robbins, 2005), and cocaine exerts its greatest increase in extracellular dopamine concentration ([DA]) within the shell subregion of the nucleus accumbens (NAc) (Di Chiara and Bass…”
BackgroundBehaviour Centred Design: towards an applied science of behaviour change
Aunger, R., & Curtis, V. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1219673 · Cited by 221
“However, if it is true that behaviour has been designed by evolution to maximise biological fitness, as we argue, why is it that some behaviours are apparently maladaptive – that is, they cause ill-health at a population level?”
BackgroundThe endocannabinoid system: emotion, learning and addiction
Moreira, F. A., & Lutz, B. (2008) · Addiction Biology · doi:10.1111/j.1369-1600.2008.00104.x · Cited by 222
“…consists of the mesolimbic dopaminergic neurons projecting from the ventral tegmental area to the ventral nucleus accumbens and to the dorsal striatum, and glutamatergic inputs from the medial prefrontal cortex to these areas (Everitt & Robbins 2005; Di Chiara & Bassareo 2007; LeMoal & Koob 2007).”
BackgroundInfluentialThe Neurobiology of Addiction: Implications for Voluntary Control of Behavior
Hyman, S. E. (2007) · The American Journal of Bioethics · doi:10.1080/15265160601063969 · Cited by 223
“There are mechanisms that permit an organism to learn and to make relatively efficient and automatic, sequences of actions to obtain specific rewards; these depend primarily on the dorsal striatum (Everitt and Robbins 2005).”
BackgroundA Liberal Account of Addiction
Foddy, B., & Savulescu, J. (2010) · Philosophy, Psychiatry, & Psychology · doi:10.1353/ppp.0.0282 · Cited by 222
“Everitt and Robbins (2005) highlight the development of dopamine activation in the striatum of long-term addicts, and take this change to represent a transition from voluntary drug use to compulsive drug use.”
BackgroundDifferential neural responses to food images in women with bulimia versus anorexia nervosa
Brooks, S. J., O′Daly, O. G., Uher, R., Friederich, H.-C., Giampietro, V., Brammer, M., Williams, S. C. R., Schiöth, H. B., Treasure, J., & Campbell, I. C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022259 · Cited by 231
“Furthermore, activation of the caudate and motor regions (precentral gyrus, SMA) are implicated in addictive behaviour [25,26] and thus might suggest that there are some similarities in neural systems between addiction and binge eating.”
BackgroundHaber, S. N., & Behrens, T. E. J. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.031 · Cited by 230
“Thus, through the striatonigro-striatal system, information can be linked and transferred to other functional regions, during learning and habit formation (Belin and Everitt, 2008; Everitt and Robbins, 2005; Porrino et al., 2007; Volkow et al., 2006).”
BackgroundDresp-Langley, B., & Hutt, A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19116910 · Cited by 177
“As in any addiction, the importance of behavioral impulsivity as a vulnerability trait predicting abuse and addiction [151,152] needs to be addressed.”
BackgroundA multistep general theory of transition to addiction
Piazza, P. V., & Deroche-Gamonet, V. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3224-4 · Cited by 227
“Importantly, the role of habit in addiction has been progressively revised (Everitt and Robbins 2005; Belin et al. 2009b, 2013).”
BackgroundWarm pleasant feelings in the brain
Rolls, E. T., Grabenhorst, F., & Parris, B. A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.005 · Cited by 227
“…by other reward representations in the orbitofrontal cortex (Grabenhorst et al., 2007a; O'Doherty et al., 2002; Rolls and McCabe, 2007; Rolls et al., 2008a), and may play a role in the incentive value of reward and punishment-related stimuli (Cardinal et al., 2002; Everitt and Robbins, 2005).”
Deep brain stimulation in addiction: a review of potential brain targets
Luigjes, J., van den Brink, W., Feenstra, M., van den Munckhof, P., Schuurman, P. R., Schippers, R., Mazaheri, A., De Vries, T. J., & Denys, D. (2012) · Molecular Psychiatry · doi:10.1038/mp.2011.114 · Cited by 223
Current interpretations of the I-PACE model of behavioral addictions
Brand, M., Müller, A., Wegmann, E., Antons, S., Brandtner, A., Müller, S. M., Stark, R., Steins-Loeber, S., & Potenza, M. N. (2025) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00020 · Cited by 190
“…are driven by the expectation that only speci fi c behaviors (e.g., using a game) can effectively help avoid or reduce negative mental conditions, which has been called “ must-do ” pathway of (online) addictive behaviors (Brand, 2022), based on earlier work (e.g., Everitt & Robbins, 2005, 2016).”
Separate circuitries encode the hedonic and nutritional values of sugar
Tellez, L. A., Han, W., Zhang, X., Ferreira, T. L., Perez, I. O., Shammah-Lagnado, S. J., van den Pol, A. N., & de Araujo, I. E. (2016) · Nature Neuroscience · doi:10.1038/nn.4224 · Cited by 222
“Within the striatum, the anatomical segregation between dorsal and ventral regions is an evolutionarily conserved trait 9 previously linked to dissociable behavioural functions 6,10 .”
Aberrant learning and memory in addiction
Torregrossa, M. M., Corlett, P. R., & Taylor, J. R. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.02.014 · Cited by 223
“Several investigators have hypothesized that addicts form habits related to drug use more rapidly and possibly to a greater degree than non-addicted individuals, and in comparison to habits formed for non-drug reinforcers (Everitt & Robbins, 2005).”
Milton, A. L., & Everitt, B. J. (2010) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2010.07249.x · Cited by 213
“…resumption of drug-seeking and drug-taking behaviour following a period of abstinence, can be unconscious, automatic and habitual (Tiffany, 1990; Everitt & Robbins, 2005) and is markedly influenced by the presence of environmental stimuli and contexts that have been paired previously with drug…”
BackgroundInfluentialSelf-citationAnimal Models of Neuropsychiatric Disorders
Fernando, A. B. P., & Robbins, T. W. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032210-104454 · Cited by 211
“…the behavioral processes underlying addiction suggest that they can be characterized in terms of underlying learning and memory processes, including both Pavlovian and instrumental elements (of which self-administration behavior is clearly an example) (Everitt et al. 2001, Everitt & Robbins 2005).”
BackgroundSelf-citationDrug-Induced Conditioned Place Preference and Its Practical Use in Substance Use Disorder Research
McKendrick, G., & Graziane, N. M. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.582147 · Cited by 205
“the discovery of more effective treatments is to accentuate the influence of environmental contexts and their influence on drug-seeking behaviors (Everitt and Robbins, 2005; Aguilar et al., 2009; LeCocq et al., 2020).”
Background
Metadata
- Authors
- Everitt, B. J., & Robbins, T. W.
- Affiliations
- University of Cambridge (GB)
- Venue
- Nature Neuroscience
- Published
- 2005-10-26
- Volume
- 8
- Issue
- 11
- Pages
- 1481-1489
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2054749214
- Cited by
- 3,785
- References
- 102
- Citations by year
- 2026: 111 · 2025: 114 · 2024: 119 · 2023: 134 · 2022: 161 · 2021: 188 · 2020: 214 · 2019: 189 · 2018: 206 · 2017: 211 · 2016: 244 · 2015: 225 · 2014: 262 · 2013: 276 · 2012: 220
- FWCI
- 8.86
- Type
- journal article
- Language
- en
- Update notices
- erratum (2006-07-01)
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Keywords
- drug addiction, reinforcement, classical conditioning, operant conditioning, habit formation, compulsive drug use, drug-seeking behavior, drug use, prefrontal cortex, striatum, dorsal striatum, ventral striatum, dopaminergic innervation, neuroplasticity
- MeSH terms
- Animals, Compulsive Behavior, Habits, Humans, Limbic System, Phenylacetates, Reinforcement, Psychology, Substance-Related Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.