Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Clinical and experimental observations show individual differences in the development of addiction. Increasing evidence supports the hypothesis that dopamine receptor availability in the nucleus accumbens (NAc) predisposes drug reinforcement. Here, modeling striatal-midbrain dopaminergic circuit, we propose a reinforcement learning model for addiction based on the actor-critic model of striatum. Modeling dopamine receptors in the NAc as modulators of learning rate for appetitive—but not aversive—stimuli in the critic—but not the actor—we define vulnerability to addiction as a relatively lower learning rate for the appetitive stimuli, compared to aversive stimuli, in the critic. We hypothesize that an imbalance in this learning parameter used by appetitive and aversive learning systems can result in addiction. We elucidate that the interaction between the degree of individual vulnerability and the duration of exposure to drug has two progressive consequences: deterioration of the imbalance and establishment of an abnormal habitual response in the actor. Using computational language, the proposed model describes how development of compulsive behavior can be a function of both degree of drug exposure and individual vulnerability. Moreover, the model describes how involvement of the dorsal striatum in addiction can be augmented progressively. The model also interprets other forms of addiction, such as obesity and pathological gambling, in a common mechanism with drug addiction. Finally, the model provides an answer for the question of why behavioral addictions are triggered in Parkinson's disease patients by D2 dopamine agonist treatments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory
Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Bayesian uncertainty of values estimated by these systems has been proposed as the computational key to switch behavior from goal-directed action to habitual response (Daw, Niv, & Dayan, 2005 ).”
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 1×
“Both tasks require the same learning process, but only the former requires action selection (O’Doherty et al., 2004).”
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 1×
“gif" alt-version="no" mimetype="image" xlink:type="simple"> where w V (a) and w P (a) are the weights for a linear estimation of the critic's values and actor's preferences, respectively (McClure, Daw, & Montague, 2003 ; Montague, Dayan, & Sejnowski, 1996 ).”
By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism
Frank, M. J., Seeberger, L. C., & O'Reilly, R. C. (2004) · Science · doi:10.1126/science.1102941 · Cited by 1,964
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“These dissociated roles of striatal subdivisions are consistent with a wealth of evidence showing that while the ventral striatum underlies reward processing and motivation (Cardinal, Parkinson, Hall, & Everitt, 2002), the dorsal striatum is involved in motor control (Packard & Knowlton, 2002).”
Haber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · cited 1×
“This network consists of a cascading serial connectivity that links the NAc shell to the more posterior VTA, which then projects to the NAc core and also to more dorsal regions of striatal organization, which in turn projects to SNc, and so on (Haber, Fudge, & McFarland, 2000 ; Ikemoto, 2007 ).”
Ikemoto, S. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.05.004 · Cited by 1,477
Synaptic plasticity and addiction
Kauer, J. A., & Malenka, R. C. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2234 · Cited by 1,397 · cited 2×
“Studies suggest a pivotal role for synaptic plasticity in the VTA that appears just 4 hours after a single exposure to cocaine and initiates plasticity in the NAc (Kauer & Malenka, 2007).”
The Role of the Dorsal Striatum in Reward and Decision-Making: Figure 1.
Balleine, B. W., Delgado, M. R., & Hikosaka, O. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1554-07.2007 · Cited by 1,390 · cited 1×
“This theory is inspired by studies in animal behavioral psychology showing that the dorsal striatum plays a critical role in habitual behavior (Balleine, Delgado, & Hikosaka, 2007 ).”
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378
The glutamate homeostasis hypothesis of addiction
Kalivas, P. W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2515 · Cited by 1,350 · cited 2×
“There is now wide agreement that the interaction of these two factors impairs the brain’s reward learning and memory systems (Everitt et al., 2008; Hyman, Malenka, & Nestler, 2006; Kalivas, 2009; Koob & Le Moal, 2005).”
Anthony, J. C., Warner, L. A., & Kessler, R. C. (1994) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.2.3.244 · Cited by 1,341
Midbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“…(Frank, Moustafa, Haughey, Curran, & Hutchison, 2007; Noble, 2003) or the involvement of SNc dopamine neurons in appetitive and aversive learning (Bayer & Glimcher, 2005; Matsumoto & Hikosaka, 2009), as well as for the dynamics of D1 receptors' changes by drug use (Edwards et al., 2007; Nader et…”
Nucleus accumbens D2/3 receptors predict trait impulsivity and cocaine reinforcement
Dalley, J. W., Fryer, T. D., Brichard, L., Robinson, E. S. J., Theobald, D. E. H., Lääne, K., Peña, Y., Murphy, E. R., Shah, Y., Probst, K., et al. (2007) · Science · doi:10.1126/science.1137073 · Cited by 1,188
Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction
Volkow, N. D., Wang, G.-J., Telang, F., Fowler, J. S., Logan, J., Childress, A.-R., Jayne, M., Ma, Y., & Wong, C. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1544-06.2006 · Cited by 1,164 · cited 2×
“Positron emission tomography (PET) studies in nonalcoholic human subjects with a dense family history for alcoholism have shown that they have higher D2 receptors in the striatum than individuals without such family histories (Volkow et al., 2006).”
Evidence for Addiction-like Behavior in the Rat
Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004) · Science · doi:10.1126/science.1099020 · Cited by 1,135 · cited 2×
“Experimental studies have shown that another major factor that contributes to the development of addiction is the degree of drug exposure (Deroche-Gamonet et al., 2004; Vanderschuren & Everitt, 2004).”
Dopamine in drug abuse and addiction: results from imaging studies and treatment implications
Volkow, N. D., Fowler, J. S., Wang, G.-J., & Swanson, J. M. (2004) · Molecular Psychiatry · doi:10.1038/sj.mp.4001507 · Cited by 1,101 · cited 1×
“Human subjects with a wide range of drug addictions have shown significant reductions in D2 receptor density within the striatum, including the NAc and the dorsal striatum (Volkow, Fowler, Wang, & Swanson, 2004 ).”
How can drug addiction help us understand obesity?
Volkow, N. D., & Wise, R. A. (2005) · Nature Neuroscience · doi:10.1038/nn1452 · Cited by 1,089 · cited 2×
“Some studies have demonstrated that there is a common mechanism at least partly underlying obesity and addiction (Volkow et al, 2008 ; Volkow & Wise, 2005 ) and also pathological gambling and addiction (Potenza, 2008 ).”
High Impulsivity Predicts the Switch to Compulsive Cocaine-Taking
Belin, D., Mar, A. C., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2008) · Science · doi:10.1126/science.1158136 · Cited by 989
Addiction: A Disease of Learning and Memory
Hyman, S. E. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1414 · Cited by 980
Computational roles for dopamine in behavioural control
Montague, P. R., Hyman, S. E., & Cohen, J. D. (2004) · Nature · doi:10.1038/nature03015 · Cited by 966
Plasticity of reward neurocircuitry and the ‘dark side’ of drug addiction
Koob, G. F., & Le Moal, M. (2005) · Nature Neuroscience · doi:10.1038/nn1105-1442 · Cited by 963 · cited 1×
“Also, impulsive behavior correlates with a tendency to addiction (Koob & Le Moal, 2005).”
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 3×
“For example, Samejima et al. (2005) have shown that dorsal striatum encodes action values while monkeys should choose between two different actions.”
Dopamine and drug addiction: the nucleus accumbens shell connection
Di Chiara, G., Bassareo, V., Fenu, S., De Luca, M. A., Spina, L., Cadoni, C., Acquas, E., Carboni, E., Valentini, V., & Lecca, D. (2004) · Neuropharmacology · doi:10.1016/j.neuropharm.2004.06.032 · Cited by 935
Cue-induced cocaine craving: neuroanatomical specificity for drug users and drug stimuli
Garavan, H., Pankiewicz, J., Bloom, A., Cho, J.-K., Sperry, L., Ross, T. J., Salmeron, B. J., Risinger, R., Kelley, D., & Stein, E. A. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.11.1789 · Cited by 931 · cited 1×
“This persistent dysregulation causes long-lasting changes in processing natural rewards such as sexually evocative visual stimuli (Garavan et al., 2000) and secondary rewards such as money (Goldstein et al.”
Opponent interactions between serotonin and dopamine
Daw, N. D., Kakade, S., & Dayan, P. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00052-7 · Cited by 844
Formation of accumbens GluR2-lacking AMPA receptors mediates incubation of cocaine craving
Conrad, K. L., Tseng, K. Y., Uejima, J. L., Reimers, J. M., Heng, L.-J., Shaham, Y., Marinelli, M., & Wolf, M. E. (2008) · Nature · doi:10.1038/nature06995 · Cited by 790 · cited 1×
“…modeling the neuroadaptations in the connections between PFC and NAc requires a computational key that normally mediates behavioral shift, which is important in particular for modeling relapse (Kalivas & O'Brien, 2008; Redish et al., 2007) and craving (Conrad et al., 2008; Redish & Johnson, 2007).”
Drug Seeking Becomes Compulsive After Prolonged Cocaine Self-Administration
Vanderschuren, L. J. M. J., & Everitt, B. J. (2004) · Science · doi:10.1126/science.1098975 · Cited by 733
Belin, D., & Everitt, B. J. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.019 · Cited by 697 · cited 2×
“Using an intrastriatal disconnection procedure, it has been shown that the striato-midbrain-striatal serial dopaminergic connectivity is essential for enhancing drug-seeking habits (Belin & Everitt, 2008 ).”
Social dominance in monkeys: dopamine D2 receptors and cocaine self-administration
Morgan, D., Grant, K. A., Gage, H. D., Mach, R. H., Kaplan, J. R., Prioleau, O., Nader, S. H., Buchheimer, N., Ehrenkaufer, R. L., & Nader, M. A. (2002) · Nature Neuroscience · doi:10.1038/nn798 · Cited by 674 · cited 1×
“In nonhuman primates, cocaine self-administration propensity is negatively correlated with the availability of D2 receptors and also social dominance (Morgan et al., 2002; Nader et al., 2006).”
Roesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., & Takahashi, Y. K. (2009) · Nature reviews. Neuroscience · doi:10.1038/nrn2753 · Cited by 585
Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior
Goto, Y., & Grace, A. A. (2005) · Nature Neuroscience · doi:10.1038/nn1471 · Cited by 576 · cited 6×
“Consistently, it has been shown that a gene in the PFC controlling prefrontal dopamine function is associated with uncertaintybased exploration (Frank et al., 2009).”
InfluentialThe neurobiology of pathological gambling and drug addiction: an overview and new findings
Potenza, M. N. (2008) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0100 · Cited by 508 · cited 2×
“Some studies have demonstrated that there is a common mechanism at least partly underlying obesity and addiction (Volkow et al., 2008; Volkow & Wise, 2005) and also pathological gambling and addiction (Potenza, 2008).”
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · cited 1×
“In an elegant study, Morris, Nevet, Arkadir, Vaadia, and Bergman ( 2006 ) showed that the activity of SNc dopamine neurons in nonhuman primates performing an instrumental conditioning task needed to choose between two competing choices is modulated by the value of upcoming action.”
Steeves, T. D. L., Miyasaki, J., Zurowski, M., Lang, A. E., Pellecchia, G., Van Eimeren, T., Rusjan, P., Houle, S., & Strafella, A. P. (2009) · Brain · doi:10.1093/brain/awp054 · Cited by 502 · cited 1×
“For example, the role of the dopaminergic reward circuit in these diseases is prominent, and all of them occur in individuals with similar vulnerabilities in dopamine receptors (Steeves et al., 2009; Volkow et al., 2008).”
A unified framework for addiction: Vulnerabilities in the decision process
Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501 · cited 2×
“, 2006); however, the ventral- to dorsal-striatum pathway is probably not the sole vulnerable pathway that causes the emergence of addiction (Redish et al., 2008), importantly in humans (Ahmed, 2008).”
D2 dopamine receptor gene in psychiatric and neurologic disorders and its phenotypes
Noble, E. P. (2003) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.10005 · Cited by 501 · cited 2×
“Nevertheless, there is no agreement for the role of D1 and D2 receptors (Frank, Moustafa, Haughey, Curran, & Hutchison, 2007; Noble, 2003) or the involvement of SNc dopamine neurons in appetitive and aversive learning (Bayer & Glimcher, 2005; Matsumoto & Hikosaka, 2009), as well as for the dynamics of D1 receptors’ ch…”
PET imaging of dopamine D2 receptors during chronic cocaine self-administration in monkeys
Nader, M. A., Morgan, D., Gage, H. D., Nader, S. H., Calhoun, T. L., Buchheimer, N., Ehrenkaufer, R., & Mach, R. H. (2006) · Nature Neuroscience · doi:10.1038/nn1737 · Cited by 481 · cited 1×
“In nonhuman primates, cocaine self-administration propensity is negatively correlated with the availability of D2 receptors and also social dominance (Morgan et al., 2002; Nader et al., 2006).”
Ito, R., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-14-06247.2002 · Cited by 463
Amphetamine Exposure Enhances Habit Formation
Nelson, A., & Killcross, S. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4305-05.2006 · Cited by 445
Volkow, N. D., Wang, G.-J., Fowler, J. S., Logan, J., Gatley, S. J., Gifford, A., Hitzemann, R., Ding, Y.-S., & Pappas, N. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.9.1440 · Cited by 406 · cited 1×
“In human subjects, individuals with lower D2 receptor availability report psychostimulants to be pleasant, while individuals with higher D2 receptors find the same psychostimulants aversive (Volkow et al., 1999).”
Involvement of the dorsal striatum in cue-controlled cocaine seeking
Vanderschuren, L. J. M. J., Di Ciano, P., & Everitt, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0925-05.2005 · Cited by 393 · cited 1×
“Furthermore, blockade of dopamine in the rat dorsal striatum inhibits cocaine seeking in a second-order schedule of reinforcement (Vanderschuren, Di Ciano, & Everitt, 2005 ).”
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · cited 4×
“Nevertheless, modeling the neuroadaptations in the connections between PFC and NAc requires a computational key that normally mediates behavioral shift, which is important in particular for modeling relapse (Kalivas & O’Brien, 2008; Redish et al., 2007) and craving (Conrad et al.”
InfluentialProperties and opioid inhibition of mesolimbic dopamine neurons vary according to target location
Ford, C. P., Mark, G. P., & Williams, J. T. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4331-05.2006 · Cited by 339 · cited 2×
“…mediating the rewarding effects of many drugs such as cocaine, nicotine, carbachol, cannabinoids, ethanol, and opiates (Carlezon et al., 1997, 2000; Ford et al., 2006; Ikemoto, Murphy, & McBride, 1998; Ikemoto et al., 1997; Ikemoto & Wise, 2002; Rodd et al., 2004, 2005; Zangen, Ikemoto, Zadina, &…”
Overexpression of dopamine D2 receptors reduces alcohol self‐administration
Thanos, P. K., Volkow, N. D., Freimuth, P., Umegaki, H., Ikari, H., Roth, G., Ingram, D. K., & Hitzemann, R. (2001) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2001.00492.x · Cited by 324
Increased Occupancy of Dopamine Receptors in Human Striatum during Cue-Elicited Cocaine Craving
Wong, D. F., Kuwabara, H., Schretlen, D. J., Bonson, K. R., Zhou, Y., Nandi, A., Brašić, J. R., Kimes, A. S., Maris, M. A., Kumar, A., et al. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301194 · Cited by 311 · cited 1×
“An important role for the dorsal striatum in human addicts is also reported (Volkow et al., 2006; Wong et al., 2006); however, the ventral- to dorsal-striatum pathway is probably not the sole vulnerable pathway that causes the emergence of addiction (Redish et al.”
A Neural Computational Model of Incentive Salience
Zhang, J., Berridge, K. C., Tindell, A. J., Smith, K. S., & Aldridge, J. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000437 · Cited by 299 · cited 2×
“Previously, individual susceptibility to drug addiction was not addressed explicitly by abstract computational (Dayan, 2009; Dezfouli et al., 2009; Redish, 2004; Redish et al., 2007; Redish & Johnson, 2007; Zhang et al., 2009) or multilevel circuit models of addiction (Gutkin et al.”
Serotonin, inhibition, and negative mood
Dayan, P., & Huys, Q. J. M. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040004 · Cited by 263 · cited 2×
“Though serotonergic system has been proposed as a candidate for handling aversive outcomes of decisions (Daw, Kakade, & Dayan, 2002 ; Dayan & Huys, 2008 ), regardless of what neuronal circuit is responsible for handling it, we use equation 2.”
InfluentialGoldstein, R. Z., Alia-Klein, N., Tomasi, D., Zhang, L., Cottone, L. A., Maloney, T., Telang, F., Caparelli, E. C., Chang, L., Ernst, T., et al. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.1.43 · Cited by 258 · cited 1×
“, 2000) and secondary rewards such as money (Goldstein et al., 2007).”
Ahmed, S. H., & Koob, G. F. (2005) · Psychopharmacology · doi:10.1007/s00213-005-2180-z · Cited by 254
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum
Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241 · cited 1×
“Atallah, Lopez-Paniagua, Rudy, & O'Reilly ( 2007 ) have shown that while NAc is critical for learning, the dorsal striatum is involved in performance but not learning.”
Self, D. W. (2004) · Neuropharmacology · doi:10.1016/j.neuropharm.2004.07.005 · Cited by 189 · cited 3×
“This assumption is consistent with evidence for D2 receptor changes by drug use and also with the critical role of coactivation of D1 and D2 receptors within the NAc shell for mediating the rewarding effects of drug and natural rewards (Hopf et al., 2003; Ikemoto et al., 1997; Self, 2004).”
Olson, V. G. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.0345-05.2005 · Cited by 186 · cited 1×
“This part of the VTA is mostly affected by appetitive, but not aversive, stimuli (Bolanos et al., 2003; Carlezon et al., 2000; Ikemoto, 2007; Olson et al., 2005).”
Two brain sites for cannabinoid reward
Zangen, A., Solinas, M., Ikemoto, S., Goldberg, S. R., & Wise, R. A. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.3554-05.2006 · Cited by 174
Habit-forming actions of nomifensine in nucleus accumbens
Carlezon, W. A., Devine, D. P., & Wise, R. A. (1995) · Psychopharmacology · doi:10.1007/bf02246095 · Cited by 170
Bachtell, R. K., Whisler, K., Karanian, D., & Self, D. W. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0133-1 · Cited by 154
Cocaine is self-administered into the shell but not the core of the nucleus accumbens of Wistar rats
Rodd-Henricks, Z. A., McKinzie, D. L., Li, T.-K., Murphy, J. M., & McBride, W. J. (2002) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.102.038950 · Cited by 150 · cited 1×
“For example, rats easily learn to self-administer cocaine and amphetamine into the shell, but not the core (Ikemoto, 2003 ; Ikemoto, Qin, & Liu, 2005 ; Rodd-Henricks, McKinzie, Li, Murphy, & McBride, 2002 ).”
Zangen, A., Ikemoto, S., Zadina, J. E., & Wise, R. A. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-16-07225.2002 · Cited by 138
Fenu, S., Spina, L., Rivas, E., Longoni, R., & Di Chiara, G. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0415-2 · Cited by 103
Spina, L., Fenu, S., Longoni, R., Rivas, E., & Di Chiara, G. (2006) · Psychopharmacology · doi:10.1007/s00213-005-0211-4 · Cited by 102
Carlezon, W. A., Haile, C. N., Coppersmith, R., Hayashi, Y., Malinow, R., Neve, R. L., & Nestler, E. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-05-j0002.2000 · Cited by 98 · cited 2×
“…the VTA is important for mediating the rewarding effects of many drugs such as cocaine, nicotine, carbachol, cannabinoids, ethanol, and opiates (Carlezon et al., 1997, 2000; Ford et al., 2006; Ikemoto, Murphy, & McBride, 1998; Ikemoto et al., 1997; Ikemoto & Wise, 2002; Rodd et al., 2004,…”
Bolaños, C. A., Perrotti, L. I., Edwards, S., Eisch, A. J., Barrot, M., Olson, V. G., Russell, D. S., Neve, R. L., & Nestler, E. J. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-20-07569.2003 · Cited by 62 · cited 3×
“, 2004, 2005; Zangen, Ikemoto, Zadina, & Wise, 2002; Zangen, Solinas, Ikemoto, Goldberg, & Wise, 2006) and also for natural rewards such as sucrose (Bolanos et al., 2003).”
Cited by
Drug addiction: updating actions to habits to compulsions ten years on
Everitt, B. J., & Robbins, T. W. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033457 · Cited by 1,225
Brain circuitry of compulsivity
van den Heuvel, O. A., van Wingen, G., Soriano-Mas, C., Alonso, P., Chamberlain, S. R., Nakamae, T., Denys, D., Goudriaan, A. E., & Veltman, D. J. (2016) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.12.005 · Cited by 374
“Computational models supported this idea (Piray et al., 2010; Egbert and Barandiaran, 2014).”
Everitt, B. J. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12644 · Cited by 318
“…we have suggested may occur as the result of repeated drug taking, may reflect a failure in the critic properly to direct action selection in the actor, so rendering choices and actions rigid and independent of the value of outcomes (Dezfouli et al., 2009; Piray et al., 2010; Belin et al., 2013).”
BackgroundAddiction: failure of control over maladaptive incentive habits
Belin, D., Belin-Rauscent, A., Murray, J. E., & Everitt, B. J. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.025 · Cited by 300
Dopamine Circuit Mechanisms of Addiction-Like Behaviors
Poisson, C. L., Engel, L., & Saunders, B. T. (2021) · Frontiers in Neural Circuits · doi:10.3389/fncir.2021.752420 · Cited by 75
Metadata
- Authors
- Piray, P., Keramati, M. M., Dezfouli, A., Lucas, C., & Mokri, A.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2010-09
- Volume
- 22
- Issue
- 9
- Pages
- 2334-2368
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2158895174
- Cited by
- 40
- References
- 64
- FWCI
- 1.05
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.