Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine
Open accessAbstract
Instrumental actions are a vital cognitive asset that endows an organism with sensitivity to the consequences of its behavior. Response-outcome feedback allows responding to be shaped in order to maximize beneficial, and minimize detrimental, outcomes. Lesions of the medial prefrontal cortex (mPFC) result in behavior that is insensitive to changes in outcome value in animals and compulsive behavior in several human psychopathologies. Such insensitivity to changes in outcome value is a defining characteristic of instrumental habits: responses that are controlled by antecedent stimuli rather than goal expectancy. Little is known regarding the neurochemical substrates mediating this sensitivity. The present experiments used sensitivity to posttraining outcome devaluation to index the action-habit status of instrumental responding. Infusions of dopamine into the ventral mPFC (vmPFC), but not dorsal mPFC, restored outcome sensitivity bidirectionally-decreasing responding following outcome devaluation and increasing responding when the outcome was not devalued. This bidirectionality makes the possibility that these infusions nonspecifically dysregulated vmPFC dopamine transmission unlikely. VmPFC dopamine promoted instrumental responding appropriate to outcome value. Reinforcer consumption data indicated that this was not a consequence of altered sensitivity to the reinforcer itself. We suggest that vmPFC dopamine reengages attentional processes underlying goal-directed behavior.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Increasing DA signaling in the PFC enhances goal-directed behavior.
“Increasing DA signaling in the PFC enhances goal-directed behavior (Hitchcott et al., 2007).”
From The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD (2015) · cites this paper as Hitchcott et al., 2007
The Discussion says increased dopamine transmission in the ventral PFC promotes goal-directed behavior, and reports that dopamine infusions there restored sensitivity to outcome value in rats. The claim broadens this finding to the PFC generally; the paper does not report the same effect for dorsal PFC dopamine. (LLM, conf=0.87)
Experimental — accuracy not yet measuredLesions of the medial prefrontal cortex result in behavior that is insensitive to changes in outcome value with stimulus-elicited, rather than goal-anticipated, instrumental responding.
“Likewise, lesions of the medial prefrontal cortex result in behavior that is insensitive to changes in outcome value with a stimulus-elicited, rather than goal-anticipated, instrumental responding (Hitchcott et al., 2007).”
From The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD (2015) · cites this paper as Hitchcott et al., 2007
In a rat experiment, a posttraining manipulation of value coupled to a dopamine infusion into ventromedial PFC produced a bidirectional effect whereby the dopamine infusion decreased responding to a devalued outcome and enhanced responding to nondevalued outcomes, suggesting an influence on model-based valuation.
“For instance, in a rat experiment in which a posttraining manipulation of value was coupled to a dopamine infusion into ventromedial PFC (vmPFC) (Hitchcott et al., 2007), a bidirectional effect was evident whereby the dopamine infusion decreased responding to a devalued outcome and enhanced responding to nondevalued outcomes, suggesting an influence on model-based valuation.”
From Goals and Habits in the Brain (2013) · cites this paper as Hitchcott et al., 2007
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Rat Brain in Stereotaxic Coordinates
Paxinos, G., & Watson, C. (1983) · Elsevier eBooks · doi:10.1016/c2009-0-63235-9 · Cited by 28,585 · see citing works
Control of goal-directed and stimulus-driven attention in the brain
Corbetta, M., & Shulman, G. L. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn755 · Cited by 12,881 · see citing works
An Integrative Theory of Prefrontal Cortex Function
Miller, E. K., & Cohen, J. D. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.167 · Cited by 12,803 · see citing works
Conflict monitoring and cognitive control
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.624 · Cited by 7,351 · see citing works
Insensitivity to future consequences following damage to human prefrontal cortex
Bechara, A., Damasio, A. R., Damasio, H., & Anderson, S. W. (1994) · Cognition · doi:10.1016/0010-0277(94)90018-3 · Cited by 6,128 · see citing works
The Psychology of Learning and Motivation: Advances in Research and Theory
(2010) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/c2009-0-62209-1 · Cited by 6,035 · see citing works
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · see citing works
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402 · see citing works
Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective
Bechara, A. (2005) · Nature Neuroscience · doi:10.1038/nn1584 · Cited by 2,149 · cited 4× · see citing works
“This view is consistent with the effects in humans of vmPFC lesions, and in certain clinical populations such as drug addicts, who repeatedly experience the detrimental consequences of their behavior yet are unable to modify it ( Bechara 2005; Ersche et al. 2005).”
BackgroundResultInfluentialJentsch, J. D., & Taylor, J. R. (1999) · Psychopharmacology · doi:10.1007/pl00005483 · Cited by 1,545 · see citing works
Self-citationGoal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works
Medial Frontal Cortex Mediates Perceptual Attentional Set Shifting in the Rat
Birrell, J. M., & Brown, V. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04320.2000 · Cited by 1,421 · see citing works
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates
Dalley, J. W., Cardinal, R. N., & Robbins, T. W. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2004.09.006 · Cited by 1,329 · see citing works
Actions and habits: The development of behavioural autonomy
Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works
Neural mechanisms of autonomic, affective, and cognitive integration
Critchley, H. D. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20749 · Cited by 1,214 · see citing works
Bechara, A., Tranel, D., Damasio, H., & Damasio, A. R. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.2.215 · Cited by 1,179 · see citing works
Neural Economics and the Biological Substrates of Valuation
Montague, P. R., & Berns, G. S. (2002) · Neuron · doi:10.1016/s0896-6273(02)00974-1 · Cited by 994 · see citing works
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987 · see citing works
Neurobiology of Executive Functions: Catecholamine Influences on Prefrontal Cortical Functions
Arnsten, A. F. T., & Li, B.-M. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.08.019 · Cited by 948 · see citing works
Prefrontal–cingulate interactions in action monitoring
Gehring, W. J., & Knight, R. T. (2000) · Nature Neuroscience · doi:10.1038/74899 · Cited by 912 · see citing works
Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning
Schoenbaum, G. M., Chiba, A. A., & Gallagher, M. (1998) · Nature Neuroscience · doi:10.1038/407 · Cited by 849 · see citing works
Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats
Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748 · see citing works
Barbas, H. (2000) · Brain Research Bulletin · doi:10.1016/s0361-9230(99)00245-2 · Cited by 664 · see citing works
Volkow, N. D., Fowler, J. S., & Wang, G.-J. (2004) · Neuropharmacology · doi:10.1016/j.neuropharm.2004.07.019 · Cited by 616 · see citing works
Fuster, J. M. (1997) · Trends in Neurosciences · doi:10.1016/s0166-2236(97)01128-4 · Cited by 516 · see citing works
Lhermitte, F. (1986) · Annals of Neurology · doi:10.1002/ana.410190405 · Cited by 487 · see citing works
The neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Clark, L., Cools, R., & Robbins, T. W. (2004) · Brain and Cognition · doi:10.1016/s0278-2626(03)00284-7 · Cited by 439 · see citing works
Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation
Faure, A., Haberland, U., Condé, F., & Massioui, N. E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.3894-04.2005 · Cited by 402 · see citing works
Prefrontal Cortical Networks Related to Visceral Function and Mood
Price, J. L. (1999) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1999.tb09278.x · Cited by 397 · see citing works
Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting
Floresco, S. B., Magyar, O., Ghods-Sharifi, S., Vexelman, C., & Tse, M. T. L. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300825 · Cited by 395 · see citing works
Coutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342 · see citing works
Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits
BALLEINE, B. (2005) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.08.061 · Cited by 326 · see citing works
Chemistry of the mind: Neurochemical modulation of prefrontal cortical function
Robbins, T. W. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20717 · Cited by 292 · see citing works
Ostlund, S. B., & Balleine, B. W. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1921-05.2005 · Cited by 291 · see citing works
van Eden, C. G., Hoorneman, E. M. D., Buijs, R. M., Matthijssen, M. A. H., Geffard, M., & Uylings, H. B. M. (1987) · Neuroscience · doi:10.1016/0306-4522(87)92964-2 · Cited by 272 · see citing works
Alcohol seeking by rats: action or habit?
Dickinson, A., Wood, N., & Smith, J. W. (2002) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/0272499024400016 · Cited by 268 · see citing works
Neuroimaging of Performance Monitoring: Error Detection and Beyond
Ullsperger, M., & von Cramon, D. Y. (2004) · Cortex · doi:10.1016/s0010-9452(08)70155-2 · Cited by 220 · see citing works
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior
Hollerman, J. R., Tremblay, L., & Schultz, W. (2000) · Progress in brain research · doi:10.1016/s0079-6123(00)26015-9 · Cited by 219 · see citing works
Ersche, K. D., Fletcher, P. C., Lewis, S. J. G., Clark, L., Stocks-Gee, G., London, M., Deakin, J. B., Robbins, T. W., & Sahakian, B. J. (2005) · Psychopharmacology · doi:10.1007/s00213-005-2205-7 · Cited by 199 · see citing works
Sullivan, R. M. (2004) · Stress · doi:10.1080/102538900410001679310 · Cited by 188 · see citing works
Oral cocaine seeking by rats: Action or habit?
Miles, F. J., Everitt, B. J., & Dickinson, A. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.5.927 · Cited by 175 · see citing works
Smiley, J. F., Williams, S. M., Szigeti‐Buck, K., & Goldman‐Rakic, P. S. (1992) · The Journal of Comparative Neurology · doi:10.1002/cne.903210302 · Cited by 154 · see citing works
Free will versus survival: Brain systems that underlie intrinsic constraints on behavior
Price, J. L. (2005) · The Journal of Comparative Neurology · doi:10.1002/cne.20750 · Cited by 140 · see citing works
Fletcher, P. J., Tenn, C. C., Rizos, Z., Lovic, V., & Kapur, S. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0157-6 · Cited by 129 · see citing works
The interaction of cognitive and stimulus–response processes in the control of behaviour
Toates, F. M. (1997) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(97)00022-5 · Cited by 127 · see citing works
Wall, P. M., & Messier, C. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00355-2 · Cited by 125 · see citing works
Jentsch, J. D., Roth, R. H., & Taylor, J. R. (2000) · Progress in Brain Research · doi:10.1016/s0079-6123(00)26028-7 · Cited by 99 · see citing works
Self-citationAssociative Representations of Instrumental Contingencies
Colwill, R. (1994) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/s0079-7421(08)60408-9 · Cited by 67 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977 · see citing works
The Neuropsychopharmacology of Fronto-Executive Function: Monoaminergic Modulation
Robbins, T. W., & Arnsten, A. F. T. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135535 · Cited by 957 · see citing works
McKay, R. T., & Dennett, D. C. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990975 · Cited by 474 · see citing works
Toward a neurobiology of delusions
Corlett, P. R., Taylor, J. R., Wang, X.-J., Fletcher, P. C., & Krystal, J. H. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2010.06.007 · Cited by 394 · see citing works
Self-citationStudent interest generated during an inquiry skills lesson
Palmer, D. A. (2008) · Journal of Research in Science Teaching · doi:10.1002/tea.20263 · Cited by 376 · see citing works
A dual operator view of habitual behavior reflecting cortical and striatal dynamics
Smith, K. S., & Graybiel, A. M. (2013) · Neuron · doi:10.1016/j.neuron.2013.05.038 · Cited by 324 · see citing works
Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats
Zapata, A., Minney, V. L., & Shippenberg, T. S. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4072-10.2010 · Cited by 296 · see citing works
Action versus valence in decision making
Guitart-Masip, M., Duzel, E., Dolan, R., & Dayan, P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.003 · Cited by 270 · see citing works
Dopaminergic Mechanisms in Actions and Habits: Figure 1.
Wickens, J. R., Horvitz, J. C., Costa, R. M., & Killcross, S. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1671-07.2007 · Cited by 271 · see citing works
Aberrant learning and memory in addiction
Torregrossa, M. M., Corlett, P. R., & Taylor, J. R. (2011) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2011.02.014 · Cited by 223 · see citing works
Self-citationWireless multilateral devices for optogenetic studies of individual and social behaviors
Yang, Y., Wu, M., Vázquez‐Guardado, A., Wegener, A. J., Grajales‐Reyes, J. G., Deng, Y., Wang, T., Avila, R. O., Moreno, J. A., Minkowicz, S., et al. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00849-x · Cited by 214 · see citing works
Corticostriatal Interactions during Learning, Memory Processing, and Decision Making
Pennartz, C. M. A., Berke, J. D., Graybiel, A. M., Ito, R., Lansink, C. S., van der Meer, M., Redish, A. D., Smith, K. S., & Voorn, P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3177-09.2009 · Cited by 213 · see citing works
Parallel maturation of goal-directed behavior and dopaminergic systems during adolescence
Naneix, F., Marchand, A. R., Di Scala, G., Pape, J.-R., & Coutureau, E. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3080-12.2012 · Cited by 209 · see citing works
Targeting extinction and reconsolidation mechanisms to combat the impact of drug cues on addiction
Taylor, J., Olausson, P., Quinn, J., & Torregrossa, M. (2008) · Neuropharmacology · doi:10.1016/j.neuropharm.2008.07.027 · Cited by 211 · see citing works
Self-citationGoing and stopping: dichotomies in behavioral control by the prefrontal cortex
Gourley, S. L., & Taylor, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4275 · Cited by 195 · see citing works
Self-citationTwenty-Five Lessons from Computational Neuromodulation
Dayan, P. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.027 · Cited by 190 · see citing works
Medial prefrontal D1 dopamine neurons control food intake
Land, B. B., Narayanan, N. S., Liu, R.-J., Gianessi, C. A., Brayton, C. E., Grimaldi, D. M., Sarhan, M., Guarnieri, D. J., Deisseroth, K. A., Aghajanian, G. K., et al. (2014) · Nature Neuroscience · doi:10.1038/nn.3625 · Cited by 180 · see citing works
Smith, K. S., Virkud, A., Deisseroth, K., & Graybiel, A. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1216264109 · Cited by 173 · see citing works
Endocannabinoid signaling is critical for habit formation
Hilário, M. R. F. (2007) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.006.2007 · Cited by 164 · see citing works
Smith, K. S., & Graybiel, A. M. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/ksmith · Cited by 156 · see citing works
Sex chromosome complement regulates habit formation
Quinn, J. J., Hitchcott, P. K., Umeda, E. A., Arnold, A. P., & Taylor, J. R. (2007) · Nature Neuroscience · doi:10.1038/nn1994 · Cited by 148 · see citing works
Self-citationVentral Tegmental Dopamine Neurons Participate in Reward Identity Predictions
Keiflin, R., Pribut, H. J., Shah, N. B., & Janak, P. H. (2018) · Current Biology · doi:10.1016/j.cub.2018.11.050 · Cited by 142 · see citing works
Lee, A. S., Duman, R. S., & Pittenger, C. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0807749105 · Cited by 138 · see citing works
The costs and benefits of brain dopamine for cognitive control
Cools, R. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1401 · Cited by 152 · see citing works
Domingo-Rodriguez, L., Ruiz de Azua, I., Dominguez, E., Senabre, E., Serra, I., Kummer, S., Navandar, M., Baddenhausen, S., Hofmann, C., Andero, R., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-14458-y · Cited by 109 · see citing works
Dopamine receptors in the learning, memory and drug reward circuitry
Dalley, J. W., & Everitt, B. J. (2009) · Seminars in Cell and Developmental Biology · doi:10.1016/j.semcdb.2009.01.002 · Cited by 108 · see citing works
Guitart‐Masip, M., Economides, M., Huys, Q. J. M., Frank, M. J., Chowdhury, R., Düzel, E., Dayan, P., & Dolan, R. J. (2013) · Psychopharmacology · doi:10.1007/s00213-013-3313-4 · Cited by 107 · see citing works
Reliance on habits at the expense of goal-directed control following dopamine precursor depletion
de Wit, S., Standing, H. R., DeVito, E. E., Robinson, O. J., Ridderinkhof, K. R., Robbins, T. W., & Sahakian, B. J. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2563-2 · Cited by 105 · see citing works
Choice and contingency in the development of behavioral autonomy during instrumental conditioning.
Kosaki, Y., & Dickinson, A. (2010) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/a0016887 · Cited by 101 · see citing works
A Role for Medial Prefrontal Dopaminergic Innervation in Instrumental Conditioning
Naneix, F., Marchand, A. R., Scala, G. D., Pape, J., & Coutureau, É. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1234-09.2009 · Cited by 96 · see citing works
Li, C.-S. R., MORGAN, P. T., Matuskey, D., Abdelghany, O., Luo, X., Chang, J. L. K., Rounsaville, B. J., Ding, Y., & Malison, R. T. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1002467107 · Cited by 97 · see citing works
Disorders of memory and plasticity in psychiatric disease
Pittenger, C. (2013) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2013.15.4/cpittenger · Cited by 92 · see citing works
Investigating habits: strategies, technologies and models
Smith, K. S., & Graybiel, A. M. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00039 · Cited by 92 · see citing works
Habitual alcohol seeking: Modeling the transition from casual drinking to addiction
Barker, J. M., & Taylor, J. R. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.08.012 · Cited by 88 · see citing works
Self-citationCocaine exposure shifts the balance of associative encoding from ventral to dorsolateral striatum
Takahashi, Y. K. (2007) · Frontiers in Integrative Neuroscience · doi:10.3389/neuro.07.011.2007 · Cited by 82 · see citing works
A unifying model of the role of the infralimbic cortex in extinction and habitsPreprint
Barker, J. M., Taylor, J. R., & Chandler, L. J. (2014) · Learning & Memory · doi:10.1101/lm.035501.114 · Cited by 79 · see citing works
Self-citationAlcohol-induced alterations in dopamine modulation of prefrontal activity
Trantham‐Davidson, H., & Chandler, L. J. (2015) · Alcohol · doi:10.1016/j.alcohol.2015.09.001 · Cited by 79 · see citing works
Corticostriatal circuitry and habitual ethanol seeking
Barker, J. M., Corbit, L. H., Robinson, D. L., Gremel, C. M., Gonzales, R. A., & Chandler, L. J. (2015) · Alcohol · doi:10.1016/j.alcohol.2015.03.003 · Cited by 75 · see citing works
Brain responses to drug cues predict craving changes in abstinent heroin users: A preliminary study
Liu, S., Wang, S., Zhang, M., Xu, Y., Shao, Z., Chen, L., Yang, W., Liu, J., & Yuan, K. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118169 · Cited by 71 · see citing works
Habit learning and memory in mammals: Behavioral and neural characteristics
Gasbarri, A., Pompili, A., Packard, M. G., & Tomaz, C. A. B. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.06.010 · Cited by 72 · see citing works
Targeting cocaine versus heroin memories: divergent roles within ventromedial prefrontal cortex
Peters, J., Pattij, T., & Vries, T. J. D. (2013) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2013.10.004 · Cited by 68 · see citing works
Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum
Smith, K. S., & Graybiel, A. M. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00925.2015 · Cited by 64 · see citing works
Neurobiology of habit formation
Amaya, K. A., & Smith, K. S. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.003 · Cited by 67 · see citing works
Rusu, S. I., & Pennartz, C. M. A. (2019) · Hippocampus · doi:10.1002/hipo.23167 · Cited by 63 · see citing works
Brovelli, A., Chicharro, D., Badier, J., Wang, H., & Jirsa, V. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4892-14.2015 · Cited by 61 · see citing works
Seip, K. M., & Morrell, J. I. (2009) · Behavioral Neuroscience · doi:10.1037/a0017666 · Cited by 63 · see citing works
Arbitration between action strategies in obsessive-compulsive disorder
Gruner, P., Anticevic, A., Lee, D., & Pittenger, C. (2016) · The Neuroscientist · doi:10.1177/1073858414568317 · Cited by 62 · see citing works
Are delusions biologically adaptive? Salvaging the doxastic shear pin
Mishara, A. L., & Corlett, P. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991464 · Cited by 62 · see citing works
Cognition-Emotion Dysinteraction in Schizophrenia
Anticevic, A., & Corlett, P. R. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00392 · Cited by 62 · see citing works
Neurobiology of apathy in Alzheimer's disease
Guimarães, H. C., Lévy, R., Teixeira, A. L., Beato, R., & Caramelli, P. (2008) · Arquivos de Neuro-Psiquiatria · doi:10.1590/s0004-282x2008000300035 · Cited by 59 · see citing works
Barker, J. M., Torregrossa, M. M., & Taylor, J. R. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00126 · Cited by 58 · see citing works
Self-citationHilário, M. R. F. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.030.2008 · Cited by 59 · see citing works
Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?
Nett, K. E., & LaLumiere, R. T. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.10.002 · Cited by 58 · see citing works
Cocaine cue-induced dopamine release in the human prefrontal cortex
Milella, M. S., Fotros, A., Gravel, P., Casey, K. F., Larcher, K., Verhaeghe, J. A. J., Cox, S. M. L., Reader, A. J., Dagher, A., Benkelfat, C., et al. (2016) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.150207 · Cited by 56 · see citing works
The cost of dopamine for dynamic cognitive control
Cools, R. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.05.007 · Cited by 79 · see citing works
Smith, K. S., & Graybiel, A. M. (2016) · PubMed Central · Cited by 55 · see citing works
Orbitofrontal Cortex and Cognitive‐Motivational Impairments in Psychostimulant Addiction
Olausson, P., Jentsch, J. D., Krueger‐Burg, D., Tronson, N. C., Nairn, A. C., & Taylor, J. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1401.016 · Cited by 54 · see citing works
Self-citationGene expression changes following extinction testing in a heroin behavioral incubation model
Kuntz-Melcavage, K. L., Brucklacher, R. M., Grigson, P. S., Freeman, W. M., & Vrana, K. E. (2009) · BMC Neuroscience · doi:10.1186/1471-2202-10-95 · Cited by 53 · see citing works
Naneix, F., Marchand, A. R., Pichon, A., Pape, J., & Coutureau, É. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.55 · Cited by 47 · see citing works
The doxastic shear pin: Delusions as errors of learning and memory
Fineberg, S. K., & Corlett, P. R. (2016) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2015.1136206 · Cited by 48 · see citing works
Dorsal striatal dopamine D1 receptor availability predicts an instrumental bias in action learning
de Boer, L., Axelsson, J., Chowdhury, R., Riklund, K., Dolan, R. J., Nyberg, L. H., Bäckman, L., & Guitart‐Masip, M. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816704116 · Cited by 48 · see citing works
Homayoun, H., & Moghaddam, B. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06679.x · Cited by 45 · see citing works
Adolescent rats are resistant to forming ethanol seeking habits
Serlin, H., & Torregrossa, M. M. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.12.002 · Cited by 41 · see citing works
Méndez-López, M., Méndez, M., López, L., & Arias, J. L. (2009) · Neuroscience Research · doi:10.1016/j.neures.2009.05.001 · Cited by 41 · see citing works
Kong, F., Chen, Z., Xue, S., Wang, X., & Jia Liu, B. (2015) · Human Brain Mapping · doi:10.1002/hbm.22934 · Cited by 40 · see citing works
Nippert, K. E., Rowland, C. P., Vazey, E. M., & Moorman, D. E. (2024) · Neuropharmacology · doi:10.1016/j.neuropharm.2024.110114 · Cited by 34 · see citing works
Sexually dimorphic c-Fos expression following spatial working memory in young and adult rats
Méndez-López, M., Méndez, M., López, L., & Arias, J. L. (2009) · Physiology & Behavior · doi:10.1016/j.physbeh.2009.06.006 · Cited by 33 · see citing works
Quinn, J. J., Pittenger, C., Lee, A. S., Pierson, J. L., & Taylor, J. R. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12106 · Cited by 32 · see citing works
Self-citationUsing optogenetics to study habits
Smith, K. S., & Graybiel, A. M. (2013) · Brain Research · doi:10.1016/j.brainres.2013.01.008 · Cited by 29 · see citing works
Habitual Preference for the Nondrug Reward in a Drug Choice Setting
Vandaele, Y., Guillem, K., & Ahmed, S. H. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.00078 · Cited by 30 · see citing works
The Role of the Rat Medial Prefrontal Cortex in Adapting to Changes in Instrumental Contingency
Coutureau, É., Esclassan, F., Scala, G. D., & Marchand, A. R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033302 · Cited by 30 · see citing works
Lissek, S., Glaubitz, B., Wolf, O. T., & Tegenthoff, M. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00238 · Cited by 24 · see citing works
Sheynikhovich, D., Otani, S., Bai, J., & Arleo, A. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2022.1068271 · Cited by 28 · see citing works
Natsheh, J. Y., & Shiflett, M. W. (2018) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2018.00045 · Cited by 27 · see citing works
Turner, K. M., & Parkes, S. L. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.07.010 · Cited by 25 · see citing works
Richter, A., Guitart‐Masip, M., Barman, A., Libeau, C., Behnisch, G., Czerney, S., Schanze, D., Assmann, A., Klein, M., Düzel, E., et al. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00140 · Cited by 24 · see citing works
Fineberg, S. K., Steinfeld, M., Brewer, J. A., & Corlett, P. R. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00111 · Cited by 21 · see citing works
The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD
Natsheh, J. Y., & Shiflett, M. W. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00326 · Cited by 21 · see citing works
Cosme, C. V., Gutman, A. L., Worth, W. R., & LaLumiere, R. T. (2016) · Addiction Biology · doi:10.1111/adb.12442 · Cited by 21 · see citing works
Lee, Y. K., & Choi, J.-S. (2012) · Experimental Neurobiology · doi:10.5607/en.2012.21.1.23 · Cited by 21 · see citing works
Kantak, K. M., Mashhoon, Y., Silverman, D. N., Janes, A. C., & Goodrich, C. M. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.02.002 · Cited by 20 · see citing works
The evolution of religious misbelief
Ara Norenzayan, A., Shariff, A., & Gervais, W. M. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991312 · Cited by 20 · see citing works
Neural systems mediating the inhibition of cocaine-seeking behaviors
Ewald, V. A. M., & LaLumiere, R. T. (2017) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2017.07.006 · Cited by 19 · see citing works
Cerpa, J.-C., Coutureau, É., & Parkes, S. L. (2021) · Behavioral Neuroscience · doi:10.1037/bne0000426 · Cited by 20 · see citing works
Social experience in adolescence shapes prefrontal cortex structure and function in adulthood
Li, D. C., Hinton, E. A., Guo, J., Knight, K. A., Sequeira, M. K., Wynne, M. E., Dighe, N. M., & Gourley, S. L. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02540-6 · Cited by 17 · see citing works
Carrara‐Nascimento, P. F., Hoffmann, L. B., Flório, J. C., Planeta, C. S., & Camarini, R. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.00031 · Cited by 17 · see citing works
Chen, S., Huang, S., Yang, C., Cai, W., Chen, H., Hao, W., Liu, T., Wang, X., Worhunsky, P. D., & Potenza, M. N. (2019) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyz069 · Cited by 16 · see citing works
Green, S. M., Nathani, S., Zimmerman, J., Fireman, D., & Urs, N. M. (2020) · eNeuro · doi:10.1523/eneuro.0194-20.2020 · Cited by 16 · see citing works
Endocannabinoid Signaling in the Striatum
Lovinger, D. M., Davis, M. I., & Costa, R. M. (2010) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-374767-9.00009-3 · Cited by 16 · see citing works
Opposing roles of prelimbic and infralimbic dopamine in conditioned cue and place preference
Hayen, A., Meese‐Tamuri, S., Gates, A., & Ito, R. (2014) · Psychopharmacology · doi:10.1007/s00213-013-3414-0 · Cited by 16 · see citing works
Gołębiowska, J., & Ryguła, R. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.02.013 · Cited by 16 · see citing works
Development of working memory in the male adolescent rat
Kirschmann, E. K., Pollock, M. W., Nagarajan, V., & Torregrossa, M. M. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2018.11.003 · Cited by 16 · see citing works
Drozd, R., Cieślak, P. E., Rychlik, M., Parkitna, J. M. R., & Ryguła, R. (2016) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2016.00163 · Cited by 15 · see citing works
LeMon, J. V., Sisk, C. L., Klump, K. L., & Johnson, A. W. (2019) · Physiology & Behavior · doi:10.1016/j.physbeh.2019.03.005 · Cited by 14 · see citing works
Animal models of OCD-relevant processes: An RDoC perspective
Pittenger, C., Pushkarskaya, H., & Gruner, P. (2019) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2019.03.001 · Cited by 13 · see citing works
Richter, A., de Boer, L., Guitart‐Masip, M., Behnisch, G., Seidenbecher, C. I., & Schott, B. H. (2021) · Journal of Neural Transmission · doi:10.1007/s00702-021-02382-4 · Cited by 12 · see citing works
Cortical Determinants of Goal-Directed Behavior
Coutureau, É., & Parkes, S. L. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-812098-9.00008-5 · Cited by 12 · see citing works
Aberrant Dopamine Transmission and Cognitive Dysfunction in Animal Models of Parkinson's Disease
Lelos, M. J., & Dunnett, S. B. (2011) · Journal of Parkinson s Disease · doi:10.3233/jpd-2011-11036 · Cited by 12 · see citing works
Bertz, J. W., Chen, J., & Woods, J. H. (2014) · Psychopharmacology · doi:10.1007/s00213-014-3659-2 · Cited by 10 · see citing works
- Authors
- Hitchcott, P. K., Quinn, J. J., & Taylor, J. R.
- Affiliations
- Yale University (US)
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-02-24
- Volume
- 17
- Issue
- 12
- Pages
- 2820-2827
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2148387659
- Cited by
- 143
- References
- 48
- Citations by year
- 2025: 3 · 2024: 5 · 2023: 4 · 2022: 3 · 2021: 8 · 2020: 6 · 2019: 7 · 2018: 6 · 2017: 5 · 2016: 11 · 2015: 10 · 2014: 14 · 2013: 10 · 2012: 8
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Cerebral Cortex (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- NECTAR - Northampton Electronic Collection of Thesis and Research (University of Northampton) (acceptedVersion)
- UNICA IRIS Institutional Research Information System (University of Cagliari) (submittedVersion)
- Funders
- National Institute of Mental Health (T32MH014276)
- National Institute on Drug Abuse (DA 11717, R01DA011717)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- ventromedial prefrontal cortex, dopamine, instrumental behavior, outcome devaluation, outcome sensitivity, goal-directed behavior, attention, reinforcement learning, compulsive behavior
- MeSH terms
- Animals, Attention, Behavior, Animal, Dopamine, Dose-Response Relationship, Drug, Goals, Habits, Male, Reward, Rats, Sprague-Dawley, Prefrontal Cortex, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
