A dual operator view of habitual behavior reflecting cortical and striatal dynamics

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works

Cognitive maps in rats and men

Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641 · see citing works

An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance

Aston-Jones, G., & Cohen, J. D. (2005) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135709 · Cited by 4,472 · see citing works

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion

Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · see citing works

The Neural Basis of Addiction: A Pathology of Motivation and Choice

Kalivas, P. W., & Volkow, N. D. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.8.1403 · Cited by 2,757 · see citing works

NEURAL MECHANISMS OF ADDICTION: The Role of Reward-Related Learning and Memory

Hyman, S. E., Malenka, R. C., & Nestler, E. J. (2006) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113009 · Cited by 2,647 · see citing works

The role of the basal ganglia in habit formation

Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402 · see citing works

NEURONAL CIRCUITS OF THE NEOCORTEX

Douglas, R. J., & Martin, K. A. C. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144152 · Cited by 1,886 · see citing works

Habits, Rituals, and the Evaluative Brain

Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works

Goal-directed instrumental action: contingency and incentive learning and their cortical substrates

Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541 · see citing works

The organization of the projection from the cerebral cortex to the striatum in the rat

McGeorge, A. J., & Faull, R. L. M. (1989) · Neuroscience · doi:10.1016/0306-4522(89)90128-0 · Cited by 1,345 · see citing works

Actions and habits: The development of behavioural autonomy

Dickinson, A. (1985) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1985.0010 · Cited by 1,217 · see citing works

The Basal Ganglia and Chunking of Action Repertoires

Graybiel, A. M. (1998) · Neurobiology of Learning and Memory · doi:10.1006/nlme.1998.3843 · Cited by 1,042 · see citing works

Intracellular Features Predicted by Extracellular Recordings in the Hippocampus In Vivo

Henze, D. A., Borhegyi, Z., Csicsvari, J., Mamiya, A., Harris, K. D., & Buzsáki, G. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.1.390 · Cited by 942 · see citing works

Building neural representations of habits.

Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · see citing works

Efferent projections of the infralimbic cortex of the rat

Hurley, K. M., Herbert, H., Moga, M. M., & Saper, C. B. (1991) · Journal of Comparative Neurology · doi:10.1002/cne.903080210 · Cited by 777 · see citing works

A specific role for posterior dorsolateral striatum in human habit learning

Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06796.x · Cited by 769 · see citing works

Coordination of Actions and Habits in the Medial Prefrontal Cortex of Rats

Killcross, S. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.4.400 · Cited by 748 · see citing works

Extinction circuits for fear and addiction overlap in prefrontal cortex

Peters, J., Kalivas, P. W., & Quirk, G. J. (2009) · Learning & Memory · doi:10.1101/lm.1041309 · Cited by 736 · see citing works

Prefrontal involvement in the regulation of emotion: convergence of rat and human studies

Quirk, G. J., & Beer, J. S. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.07.004 · Cited by 701 · see citing works

Variations in the Sensitivity of Instrumental Responding to Reinforcer Devaluation

Adams, C. D. (1982) · The Quarterly Journal of Experimental Psychology Section B · doi:10.1080/14640748208400878 · Cited by 635 · see citing works

Start/stop signals emerge in nigrostriatal circuits during sequence learning

Jin, X., & Costa, R. M. (2010) · Nature · doi:10.1038/nature09263 · Cited by 611 · see citing works

Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories

Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595 · see citing works

What songbirds teach us about learning

Brainard, M. S., & Doupe, A. J. (2002) · Nature · doi:10.1038/417351a · Cited by 589 · see citing works

Oscillatory Entrainment of Striatal Neurons in Freely Moving Rats

Berke, J. D., Okatan, M., Skurski, J., & Eichenbaum, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.08.035 · Cited by 507 · see citing works

A unified framework for addiction: Vulnerabilities in the decision process

Redish, A. D., Jensen, S., & Johnson, A. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800472x · Cited by 501 · see citing works

A biological theory of reinforcement.

Glickman, S. E., & Schiff, B. B. (1967) · Psychological Review · doi:10.1037/h0024290 · Cited by 466 · see citing works

Differential Dynamics of Activity Changes in Dorsolateral and Dorsomedial Striatal Loops during Learning

Thorn, C. A., Atallah, H. E., Howe, M. W., & Graybiel, A. M. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.036 · Cited by 412 · see citing works

The integrative function of the basal ganglia in instrumental conditioning

Balleine, B. W., Liljeholm, M., & Ostlund, S. B. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.10.034 · Cited by 356 · see citing works

Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling

Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · see citing works

Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats

Coutureau, E., & Killcross, S. (2003) · Behavioural Brain Research · doi:10.1016/j.bbr.2003.09.025 · Cited by 342 · see citing works

Variability, compensation, and modulation in neurons and circuits

Marder, E. E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010674108 · Cited by 341 · see citing works

Mapping value based planning and extensively trained choice in the human brain

Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310 · see citing works

Switching from automatic to controlled behavior: cortico-basal ganglia mechanisms

Hikosaka, O., & Isoda, M. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.01.006 · Cited by 304 · see citing works

Sublayer-specific microcircuits of corticospinal and corticostriatal neurons in motor cortex

Anderson, C. T., Sheets, P. L., Kiritani, T., & Shepherd, G. M. (2010) · Nature Neuroscience · doi:10.1038/nn.2538 · Cited by 261 · see citing works

Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning.

Holland, P. C., & Straub, J. J. (1979) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.5.1.65 · Cited by 254 · see citing works

Rat Prefrontal Cortical Neurons Selectively Code Strategy Switches

Rich, E. L., & Shapiro, M. L. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.6068-08.2009 · Cited by 253 · see citing works

Separate neural substrates for skill learning and performance in the ventral and dorsal striatum

Atallah, H. E., Lopez-Paniagua, D., Rudy, J. W., & O'Reilly, R. C. (2007) · Nature Neuroscience · doi:10.1038/nn1817 · Cited by 241 · see citing works

Representation of Action Sequence Boundaries by Macaque Prefrontal Cortical Neurons

Fujii, N., & Graybiel, A. M. (2003) · Science · doi:10.1126/science.1086872 · Cited by 193 · see citing works

Vicarious Trial and Error at a Point of Choice: I. A General Survey of its Relation to Learning Efficiency

Muenzinger, K. F. (1938) · The Pedagogical Seminary and Journal of Genetic Psychology · doi:10.1080/08856559.1938.10533799 · Cited by 178 · see citing works

Neuronal Activity in the Rodent Dorsal Striatum in Sequential Navigation: Separation of Spatial and Reward Responses on the Multiple T Task

Schmitzer-Torbert, N. C., & Redish, A. D. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00687.2003 · Cited by 176 · see citing works

Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex

Smith, K. S., Virkud, A., Deisseroth, K., & Graybiel, A. M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1216264109 · Cited by 173 · see citing works

Amygdala Central Nucleus Interacts with Dorsolateral Striatum to Regulate the Acquisition of Habits

Lingawi, N. W., & Balleine, B. W. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.4806-11.2012 · Cited by 172 · see citing works

Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine

Hitchcott, P. K., Quinn, J. J., & Taylor, J. R. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm010 · Cited by 143 · see citing works

Neural Coding of Syntactic Structure in Learned Vocalizations in the Songbird

Fujimoto, H., Hasegawa, T., & Watanabe, D. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1606-11.2011 · Cited by 127 · see citing works

Changes in activity of the striatum during formation of a motor habit

Tang, C., Pawlak, A. P., Prokopenko, V., & West, M. O. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05353.x · Cited by 122 · see citing works

Lesions of Rat Infralimbic Cortex Enhance Recovery and Reinstatement of an Appetitive Pavlovian ResponsePreprint

Rhodes, S. E. V., & Killcross, S. (2004) · Learning & Memory · doi:10.1101/lm.79704 · Cited by 119 · see citing works

Covert skill learning in a cortical-basal ganglia circuit

Charlesworth, J. D., Warren, T. L., & Brainard, M. S. (2012) · Nature · doi:10.1038/nature11078 · Cited by 119 · see citing works

Habitual versus goal-directed action control in Parkinson disease

de Wit, S., Barker, R. A., Dickinson, A. D., & Cools, R. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21514 · Cited by 116 · see citing works

Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task

Carelli, R. M., Wolske, M., & West, M. O. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-05-01804.1997 · Cited by 114 · see citing works

Basal ganglia neural mechanisms of natural movement sequences

Aldridge, J. W., Berridge, K. C., & Rosen, A. R. (2004) · Canadian Journal of Physiology and Pharmacology · doi:10.1139/y04-061 · Cited by 107 · see citing works

Striatal Versus Hippocampal Representations During Win-Stay Maze Performance

Berke, J. D., Breck, J. T., & Eichenbaum, H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.91106.2008 · Cited by 105 · see citing works

Exhumed from thought: Basal ganglia and response learning in the plus-maze

Packard, M. G. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.013 · Cited by 97 · see citing works

Prefrontal Cortex Mediates Extinction of Responding by Two Distinct Neural Mechanisms in Accumbens Shell

Ghazizadeh, A., Ambroggi, F., Odean, N. N., & Fields, H. L. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.3891-11.2012 · Cited by 87 · see citing works

Neuronal Correlates of Instrumental Learning in the Dorsal Striatum

Kimchi, E. Y., Torregrossa, M. M., Taylor, J. R., & Laubach, M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00262.2009 · Cited by 83 · see citing works

Recent breakthroughs in basal ganglia research

Bézard, E. (2006) · Nova Science Publishers eBooks · Cited by 71 · see citing works

Stable Encoding of Task Structure Coexists With Flexible Coding of Task Events in Sensorimotor Striatum

Kubota, Y., Liu, J., Hu, D., DeCoteau, W. E., Eden, U. T., Smith, A. C., & Graybiel, A. M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00522.2009 · Cited by 66 · see citing works

Deep Brain Stimulation for Psychiatric Disorders

Holtzheimer, P., & Mayberg, H. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113638 · Cited by 65 · see citing works

Actions, policies, values, and the basal ganglia

Daw, N. D., Niv, Y., & Dayan, P. (2006) · MPG.PuRe (Max Planck Society) · Cited by 42 · see citing works

Advance cueing produces enhanced action-boundary patterns of spike activity in the sensorimotor striatum

Barnes, T. D., Mao, J.-B., Hu, D., Kubota, Y., Dreyer, A. A., Stamoulis, C., Brown, E. N., & Graybiel, A. M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00871.2010 · Cited by 40 · see citing works

Appetites, Aversions, and Addictions: A Model for Visceral Memory

García, J., & Ervin, F. R. (1968) · Recent Advances in Biological Psychiatry · doi:10.1007/978-1-4684-9072-5_24 · Cited by 36 · see citing works

Absence of cue-evoked firing in rat dorsolateral striatum neurons

Root, D. H., Tang, C. C., Ma, S., Pawlak, A. P., & West, M. O. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.03.001 · Cited by 12 · see citing works

Psychology of Habit.

Wood, W., & Rünger, D. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033417 · Cited by 1,445 · see citing works

The Multifaceted Role of the Ventromedial Prefrontal Cortex in Emotion, Decision Making, Social Cognition, and Psychopathology

Hiser, J., & Koenigs, M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.10.030 · Cited by 972 · see citing works

The mouse cortico-striatal projectome

Hintiryan, H., Foster, N. N., Bowman, I., Bay, M., Song, M. Y., Gou, L., Yamashita, S., Bienkowski, M. S., Zingg, B., Zhu, M., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4332 · Cited by 541 · see citing works

Exploration versus exploitation in space, mind, and society

Hills, T. T., Todd, P. M., Lazer, D. M. J., Redish, A. D., & Couzin, I. D. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.10.004 · Cited by 552 · see citing works

The Neural Representation of Sequences: From Transition Probabilities to Algebraic Patterns and Linguistic Trees

Dehaene, S., Meyniel, F., Wacongne, C., Wang, L., & Pallier, C. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.019 · Cited by 478 · see citing works

The transition to compulsion in addiction

Lüscher, C., Robbins, T. W., & Everitt, B. J. (2020) · Nature reviews. Neuroscience · doi:10.1038/s41583-020-0289-z · Cited by 475 · see citing works

Vicarious trial and error

Redish, A. D. (2016) · Nature reviews. Neuroscience · doi:10.1038/nrn.2015.30 · Cited by 462 · see citing works

The striatum: where skills and habits meet

Graybiel, A. M., & Grafton, S. T. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021691 · Cited by 463 · see citing works

Bursts of beta oscillation differentiate postperformance activity in the striatum and motor cortex of monkeys performing movement tasks

Feingold, J., Gibson, D. J., DePasquale, B., & Graybiel, A. M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517629112 · Cited by 370 · see citing works

Conscious and Unconscious Memory Systems

Squire, L. R., & Dede, A. J. O. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021667 · Cited by 366 · see citing works

Goal-directed learning and obsessive-compulsive disorder

Gillan, C. M., & Robbins, T. W. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0475 · Cited by 348 · see citing works

“Liking” and “wanting” in eating and food reward: Brain mechanisms and clinical implications

Morales, I., & Berridge, K. C. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.113152 · Cited by 346 · see citing works

Striatal circuits, habits, and implications for obsessive-compulsive disorder

Burguière, E., Monteiro, P., Mallet, L., Feng, G., & Graybiel, A. M. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.08.008 · Cited by 286 · see citing works

Functional neuroimaging of avoidance habits in obsessive-compulsive disorder

Gillan, C. M., Apergis-Schoute, A. M., Morein-Zamir, S., Urcelay, G. P., Sule, A., Fineberg, N. A., Sahakian, B. J., & Robbins, T. W. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2014.14040525 · Cited by 265 · see citing works

Endocannabinoid Modulation of Orbitostriatal Circuits Gates Habit Formation

Gremel, C. M., Chancey, J. H., Atwood, B. K., Luo, G., Neve, R., Ramakrishnan, C., Deisseroth, K., Lovinger, D. M., & Costa, R. M. (2016) · Neuron · doi:10.1016/j.neuron.2016.04.043 · Cited by 251 · see citing works

Striatal activity topographically reflects cortical activity

Peters, A. J., Fabre, J. M., Steinmetz, N. A., Harris, K. D., & Carandini, M. (2021) · Nature · doi:10.1038/s41586-020-03166-8 · Cited by 226 · see citing works

Habitual instigation and habitual execution: definition, measurement, and effects on behaviour frequency

Gardner, B., Phillips, L. A., & Judah, G. (2016) · British Journal of Health Psychology · doi:10.1111/bjhp.12189 · Cited by 232 · see citing works

The Cognitive Architecture of Spatial Navigation: Hippocampal and Striatal Contributions

Chersi, F., & Burgess, N. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.021 · Cited by 240 · see citing works

Circuit Mechanisms of Sensorimotor Learning

Makino, H., Hwang, E. J., Hedrick, N. G., & Komiyama, T. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.029 · Cited by 228 · see citing works

Differential roles of medial prefrontal subregions in the regulation of drug seeking

Moorman, D. E., James, M. H., McGlinchey, E. M., & Aston‐Jones, G. (2014) · Brain Research · doi:10.1016/j.brainres.2014.12.024 · Cited by 224 · see citing works

Optogenetic dissection of medial prefrontal cortex circuitry

Riga, D., Matos, M. R., Glas, A., Smit, A. B., Spijker, S., & Van den Oever, M. C. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00230 · Cited by 208 · see citing works

Dorsal Striatal Circuits for Habits, Compulsions and Addictions

Lipton, D. M., Gonzales, B. J., & Citri, A. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00028 · Cited by 197 · see citing works

Going and stopping: dichotomies in behavioral control by the prefrontal cortex

Gourley, S. L., & Taylor, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4275 · Cited by 195 · see citing works

The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

Balleine, B. W. (2019) · Neuron · doi:10.1016/j.neuron.2019.09.024 · Cited by 172 · see citing works

Influence of reward motivation on human declarative memory

Lombard, E., Bavelier, D., & Schwartz, S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.11.015 · Cited by 174 · see citing works

The role of NPY in learning and memory

Gøtzsche, C. R., & Woldbye, D. P. D. (2015) · Neuropeptides · doi:10.1016/j.npep.2015.09.010 · Cited by 165 · see citing works

Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction

Moorman, D. E., & Aston‐Jones, G. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1507611112 · Cited by 159 · see citing works

Neural mechanisms regulating different forms of risk-related decision-making: Insights from animal models

Orsini, C. A., Moorman, D. E., Young, J. W., Setlow, B., & Floresco, S. B. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.04.009 · Cited by 153 · see citing works

Habit formation

Smith, K. S., & Graybiel, A. M. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/ksmith · Cited by 156 · see citing works

Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity

Coddington, L. T., & Dudman, J. T. (2019) · Neuron · doi:10.1016/j.neuron.2019.08.036 · Cited by 150 · see citing works

DISSECTING OCD CIRCUITS: FROM ANIMAL MODELS TO TARGETED TREATMENTS: Review: Dissecting OCD Circuits: Animals to Treatments

Ahmari, S. E., & Dougherty, D. D. (2015) · Depression and Anxiety · doi:10.1002/da.22367 · Cited by 128 · see citing works

Goal-direction and top-down control

Buschman, T. J., & Miller, E. K. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0471 · Cited by 122 · see citing works

Habitual versus goal-directed action control in Parkinson disease

de Wit, S., Barker, R. A., Dickinson, A. D., & Cools, R. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21514 · Cited by 116 · see citing works

Opposing roles of primate areas 25 and 32 and their putative rodent homologs in the regulation of negative emotion

Wallis, C. U., Cardinal, R. N., Alexander, L., Roberts, A. C., & Clarke, H. F. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1620115114 · Cited by 117 · see citing works

Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training

Vandaele, Y., Mahajan, N. R., Ottenheimer, D. J., Richard, J. M., Mysore, S. P., & Janak, P. H. (2019) · eLife · doi:10.7554/elife.49536 · Cited by 108 · see citing works

Nucleus Accumbens Core and Shell Differentially Encode Reward-Associated Cues after Reinforcer Devaluation

West, E. A., & Carelli, R. M. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.2976-15.2016 · Cited by 107 · see citing works

The Necessity of Rostrolateral Prefrontal Cortex for Higher-Level Sequential Behavior

Desrochers, T. M., Chatham, C. H., & Badre, D. (2015) · Neuron · doi:10.1016/j.neuron.2015.08.026 · Cited by 106 · see citing works

Two-photon imaging in mice shows striosomes and matrix have overlapping but differential reinforcement-related responses

Bloem, B., Huda, R., Sur, M., & Graybiel, A. M. (2017) · eLife · doi:10.7554/elife.32353 · Cited by 99 · see citing works

Regulation of habit formation in the dorsal striatum

Malvaez, M., & Wassum, K. M. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.11.005 · Cited by 96 · see citing works

Emotional self-control and dysregulation: A dual-process analysis of pathways to externalizing/internalizing symptomatology and positive well-being in younger adolescents

Wills, T. A., Simons, J. S., Sussman, S., & Knight, R. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.039 · Cited by 98 · see citing works

Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking

Collins, A. L., & Saunders, B. T. (2020) · Journal of Neuroscience Research · doi:10.1002/jnr.24587 · Cited by 87 · see citing works

Discovery of hierarchical representations for efficient planning

Tomov, M. S., Yagati, S., Kumar, A., Yang, W., & Gershman, S. J. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007594 · Cited by 97 · see citing works

The relationship between habits and motor skills in humans

Du, Y., Krakauer, J. W., & Haith, A. M. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.02.002 · Cited by 94 · see citing works

Illuminating circuitry relevant to psychiatric disorders with optogenetics

Steinberg, E. E., Christoffel, D. J., Deisseroth, K., & Malenka, R. C. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.08.004 · Cited by 92 · see citing works

The role of learning-related dopamine signals in addiction vulnerability

Huys, Q. J. M., Tobler, P. N., Hasler, G., & Flagel, S. B. (2014) · Progress in brain research · doi:10.1016/b978-0-444-63425-2.00003-9 · Cited by 87 · see citing works

Infralimbic cortex is required for learning alternatives to prelimbic promoted associations through reciprocal connectivity

Mukherjee, A., & Caroni, P. (2018) · Nature Communications · doi:10.1038/s41467-018-05318-x · Cited by 89 · see citing works

A Working Hypothesis for the Role of the Cerebellum in Impulsivity and Compulsivity

Miquel, M., Nicola, S. M., Gil‐Miravet, I., Guarque‐Chabrera, J., & Sanchez-Hernandez, A. (2019) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2019.00099 · Cited by 89 · see citing works

Inversely Active Striatal Projection Neurons and Interneurons Selectively Delimit Useful Behavioral Sequences

Martiros, N., Burgess, A. A., & Graybiel, A. M. (2018) · Current Biology · doi:10.1016/j.cub.2018.01.031 · Cited by 87 · see citing works

Ventromedial Prefrontal Cortex Damage Is Associated with Decreased Ventral Striatum Volume and Response to Reward

Pujara, M. S., Philippi, C. L., Motzkin, J. C., Başkaya, M. K., & Koenigs, M. R. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.4236-15.2016 · Cited by 84 · see citing works

Behavioral and neural mechanisms underlying habitual and compulsive drug seeking

Smith, R. J., & Laiks, L. (2017) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2017.09.003 · Cited by 87 · see citing works

Dorsolateral Striatum Engagement Interferes with Early Discrimination Learning

Bergstrom, H. C., Lipkin, A. M., Lieberman, A. G., Pinard, C. R., Gunduz‐Cinar, O., Brockway, E. T., Taylor, W. W., Nonaka, M., Bukalo, O., Wills, T. A., et al. (2018) · Cell Reports · doi:10.1016/j.celrep.2018.04.081 · Cited by 82 · see citing works

Cue Reactivity in the Ventral Striatum Characterizes Heavy Cannabis Use, Whereas Reactivity in the Dorsal Striatum Mediates Dependent Use

Zhou, X., Zimmermann, K., Xin, F., Zhao, W., Derckx, R. T., Sassmannshausen, A., Scheele, D., Hurlemann, R., Weber, B., Kendrick, K. M., et al. (2019) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2019.04.006 · Cited by 77 · see citing works

A unifying model of the role of the infralimbic cortex in extinction and habitsPreprint

Barker, J. M., Taylor, J. R., & Chandler, L. J. (2014) · Learning & Memory · doi:10.1101/lm.035501.114 · Cited by 79 · see citing works

Differential Entrainment and Learning-Related Dynamics of Spike and Local Field Potential Activity in the Sensorimotor and Associative Striatum

Thorn, C. A., & Graybiel, A. M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.1782-13.2014 · Cited by 76 · see citing works

Transcriptional and Epigenetic Substrates of Methamphetamine Addiction and Withdrawal: Evidence from a Long-Access Self-Administration Model in the Rat

Cadet, J. L., Brannock, C., Jayanthi, S., & Krasnova, I. N. (2014) · Molecular Neurobiology · doi:10.1007/s12035-014-8776-8 · Cited by 76 · see citing works

Differentiating neural systems mediating the acquisition vs. expression of goal‐directed and habitual behavioral control

Liljeholm, M., Dunne, S., & O’Doherty, J. P. (2015) · European Journal of Neuroscience · doi:10.1111/ejn.12897 · Cited by 68 · see citing works

Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

DiFeliceantonio, A. G., & Berridge, K. C. (2016) · European Journal of Neuroscience · doi:10.1111/ejn.13220 · Cited by 69 · see citing works

Striatal dopamine signals are region specific and temporally stable across action-sequence habit formation

van Elzelingen, W., Warnaar, P., de Matos, J. M. S., Bastet, W., Jonkman, R., Smulders, D., Goedhoop, J. N., Denys, D. A. J. P., Arbab, T., & Willuhn, I. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.027 · Cited by 63 · see citing works

Using mice to model Obsessive Compulsive Disorder: From genes to circuits

Ahmari, S. E. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2015.11.009 · Cited by 68 · see citing works

Going veggie: Identifying and overcoming the social and psychological barriers to veganism

Bryant, C. J., Prosser, A. M. B., & Barnett, J. C. (2021) · Appetite · doi:10.1016/j.appet.2021.105812 · Cited by 65 · see citing works

Targeting cocaine versus heroin memories: divergent roles within ventromedial prefrontal cortex

Peters, J., Pattij, T., & Vries, T. J. D. (2013) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2013.10.004 · Cited by 68 · see citing works

Habit formation coincides with shifts in reinforcement representations in the sensorimotor striatum

Smith, K. S., & Graybiel, A. M. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00925.2015 · Cited by 64 · see citing works

Neurobiology of habit formation

Amaya, K. A., & Smith, K. S. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2018.01.003 · Cited by 67 · see citing works

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico‐basal ganglia systems

Rusu, S. I., & Pennartz, C. M. A. (2019) · Hippocampus · doi:10.1002/hipo.23167 · Cited by 63 · see citing works

Characterization of Cortical Networks and Corticocortical Functional Connectivity Mediating Arbitrary Visuomotor Mapping

Brovelli, A., Chicharro, D., Badier, J., Wang, H., & Jirsa, V. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4892-14.2015 · Cited by 61 · see citing works

Tryptophan Depletion Promotes Habitual over Goal-Directed Control of Appetitive Responding in Humans

Worbe, Y., Savulich, G., de Wit, S., Fernandez-Egea, E., & Robbins, T. W. (2015) · International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyv013 · Cited by 64 · see citing works

Arbitration between action strategies in obsessive-compulsive disorder

Gruner, P., Anticevic, A., Lee, D., & Pittenger, C. (2016) · The Neuroscientist · doi:10.1177/1073858414568317 · Cited by 62 · see citing works

A basal ganglia-like cortical–amygdalar–hypothalamic network mediates feeding behavior

Barbier, M., Chometton, S., Pautrat, A., Miguet‐Alfonsi, C., Datiche, F., Gascuel, J., FELLMANN, D., Peterschmitt, Y., Coizet, V., & Risold, P. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2004914117 · Cited by 60 · see citing works

Computational validity: using computation to translate behaviours across species

Redish, A. D., Kepecs, Á., Anderson, L. M., Calvin, O. L., Grissom, N. M., Haynos, A. F., Heilbronner, S. R., Herman, A. B., Jacob, S., Ma, S., et al. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2020.0525 · Cited by 59 · see citing works

Making habits measurable beyond what they are not: A focus on associative dual-process models

Watson, P., O’Callaghan, C., Perkes, I. E., Bradfield, L. A., & Turner, K. M. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104869 · Cited by 61 · see citing works

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

Nett, K. E., & LaLumiere, R. T. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.10.002 · Cited by 58 · see citing works

Memorable Trends

Dudai, Y., & Morris, R. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.039 · Cited by 59 · see citing works

Habits are negatively regulated by histone deacetylase 3 in the dorsal striatum

Malvaez, M., Greenfield, V. Y., Matheos, D. P., Angelillis, N. A., Murphy, M. D., Kennedy, P. J., Wood, M. A., & Wassum, K. M. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.01.025 · Cited by 56 · see citing works

Inactivation of prelimbic and infralimbic cortex respectively affects minimally-trained and extensively-trained goal-directed actions

Shipman, M. L., Trask, S., Bouton, M. E., & Green, J. T. (2018) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2018.07.010 · Cited by 56 · see citing works

Character, Circumstances, and Criminal Careers

Wikström, P. H., Treiber, K., & Roman, G. (2024) · doi:10.1093/oso/9780198865865.001.0001 · Cited by 57 · see citing works

Striosomes control dopamine via dual pathways paralleling canonical basal ganglia circuits

Lazaridis, I., Crittenden, J. R., Ahn, G., Hirokane, K., Wickersham, I. R., Yoshida, T., Mahar, A., Skara, V., Loftus, J., Parvataneni, K., et al. (2024) · Current Biology · doi:10.1016/j.cub.2024.09.070 · Cited by 55 · see citing works

Habit formation.

Smith, K. S., & Graybiel, A. M. (2016) · PubMed Central · Cited by 55 · see citing works

Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences

Desrochers, T. M., Amemori, K., & Graybiel, A. M. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.019 · Cited by 56 · see citing works

Hippocampus and subregions of the dorsal striatum respond differently to a behavioral strategy change on a spatial navigation task

Regier, P. S., Amemiya, S., & Redish, A. D. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00189.2015 · Cited by 54 · see citing works

Inhibiting Rho kinase promotes goal-directed decision making and blocks habitual responding for cocaine

Swanson, A. M., DePoy, L. M., & Gourley, S. L. (2017) · Nature Communications · doi:10.1038/s41467-017-01915-4 · Cited by 54 · see citing works

Addiction History Associates with the Propensity to Form Habits

McKim, T. H., Bauer, D. J., & Boettiger, C. A. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00953 · Cited by 53 · see citing works

Opposing Roles of the Dorsolateral and Dorsomedial Striatum in the Acquisition of Skilled Action Sequencing in Rats

Turner, K. M., Svegborn, A., Langguth, M., McKenzie, C., & Robbins, T. W. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1907-21.2022 · Cited by 51 · see citing works

Policy compression: An information bottleneck in action selection

Lai, L., & Gershman, S. (2021) · The psychology of learning and motivation · doi:10.1016/bs.plm.2021.02.004 · Cited by 77 · see citing works

Contingency Management and Deliberative Decision-Making Processes

Regier, P. S., & Redish, A. D. (2015) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2015.00076 · Cited by 50 · see citing works

Reward network connectivity “at rest” is associated with reward sensitivity in healthy adults: A resting-state fMRI study

Adrián‐Ventura, J., Costumero, V., Parcet, M. A., & Ávila, C. (2019) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-019-00688-1 · Cited by 48 · see citing works

The Crossed Projection to the Striatum in Two Species of Monkey and in Humans: Behavioral and Evolutionary Significance

Innocenti, G. M., Dyrby, T. B., Andersen, K. W., Rouiller, E. M., & Caminiti, R. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw161 · Cited by 48 · see citing works

Effect of Experimental Manipulation of the Orbitofrontal Cortex on Short-Term Markers of Compulsive Behavior: A Theta Burst Stimulation Study

Price, R. B., Gillan, C. M., Hanlon, C., Ferrarelli, F., Kim, T., Karim, H. T., Renard, M., Kaskie, R., Degutis, M., Wears, A., et al. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20060821 · Cited by 48 · see citing works

Basal ganglia mechanisms in action selection, plasticity, and dystonia

Mink, J. W. (2018) · European Journal of Paediatric Neurology · doi:10.1016/j.ejpn.2018.01.005 · Cited by 47 · see citing works

The Monitoring and Control of Task Sequences in Human and Non-Human Primates

Desrochers, T. M., Burk, D. C., Badre, D., & Sheinberg, D. L. (2016) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00185 · Cited by 47 · see citing works

Differential processing of decision information in subregions of rodent medial prefrontal cortex

Diehl, G. W., & Redish, A. D. (2023) · eLife · doi:10.7554/elife.82833 · Cited by 47 · see citing works

Inhibition of presynaptic calcium transients in cortical inputs to the dorsolateral striatum by metabotropic GABA B and mGlu2/3 receptors

Kupferschmidt, D. A., & Lovinger, D. M. (2015) · The Journal of Physiology · doi:10.1113/jp270045 · Cited by 45 · see citing works

Neural circuitry for behavioural arrest

Roseberry, T. K., & Kreitzer, A. C. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0197 · Cited by 44 · see citing works

Habitual Behavior Is Mediated by a Shift in Response-Outcome Encoding by Infralimbic Cortex

Barker, J. M., Glen, W. B., Linsenbardt, D. N., Lapish, C. C., & Chandler, L. J. (2017) · eNeuro · doi:10.1523/eneuro.0337-17.2017 · Cited by 44 · see citing works

Reciprocal amygdala–prefrontal interactions in learning

Yizhar, O., & Klavir, O. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.06.006 · Cited by 44 · see citing works

Differential Effects of Dorsal and Ventral Medial Prefrontal Cortex Inactivation during Natural Reward Seeking, Extinction, and Cue-Induced Reinstatement

Caballero, J. P., Scarpa, G. B., Remage‐Healey, L., & Moorman, D. E. (2019) · eNeuro · doi:10.1523/eneuro.0296-19.2019 · Cited by 45 · see citing works

Place vs. Response Learning: History, Controversy, and Neurobiology

Goodman, J. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.598570 · Cited by 42 · see citing works

Modeling falls in Parkinson's disease: Slow gait, freezing episodes and falls in rats with extensive striatal dopamine loss

Kucinski, A. J., Albin, R. L., Lustig, C., & Sarter, M. F. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2015.01.012 · Cited by 42 · see citing works

Goal-directed control on interval schedules does not depend on the action–outcome correlation.

Garr, E., Bushra, B., Tu, N., & Delamater, A. R. (2019) · Journal of Experimental Psychology Animal Learning and Cognition · doi:10.1037/xan0000229 · Cited by 41 · see citing works

Translational Research on Habit and Alcohol

McKim, T. H., Shnitko, T. A., Robinson, D. L., & Boettiger, C. A. (2016) · Current Addiction Reports · doi:10.1007/s40429-016-0089-8 · Cited by 41 · see citing works

Brain correlates of constituent structure in sign language comprehension

Moreno, A., Limousin, F., Dehaene, S., & Pallier, C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.11.040 · Cited by 42 · see citing works

Building neural representations of habits.

Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · see citing works

Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories

Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595 · see citing works

Changes in activity of the striatum during formation of a motor habit

Tang, C., Pawlak, A. P., Prokopenko, V., & West, M. O. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05353.x · Cited by 122 · see citing works

Habit learning is associated with major shifts in frequencies of oscillatory activity and synchronized spike firing in striatum

Howe, M. W., Atallah, H. E., McCool, A. D., Gibson, D. J., & Graybiel, A. M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1113158108 · Cited by 116 · see citing works

Unveiling the neural correlates of habit in the dorsal striatumPreprint

Vandaele, Y., & Janak, P. H. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.03.438314 · Cited by 3 · see citing works