Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Open accessAbstract
Midbrain dopamine and striatal tonically active neurons (TANs, presumed acetylcholine interneurons) signal behavioral significance of environmental events. Since striatal dopamine and acetylcholine affect plasticity of cortico-striatal transmission and are both crucial to learning, they may serve as teachers in the basal ganglia circuits. We recorded from both neuronal populations in monkeys performing a probabilistic instrumental conditioning task. Both neuronal types respond robustly to reward-related events. Although different events yielded responses with different latencies, the responses of the two populations coincided, indicating integration at the target level. Yet, while the dopamine neurons' response reflects mismatch between expectation and outcome in the positive domain, the TANs are invariant to reward predictability. Finally, TAN pairs are synchronized, compared to a minority of dopamine neuron pairs. We conclude that the striatal cholinergic and dopaminergic systems carry distinct messages by different means, which can be integrated differently to shape the basal ganglia responses to reward-related events.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Dopamine responses in elaborate tasks constitute standard reward prediction-error signals.
“However, on closer inspection, dopamine responses in such elaborate tasks constitute standard reward prediction-error signals2,33,59,66,69,75,151–153.”
From Dopamine reward prediction-error signalling: A two-component response (2016) · cites this paper as [59]
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
ON THE LAW OF EFFECT <sup>1</sup>
Herrnstein, R. J. (1970) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1970.13-243 · Cited by 2,611 · see citing works
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085 · see citing works
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777 · see citing works
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589 · cited 2× · see citing works
“In such cases it has been shown both theoretically and experimentally (Reddi and Carpenter, 2000; Carpenter and Williams, 1995; Roitman and Shadlen, 2002; Goodie and Crooks, 2004) that performance is suboptimal, similar to the speed/accuracy tradeoff effect in motor performance.”
BackgroundNeuronal Spike Trains and Stochastic Point Processes
Perkel, D. H., Gerstein, G. L., & Moore, G. (1967) · Biophysical Journal · doi:10.1016/s0006-3495(67)86596-2 · Cited by 1,482 · see citing works
The Basal Ganglia and Adaptive Motor Control
Graybiel, A. M., Aosaki, T., Flaherty, A. W., & Kimura, M. (1994) · Science · doi:10.1126/science.8091209 · Cited by 1,324 · see citing works
Neuronal Spike Trains and Stochastic Point Processes
Perkel, D. H., Gerstein, G. L., & Moore, G. P. (1967) · Biophysical Journal · doi:10.1016/s0006-3495(67)86597-4 · Cited by 1,310 · see citing works
Correlated neuronal discharge rate and its implications for psychophysical performance
Zohary, E., Shadlen, M. N., & Newsome, W. T. (1994) · Nature · doi:10.1038/370140a0 · Cited by 1,237 · see citing works
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,103 · see citing works
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · see citing works
Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events
Horvitz, J. C. (2000) · Neuroscience · doi:10.1016/s0306-4522(00)00019-1 · Cited by 967 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Neural computation of log likelihood in control of saccadic eye movements
Carpenter, R. H. S., & Williams, M. L. L. (1995) · Nature · doi:10.1038/377059a0 · Cited by 823 · see citing works
Dopamine operates as a subsecond modulator of food seeking
Roitman, M. F., Stuber, G. D., Phillips, P. E. M., Wightman, R. M., & Carelli, R. M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3823-03.2004 · Cited by 718 · see citing works
MATCHING, UNDERMATCHING, AND OVERMATCHING IN STUDIES OF CHOICE
William, B. M. (1979) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1979.32-269 · Cited by 702 · see citing works
Aosaki, T., Tsubokawa, H., Ishida, A., Watanabe, K., Graybiel, A. M., & Kimura, M. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03969.1994 · Cited by 600 · see citing works
Wilson, C. J., Chang, H., & Kitai, S. (1990) · Journal of Neuroscience · doi:10.1523/jneurosci.10-02-00508.1990 · Cited by 511 · see citing works
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506 · see citing works
Acetylcholine-mediated modulation of striatal function
Calabresi, P., Centonze, D., Gubellini, P., Pisani, A., & Bernardi, G. (2000) · Trends in Neurosciences · doi:10.1016/s0166-2236(99)01501-5 · Cited by 440 · see citing works
A stereotaxic atlas of the brain of the cynomolgus monkey (Macaca fascicularis)
Szabo, J., & Cowan, W. M. (1984) · The Journal of Comparative Neurology · doi:10.1002/cne.902220208 · Cited by 415 · see citing works
The influence of urgency on decision time
Reddi, B. A. J., & Carpenter, R. H. S. (2000) · Nature Neuroscience · doi:10.1038/77739 · Cited by 411 · see citing works
An Economist’s Perspective on Probability Matching
Vulkan, N. (2000) · Journal of Economic Surveys · doi:10.1111/1467-6419.00106 · Cited by 401 · see citing works
Temporal and spatial characteristics of tonically active neurons of the primate's striatum
Aosaki, T., Kimura, M., & Graybiel, A. M. (1995) · Journal of Neurophysiology · doi:10.1152/jn.1995.73.3.1234 · Cited by 385 · see citing works
Kerr, J. N. D., & Wickens, J. R. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.1.117 · Cited by 384 · see citing works
The pathogenesis of Parkinson's disease: a new hypothesis.
Barbeau, A. (1962) · PubMed · Cited by 340 · see citing works
Alexander, G. E., & DeLong, M. R. (1985) · Journal of Neurophysiology · doi:10.1152/jn.1985.53.6.1417 · Cited by 336 · see citing works
Spontaneous Activity of Neostriatal Cholinergic InterneuronsIn Vitro
Bennett, B. D., & Wilson, C. J. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05586.1999 · Cited by 319 · see citing works
Coding of Predicted Reward Omission by Dopamine Neurons in a Conditioned Inhibition Paradigm
Tobler, P. N., Dickinson, A., & Schultz, W. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-32-10402.2003 · Cited by 300 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Single cell studies of the primate putamen
Crutcher, M. D., & DeLong, M. R. (1984) · Experimental Brain Research · doi:10.1007/bf00238154 · Cited by 283 · see citing works
Venton, B. J., Zhang, H., Garris, P. A., Phillips, P. E. M., Sulzer, D., & Wightman, R. M. (2003) · Journal of Neurochemistry · doi:10.1046/j.1471-4159.2003.02109.x · Cited by 281 · see citing works
Raz, A., Feingold, A., Zelanskaya, V., Vaadia, E., & Bergman, H. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.3.2083 · Cited by 258 · see citing works
Self-citationProjections of the sexually dimorphic anteroventral periventricular nucleus in the female rat
Gu, G. B., & Simerly, R. B. (1997) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19970721)384:1 · Cited by 251 · see citing works
Treatment of Parkinson's disease.
Hardie, R. J. (1985) · PubMed · Cited by 217 · see citing works
The Left Hemisphere's Role in Hypothesis Formation
Wolford, G., Miller, M. B., & Gazzaniga, M. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-j0003.2000 · Cited by 216 · see citing works
Unilateral Dopamine Denervation Blocks Corticostriatal LTP
Centonze, D., Gubellini, P., Picconi, B., Calabresi, P., Giacomini, P., & Bernardi, G. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.82.6.3575 · Cited by 211 · see citing works
Grace, A. A., & Bunney, B. S. (1983) · Neuroscience · doi:10.1016/0306-4522(83)90137-9 · Cited by 205 · see citing works
Lavoie, B. A., Smith, Y., & Parent, A. (1989) · The Journal of Comparative Neurology · doi:10.1002/cne.902890104 · Cited by 203 · see citing works
Nigrostriatal Dopamine System in Learning to Perform Sequential Motor Tasks in a Predictive Manner
Matsumoto, N., Hanakawa, T., Maki, S., Graybiel, A. M., & Kimura, M. (1999) · Journal of Neurophysiology · doi:10.1152/jn.1999.82.2.978 · Cited by 181 · see citing works
Pisani, A., Bonsi, P., Centonze, D., Calabresi, P., & Bernardi, G. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-07-j0003.2000 · Cited by 168 · see citing works
Jones, I. W., Bolam, J. P., & Wonnacott, S. (2001) · The Journal of Comparative Neurology · doi:10.1002/cne.1345 · Cited by 167 · see citing works
Temporal Difference Model Reproduces Anticipatory Neural Activity
Suri, R. E., & Schultz, W. (2001) · Neural Computation · doi:10.1162/089976601300014376 · Cited by 166 · see citing works
DeBoer, P., & Abercrombie, E. D. (1996) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)12934-0 · Cited by 163 · see citing works
Apicella, P., Legallet, E., & Trouche, E. (1997) · Experimental Brain Research · doi:10.1007/pl00005773 · Cited by 162 · see citing works
Primate brain maps : structure of the macaque brain
Martin, R., Bowden, D. M., Wu, J. C.-C., Dubach, M. F., & Robertson, J. E. (2000) · Elsevier eBooks · Cited by 160 · see citing works
Muscarinic modulation of a transient K+ conductance in rat neostriatal neurons
Akins, P. T., Surmeier, D. J., & Kitai, S. T. (1990) · Nature · doi:10.1038/344240a0 · Cited by 154 · see citing works
Flores‐Hernández, J., Hernandez, S., Snyder, G. L., Yan, Z., Fienberg, A. A., Moss, S. J., Greengard, P., & Surmeier, D. J. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.5.2996 · Cited by 150 · see citing works
Centonze, D., Gubellini, P., Pisani, A., Bernardi, G., & Calabresi, P. (2003) · Reviews in the Neurosciences · doi:10.1515/revneuro.2003.14.3.207 · Cited by 148 · see citing works
Muscarinic and Nicotinic Cholinergic Mechanisms in the Mesostriatal Dopamine Systems
Zhou, F.-M., Wilson, C. J., & Dani, J. A. (2003) · The Neuroscientist · doi:10.1177/1073858402239588 · Cited by 142 · see citing works
Activation of M1-like muscarinic receptors is required for the induction of corticostriatal LTP
Calabresi, P., Centonze, D., Gubellini, P., & Bernardi, G. (1999) · Neuropharmacology · doi:10.1016/s0028-3908(98)00199-3 · Cited by 126 · see citing works
Dopamine Release and Uptake Dynamics within Nonhuman Primate StriatumIn Vitro
Cragg, S. J., Hille, C. J., & Greenfield, S. A. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08209.2000 · Cited by 120 · see citing works
Ravel, S., Legallet, E., & Apicella, P. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-24-08489.2003 · Cited by 116 · see citing works
Impairment of reward-related learning by cholinergic cell ablation in the striatum
Kitabatake, Y., Hikida, T., Watanabe, D., Pastan, I. H., & Nakanishi, S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1032899100 · Cited by 115 · see citing works
A Network Representation of Response Probability in the Striatum
Blázquez, P. M., Fujii, N., Kojima, J., & Graybiel, A. M. (2002) · Neuron · doi:10.1016/s0896-6273(02)00627-x · Cited by 114 · see citing works
Blockade of M2-like muscarinic receptors enhances long-term potentiation at corticostriatal synapses
Calabresi, P., Centonze, D., Gubellini, P., Pisani, A., & Bernardi, G. (1998) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1998.00348.x · Cited by 107 · see citing works
Ravel, S., Sardo, P., Legallet, E., & Apicella, P. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-15-05730.2001 · Cited by 107 · see citing works
Cholinergic and dopaminergic modulation of potassium conductances in neostriatal neurons.
Kitai, S. T., & Surmeier, D. J. (1993) · PubMed · Cited by 102 · see citing works
Putaminal Activity for Simple Reactions or Self-Timed Movements
Lee, I. H., & Assad, J. A. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01055.2002 · Cited by 101 · see citing works
Role of Tonically Active Neurons in Primate Caudate in Reward-Oriented Saccadic Eye Movement
Shimo, Y., & Hikosaka, O. (2001) · Journal of Neuroscience · doi:10.1523/jneurosci.21-19-07804.2001 · Cited by 97 · see citing works
Molecular and cellular mechanisms of neostriatal function
Ariano, M. A., & Surmeier, D. J. (1995) · Cited by 96 · see citing works
Pisani, A. (2003) · Neuropharmacology · doi:10.1016/s0028-3908(03)00137-0 · Cited by 94 · see citing works
Tonically active neurons in the monkey striatum do not preferentially respond to appetitive stimuli
Ravel, S., Legallet, E., & Apicella, P. (1999) · Experimental Brain Research · doi:10.1007/s002210050876 · Cited by 93 · see citing works
Permissive role of interneurons in corticostriatal synaptic plasticity
Centonze, D., Gubellini, P., Bernardi, G., & Calabresi, P. (1999) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00018-1 · Cited by 89 · see citing works
Drukarch, B., Schepens, E., Schoffelmeer, A. N. M., & Stoof, J. C. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb07244.x · Cited by 63 · see citing works
Influence of Predictive Information on Responses of Tonically Active Neurons in the Monkey Striatum
Apicella, P., Ravel, S., Sardo, P., & Legallet, E. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.6.3341 · Cited by 63 · see citing works
Influence of Spatial Information on Responses of Tonically Active Neurons in the Monkey Striatum
Ravel, S., Sardo, P., Legallet, E., & Apicella, P. (2006) · Journal of Neurophysiology · doi:10.1152/jn.01113.2005 · Cited by 62 · see citing works
Goal-directed, serial and synchronous activation of neurons in the primate striatum
Kimura, M., Matsumoto, N., Okahashi, K., Ueda, Y., Satoh, T., Minamimoto, T., Sakamoto, M., & Yamada, H. (2003) · Neuroreport · doi:10.1097/00001756-200305060-00004 · Cited by 41 · see citing works
Time-Pressure Effects on Performance in a Base-Rate Task
Goodie, A. S., & Crooks, C. L. (2004) · The Journal of General Psychology · doi:10.3200/genp.131.1.18-28 · Cited by 40 · see citing works
Anticholinergic therapies in the treatment of Parkinson's disease
(2002) · Movement Disorders · doi:10.1002/mds.5556 · Cited by 31 · see citing works
Kudernatsch, M., & Sutor, B. (1994) · Neuroscience Letters · doi:10.1016/0304-3940(94)90571-1 · Cited by 26 · see citing works
Martin, R. F., & Bowden, D. M. (2000) · Cited by 16 · see citing works
Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement
下, 泰. (2002) · Medical Entomology and Zoology · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Dopamine in motivational control: rewarding, aversive, and alerting
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.11.022 · Cited by 2,396 · see citing works
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works
Behavioral Theories and the Neurophysiology of Reward
Schultz, W. (2006) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070229 · Cited by 1,637 · see citing works
Multiple dopamine functions at different time courses
Schultz, W. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.28.061604.135722 · Cited by 1,415 · see citing works
Two types of dopamine neuron distinctly convey positive and negative motivational signals
Matsumoto, M., & Hikosaka, O. (2009) · Nature · doi:10.1038/nature08028 · Cited by 1,378 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · see citing works
Berke, J. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0152-y · Cited by 904 · see citing works
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885 · see citing works
Striatal Dopamine Release Is Triggered by Synchronized Activity in Cholinergic Interneurons
Threlfell, S., Lalic, T., Platt, N. J., Jennings, K. A., Deisseroth, K., & Cragg, S. J. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.038 · Cited by 845 · see citing works
Neuroanatomical and Neurochemical Substrates of Timing
Coull, J. T., Cheng, R., & Meck, W. H. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.113 · Cited by 801 · see citing works
Dissociable dopamine dynamics for learning and motivation
Mohebi, A., Pettibone, J. R., Hamid, A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., Tian, L., Kennedy, R. T., & Berke, J. D. (2019) · Nature · doi:10.1038/s41586-019-1235-y · Cited by 714 · see citing works
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works
Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646 · see citing works
Syringe-injectable electronics
Liu, J., Fu, T.-M., Cheng, Z., Hong, G., Zhou, T., Jin, L., Duvvuri, M., Jiang, Z., Kruskal, P., Xie, C., et al. (2015) · Nature Nanotechnology · doi:10.1038/nnano.2015.115 · Cited by 687 · see citing works
Dopamine signals for reward value and risk: basic and recent data
Schultz, W. (2010) · Behavioral and Brain Functions · doi:10.1186/1744-9081-6-24 · Cited by 653 · see citing works
The basal ganglia: learning new tricks and loving it
Graybiel, A. M. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.006 · Cited by 650 · see citing works
From perception to pleasure: Music and its neural substrates
Zatorre, R. J., & Salimpoor, V. N. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301228110 · Cited by 603 · see citing works
Frank, M. J., & Claus, E. D. (2006) · Psychological Review · doi:10.1037/0033-295x.113.2.300 · Cited by 578 · see citing works
Physiology and pharmacology of striatal neurons
Kreitzer, A. C. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135422 · Cited by 530 · see citing works
Functional diversity and specificity of neostriatal interneurons
Tepper, J. M., & Bolam, J. P. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.10.003 · Cited by 526 · see citing works
Alexander, G. E. (2004) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2004.6.3/galexander · Cited by 522 · see citing works
Cachope, R., Mateo, Y., Mathur, B. N., Irving, J. M., Wang, H., Morales, M., Lovinger, D. M., & Cheer, J. F. (2012) · Cell Reports · doi:10.1016/j.celrep.2012.05.011 · Cited by 519 · see citing works
Wang, Z., Li, K., Day, M., Ronesi, J. A., Yin, H. H., Ding, J., Tkatch, T., Lovinger, D. M., & Surmeier, D. J. (2006) · Neuron · doi:10.1016/j.neuron.2006.04.010 · Cited by 513 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
Self-citationAmbroggi, F., Ishikawa, A., Fields, H. L., & Nicola, S. M. (2008) · Neuron · doi:10.1016/j.neuron.2008.07.004 · Cited by 488 · see citing works
Neural Circuitry of Reward Prediction Error
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031109 · Cited by 437 · see citing works
Thalamic Gating of Corticostriatal Signaling by Cholinergic Interneurons
Ding, J., Guzmán, J. N., Peterson, J. D., Goldberg, J. A., & Surmeier, D. J. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.017 · Cited by 462 · see citing works
The computational neurobiology of learning and reward
Daw, N. D., & Doya, K. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.03.006 · Cited by 462 · see citing works
Re-emergence of striatal cholinergic interneurons in movement disorders
Pisani, A., Bernardi, G., Ding, J., & Surmeier, D. J. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.07.008 · Cited by 466 · see citing works
Pan, W.-X., Schmidt, R., Wickens, J. R., & Hyland, B. I. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1478-05.2005 · Cited by 429 · see citing works
Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision Making
Sul, J. H., Kim, H., Huh, N., Lee, D., & Jung, M. W. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.033 · Cited by 372 · see citing works
The nucleus accumbens as part of a basal ganglia action selection circuit
Nicola, S. M. (2006) · Psychopharmacology · doi:10.1007/s00213-006-0510-4 · Cited by 360 · see citing works
The basal ganglia in Parkinson's disease: Current concepts and unexplained observations
Obeso, J. A., Marin, C., Rodriguez-Oroz, C., Blesa, J., Benitez-Temiño, B., Mena-Segovia, J., Rodríguez, M., & Olanow, C. W. (2009) · Annals of Neurology · doi:10.1002/ana.21481 · Cited by 359 · see citing works
Voon, V., Fernagut, P., Wickens, J. R., Baunez, C., Rodríguez‐Oroz, M., Pavon, N., Juncos, J. L., Obeso, J. A., & Bézard, E. (2009) · The Lancet Neurology · doi:10.1016/s1474-4422(09)70287-x · Cited by 352 · see citing works
Kelley, A. E., Baldo, B. A., & Pratt, W. E. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20769 · Cited by 352 · see citing works
Stocco, A., Lebiere, C. J., & Anderson, J. R. (2010) · Psychological Review · doi:10.1037/a0019077 · Cited by 352 · see citing works
Dautan, D., Huerta-Ocampo, I., Witten, I. B., Deisseroth, K. A., Bolam, J. P., Gerdjikov, T. V., & Mena‐Segovia, J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5071-13.2014 · Cited by 335 · see citing works
Dopamine neurons share common response function for reward prediction error
Eshel, N., Tian, J., Bukwich, M., & Uchida, N. (2016) · Nature Neuroscience · doi:10.1038/nn.4239 · Cited by 306 · see citing works
The temporal precision of reward prediction in dopamine neurons
Fiorillo, C. D., Newsome, W. T., & Schultz, W. (2008) · Nature Neuroscience · doi:10.1038/nn.2159 · Cited by 310 · see citing works
Coupled ripple oscillations between the medial temporal lobe and neocortex retrieve human memory
Vaz, A. P., Inati, S. K., Brunel, N., & Zaghloul, K. A. (2019) · Science · doi:10.1126/science.aau8956 · Cited by 267 · see citing works
GABAergic circuits mediate the reinforcement-related signals of striatal cholinergic interneurons
English, D. F., Ibáñez-Sandoval, O., Stark, E., Tecuapetla, F., Buzsáki, G., Deisseroth, K. A., Tepper, J. M., & Koós, T. Z. (2011) · Nature Neuroscience · doi:10.1038/nn.2984 · Cited by 288 · see citing works
How visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285 · see citing works
Dopamine release in the basal ganglia
Rice, M. E., Patel, J. C., & Cragg, S. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.08.066 · Cited by 281 · see citing works
Acetylcholine–dopamine balance hypothesis in the striatum: An update
Aosaki, T., Miura, M., Suzuki, T., Nishimura, K., & Masuda, M. (2010) · Geriatrics and gerontology international/Geriatrics & gerontology international · doi:10.1111/j.1447-0594.2010.00588.x · Cited by 276 · see citing works
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., & Bergman, H. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3839-08.2008 · Cited by 273 · see citing works
Self-citationWhat is reinforced by phasic dopamine signals?
Redgrave, P., GURNEY, K. N., & Reynolds, J. N. J. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.10.007 · Cited by 254 · see citing works
Attention-Gated Reinforcement Learning of Internal Representations for Classification
Roelfsema, P. R., & van Ooyen, A. (2005) · Neural Computation · doi:10.1162/0899766054615699 · Cited by 258 · see citing works
Wen, C., Ogura, Y., & Matsushima, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00476 · Cited by 262 · see citing works
Reward functions of the basal ganglia
Schultz, W. (2016) · Journal of Neural Transmission · doi:10.1007/s00702-016-1510-0 · Cited by 248 · see citing works
Exley, R. A., & Cragg, S. J. (2007) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707510 · Cited by 249 · see citing works
Fuxé, K., Dahlström, A. B., Höistad, M., Marcellino, D. J., Jansson, A., Rivera, A., Dı́az-Cabiale, Z., Jacobsen, K. R., Tinner, B., Hagman, B., et al. (2007) · Brain Research Reviews · doi:10.1016/j.brainresrev.2007.02.009 · Cited by 247 · see citing works
Meaningful silences: how dopamine listens to the ACh pause
Cragg, S. J. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.01.003 · Cited by 245 · see citing works
Exley, R., Clements, M. A., Hartung, H., McIntosh, J. M., & Cragg, S. J. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301617 · Cited by 242 · see citing works
Neurocomputational models of basal ganglia function in learning, memory and choice
Cohen, M. X., & Frank, M. J. (2008) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.029 · Cited by 238 · see citing works
Tourette Syndrome and Tic Disorders: A Decade of Progress
Swain, J. E., Scahill, L. D., Lombroso, P. J., King, R. A., & Leckman, J. F. (2007) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318068fbcc · Cited by 238 · see citing works
Shen, W., Hamilton, S. E., Nathanson, N. M., & Surmeier, D. J. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.1381-05.2005 · Cited by 237 · see citing works
A hypothesis for basal ganglia-dependent reinforcement learning in the songbird
Fee, M. S., & Goldberg, J. H. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.069 · Cited by 231 · see citing works
Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment
Hamid, A., Frank, M. J., & Moore, C. I. (2021) · Cell · doi:10.1016/j.cell.2021.03.046 · Cited by 213 · see citing works
Role of Striatum in Updating Values of Chosen Actions
Kim, H., Sul, J. H., Huh, N., Lee, D., & Jung, M. W. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.2728-09.2009 · Cited by 225 · see citing works
Threlfell, S., Clements, M. A., Khodai, T., Pienaar, I. S., Exley, R. A., Wess, J., & Cragg, S. J. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.5620-09.2010 · Cited by 224 · see citing works
An action potential initiation mechanism in distal axons for the control of dopamine release
Liu, C., Cai, X., Ritzau-Jost, A., Kramer, P. F., Li, Y., Khaliq, Z. M., Hallermann, S., & Kaeser, P. S. (2022) · Science · doi:10.1126/science.abn0532 · Cited by 213 · see citing works
Corticostriatal projection neurons – dichotomous types and dichotomous functions
Reiner, A. J. (2010) · Frontiers in Neuroanatomy · doi:10.3389/fnana.2010.00142 · Cited by 196 · see citing works
Neurobiological Substrates of Tourette's Disorder
Leckman, J. F., Bloch, M. H., Smith, M. E., Larabi, D. I., & Hampson, M. (2010) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2009.0118 · Cited by 198 · see citing works
Dopamine Signaling in Dorsal Versus Ventral Striatum: The Dynamic Role of Cholinergic Interneurons
Threlfell, S., & Cragg, S. J. (2011) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2011.00011 · Cited by 195 · see citing works
Reappraising striatal D1- and D2-neurons in reward and aversion
Soares‐Cunha, C., Coimbra, B., Sousa, N., & Rodrigues, A. J. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.05.021 · Cited by 190 · see citing works
Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate
Bayer, H. M., Lau, B., & Glimcher, P. W. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01140.2006 · Cited by 184 · see citing works
Guo, Q., Wang, D., He, X., Feng, Q., Lin, R., Xu, F., Fu, L., & Luo, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0123381 · Cited by 186 · see citing works
Reinforcement learning, conditioning, and the brain: Successes and challenges
Maia, T. V. (2009) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.9.4.343 · Cited by 184 · see citing works
Leading tonically active neurons of the striatum from reward detection to context recognition
Apicella, P. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.03.011 · Cited by 186 · see citing works
Local control of striatal dopamine release
Cachope, R., & Cheer, J. F. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00188 · Cited by 183 · see citing works
Puig, M. V., Rose, J., Schmidt, R., & Freund, N. (2014) · Frontiers in Neural Circuits · doi:10.3389/fncir.2014.00093 · Cited by 182 · see citing works
Redgrave, P., Vautrelle, N., & Reynolds, J. N. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.07.060 · Cited by 183 · see citing works
Cholinergic interneurons mediate fast VGluT3-dependent glutamatergic transmission in the striatum
Higley, M. J., Gittis, A. H., Oldenburg, I. A., Balthasar, N., Seal, R. P., Edwards, R. H., Lowell, B. B., Kreitzer, A. C., & Sabatini, B. L. (2011) · PLoS ONE · doi:10.1371/journal.pone.0019155 · Cited by 175 · see citing works
Representation and timing in theories of the dopamine system
Daw, N. D., Courville, A. C., & Touretzky, D. S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1637 · Cited by 173 · see citing works
The Role of Acetylcholine in Cocaine Addiction
Williams, M. J., & Adinoff, B. H. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301585 · Cited by 173 · see citing works
Gonzales, K. K., & Smith, Y. (2015) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12762 · Cited by 164 · see citing works
Pisani, A., Martella, G., Tscherter, A., Bonsi, P., Sharma, N., Bernardi, G., & Standaert, D. G. (2006) · Neurobiology of Disease · doi:10.1016/j.nbd.2006.07.006 · Cited by 166 · see citing works
Wilson, C. J. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.053 · Cited by 163 · see citing works
Mechanisms and regulation of dopamine release
Liu, C., & Kaeser, P. S. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.01.001 · Cited by 162 · see citing works
Exley, R., Maubourguet, N., David, V., Eddine, R., Evrard, A., Pons, S., Marti, F., Threlfell, S., Cazala, P., McIntosh, J. M., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1103000108 · Cited by 159 · see citing works
Temporally Extended Dopamine Responses to Perceptually Demanding Reward-Predictive Stimuli
Nomoto, K., Schultz, W., Watanabe, T., & Sakagami, M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4828-09.2010 · Cited by 158 · see citing works
Di Filippo, M., Picconi, B., Tantucci, M., Ghiglieri, V., Bagetta, V., Sgobio, C., Tozzi, A., Parnetti, L., & Calabresi, P. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.09.025 · Cited by 158 · see citing works
The centromedian nucleus: Anatomy, physiology, and clinical implications
Ilyas, A., Pizarro, D., Romeo, A. K., Riley, K. O., & Pati, S. B. B. (2019) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2019.01.050 · Cited by 155 · see citing works
Dopamine, uncertainty and TD learning
Niv, Y., Duff, M. O., & Dayan, P. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-6 · Cited by 153 · see citing works
Morikawa, H., & Paladini, C. A. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.08.023 · Cited by 150 · see citing works
Akineto-rigid vs. tremor syndromes in Parkinsonism
Zaidel, A., Arkadir, D., Israel, Z. H., & Bergman, H. (2009) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32832d9d67 · Cited by 151 · see citing works
Self-citationMuscarinic modulation of striatal function and circuitry
Goldberg, J. A., Ding, J. B., & Surmeier, D. J. (2012) · Handbook of Experimental Pharmacology · doi:10.1007/978-3-642-23274-9_10 · Cited by 150 · see citing works
Berke, J. D. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.2192-08.2008 · Cited by 149 · see citing works
Distinct Tonic and Phasic Anticipatory Activity in Lateral Habenula and Dopamine Neurons
Bromberg-Martin, E. S., Matsumoto, M., & Hikosaka, O. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.016 · Cited by 146 · see citing works
Shaping of Motor Responses by Incentive Values through the Basal Ganglia
Pasquereau, B., Nadjar, A., Arkadir, D., Bézard, E., Goillandeau, M., Bioulac, B. H., Gross, C. E., & Boraud, T. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.3745-06.2007 · Cited by 146 · see citing works
Self-citationKim, K. M., Baratta, M. V., Yang, A., Lee, D., Boyden, E. S., & Fiorillo, C. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0033612 · Cited by 144 · see citing works
Dopamine and glutamate regulate striatal acetylcholine in decision-making
Chantranupong, L., Beron, C. C., Zimmer, J. A., Wen, M. J., Wang, W., & Sabatini, B. L. (2023) · Nature · doi:10.1038/s41586-023-06492-9 · Cited by 153 · see citing works
Caprioli, D., Vènniro, M., Zhang, M. H., Bossert, J. M., Warren, B. L., Hope, B. T., & Shaham, Y. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.3091-16.2016 · Cited by 143 · see citing works
Goldberg, J. A., & Reynolds, J. N. J. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.08.067 · Cited by 140 · see citing works
Doig, N. M., Magill, P. J., Apicella, P., Bolam, J. P., & Sharott, A. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4627-13.2014 · Cited by 138 · see citing works
Intrinsic dopamine and acetylcholine dynamics in the striatum of mice
Krok, A. C., Maltese, M., Mistry, P. N., Miao, X., Li, Y., & Tritsch, N. X. (2023) · Nature · doi:10.1038/s41586-023-05995-9 · Cited by 144 · see citing works
Recurrent Inhibitory Network among Striatal Cholinergic Interneurons
Sullivan, M. A., Chen, H., & Morikawa, H. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.2411-08.2008 · Cited by 137 · see citing works
Role of Striatal Cholinergic Interneurons in Set-Shifting in the Rat
Aoki, S., Liu, A. W., Zucca, A., Zucca, S., & Wickens, J. R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0490-15.2015 · Cited by 130 · see citing works
- Authors
- Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H.
- Affiliations
- Hebrew University of Jerusalem (IL)
- Corresponding author
- Morris, Genela
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2004-07
- Volume
- 43
- Issue
- 1
- Pages
- 133-143
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2154145851
- Semantic Scholar
- fd94217912e9b183da7428af2af0960f198fcd3c
- Cited by
- 574
- References
- 75
- Citations by year
- 2026: 13 · 2025: 15 · 2024: 11 · 2023: 14 · 2022: 24 · 2021: 21 · 2020: 49 · 2019: 32 · 2018: 24 · 2017: 22 · 2016: 32 · 2015: 31 · 2014: 29 · 2013: 18 · 2012: 20
- FWCI
- 9.83
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Neuron (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- midbrain dopamine, basal ganglia, reward prediction, neuronal synchronization, signal integration
- MeSH terms
- Acetylcholine, Action Potentials, Animals, Behavior, Animal, Dopamine, Female, Interneurons, Learning, Macaca mulatta, Male, Mesencephalon, Neural Pathways, Synaptic Transmission, Neuronal Plasticity, Reaction Time, Reward, Substantia Nigra, Neostriatum
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review