Beyond reward prediction errors: the role of dopamine in movement kinematics
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
We recorded activity of dopamine (DA) neurons in the substantia nigra pars compacta in unrestrained mice while monitoring their movements with video tracking. Our approach allows an unbiased examination of the continuous relationship between single unit activity and behavior. Although DA neurons show characteristic burst firing following cue or reward presentation, as previously reported, their activity can be explained by the representation of actual movement kinematics. Unlike neighboring pars reticulata GABAergic output neurons, which can represent vector components of position, DA neurons represent vector components of velocity or acceleration. We found neurons related to movements in four directions-up, down, left, right. For horizontal movements, there is significant lateralization of neurons: the left nigra contains more rightward neurons, whereas the right nigra contains more leftward neurons. The relationship between DA activity and movement kinematics was found on both appetitive trials using sucrose and aversive trials using air puff, showing that these neurons belong to a velocity control circuit that can be used for any number of purposes, whether to seek reward or to avoid harm. In support of this conclusion, mimicry of the phasic activation of DA neurons with selective optogenetic stimulation could also generate movements. Contrary to the popular hypothesis that DA neurons encode reward prediction errors, our results suggest that nigrostriatal DA plays an essential role in controlling the kinematics of voluntary movements. We hypothesize that DA signaling implements gain adjustment for adaptive transition control, and describe a new model of the basal ganglia (BG) in which DA functions to adjust the gain of the transition controller. This model has significant implications for our understanding of movement disorders implicating DA and the BG.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genome-wide atlas of gene expression in the adult mouse brain
Lein, E. S., Hawrylycz, M. J., Ao, N., Ayres, M., Bensinger, A., Bernard, A., Boe, A. F., Boguski, M. S., Brockway, K. S., Byrnes, E. J., et al. (2007) · Nature · doi:10.1038/nature05453 · Cited by 5,572
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Primate models of movement disorders of basal ganglia origin
DeLong, M. R. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90110-v · Cited by 3,824
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081 · cited 1×
“To understand the hierarchical control model, it is important to grasp the fundamental difference between this model and traditional models that purport to use closed loop control (Todorov and Jordan, 2002).”
BackgroundMountcastle, V. B., Lynch, J. C., Georgopoulos, A., Sakata, H., & Acuna, C. (1975) · Journal of Neurophysiology · doi:10.1152/jn.1975.38.4.871 · Cited by 2,061
Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry
Kravitz, A. V., Freeze, B. S., Parker, P. R. L., Kay, K., Thwin, M. T., Deisseroth, K., & Kreitzer, A. C. (2010) · Nature · doi:10.1038/nature09159 · Cited by 1,885 · cited 1×
“This is not surprising since the striatum is the major target of DA projection, and stimulation of the DA neurons or of their targets in the striatum can elicit movements (Ferrier, 1876; Kravitz et al., 2010; Rossi et al., 2015).”
BackgroundHaber, S. N., Fudge, J. L., & McFarland, N. R. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-06-02369.2000 · Cited by 1,610 · cited 1×
“Haber and colleagues observed that the nigral output disinhibits a region of the SNc that send DA projections to the origin of the striatonigral projections as well as neighboring regions, forming a striatonigrostriatal loop (Haber et al., 2000).”
BackgroundA toolbox of Cre-dependent optogenetic transgenic mice for light-induced activation and silencing
Madisen, L., Mao, T., Koch, H., Zhuo, J.-M., Berenyi, A., Fujisawa, S., Hsu, Y.-W. A., Garcia, A. J., Gu, X., Zanella, S., et al. (2012) · Nature Neuroscience · doi:10.1038/nn.3078 · Cited by 1,398
Neuron-type-specific signals for reward and punishment in the ventral tegmental area
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., & Uchida, N. (2012) · Nature · doi:10.1038/nature10754 · Cited by 1,318
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03095.x · Cited by 1,226
Self-citationTonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 1×
“The role of DA in scaling performance has long been noted and emphasized by another class of ideas, e.g., DA is thought to reduce sensorimotor threshold (White, 1986), or increase “response vigor” (Niv et al., 2007), or bias action selection (McClure et al., 2003; Roesch et al., 2007).”
BackgroundThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
Self-citationResponses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill
Yin, H. H., Mulcare, S. P., Hilário, M. R. F., Clouse, E., Holloway, T., Davis, M. I., Hansson, A. C., Lovinger, D. M., & Costa, R. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2261 · Cited by 818
Self-citationRoesch, M. R., Calu, D. J., & Schoenbaum, G. (2007) · Nature Neuroscience · doi:10.1038/nn2013 · Cited by 597
Construction of implantable optical fibers for long-term optogenetic manipulation of neural circuits
Sparta, D. R., Stamatakis, A. M., Phillips, J. L., Hovelsø, N., van Zessen, R., & Stuber, G. D. (2012) · Nature Protocols · doi:10.1038/nprot.2011.413 · Cited by 394
Romo, R., & Schultz, W. (1990) · Journal of Neurophysiology · doi:10.1152/jn.1990.63.3.592 · Cited by 353 · cited 4×
“…Durham, NC 27708, USA hy43@duke.edu Received: 12 April 2015 Accepted: 06 May 2015 Published: 27 May 2015 Citation: Barter JW, Li S, Lu D, Bartholomew RA, Rossi MA, Shoemaker CT, Salas-Meza D, Gaidis E and Yin HH (2015) Beyond reward prediction errors: the role of dopamine in movement kinematics.”
BackgroundInfluentialHow visual stimuli activate dopaminergic neurons at short latency
Dommett, E., Coizet, V., Blaha, C. D., Martindale, J., Lefebvre, V., Walton, N., Mayhew, J. E. W., Overton, P. G., & Redgrave, P. (2005) · Science · doi:10.1126/science.1107026 · Cited by 285 · cited 1×
“…are behavioral outputs generated to restore the desired inputs dictated by lower level reference signals, for position, muscle length, tension, etc. Interestingly, artificially induced position error signals from deep layer tectal neurons can also activate DA neurons (Dommett et al., 2005).”
BackgroundCannon, C. M., & Palmiter, R. D. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-34-10827.2003 · Cited by 280 · cited 2×
“…substantia nigra, basal ganglia, movement, reward prediction error, striatum Introduction The role of dopamine (DA) in behavior has remained controversial despite decades of research (Cannon and Palmiter, 2003; Cagniard et al., 2006; Jin and Costa, 2010; Leblois et al., 2010; Rossi et al., 2013a).”
BackgroundThe phasic reward signal of primate dopamine neurons
Schultz, W. (1997) · Advances in Pharmacology · doi:10.1016/s1054-3589(08)60841-8 · Cited by 169
A Wireless Multi-Channel Recording System for Freely Behaving Mice and Rats
Fan, D., Rich, D., Holtzman, T., Ruther, P., Dalley, J. W., Lopez, A., Rossi, M. A., Barter, J. W., Salas-Meza, D., Herwik, S., et al. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022033 · Cited by 143
Self-citationThe activity of pars compacta neurons of the monkey substantia nigra in relation to motor activation
Schultz, W., Ruffieux, A., & Aebischer, P. (1983) · Experimental Brain Research · doi:10.1007/bf00237874 · Cited by 136 · cited 2×
“…Durham, NC 27708, USA hy43@duke.edu Received: 12 April 2015 Accepted: 06 May 2015 Published: 27 May 2015 Citation: Barter JW, Li S, Lu D, Bartholomew RA, Rossi MA, Shoemaker CT, Salas-Meza D, Gaidis E and Yin HH (2015) Beyond reward prediction errors: the role of dopamine in movement kinematics.”
BackgroundOperant self-stimulation of dopamine neurons in the substantia nigra
Rossi, M. A., Sukharnikova, T., Hayrapetyan, V. Y., Yang, L., & Yin, H. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065799 · Cited by 119 · cited 7×
“Indeed, in recent studies we also observed the type of short latency phasic responses in SNr GABA neurons, identified using similar criteria as the present study (Fan et al., 2012; Rossi et al., 2013a).”
BackgroundResultInfluentialSelf-citationWang, D. V., & Tsien, J. Z. (2011) · PLoS ONE · doi:10.1371/journal.pone.0017047 · Cited by 116 · cited 1×
“…University, Genome Sciences Research Building II, 103 Research Drive, Box 91050, Durham, NC 27708, USA hy43@duke.edu Received: 12 April 2015 Accepted: 06 May 2015 Published: 27 May 2015 Citation: Barter JW, Li S, Lu D, Bartholomew RA, Rossi MA, Shoemaker CT, Salas-Meza D, Gaidis E and Yin…”
White, N. M. (1986) · Neuroscience & Biobehavioral Reviews · doi:10.1016/0149-7634(86)90030-8 · Cited by 79 · cited 1×
“The role of DA in scaling performance has long been noted and emphasized by another class of ideas, e.g., DA is thought to reduce sensorimotor threshold (White, 1986), or increase “response vigor” (Niv et al., 2007), or bias action selection (McClure et al., 2003; Roesch et al., 2007).”
Background
Cited by
Dopamine neuron activity before action initiation gates and invigorates future movements
da Silva, J. A., Tecuapetla, F., Paixão, V., & Costa, R. M. (2018) · Nature · doi:10.1038/nature25457 · Cited by 623
Rapid signalling in distinct dopaminergic axons during locomotion and reward
Howe, M. W., & Dombeck, D. A. (2016) · Nature · doi:10.1038/nature18942 · Cited by 602
Striatal circuits for reward learning and decision-making
Cox, J., & Witten, I. B. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0189-2 · Cited by 568
Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
Engelhard, B., Finkelstein, J., Cox, J., Fleming, W., Jang, H. J., Ornelas, S., Koay, S. A., Thiberge, S. Y., Daw, N. D., Tank, D. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1261-9 · Cited by 544
What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation
Klaus, A., Alves da Silva, J., & Costa, R. M. (2019) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031033 · Cited by 284
Metadata
- Authors
- Barter, J. W., Li, S., Lu, D., Bartholomew, R. A., Rossi, M. A., Shoemaker, C. T., Salas-Meza, D., Gaidis, E., & Yin, H. H.
- Venue
- Frontiers in Integrative Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2015-05-27
- Volume
- 9
- Pages
- 39-39
- ISSN
- 1662-5145 (ISSN-L)
- OpenAlex
- W1596586683
- Cited by
- 147
- References
- 25
- FWCI
- 4.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.