The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Learning from Sensory and Reward Prediction Errors during Motor Adaptation
Open accessAbstract
Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
Internal models for motor control and trajectory planning.
Kawato, M. (1999) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(99)00028-8 · Cited by 2,685
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498
The role of the basal ganglia in habit formation
Yin, H. H., & Knowlton, B. J. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1919 · Cited by 2,402
Computational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717
A computational neuroanatomy for motor control
Shadmehr, R., & Krakauer, J. W. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1280-5 · Cited by 1,187
Self-citationInteracting adaptive processes with different timescales underlie short-term motor learning
Smith, M. A., Ghazizadeh, A., & Shadmehr, R. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040179 · Cited by 1,113 · cited 1×
“adaptation [4,5,11,12,13,14], to our knowledge all current models”
BackgroundMotivational control of goal-directed action
Dickinson, A., & Balleine, B. (1994) · Animal Learning & Behavior · doi:10.3758/bf03199951 · Cited by 995
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Learning of action through adaptive combination of motor primitives
Thoroughman, K. A., & Shadmehr, R. (2000) · Nature · doi:10.1038/35037588 · Cited by 945
Self-citationRepresentation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939
Sensory prediction errors drive cerebellum-dependent adaptation of reaching
Tseng, Y.-W., Diedrichsen, J., Krakauer, J. W., Shadmehr, R., & Bastian, A. J. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00266.2007 · Cited by 883
Self-citationPrediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779
A computational model of four regions of the cerebellum based on feedback-error learning
Kawato, M., & Gomi, H. (1992) · Biological Cybernetics · doi:10.1007/bf00201431 · Cited by 626
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595
Sources of Signal-Dependent Noise During Isometric Force Production
Jones, K. E., Hamilton, A. F. D. C., & Wolpert, D. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1533 · Cited by 562
Fast Perceptual Learning in Visual Hyperacuity
Poggio, T., Fahle, M., & Edelman, S. (1992) · Science · doi:10.1126/science.1589770 · Cited by 540
Smith, M. A., & Shadmehr, R. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00943.2004 · Cited by 497
Self-citationFrank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009) · Nature Neuroscience · doi:10.1038/nn.2342 · Cited by 471
The statistical determinants of adaptation rate in human reaching
Burge, J., Ernst, M. O., & Banks, M. S. (2008) · Journal of Vision · doi:10.1167/8.4.20 · Cited by 400
A central source of movement variability
Churchland, M. M., Afshar, A., & Shenoy, K. V. (2006) · Neuron · doi:10.1016/j.neuron.2006.10.034 · Cited by 393 · cited 1×
“. However, noise is present even in the planning stage of movements”
BackgroundThe dynamics of memory as a consequence of optimal adaptation to a changing body
Kording, K. P., Tenenbaum, J. B., & Shadmehr, R. (2007) · Nature Neuroscience · doi:10.1038/nn1901 · Cited by 393
Self-citationSchönberg, T., Daw, N. D., Joel, D., & O'Doherty, J. P. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2496-07.2007 · Cited by 390
Motor Adaptation as a Process of Reoptimization
Izawa, J., Rane, T., Donchin, O., & Shadmehr, R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.5359-07.2008 · Cited by 347
Self-citationRepresentation of internal models of action in the autistic brain
Haswell, C. C., Izawa, J., Dowell, L. R., Mostofsky, S. H., & Shadmehr, R. (2009) · Nature Neuroscience · doi:10.1038/nn.2356 · Cited by 322
Self-citationEstimating the sources of motor errors for adaptation and generalization
Berniker, M., & Kording, K. (2008) · Nature Neuroscience · doi:10.1038/nn.2229 · Cited by 316
Decision making, movement planning and statistical decision theory
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.010 · Cited by 314
Modulation of saccadic eye movements by predicted reward outcome
Takikawa, Y., Kawagoe, R., Itoh, H., Nakahara, H., & Hikosaka, O. (2002) · Experimental Brain Research · doi:10.1007/s00221-001-0928-1 · Cited by 288
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284
Size of Error Affects Cerebellar Contributions to Motor Learning
Criscimagna-Hemminger, S. E., Bastian, A. J., & Shadmehr, R. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00822.2009 · Cited by 271
Self-citationMotor Learning Is Optimally Tuned to the Properties of Motor Noise
van Beers, R. J. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.025 · Cited by 261
The Cerebellum Updates Predictions about the Visual Consequences of One's Behavior
Synofzik, M., Lindner, A., & Thier, P. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.071 · Cited by 223
Optimal Compensation for Changes in Task-Relevant Movement Variability
Trommershäuser, J., Gepshtein, S., Maloney, L. T., Landy, M. S., & Banks, M. S. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.1906-05.2005 · Cited by 192
Nakahara, H., Doya, K., & Hikosaka, O. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901750363208 · Cited by 191
Gabrieli, J. D. E., Stebbins, G. T., Singh, J., & Willingham, D. B. (1997) · Neuropsychology · doi:10.1037//0894-4105.11.2.272 · Cited by 191
Generalization as a behavioral window to the neural mechanisms of learning internal models
Shadmehr, R. (2004) · Human Movement Science · doi:10.1016/j.humov.2004.04.003 · Cited by 171
Self-citationTanaka, H., Sejnowski, T. J., & Krakauer, J. W. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90834.2008 · Cited by 171
Bayesian Integration in Force Estimation
Kording, K. P., Ku, S.-P., & Wolpert, D. M. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00275.2004 · Cited by 141
Baddeley, R. J., Ingram, H. A., & Miall, R. C. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-07-03066.2003 · Cited by 134
On-Line Processing of Uncertain Information in Visuomotor Control
Izawa, J., & Shadmehr, R. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.3063-08.2008 · Cited by 134
Self-citationLearning and consolidation of visuo-motor adaptation in Parkinson's disease
Marinelli, L., Crupi, D., Di Rocco, A., Bove, M., Eidelberg, D., Abbruzzese, G., & Ghilardi, M. F. (2009) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2008.02.012 · Cited by 129
Synofzik, M., Thier, P., & Lindner, A. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00104.2006 · Cited by 118
Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity
Sing, G. C., Joiner, W. M., Nanayakkara, T., Brayanov, J. B., & Smith, M. A. (2009) · Neuron · doi:10.1016/j.neuron.2009.10.001 · Cited by 118
Bedford, F. L. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01266-2 · Cited by 86
Motor skill learning in Parkinson's disease
Agostino, R., Sanes, J. N., & Hallett, M. (1996) · Journal of the Neurological Sciences · doi:10.1016/0022-510x(96)00060-3 · Cited by 78
Adaptation and generalization in acceleration-dependent force fields
Hwang, E. J., Smith, M. A., & Shadmehr, R. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-0163-2 · Cited by 66
Self-citationBiological arm motion through reinforcement learning
Izawa, J., Kondo, T., & Ito, K. (2004) · Biological Cybernetics · doi:10.1007/s00422-004-0485-3 · Cited by 56
Self-citationLearning Not to Generalize: Modular Adaptation of Visuomotor Gain
Pearson, T. S., Krakauer, J. W., & Mazzoni, P. (2010) · Journal of Neurophysiology · doi:10.1152/jn.01089.2009 · Cited by 52
Cited by
Principles of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391
The basal ganglia and the cerebellum: nodes in an integrated network
Bostan, A. C., & Strick, P. L. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0002-7 · Cited by 786
Explicit and implicit contributions to learning in a sensorimotor adaptation task
Taylor, J. A., Krakauer, J. W., & Ivry, R. B. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3619-13.2014 · Cited by 768
Human sensorimotor learning: adaptation, skill, and beyond
Krakauer, J. W., & Mazzoni, P. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.06.012 · Cited by 558
The Role of Variability in Motor Learning
Dhawale, A. K., Smith, M. A., & Ölveczky, B. P. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031548 · Cited by 516
Metadata
- Authors
- Izawa, J., & Shadmehr, R.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-03-10
- Volume
- 7
- Issue
- 3
- Pages
- e1002012
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2093356961
- Cited by
- 477
- References
- 50
- FWCI
- 12.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.