The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
The loss function of sensorimotor learning
Open accessAbstract
Motor learning can be defined as changing performance so as to optimize some function of the task, such as accuracy. The measure of accuracy that is optimized is called a loss function and specifies how the CNS rates the relative success or cost of a particular movement outcome. Models of pointing in sensorimotor control and learning usually assume a quadratic loss function in which the mean squared error is minimized. Here we develop a technique for measuring the loss associated with errors. Subjects were required to perform a task while we experimentally controlled the skewness of the distribution of errors they experienced. Based on the change in the subjects' average performance, we infer the loss function. We show that people use a loss function in which the cost increases approximately quadratically with error for small errors and significantly less than quadratically for large errors. The system is thus robust to outliers. This suggests that models of sensorimotor control and learning that have assumed minimizing squared error are a good approximation but tend to penalize large errors excessively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
Huber, P. J. (1981) · Wiley Series in Probability and Statistics · doi:10.1002/0471725250 · Cited by 7,066
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498
Self-citationLearning of action through adaptive combination of motor primitives
Thoroughman, K. A., & Shadmehr, R. (2000) · Nature · doi:10.1038/35037588 · Cited by 945
Learning to move amid uncertainty
Scheidt, R. A., Dingwell, J. B., & Mussa-Ivaldi, F. A. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.2.971 · Cited by 411
Cited by
Optimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746
“A recent attempt to measure that parameter, in a virtual aiming tas”
BackgroundCausal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069
“We assume that the cost in this estimation process is the mean squared error [43]:”
BackgroundBayesian decision theory in sensorimotor control
Körding, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 867
Self-citationTemporal context calibrates interval timing
Jazayeri, M., & Shadlen, M. N. (2010) · Nature Neuroscience · doi:10.1038/nn.2590 · Cited by 781
Gaussian Processes for Data-Efficient Learning in Robotics and Control
Deisenroth, M. P., Fox, D., & Rasmussen, C. E. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.218 · Cited by 659
Todorov, E., & Li, W. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1469949 · Cited by 611
Patton, J. L., Stoykov, M. E., Kovic, M., & Mussa-Ivaldi, F. A. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0097-8 · Cited by 469
“Several studies have shown how the nervous system can be ''tricked'' by giving altered sensory feedback (Flanagan and Rao 1995; Srinivasan and LaMotte 1995; Robles-De-La-Torre and Hayward 2001; Ernst and Banks 2002; Sainburg et al. 2003; Brewer et al. 2004; Kording and Wolpert 2004a).”
BackgroundBayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436
Relevance of Error: What Drives Motor Adaptation?
Wei, K., & Körding, K. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90545.2008 · Cited by 422
“A previous study on human decision making found that the cost function of sensorimotor learning is insensitive to outliers (Körding and Wolpert 2004).”
BackgroundTodorov, E. (2005) · Neural Computation · doi:10.1162/0899766053491887 · Cited by 398
A Bayesian observer model constrained by efficient coding can explain 'anti-Bayesian' percepts
Wei, X.-X., & Stocker, A. A. (2015) · Nature Neuroscience · doi:10.1038/nn.4105 · Cited by 397
Computational principles of sensorimotor control that minimize uncertainty and variability
Bays, P. M., & Wolpert, D. M. (2007) · The Journal of Physiology · doi:10.1113/jphysiol.2006.120121 · Cited by 359
Self-citationMotor control is decision-making
Wolpert, D. M., & Landy, M. S. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.05.003 · Cited by 336
Self-citationEmken, J. L., & Reinkensmeyer, D. J. (2005) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2004.843173 · Cited by 300
“Consistent with this possibility, Kording and Wolpert [25] recently identified how the motor system calculates the cost of kinematic error in an aiming task, based on the assumption that the motor system minimizes that cost.”
BackgroundBayesian optimization of time perception
Shi, Z., Church, R. M., & Meck, W. H. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.09.009 · Cited by 275
Characteristics of Implicit Sensorimotor Adaptation Revealed by Task-irrelevant Clamped Feedback
Morehead, J. R., Taylor, J. A., Parvin, D. E., & Ivry, R. B. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01108 · Cited by 268
Probabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
Self-citationPetzschner, F. H., Weber, L. A. E., Gard, T., & Stephan, K. E. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2017.05.012 · Cited by 181
Bayes in the Brain—On Bayesian Modelling in Neuroscience
Colombo, M., & Seriès, P. (2012) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axr043 · Cited by 164
Berret, B., Darlot, C., Jean, F., Pozzo, T., Papaxanthis, C., & Gauthier, J. P. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000194 · Cited by 163
A detailed comparison of optimality and simplicity in perceptual decision making.
Shen, S., & Ma, W. J. (2016) · Psychological Review · doi:10.1037/rev0000028 · Cited by 46
Remembering forward: Neural correlates of memory and prediction in human motor adaptation
Scheidt, R. A., Zimbelman, J. L., Salowitz, N. M. G., Suminski, A. J., Mosier, K. M., Houk, J., & Simo, L. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.072 · Cited by 42
(2013) · PubMed · Cited by 21
Metadata
- Authors
- Körding, K. P., & Wolpert, D. M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2004-06-21
- Volume
- 101
- Issue
- 26
- Pages
- 9839-9842
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2160291974
- Cited by
- 191
- References
- 7
- FWCI
- 3.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.