The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System
Abstract
Optimality principles of biological movement are conceptually appealing and straightforward to formulate. Testing them empirically, however, requires the solution to stochastic optimal control and estimation problems for reasonably realistic models of the motor task and the sensorimotor periphery. Recent studies have highlighted the importance of incorporating biologically plausible noise into such models. Here we extend the linear-quadratic-gaussian framework—currently the only framework where such problems can be solved efficiently—to include control-dependent, state-dependent, and internal noise. Under this extended noise model, we derive a coordinate-descent algorithm guaranteed to converge to a feedback control law and a nonadaptive linear estimator optimal with respect to each other. Numerical simulations indicate that convergence is exponential, local minima do not exist, and the restriction to nonadaptive linear estimators has negligible effects in the control problems of interest. The application of the algorithm is illustrated in the context of reaching movements. A Matlab implementation is available at www.cogsci.ucsd.edu/∼todorov .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Biomechanics and motor control of human movement
(1990) · Choice Reviews Online · doi:10.5860/choice.28-2135 · Cited by 8,451
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
The coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395 · cited 8×
“6.2 Results. Reaching movements are known to have stereotyped bellshaped speed profiles ( Flash & Hogan, 1985 ).”
BackgroundMethodInfluential(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5086 · Cited by 3,515
Optimal feedback control as a theory of motor coordination
Todorov, E., & Jordan, M. I. (2002) · Nature Neuroscience · doi:10.1038/nn963 · Cited by 3,081
Self-citationSignal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498
Optimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746
Self-citationFormation and control of optimal trajectory in human multijoint arm movement
Uno, Y., Kawato, M., & Suzuki, R. (1989) · Biological Cybernetics · doi:10.1007/bf00204593 · Cited by 1,706
Motor-output variability: A theory for the accuracy of rapid motor acts.
Schmidt, R. A. (1979) · Psychological Review · doi:10.1037//0033-295x.86.5.415 · Cited by 1,555
Optimality in human motor performance: Ideal control of rapid aimed movements.
Meyer, D. E., Abrams, R. A., Kornblum, S., Wright, C. E., & Keith Smith, J. E. (1988) · Psychological Review · doi:10.1037/0033-295x.95.3.340 · Cited by 1,406
Dynamic Optimization of Human Walking
Anderson, F. C., & Pandy, M. G. (2001) · Journal of Biomechanical Engineering · doi:10.1115/1.1392310 · Cited by 1,107
Physical principles for economies of skilled movements
Nelson, W. L. (1983) · Biological Cybernetics · doi:10.1007/bf00339982 · Cited by 979
Bayesian decision theory in sensorimotor control
Körding, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 867
Stochastic Control of Partially Observable Systems
Bensoussan, A. (1992) · Cambridge University Press eBooks · doi:10.1017/cbo9780511526503 · Cited by 648
Risk-sensitive optimal control
Whittle, P. J. L. (1990) · Medical Entomology and Zoology · Cited by 641
Todorov, E., & Li, W. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1469949 · Cited by 611
Self-citationSources of Signal-Dependent Noise During Isometric Force Production
Jones, K. E., Hamilton, A. F. D. C., & Wolpert, D. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.2002.88.3.1533 · Cited by 562
ITERATIVE LINEAR QUADRATIC REGULATOR DESIGN FOR NONLINEAR BIOLOGICAL MOVEMENT SYSTEMS
(2004) · Proceedings of the First International Conference on Informatics in Control, Automation and Robotics · doi:10.5220/0001143902220229 · Cited by 543
An optimal control model for analyzing human postural balance
Kuo, A. D. (1995) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.362914 · Cited by 528
Differential dynamic programming
Jacobson, D. H., & Mayne, D. Q. (1970) · CERN Document Server (European Organization for Nuclear Research) · Cited by 521
Motor primitives in vertebrates and invertebrates
Flash, T., & Hochner, B. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.011 · Cited by 508
Studies of human locomotion via optimal programming
Chow, C. K., & Jacobson, D. H. (1971) · Mathematical Biosciences · doi:10.1016/0025-5564(71)90062-9 · Cited by 235
Energy-optimal controls in the mammalian neuromuscular system
Hatze, H., & Buys, J. D. (1977) · Biological Cybernetics · doi:10.1007/bf00357705 · Cited by 216
Stochastic Modelling and Control
Hartley, R. (1986) · Journal of the Operational Research Society · doi:10.1057/jors.1986.158 · Cited by 204
Spatial Organization and Magnitude of Orientation Contrast Interactions in Primate V1
Jones, H. E., Wang, W., & Sillito, A. M. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00403.2001 · Cited by 195
The loss function of sensorimotor learning
Körding, K. P., & Wolpert, D. M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308394101 · Cited by 191
Cosine Tuning Minimizes Motor Errors
Todorov, E. V. (2002) · Neural Computation · doi:10.1162/089976602753712918 · Cited by 119
Self-citationUnderstanding Sensorimotor Feedback through Optimal ControlPreprint
Loeb, G. E., Levine, W. S., & He, J. (1990) · Cold Spring Harbor Symposia on Quantitative Biology · doi:10.1101/sqb.1990.055.01.074 · Cited by 117
A Minimal Intervention Principle for Coordinated Movement
Todorov, E. V., & Jordan, M. I. (2002) · Cited by 106
Self-citationA State-Space Analysis for Reconstruction of Goal-Directed Movements Using Neural Signals
Srinivasan, L., Eden, U. T., Willsky, A. S., & Brown, E. N. (2006) · Neural Computation · doi:10.1162/neco.2006.18.10.2465 · Cited by 84
The variation of hand tremor with force in healthy subjects
Sutton, G. G., & Sykes, K. (1967) · The Journal of Physiology · doi:10.1113/jphysiol.1967.sp008276 · Cited by 72
Computational motor control: feedback and accuracy
Guigon, E., Baraduc, P., & Desmurget, M. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06028.x · Cited by 70
Estimation and control of systems with multiplicative noise via linear matrix inequalities
Li, W., Todorov, E. V., & Skelton, R. E. (2005) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2005.1470231 · Cited by 32
Self-citationA computational description of the organization of human reaching and prehension
Hoff, B. R. (2017) · University of Southern California Digital Library · doi:10.25549/usctheses-c20-170041 · Cited by 25
Optimal estimation of feed-foward-controlled linear systems
Kemere, C. T., & Meng, T. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2005.1416313 · Cited by 23
Studies of goal directed movements
Todrov, E. V. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 17
Cited by
A computational neuroanatomy for motor control
Shadmehr, R., & Krakauer, J. W. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1280-5 · Cited by 1,187
Bayesian decision theory in sensorimotor control
Körding, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 867
Todorov, E., & Li, W. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1469949 · Cited by 611
Self-citationThe coordination of movement: optimal feedback control and beyond
Diedrichsen, J., Shadmehr, R., & Ivry, R. B. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.11.004 · Cited by 577
Motor primitives in vertebrates and invertebrates
Flash, T., & Hochner, B. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.10.011 · Cited by 508
Metadata
- Authors
- Todorov, E.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 2005-05-01
- Volume
- 17
- Issue
- 5
- Pages
- 1084-1108
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2101576232
- Cited by
- 398
- References
- 37
- FWCI
- 4.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.