Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
“This framework has been able to explain quantitative data from human and primate movement”
BackgroundCentral pattern generators for locomotion control in animals and robots: A review
Ijspeert, A. J. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.03.014 · Cited by 1,853
“…now propose that animal motor control is based on the combination of motor primitives, i.e. that complex movements are generated by combining a finite set of simpler elementary movements (Thoroughman & Shadmehr, 2000; Tresch, Saltiel, d'Avella, & Bizzi, 2002; Todorov, 2004; Flash & Hochner, 2005).”
Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors
Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013) · Neural Computation · doi:10.1162/neco_a_00393 · Cited by 1,598
“As a final remark, there is a rich literature on using optimization approaches to generate goal-directed movement (Kawato, 1996; Todorov, 2004), also discussed in some areas of reinforcement learning (Peters & Schaal, 2008; Theodorou, Buchli, & Schaal, 2010).”
MethodAugmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
“The feedback should not force the learner to correct task-irrelevant errors (Liu & Todorov, 2007; Todorov, 2004; Todorov & Jordan, 2002; Wei & Körding, 2009; Wolpert et al., 2011).”
BackgroundMethodInfluentialPrinciples of sensorimotor learning
Wolpert, D. M., Diedrichsen, J., & Flanagan, J. R. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3112 · Cited by 1,391
“32 ), which suggests that the central nervous system sets up feedback controllers that continuously convert sensory inputs into motor outputs, and that these are optimally tuned to the goals of the task by trading off energy consumption with accuracy constraints.”
BackgroundHealth behavior models in the age of mobile interventions: are our theories up to the task?
Riley, W. T., Rivera, D. E., Atienza, A. A., Nilsen, W., Allison, S. M., & Mermelstein, R. (2011) · Translational Behavioral Medicine · doi:10.1007/s13142-011-0021-7 · Cited by 978
Action understanding as inverse planning
Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009) · Cognition · doi:10.1016/j.cognition.2009.07.005 · Cited by 920
“…can model domains and tasks that go well beyond a single agent moving in a simple two-dimensional maze, such as motor action (Körding, 1997; Todorov, 2004), games and other strategic interactions (Filar & Vrieze, 1997; Littman, 1994), and a range of cooperative or communicative activities…”
BackgroundBayesian decision theory in sensorimotor control
Körding, K. P., & Wolpert, D. M. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.003 · Cited by 867
“Optimal feedback control [ 45 ] is a framework for studying such problems.”
Lieder, F., & Griffiths, T. L. (2020) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1900061x · Cited by 892
Sensorimotor Integration in Speech Processing: Computational Basis and Neural Organization
Hickok, G., Houde, J., & Rong, F. (2011) · Neuron · doi:10.1016/j.neuron.2011.01.019 · Cited by 786
“Of late, SFC models have been highly successful at explaining the role of the CNS in nonspeech motor phenomena (Shadmehr and Krakauer, 2008; Todorov, 2004), and an SFC model of speech motor control has recently been proposed (Ventura et al., 2009).”
Toward a New Theory of Motor Synergies
Latash, M. L., Scholz, J. P., & Schöner, G. (2007) · Motor Control · doi:10.1123/mcj.11.3.276 · Cited by 794
“This back-coupling could be viewed as a neural mechanism that performs something akin to Todorov and Jordan's (2002) " minimum intervention " principle.”
BackgroundMethodInfluentialPredictions not commands: Active inference in the motor system
Adams, R. A., Shipp, S., & Friston, K. J. (2013) · Brain Structure and Function · doi:10.1007/s00429-012-0475-5 · Cited by 765
“9).”
Computational Mechanisms of Sensorimotor Control
Franklin, D. W., & Wolpert, D. M. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.006 · Cited by 725
“Many of the concepts we have reviewed are currently being unified with a normative framework (e.g., Berniker and Kording, 2008; Kording et al., 2007a; Mitrovic et al., 2010; Todorov, 2004).”
Shared and specific muscle synergies in natural motor behaviors
d'Avella, A., & Bizzi, E. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500199102 · Cited by 707
Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation
Lebedev, M. A., & Nicolelis, M. A. L. (2017) · Physiological Reviews · doi:10.1152/physrev.00027.2016 · Cited by 653
“Optimal feedback control is yet another popular motor control theory (263, 801, 802).”
BackgroundTemporal structure of motor variability is dynamically regulated and predicts motor learning ability
Wu, H. G., Miyamoto, Y. R., Castro, L. N. G., Ölveczky, B. P., & Smith, M. A. (2014) · Nature Neuroscience · doi:10.1038/nn.3616 · Cited by 675
Changes of mind in decision-making
Resulaj, A., Kiani, R., Wolpert, D. M., & Shadlen, M. N. (2009) · Nature · doi:10.1038/nature08275 · Cited by 678
Inside the brain of an elite athlete: the neural processes that support high achievement in sports
Yarrow, K., Brown, P., & Krakauer, J. W. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2672 · Cited by 637
“In a recent formulation of the computational motor control framework, called optimal feedback contro”
Todorov, E., & Li, W. (2005) · Proceedings of the 2005, American Control Conference, 2005. · doi:10.1109/acc.2005.1469949 · Cited by 611
“Such modeling has proven extremely useful in the study of how the brain controls movement [ 15 ].”
BackgroundMethodSelf-citationProbabilistic brains: knowns and unknowns
Pouget, A., Beck, J. M., Ma, W. J., & Latham, P. E. (2013) · Nature Neuroscience · doi:10.1038/nn.3495 · Cited by 615
Psychological entropy: a framework for understanding uncertainty-related anxiety
Hirsh, J. B., Mar, R. A., & Peterson, J. B. (2012) · Psychological Review · doi:10.1037/a0026767 · Cited by 606
Human sensorimotor learning: adaptation, skill, and beyond
Krakauer, J. W., & Mazzoni, P. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.06.012 · Cited by 558
Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation
Mazzoni, P., Hristova, A., & Krakauer, J. W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0264-07.2007 · Cited by 557
“…in SN is that although PD patients did not show any degradation of accuracy with increasing difficulty, they might exhibit degradation of other trajectory variables, such as curvature and integrated square jerk, known to be optimized quantities in current computational models (Todorov, 2004).”
BackgroundMethodThe Role of Variability in Motor Learning
Dhawale, A. K., Smith, M. A., & Ölveczky, B. P. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031548 · Cited by 516
“…with optimal feedback control theory, which posits that movements are specifically planned and shaped to optimize fidelity in performance (Harris and Wolpert, 1998) and reduce effort (Braun et al., 2009; Izawa and Shadmehr, 2008; Izawa et al., 2008; Todorov, 2004; Todorov and Jordan, 2002).”
Neuromechanics of muscle synergies for posture and movement
Ting, L. H., & McKay, J. L. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.01.002 · Cited by 514
“However, in statistically unlikely conditions, this approximation may be degraded (cf. [ 52]).”
BackgroundOptimizing Compliant, Model-Based Robotic Assistance to Promote Neurorehabilitation
Wolbrecht, E. T., Chan, V., Reinkensmeyer, D. J., & Bobrow, J. E. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2008.918389 · Cited by 506
Understanding sensorimotor adaptation and learning for rehabilitation
Bastian, A. J. (2008) · Current Opinion in Neurology · doi:10.1097/wco.0b013e328315a293 · Cited by 472
A sensorimotor paradigm for Bayesian model selection
Genewein, T., & Braun, D. A. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00291 · Cited by 485
“Two, the prediction of sensory consequences of actions and three, the selection of desirable actions, which builds upon the state estimate as well as the capability to predict consequences (Wolpert and Ghahramani, 2000; Todorov, 2004; Shadmehr et al., 2010; Franklin and Wolpert, 2011).”
BackgroundPrinciples of neural ensemble physiology underlying the operation of brain–machine interfaces
Nicolelis, M. A. L., & Lebedev, M. A. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2653 · Cited by 483
Speech Production as State Feedback Control
Houde, J. F., & Nagarajan, S. S. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00082 · Cited by 463
“…control (SFC) theory to modeling the role of the higher central nervous system (i.e., cortex, the cerebellum, thalamus, and basal ganglia – hereafter referred to as “the CNS”) in motor control (Arbib, 1981; Todorov and Jordan, 2002; Todorov, 2004; Guigon et al., 2008; Shadmehr and Krakauer, 2008).”
BackgroundInfluentialPerformance variability enables adaptive plasticity of ‘crystallized’ adult birdsong
Tumer, E. C., & Brainard, M. S. (2007) · Nature · doi:10.1038/nature06390 · Cited by 448
Goal-directed aiming: Two components but multiple processes.
Elliott, D., Hansen, S., Grierson, L. E. M., Lyons, J., Bennett, S. J., & Hayes, S. J. (2010) · Psychological Bulletin · doi:10.1037/a0020958 · Cited by 415
“For a given aiming situation, the performer must discover the temporal and endpoint characteristics of a set of aiming trajectories that, on average, optimize speed, accuracy, and energy expenditure (Todorov, 2004; Trommershäuser, Gepshtein, Maloney, Landy, & Banks, 2005).”
BackgroundEvidence for the Flexible Sensorimotor Strategies Predicted by Optimal Feedback Control
Liu, D., & Todorov, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1110-06.2007 · Cited by 447
“Here, we show that the optimal feedback control theory that we (Todorov and Jordan, 2002a,b; Todorov, 2004, 2005; Todorov et al., 2005) and others (Meyer et al., 1988; Loeb et al., 1990; Hoff, 1992; Kuo, 1995; Scott, 2004) have pursued affords the flexibility apparent in behavioral data, in…”
BackgroundMethodSelf-citationNeuromechanical Principles Underlying Movement Modularity and Their Implications for Rehabilitation
Ting, L. H., Chiel, H. J., Trumbower, R. D., Allen, J. L., McKay, J. L., Hackney, M. E., & Kesar, T. M. (2015) · Neuron · doi:10.1016/j.neuron.2015.02.042 · Cited by 411
“As motor modules are refined over a lifetime, they may appear objectively optimal based on minimizing movement time, energy, or some other feature of the movement (Todorov and Jordan 2002; Scott 2004; Todorov 2004; Scott 2008; Shadmehr and Krakauer 2008).”
Efficient computation of optimal actions
Todorov, E. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0710743106 · Cited by 417
“Examples include a nervous system generating muscle activations to maximize movement performance (1), a foraging animal deciding which way to turn to maximize food (2), an internet router directing packets to minimize delays (3), an onboard computer controlling a jet engine to minimize fuel consumption (4), and an inv…”
BackgroundSelf-citationTodorov, E. (2005) · Neural Computation · doi:10.1162/0899766053491887 · Cited by 398
“For stochastic partially observable plants such as the musculoskeletal system, however, open-loop approaches yield suboptimal performance (Todorov & Jordan, 2002b; Todorov, 2004).”
BackgroundSelf-citationA central source of movement variability
Churchland, M. M., Afshar, A., & Shenoy, K. V. (2006) · Neuron · doi:10.1016/j.neuron.2006.10.034 · Cited by 393
“…based on efforts to infer optimal strategies of motor control (Hamilton et al., 2004; Hamilton and Wolpert, 2002; Harris, 2004; Harris and Wolpert, 1998; Haruno and Wolpert, 2005; Iguchi et al., 2005; Simmons and Demiris, 2006; Todorov, 2002, 2004; Todorov and Jordan, 2002; van Beers et al., 2002).”
Training recurrent neural networks
Hinton, G. E., & Sutskever, I. (2013) · Cited by 383
A parietal-premotor network for movement intention and motor awareness
Desmurget, M., & Sirigu, A. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.08.001 · Cited by 370
Perception of speech reflects optimal use of probabilistic speech cues
Clayards, M., Tanenhaus, M. K., Aslin, R. N., & Jacobs, R. A. (2008) · Cognition · doi:10.1016/j.cognition.2008.04.004 · Cited by 350
“Ideal observer models are increasingly being applied to perception in many domains and at multiple levels (e.g., Anderson, 1990; Barlow, 1957; Geisler, 1989; Griffiths & Tenenbaum, 2006; Todorov, 2004).”
BackgroundPatterned control of human locomotion
Lacquaniti, F., Ivanenko, Y. P., & Zago, M. (2012) · The Journal of Physiology · doi:10.1113/jphysiol.2011.215137 · Cited by 334
Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control
Manohar, S. G., Chong, T. T.-J., Apps, M. A. J., Batla, A., Stamelou, M., Jarman, P. R., Bhatia, K. P., & Husain, M. (2015) · Current Biology · doi:10.1016/j.cub.2015.05.038 · Cited by 317
Confidence as Bayesian probability: From neural origins to behavior
Meyniel, F., Sigman, M., & Mainen, Z. F. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.039 · Cited by 349
“…out Summary Confidence from Distributions Cue combination (Ernst and Banks, 2002; Ma et al., 2006) and motor control (Kö rding and Wolpert, 2004; Todorov, 2004; Wolpert and Ghahramani, 2000) are examples of behaviors whose optimization requires the use of confidence (inverse uncertainty ) and…”
What is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
Risk-Sensitivity in Sensorimotor Control
Braun, D. A., Nagengast, A. J., & Wolpert, D. M. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00001 · Cited by 325
“Nevertheless, such motor tasks are amenable to theoretical investigation by optimality principles (Todorov, 2004).”
BackgroundDecision-making in sensorimotor control
Gallivan, J. P., Chapman, C. S., Wolpert, D. M., & Flanagan, J. R. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0045-9 · Cited by 304
Resynthesizing behavior through phylogenetic refinement
Cisek, P. (2019) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-019-01760-1 · Cited by 289
“For example, it has been proposed that the human motor system is continuously optimizing, at each moment during movement, a cost function across all possible future paths to the goal state (Todorov, 2004).”
Decision theory: what “should” the nervous system do?
Körding, K. (2007) · Science · doi:10.1126/science.1142998 · Cited by 313
Optimal feedback control and the long-latency stretch response
Pruszynski, J. A., & Scott, S. H. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3041-8 · Cited by 295
“involves the sophisticated manipulation of sensory feedback (Todorov 2004; Todorov and Jordan 2002).”
BackgroundMotor variability in occupational health and performance
Srinivasan, D., & Mathiassen, S. E. (2012) · Clinical Biomechanics · doi:10.1016/j.clinbiomech.2012.08.007 · Cited by 279
“…intervention ’ principle of motor control, implying that deviations from average behaviour are corrected only when they interfere with task goals (Todorov, 2004), was recently supported by another study of a fi nger-force production task using intra-muscular EMG recordings from all seven index fi…”
Internal models direct dragonfly interception steering
Mischiati, M., Lin, H.-T., Herold, P., Imler, E., Olberg, R., & Leonardo, A. (2015) · Nature · doi:10.1038/nature14045 · Cited by 297
Real-Time Optimal Control via Deep Neural Networks: Study on Landing Problems
Sánchez-Sánchez, C., & Izzo, D. (2018) · Journal of Guidance, Control, and Dynamics · doi:10.2514/1.g002357 · Cited by 286
Motor Adaptation as a Greedy Optimization of Error and Effort
Emken, J. L., Benitez, R., Sideris, A., Bobrow, J. E., & Reinkensmeyer, D. J. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01095.2006 · Cited by 256
Tuning pathological brain oscillations with neurofeedback: a systems neuroscience framework
Ros, T., J. Baars, B., Lanius, R. A., & Vuilleumier, P. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.01008 · Cited by 258
Maye, A., Hsieh, C.-H., Sugihara, G., & Brembs, B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000443 · Cited by 271
“The nonlinear mechanisms need still to be influenced by the environment both in a feed-forward form (the sensorimotor link) [7,13,14,72] and by reafferent feedback control (Fig. 7) [ 73 ,74].”
BackgroundThe problem of serial order in behavior: Lashley’s legacy
Rosenbaum, D. A., Cohen, R. G., Jax, S. A., Weiss, D. J., & van der Wel, R. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.04.001 · Cited by 265
“) There has been debate about the minimum jerk principle, but speed profiles of manual positioning movements are broadly consistent with any such optimization principle, which requires, for its implementation, information about initial and final positions (Todorov, 2004).”
BackgroundThermodynamics as a theory of decision-making with information-processing costs
Ortega, P. A., & Braun, D. A. (2013) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2012.0683 · Cited by 255
“Sensorimotor behaviours can often be described by optimality principles that take into account performance criteria such as energy requirements, endpoint accuracy, smoothness of movement trajectories and other task-related criteria [70,71].”
BackgroundHierarchical motor control in mammals and machines
Merel, J., Botvinick, M., & Wayne, G. (2019) · Nature Communications · doi:10.1038/s41467-019-13239-6 · Cited by 274
“An alternative to hand-engineering the low-dimensional control space involves unsupervised learning (or self-supervised learning) of sensorimotor primitives in order to produce a learned low-level controller 11,65 .”
BackgroundMethodSaccades and pursuit: two outcomes of a single sensorimotor process
Orban de Xivry, J., & Lefèvre, P. (2007) · The Journal of Physiology · doi:10.1113/jphysiol.2007.139881 · Cited by 262
“Within this context, saccade triggering can be interpreted as an optimal control problem, similar to the ones solved by the brain in the control of our actions (Harris & Wolpert, 1998; Todorov & Jordan, 2002; Todorov, 2004; Harris & Wolpert, 2006).”
MethodTan, H., Wade, C., & Brown, P. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.3204-15.2016 · Cited by 267
“But how does the motor system gauge whether to rely more on feedforward estimates of the predicted movement outcome or the sensory feedback of the actual outcome of the movement? The relative weight and confidence placed in each source of information has been suggested to be proportional to its reliability (the invers…”
MethodAtypical basic movement kinematics in autism spectrum conditions
Cook, J. L., Blakemore, S.-J., & Press, C. (2013) · Brain · doi:10.1093/brain/awt208 · Cited by 252
“A lack of typical kinematics might be a consequence of peripheral factors (Todorov, 2004) such as abnormal muscle tone in autism (Maurer and Damasio, 1982), or central nervous system (CNS) factors.”
A Neural Basis for Motor Primitives in the Spinal Cord
Hart, C. B., & Giszter, S. F. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5894-08.2010 · Cited by 263
“Modularity could simply represent task structures and/or optimal control outcomes using a redundant limb (Sanger, 1994, 2000; Todorov, 2004; Todorov et al., 2005; Chhabra and Jacobs, 2006).”
BackgroundNeural bases of hand synergies
Santello, M., Baud-Bovy, G., & Jörntell, H. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00023 · Cited by 250
“This finding supports the “principle of minimum intervention” or optimal sensorimotor control (Todorov and Jordan, 2002; Todorov, 2004), hence compatible with the earlier framework of synergies proposed by Bernstein (1967) (see also above-discussed uncontrolled manifold hypothesis).”
BackgroundResultA Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control
Sensinger, J. W., & Dosen, S. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00345 · Cited by 230
“In summary, the theory of optimal feedback control states that humans rely on the following components when controlling movements (Todorov, 2004; Shadmehr and Krakauer, 2008): (1) Costs and rewards: at any time within a motion, there are multiple potential actions.”
BackgroundMethodRapid Motor Responses Are Appropriately Tuned to the Metrics of a Visuospatial Task
Pruszynski, J. A., Kurtzer, I., & Scott, S. H. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90262.2008 · Cited by 230
“Specifically, optimal feedback control posits that the extensive repertoire of behavior exhibited by the volitional motor system is accomplished via intelligent manipulation of sensory feedback (Todorov 2004; Todorov and Jordan 2002).”
BackgroundPezzulo, G., & Levin, M. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2016.0555 · Cited by 233
Computational Motor Control: Redundancy and Invariance
Guigon, E., Baraduc, P., & Desmurget, M. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00290.2006 · Cited by 231
“The central tenet of optimal control is that a unique solution to a problem with infinitely many solutions can be obtained in a principled way (Todorov 2004).”
BackgroundHuman-like driving behaviour emerges from a risk-based driver model
Kolekar, S., de Winter, J., & Abbink, D. (2020) · Nature Communications · doi:10.1038/s41467-020-18353-4 · Cited by 221
Evidence for Composite Cost Functions in Arm Movement Planning: An Inverse Optimal Control Approach
Berret, B., Chiovetto, E., Nori, F., & Pozzo, T. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002183 · Cited by 216
“Decision making in such a motor planning context [48,49] can be essentially driven by optimal control [8].”
Optimal sensorimotor transformations for balance
Lockhart, D. B., & Ting, L. H. (2007) · Nature Neuroscience · doi:10.1038/nn1986 · Cited by 233
“in facilitating interjoint stability and coordination are critical to the implementation of a low-dimensional, hierarchal controller and warrant further stud”
BackgroundBayesian models: the structure of the world, uncertainty, behavior, and the brain
Vilares, I., & Kording, K. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.05965.x · Cited by 214
Convergent models of handedness and brain lateralization
Sainburg, R. L. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01092 · Cited by 221
“Thus, optimality is an important principle for predictive control (Todorov, 2004).”
BackgroundFleming, A., Stafford, N., Huang, S., Hu, X., Ferris, D. P., & Huang, H. (. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac1176 · Cited by 216
“This is because estimation of the actual motor system state (such as limb movement and position) depends not only on the afferent feedback, but also from the stream of efferent movement commands (efference copy) to the residual muscles (figure 3) [109, 112].”
BackgroundReference Trajectory Generation for Rehabilitation Robots: Complementary Limb Motion Estimation
Vallery, H., van Asseldonk, E. H. F., Buss, M., & van der Kooij, H. (2009) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2008.2008278 · Cited by 228
“The important question remains what the “correct” motion is. Although it is possible to generate trajectories for a given task that resemble the average pattern of a healthy subject, e.g., using optimization [ 13 ], such a reference is not tailored to the individual patient and situation.”
BackgroundLearning to be economical: the energy cost of walking tracks motor adaptation
Finley, J. M., Bastian, A. J., & Gottschall, J. S. (2013) · The Journal of Physiology · doi:10.1113/jphysiol.2012.245506 · Cited by 223
“Many theories of motor control suggest that movements are refined so as to minimize energetic cost (Zarrugh et al. 1974; Hatze & Buys, 1977; Alexander, 1997; Todorov, 2004; Emken et al. 2007).”
BackgroundSpecificity of Reflex Adaptation for Task-Relevant Variability
Franklin, D. W., & Wolpert, D. M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4406-08.2008 · Cited by 209
“In addition, optimal feedback control predicts that feedback is controlled to correct for disturbances that affect task success (Todorov and Jordan, 2002; Todorov, 2004; Liu and Todorov, 2007; Scott, 2008).”
Computational Models of Interoception and Body Regulation
Petzschner, F. H., Garfinkel, S. N., Paulus, M. P., Koch, C., & Khalsa, S. S. (2021) · Trends in Neurosciences · doi:10.1016/j.tins.2020.09.012 · Cited by 227
“A number of concrete formulations describe how organisms could learn to transition from their current internal state to the desired state, e.g., by minimizing the overall cost [43,44], maximizing long-term expected rewards [42,45–48] or minimizing surprise about sensory inputs [39,49–51].”
BackgroundInternal models in biological control
McNamee, D., & Wolpert, D. M. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105206 · Cited by 225
“Optimal feedback control (OFC) was introduced [8, 11] in the motor control context in order to provide a normative solution to the “degrees of freedom” problem of motor coordination and, in particular, to develop a broad account of effector covariance structure and motor synergy as a function of…”
BackgroundPineda, J. A. (2008) · Behavioral and Brain Functions · doi:10.1186/1744-9081-4-47 · Cited by 213
Ting, L. H. (2007) · Progress in Brain Research · doi:10.1016/s0079-6123(06)65019-x · Cited by 215
“…transformations are roughly optimal in the sense that they are comparable to solutions derived from optimization techniques (Kuo, 1995, 2005; Todorov and Jordan, 2002; Scott, 2004; Todorov, 2004; Kurtzer et al., 2006), these mappings do not appear to be updated on a rapid trial-by-trial time scale.”
MethodMuscle Coordination Is Habitual Rather than Optimal
de Rugy, A., Loeb, G. E., & Carroll, T. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5792-11.2012 · Cited by 214
“The computational framework of optimal control theory has gained influence as a general theory of motor coordination because it can specify uniquely how behavioral goals should be achieved by minimizing costs such as the effort or variability of movement (Pedotti et al., 1978; Crowninshield and Brand, 1981; Davy and A…”
BackgroundInfluentialAn Optimality Principle Governing Human Walking
Arechavaleta, G., Laumond, J.-P., Hicheur, H., & Berthoz, A. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.915449 · Cited by 219
“Among the developed approaches, differentail geometry (e.g., [Flash and Handzel 2007]) and optimal control (e.g., [Todorov 2004; Jordan and Wolpert 1999]) play today a central role in such researches.”
BackgroundMethodResultInfluentialValero-Cuevas, F. J., Venkadesan, M., & Todorov, E. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90324.2008 · Cited by 218
Self-citationSuzuki, Y., Nomura, T., Casadio, M., & Morasso, P. (2012) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2012.06.019 · Cited by 207
“The UCM obtained as an averaged movement and motor variations from the UCM can be interpreted in the framework of the theory of optimal feedback control, where the optimal control law is, roughly speaking, determined so that it minimizes the movement-trajectory-dependent global cost referred to as the ‘‘cost-to-go’’ n…”
BackgroundMethodInfluentialTodorov, E. (2006) · Bayesian Brain · doi:10.7551/mitpress/1535.003.0018 · Cited by 195
Self-citationProbabilistic models in human sensorimotor control
Wolpert, D. M. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.05.005 · Cited by 212
“Therefore a new framework of optimal feedback control has been developed in which a cost based on both statistics and energy was considered in the presence of SDN (Scott, 2004; Todorov, 2004, 2005).”
BackgroundDeliberation in the Motor System: Reflex Gains Track Evolving Evidence Leading to a Decision
Selen, L. P. J., Shadlen, M. N., & Wolpert, D. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5273-11.2012 · Cited by 207
“Feedback gains, such as long latency reflexes, are key parameters in compu- tational models of sensorimotor control (Todorov and Jordan, 2002; Scott, 2004; Todorov, 2004; Pruszynski et al., 2008).”
BackgroundBraun, D. A., Mehring, C., & Wolpert, D. M. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.031 · Cited by 210
“Such parametric control laws can be used to study movement generation within the framework of optimal feedback control, and have been successful in explaining a wide range of human motor behaviour [55–61].”
BackgroundScott, S. H., & Dukelow, S. P. (2011) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2010.04.0057 · Cited by 205
“Bayesian inference and economic theories provide formal computational frameworks for understanding perceptual and cognitive decision making [7,17–18], and optimal control theory illuminates the flexible nature of the voluntary motor system shaped by evolution and learning [19–20].”
BackgroundRandom change in cortical load representation suggests distinct control of posture and movement
Kurtzer, I., Herter, T. M., & Scott, S. H. (2005) · Nature Neuroscience · doi:10.1038/nn1420 · Cited by 209
Differences in Adaptation Rates after Virtual Surgeries Provide Direct Evidence for Modularity
Berger, D. J., Gentner, R., Edmunds, T., Pai, D. K., & d'Avella, A. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0122-13.2013 · Cited by 205
“However, task constraints and biomechanical demands might also give rise to low-dimensional motor commands independently of modularity (Todorov, 2004; Tresch and Jarc, 2009; Kutch and Valero-Cuevas, 2012) and the observation of low dimensionality does not provide, per se, definitive evidence for modularity.”
BackgroundRedundancy, Self-Motion, and Motor Control
Martin, V., Scholz, J. P., & Schöner, G. (2009) · Neural Computation · doi:10.1162/neco.2008.01-08-698 · Cited by 199
“Principles of stochastic optimal control have been used to provide a very different kind of account for redundancy in which control signals are computed by optimizing an effort functional at each point in time during the movement (Todorov & Jordan, 2002, 2003; Todorov, 2004).”
Do Humans Optimally Exploit Redundancy to Control Step Variability in Walking?
Dingwell, J. B., John, J., & Cusumano, J. P. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000856 · Cited by 194
“Thus, GEM-aware control exploits inherent task redundancy [25,27,28] to simultaneously achieve high task”
BackgroundMethodInfluentialFrom Intention to Action: Motor Cortex and the Control of Reaching Movements
Kalaska, J. F. (2009) · Advances in Experimental Medicine and Biology · doi:10.1007/978-0-387-77064-2_8 · Cited by 197
“An intriguing new perspective comes from recent ‘‘optimal feedback control’’ models (Harris &Wolpert 1998; Todorov & Jordan 2002; Todorov 2004; Scott 2004).”
BackgroundWolpert, D. M., & Ghahramani, Z. (2004) · UCL Discovery (University College London) · Cited by 196
Influence of the behavioral goal and environmental obstacles on rapid feedback responses
Nashed, J. Y., Crevecoeur, F., & Scott, S. H. (2012) · Journal of Neurophysiology · doi:10.1152/jn.01089.2011 · Cited by 182
“Recent motor control theories suggest that online feedback plays an important role in voluntary motor control (Scott 2004; Todorov and Jordan 2002; Todorov 2004).”
BackgroundHuman Sensorimotor Communication: A Theory of Signaling in Online Social Interactions
Pezzulo, G., Donnarumma, F., & Dindo, H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0079876 · Cited by 175
“These limitations can be overcome by introducing in our formulation more detailed action models based on optimal control theory [57,58].”
MethodHuman-in-the-Loop Optimization of Shared Autonomy in Assistive Robotics
Gopinath, D., Jain, S., & Argall, B. D. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2016.2593928 · Cited by 168
“Principles from optimal control theory have been successfully used to account for different aspects of human motor control such as arm trajectory formation, posture control and locomotion [16]–[18].”
Koban, L., Ramamoorthy, A., & Konvalinka, I. (2019) · Social Neuroscience · doi:10.1080/17470919.2017.1400463 · Cited by 180
“Examples include reinforcement learning (Daw, Niv, & Dayan, 2005; Schultz, 2006), sensorimotor control (Todorov, 2004) and perceptual”
Background
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.