Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 101–200 of 1,000
Li, W., & Todorov, E. (2007) · International Journal of Control · doi:10.1080/00207170701364913 · Cited by 178
“It has also provided the most fruitful general framework for constructing models of biological movement (Uno et al. 1989, Harris and Wolpert 1998, Todorov and Jordan 2002, Todorov 2004).”
BackgroundMethodSelf-citationRapid Online Selection between Multiple Motor Plans
Nashed, J. Y., Crevecoeur, F., & Scott, S. H. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3063-13.2014 · Cited by 162
“Optimal control derives a control function that minimizes a cost function expressed in terms of state and control variables of a dynamical system (Bryson and Ho 1975; Todorov and Jordan, 2002; Todorov, 2004).”
Backgroundvan der Kooij, H., & Peterka, R. J. (2011) · Journal of Computational Neuroscience · doi:10.1007/s10827-010-0291-y · Cited by 162
“…velocity, and thus was not one of the commonly used criteria such as minimization of deviation (Harris and Wolpert 1998; van der Kooij et al. 1999; Todorov 2004), jerk (Hogan 1984; Flash and Hogan 1985), rate-of-torque change (Uno et al. 1989), or control effort (van der Kooij et al. 1999; Carver…”
MethodSonification and haptic feedback in addition to visual feedback enhances complex motor task learning
Sigrist, R., Rauter, G., Marchal-Crespo, L., Riener, R., & Wolf, P. (2015) · Experimental Brain Research · doi:10.1007/s00221-014-4167-7 · Cited by 158
“…inducing a dependency, concurrent feedback can also force instantaneous corrections of task-irrelevant errors that appear randomly (Liu and Todorov 2007; Todorov 2004; Todorov and Jordan 2002; Wei and Körding 2009; Wolpert et al. 2011) and originate from noise in the motor system (van Beers 2009).”
BackgroundResource-rational decision making
Bhui, R., Lai, L., & Gershman, S. J. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.02.015 · Cited by 168
The Temporal Evolution of Feedback Gains Rapidly Update to Task Demands
Dimitriou, M., Wolpert, D. M., & Franklin, D. W. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.5669-12.2013 · Cited by 147
“A prominent theory of motor control, termed optimal feedback control (OFC), postulates that the sensorimotor control system produces smooth and adaptable movements by setting the appropriate feedback gains, which vary as a function of time, to the task being performed (Todorov and Jordan, 2002; Scott, 2004; Todorov, 2…”
BackgroundSensorimotor control of standing balance
Forbes, P. A., Chen, A., & Blouin, J. (2018) · Handbook of clinical neurology · doi:10.1016/b978-0-444-63916-5.00004-5 · Cited by 199
Berret, B., Darlot, C., Jean, F., Pozzo, T., Papaxanthis, C., & Gauthier, J. P. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000194 · Cited by 163
“Otherwise the errors are ignored and, thus, variability in taskirrelevant dimensions is allowed [28–30].”
BackgroundMotor equivalent control of the center of mass in response to support surface perturbations
Scholz, J. P., Schöner, G., Hsu, W. L., Jeka, J. J., Horak, F., & Martin, V. (2007) · Experimental Brain Research · doi:10.1007/s00221-006-0848-1 · Cited by 159
“Such updating, which is assumed within stochastic optimal control models (Todorov 2004), can be achieved by providing feedback about the current joint configuration to the postural planning level.”
BackgroundTowards a neurocomputational model of speech production and perception
Kröger, B. J., Kannampuzha, J., & Neuschaefer-Rube, C. (2009) · Speech Communication · doi:10.1016/j.specom.2008.08.002 · Cited by 158
“2006, Saltzman and Munhall 1989; for a general description of goal-directed action units see Sober and Sabes 2003, Todorov 2004, Fadiga and Craighero 2004).”
BackgroundDeep reinforcement learning for modeling human locomotion control in neuromechanical simulation
Song, S., Kidziński, Ł., Peng, X. B., Ong, C., Hicks, J., Levine, S., Atkeson, C. G., & Delp, S. L. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00919-y · Cited by 150
Bril, B., Rein, R., Nonaka, T., Wenban-Smith, F. F., & Dietrich, G. (2010) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0018171 · Cited by 180
“Accordingly, external forces have often been stressed as an essential environmental constraint affecting movement execution, whereas skilled performance is characterized by motor solutions that harness rather than resist external forces (Bernstein, 1996; Demenÿ, 1924; Goldfield, Kay, & Warren, 1993; McGraw, 1932; Todo…”
BackgroundGhilardi, M. F., Moisello, C., Silvestri, G., Ghez, C. P., & Krakauer, J. W. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01138.2007 · Cited by 161
The role of kinematic redundancy in adaptation of reaching
Yang, J.-F., Scholz, J. P., & Latash, M. L. (2006) · Experimental Brain Research · doi:10.1007/s00221-006-0602-8 · Cited by 169
“Such a solution might not require a detailed intrinsic model of the dynamics of the limb‐environment interaction to solve the problem (Martin et al. 2004; see also Guenther and Barreca 1997; Todorov 2004 ).”
BackgroundLillicrap, T. P., & Scott, S. H. (2013) · Neuron · doi:10.1016/j.neuron.2012.10.041 · Cited by 157
Roh, J., Rymer, W. Z., & Beer, R. F. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00006 · Cited by 167
“Muscle synergies are potentially shaped by biomechanical or task constraints, independent of putative neural constraints (Todorov, 2004; Kutch and Valero-Cuevas, 2012).”
BackgroundThe Cerebro-Cerebellum as a Locus of Forward Model: A Review
Tanaka, H., Ishikawa, T., Lee, J., & Kakei, S. (2020) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2020.00019 · Cited by 155
“The optimal feedback control (OFC) model provides a unified framework that integrates diverse computational processes in motor control and motor learning such as the internal forward model, Kalman filter, and feedback control (Todorov and Jordan, 2002; Todorov, 2004).”
BackgroundDounskaia, N. V. (2005) · Experimental Brain Research · doi:10.1007/s00221-005-2339-1 · Cited by 167
“Alternative interpretations, for example position-dependent control (Bizzi et al. 1992; Feldman 1986) and optimal control (see Todorov 2004 for review), view the regulation of inter-segmental dynamics as a byproduct of the control strategies.”
BackgroundWolpert, D. M., & Flanagan, J. R. (2010) · Current Biology · doi:10.1016/j.cub.2010.04.035 · Cited by 181
“Recently, the idea of optimally shaping the control mechanisms to task goals has been formalized in the theoretical framework of optimal feedback control [15] and this has led to a resurgence of interest in feedback control.”
BackgroundNeural substrates of visuomotor learning based on improved feedback control and prediction
Grafton, S. T., Schmitt, P. J., Horn, J. D. V., & Diedrichsen, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.062 · Cited by 161
Bayesian learning theory applied to human cognition
Jacobs, R. A., & Kruschke, J. K. (2011) · WIREs Cognitive Science · doi:10.1002/wcs.80 · Cited by 146
Montie, H. L., Cho, M. S., Holder, L., Liu, Y., Tsvetkov, A. S., Finkbeiner, S., & Merry, D. E. (2009) · Human Molecular Genetics · doi:10.1093/hmg/ddp115 · Cited by 148
Temporal Evolution of “Automatic Gain-Scaling”
Pruszynski, J. A., Kurtzer, I. L., Lillicrap, T., & Scott, S. H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00085.2009 · Cited by 159
How does it feel to act together?
Pacherie, É. (2013) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-013-9329-8 · Cited by 162
“3 Models of motor control are typically based on optimality principles (for a review, see Todorov 2004).”
BackgroundCan modular strategies simplify neural control of multidirectional human locomotion?
Zelik, K. E., Scaleia, V. L., Ivanenko, Y. P., & Lacquaniti, F. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00776.2013 · Cited by 147
“2012) or emerge from optimal control theory (Chhabra and Jacobs 2006; de Rugy et al. 2013; Todorov 2004) rather than reflect tangible modules employed by the neural controller.”
BackgroundNeuromuscular Effects of Shifting the Focus of Attention in a Simple Force Production Task
Lohse, K. R., Sherwood, D. E., & Healy, A. F. (2011) · Journal of Motor Behavior · doi:10.1080/00222895.2011.555436 · Cited by 134
“…Emmerick, Whiting, & Newell, 1992) in the movement by reducing stiffness (through reduced muscle recruitment), which increases variability in task-irrelevant dimensions of the movement pattern in order to improve the movement outcome (Scholz & Schöner, 1999; Todorov, 2004; Todorov & Jordan, 2002).”
BackgroundFederolf, P., Boyer, K. A., & Andriacchi, T. P. (2013) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2013.06.032 · Cited by 144
“, 2007; Schoner, 1995) or the “optimal feedback control theory” (Todorov and Jordan, 2002; Todorov, 2004).”
Kiemel, T., Zhang, Y., & Jeka, J. J. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1013-11.2011 · Cited by 168
“The cost function serves to quantify the task goals for the motor behavior (Todorov, 2004).”
BackgroundReal-time optimal control for irregular asteroid landings using deep neural networks
Cheng, L., Wang, Z., Song, Y. J., & Jiang, F. (2020) · Acta Astronautica · doi:10.1016/j.actaastro.2019.11.039 · Cited by 144
Human Inferences about Sequences: A Minimal Transition Probability Model
Meyniel, F., Maheu, M., & Dehaene, S. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005260 · Cited by 142
“also been put forward by the predictive coding [7,53] and the active inference [46,54] frameworks, and applied, for instance, to motor control [55,56] or reinforcement learning [57].”
MethodConstraints on the Complete Optimization of Human Motion
Glazier, P. S., & Davids, K. (2008) · Sports Medicine · doi:10.2165/00007256-200939010-00002 · Cited by 175
Denève, S., Duhamel, J.-R., & Pouget, A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3985-06.2007 · Cited by 137
“…the nervous system for estimating sensory variables and for optimal motor control (Wolpert et al., 1995a; Kawato, 1999; Desmurget and Grafton, 2000; Mehta and Schaal, 2002; Todorov, 2004; Saunders and Knill, 2005), but very little is known about the neural implementation of these internal models.”
BackgroundVisuomotor feedback gains upregulate during the learning of novel dynamics
Franklin, S., Wolpert, D. M., & Franklin, D. W. (2012) · Journal of Neurophysiology · doi:10.1152/jn.01123.2011 · Cited by 150
Learning-Based Control: A Tutorial and Some Recent Results
Jiang, Z., Bian, T., & Weinan, G. (2020) · Foundations and Trends® in Systems and Control · doi:10.1561/2600000023 · Cited by 153
A Model of Reward- and Effort-Based Optimal Decision Making and Motor Control
Rigoux, L., & Guigon, E. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002716 · Cited by 129
“for any time tM[t0;tf], where L is a function which generally penalizes large controls (effort) and deviations from a goal state (error; see [92] for a review).”
BackgroundA synergy-based hand control is encoded in human motor cortical areas
Leo, A., Handjaras, G., Bianchi, M., Marino, H., Gabiccini, M., Guidi, A., Scilingo, E. P., Pietrini, P., Bicchi, A., Santello, M., et al. (2016) · eLife · doi:10.7554/elife.13420 · Cited by 133
“DOI: 10.7554/eLife.13420 1 of 32 Todorov and Jordan, 2002; Todorov, 2004), further studies have favored an alternative solution based on linear dimensionality reduction strategies or motor synergies (Latash, 2010).”
BackgroundInfluentialKistemaker, D. A., van Soest, A., Wong, J. D., Kurtzer, I. L., & Gribble, P. L. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00751.2012 · Cited by 151
“It could also be open-loop muscle activations produced by (a combination of) forward and inverse neural models (e.g., Kawato 1999; Kawato and Wolpert 1998; Todorov 2004).”
BackgroundA neurological view on reactive human stance control
Mergner, T. (2010) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2010.08.001 · Cited by 143
Sartori, M., Maculan, M., Pizzolato, C., Reggiani, M., & Farina, D. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00989.2014 · Cited by 140
Skill and motor control: intelligence all the way down
Fridland, E. (2016) · Philosophical Studies · doi:10.1007/s11098-016-0771-7 · Cited by 134
Dosen, S., Markovic, M., Strbac, M., Belic, M., Kojic, V., Bijelic, G., Keller, T., & Farina, D. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2550864 · Cited by 121
“state estimation and optimal and predictive control [38], [39], and these abilities are likely to fundamentally impact the performance of prosthetic control as well.”
BackgroundThe formation of trajectories during goal‐oriented locomotion in humans. I. A stereotyped behaviour
Hicheur, H., Pham, Q., Arechavaleta, G., Laumond, J., & Berthoz, A. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05836.x · Cited by 129
“cost functions were systematically used in computational approaches of movement learning and control (Todorov, 2004).”
MethodMental representation and motor imagery training
Schack, T., Essig, K., Frank, C., & Koester, D. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00328 · Cited by 140
The cortical computations underlying feedback control in vocal production
Houde, J. F., & Chang, E. F. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.04.006 · Cited by 140
“Our SFC model is derived from the general state feedback control framework used in optimal feedback control (OFC) models of motor behavior [5, 6, 10, 23, 24].”
MethodThe role of attention in motor control.
Lohse, K. R., Jones, M., Healy, A. F., & Sherwood, D. E. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0032817 · Cited by 126
“An important contribution of the present work is that it helps to tie cognitive variables such as attention to theories of motor control founded on rational analysis and optimal control theory (Diedrichsen, Shadmehr, & Ivry, 2010; Todorov, 2004; Todorov & Jordan, 2002).”
InfluentialCharacterization of Compensatory Trunk Movements During Prosthetic Upper Limb Reaching Tasks
Metzger, A. J., Dromerick, A. W., Holley, R. J., & Lum, P. S. (2012) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2012.03.011 · Cited by 128
Eye movements in the wild: Oculomotor control, gaze behavior & frames of reference
Lappi, O. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.06.006 · Cited by 139
Control of Human Limb Movements: The Leading Joint Hypothesis and Its Practical Applications
Dounskaia, N. V. (2010) · Exercise and Sport Sciences Reviews · doi:10.1097/jes.0b013e3181f45194 · Cited by 125
“According to the optimal control approach, neural commands to the muscles are a result of the CNS’s solving a problem of optimization of a specific cost function, such as muscle energy expenditure, movement time, accuracy, smoothness, and others (30).”
BackgroundTodorov, E., Li, W., & Pan, X. (2005) · Journal of Robotic Systems · doi:10.1002/rob.20093 · Cited by 128
Self-citationParallel specification of competing sensorimotor control policies for alternative action options
Gallivan, J. P., Logan, L., Wolpert, D. M., & Flanagan, J. R. (2016) · Nature Neuroscience · doi:10.1038/nn.4214 · Cited by 124
Statistical method for prediction of gait kinematics with Gaussian process regression
Yun, Y., Kim, H.-C., Shin, S. Y., Lee, J.-W., Deshpande, A. D., & Kim, C.-H. (2013) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2013.09.032 · Cited by 129
“The choice of cost function affects the results significantly and it is a topic of ongoing scientific debate (Todorov, 2004).”
BackgroundOptimal Control Predicts Human Performance on Objects with Internal Degrees of Freedom
Nagengast, A. J., Braun, D. A., & Wolpert, D. M. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000419 · Cited by 122
“General principles of human movements have since emerged from this framework such as the minimum-intervention principle [7].”
BackgroundOptimal variable stiffness control: formulation and application to explosive movement tasks
Braun, D. J., Howard, M., & Vijayakumar, S. (2012) · Autonomous Robots · doi:10.1007/s10514-012-9302-3 · Cited by 128
“, u ∈ R, m > n) in a system dependent and task specific way (Todorov 2004).”
BackgroundInfluentialComputational Models for Neuromuscular Function
Valero‐Cuevas, F. J., Hoffmann, H., Kurse, M. U., Kutch, J. J., & Theodorou, E. A. (2009) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2009.2034981 · Cited by 130
“The influential work by [191] established the minimal intervention principle in the context of optimal control.”
BackgroundMethodAre muscle synergies useful for neural control?
de Rugy, A., Loeb, G. E., & Carroll, T. J. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00019 · Cited by 135
“…muscle synergy hypothesis arise from the inherent principles of optimal control, highlighting the obvious possibility that synergy might just be a by-product of an alternate control scheme rather than a control principle in itself (Todorov, 2004; Chhabra and Jacobs, 2006; Diedrichsen et al., 2010).”
BackgroundResultInfluentialSoft Materials and Devices Enabling Sensorimotor Functions in Soft Robots
Su, J., He, K., Li, Y., Tu, J., & Chen, X. (2025) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00906 · Cited by 124
Inverse Optimal Control with Linearly-Solvable MDPs
Dvijotham, K., & Todorov, E. V. (2010) · Cited by 118
Self-citationSigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Journal of Motor Behavior · doi:10.1080/00222895.2013.826169 · Cited by 130
“We assume that, instead, concurrent feedback designs forced the correction of task-irrelevant errors as observed by others (Liu & Todorov, 2007; Todorov, 2004; Todorov & Jordan, 2002; Wei & Körding, 2009; Wolpert, Diedrichsen, & Flanagan, 2011).”
Impact of Time on Quality of Motor Control of the Paretic Upper Limb After Stroke
van Kordelaar, J., van Wegen, E. E. H., & Kwakkel, G. (2013) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2013.10.006 · Cited by 131
Shanechi, M. M., Orsborn, A. L., & Carmena, J. M. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004730 · Cited by 113
“This choice is also motivated by recent motor control studies that have suggested infinite-horizon models [44–46] as a possible alternative to the finite-horizon ones [40, 41].”
BackgroundChanges in Performance Monitoring During Sensorimotor Adaptation
Anguera, J. A., Seidler, R. D., & Gehring, W. J. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00063.2009 · Cited by 109
The Central Nervous System Does Not Minimize Energy Cost in Arm Movements
Kistemaker, D. A., Wong, J. D., & Gribble, P. L. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00483.2010 · Cited by 119
The Lombard Effect: From Acoustics to Neural Mechanisms
Luo, J., Hage, S. R., & Moss, C. F. (2018) · Trends in Neurosciences · doi:10.1016/j.tins.2018.07.011 · Cited by 122
Bruton, M. R., & O’Dwyer, N. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00052.2018 · Cited by 122
“Feedback control laws solve redundancy from moment to moment and are operational in the absence of adequate time for sensory feed-back, depending instead on internal forward models (Todorov 2004).”
BackgroundInfluentialLearning Optimal Adaptation Strategies in Unpredictable Motor Tasks
Braun, D. A., Aertsen, A., Wolpert, D. M., & Mehring, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3075-08.2009 · Cited by 110
“Thus, once learning has taken place and stable motor responses have formed, complex motor behaviors can often be understood by simple optimality principles that trade off attributes such as task success and energy expenditure (Todorov, 2004).”
BackgroundWelch, T. D. J., & Ting, L. H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90775.2008 · Cited by 124
“…that muscles across the body appear to be modulated by a common set of variables related to CoM kinematics is consistent with a low-dimensional, hierarchal feedback control law (Todorov 2004), where task-level variables modulate the activity of muscle synergies (Ting 2007; Ting and McKay 2007).”
ResultOptimizing walking controllers for uncertain inputs and environments
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778810 · Cited by 113
Moisello, C., Crupi, D., Tunik, E., Quartarone, A., Bove, M., Tononi, G., & Ghilardi, M. F. (2009) · Experimental Brain Research · doi:10.1007/s00221-008-1681-5 · Cited by 107
“In other words, when possible, the motor system seems to shift from a time-saving, but energy-costly strategy as in unpredictable reaction time tasks, to a preferable energy-saving strategy, as in predictable timed-response tasks (Todorov 2004).”
MacNeilage, P. R., Ganesan, N., & Angelaki, D. E. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90677.2008 · Cited by 118
“Kalman filters have often been used to model state estimation problems faced by the nervous system (Todorov 2004; Wolpert and Gharamani 2000).”
MethodBattaglia, P. W., & Schrater, P. R. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.1309-07.2007 · Cited by 108
“, 2006), internal motor output variability representations (Harris and Wolpert, 1998; Todorov and Jordan, 2002; Todorov, 2004), and selection of gainmaximizing actions (Schrater and Kersten, 2000; Trommershäuser et al.”
BackgroundBasic and supplementary sensory feedback in handwriting
Danna, J., & Velay, J.-L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00169 · Cited by 94
“Indeed, the Optimal feedback control model (for a review, see Todorov, 2004) suggests that the central nervous system sets up FB controllers that continuously convert sensory inputs into motor outputs, and that these are optimally tuned to the goals of the task by trading off energy consumption…”
BackgroundTerrier, P., & Dériaz, O. (2012) · Human Movement Science · doi:10.1016/j.humov.2012.05.004 · Cited by 109
Direction-dependent arm kinematics reveal optimal integration of gravity cues
Gaveau, J., Berret, B., Angelaki, D. E., & Papaxanthis, C. (2016) · eLife · doi:10.7554/elife.16394 · Cited by 105
“…sensor and effector dynamics, as well as physical laws of motion, to optimally interact with the external environment (Shadmehr and Mussa-Ivaldi, 1994; Conditt et al., 1997; Gribble and Ostry, 1999; Wolpert and Ghahramani, 2000; Pigeon et al., 2003; Todorov, 2004; Ahmed et al., 2008; Scott, 2012).”
BackgroundMethodMachens, C. K. (2012) · Science · doi:10.1126/science.1231865 · Cited by 111
Fine, M. S., & Thoroughman, K. A. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00215.2006 · Cited by 109
“To investigate trial-by-trial behavior we applied pulses infrequently, and therefore we could not test for the possibility that pulses induced changes in the feedback response (Burdet et al. 2001; Todorov 2004).”
Stability of hand force production. I. Hand level control variables and multifinger synergies
Reschechtko, S., & Latash, M. L. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00485.2017 · Cited by 105
“…been suggested for ensuring such variance patterns, including computational schemes based on ideas of optimal feedback control (Diedrichsen et al. 2010; Todorov 2004; Todorov and Jordan 2002) and physiological schemes assuming tunable back-coupling loops (Latash et al. 2005; Martin et al. 2009).”
BackgroundElephants evolved strategies reducing the biomechanical complexity of their trunk
Dagenais, P., Hensman, S., Haechler, V., & Milinkovitch, M. C. (2021) · Current Biology · doi:10.1016/j.cub.2021.08.029 · Cited by 116
Coordinate Dependence of Variability Analysis
Sternad, D., Park, S., Müller, H., & Hogan, N. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000751 · Cited by 102
“The same feature can be generated by a stochastic optimal feedback control strategy [16,17] which has been proposed as a theory of CNS control.”
BackgroundThe role of cocontraction in the impairment of movement accuracy with fatigue
Missenard, O., Mottet, D., & Perrey, S. (2008) · Experimental Brain Research · doi:10.1007/s00221-007-1264-x · Cited by 102
“For instance, Todorov (2004) proposed that motor behaviour arises from the simultaneous minimization of an error cost (task performance) and an effort cost (energy expenditure).”
BackgroundSpinal stretch reflexes support efficient hand control
Weiler, J., Gribble, P. L., & Pruszynski, J. A. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0336-0 · Cited by 101
Pham, Q., Hicheur, H., Arechavaleta, G., Laumond, J., & Berthoz, A. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05835.x · Cited by 107
“Optimization theory is an appealing framework as it is related to the possibility that the sensorimotor system is the product of processes such as evolution, development, learning or adaptation that continuously act to improve behavioural performance (Todorov, 2004).”
BackgroundLeg Dominance Effects on Postural Control When Performing Challenging Balance Exercises
Promsri, A., Haid, T. H., Werner, I., & Federolf, P. (2020) · Brain Sciences · doi:10.3390/brainsci10030128 · Cited by 114
Safavynia, S. A., & Ting, L. H. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00653.2011 · Cited by 110
“It has been proposed that the nervous system could make use of sensory feedback to estimate the body’s state and achieve a desired movement trajectory through low-dimensional control (Todorov 2004).”
BackgroundIntegration of auditory and somatosensory error signals in the neural control of speech movements
Feng, Y., Gracco, V. L., & Max, L. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00638.2010 · Cited by 108
“In this broader theoretical framework (Scott 2002, 2004; Todorov 2004; Todorov and Jordan 2002), an optimal feedback controller maps movement goals into motor commands by means of an internal inverse model, and a state estimator applies Bayesian optimal integration of actual sensory feedback, sensory consequences pred…”
BackgroundYoo, S. B. M., Hayden, B. Y., & Pearson, J. M. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2019.0664 · Cited by 115
“In fact, many classic RL problems like cart-pole or learning to walk are control problems [56,60,61].”
BackgroundBallanger, B., Thobois, S., Baraduc, P., Turner, R. S., Broussolle, E., & Desmurget, M. (2006) · Movement Disorders · doi:10.1002/mds.20987 · Cited by 103
Why Don't We Move Slower? The Value of Time in the Neural Control of Action
Berret, B., & Jean, F. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.1921-15.2016 · Cited by 109
“the general assumption that biological movement is optimal with respect to some cost function (Engelbrecht, 2001; Todorov, 2004).”
BackgroundThe potential of corticomuscular and intermuscular coherence for research on human motor control
Boonstra, T. W. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00855 · Cited by 102
“The possibility that the CNS produces movement through the flexible combination of groups of muscles, or muscle synergies, has received much attention (Todorov, 2004; Tresch and Jarc, 2009).”
BackgroundGait Trajectory and Gait Phase Prediction Based on an LSTM Network
Su, B., & Gutierrez-Farewik, E. M. (2020) · Sensors · doi:10.3390/s20247127 · Cited by 90
“Furthermore, while the choice of cost function affects simulation results significantly, its formulation still remains a topic of ongoing scientific debate [8], particularly for persons with a gait pathology.”
BackgroundTerrain-adaptive bipedal locomotion control
Wu, J.-C., & Popović, Z. (2010) · ACM Transactions on Graphics · doi:10.1145/1778765.1778809 · Cited by 95
Fast reinforcement learning with generalized policy updates
Barreto, A., Hou, S., Borsa, D., Silver, D., & Precup, D. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1907370117 · Cited by 78
Neuromotor Noise, Error Tolerance and Velocity-Dependent Costs in Skilled Performance
Sternad, D., Abe, M., Hu, X., & Müller, H. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002159 · Cited by 102
“Interestingly, this structured variability is also the consequence of the optimization of control cost in the optimal feedback control models [13].”
BackgroundGeneration of Variants of a Motor Act in a Modular and Hierarchical Motor Network
Jing, J., & Weiss, K. R. (2005) · Current Biology · doi:10.1016/j.cub.2005.08.051 · Cited by 98
Optimal Integration of Gravity in Trajectory Planning of Vertical Pointing Movements
Crevecoeur, F., Thonnard, J., & Lefèvre, P. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00113.2009 · Cited by 96
Flint, R. D., Scheid, M. R., Wright, Z. A., Solla, S. A., & Slutzky, M. W. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2339-15.2016 · Cited by 95
“The principle predicts low variability in the task-relevant space and higher variability in the task-null space, a phenomenon that can be explained by optimal feedback control (Todorov, 2004) among other models (Martin et al.”
BackgroundInteractional leader–follower sensorimotor communication strategies during repetitive joint actions
Candidi, M., Curioni, A., Donnarumma, F., Sacheli, L. M., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.0644 · Cited by 92
“For example, the objective of optimal control is providing control signals that prescribe trajectories that are optimal in relation to some cost function [60].”
BackgroundRisk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
Nagengast, A. J., Braun, D. A., & Wolpert, D. M. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000857 · Cited by 90
“Previous studies have used risk-neutral optimal control models to explain a wide-range of movement phenomena [17,18].”
BackgroundGoble, J. A., Zhang, Y., Shimansky, Y. P., Sharma, S., & Dounskaia, N. V. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00582.2007 · Cited by 90
“Optimal control modeling has often considered movement trajectories from the perspectives of a minimization of muscle energy (see Todorov 2004 for review).”
BackgroundBrain anatomical networks in world class gymnasts: A DTI tractography study
Wang, B., Fan, Y., Lü, M., Li, S., Song, Z., Peng, X., Zhang, R., Lin, Q., He, Y., Wang, J., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.10.007 · Cited by 99
“The sensorimotor system has been demonstrated to be the central module in the human brain network (He et al., 2009) and plays an important role in behavioral performance (Todorov, 2004).”
BackgroundNature of Motor Control: Perspectives and Issues
Turvey, M. T., & Fonseca, S. T. (2008) · Advances in experimental medicine and biology · doi:10.1007/978-0-387-77064-2_6 · Cited by 107
“The implementation entails ill-defined processes of inverse kinematics and inverse kinetics addressed, theoretically, through conceptions from control theory and biomechanics (Hollerbach, 1990a, 1990b; Todorov, 2004).”
Method
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.