Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 401–500 of 1,000
Deciphering the functional role of spatial and temporal muscle synergies in whole-body movements
Delis, I., Hilt, P. M., Pozzo, T., Panzeri, S., & Berret, B. (2018) · Scientific Reports · doi:10.1038/s41598-018-26780-z · Cited by 53
Neuroscience out of control: control-theoretic perspectives on neural circuit dynamics
Kao, T.-C., & Hennequin, G. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.09.001 · Cited by 58
“Control theory has long been applied to study motor control [64, 65], providing insights into the computational and algorithmic principles of internal models [66], error-corrective feedback [67], and planning [68].”
BackgroundEmbodied skillful performance: where the action is
Hipólito, I., Baltieri, M., Friston, K. J., & Ramstead, M. J. D. (2021) · Synthese · doi:10.1007/s11229-020-02986-5 · Cited by 55
“The applications of the LQG framework in optimal motor control are ubiquitous, but often only implicit, with a few major exceptions more directly advocating its use in cognitive (neuro)science (Todorov and Jordan 2002; Todorov 2004; McNamee and Wolpert 2019).”
BackgroundMethodOptimal Control of Natural Eye-Head Movements Minimizes the Impact of Noise
Sağlam, M., Lehnen, N., & Glasauer, S. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.3721-11.2011 · Cited by 48
Kimura, A., Yokozawa, T., & Ozaki, H. (2021) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2021.753062 · Cited by 55
“The presence of this control strategy has also been supported theoretically (Todorov and Jordan, 2002; Todorov, 2004; Diedrichsen, 2007; Liu and Todorov, 2007); the optimal feedback control model proposed by Todorov and Jordan (2002) does not act to correct movements in directions that have no…”
Humans plan for the near future to walk economically on uneven terrain
Darici, O., & Kuo, A. D. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2211405120 · Cited by 52
“We treat the overall reasoning as tantamount to a central nervous system internal model (27) of walking that enables planning for economy.”
BackgroundAutomatically discovering ordinary differential equations from data with sparse regression
Egan, K., Li, W., & Carvalho, R. (2024) · Communications Physics · doi:10.1038/s42005-023-01516-2 · Cited by 62
Gaudez, C., Gilles, M. A., & Savin, J. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2015.08.014 · Cited by 51
Analytical Study of Perceptual and Motor Transparency in Bilateral Teleoperation
Nisky, I., Mussa-Ivaldi, F. A., & Karniel, A. (2013) · IEEE Transactions on Human-Machine Systems · doi:10.1109/tsmc.2013.2284487 · Cited by 51
“ries in human motor control employ optimality principles [69].”
BackgroundBogadhi, A. R., Montagnini, A., & Masson, G. S. (2013) · Journal of Vision · doi:10.1167/13.13.5 · Cited by 49
The continuous end-state comfort effect: weighted integration of multiple biases
Herbort, O., & Butz, M. V. (2011) · Psychological Research · doi:10.1007/s00426-011-0334-7 · Cited by 50
“A prominent approach to explain motor behavior is the optimal control framework (Engelbrecht 2001; Flash and Hogan 1985; Harris and Wolpert 1998; Todorov 2004; Wolpert and Ghahramani 2000).”
BackgroundPhysiological properties of brain-machine interface input signals
Slutzky, M. W., & Flint, R. D. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00070.2017 · Cited by 46
“This principle accounts for the simultaneous observation of highly accurate control of movements in a particular task with substantial trial-to-trial variability in the way the limb or body moves while achieving the task goal (Todorov 2004).”
BackgroundDesmurget, M., Richard, N., Beuriat, P.-A., Szathmári, A., Mottolèse, C., Duhamel, J., & Sirigu, A. (2018) · Current Biology · doi:10.1016/j.cub.2018.08.027 · Cited by 47
Nordin, A. D., & Dufek, J. S. (2019) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2019.1576837 · Cited by 52
“The Uncontrolled Manifold Hypothesis provides a conceptual framework for the anisotropic nature of movement variability, explained by the minimal intervention principle (Diedrichsen et al., 2010; Lohse et al., 2014; Todorov, 2004).”
BackgroundInfluentialComplex Unconstrained Three-Dimensional Hand Movement and Constant Equi-Affine Speed
Maoz, U., Berthoz, A., & Flash, T. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90702.2008 · Cited by 46
“Yet another model, based on stochastic optimal feedback control, stresses the role of closed-loop sensorimotor integration, while allowing trial-by-trial variability in task-irrelevant dimensions of the movement (Braun and Wolpert 2007; Guigon et al. 2007; Todorov 2004; Todorov and Jordan 2002).”
BackgroundThaler, L., & Goodale, M. A. (2011) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2011.00092 · Cited by 53
“In recent years advancements have been made in understanding the neural and computational basis of pointing and reaching movements that are directed at visual targets (for reviews see for example Desmurget et al., 1998; Lacquaniti and Caminiti, 1998; Kawato, 1999; Desmurget and Grafton, 2000; Todorov, 2004; Buneo and…”
BackgroundPremotor Correlates of Integrated Feedback Control for Eye–Head Gaze Shifts
Sylvestre, P. A., & Cullen, K. E. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.4099-05.2006 · Cited by 47
“The concept of optimal feedback control has provided an interesting explanation for variable yet successful control of limb movement (for review, see Todorov, 2004).”
BackgroundBeyond rambling and trembling: effects of visual feedback on slow postural drift
Yamagata, M., Popow, M., & Latash, M. L. (2019) · Experimental Brain Research · doi:10.1007/s00221-019-05470-w · Cited by 47
“Note that, unlike other applications of optimization principles in motor control (Prilutsky and Zatsiorsky 2002; Todorov 2004; Diedrichsen et al.”
BackgroundOptimal speech motor control and token-to-token variability: a Bayesian modeling approach
Patri, J.-F., Diard, J., & Perrier, P. (2015) · Biological Cybernetics · doi:10.1007/s00422-015-0664-4 · Cited by 55
“In that sense, most optimal motor control models have been successful in accounting for average patterns of behavior at the expense of not being able to model trial-to-trial variability (see Todorov (2004) for a review).”
BackgroundLuque, N. R., Garrido, J. A., Carrillo, R. R., D'Angelo, E. U., & Ros, E. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00097 · Cited by 52
“…in task-space coordinates, then translate them into intrinsic-body coordinates, and then finally, generate the appropriate motor commands to achieve theses transitions (Houk et al., 1996; Nakano et al., 1999; Todorov, 2004; Hwang and Shadmehr, 2005; Izawa et al., 2012; Passot et al., 2013).”
BackgroundAdaptation of motor behavior to preserve task success in the presence of muscle fatigue
Missenard, O., Mottet, D., & Perrey, S. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.03.062 · Cited by 55
“This position validates the idea that task goals can be quantified as cost functions, and that computational tools of optimal control can be applied to obtain predictions of motor behaviour (Todorov, 2004).”
BackgroundA neural implementation model of feedback-based motor learning
Feulner, B., Perich, M. G., Miller, L. E., Clopath, C., & Gallego, J. Á. (2025) · Nature Communications · doi:10.1038/s41467-024-54738-5 · Cited by 53
“4E, F), but this is to be expected from a robust controller 79 , especially if the feedback is delayed.”
Adaptability of stride-to-stride control of stepping movements in human walking
Bohnsack, N. K., Cusumano, J. P., & Dingwell, J. B. (2015) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2015.12.010 · Cited by 53
“Common optimality principles, like minimizing energetic cost (Kuo, 2001; Srinivasan and Ruina, 2006), predict average behavior (Collins, 1995; Scott, 2004), but not the variability of repeated movements (Körding and Wolpert, 2004; Todorov, 2004; Stein et al., 2005; Faisal et al., 2008), like walking (Winter, 1984; Hau…”
BackgroundDistributed Cerebellar Motor Learning: A Spike-Timing-Dependent Plasticity Model
Luque, N. R., Garrido, J. A., Naveros, F., Carrillo, R. R., D'Angelo, E. U., & Ros, E. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00017 · Cited by 50
“Frontiers in Computational Neuroscience | www.frontiersin.org 9 March 2016 | Volume 10 | Article 17 Todorov, 2004; Hwang and Shadmehr, 2005; Izawa et al., 2012; Passot et al., 2013).”
BackgroundBerret, B., & Jean, F. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007414 · Cited by 53
“Optimal control theory is a leading framework for understanding biological motor behavior in computational terms [1–4].”
Berret, B., Conessa, A., Schweighofer, N., & Burdet, E. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009047 · Cited by 52
Wu, H. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3155369 · Cited by 45
“This methodology assumes that human behavior can be described by an optimal control model [8]–[10] with an unknown cost function.”
MethodGrand challenges of brain computer interfaces in the years to come
Vaadia, E. (2009) · Frontiers in Neuroscience · doi:10.3389/neuro.01.015.2009 · Cited by 44
“The first steps in theories, regarding the principles of brain function that are most relevant to neuroprosthetics, come from computational sensorimotor control (Kawato, 1999; Shadmehr and Krakauer, 2008; Todorov, 2004; Wolpert and Ghahramani 2000).”
BackgroundForce variability is mostly not motor noise: Theoretical implications for motor control
Nagamori, A., Laine, C. M., Loeb, G. E., & Valero‐Cuevas, F. J. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008707 · Cited by 51
“Under this theoretical framework, observed kinematics and its variability reflect the performance limitation imposed by the motor system [6, 18] attempting to minimize the deleterious effects of ‘motor noise’ on behavior [12, 17].”
BackgroundMethodInfluentialVisuomotor robustness is based on integration not segregation
Schenk, T. (2010) · Vision Research · doi:10.1016/j.visres.2010.08.013 · Cited by 48
Adaptive learning of human motor behaviors: An evolving inverse optimal control approach
El-Hussieny, H., Abouelsoud, A. A., Assal, S. F. M., & Megahed, S. M. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.024 · Cited by 47
Does the Motor System Need Intermittent Control?
Loram, I. D., van de Kamp, C., Lakie, M., Gollee, H., & Gawthrop, P. J. (2014) · Exercise and Sport Sciences Reviews · doi:10.1249/jes.0000000000000018 · Cited by 50
“1B), in which task level goals influence fast continuous feedback loops, is in principle appropriate for modulating the complex mapping of multiple sensory inputs to multiple motor outputs organized in a functional modular manner including synergies, motor primitives, and pattern generators (31,32).”
BackgroundMethodInfluentialOptimal Control of a Hybrid Rhythmic-Discrete Task: The Bouncing Ball Revisited
Ronsse, R., Wei, K., & Sternad, D. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00600.2009 · Cited by 47
“Unlike our present approach, most studies that combined experimental data with modeling focused on unimanual and bimanual reaching (Diedrichsen 2007; Diedrichsen and Gush 2009; Liu and Todorov 2007; Todorov 2004, 2005; Todorov and Jordan 2002).”
MethodResultWhere Do You Think You're Going?: Inferring Beliefs about Dynamics from BehaviorPreprint
Reddy, S., Dragan, A. D., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08010 · Cited by 82
“Humans leverage internal models of the world for motor control [53, 30, 14, 34, 49], goal-directed decision making [7], and representing the mental states of other agents [39].”
BackgroundBrain–Machine Interfaces: Closed-Loop Control in an Adaptive System
Sorrell, E., Rule, M. E., & O’Leary, T. (2021) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-061720-012348 · Cited by 49
Cerebellarlike Corrective Model Inference Engine for Manipulation Tasks
Luque, N. R., Garrido, J. A., Carrillo, R. R., Coenen, O. J. M. D., & Ros, E. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2138693 · Cited by 43
A preferred pattern of joint coordination during arm movements with redundant degrees of freedom
Dounskaia, N. V., & Wang, W. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00082.2014 · Cited by 47
Motor invariants in action execution and perception
Torricelli, F., Tomassini, A., Pezzulo, G., Pozzo, T., Fadiga, L., & D’Ausilio, A. (2022) · Physics of Life Reviews · doi:10.1016/j.plrev.2022.11.003 · Cited by 54
Vestibular and cerebellar contribution to gaze optimality
Sağlam, M., Glasauer, S., & Lehnen, N. (2014) · Brain · doi:10.1093/brain/awu006 · Cited by 44
“In addition to movement kinematics, accuracy also plays a role in optimality (Todorov, 2004).”
BackgroundPredictive Simulation of Reaching Moving Targets Using Nonlinear Model Predictive Control
Mehrabi, N., Razavian, R. S., Ghannadi, B., & McPhee, J. (2017) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00143 · Cited by 49
“However, during conscious voluntary movements, the CNS has to continuously update the motor commands to correct for errors (Todorov, 2004).”
BackgroundThe role of conjunctive representations in prioritizing and selecting planned actions
Kikumoto, A., Mayr, U., & Badre, D. (2022) · eLife · doi:10.7554/elife.80153 · Cited by 37
“(Todorov 2004; McNamee and Wolpert 2019), prioritization and selection operate on conjunctive representations that minimally defines relevant task states and response”
Roos, P. E., & Dingwell, J. B. (2011) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2011.03.003 · Cited by 42
“The step width controller applied in our 3D walking model is consistent with a feedback controller that followed a ‘‘Minimum Intervention Principle’’ approach (Todorov, 2004; Dingwell et al., 2010), where active control was applied primarily in the medio-lateral direction where the model was unstable, while anterior–p…”
Model-Based Approaches to Active Perception and Control
Pezzulo, G., Donnarumma, F., Iodice, P., Maisto, D., & Stoianov, I. (2017) · Entropy · doi:10.3390/e19060266 · Cited by 45
“At the same time, the control schemes that are nowadays most used in computational neuroscience, such as optimal control [60,61] and active inference [62–66], include two notions that are at least “suspect” from the 4-Es perspective.”
BackgroundDounskaia, N. V., Goble, J. A., & Wang, W. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00630.2010 · Cited by 47
A neuromuscular model featuring co-activation for use in driver simulation
Hoult, W., & Cole, D. J. (2008) · Vehicle System Dynamics · doi:10.1080/00423110801935798 · Cited by 42
“Control strategies that take into account metabolic energy cost have been shown to produce realistic biomechanic behavioural predictions [4].”
BackgroundA FAST AND EFFICIENT MODEL FOR LEARNING TO REACH
Sun, G., & Scassellati, B. M. (2005) · International Journal of Humanoid Robotics · doi:10.1142/s0219843605000569 · Cited by 42
Manifold reaching paradigm: how do we handle target redundancy?
Berret, B., Chiovetto, E., Nori, F., & Pozzo, T. (2011) · Journal of Neurophysiology · doi:10.1152/jn.01063.2010 · Cited by 45
“Optimal control theory was proven to be successful in predicting many features of point-to-point reaching movements (see Engelbrecht 2001; Todorov 2004 for reviews).”
BackgroundOptimal control for biological movement systems
Li, W. (2006) · eScholarship (California Digital Library) · Cited by 56
Passive Model-Predictive Impedance Control for Safe Physical Human–Robot Interaction
Cao, R., Cheng, L., & Li, H. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3275217 · Cited by 41
“Somestudies show that the brain has an internal model of the environment and its own body, and uses this model to compute the optimal control inputs that minimize a cost function that reflects the task goals and constraints [19], [20].”
MethodWei, Y., Marshall, A. G., McGlone, F. P., Makdani, A. D., Zhu, Y., Yan, L., Ren, L., & Wei, G. (2024) · Nature Communications · doi:10.1038/s41467-024-50616-2 · Cited by 49
“The muscle synergy neural activation level was regarded as the outputofthesensorimotorcontrollingstrategy,whereastheinputwas the 2nd order afferent tactile signals 49,50 .”
The Neuronal Basis of Long-Term Sensorimotor Learning
Mandelblat-Cerf, Y., Novick, I., Paz, R., Link, Y., Freeman, S., & Vaadia, E. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.4055-10.2011 · Cited by 47
“Assuming that the brain attempts to minimize some cost function during adaptation (Todorov and Jordan, 2002; Todorov, 2004), it is likely that these changes, which reduce the total muscle activation, are cost effective and facilitate optimization of the motor plan.”
BackgroundIterative path integral stochastic optimal control: theory and applications to motor control
Theodorou, E. A. (2011) · University of Southern California Digital Library · doi:10.25549/usctheses-m3804 · Cited by 58
Eye-hand coordination during flexible manual interception of an abruptly appearing, moving target
Li, Y., Wang, Y., & Cui, H. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00476.2017 · Cited by 41
“It has been proposed that compensating for these inherent delays relies on sensory predictions of up-to- date states (Körding and Wolpert 2004; Nijhawan 1994; Sabes 2000; Todorov 2004) and forward models of upcoming movements (Scott 2012; Wolpert et al. 1995).”
BackgroundRethinking Margin of Stability: Incorporating Step-To-Step Regulation to Resolve the Paradox
Kazanski, M. E., Cusumano, J. P., & Dingwell, J. B. (2021) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2022.111334 · Cited by 45
Stuit, S., Cass, J., Paffen, C. L. E., & Alais, D. (2009) · Journal of Vision · doi:10.1167/9.11.7 · Cited by 41
End-state comfort and joint configuration variance during reaching
Solnik, S., Pažin, N., Coelho, C. J., Rosenbaum, D. Α., Scholz, J. P., Zatsiorsky, V. M., & Latash, M. L. (2013) · Experimental Brain Research · doi:10.1007/s00221-012-3383-2 · Cited by 41
“A recent series of studies (Park et al. 2010, 2011, 2012) suggests that optimization processes (cf. Seif-Naraghi and Winters 1990; Todorov 2004) may be used to identify the center of a family of acceptable solutions, while the shape of the distribution reflects stabilization of certain performance…”
Biomechanical capabilities influence postural control strategies in the cat hindlimb
McKay, J. L., Burkholder, T. J., & Ting, L. H. (2006) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2006.10.013 · Cited by 41
“While total force generated by all four limbs must oppose the perturbation direction, the nervous system is free to choose single limb force directions that may optimize arbitrary criteria (cf., Crowninshield and Brand, 1981; Kaya et al., 2006; Harris and Wolpert, 1998; Todorov, 2004; Scott, 2004).”
BackgroundA Gesture-Based Concept for Speech Movement Control in Articulatory Speech Synthesis
Kröger, B. J., & Birkholz, P. (2007) · Springer eBooks · doi:10.1007/978-3-540-76442-7_16 · Cited by 41
“…control of biological systems in general - not only for speech movement control, but also for nonverbal gestures like eye-brow movements as well as for head, arm, and other (speech-accompanying) body movements (Sober und Sabes 2003, Todorov 2004, Paine und Tani 2004, Fadiga und Craihgero 2004).”
BackgroundDysmetria and errors in predictions: the role of internal forward model
Cabaraux, P., Gandini, J., Kakei, S., Manto, M., Mitoma, H., & Tanaka, H. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21186900 · Cited by 40
“This type of controller is often termed as an internal feedback controller because not the actual sensory feedback signal, but the internal prediction from a forward model drives the feedback controller [31].”
BackgroundCodol, O., Michaels, J. A., Kashefi, M., Pruszynski, J. A., & Gribble, P. L. (2024) · eLife · doi:10.7554/elife.88591 · Cited by 44
“…( Feldman and Levin, 1995 ; Flanagan et al., 1993 ; Gribble and Ostry, 2000 ; Won and Hogan, 1995 ), optimal control ( Shadmehr and Krakauer, 2008 ; Todorov, 2004 ), and parallel distributed processing models ( Fetz, 1993 ; Gomi and Kawato, 1993 ; Jordan and Rumelhart, 1992 ; Lillicrap and Scott,…”
BackgroundOptimality principles in spacecraft neural guidance and control
Izzo, D., Blazquez, E., Ferede, R., Origer, S., Wagter, C. D., & de Croon, G. (2024) · Science Robotics · doi:10.1126/scirobotics.adi6421 · Cited by 45
“It is loosely inspired by models that interpret sensorimotor action in humans in terms of optimal control theory ( 4 ), thus suggesting how optimality principles, in the mathematical sense, are deeply embedded directly in the neuro-musculo-skeletal system.”
BackgroundMarineau, E., Ducas, J., Mathieu, J., Pano-Rodríguez, Á., Descarreaux, M., & Abboud, J. (2024) · Scandinavian Journal of Medicine and Science in Sports · doi:10.1111/sms.14706 · Cited by 40
Gilet, E., Diard, J., & Bessìère, P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020387 · Cited by 40
“This would result in fixed produced trajectories [37], except that, in BAP, another source of variability exists, ‘‘upstream’’ of trajectory generation and execution.”
BackgroundInfluentialPredictive Communication Quality Control in Haptic Teleoperation With Time Delay and Packet Loss
Rank, M., Shi, Z., Müller, H. J., & Hirche, S. (2016) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2016.2519608 · Cited by 40
“Considering humans’ natural energy-saving behavior [42], the task completion time tcom achievable for a control strategy using similar energy levels is lower when accelerating the low compared with the high inertia.”
BackgroundInverse Reinforcement Learning for Identification in Linear-Quadratic Dynamic Games
Köpf, F., Inga, J., Rothfuß, S., Flad, M., & Hohmann, S. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.2537 · Cited by 40
MKK3 modulates JNK-dependent cell migration and invasion
Sun, Y., Zhang, D., Guo, X., Li, W., Li, C.-L. F., Luo, J., Zhou, M., & Xue, L. (2019) · Cell Death and Disease · doi:10.1038/s41419-019-1350-6 · Cited by 45
Autonomous functional movements in a tendon-driven limb via limited experience
Marjaninejad, A., Urbina-Meléndez, D., Cohn, B. A., & Valero‐Cuevas, F. J. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0029-0 · Cited by 42
Optimization of energy and time predicts dynamic speeds for human walking
Carlisle, R. E., & Kuo, A. D. (2023) · eLife · doi:10.7554/elife.81939 · Cited by 42
“Such models have long been proposed to explain humans predict and adapt their movement trajectories, for example to novel dynamics ( Todorov, 2004 ).”
Acquiring musculoskeletal skills with curriculum-based reinforcement learning
Chiappa, A. S., Tano, P., Patel, N., Ingster, A., Pouget, A., & Mathis, A. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.002 · Cited by 55
Keenan, K. G., Santos, V. J., Madhusudhan Venkadesan, A., & Valero‐Cuevas, F. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0853-09.2009 · Cited by 39
Human motion segmentation using cost weights recovered from inverse optimal control
Lin, J. F.-S., Bonnet, V., Panchea, A. M., Ramdani, N., Venture, G., & Kulić, D. (2016) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2016.7803409 · Cited by 39
“Previous studies [4] show that different cost functions are used for different movements.”
BackgroundTsiantis, N., Balsa‐Canto, E., & Banga, J. R. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty139 · Cited by 47
“…molecu ar and cell biology phenomena, up to the levels of organs, individuals,populations and their evolution (McFarland, 1977; Smith, 1978; Schaffer, 1983; Parkeret al., 1990; Alexander, 1996; Popescu, 1998; Sutherland, 2005; Dekel and Alon, 2005; Todorov, 2004; Friston, 2010; de Voset al., 2013).”
Performance Monitoring for Sensorimotor Confidence: A Visuomotor Tracking Study
Locke, S. M., Mamassian, P., & Landy, M. S. (2019) · Cognition · doi:10.1016/j.cognition.2020.104396 · Cited by 40
Posterior parietal cortex predicts upcoming movement in dynamic sensorimotor control
Li, Y., Wang, Y., & Cui, H. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2118903119 · Cited by 43
Biologically Guided Driver Modeling: the Stop Behavior of Human Car Drivers
Lio, M. D., Mazzalai, A., GURNEY, K. N., & Saroldi, A. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2751526 · Cited by 43
Healthy and dystonic children compensate for changes in motor variability
Chu, V. W., Sternad, D., & Sanger, T. D. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00908.2012 · Cited by 41
“More recently, several studies on movement control have provided evidence that subjects choose movement strategies that minimize the cost of execution variability (Cohen and Sternad 2009; Harris and Wolpert 1998; Liu and Todorov 2007; Miyamoto et al. 2004; Müller and Sternad 2009; Scholz and Schöner 1999; Scholz et al…”
BackgroundPersonalized kinematics for human-robot collaborative manipulation
Bestick, A., Burden, S. A., Willits, G., Naikal, N., Sastry, S., & Bajcsy, R. K. (2015) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353498 · Cited by 38
“For the kinematic model of Section II-A the state is given by the generalized joint coordinates x = θ, the dynamics are driven entirely by the process noise u (i.e. f ≡ id Rn ), while the observation of a feature affixed to the output of joint j at a position p is given in (4), and h(θ) is…”
BackgroundLong-Latency Feedback Coordinates Upper-Limb and Hand Muscles during Object Manipulation Tasks
Crevecoeur, F., Thonnard, J., Lefèvre, P., & Scott, S. H. (2016) · eNeuro · doi:10.1523/eneuro.0129-15.2016 · Cited by 40
“Hence, internal predictions from forward models are clearly an important feature of motor control (Wolpert and Ghahramani, 2000; Todorov, 2004).”
BackgroundAlessandro, C., Rellinger, B. A., Barroso, F. O., & Tresch, M. C. (2018) · eLife · doi:10.7554/elife.38215 · Cited by 38
“…(Flash and Hogan, 1985) can further constrain muscle activations, and the specific criteria used by the CNS to specify muscle activations underlying behavior has been the topic of considerable research (Scott, 2004; Todorov, 2004; Alessandro, 2016; Kistemaker et al., 2014; Prilutsky, 2000).”
BackgroundOptimizing the learning rate for adaptive estimation of neural encoding models
Hsieh, H.-L., & Shanechi, M. M. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006168 · Cited by 42
Ravi, D. K., Gwerder, M., König, N., Baumann, C. R., Uhl, M., van Dieën, J. H., Taylor, W. R., & Singh, N. B. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.10.008 · Cited by 39
“the level that one should aim for (Todorov, 2004)) by optimizing accuracy, while requiring minimal control effort.”
InfluentialBayesian Models of Brain and Behaviour
Penny, W. (2012) · ISRN Biomathematics · doi:10.5402/2012/785791 · Cited by 35
“For reviews of these approaches applied to neuroscience see [115, 116].”
BackgroundNiu, X., Latash, M. L., & Zatsiorsky, V. M. (2012) · Journal of Motor Behavior · doi:10.1080/00222895.2011.650735 · Cited by 37
“A widely held assumption—originally introduced in a seminal study by Nubar and Contini (1961)—is that the central controller follows the principle of optimality: It implements a solution that optimizes a certain unknown cost function (reviewed in Ait-Haddou, Jinha, Herzog, & Binding, 2004; Collins, 1995; Erdemir, McLe…”
Unsupervised adaptation of brain-machine interface decoders
Gürel, T. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00164 · Cited by 39
“OFC models also provide a framework, in which high movement goals can be discounted based on online sensory input flow [43].”
BackgroundMeyniel, F., Safra, L., & Pessiglione, M. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003584 · Cited by 41
“The economic view does not integrate the constraints imposed by physiological reactions, which might be difficult to anticipate [9].”
BackgroundCerebellar Input Configuration Toward Object Model Abstraction in Manipulation Tasks
Luque, N. R., Garrido, J. A., Carrillo, R. R., Coenen, O., & Ros, E. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2156809 · Cited by 37
Modeling Gesture-Typing Movements
Quinn, P., & Zhai, S. (2016) · Human-Computer Interaction · doi:10.1080/07370024.2016.1215922 · Cited by 44
“These approaches are argued to be analogous to biological processes that seek to enhance behavior in the same way that a cost-minimizing optimization procedure does (Hoff & Arbib, 1993; Todorov, 2004).”
BackgroundMultiscale modeling and decoding algorithms for spike-field activity
Hsieh, H.-L., Wong, Y. T., Pesaran, B., & Shanechi, M. M. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaeb1a · Cited by 46
“We simulate the brain strategy in closed-loop BMI control with an OFC model [12, 42, 51, 73, 75, 76].”
MethodThe shadow of the future affects cooperation in a cleaner fish
Oates, J., Manica, A., & Bshary, R. (2010) · Current Biology · doi:10.1016/j.cub.2010.04.022 · Cited by 39
Fractionation of the visuomotor feedback response to directions of movement and perturbation
Franklin, D. W., Franklin, S., & Wolpert, D. M. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00377.2013 · Cited by 42
“Such modulation has been used to support the theory that the skillful movement occurs through the setting of the appropriate feedback gains to the task being performed, a theory termed optimal feedback control (Liu and Todorov 2007; Scott 2004; Todorov 2004; Todorov and Jordan 2002).”
MethodOptimality and Modularity in Human Movement: From Optimal Control to Muscle Synergies
Berret, B., Delis, I., Gaveau, J., & Jean, F. (2018) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-93870-7_6 · Cited by 42
“This is not to say that optimal control has not been used; on the contrary it has been applied extensively mostly since the 80s and has emerged as a leading theory in the human movement control literature [49, 144].”
BackgroundHow the conception of control influences our understanding of actions
Floegel, M., Kasper, J., Perrier, P., & Kell, C. A. (2023) · Nature reviews. Neuroscience · doi:10.1038/s41583-023-00691-z · Cited by 39
A factor graph approach to estimation and model predictive control on Unmanned Aerial Vehicles
Ta, D.-N., Kobilarov, M., & Dellaert, F. (2014) · International Conference on Unmanned Aircraft Systems (ICUAS) · doi:10.1109/icuas.2014.6842254 · Cited by 41
“This practice is undesirable however, as in theory the separation principle does not hold in general for nonlinear systems; furthermore, it conceals the fact that both problems stem from a closely related principle of optimality [31], [35].”
BackgroundUsing noise to shape motor learning
Thorp, E. B., Kording, K. P., & Mussa-Ivaldi, F. A. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00493.2016 · Cited by 38
“…by minimizing effort (Fagg et al. 2006; Farshchiansadegh et al. 2016), noise (Harris and Wolpert 1998), kinematic qualities of the movement such as smoothness (Flash and Hogan 1985; Morasso 1981), or some combination of these factors (Mistry et al. 2013; O’Sullivan et al. 2009; Todorov 2004).”
BackgroundGoodman, R. S., & Tremblay, L. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5258-7 · Cited by 38
“Such later utilization of online proprioceptive feedback would also follow principles of energy expenditure minimization (e.g., Elliott et al. 2004; Todorov 2004).”
BackgroundEthical Learning, Natural and Artificial
Railton, P. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190905033.003.0002 · Cited by 50
Active inference unifies intentional and conflict-resolution imperatives of motor control
Maselli, A., Lanillos, P., & Pezzulo, G. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010095 · Cited by 39
“At difference with other approaches, such as optimal motor control [2] that only focuses on intentional aspects of movement, the framework of active inference considers multisensory conflict resolution as part and parcel of movement control.”
Moving faster while preserving accuracy
Missenard, O., & Fernandez, L. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.020 · Cited by 37
Reading motor intention through mental imagery
Lewkowicz, D., Delevoye, Y., Bailly, D., Andry, P., & Gaussier, P. (2013) · Adaptive Behavior · doi:10.1177/1059712313501347 · Cited by 38
“The development and application of e.g. the optimal theories of motor control (Doya, 2000; Todorov, 2004; Todorov & Jordan, 2002) have provided the means to create systems that have even mastered the problem of gravity, allowing for the execution of complex physical motor sequences such as walking…”
BackgroundReaching while walking: Reaching distance costs more than walking distance
Rosenbaum, D. Α. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.6.1100 · Cited by 36
“Such research can help researchers identify possible “grammars of action” (Goodnow & Levine, 1973) or, to use a term rooted in engineering rather than linguistics, optimization criteria underlying action choices (Todorov, 2004).”
Background
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.