Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 601–700 of 1,000
Deep kinematic inference affords efficient and scalable control of bodily movements
Priorelli, M., Pezzulo, G., & Stoianov, I. P. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2309058120 · Cited by 29
“Mainstream theories based on Optimal Control provide a solution to the two inversions that rests upon the optimization of a cost function [2, 3, 4, 5, 6].”
MethodFrom Humans to Humanoids: the Optimal Control Framework
Ivaldi, S., Sigaud, O., Berret, B., & Nori, F. (2012) · Paladyn Journal of Behavioral Robotics · doi:10.2478/s13230-012-0022-3 · Cited by 28
“OC has become of great interest in the neuroscientific community [154, 158].”
BackgroundPoston, B., Gemmert, A. W. A. V., Sharma, S., Chakrabarti, S., Zavaremi, S. H., & Stelmach, G. E. (2013) · Acta Psychologica · doi:10.1016/j.actpsy.2013.02.011 · Cited by 33
“Finally, the results suggest that the CNS uses cost functions in addition to endpoint variance to plan and execute arm movements (Tanaka et al., 2006; Todorov, 2004).”
BackgroundInfluentialPointing with the wrist: a postural model for Donders’ law
Campolo, D., Widjaja, F., Esmaeili, M. R., & Burdet, E. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2747-3 · Cited by 27
“It may then be necessary to extend the present model by including dynamic modeling and costs such as effort and movement error (Franklin et al. 2008; Todorov 2004).”
MethodThe Expected Utility of Movement
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374176-9.00008-7 · Cited by 32
“Theories applying optimal control theory to modeling motor behavior (Harris and Wolpert, 1998; Todorov, 2004) as well as applying Bayesian decision theory to modeling adaptive motor behavior (Körding and Wolpert, 2004a), depend crucially on the choice of a fixed and arbitrary loss function.”
BackgroundMethodToo Good to be True? Ideomotor Theory from a Computational Perspective
Herbort, O., & Butz, M. V. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00494 · Cited by 33
“From a functional point of view, it is reasonable to select the most efficient action (Todorov, 2004).”
BackgroundEstimating the patient�s contribution during robot-assisted therapy
Guidali, M., Keller, U., Klamroth-Marganska, V., Nef, T., & Riener, R. (2013) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2011.09.0172 · Cited by 28
“Adapting the amount of assistance to the user’s performance guarantees that he or she can complete the task, but carries the risk that he or she will decrease voluntary effort since the human motor system tends to optimize effort [34].”
BackgroundOptimal Feedback Control for anthropomorphic manipulators
Mitrović, D., Nagashima, S., Klanke, S., Matsubara, T., & Vijayakumar, S. (2010) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2010.5509630 · Cited by 27
“Recently OFC has found large attention in the study of biological motor control [16] where it has shown to be a powerful theory for interpreting human motor behaviour [8], [13].”
BackgroundHayashibe, M., & Shimoda, S. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2014.00021 · Cited by 28
Weiler, J., Saravanamuttu, J., Gribble, P. L., & Pruszynski, J. A. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00524.2016 · Cited by 27
“…and elbow, which would be consistent with accounting for anticipated interaction torques, and a negative correlation between muscles that flex the elbow and wrist muscles, which would be consistent with exploiting kinematic redundancy (see Scott 2004; Todorov 2004; Todorov and Jordan 2002).”
BackgroundTrajectory formation principles are the same after mild or moderate stroke
Mottet, D., van Dokkum, L. E. H., Froger, J., Gouaïch, A., & Laffont, I. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173674 · Cited by 27
“We conclude by pointing out that all these findings are coherent with the demonstration that signal dependent noise in movement production determines movement organization, via open-loop optimization [4] and optimal of feed-back control [8,51].”
BackgroundA systematic evaluation of the evidence for perceptual control theory in tracking studies
Parker, M. G., Willett, A. B. S., Tyson, S. F., Weightman, A., & Mansell, W. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.02.030 · Cited by 27
Proactive Action Preparation: Seeing Action Preparation as a Continuous and Proactive Process
Pezzulo, G., & Ognibene, D. (2012) · Motor Control · doi:10.1123/mcj.16.3.386 · Cited by 28
“Theories of adaptive optimal control assume that, by using internal models, agents can execute optimal actions conditioned to an agent’s goals, and which take into account environmental constraints such as uncertainty in the measurements and noise in the motor system (Bays & Wolpert, 2007; Faisal et al., 2008; Harris…”
BackgroundMethodRiemannian geometric approach to human arm dynamics, movement optimization, and invariance
Biess, A., Flash, T., & Liebermann, D. G. (2011) · Physical Review E · doi:10.1103/physreve.83.031927 · Cited by 31
Eye-Hand Coordination in Rhythmical Pointing
Lazzari, S., Mottet, D., & Vercher, J. (2009) · Journal of Motor Behavior · doi:10.3200/jmbr.41.4.294-304 · Cited by 29
“An interesting alternative to this oscillatory approach was found in the optimal control models, in which Fitts’s law emerged out of control strategies that minimized movement variability using optimality principles (Bays & Wolpert, 2007; Todorov, 2004; Trommershauser et al., 2005).”
Near-Optimal Human Adaptive Control across Different Noise Environments
Chhabra, M., & Jacobs, R. A. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.2238-06.2006 · Cited by 28
“As mentioned above, it is often useful to compare human performances on perceptual or motor tasks with the performances of “ideal observers” or ideal actors (Barlow, 1957; Geisler, 1989; Baddeley et al., 2003; Todorov, 2004; Berthier et al., 2005).”
Optimal coordination and control of posture and movements
Johansson, R., Fransson, P.-A., & Magnusson, M. (2009) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2009.08.013 · Cited by 31
“As decomposition of control into internal inverse models for (‘proactive’) trajectory generation and sensory feedback for (‘reactive’) stable task execution and adaptation is essential for motor control, optimality principles should apply to both (Todorov, 2004).”
BackgroundInfluentialOptimization in target movement simulations
Eriksson, A. (2008) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2008.04.017 · Cited by 27
Stiffness and temporal optimization in periodic movements: An optimal control approach
Nakanishi, J., Rawlik, K., & Vijayakumar, S. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094799 · Cited by 26
“Optimal control theory has been used as a theoretical model of movement generation in biological motor control [1].”
MethodOptimal control of the Lotka–Volterra system: turnpike property and numerical simulations
Ibañez, A. (2016) · Journal of Biological Dynamics · doi:10.1080/17513758.2016.1226435 · Cited by 37
“The Optimal Control Theory has been successfully applied to a wide range of real problems such as in neurology, to explain the behaviour of the sensorimotor system using a feedback optimal control law [1, 2, 3, 4].”
BackgroundKrüger, M., & Hermsdörfer, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00041 · Cited by 28
“This assumption is supported by motor control theories, e.g., optimal feedback control: Todorov and Jordan (2002); Todorov (2004); also see Harris and Wolpert (1998).”
MethodA computational theory for the production of limb movements.
Guigon, E. (2023) · Psychological Review · doi:10.1037/rev0000323 · Cited by 32
“Equations 1 to 5 define an architecture that belongs to the class of control/estimation architectures (Figure 1A; Todorov, 2004).”
BackgroundThe otolith vermis: A systems neuroscience theory of the Nodulus and Uvula
Laurens, J. (2022) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2022.886284 · Cited by 27
“…has been the subject of considerable attention and debate, both at the experimental and theoretical levels (Mayne, 1974; Angelaki et al., 1999, 2004; Hess and Angelaki, 1999; Merfeld et al., 1999, 2005a,b; Bos and Bles, 2002; Raphan and Cohen, 2002; Laurens and Angelaki, 2011; Yakushin et…”
Flexible intentions: An Active Inference theory
Priorelli, M., & Stoianov, I. P. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1128694 · Cited by 28
“For example, the prevailing Optimal Feedback Control theory defines motor goals through task-specific cost functions (Todorov, 2004).”
BackgroundInternal feedback in the cortical perception–action loop enables fast and accurate behavior
Li, J. S., Sarma, A. A., B, T. J. S. A., & Doyle, J. C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2300445120 · Cited by 34
“x̃(1) = w1 0 w2 → x̃(2) = A12w2 A12w2 A21w1 A21w1 → x̃(3) = 0.”
Macuga, K. L., & Frey, S. H. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.024 · Cited by 29
“The contributions of these respective controllers are thought to vary according to prevailing task demands in an attempt to optimize performance (Kording and Wolpert, 2006; Todorov, 2004).”
Isableu, B., Rezzoug, N., Mallet, G., Bernardin, D., Gorce, P., & Pagano, C. C. (2009) · Neuroscience · doi:10.1016/j.neuroscience.2009.08.065 · Cited by 26
The role of vision, speed, and attention in overcoming directional biases during arm movements
Dounskaia, N. V., & Goble, J. A. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2547-9 · Cited by 26
“It has often been hypothesized that muscle effort is minimized during human movements (Todorov 2004).”
BackgroundInverse Optimal Control as a Tool to Understand Human Movement
Mombaur, K., & Clever, D. (2017) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-51547-2_8 · Cited by 26
Visuomotor feedback gains are modulated by gaze position
de Brouwer, A. J., Gallivan, J. P., & Flanagan, J. R. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00182.2018 · Cited by 28
“The decrease in the gain of the visuomotor response with increasing distance between the error and the point of gaze could be explained in the framework of Bayesian estimation and optimal feedback control (Todorov 2004).”
BackgroundMotor equivalence and self-motion induced by different movement speeds
Scholz, J. P., Dwight-Higgin, T., Lynch, J. E., Tseng, Y.-W., Martin, V., & Schöner, G. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2541-2 · Cited by 30
“Other optimality principles such as minimum effort (Todorov 2004) or minimum torque change (Uno et al. 1989) do not exclude that movement plans may include self-motion.”
BackgroundMinimum jerk for human catching movements in 3D
Fligge, N., McIntyre, J., & van der Smagt, P. (2012) · IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob.2012.6290265 · Cited by 31
Optimality Principles in Human Point-to-Manifold Reaching Accounting for Muscle Dynamics
Wochner, I., Driess, D., Zimmermann, H., Haeufle, D. F. B., Toussaint, M., & Schmitt, S. (2020) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2020.00038 · Cited by 28
“As shown there, almost all criteria predict the two typical movement features for point-to-point reaching movements: straight paths and bellshaped speed profiles similar to previous findings in the literature (e.g., Abend et al., 1982; Flash and Hogan, 1985; Harris and Wolpert, 1998; Todorov, 2004).”
SnapMove: Movement Projection Mapping in Virtual Reality
Cohn, B. A., Maselli, A., Ofek, E., & González-Franco, M. (2020) · IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) · doi:10.1109/aivr50618.2020.00024 · Cited by 27
“At the same time, users try to find sensorimotor strategies to achieve a given outcome with the minimal energetic cost [11].”
BackgroundSchaefer, L. V., & Bittmann, F. N. (2021) · PLoS ONE · doi:10.1371/journal.pone.0238331 · Cited by 30
“With a more complex feedback control, the variability will be even higher as a sign of an adequate adaptation [25].”
BackgroundOnline Vision as a Function of Real-Time Limb Velocity: Another Case for Optimal Windows
Kennedy, A., Bhattacharjee, A., Hansen, S., Reid, C., & Tremblay, L. (2015) · Journal of Motor Behavior · doi:10.1080/00222895.2015.1012579 · Cited by 27
“ment planning and a carefully selected use of online feedback (Elliott et al., 2010; Elliott, Hansen, Mendoza, & Tremblay, 2004; Todorov, 2004; Trommersh€auser, Gepshtein, Maloney, Landy, & Banks, 2005).”
Sensory Feedback Reduces Individuality by Increasing Variability within Subjects
Cullins, M. J., Gill, J. P., McManus, J. M., Lu, H., Shaw, K. M., & Chiel, H. J. (2015) · Current Biology · doi:10.1016/j.cub.2015.08.044 · Cited by 28
Modeling the motor cortex: Optimality, recurrent neural networks, and spatial dynamics
Tanaka, H. (2015) · Neuroscience Research · doi:10.1016/j.neures.2015.10.012 · Cited by 26
A switching cost for motor planning
de Xivry, J. O., & Lefèvre, P. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00319.2016 · Cited by 25
“…we consider that motor planning (i.e. before movement onset) consists in the derivation of a goaldirected feedback control law (Todorov and Jordan, 2002; Scott, 2004; Todorov, 2004; Liu and Todorov, 2007) and that responses to any perturbations during the movement are driven by this feedback law.”
BackgroundActive strategies for multisensory conflict suppression in the virtual hand illusion
Lanillos, P., Franklin, S., Maselli, A., & Franklin, D. W. (2021) · Scientific Reports · doi:10.1038/s41598-021-02200-7 · Cited by 30
Load emphasizes muscle effort minimization during selection of arm movement direction
Wang, W., & Dounskaia, N. V. (2012) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-9-70 · Cited by 25
“Human movements are often considered to be nearoptimal, although the type of minimized movement cost remains under debate [1].”
BackgroundTapping on a target: dealing with uncertainty about its position and motion
Brenner, E., de la Malla, C., & Smeets, J. B. J. (2022) · Experimental Brain Research · doi:10.1007/s00221-022-06503-7 · Cited by 26
“The second is that movements are constantly adjusted to reach their goal, rather than being adjusted to follow an initial plan (optimal feedback control; Scott 2004; Todorov 2004; Todorov and Jordan 2002).”
BackgroundDifferential dynamic programming for optimal estimation
Kobilarov, M., Ta, D.-N., & Dellaert, F. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139279 · Cited by 25
“This is despite that both problems stem from a closely related principle of optimality [7], [38], [39] which in the linear-Gaussian case is the well-known duality between the celebrated linear quadratic regulator (LQR) and linear Gaussian estimator (LGE).”
BackgroundNeilson, P. D., & Neilson, M. D. (2010) · Human Movement Science · doi:10.1016/j.humov.2009.10.005 · Cited by 28
“As pointed out by Guigon, Baraduc, and Desmurget (2007), reasoning based on the separation of trajectory planning and trajectory execution has been seriously questioned (Bullock & Grossberg, 1988; Cole & Abbs, 1986; Sporns & Edelman, 1993; Todorov, 2004; Todorov & Jordan, 2002), the main argument being that the trajec…”
BackgroundInverse optimal control for a hybrid dynamical system with impacts
Aghasadeghi, N., Long, A., & Bretl, T. W. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225259 · Cited by 24
“IOC problems are of interest in a wide range of applications, from basic science [2], [3] and locomotion [4], [5], to optimal control of aircraft [6], and more recently aerobatic helicopter flight [7] within the robotics community.”
BackgroundCashaback, J. G. A., & Cluff, T. (2015) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2014.12.053 · Cited by 24
“Another interesting concept that should be further explored is the potential hierarchical structure of objectives (Bernstein, 1967; Pierrynowski, 1982; Todorov, 2004; Li et al., 2004).”
BackgroundA Developmental Approach Aids Motor Learning
Ivanchenko, V., & Jacobs, R. A. (2003) · Neural Computation · doi:10.1162/089976603322297287 · Cited by 24
Perich, M. G., & Miller, L. E. (2017) · Experimental Brain Research · doi:10.1007/s00221-017-4997-1 · Cited by 29
“Both approaches posit the use of internal models of the limb (Wolpert et al. 1995), whether to transform a desired kinematic trajectory into kinetic commands (Kalaska and Crammond 1992; Shadmehr and MussaIvaldi 1994), or for optimal state estimation (Shimansky et al. 2004; Todorov 2004; Scott 2012).”
The Differential Impact of a Response’s Effectiveness and its Monetary Value on Response-Selection
Karsh, ., Hemed, E., Nafcha, O., Bakbani-Elkayam, S., Custers, R., & Eitam, B. (2020) · Scientific Reports · doi:10.1038/s41598-020-60385-9 · Cited by 24
Poston, B., Christou, E. A., Enoka, J. A., & Enoka, R. M. (2009) · Experimental Brain Research · doi:10.1007/s00221-009-2126-5 · Cited by 24
“…variance theory (Christou et al. 2003, 2007; Harris and Wolpert 1998; Hamilton and Wolpert 2002; Jones et al. 2002; Hamilton et al. 2004), whereas others either have not or have found mixed results (Christou et al. 2007; Osu et al. 2004; Poston et al. 2008a, b; Tanaka et al. 2006; Todorov 2004).”
InfluentialAnticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems
Butz, M. V., Sigaud, O., Pezzulo, G., & Baldassarre, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-74262-3_1 · Cited by 26
“This principle is now most directly used in inverse modeling for control, in which a goal state and the current state trigger suitable motor commands as output [50, 57, 62, 80].”
BackgroundLeib, R., Howard, I. S., Millard, M., & Franklin, D. W. (2023) · Comprehensive physiology · doi:10.1002/cphy.c220032 · Cited by 27
Optimal strategies for throwing accurately
Venkadesan, M., & Mahadevan, L. (2010) · Cited by 23
Kettner, C., Möhler, F., Reuter, M., & Stein, T. (2022) · Bioengineering · doi:10.3390/bioengineering9110616 · Cited by 24
A Riemannian Take on Human Motion Analysis and Retargeting
Klein, H., Jaquier, N., Meixner, A., & Asfour, T. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9982127 · Cited by 23
Sensorimotor feedback loops are selectively sensitive to reward
Codol, O., Kashefi, M., Forgaard, C. J., Galea, J. M., Pruszynski, J. A., & Gribble, P. L. (2023) · eLife · doi:10.7554/elife.81325 · Cited by 25
“One such principle is that feedback gains may be according to a cost function to produce optimal control ( Todorov, 2004 ).”
BackgroundA neuronal least-action principle for real-time learning in cortical circuits
Senn, W., Dold, D., Kungl, Á. F., Ellenberger, B., Jordan, J., Bengio, Y., Sacramento, J., & Petrovici, M. A. (2024) · eLife · doi:10.1101/2023.03.25.534198 · Cited by 29
“This links our framework to optimal control theory and motor control where delays are also taken into account, so that a movement can be corrected early enough (Wolpert & Ghahramani, 2000; Todorov & Jordan, 2002; Todorov, 2004).”
Perturbation-Induced False Starts as a Test of the Jirsa-Kelso Excitator Model
Fink, P. W., Kelso, J. A. S., & Jirsa, V. (2009) · Journal of Motor Behavior · doi:10.3200/jmbr.41.2.147-157 · Cited by 23
“This approach suggests that movements are organized to minimize some objective function (e.g., for jerk, see Flash & Hogan, 1985; for torque change, see Uno, Kawato, & Suzuki, 1989; for energy minimization, see Chapman, 1968; Hatze, 1977; for variance in the end position, see Harris & Wolpert, 1998; for overviews, see…”
Speeded Reaching Movements around Invisible Obstacles
Hudson, T. E., Wolfe, U., & Maloney, L. T. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002676 · Cited by 23
“Our data have implications for a class of popular models of obstacle avoidance and reach planning in general based on optimal linear feedback control [29,30,31].”
Virtual biomechanics: a new method for online reconstruction of force from EMG recordings
de Rugy, A., Loeb, G. E., & Carroll, T. J. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00714.2012 · Cited by 23
“Indeed, the ability to resolve redundancy is central to the attractiveness of several influential motor control schemes, including optimal control, motor primitives, and hierarchical sensorimotor control (e.g., d’Avella et al. 2003; Haruno and Wolpert 2005; Loeb et al. 1999; Todorov 2004; Todorov and Jordan 2002).”
BackgroundHow humans control arm movements
Berret, B., Gauthier, J.-P., & Papaxanthis, C. (2008) · Proceedings of the Steklov Institute of Mathematics · doi:10.1134/s0081543808020053 · Cited by 23
“In the paper [4], there is a recent review about “optimality principles in sensorimotor control,” and although it is the only general reference we give here from the neurobiology literature, there is an enormous amount of such literature.”
BackgroundReversal of Bimanual Feedback Responses With Changes in Task Goal
Diedrichsen, J., & Gush, S. (2008) · Journal of Neurophysiology · doi:10.1152/jn.90887.2008 · Cited by 23
Linear Conic Optimization for Inverse Optimal Control
Pauwels, E., Henrion, D., & Lasserre, J. B. (2016) · SIAM Journal on Control and Optimization · doi:10.1137/14099454x · Cited by 23
“Of more important interest to us is the application of the optimality principle to model the motion of living organisms [42].”
BackgroundDaily update of motor predictions by physical activity
Gueugneau, N., Schweighofer, N., & Papaxanthis, C. (2015) · Scientific Reports · doi:10.1038/srep17933 · Cited by 23
Preparing to move: Setting initial conditions to simplify interactions with complex objects
Nayeem, R., Bazzi, S., Sadeghi, M., Hogan, N., & Sternad, D. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009597 · Cited by 28
“Although effort minimization and the minimum intervention principle are core to stochastic optimal feedback control models [44,84], they are quite distinct from predictability.”
BackgroundThe leading joint hypothesis for spatial reaching arm motions
Ambike, S., & Schmiedeler, J. P. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3335-x · Cited by 27
Kurata, K. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00149.2007 · Cited by 26
“achievement of overall accuracy in reaching (Harris and Wolpert 1998; Todorov 2004).”
BackgroundNeural coordination during reach-to-grasp
Vaidya, M., Kording, K. P., Saleh, M., Takahashi, K., & Hatsopoulos, N. G. (2015) · Journal of Neurophysiology · doi:10.1152/jn.00349.2015 · Cited by 23
Modeling constraints to redundancy in bimanual force coordination
Hu, X., & Newell, K. M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.01086.2010 · Cited by 23
“The optimal feedback control rule also leads to different properties of variability in different dimensions (Todorov 2004).”
BackgroundA neuronal least-action principle for real-time learning in cortical circuitsPreprint
Senn, W., Dold, D., Kungl, Á. F., Ellenberger, B., Jordan, J., Bengio, Y., Sacramento, J., & Petrovici, M. A. (2023) · eLife · doi:10.7554/elife.89674 · Cited by 26
Clever, D., Harant, M., Koch, H., Mombaur, K., & Endres, D. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.06.001 · Cited by 22
“This hypothesis posits that the human motor system is optimal (or near optimal) in its choice of movements, given the sensory input and goal specifications [3, 4].”
BackgroundBucklin, M. A., Wu, M., Brown, G., & Gordon, K. E. (2019) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2019.07.030 · Cited by 22
“Hence, the nervous system can adapt different control strategies depending on priorities (e.g. error tolerance, energy) associated with task-specific goals (Todorov, 2004).”
BackgroundWachholz, F., Tiribello, F., Promsri, A., & Federolf, P. (2019) · Brain Sciences · doi:10.3390/brainsci10010001 · Cited by 24
Frequency-dependent force direction elucidates neural control of balance
Shiozawa, K., Lee, J., Russo, M., Sternad, D., & Hogan, N. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00907-2 · Cited by 22
Zahler, S. H., Taylor, D. E., Wright, B. S., Wong, J. Y., Shvareva, V. A., Park, Y. A., & Feinberg, E. H. (2023) · Cell · doi:10.1016/j.cell.2023.05.031 · Cited by 22
Mechanisms of sensorimotor adaptation in a hierarchical state feedback control model of speech
Kim, K. S., Gaines, J. L., Parrell, B., Ramanarayanan, V., Nagarajan, S. S., & Houde, J. F. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011244 · Cited by 25
Kinematic markers of skill in first-person shooter video games
Warburton, M., Campagnoli, C., Mon-Williams, M. A., Mushtaq, F., & Morehead, J. R. (2023) · PNAS Nexus · doi:10.1093/pnasnexus/pgad249 · Cited by 23
Yao, B., Yang, B., Xu, W., Ji, Z., Zhou, Z., & Wang, L. (2023) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102714 · Cited by 25
A balanced view of motor control
Tresch, M. C. (2007) · Nature Neuroscience · doi:10.1038/nn1007-1227 · Cited by 22
On the use of musculoskeletal models to interpret motor control strategies from performance data
Cheng, E. J., & Loeb, G. E. (2008) · Journal of Neural Engineering · doi:10.1088/1741-2560/5/2/014 · Cited by 24
“Recently, the phenomenon of signal-dependent motor noise (Hamilton et al 2004) has been used to explain optimal control strategies that result in minimization of muscle force levels (Todorov 2004).”
BackgroundBouncing between Model and Data: Stability, Passivity, and Optimality in Hybrid Dynamics
Ronsse, R., & Sternad, D. (2010) · Journal of Motor Behavior · doi:10.1080/00222895.2010.526451 · Cited by 22
“Central to this modeling is that perturbations or errors that do not directly affect the task goal are not corrected, therefore making the effector trajectory a priori unknown ( Todorov, 2004 ; Todorov & Jordan, 2002 ).”
MethodBologna, M., Caronni, A., Berardelli, A., & Rothwell, J. C. (2012) · European Journal of Neuroscience · doi:10.1111/ejn.12009 · Cited by 24
“In theories of optimal motor control (Todorov, 2004), the motor system attempts to achieve a desired level of performance at minimal cost.”
BackgroundThe Robust Running Ape: Unraveling the Deep Underpinnings of Coordinated Human Running Proficiency
Kiely, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00892 · Cited by 23
“Recently, through the lens of Optimal Feedback Control Theory (OFCT), conventional interpretations of DST have been criticized for obscuring the fundamental priority of sensory feedback in shaping effective movement coordination (Todorov, 2004, 2009).”
The modularity of action and perception revisited using control theory and active inference
Baltieri, M., & Buckley, C. L. (2018) · Conference on Artificial Life (ALIFE) · doi:10.1162/isal_a_00031 · Cited by 14
“In the last few decades, optimal control has also emerged as a dominant theory of action, motor control and behaviour in neuroscience (Kawato, 1999; Wolpert and Ghahramani, 2000; Todorov, 2004; Körding and Wolpert, 2006; Körding, 2007; Franklin and Wolpert, 2011).”
BackgroundMethodInfluentialde Rugy, A., Davoodi, R., & Carroll, T. J. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00130.2012 · Cited by 22
“For instance, recent optimal control theories that posit that the nervous system solves muscle redundancy by minimizing costs such as muscle effort or motor noise (Todorov 2004; Todorov and Jordan 2002) were able to qualitatively reproduce the pattern of muscle”
BackgroundRhythmic movements are larger and faster but with the same frequency on removal of visual feedback
Levy‐Tzedek, S., Ben-Tov, M., & Karniel, A. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00266.2011 · Cited by 22
The Role of Online Visual Feedback for the Control of Target-Directed and Allocentric Hand Movements
Thaler, L., & Goodale, M. A. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00743.2010 · Cited by 24
Learning Upright Standing on a Multiaxial Balance Board
Valle, M. S., Casabona, A., Cavallaro, C., Castorina, G., & Cioni, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0142423 · Cited by 23
“In fact, parallel processes can be implemented in order to reduce the energy expenditure and to optimize the combination of the diverse components [45; 46].”
BackgroundOccam's Razor in sensorimotor learning
Genewein, T., & Braun, D. A. (2014) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2013.2952 · Cited by 24
Perceived Cost and Intrinsic Motor Variability Modulate the Speed-Accuracy Trade-Off
Bertucco, M., Bhanpuri, N. H., & Sanger, T. D. (2015) · PLoS ONE · doi:10.1371/journal.pone.0139988 · Cited by 22
Nakayama, K., Moher, J., & Song, J.-H. (2023) · Annual Review of Psychology · doi:10.1146/annurev-psych-021422-043229 · Cited by 21
Terra incognita of the uncontrolled manifold
Latash, M. L. (2024) · Journal of Neurophysiology · doi:10.1152/jn.00394.2024 · Cited by 21
Explaining human motor coordination via the synergy expansion hypothesis
Tessari, F., West, A. M., & Hogan, N. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2501705122 · Cited by 25
“Specifically, the authors repro-pose the theory of motor chunking presented by Lashley in 1951 ( 36 ), in which motor chunks represent specific temporal combinations of elementary actions that could be quickly retrieved and [ 9 ] accurately combined together.”
InfluentialInga, J., Creutz, A., & Hohmann, S. (2021) · European Control Conference (ECC) · doi:10.23919/ecc54610.2021.9655110 · Cited by 21
Continuous evaluation of cost-to-go for flexible reaching control and online decisions
Comite, A. D., Lefèvre, P., & Crevecoeur, F. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011493 · Cited by 24
“It plays a central role in the optimal feedback control framework (OFC) [26,27], which posits that the closed-loop control policy underlying reaching behavior results from the minimization of the cost function defined by a weighted sum of motor errors and control-related costs [28].”
A Perspective on Prosthetic Hands Control: From the Brain to the Hand
Gentile, C., & Gruppioni, E. (2023) · Prosthesis · doi:10.3390/prosthesis5040083 · Cited by 24
“These synergies not only enhance the hand’s resilience and flexibil-ity [65] but also assist in creating more practical, user-friendly devices that meet the user’s requirements and expectations [59,122].”
BackgroundMechanisms for handling uncertainty in sensorimotor control in sports: a scoping review
Beck, D., Hossner, E.-J., & Zahno, S. (2023) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2023.2280899 · Cited by 23
“This idea is presented in more detail in Figure 3, where the framework of optimal feedback control (according to Körding & Wolpert, 2006; and Todorov, 2004) is used to integrate the highlighted mechanisms (1) – (5).”
InfluentialGeneration of human walking paths
Papadopoulos, A. V., Bascetta, L., & Ferretti, G. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9443-2 · Cited by 21
“An optimal control approach has been formerly applied in the field of neuroscience (Todorov 2004) to predict motion of limbs, i.e., by searching a control input according to some performance criterion, such as minimization of jerk (Viviani and Flash 1995), torque-change (Uno et al. 1989),…”
MethodSuboptimal Muscle Synergy Activation Patterns Generalize their Motor Function across Postures
Sohn, M. H., & Ting, L. H. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00007 · Cited by 23
“…that the optimal muscle activation patterns based on a minimum-effort criteria do not generalize their function across postures we demonstrate that a single optimization criterion (Todorov, 2004) may not be sufficient for the nervous system to organize the spatial structure of muscle synergies.”
Neural Control Adaptation to Motor Noise Manipulation
Hasson, C. J., Gelina, O., & Woo, G. (2016) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2016.00059 · Cited by 21
“Motor noise has important implications for human movement control—the amplitude of motor commands should be kept small to minimize the variability of motor actions (Harris and Wolpert, 1998; Todorov, 2004).”
Background
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.