Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 201–300 of 1,000
Giszter, S. F., Patil, V., & Hart, C. B. (2007) · Progress in brain research · doi:10.1016/s0079-6123(06)65020-6 · Cited by 92
Random walk of motor planning in task-irrelevant dimensions
van Beers, R. J., Brenner, E., & Smeets, J. B. J. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00706.2012 · Cited by 92
“It is widely assumed that movements are planned to minimize a certain cost function (Todorov 2004), but it is often not known what exactly the cost function is.”
BackgroundEngagement of the Rat Hindlimb Motor Cortex across Natural Locomotor Behaviors
DiGiovanna, J., Dominici, N., Friedli, L., Rigosa, J., Duis, S., Kreider, J., Beauparlant, J., van den Brand, R., Schieppati, M., Micera, S., et al. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.4343-15.2016 · Cited by 95
“Thus, optimal feedback controller theory predicts that motor cortex engagement should augment with increasing demands in task accuracy (Todorov, 2004).”
BackgroundCurrent models of speech motor control: A control-theoretic overview of architectures and properties
Parrell, B., Lammert, A. C., Ciccarelli, G. A., & Quatieri, T. F. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5092807 · Cited by 100
“Importantly, the estimated state that results from combining internal predictions and feedback can be compared with the desired state to generate a motor command (Todorov, 2004), just as in a pure feedback controller.”
BackgroundMethodInfluentialAdamovich, S., Fluet, G. G., Merians, A. S., Mathai, A., & Qiu, Q. (2009) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2009.2028830 · Cited by 92
“and generates trajectories independently, with the objective to avoid the typically occurring human “slacking” associated with extensive external assistance [40].”
BackgroundNoohi, E., Žefran, M., & Patton, J. L. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2572698 · Cited by 99
State estimation in posterior parietal cortex: Distinct poles of environmental and bodily states
Medendorp, W. P., & Heed, T. (2019) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2019.101691 · Cited by 93
Sensorimotor integration for multisegmental frontal plane balance control in humans
Goodworth, A. D., & Peterka, R. J. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00670.2010 · Cited by 88
Action plan co-optimization reveals the parallel encoding of competing reach movements
Gallivan, J. P., Barton, K. S., Chapman, C. S., Wolpert, D. M., & Flanagan, J. R. (2015) · Nature Communications · doi:10.1038/ncomms8428 · Cited by 96
Brain-Machine Interfaces: Powerful Tools for Clinical Treatment and Neuroscientific Investigations
Slutzky, M. W. (2019) · The Neuroscientist · doi:10.1177/1073858418775355 · Cited by 81
“This principle accounts for the simultaneous observation of highly accurate control of movements in a particular task with substantial trial-to-trial variability in the way the limb or body moves while achieving the task goal (Todorov 2004).”
BackgroundShanechi, M. M., Williams, Z. M., Wornell, G. W., Hu, R. C., Powers, M. E., & Brown, E. N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059049 · Cited by 90
“Hence we build the prior goal-directed state-space model for the movement kinematics based on the optimal feedback control theory of the sensorimotor system [44,45].”
BackgroundMethodInfluentialHuman-machine symbiosis: A multivariate perspective for physically coupled human-machine systems
Inga, J., Rueß, M., Robens, J. H., Nelius, T., Rothfuß, S., Kille, S., Dahlinger, P., Lindenmann, A., Thomaschke, R., Neumann, G. M., et al. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102926 · Cited by 103
A State-Space Analysis for Reconstruction of Goal-Directed Movements Using Neural Signals
Srinivasan, L., Eden, U. T., Willsky, A. S., & Brown, E. N. (2006) · Neural Computation · doi:10.1162/neco.2006.18.10.2465 · Cited by 89
“Based on stochastic optimal control theory, the most recent arm models (Todorov & Jordan, 2002; Todorov, 2004b) choose control forces based on estimates of path history and costto-go, the price associated with various ways of completing the reach.”
BackgroundMethodResultInfluentialOn the human control of vehicles: an experimental study of acceleration
Bosetti, P., Lio, M. D., & Saroldi, A. (2013) · European Transport Research Review · doi:10.1007/s12544-013-0120-2 · Cited by 93
“Several authors showed that general human sensory-motor strategies are learnt and optimized [11 – 15].”
Ting, L. H., Chvatal, S. A., Safavynia, S. A., & McKay, J. L. (2012) · International Journal for Numerical Methods in Biomedical Engineering · doi:10.1002/cnm.2485 · Cited by 93
“Likewise, controlling a task-level variable cannot be achieved by controlling muscles, joint torques, or joint angles independently, but requires that they be coordinated in a task-specific way [33, 34].”
BackgroundTask-dependent coordination of rapid bimanual motor responses
Dimitriou, M. D., Franklin, D. W., & Wolpert, D. M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00787.2011 · Cited by 86
“One theory, termed optimal feedback control (OFC), suggests that these feedback control processes are optimally tuned to task goals, for example, optimizing a trade-off between accuracy and effort in the presence of sensorimotor noise and external perturbations, with control achieved by flexible use of sensory feedbac…”
Neural basis of sensorimotor learning: modifying internal models
Lalazar, H., & Vaadia, E. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.11.003 · Cited by 88
“Therefore, forward models are a necessary ingredient for the contemporary description of the sensorimotor system as an optimal feedback controller [4].”
BackgroundPredictive joint-action model: A hierarchical predictive approach to human cooperation
Pesquita, A., Whitwell, R. L., & Enns, J. T. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1393-6 · Cited by 93
“independent, as we infer from Wolpert et al., (2003) and Keller et al.”
BackgroundMethodPredictive attenuation of touch and tactile gating are distinct perceptual phenomena
Kilteni, K., & Ehrsson, H. H. (2022) · iScience · doi:10.1016/j.isci.2022.104077 · Cited by 87
“that the brain produces motor commands through an inverse model (93) or controller (94).”
BackgroundA perspective on multisensory integration and rapid perturbation responses
Cluff, T., Crevecoeur, F., & Scott, S. H. (2014) · Vision Research · doi:10.1016/j.visres.2014.06.011 · Cited by 91
“In recent years, there have been substantial advances in our understanding of the computations involved in flexible feedback control (Todorov, 2004; Todorov & Jordan, 2002).”
Fatigue and Motor Redundancy: Adaptive Increase in Finger Force Variance in Multi-Finger Tasks
Singh, T., Varadhan, S. K. M., Zatsiorsky, V. M., & Latash, M. L. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00077.2010 · Cited by 115
Asymmetric adaptation with functional advantage in human sensorimotor control
Jeka, J. J., Oie, K. S., & Kiemel, T. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1539-x · Cited by 89
“…Bayesian framework can also be applied to the problem of estimating quantities that change stochastically with time, such as when sensory estimates of self-motion need to be continuously updated for compensatory corrections to an individual’s motor state (Todorov 2004; Wolpert and Ghahramani 2000).”
Manipulating the edge of instability
Venkadesan, M., Guckenheimer, J. M., & Valero‐Cuevas, F. J. (2007) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2007.01.022 · Cited by 84
“Nevertheless, our results agree with and add valuable insight to the existing body of evidence for optimality principles in sensorimotor control (Harris and Wolpert, 1998; Todorov, 2004).”
ResultCompositionality of optimal control laws
Todorov, E. V. (2009) · neural information processing systems · Cited by 126
Self-citationIdentifying Stride-To-Stride Control Strategies in Human Treadmill Walking
Dingwell, J. B., & Cusumano, J. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124879 · Cited by 81
“In contrast to approaches that seek to identify single “optimal” average solutions [21,22], or that only analyze “variability” [7,14], the present results clearly demonstrate that one must account for trial-to-trial (here, stride-to-stride) fluctuation dynamics [28,29,51] to identify appropriate control policies.”
BackgroundMethodResultInfluentialStrategies of locomotor collision avoidance
Basili, P., Sağlam, M., Kruse, T., Huber, M., Kirsch, A., & Glasauer, S. (2012) · Gait & Posture · doi:10.1016/j.gaitpost.2012.08.003 · Cited by 81
“For example, planning strategies may differ regarding the use of feedback information: feedback may simply be used as servomechanism trying to follow a pre-planned trajectory, or may take into account the inherent uncertainty about the sensory information [22].”
BackgroundRisk-Sensitive Optimal Feedback Control for Haptic Assistance
Medina, J. R., Lee, D., & Hirche, S. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225085 · Cited by 81
“Our approach is inspired by recent findings in human sensorimotor control [8], [9], which state that human sensorimotor behavior is the result of minimizing a cost function while considering process noise and uncertainty in the dynamics.”
MethodHuys, R., Perdikis, D., & Jirsa, V. K. (2014) · Psychological Review · doi:10.1037/a0037014 · Cited by 72
“…on internal models (Hwang & Shadmehr, 2005; Wolpert, 1997; Wolpert & Ghahramani, 2000), optimization (Guigon, Baraduc, & Desmurget, 2007b, 2008; Todorov, 2004; Todorov & Jordan, 2002), Bayesian decision theory (Chater, Tenenbaum, & Yuille, 2006; Kersten & Yuille, 2003; Körding & Wolpert, 2004;…”
BackgroundIjspeert, A. J., & Daley, M. A. (2023) · Journal of Experimental Biology · doi:10.1242/jeb.245784 · Cited by 79
Adaptive Optimal Feedback Control with Learned Internal Dynamics Models
Mitrović, D., Klanke, S., & Vijayakumar, S. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05181-4_4 · Cited by 93
“In the ideal case, the system state is directly mapped to control signals during execution, and the form of this mapping is again governed by a cost function [25].”
BackgroundKurtzer, I. L., Pruszynski, J. A., & Scott, S. H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.00453.2009 · Cited by 85
Laurens, J., & Angelaki, D. E. (2017) · eLife · doi:10.7554/elife.28074 · Cited by 91
Muscle Co-Contraction Modulates Damping and Joint Stability in a Three-Link Biomechanical Limb
Heitmann, S., Ferns, N., & Breakspear, M. J. (2012) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2011.00005 · Cited by 81
Towards physics of neural processes and behavior
Latash, M. L. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.005 · Cited by 83
“Mathematical modeling approaches, including optimization methods, have been used to explore possible causes of purposeful actions (for reviews see Prilutsky and Zatsiorsky, 2002; Todorov, 2004; Diedrichsen et al., 2010).”
MethodFeedback responses rapidly scale with the urgency to correct for external perturbations
Crevecoeur, F., Kurtzer, I. L., Bourke, T., & Scott, S. H. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00216.2013 · Cited by 74
“Feedback also plays an important role in voluntary control (Scott 2004; Todorov 2004), leading to increased interest in understanding the complexity present in corrective responses”
Non-Photorealistic Rendering and the science of art
Hertzmann, A. (2010) · International Symposium on Non-Photorealistic Animation and Rendering (NPAR) · doi:10.1145/1809939.1809957 · Cited by 85
Imitating human reaching motions using physically inspired optimization principles
Albrecht, S., Ramírez-Amaro, K., Ugalde, F. R., Weikersdorfer, D., Leibold, M., Ulbrich, M., & Beetz, M. (2011) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2011.6100856 · Cited by 90
Garrido, J. A., Luque, N. R., D'Angelo, E. U., & Ros, E. (2013) · Frontiers in Neural Circuits · doi:10.3389/fncir.2013.00159 · Cited by 86
“…first plans the optimal trajectory in task-space coordinates, translates these into intrinsic-body coordinates, and finally generates the appropriate motor commands to achieve these transitions (Houk et al., 1996; Nakano et al., 1999; Todorov, 2004; Hwang and Shadmehr, 2005; Izawa et al., 2012).”
BackgroundAssembly and function of spinal circuits for motor control
Catela, C., Shin, M. M., & Dasen, J. S. (2015) · Annual Review of Cell and Developmental Biology · doi:10.1146/annurev-cellbio-100814-125155 · Cited by 77
Unexpected complexity of everyday manual behaviors
Yan, Y., Goodman, J. M., Moore, D. D., Solla, S. A., & Bensmaia, S. J. (2020) · Nature Communications · doi:10.1038/s41467-020-17404-0 · Cited by 73
“Indeed, one hypothesis derived from (but not necessarily entailed by) optimal feedback control theory stipulates that the CNS defines low-dimensional manifolds of control to satisfy movement goals on a task-by-task basis, with motor noise being preferentially shunted into dimensions outside of such manifolds [42–44].”
BackgroundHuman-Like Arm Motion Generation: A Review
Gulletta, G., Erlhagen, W., & Bicho, E. G. (2020) · Robotics · doi:10.3390/robotics9040102 · Cited by 83
Floreano, D., Ijspeert, A. J., & Schaal, S. (2014) · Current Biology · doi:10.1016/j.cub.2014.07.058 · Cited by 86
“While complex to compute, optimal control provided interesting explanations of experimental data [98,99] and inspired many other investigations [99,100].”
General-Purpose Filter Design for Neural Prosthetic Devices
Srinivasan, L., Eden, U. T., Mitter, S. K., & Brown, E. N. (2007) · Journal of Neurophysiology · doi:10.1152/jn.01118.2006 · Cited by 75
“First, the subject’s desired arm movement was generated based on the reach state equation (Srinivasan et al. 2005, 2006a) which is related to the stochastic optimal-control model (Bertsekas 2005; Kemere and Meng 2005; Todorov 2004).”
MethodSynergies in Intra- and Interpersonal Interlimb Rhythmic Coordination
Black, D. P., Riley, M. A., & McCord, C. K. (2007) · Motor Control · doi:10.1123/mcj.11.4.348 · Cited by 75
“Recently the uncontrolled manifold (UCM) method has been developed as a means of detecting the presence and quantifying the strength of synergies (Latash, Danion, Scholz, Zatsiorsky, & Schöner, 2003; Latash, Scholz, Danion, & Schöner, 2001; Latash, Scholz, & Schöner, 2002; Scholz, Danion, Latash, & Schöner, 2002; Scho…”
MethodContinuously updating one’s predictions underlies successful interception
Brenner, E., & Smeets, J. B. J. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00517.2018 · Cited by 83
A neural circuit model for human sensorimotor timing
Egger, S. W., Le, N. M., & Jazayeri, M. (2020) · Nature Communications · doi:10.1038/s41467-020-16999-8 · Cited by 81
“(21) and the mean IPI between actions as in Eq.”
BackgroundNeural mechanism of optimal limb coordination in crustacean swimming
Zhang, C., Guy, R. D., Mulloney, B., Zhang, Q., & Lewis, T. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323208111 · Cited by 76
“Brain Res Brain Res Rev 57(1):118–124.”
BackgroundFrom dynamic movement primitives to associative skill memories
Pástor, P., Kalakrishnan, M., Meier, F., Stulp, F., Buchli, J., Theodorou, E. A., & Schaal, S. (2012) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2012.09.017 · Cited by 91
Modeling the Role of Sensory Feedback in Speech Motor Control and Learning
Parrell, B., & Houde, J. (2019) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2019_jslhr-s-csmc7-18-0127 · Cited by 75
“…or SFC , and it has long been a province of engineering control theory, partly because of its ability to generate controls even when sensor feedback is only intermittently available and partly because it forms the basis for optimal control theory (Todorov, 2004, 2006; Todorov & Jordan, 2002).”
BackgroundThe use of flexible arm muscle synergies to perform an isometric stabilization task
Krishnamoorthy, V., Scholz, J. P., & Latash, M. L. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2006.11.014 · Cited by 81
The gravitational imprint on sensorimotor planning and control
White, O., Gaveau, J., Bringoux, L., & Crevecoeur, F. (2020) · Journal of Neurophysiology · doi:10.1152/jn.00381.2019 · Cited by 87
“More specifically, optimal control approach consists in calculating the best sequence of motor commands with respect to a behavioral performance index and based on knowledge of dynamics (Todorov 2004).”
BackgroundFrom Motor Learning to Interaction Learning in Robots
Sigaud, O., & Peters, J. (2009) · Studies in computational intelligence · doi:10.1007/978-3-642-05181-4_1 · Cited by 78
Tactile suppression in goal-directed movement
Juravle, G., Binsted, G., & Spence, C. J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1203-6 · Cited by 80
“One of the principle roles of such an internal model in movement control is to regulate performance by comparing, in real time (i.e., optimal feedback control; Todorov, 2004), the predicted sensory states with the actual sensory states.”
BackgroundCrevecoeur, F., Scott, S. H., & Cluff, T. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.0770-19.2019 · Cited by 87
“In theory, LQG yields efficient control in the presence of Gaussian disturbances based on goal-directed, task-dependent state-feedback control law (Todorov, 2004; Franklin and Wolpert, 2011; Scott, 2012; Crevecoeur and Kurtzer, 2018).”
BackgroundAdaptation to Visual Feedback Delay Influences Visuomotor Learning
Honda, T., Hirashima, M., & Nozaki, D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0037900 · Cited by 86
“Given the importance of continuous visual feedback for motor control and learning [18,24,25], it is possible that the beneficial effect of repeated delay exposure in motor learning is observed only when providing continuous visual feedback.”
BackgroundGaveau, J., Berret, B., Demougeot, L., Fadiga, L., Pozzo, T., & Papaxanthis, C. (2013) · Journal of Neurophysiology · doi:10.1152/jn.01029.2012 · Cited by 77
Woytowicz, E. J., Westlake, K. P., Whitall, J., & Sainburg, R. L. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00878.2017 · Cited by 81
“It is likely that predictive modulation of feedback circuits takes place (Todorov 2004), and we have previously shown that nondominant arm specialization for impedance mechanisms occurs largely through predictive modulation of rapid reflex responses to imposed forces (Bagesteiro and Sainburg 2003; Duff and Sainburg 20…”
BackgroundAdaptive control of dynamic balance in human gait on a split-belt treadmill
Buurke, T. J. W., Lamoth, C. J. C., Vervoort, D., van der Woude, L. H. V., & den Otter, R. (2018) · Journal of Experimental Biology · doi:10.1242/jeb.174896 · Cited by 75
“It has been suggested that the adaptive control of gait serves to decrease energy use (Donelan et al., 2001; Emken et al., 2007; Finley et al., 2013; Sparrow and Newell, 1998; Todorov, 2004; Umberger and Martin, 2007).”
BackgroundBridging developmental systems theory and evolutionary psychology using dynamic optimization
Frankenhuis, W. E., Panchanathan, K., & Clark Barrett, H. (2013) · Developmental Science · doi:10.1111/desc.12053 · Cited by 73
Visuomotor Behaviour in Amblyopia: Deficits and Compensatory Adaptations
Niechwiej‐Szwedo, E., Colpa, L., & WONG, A. M. F. (2019) · Neural Plasticity · doi:10.1155/2019/6817839 · Cited by 82
“Optimal motor performance can be operationally defined as movements that are performed fast and accurately, while minimizing the energy and mental costs [152].”
BackgroundReward-Based Improvements in Motor Control Are Driven by Multiple Error-Reducing Mechanisms
Codol, O., Holland, P. J., Manohar, S., & Galea, J. M. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.2646-19.2020 · Cited by 77
“…5; figure 7K-L): The simulations displayed here incorrectly assume that the noise term remains the same throughout the reach (Shadmehr & Krakauer, 2008; Todorov, 2004) and that feedback can account for errors from one timestep to the next, that is nearly immediately (Bhushan & Shadmehr, 1999).”
BackgroundInfluentialUpper limb kinematics after cervical spinal cord injury: a review
Mateo, S., Roby-Brami, A., Reilly, K. T., Rossetti, Y., Collet, C., & Rode, G. (2015) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-12-9 · Cited by 73
Lio, M. D., Biral, F., Bertolazzi, E., Galvani, M., Bosetti, P., Windridge, D., Saroldi, A., & Tango, F. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2330199 · Cited by 78
“…where they may be used offline to produce motor imagery; to estimate the effect of hypothetical actions; to develop and evaluate plans, such as model-based planning in control theory (e.g., model-predictive control and Optimal Control); and finally, to simulate the observed actions of other people.”
BackgroundMaximum entropy inverse reinforcement learning in continuous state spaces with path integrals
Aghasadeghi, N., & Bretl, T. W. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094679 · Cited by 74
“IRL problems are of interest in a wide range of applications, from basic science [2], [3] to optimal control of aircraft [4] and more recently aerobatic helicopter flight [5] within the robotics community.”
BackgroundGaveau, J., Païzis, C., Berret, B., Pozzo, T., & Papaxanthis, C. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00081.2011 · Cited by 76
“Biological movements are the most efficient in the sense that they optimize some performance criteria, which may include the goal of the movement, the current state of the musculoskeletal system, and the environment (Todorov 2004).”
BackgroundRepresentations of uncertainty in sensorimotor control
Orbán, G., & Wolpert, D. M. (2011) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2011.05.026 · Cited by 82
“This framework has started to tie together previously disparate areas such as planning, on-line control, coordination, and the interaction of effort and noise (for reviews see [10–12]).”
Ranganathan, R., Wieser, J., Mosier, K. M., Mussa-Ivaldi, F. A., & Scheidt, R. A. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.4455-13.2014 · Cited by 71
“The idea that exploration favors the task space over the null space when coordinating multiple degrees of freedom is also consistent with models that emphasize the minimization of both task error and movement effort (Todorov and Jordan, 2002; Todorov, 2004).”
ResultMovement variability near goal equivalent manifolds: Fluctuations, control, and model-based analysis
Cusumano, J. P., & Dingwell, J. B. (2013) · Human Movement Science · doi:10.1016/j.humov.2013.07.019 · Cited by 77
“Schematic diagram in the body state space illustrating the stability geometry for a typical MIP controller with weak POP perturbation.”
BackgroundMethodInfluentialConnecting emotions and words: the referential process
Bucci, W., Maskit, B., & Murphy, S. M. (2015) · Phenomenology and the Cognitive Sciences · doi:10.1007/s11097-015-9417-z · Cited by 81
“According to Todorov (2004), athletic skill requires development of Bforward models^ that involve integration of current sensory information with mental maps built on previous sensory experience; these processes require attention but not verbal intervention.”
BackgroundFeed-forward control of a redundant motor system
Goodman, S. R., & Latash, M. L. (2006) · Biological Cybernetics · doi:10.1007/s00422-006-0086-4 · Cited by 71
“However, as the authors of this approach admit, the computational part of the model introduces substantial complications (Todorov and Jordan 2002; Todorov 2004).”
BackgroundMethodConstraints on neural redundancy
Hennig, J. A., Golub, M. D., Lund, P. J., Sadtler, P. T., Oby, E. R., Quick, K. M., Ryu, S. I., Tyler-Kabara, E. C., Batista, A. P., Yu, B. M., et al. (2018) · eLife · doi:10.7554/elife.36774 · Cited by 69
“OFC models have been widely used to explain muscle activity during motor tasks ( Todorov, 2004 ; Scott, 2004 ; Diedrichsen et al., 2010 ).”
MethodMotor Equivalence (ME) During Reaching: Is ME Observable at the Muscle Level?
Mattos, D. J. D. S., Kuhl, J., Scholz, J. P., & Latash, M. L. (2013) · Motor Control · doi:10.1123/mcj.17.2.145 · Cited by 73
“Some of the schemes imply neural computations (Goodman & Latash, 2006; Todorov, 2004; Todorov & Jordan, 2002), while the rest are based on assuming certain physical and physiological processes.”
BackgroundOptimal Processing Times in Reading: A Formal Model and Empirical Investigation
Smith, N. J., & Lévy, R. (2008) · Proceedings of the Annual Meeting of the Cognitive Science Society · Cited by 85
Distinct eye movement patterns enhance dynamic visual acuity
Palidis, D. J., Wyder-Hodge, P. A., Fooken, J., & Spering, M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172061 · Cited by 71
Internal models of sensorimotor integration regulate cortical dynamics
Egger, S. W., Remington, E. D., Chang, C.-J., & Jazayeri, M. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0500-6 · Cited by 75
Computational motor control: feedback and accuracy
Guigon, E., Baraduc, P., & Desmurget, M. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06028.x · Cited by 76
“The central idea of these models is that the nervous system acts as a stochastically optimal controller, i.e. a controller that plans optimal movements taking the statistics of noise (SDN m ) into account (review in Todorov, 2004).”
BackgroundPassive Motion Paradigm: An Alternative to Optimal Control
Mohan, V., & Morasso, P. (2011) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2011.00004 · Cited by 75
“A later development (Todorov and Jordan, 2002; Todorov, 2004) suggested using an extension of OCT that incorporates sensory feedback in the computational architecture.”
MethodButz, M. V., Herbort, O., & Hoffmann, J. (2007) · Psychological Review · doi:10.1037/0033-295x.114.4.1015 · Cited by 77
Control at stability's edge minimizes energetic costs: expert stick balancing
MILTON, J. G., Meyer, R., Zhvanetsky, M., Ridge, S. E., & Insperger, T. (2016) · Journal of The Royal Society Interface · doi:10.1098/rsif.2016.0212 · Cited by 71
Shared and Task-Specific Muscle Synergies during Normal Walking and Slipping
Nazifi, M. M., Yoon, H. U., Beschorner, K. E., & Hur, P. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00040 · Cited by 78
“Keywords: motor control, muscle synergy, slip, gait, fall Abbreviations: CNS, central nervous system; MH, medial hamstring; TA, tibialis anterior; RF, rectus femoris; MG, medial gastrocnemius; NS, non-slipping (limb); S, slipping (limb).”
Niechwiej‐Szwedo, E., Gonzalez, D., Nouredanesh, M., & Tung, J. Y. (2018) · PLoS ONE · doi:10.1371/journal.pone.0193639 · Cited by 72
Motor-Sensory Confluence in Tactile Perception
Saig, A., Gordon, G., Assa, E., Arieli, A., & Ahissar, E. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.2432-12.2012 · Cited by 71
“Closed-loop optimal control is a method of automatic control in which the operating conditions of the controlled object are maintained such that a criterion function, called performance criterion, target function, or objective function, is maximized (Korovin, 1979; Todorov, 2004).”
Methodde Freitas, P. B., de Freitas, S. M. S. F., Lewis, M. M., Huang, X., & Latash, M. L. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5393-1 · Cited by 69
“Note that we imply in this context finding an optimal solution for a steady-state task, not optimal feedback control schemes that have gained prominence lately (Todorov and Jordan 2002; Todorov 2004; Diedrichsen et al.”
BackgroundBeyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality
Abtahi, P., Hough, S. Q., Landay, J. A., & Follmer, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517706 · Cited by 76
“, catching a ball) and has been used to predict how the human brain plans and controls movement [140] by studying the link between high-level goals and real-time sensorimotor control strategies [178].”
Learning the microstructure of successful behavior
Charlesworth, J. D., Tumer, E. C., Warren, T. L., & Brainard, M. S. (2011) · Nature Neuroscience · doi:10.1038/nn.2748 · Cited by 78
“In principle, the prediction quality in single and dual contingency experiments could have resulted from a mixture of soft constraints that impose smoothness limitations on the structure of behavior and learnin”
BackgroundPaz, R., Natan, C., Boraud, T., Bergman, H., & Vaadia, E. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0164-05.2005 · Cited by 65
“First , because the visuomotor task in - duced visual directional errors , the monkeys might have used a strategy that minimizes errors in this relevant dimension ( Todorov , 2004 ) , but improvement of other less relevant move - ment parameters emerges naturally and occurs more slowly .”
BackgroundProperties of Synergies Arising from a Theory of Optimal Motor Behavior
Chhabra, M., & Jacobs, R. A. (2006) · Neural Computation · doi:10.1162/neco.2006.18.10.2320 · Cited by 71
“We used the same parameter values for the arm as Li and Todorov (2004).”
BackgroundMethodInfluentialChoosing to switch: Spontaneous task switching despite associated behavioral costs
Kessler, Y., Shencar, Y., & Meiran, N. (2009) · Acta Psychologica · doi:10.1016/j.actpsy.2009.03.005 · Cited by 73
“In a broader theoretical context, the tendency to adopt the present set point and to resist changes can be explained by the optimality principle in cognition (Bogacz, 2006; Todorov, 2004).”
BackgroundAsai, Y., Shota, T., & Nomura, T. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062956 · Cited by 72
“For a novel given goal of a motor task, the brain addresses issues concerning motor planning, state estimation, prediction and motor execution, whereby a task specific control strategy is acquired through motor learning [1,2,3].”
BackgroundYeo, S.-H., Franklin, D. W., & Wolpert, D. M. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005190 · Cited by 77
Bilinearity, rules, and prefrontal cortex
Dayan, P. (2007) · Frontiers in Computational Neuroscience · doi:10.3389/neuro.10.001.2007 · Cited by 65
“This approach has been considered in the domain of motor control (e.g., Sanger, 1995; Todorov, 2004), and has obvious application to cognitive control too.”
BackgroundWhen “Simon Says” Doesn’t Work: Alternatives to Imitation for Facilitating Early Speech Development
DeThorne, L. S., Johnson, C. J., Walder, L., & Mahurin‐Smith, J. (2009) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2008/07-0090 · Cited by 74
Synthesizing Anticipatory Haptic Assistance Considering Human Behavior Uncertainty
Medina, J. R., Lorenz, T., & Hirche, S. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2014.2387571 · Cited by 71
“Color versions of one or more of the figures in this paper are available online at http://ieeexplore.ieee.org.”
BackgroundInfluence of haptic guidance in learning a novel visuomotor task
van Asseldonk, E. H. F., Wessels, M., Stienen, A. H. A., van der Helm, F. C. T., & van der Kooij, H. (2009) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2009.08.010 · Cited by 80
Feedback control policies employed by people using intracortical brain–computer interfaces
Willett, F. R., Pandarinath, C., Jarosiewicz, B., Murphy, B. A., Memberg, W. D., Blabe, C. H., Saab, J., Walter, B. L., Sweet, J. A., Miller, J. P., et al. (2017) · Journal of Neural Engineering · doi:10.1088/1741-2560/14/1/016001 · Cited by 57
Exploration of joint redundancy but not task space variability facilitates supervised motor learning
Singh, P., Jana, S., Ghosal, A., & Murthy, A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1613383113 · Cited by 77
Moral Utility Theory: Understanding the motivation to behave (un)ethically
Hirsh, J. B., Lu, J. G., & Galinsky, A. D. (2018) · Research in Organizational Behavior · doi:10.1016/j.riob.2018.10.002 · Cited by 72
“The behaviors that are ultimately selected are the ones that are predicted to most ef fi ciently bring about the desired goal state and thus have the highest SEU (Todorov, 2004).”
A Computational Model of Limb Impedance Control Based on Principles of Internal Model Uncertainty
Mitrović, D., Klanke, S., Osu, R., Kawato, M., & Vijayakumar, S. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013601 · Cited by 73
“Stochastic OFC has been shown to be a powerful theory for interpreting biological motor control [16-19], since it unifies motor costs, expected rewards, internal models, noise and sensory feedback into a coherent mathematical framework [20].”
BackgroundImpaired Endogenously Evoked Automated Reaching in Parkinson's Disease
Torres, E. B., Heilman, K. M., & Poizner, H. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.1150-11.2011 · Cited by 67
Force control in object manipulation—A model for the study of sensorimotor control strategies
Nowak, D. A., Glasauer, S., & Hermsdörfer, J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.06.003 · Cited by 70
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.