Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 801–900 of 1,000
Ikegami, T., & Ganesh, G. (2017) · eNeuro · doi:10.1523/eneuro.0341-17.2017 · Cited by 16
“This mapping is believed to be essential for online feedback control in the presence of neural delays and noises (Todorov and Jordan, 2002; Todorov, 2004).”
BackgroundComputational Approaches for Goal-Directed Movement Planning and Execution
Crevecoeur, F., Cluff, T., & Scott, S. H. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9504.003.0051 · Cited by 18
Excitation of natural spinal reflex loops in the sensory-motor control of hand prostheses
Alva, P. G. S., Boesendorfer, A., Aszmann, O. C., Ibáñez, J., & Farina, D. (2024) · Science Robotics · doi:10.1126/scirobotics.adl0085 · Cited by 18
“This modulation integrates natural mechanisms, such as corrective responses or afferent support for muscle activation ( 40 ), into prosthesis control.”
BackgroundInfluentialAn Optimal Control-Based Formulation to Determine Natural Locomotor Paths for Humanoid Robots
Mombaur, K., Laumond, J., & Yoshida, E. (2010) · Advanced Robotics · doi:10.1163/016918610x487090 · Cited by 15
“[ are used to steer the path generation process and how this task is achieved using a generally highly redundant control space (see, e.g., Refs [16–18]).”
Estimation of Maximum Finger Tapping Frequency Using Musculoskeletal Dynamic Simulations
Shourijeh, M. S., Razavian, R. S., & McPhee, J. (2017) · Journal of Computational and Nonlinear Dynamics · doi:10.1115/1.4036288 · Cited by 15
Human Balance Control: Dead Zones, Intermittency, and Micro-chaos
MILTON, J. G., Insperger, T., & Stépàn, G. (2015) · Springer eBooks · doi:10.1007/978-4-431-55444-8_1 · Cited by 18
“tions indicate that optimal control strategies in the presence of noise and delay are those in which corrective movements are made intermittently [75, 92, 93].”
BackgroundSmith, B. W., Rowe, J. B., & Reinkensmeyer, D. J. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00700.2017 · Cited by 15
“This would imply a trade-off between grip steadiness (which may contribute to movement accuracy) and grip efficiency (the often posited goal of slacking), echoing the accuracy-energetics trade-off associated with optimal feedback control (Todorov 2004).”
BackgroundA switched dynamic model for pointing tasks with a computer mouse
Aranovskiy, S. V., Ushirobira, R., Efimov, D. V., & Casiez, G. (2019) · Asian Journal of Control · doi:10.1002/asjc.2063 · Cited by 15
“The modeling of the ballistic movement as a sensorimotor feedback control for motor coordination in stochastic environment is discussed in [26,27].”
BackgroundRapid Feedback Responses Parallel the Urgency of Voluntary Reaching Movements
Poscente, S. V., Peters, R. M., Cashaback, J. G. A., & Cluff, T. (2021) · Neuroscience · doi:10.1016/j.neuroscience.2021.07.014 · Cited by 17
Neural Control of Stopping and Stabilizing the Arm
Jayasinghe, S. A. L., Scheidt, R. A., & Sainburg, R. L. (2022) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2022.835852 · Cited by 18
“Motor selection and motor planning mechanisms involve optimizing costs, such as smoothness, accuracy, mechanical energy, etc., to produce energetically efficient trajectories (Flash and Hogan, 1985; Alexander, 1997; Todorov, 2004; Nishii and Taniai, 2009; Huang et al., 2012).”
BackgroundInsight into the hierarchical control governing leg stiffness during the stance phase of running
Garofolini, A., Mickle, K. J., McLaughlin, P. A., & Taylor, S. B. (2022) · Scientific Reports · doi:10.1038/s41598-022-16263-7 · Cited by 16
Cognitive control, intentions, and problem solving in skill learning
Christensen, W. D., & Bicknell, K. (2022) · Synthese · doi:10.1007/s11229-022-03920-7 · Cited by 16
“…(1975) schema theory, the internal models approach (Daniel M. Wolpert & Kawato, 1998; Wolpert et al., 1995), Optimal Feedback Control theory (Todorov, 2004), and the coordinative structures of dynamical systems theory (e.g. Kelso & Zanone, 2002), which generate high order patterns in…”
BackgroundSchaefer, L. V., & Bittmann, F. N. (2023) · Frontiers in Medicine · doi:10.3389/fmed.2022.879971 · Cited by 18
Lecomte, C. G., Mari, S., Audet, J., Yassine, S., Merlet, A. N., Morency, C., Harnie, J., Beaulieu, C., Gendron, L., & Frigon, A. (2023) · Journal of Neuroscience · doi:10.1523/jneurosci.0478-23.2023 · Cited by 16
Wei, Q., Li, T., Zhang, J., Li, H., Wang, X., & Xiao, J. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3367884 · Cited by 15
“I T IS a general hypothesis of bionics that agents in nature make decisions in an optimal way, for example, human motions [1] and quadruped gaits [2].”
BackgroundOptimization as motion selection principle in robot action
Laumond, J., Mansard, N., & Lasserre, J. B. (2015) · Communications of the ACM · doi:10.1145/2743132 · Cited by 15
“In life sciences, it is recognized that optimality principles in sensorimotor control explain quite well empirical observations, or at least in any case better than other principles [40].”
BackgroundMechanisms for Robust Cognition
Walsh, M. M., & Gluck, K. A. (2014) · Cognitive Science · doi:10.1111/cogs.12192 · Cited by 15
“This is done using sensory (e.g., visual and prioceptive) and non-sensory (e.g., efferent motor commands) information (Desmurget & Grafton, 2000; Todorov, 2004).”
MethodSlota, G. P., Suh, M. S., Latash, M. L., & Zatsiorsky, V. M. (2012) · Journal of Motor Behavior · doi:10.1080/00222895.2012.665101 · Cited by 15
“ment tasks and from different perspectives (e.g., Guigon, Baraduc, & Desmurget, 2007; Todorov, 2004).”
BackgroundQuickly making the correct choice
Brenner, E., & Smeets, J. B. J. (2015) · Vision Research · doi:10.1016/j.visres.2015.03.028 · Cited by 15
“This has led to the idea that human movements are close to optimal (e.g. Diedrichsen, Shadmehr, & Ivry, 2010; Körding & Wolpert, 2006; Todorov, 2004; Todorov & Jordan, 2002; Trommershäuser, Maloney, & Landy, 2008).”
InfluentialPasciuto, I., Ausejo, S., Celigueta, J. T., Suescun, Á., & Cazón, A. (2013) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-013-0960-3 · Cited by 15
“A knowledge-based approach is also usually followed in predictions involving musculoskeletal DHMs (Anderson and Pandy 2001; Kaplan and Heegaard 2001; Todorov 2004; Eriksson and Nordmark 2011).”
BackgroundAdaptation of the preferred human bouncing pattern toward the metabolically optimal frequency
Merritt, K. J., Raburn, C. E., & Dean, J. C. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00984.2011 · Cited by 15
Vu, V. H., Isableu, B., & Berret, B. (2016) · Neuroscience · doi:10.1016/j.neuroscience.2016.04.027 · Cited by 16
“Interestingly, the optimal control framework precisely makes hypotheses about the variables potentially represented by the brain during motor control (Todorov, 2004).”
Kinematics in the brain: unmasking motor control strategies?
van Dokkum, L. E. H., Mottet, D., Laffont, I., Bonafé, A., de Champfleur, N. M., Froger, J., & Bars, E. L. (2017) · Experimental Brain Research · doi:10.1007/s00221-017-4982-8 · Cited by 15
“The higher the NVP value, the less smooth was the unfolding of the trajectory in space–time, which indicates a higher amount of submovements towards the goal (Todorov 2004).”
Boulanger, M., Giraudet, G., & Faubert, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173678 · Cited by 15
A Hybrid Framework for Understanding and Predicting Human Reaching Motions
Oguz, O. S., Zhou, Z., & Wollherr, D. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00027 · Cited by 17
“Therefore, optimal control theory becomes the central mathematical formulation to model, describe, and understand motor control by the CNS ( Bertsekas et al., 1995; Todorov, 2004), as it emphasizes the optimality of biological movements by minimizing some performance criteria.”
BackgroundActive Viscoelasticity of Sarcomeres
Nguyen, K. D., Sharma, N., & Venkadesan, M. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00069 · Cited by 15
“Such simplified models are essential to elucidate underlying biological principles (Herzog, 2000), and to facilitate intensive computations such as applications of optimal control to study motor behaviors (Todorov, 2004).”
BackgroundMelnyk, A., & Pitti, A. (2018) · Advanced Robotics · doi:10.1080/01691864.2018.1483209 · Cited by 16
Human Movements: Synergies, Stability, and Agility
Latash, M. L. (2018) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-93870-7_7 · Cited by 15
Efficient computation of optimal open-loop controls for stochastic systems
Berret, B., & Jean, F. (2020) · Automatica · doi:10.1016/j.automatica.2020.108874 · Cited by 20
“1 Introduction In fields such as robotics or movement neuroscience, a preliminary motion planning stage is generally considered before movement execution (Todorov, 2004; LaValle, 2006).”
BackgroundMovement curvature planning through force field internal models
Petresкa, B., & Billard, A. (2009) · Biological Cybernetics · doi:10.1007/s00422-009-0300-2 · Cited by 20
“Closed-loop control takes into account the uncertainty of the “real-world” and allows intelligent online corrections as well as robust responses to perturbations, rather than “playing a prerecorded tape” (Todorov 2004).”
BackgroundMethodInfluentialOn Kalman-Bucy filters, linear quadratic control and active inferencePreprint
Baltieri, M., & Buckley, C. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.06269 · Cited by 17
“This reflects recent developments in computational models of perception and behaviour, nowadays mostly described in terms of state estimation, or inference [64, 80, 66, 63, 35], and optimal control [62, 103, 95, 91, 31] respectively.”
BackgroundMovement variability can be modulated in speech production
Tang, D.-L., Parrell, B., & Niziolek, C. A. (2022) · Journal of Neurophysiology · doi:10.1152/jn.00095.2022 · Cited by 15
The influence of movement-related costs when searching to act and acting to search
Moskowitz, J. B., Berger, S. A., Fooken, J., Castelhano, M. S., Gallivan, J. P., & Flanagan, J. R. (2022) · Journal of Neurophysiology · doi:10.1152/jn.00305.2022 · Cited by 17
rTMS over the human medial parietal cortex impairs online reaching corrections
Breveglieri, R., Borgomaneri, S., Bosco, A., Filippini, M., Vitis, M. D., Tessari, A., Avenanti, A., Galletti, C., & Fattori, P. (2023) · Brain Structure and Function · doi:10.1007/s00429-023-02735-7 · Cited by 17
“The prominent theory of optimal feedback control (Todorov and Jordan 2002; Todorov 2004) suggests that sensorimotor gains are used to adapt movement trajectories for successful reaching, and recent studies have shown that those gains are modulated following a specific time-course (Dimitriou et al.…”
BackgroundLearning to select targets within targets in reaching tasks
Herbort, O., Ognibene, D., Butz, M. V., & Baldassarre, G. (2007) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2007.4354040 · Cited by 14
Zhang, Z., & Yang, X. (2019) · Advances in Manufacturing · doi:10.1007/s40436-019-00268-z · Cited by 14
Canonical cortical circuits and the duality of Bayesian inference and optimal control
Doya, K. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.07.003 · Cited by 16
“Models of the motor cortex have also been proposed based on optimal control theory [31,32].”
Hage, R., Detrembleur, C., Dierick, F., Brismée, J., Roussel, N. A., & Pitance, L. (2021) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-021-04876-4 · Cited by 17
“(2018) stated that in order to limit the degrees of freedom and ensure the coherence of movements, proprioceptive relays in the form of feedforward and feedback are essential for optimal performance [70, 71].”
BackgroundAn Engineering Model of Human Balance Control—Part I: Biomechanical Model
Barton, J. E., Roy, A., Sorkin, J. D., Rogers, M. W., & Macko, R. F. (2015) · Journal of Biomechanical Engineering · doi:10.1115/1.4031486 · Cited by 15
Talebian, S., Mousavi, S. J., Olyaei, G., Sanjari, M. A., & Parnianpour, M. (2010) · Spine · doi:10.1097/brs.0b013e3181bc34b5 · Cited by 14
“It is suggested that despite redundancy in the neuromuscular system, the muscle activation patterns used in movements or specific tasks show stereotyped recruitment across subjects and repeated trials.(33,34) Haruno and Wolpert(32) have recently reported that spatiotemporal patterns of both muscle recruitment and kine…”
Backgroundvan de Kamp, C., Gawthrop, P. J., Gollee, H., Lakie, M., & Loram, I. D. (2013) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00055 · Cited by 16
“…broadly representing the prevailing idea of biological control discussed by many authors within the continuous optimal feedback paradigm (e.g., Li et al., 2004; Todorov, 2004; Todorov et al., 2005; Lockhart and Ting, 2007; Karniel, 2011, 2013; Pruszynski and Scott, 2012; Safavynia and Ting, 2012).”
BackgroundConsciousness as Recursive, Spatiotemporal Self-Location
Peters, F. (2009) · Psychological Research · doi:10.1007/s00426-009-0258-7 · Cited by 16
“When somatically active, all movements are constructed on a minimum-trajectory basis which is managed by last-minute, only-as-much-as needed adjustments (Todorov, 2004).”
BackgroundNonlinear Optimal Control of Planar Musculoskeletal Arm Model With Minimum Muscles Stress Criterion
Sharifi, M., Salarieh, H., & Behzadipour, S. (2016) · Journal of Computational and Nonlinear Dynamics · doi:10.1115/1.4034392 · Cited by 14
Adaptive use of interaction torque during arm reaching movement from the optimal control viewpoint
Vu, V. H., Isableu, B., & Berret, B. (2016) · Scientific Reports · doi:10.1038/srep38845 · Cited by 14
Li, Z., Mazzoni, P., Song, S., & Qian, N. (2017) · Neural Computation · doi:10.1162/neco_a_01040 · Cited by 14
“The fourth component of the state vector was assumed to be unobservable (Todorov, 2004; Qian et al., 2013) as there is no evidence that the sensory systems can perceive the third-order temporal derivative of position.”
BackgroundAsymmetrical Relationship between Prediction and Control during Visuomotor Adaptation
Mathew, J., Bernier, P., & Danion, F. (2018) · eNeuro · doi:10.1523/eneuro.0280-18.2018 · Cited by 15
“In the internal model approach, the former mechanism is accounted for by a forward model, also called the predictor or state estimator (Miall and Wolpert, 1996; Wolpert and Ghahramani, 2000; Wolpert and Flanagan, 2001; Todorov, 2004); and the second one is accounted for by an inverse model, also called the controller…”
BackgroundMethodInfluentialHolmes, P., Danforth, S. M., Fu, X.-Y., Moore, T. Y., & Vasudevan, R. (2020) · Royal Society Open Science · doi:10.1098/rsos.191410 · Cited by 17
The role of auditory context in action-effect-related motor adaptation
Neszmélyi, B., & Horváth, J. (2019) · Human Movement Science · doi:10.1016/j.humov.2019.102503 · Cited by 15
Free Energy Principle in Human Postural Control System: Skin Stretch Feedback Reduces the Entropy
Hur, P., Pan, Y.-T., & DeBuys, C. (2019) · Scientific Reports · doi:10.1038/s41598-019-53028-1 · Cited by 15
Mental Representation in Action
Schack, T. (2020) · Wiley eBooks · doi:10.1002/9781119568124.ch24 · Cited by 14
Task-level regulation enhances global stability of the simplest dynamic walker
Patil, N. S., Dingwell, J. B., & Cusumano, J. P. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2020.0278 · Cited by 14
“For a given scalar observable O, a function of the walker’s state, we solve this problem within an optimal control framework [7,8,14,15]: at step k, the optimum push-off, P k , that minimizes the next-step quadratic cost is”
BackgroundHauge, T. C., Katz, G. E., Davis, G. P., Huang, D.-W., Reggia, J. A., & Gentili, R. J. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00685-2 · Cited by 15
Tight or Loose Coupling Between Components of the Feeding Neuromusculature ofAplysia?
Zhurov, Y., Weiss, K. R., & Březina, V. (2005) · Journal of Neurophysiology · doi:10.1152/jn.01338.2004 · Cited by 15
“Comparison with other systems How unusual is our finding of a lack of tight coupling in the neuromusculature? In the very complex neuromuscular system of a vertebrate, during the performance of an arbitrary voluntary task such as reaching for an object in space or even a behavior such as locomotion that is intrinsical…”
BackgroundInfluentialInterregional synchrony of visuomotor tracking: Perturbation effects and individual differences
Spapé, M., & Serrien, D. J. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2010.05.029 · Cited by 14
“It is, however, noteworthy that as the visuomotor task used in this study induced visual directional errors, the participants might have adopted a strategy to minimize errors in this dimension, at least initially [41].”
Dual adaptation to sensory conflicts during whole-body rotations
Dumontheil, I., Panagiotaki, P., & Berthoz, A. (2006) · Brain Research · doi:10.1016/j.brainres.2005.11.091 · Cited by 14
“The neural basis of adaptation to conflicting sensory inputs during motor tasks has been extensively studied (see for instance, review by Berthoz and Melvill Jones, 1985 for gaze control or review by Todorov, 2004 for sensorimotor control).”
Effects of neuromuscular lags on controlling contact transitions
Venkadesan, M., & Valero‐Cuevas, F. J. (2009) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2008.0261 · Cited by 14
“With the discovery of signal-dependent noise in muscles, most contemporary research considers noise as the reason for speed–accuracy trade-offs (Meyer et al. 1990; Harris & Wolpert 1998, 2006; Todorov 2004, 2005).”
BackgroundCHANGE DETECTION, MULTIPLE CONTROLLERS, AND DYNAMIC ENVIRONMENTS: INSIGHTS FROM THE BRAIN
Pearson, J. M., & Platt, M. L. (2012) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.5 · Cited by 15
“Thus, model switching and model learning happen within the same prediction error framework, which can be given a Bayesian formulation in terms of optimal inference about the world (Friston, 2011; Todorov, 2004; Todorov & Jordan, 2002; Wolpert & Kawato, 1998).”
BackgroundValidation of a Human Cooperative Steering Behavior Model Based on Differential Games
Inga, J., Flad, M., & Hohmann, S. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914574 · Cited by 14
“Studies in neuroscience indicate that human motor behavior arises from an optimization process in the central nervous system [6].”
BackgroundBiases and optimality of sensory-motor and cognitive decisions
Trommershäuser, J. (2009) · Progress in brain research · doi:10.1016/s0079-6123(09)01321-1 · Cited by 16
Controlling the gaze direction of a humanoid robot with redundant joints
Faber, F., Bennewitz, M., & Behnke, S. (2008) · IEEE RO-MAN · doi:10.1109/roman.2008.4600701 · Cited by 14
“The similarity between the motion of a human and the movements of an android is measured by differences of the motion at the visible surface.”
BackgroundThe ideal listener: Making optimal use of acoustic -phonetic cues for word recognition
Clayards, M. A., & Aslin, R. Ν. (2008) · UR Research (University of Rochester) · Cited by 38
Crucial hurdles to achieving human-robot harmony
Ghonasgi, K., Higgins, T. M., Huber, M. E., & O’Malley, M. K. (2024) · Science Robotics · doi:10.1126/scirobotics.adp2507 · Cited by 13
Sherback, M., Valero‐Cuevas, F. J., & D’Andrea, R. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000708 · Cited by 15
“For a survey of applications of optimality as an organizing principle of animal behavior see [16,17].”
BackgroundMethodLuque, N. R., Carrillo, R. R., Naveros, F., Garrido, J. A., & Sáez‐Lara, M. J. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.08.002 · Cited by 15
Learning movement primitives from optimal and dynamically feasible trajectories for humanoid walking
Koch, K., Clever, D., Mombaur, K., & Endres, D. (2015) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2015.7363463 · Cited by 13
“Here, it is claimed that the human motor system is optimal (or near optimal) in its choice of movements, given the sensory input and goal specifications [30], [15].”
BackgroundHow optimal is bimanual tracking? The key role of hand coordination in space
Mathew, J., de Rugy, A., & Danion, F. (2019) · Journal of Neurophysiology · doi:10.1152/jn.00119.2019 · Cited by 14
“The computational framework of optimal control theory 70 suggests that when we perform hand movements, muscles and joints are coordinated so as to 71 minimize costs such as effort and/or variability of movement (Harris and Wolpert 1998; 72 Todorov and Jordan 2002; Scott 2004; Todorov 2004; Diedrichsen et al. 2010).”
BackgroundUsing metabolic energy to quantify the subjective value of physical effort
Summerside, E. M., & Ahmed, A. A. (2021) · Journal of The Royal Society Interface · doi:10.1098/rsif.2021.0387 · Cited by 14
Humans use minimum cost movements in a whole-body task
Liu, L., Ballard, D. H., & Hayhoe, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-99423-5 · Cited by 13
Distance effects on visual search and visually guided freehand interaction on large displays
Lou, X., Fu, L., Yan, L., Li, X., & Hansen, P. (2022) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2022.103318 · Cited by 13
Mitoma, H., Kakei, S., Tanaka, H., & Manto, M. U. (2023) · Biology · doi:10.3390/biology12111435 · Cited by 15
“[16,35].”
BackgroundMethodInfluentialHerbort, O. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2013.01.003 · Cited by 13
“Sixth, the optimal control approach has proven to be a successful framework for understanding simpler actions such as saccades or reaching movements (Berthier et al., 2005; Harris & Wolpert, 1998; Todorov & Jordan, 2002; Rosenbaum et al., 1991; for reviews see Engelbrecht, 2001; Todorov, 2004).”
BackgroundThe inflow of sensory information for the control of standing is graded and bidirectional
Tahayori, B., Port, N., & Koceja, D. M. (2012) · Experimental Brain Research · doi:10.1007/s00221-012-3010-2 · Cited by 13
Trial-to-Trial Reoptimization of Motor Behavior Due to Changes in Task Demands Is Limited
de Xivry, J. O. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066013 · Cited by 14
“However, optimal control theory [4] suggests that removing visual information should increase the uncertainty about”
Conservation law for self-paced movements
Huh, D., & B, T. J. S. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1608724113 · Cited by 13
Lio, M. D., Mazzalai, A., & Darin, M. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2731901 · Cited by 13
Modular Organization of Exploratory Force Development Under Isometric Conditions in the Human Arm
Roh, J., Lee, S. W., & Wilger, K. D. (2018) · Journal of Motor Behavior · doi:10.1080/00222895.2017.1423020 · Cited by 14
“Alternatively, muscle coordination in the redundant musculature might be performed by task constraints and optimizing a performance criterion (De Groote, Jonkers, & Duysens, 2014; Todorov 2004; Todorov & Jordan, 2002).”
MethodIslam, R., Cuellar, C. A., Felmlee, B., Riccelli, T. E., Silvernail, J. L., Boschen, S. L., Grahn, P. J., & Lavrov, I. A. (2019) · Scientific Reports · doi:10.1038/s41598-019-52806-1 · Cited by 14
Assessing Emotion by Mouse-cursor Tracking: Theoretical and Empirical Rationales
Yamauchi, T., Leontyev, A., & Razavi, M. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925537 · Cited by 16
“” Research suggests that this cost optimization process unfolds continuously with respect to the goal of the task at hand [33].”
BackgroundStudying Sensorimotor Processing With Physiology in Behaving Drosophila
Seelig, J. D., & Jayaraman, V. (2011) · International review of neurobiology · doi:10.1016/b978-0-12-387003-2.00007-0 · Cited by 13
Nguyen, H., & Dingwell, J. B. (2012) · Journal of Biomechanical Engineering · doi:10.1115/1.4006811 · Cited by 15
“Understanding how the central nervous system regulates and structures movement variability is critical to understanding how humans perform skilled movements [1,17-20].”
BackgroundInfluentialCasellato, C., Pedrocchi, A., Garrido, J. A., Luque, N. R., Ferrigno, G., D'Angelo, E. U., & Ros, E. (2012) · IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob) · doi:10.1109/biorob.2012.6290791 · Cited by 17
“First, the desired trajectory is generated following a minimum-jerk criterion in external space, so facing the kinematic redundancy [15].”
MethodVisuomotor adaptation to a visual rotation is gravity dependent
Toma, S., Sciutti, A., Papaxanthis, C., & Pozzo, T. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00369.2014 · Cited by 14
Individual Driver Modeling via Optimal Selection of Steering Primitives
Flad, M., Trautmann, C., Diehm, G., & Hohmann, S. (2014) · IFAC Proceedings Volumes · doi:10.3182/20140824-6-za-1003.00223 · Cited by 13
Nonlinear Optimization for Human-Like Movements of a High Degree of Freedom Robotics Arm-Hand System
Silva, E. C. E., Costa, M. F. P., Bicho, E. G., & Erlhagen, W. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21931-3_26 · Cited by 16
“In this paper we evaluate the real-time performance of a model for generating trajectories of a high degree of freedom (DOF) robotics arm-hand system that reflects optimality principles of human motor control and key characteristics of human arm trajectories [9].”
MethodRobotics and neuroscience: A rhythmic interaction
Ronsse, R., Lefèvre, P., & Sepulchre, R. J. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.03.005 · Cited by 13
“…(see e.g. Haruno,Wolpert, and Kawato (2001), Kawato (1999), Mehta and Schaal (2002), Miall, Weir, Wolpert, and Stein (1993), Wolpert and Miall (1996) and Wolpert, Miall, and Kawato (1998)) and the theory of optimal control (see e.g. Scott (2004), Todorov (2004) and Todorov and Jordan (2002)).”
Simulating the impact of sensorimotor deficits on reaching performance
Sketch, S. M., Simpson, C. S., Crevecoeur, F., & Okamura, A. M. (2017) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2017.8009217 · Cited by 13
Gopal, A., Jana, S., & Murthy, A. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00329.2017 · Cited by 13
“Previous modeling studies have also proposed the existence of an optimal controller (Enderle and Wolfe 1987; Goossens and van Opstal 2012; Todorov 2004; Todorov and Jordan 2002) that plays a major role in the execution of saccades by maintaining the main sequence relationship.”
MethodApplications of the Free Energy Principle to Machine Learning and NeurosciencePreprint
Millidge, B. (2021) · arXiv (Cornell University) · doi:10.7488/era/1501 · Cited by 18
A Sonomyography-Based Muscle Computer Interface for Individuals With Spinal Cord Injury
Shenbagam, M., Kamatham, A. T., Vijay, P., Salimath, S., Patwardhan, S., Sikdar, S., Kataria, C., & Mukherjee, B. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3359483 · Cited by 14
“Additionally, the slowing of motor outputs could also be a result of central adaptation to preserve endpoint accuracy and stability similar to healthy counterparts [69].”
BackgroundA Computational Model of Deep Brain Stimulation for Parkinson’s Disease Tremor and Bradykinesia
Nair, S. S., & Chakravarthy, V. S. (2024) · Brain Sciences · doi:10.3390/brainsci14060620 · Cited by 14
“In this section, we fi rst introduce the CBG model and the DBS The earliest efforts in modeling coordinated reaching movements started with control-system-based loops [41–45]. intervention.”
MethodResultLu, T., Lu, S.-H., Yu, C.-H., Wu, K., & Kuan, Y. (2024) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-024-01483-x · Cited by 12
Campolo, D., & Cardin, F. (2025) · Applied Mathematical Modelling · doi:10.1016/j.apm.2025.116003 · Cited by 17
Golilarz, N. A., Khatib, H. S. A., & Rahimi, S. (2026) · IEEE Access · doi:10.1109/access.2026.3689754 · Cited by 16
“By incorporating sensorimotor feed-back [78], the framework gains access to real-time environmental constraints.”
Oranchuk, D. J., Nelson, A. R., Lum, D., Natera, A., Bittmann, F. N., & Schaefer, L. V. (2026) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0001264084.99230.dc · Cited by 14
Exploring disturbance as a force for good in motor learning
Brookes, J., Mushtaq, F., Jamieson, E., Fath, A. J., Bingham, G. P., Culmer, P., Wilkie, R. M., & Mon-Williams, M. A. (2020) · PLoS ONE · doi:10.1371/journal.pone.0224055 · Cited by 13
“28 669 understood and, as such, it is difficult to speculate on how the individuals learned to 670 compensate for the complex force field, but we suggest that the learning was likely to 671 involve processes related to optimal feedback control as well as predictive 672 mechanisms [47–49].”
BackgroundSomatosensory Information in Skilled Motor Performance: A Narrative Review
Whittier, T. T., Patrick, C. M., & Fling, B. W. (2023) · Journal of Motor Behavior · doi:10.1080/00222895.2023.2213198 · Cited by 12
“This model of voluntary movement control is known as optimal feedback control (OFC) and reliably explains the use of sensory information during movements (Krakauer & Mazzoni, 2011; Scott, 2004, 2012; Shadmehr et al., 2010; Shadmehr & Krakauer, 2008; Todorov, 2004; Todorov & Jordan, 2002).”
MethodBogard, A. T., Hemmerle, M. R., Smith, A. C., & Tan, A. Q. (2023) · The Journal of Physiology · doi:10.1113/jp285425 · Cited by 14
“As a corollary to error-based learning, there is growing evidence to support the notion that motor adaptation is driven in part to reflect energy optimization (Emken et al., 2007; Todorov, 2004).”
Control of bimanual rhythmic movements: trading efficiency for robustness depending on the context
Ronsse, R., Thonnard, J., Lefèvre, P., & Sepulchre, R. J. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1297-9 · Cited by 13
“Note that the optimal control theory has been recently used to provide an elegant framework to capture planning and control into a single executive system (Todorov and Jordan 2002; Scott 2004; Todorov 2004, 2006; Bays and Wolpert 2007; Liu and Todorov 2007).”
BackgroundMethodInfluentialSmeets, J. B. J., Brenner, E., & Martin, J. (2008) · Advances in experimental medicine and biology · doi:10.1007/978-0-387-77064-2_27 · Cited by 12
“Such models generally optimize some behavioral variable (Todorov, 2004).”
BackgroundDynamical Motor Control Learned with Deep Deterministic Policy Gradient
Shi, H., Sun, Y., & Li, J. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/8535429 · Cited by 12
“The parameters of the controller are adapted to capture the spatial patterns of the state input to generate the desired control command under a certain optimality principle [1, 4].”
Background
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.