Optimality principles in sensorimotor control
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
The sensorimotor system is a product of evolution, development, learning and adaptation-which work on different time scales to improve behavioral performance. Consequently, many theories of motor function are based on 'optimal performance': they quantify task goals as cost functions, and apply the sophisticated tools of optimal control theory to obtain detailed behavioral predictions. The resulting models, although not without limitations, have explained more empirical phenomena than any other class. Traditional emphasis has been on optimizing desired movement trajectories while ignoring sensory feedback. Recent work has redefined optimality in terms of feedback control laws, and focused on the mechanisms that generate behavior online. This approach has allowed researchers to fit previously unrelated concepts and observations into what may become a unified theoretical framework for interpreting motor function. At the heart of the framework is the relationship between high-level goals, and the real-time sensorimotor control strategies most suitable for accomplishing those goals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This matches with a theory of optimal motor control, stating that task-irrelevant errors or variability coming from sensory-motor noise should be left untreated to maximize performance (Liu & Todorov, 2007;Todorov, 2004;Todorov & Jordan, 2002;Wei & Körding, 2009;Wolpert et al., 2011).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“However, the same goal or end-effector movement can be achieved by different solutions (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Often, the artificially generated trajectories are smooth functions that are based on optimality principles approximating human motor control, such as minimal jerk, minimal torque, and minimal torque change (Todorov, 2004).”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Todorov, 2004
In the citing paper
“Optimal feedback control systems have been applied to basic sensorimotor control [97] and to reinforcement learning models [98].”
From Health behavior models in the age of mobile interventions: are our theories up to the task? (2011) · cites this paper as [97]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Advances in Neural Information Processing Systems 14: Proceedings of the 2001 Conference
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 8,890
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“Optimal feedback control explains one of the most thoroughly investigated properties of discrete movements: the scaling of duration with amplitude and desired accurac”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Applied Optimal Control: Optimization, Estimation, and Control
Bryson, A. E., & Ho, Y.-C. (2018) · Routledge eBooks · doi:10.1201/9781315137667 · Cited by 6,015
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694 · cited 1×
“, where it has been used to model neural coding in primary visual corte”
MethodThe co-ordination and regulation of movements
(1969) · Brain Research · doi:10.1016/0006-8993(69)90278-9 · Cited by 5,043 · cited 1×
“; the stereotypical movement patterns it implies are much more common in constrained laboratory tasks than in the real worl”
BackgroundThe coordination of arm movements: an experimentally confirmed mathematical model
Flash, T., & Hogan, N. (1985) · The Journal of Neuroscience · doi:10.1523/jneurosci.05-07-01688.1985 · Cited by 4,395
Research works printed but not linked: 5
- Marr, D. Vision (Freeman, San Francisco, 1982).
- Bernstein, N.I. The Coordination and Regulation of Movements (Pergamon, Oxford, 1967).
- Bryson, A. & Ho, Y. Applied Optimal Control (Blaisdell, Waltham, Massachusetts, 1969).
- Humphrey, D.R. & Reed, D.J. in Advances in Neurology: Motor Control Mechanisms in Health and Disease (ed. Desmedt, J.E) 347–372 (Raven, New York, 1983).
- Todorov, E. & Jordan, M. in Advances in Neural Information Processing Systems vol. 15 (eds. Becker, S., Thrun, S. & Obermayer, K.) 27–34 (MIT Press, Cambridge, Massachusetts, 2002).
Cited by
Items 301–400 of 1,000
Space–Time Separation During Obstacle-Avoidance Learning in Monkeys
Torres, E. B., & Andersen, R. A. (2006) · Journal of Neurophysiology · doi:10.1152/jn.00188.2006 · Cited by 68
“J Neurophysiol 88: 1–13, 2002) assumes that motion strategies are resolved in space independently from the temporal dynamics of the motion and predicts the coarticulation of the hand transport and rotation along the path.”
BackgroundHug, F., Goupille, C., Baum, D., Raiteri, B. J., Hodges, P. W., & Tucker, K. J. (2015) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2015.1908 · Cited by 70
The role of vestibular cues in postural sway
Karmali, F., Goodworth, A. D., Valko, Y., Leeder, T., Peterka, R. J., & Merfeld, D. M. (2021) · Journal of Neurophysiology · doi:10.1152/jn.00168.2020 · Cited by 68
Hidden neural states underlie canary song syntax
Cohen, Y., Shen, J., Semu, D., Leman, D. P., Liberti, W. A., Perkins, L. N., Liberti, D. C., Kotton, D. N., & Gardner, T. J. (2020) · Nature · doi:10.1038/s41586-020-2397-3 · Cited by 65
Smoothness metrics for reaching performance after stroke. Part 1: which one to choose?
Refai, M. I. M., Saes, M., Scheltinga, B. L., van Kordelaar, J., Bussmann, J. B. J., Veltink, P. H., Buurke, J. H., Meskers, C. G. M., van Wegen, E. E. H., Kwakkel, G., et al. (2021) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-021-00949-6 · Cited by 69
Apparent and Actual Trajectory Control Depend on the Behavioral Context in Upper Limb Motor Tasks
Cluff, T., & Scott, S. H. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0902-15.2015 · Cited by 67
“The basic approach of OFC is that motor commands are dictated by a cost function that depends on the behavioral goal (Todorov and Jordan, 2002; Scott, 2004; Todorov, 2004; Diedrichsen et al., 2010).”
BackgroundLiu, X., Mosier, K. M., Mussa-Ivaldi, F. A., Casadio, M., & Scheidt, R. A. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00247.2010 · Cited by 67
“As recognized by Todorov and colleagues (Todorov 2004; Todorov and Jordan 2002) and others (Diedrichsen 2007; Latash et al. 2007; Müller and Sternad 2009; Scheidt et al. 2000; Scholz and Schöner 1999; Smith et al. 2006), examining the evolution of behavior within the null space of the task provides…”
BackgroundMovement Adjustments Have Short Latencies Because There is No Need to Detect Anything
Smeets, J. B. J., Wijdenes, L. O., & Brenner, E. (2015) · Motor Control · doi:10.1123/mc.2014-0064 · Cited by 67
Dingwell, J. B., Salinas, M. M., & Cusumano, J. P. (2017) · Gait & Posture · doi:10.1016/j.gaitpost.2017.03.018 · Cited by 73
“Control inputs, Tn uu 21,xu , were obtained analytically [24] by deriving an unbiased stochastic optimal single-step controller, based on the Minimum Intervention Principle [20], subject to the expected value of the following cost function: 22 2 1 22 uupeC (5) where e is the error with respect to the GEM, vTLe nn , an…”
Marković, M., Schweisfurth, M. A., Engels, L. F., Farina, D., & Dosen, S. S. (2018) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-018-0422-7 · Cited by 69
Fridland, E. (2015) · Synthese · doi:10.1007/s11229-014-0617-9 · Cited by 77
“Also, see Todorov and Jordan (2002), Todorov (2004), Liu and Todorov (2007), Deidrichsen (2007). on the edge of my seat, I’ll grip the steering wheel tightly with both hands, I won’t pay attention to the music, etc.”
BackgroundBayesian Sensorimotor Psychology
Rescorla, M. (2016) · Mind & Language · doi:10.1111/mila.12093 · Cited by 74
Systemic effects of deep brain stimulation on synergic control in Parkinson’s disease
Falaki, A., Jo, H. J., Lewis, M. M., O'Connell, B., Jesus, S. D., McInerney, J., Huang, X., & Latash, M. L. (2018) · Clinical Neurophysiology · doi:10.1016/j.clinph.2018.02.126 · Cited by 64
McKay, J. L., & Ting, L. H. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002465 · Cited by 69
“Further, it has been argued that low-dimensional muscle patterns emerge from optimization of the activation of individual muscles, without explicit neural constraints on muscle activation [1,2].”
BackgroundZhang, H., Wu, S., & Maloney, L. T. (2010) · Journal of Vision · doi:10.1167/10.6.1 · Cited by 63
“[PubMed] Todorov, E., & Jordan, M. I. (2002).”
BackgroundAihara, T., Kitajo, K., Nozaki, D., & Yamamoto, Y. (2010) · Chemical Physics · doi:10.1016/j.chemphys.2010.04.027 · Cited by 72
Individuals have unique muscle activation signatures as revealed during gait and pedaling
Hug, F., Vogel, C., Tucker, K. J., Dorel, S., Deschamps, T., Carpentier, É. L., & Lacourpaille, L. (2019) · Journal of Applied Physiology · doi:10.1152/japplphysiol.01101.2018 · Cited by 62
High-gamma band activity of primary hand cortical areas: A sensorimotor feedback efficiency index
Tecchio, F., Zappasodi, F., Porcaro, C., Barbati, G., Assenza, G., Salustri, C., & Rossini, P. M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.038 · Cited by 69
“The aim of obtaining indexes of sensorimotor feedback efficiency originates from the crucial role played by feedback in the learning processes (Todorov, 2004; Bastian, 2006).”
BackgroundThe Dorsal Striatum Energizes Motor Routines
Jurado-Parras, M.-T., Safaie, M., Sarno, S., Louis, J., Karoutchi, C., Berret, B., & Robbe, D. (2020) · Current Biology · doi:10.1016/j.cub.2020.08.049 · Cited by 72
Neuromuscular control: from a biomechanist's perspective
Mulla, D. M., & Keir, P. J. (2023) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2023.1217009 · Cited by 73
“In biomechanics and motor control, optimality principles have been the predominant approach over the past half-century for resolving the degrees of freedom problem, including the prediction of load-sharing across muscles and movement trajectories (123, 124).”
BackgroundRhythmic Manipulation of Objects with Complex Dynamics: Predictability over Chaos
Nasseroleslami, B., Hasson, C. J., & Sternad, D. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003900 · Cited by 65
“This finding contradicted the dominant role of force minimization in human motor coordination [18,19], which is frequently invoked as one of the main optimization costs in optimal feedback control [11,36].”
ResultReinforcement learning control of a biomechanical model of the upper extremity
Fischer, F., Bachinski, M., Klar, M., Fleig, A., & Müller, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-93760-1 · Cited by 69
Lindsay, R. S., & Spittle, M. (2024) · International Journal of Sports Science & Coaching · doi:10.1177/17479541241240853 · Cited by 72
“Todorov 33 describes this as the minimal intervention principle (MIP), whereby a coach should only intervene when deviations in movement patterns interfere with performance outcomes.”
BackgroundHerter, T. M., Korbel, T., & Scott, S. H. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90230.2008 · Cited by 60
“Recently however, the importance of afferent feedback for voluntary control has been reilluminated by the hypothesis that the volitional motor system may behave like an optimal feedback controller (Todorov and Jordan 2002; Todorov 2004).”
Toward Functional Classification of Neuronal Types
Sharpee, T. O. (2014) · Neuron · doi:10.1016/j.neuron.2014.08.040 · Cited by 58
Brain–Machine Interface Control Algorithms
Shanechi, M. M. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2639501 · Cited by 61
“Quadratic cost functions have also been used to build OFC models in motor control studies [76], [77], [80], [81].”
MethodRapid target foraging with reach or gaze: The hand looks further ahead than the eye
Diamond, J. S., Wolpert, D. M., & Flanagan, J. R. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005504 · Cited by 65
Individual Movement Variability Magnitudes Are Explained by Cortical Neural Variability
Haar, S., Donchin, O., & Dinstein, I. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.1650-17.2017 · Cited by 72
“…of specific kinematic components such as movement extent and movement direction is thought to be governed by independent neural processes (Gordon et al., 1994b; Krakauer et al., 2000; van Beers, 2009) according to the demands of the examined motor task (Todorov, 2004; Latash et al., 2007).”
BackgroundHow people initiate energy optimization and converge on their optimal gaits
Selinger, J. C., Wong, J. D., Simha, S. N., & Donelan, J. M. (2019) · Journal of Experimental Biology · doi:10.1242/jeb.198234 · Cited by 77
“While there is a growing body of evidence that preferred behaviour in these various tasks indeed optimizes reasonable objective functions, how the nervous system performs this optimization is largely unknown (Franklin and Wolpert, 2011; Todorov, 2004).”
BackgroundInfluentialGenerality and legibility in mobile manipulation: Learning skills for routine tasks
Beetz, M., Stulp, F., Esden-Tempski, P., Fedrizzi, A., Klank, U., Kresse, I., Maldonado, A., & Ruiz, F. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9152-9 · Cited by 70
“very long and multi-faceted optimization process (Todorov 2004).”
BackgroundMotor primitives and synergies in the spinal cord and after injury—the current state of play
Giszter, S. F., & Hart, C. B. (2013) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12065 · Cited by 64
Effects of social intention on movement kinematics in cooperative actions
Quesque, F., Lewkowicz, D., Delevoye, Y., & Coello, Y. (2013) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2013.00014 · Cited by 62
“Current models of motor control (for a review, see Todorov, 2004) are based on optimized function costs that are often named minimum-X (jerk, torque change, energy, time, variance, etc.).”
BackgroundRisk-sensitivity and the mean-variance trade-off: decision making in sensorimotor control
Nagengast, A. J., Braun, D. A., & Wolpert, D. M. (2011) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2010.2518 · Cited by 64
Towards an ecologically grounded functional practice in rehabilitation
Vaz, D. V., da Silva, P. L. P., Mancini, M. C., Carello, C., & Kinsella-Shaw, J. M. (2017) · Human Movement Science · doi:10.1016/j.humov.2017.01.010 · Cited by 67
Crevecoeur, F., Sepulchre, R. J., Thonnard, J., & Lefèvre, P. (2011) · Automatica · doi:10.1016/j.automatica.2011.01.026 · Cited by 53
“Recent results on the neural control of movement suggest that the control process used by the brain presents many features of an optimal feedback controller (Scott, 2004; Shadmehr & Krakauer, 2008; Todorov, 2004).”
BackgroundCatching a Ball at the Right Time and Place: Individual Factors Matter
Cesqui, B., d’Avella, A., Portone, A., & Lacquaniti, F. (2012) · PLoS ONE · doi:10.1371/journal.pone.0031770 · Cited by 65
“In this context, flexible and equivalent motor behaviors may be obtained by controlling only those combinations of degrees of freedom which are relevant for successful performance [7], thus leaving most variability due to noise in task-irrelevant combinations [8].”
BackgroundFunctional reorganization of upper-body movement after spinal cord injury
Casadio, M., Pressman, A., Fishbach, A., Danziger, Z. C., Acosta, S., Chen, D., Tseng, H.-Y., & Mussa-Ivaldi, F. A. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2427-8 · Cited by 60
“However, it may be incongruent with the view that the motor system shifts its variance to an ‘‘uncontrolled manifold’’ (Scholz and Schoner 1999; Latash et al. 2001, 2002; Todorov 2004).”
BackgroundMotivation dynamically increases noise resistance by internal feedback during movement
Manohar, S., Muhammed, K., Fallon, S. J., & Husain, M. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2018.07.011 · Cited by 64
“Such findings contravene traditional optimal control theory, which predicts that speed should trade off with accuracy, because moving faster requires larger motor control signals (Harris and Wolpert, 1998; Todorov, 2004).”
Approaches to human arm movement control—A review
Campos, F. M., & Calado, J. M. F. (2009) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2009.03.001 · Cited by 71
“Todorov (2004) suggests that an important missing study would be the identification of the characteristics of human movement in different tasks, in a way that the quantities being optimised would be recognised.”
BackgroundShanechi, M. M., Wornell, G. W., Williams, Z. M., & Brown, E. N. (2012) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2012.2221743 · Cited by 60
Optimal Sensorimotor Control in Eye Movement Sequences
Munuera, J., Morel, P., Duhamel, J., & Denève, S. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.1169-08.2009 · Cited by 60
“, position and velocity) and an inverse model to compute the motor command given the internal estimate (Wolpert et al., 1995; Wolpert and Kawato, 1998; Todorov, 2004).”
MethodLearning control in robot-assisted rehabilitation of motor skills – a review
Zhou, S.-H., Fong, J., Crocher, V., Tan, Y., Oetomo, D., & Mareels, I. (2016) · Journal of Control and Decision · doi:10.1080/23307706.2015.1129295 · Cited by 65
“…2006; van Beers, 2009, 2012), and machine learning (Peters & Schaal, 2008; Shteingart & Loewenstein, 2014), or learning a class of parametrised motor primitives (Mussa-Ivaldi & Bizzi, 2000; Nori & Frezza, 2005) and even optimal control design (Li & Todorov, 2004; Todorov, 2004; Todorov & Li, 2005).”
BackgroundMethodToward a Unified Sub-symbolic Computational Theory of Cognition
Butz, M. V. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00925 · Cited by 51
“Theories of optimal control, which are closely related to active inference (Friston et al., 2010; Friston, 2011), can approximately model such behavior (Todorov, 2004).”
BackgroundA cross-species neural integration of gravity for motor optimization
Gaveau, J., Grosprêtre, S., Berret, B., Angelaki, D. E., & Papaxanthis, C. (2021) · Science Advances · doi:10.1126/sciadv.abf7800 · Cited by 64
“…that the brain builds internal representations of the environmental and musculoskeletal dynamics to optimise motor planning and control (Franklin and Wolpert, 2011; Guigon et al., 2008; Izawa et al., 2008; Shadmehr and Wise, 2005; Shadmehr et al., 2010; Todorov, 2004; Wolpert and Ghahramani, 2000).”
BackgroundFocal dystonia and the Sensory-Motor Integrative Loop for Enacting (SMILE)
Perruchoud, D., Murray, M. M., Lefebvre, J., & Ionta, S. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00458 · Cited by 63
“Basic research in neuroscience has produced converging evidence on the tight relationship between movement generation and recalibration (see also Todorov, 2004).”
BackgroundInterfacing With the Computational Brain
Jackson, A., & Fetz, E. E. (2011) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2011.2158586 · Cited by 55
“Optimal control theory can be formulated mathematically by defining a cost function, and selecting a control policy to minimize that function [55], [56].”
BackgroundVigour of self-paced reaching movement: cost of time and individual traits
Berret, B., Castanier, C., Bastide, S., & Deroche, T. (2018) · Scientific Reports · doi:10.1038/s41598-018-28979-6 · Cited by 58
Rapid Visuomotor Responses Reflect Value-Based Decisions
Carroll, T. J., McNamee, D., Ingram, J. N., & Wolpert, D. M. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.1934-18.2019 · Cited by 56
“The selection of an “action” to be taken is therefore better conceived of as the specification of a feedback control policy that continuously transforms internal neural states and sensory inputs into motor outputs (Todorov and Jordan, 2002; Scott, 2004; Todorov, 2004).”
BackgroundA Computational Model for Rhythmic and Discrete Movements in Uni- and Bimanual Coordination
Ronsse, R., Sternad, D., & Lefèvre, P. (2009) · Neural Computation · doi:10.1162/neco.2008.03-08-720 · Cited by 55
“The modeling of the cortical processing involved in the planning, control, and sensory integration of discrete reaching movements has recently been reviewed in the context of optimization principles (see Jordan & Wolpert, 1999; Wolpert & Ghahramani, 2000; Todorov & Jordan, 2002; Todorov, 2004).”
Studying the neural representations of uncertainty
Walker, E. Y., Pohl, S., Denison, R. N., Barack, D. L., Lee, J., Block, N., Ma, W. J., & Meyniel, F. (2023) · Nature Neuroscience · doi:10.1038/s41593-023-01444-y · Cited by 56
“2011), motor control (Todorov 2004; Trommershäuser et al. 2008), and memory (Flavell & Wellman 1977; Koriat et al.”
BackgroundThe delayed and noisy nervous system: implications for neural control
MILTON, J. G. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/6/065005 · Cited by 58
“Two mechanisms have been proposed: (1) stochastic optimal control when time delays are sufficiently small that they can be compensated [74, 75] and (2) switch-like controllers when time delays are too large to be compensated [26, 27, 63, 65, 66, 76–78].”
BackgroundHuman motion in cooperative tasks: Moving object case study
Miossec, S., & Kheddar, A. (2009) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio.2009.4913224 · Cited by 64
“In a synthetic review of the optimality principles governing human sensorimotor motions, two general approaches are distinguished [1]: (i) open-loop optimization that can explain average behaviors, (ii) closed-loop optimization that can explain detailed behaviors in reaction to environment change…”
BackgroundRobot learning from demonstrations: Emulation learning in environments with moving obstacles
E., A. M. G., & Ragaglia, M. (2017) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.12.001 · Cited by 65
“Teaching a robot how to perform the pick-and-place task in a dynamic environment is very challenging and demanding (Wheeler et al., 2002).”
BackgroundSaraf‐Sinik, I., Assa, E., & Ahissar, E. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.4149-14.2015 · Cited by 55
“Studies of motor tasks (Shadmehr et al., 2010), perceptual tasks (Saig et al., 2012), and optimal control theory (Todorov, 2004) suggest two major types of motor variables that can be measured during the performance of a given task: “controlled variables,” which the system aims to maintain within a…”
BackgroundPruszynski, J. A. (2014) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2014.00072 · Cited by 56
“This type of adaptive control has been shown in various contexts for voluntary motor control (Latash et al., 2002; Todorov, 2004) but, so far has only been suggested with respect to the long-latency stretch response (Scott, 2004).”
Rapid visuomotor feedback gains are tuned to the task dynamics
Franklin, S., Wolpert, D. M., & Franklin, D. W. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00748.2016 · Cited by 54
“Modulation of the feedback responses, according to the environmental dynamics, is appropriate when we consider the optimal feedback control theory of motor control (Scott 2004; Todorov 2004; Todorov and Jordan 2002).”
BackgroundCoelho, C. J., Przybyla, A., Yadav, V. H., & Sainburg, R. L. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00885.2012 · Cited by 59
“A popular approach to the problem of action selection has been to identify linkages within the neuromuscular system and then to model behavior as optimizations performed under those constraints (Bernstein 1967; Todorov 2004).”
Optimal Control of Gaze Shifts
Kardamakis, A. A., & Moschovakis, A. K. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.5518-08.2009 · Cited by 57
“Optimal control theory (Wolpert and Ghahramani, 2000; Todorov, 2004) exploits the kinematic and dynamic stereotypes of observed movements to gain insight into these mechanisms.”
BackgroundMira, P. J. R., Seix, C. R., & Bramona, J. F. (2013) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 55
A Synthesis of the Many Errors and Learning Processes of Visuomotor AdaptationPreprint
Morehead, J. R., & de Xivry, J. O. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.03.14.435278 · Cited by 60
“In the latter case, the motor commands are computed in relation to the loss function, which is not really part of the control scheme (Pruszynski and Scott 2012; Scott 2004; Shadmehr and Krakauer 2008; Todorov 2004; Todorov and Jordan 2002).”
BackgroundMethodInfluentialKessler, F., Frankenstein, J., & Rothkopf, C. A. (2024) · Nature Communications · doi:10.1038/s41467-024-49722-y · Cited by 66
Tavares, G., & Faisal, A. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065774 · Cited by 59
“In neuroscience, the variability in human decision making and motor behaviour has been found to display a characteristic variability structure [2] than can be used to predict the behavioural decisions and performance of individuals [3].”
BackgroundPitch Representations in the Auditory Nerve: Two Concurrent Complex Tones
Larsen, E., Cedolin, L., & Delgutte, B. (2008) · Journal of Neurophysiology · doi:10.1152/jn.01361.2007 · Cited by 54
“The idea of matching incoming sensory data to templates generated from internal models of sensory signal processing is widely accepted in studies of sensori-motor control (e.g. Merfeld et al. 1999; Todorov 2004; Guenther et al. 2006).”
Muscular fatigue increases signal-dependent noise during isometric force production
Missenard, O., Mottet, D., & Perrey, S. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2008.03.090 · Cited by 60
Human Leg Model Predicts Ankle Muscle-Tendon Morphology, State, Roles and Energetics in Walking
Krishnaswamy, P., Brown, E. N., & Herr, H. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001107 · Cited by 54
“Understanding how these redundancies are resolved in typical joint movements has been a long-standing problem in biomechanics, neuroscience and prosthetics [1,2].”
BackgroundTwo heads are better than one: both complementary and synchronous strategies facilitate joint action
Masumoto, J., & Inui, N. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00776.2012 · Cited by 61
“In the present study, the force error compensation is consistent with the optimal feedback control theory (Todorov 2004; Todorov and Jordan 2002), which suggests that the central nervous system sets up feedback controllers that continuously convert the state estimate (an internal representation of…”
ResultDeconstructing skill learning and its physiological mechanisms
Spampinato, D. A., & Celnik, P. A. (2018) · Cortex · doi:10.1016/j.cortex.2018.03.017 · Cited by 60
Promsri, A., Longo, A., Haid, T. H., Doix, A.-C. M., & Federolf, P. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16183399 · Cited by 54
The energetic basis for smooth human arm movements
Wong, J. D., Cluff, T., & Kuo, A. D. (2021) · eLife · doi:10.7554/elife.68013 · Cited by 57
Adaptive Motor Imagery: A Multimodal Study of Immobilization-Induced Brain Plasticity
Burianová, H., Sowman, P. F., Marstaller, L., Rich, A. N., Williams, M., Savage, G. R., Al‐Janabi, S., de Lissa, P., & Johnson, B. W. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu287 · Cited by 55
Auditory representation of learned sound sequences in motor regions of the macaque brain
Archakov, D., DeWitt, I., Kuśmierek, P., Ortiz-Rios, M., Cameron, D. J., Cui, D., Morin, E. L., VanMeter, J. W., Sams, M. E., Jääskeläinen, I. P., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915610117 · Cited by 54
“Building on early, pioneering work (13–15), studies incorporating optimality principles (16), such as optimal state estimation (17, 18) and state feedback control (19–22), have been successful in capturing important dynamics of human vocal communication.”
BackgroundDegenerate coding in neural systems
Leonardo, A. M. (2005) · Journal of Comparative Physiology A · doi:10.1007/s00359-005-0026-0 · Cited by 53
“Can degeneracy exist in a sensory system? Degeneracy has been known to be an important part of motor control for many years (Todorov 2004), and the analysis of birdsong motor control shows how neural circuit dynamics fit naturally within this framework.”
BackgroundInfluentialThe cost of moving optimally: kinematic path selection
Kistemaker, D. A., Wong, J. D., & Gribble, P. L. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00291.2014 · Cited by 53
A bilevel optimization approach to obtain optimal cost functions for human arm movements
Albrecht, S., Leibold, M., & Ulbrich, M. (2012) · Numerical Algebra Control and Optimization · doi:10.3934/naco.2012.2.105 · Cited by 64
“As Todorov [50] stated, “the true performance criterion in most cases is likely to involve a mix of cost terms”.”
BackgroundSánchez, N., Park, S., & Finley, J. M. (2017) · Scientific Reports · doi:10.1038/s41598-017-08147-y · Cited by 56
“Here, the net impulse is expressed as the sum of the propulsive and braking impulse magnitudes, baseline corrected to the TiedFBK condition. β β β β∆ = + + + ∗ + + + + ∗NetImpulse Asym Leg Asym Leg b b Asym b Leg b Asym Leg (4)0 1 2 3 0 1 2 3 For the distribution of step length asymmetries that minimized the net impul…”
BackgroundMethodInfluentialOptimality, stochasticity, and variability in motor behavior
Guigon, E., Baraduc, P., & Desmurget, M. (2007) · Journal of Computational Neuroscience · doi:10.1007/s10827-007-0041-y · Cited by 60
Embodied Communication: How Robots and People Communicate Through Physical Interaction
Kalinowska, A., Pilarski, P. M., & Murphey, T. D. (2023) · Annual Review of Control Robotics and Autonomous Systems · doi:10.1146/annurev-control-070122-102501 · Cited by 59
On Curve Negotiation: From Driver Support to Automation
Bosetti, P., Lio, M. D., & Saroldi, A. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2395819 · Cited by 55
“a convenient mathematical tool for such problem category, but mainly because of the consolidated opinion—in cognitive and behavioral sciences—that optimal control successfully models flexible/optimized human sensory-motor strategies [29]–[31].”
BackgroundInfluentialNetwork Dynamics Mediating Ipsilateral Motor Cortex Activity during Unimanual Actions
Verstynen, T., & Ivry, R. B. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2011.21612 · Cited by 53
Myoelectric control with abstract decoders
Dyson, M., Barnes, J., & Nazarpour, K. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aacbfe · Cited by 55
“The skewed MAV profile observed in late trials is contingent with minimum-variance models which optimise performance by producing larger commands earlier, allowing for more time to detect and correct any errors resulting from controldependent noise [74].”
BackgroundInverse Optimal Control for Multiphase Cost Functions
Jin, W., Kulić, D., Lin, J. F.-S., Mou, S., & Hirche, S. (2019) · IEEE Transactions on Robotics · doi:10.1109/tro.2019.2926388 · Cited by 52
“For example, prior studies [4], [5] show that human motions tend to minimize different costs in different circumstances depending on tasks and environmental”
BackgroundHow Does Our Motor System Determine Its Learning Rate?
van Beers, R. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049373 · Cited by 60
“Although different frameworks have been used, such as optimal (feedback) control (for reviews, see: [1,2]), statistical decision theory (for a review, see: [3]), and Bayesian decision theory (for reviews, see: [4,5]), all of these studies found evidence for the principle that our motor system attempts to minimize a co…”
MethodStewart, B. M., Baugh, L. A., Gallivan, J. P., & Flanagan, J. R. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00131.2013 · Cited by 58
“…a situation could occur if participants aimed to minimize a cost function associated with corrective translational movements of the hand such as the variance of durations or energy outlays of these movements (for reviews dealing with cost functions, see Diedrichsen et al. 2010 and Todorov 2004).”
BackgroundMaÿe, A., Hsieh, C., Sugihara, G., & Brembs, B. (2007) · SciVee · doi:10.4016/726.01 · Cited by 52
Optimality, Stability, and Agility of Human Movement: New Optimality Criterion and Trade-Offs
Latash, M. L. (2022) · Motor Control · doi:10.1123/mc.2021-0135 · Cited by 52
Control of Precision Grip Force in Lifting and Holding of Low-Mass Objects
Hiramatsu, Y., Kimura, D., Kadota, K., Ito, T., & Kinoshita, H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138506 · Cited by 51
“Optimal sensori-motor control theories use cost functions to explain how actions are performed [64].”
BackgroundKinematic Analysis of Mae-Geri Kicks in Beginner and Advanced Kyokushin Karate Athletes
Błaszczyszyn, M., Szczęsna, A., Pawlyta, M., Marszałek, M., & Karczmit, D. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16173155 · Cited by 51
“Consequently, instead of activation of all joints, the brain modifies the position using only a few joints, leaving less important ones unchanged for effective movement performance [29].”
BackgroundPlanning and control of hand orientation in grasping movements
Herbort, O., & Butz, M. V. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2191-9 · Cited by 50
“These results imply that even though some aspects of human manual action seem to be strictly optimized (for a review see Todorov 2004 ), the selection of the grasp orientation does not seem to be subject to such optimization.”
BackgroundIdentification of intermittent control in man and machine
Loram, I. D., van de Kamp, C., Gollee, H., & Gawthrop, P. J. (2012) · Journal of The Royal Society Interface · doi:10.1098/rsif.2012.0142 · Cited by 57
Evidence for Continuous Processing of Visual Information in a Manual Video-Aiming Task
Proteau, L., Roujoula, A., & Messier, J. (2009) · Journal of Motor Behavior · doi:10.3200/jmbr.41.3.219-231 · Cited by 50
Directionality in distribution and temporal structure of variability in skill acquisition
Abe, M., & Sternad, D. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00225 · Cited by 50
“The same concept has been part of the stochastic optimal feedback control framework, where only errors in directions irrelevant for task achievement are penalized by the cost function (Todorov and Jordan, 2002; Todorov, 2004).”
BackgroundNeural correlates of lower limbs proprioception: An fMRI study of foot position matching
Iandolo, R., Bellini, A., Saiote, C., Marre, I., Bommarito, G., Oesingmann, N., Fleysher, L., Mancardi, G., Casadio, M., & Inglese, M. (2018) · Human Brain Mapping · doi:10.1002/hbm.23972 · Cited by 55
“This is in accordance with the results for the upper limb movements, where the variability depended on movement execution noise and increased proportionally in relation to the strength of the motor command, that is, the effort (Van Beers, Haggard, Wolpert, & Beers, 2004; Harris & Wolpert, 1998; Todorov, 2004), but is…”
BackgroundResultThe Promise of Stochastic Resonance in Falls Prevention
White, O., Babič, J., Trenado, C., Johannsen, L., & Goswami, N. (2019) · Frontiers in Physiology · doi:10.3389/fphys.2018.01865 · Cited by 54
“Should additional tactile and proprioceptive information become available, however, more accurate state estimates based on multisensory integration and prediction may decrease the likelihood of unsuccessful behaviors (Wolpert and Ghahramani, 2000; Todorov, 2004).”
BackgroundParabolic movement primitives and cortical states: merging optimality with geometric invariance
Polyakov, F., Stark, E., Drori, R., Abeles, M., & Flash, T. (2009) · Biological Cybernetics · doi:10.1007/s00422-008-0287-0 · Cited by 50
Learning impedance control of antagonistic systems based on stochastic optimization principles
Mitrović, D., Klanke, S., & Vijayakumar, S. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910387653 · Cited by 53
“Optimality principles have successfully been used in biological (Flash and Hogan 1985; Scott 2004; Todorov 2004) and in artificial systems (Nakamura and Hanafusa 1987; Cortes et al.”
BackgroundMethodCasarotti, M., Lisi, M., Umiltà, C. A., & Zorzi, M. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00231 · Cited by 52
“Growing empirical evidence suggests that the brain integrates sensory and motor signals using such internal models to perform a variety of tasks, such as predicting sensory information and optimal motor control (Todorov, 2004; Desmurget & Grafton, 2000; Kawato, 1999; Wolpert, Ghahramani, & Jordan, 1995).”
BackgroundBody machine interface: Remapping motor skills after spinal cord injury
Casadio, M., Pressman, A., Acosta, S., Danzinger, Z., Fishbach, A., Mussa-Ivaldi, F. A., Muir, K., Tseng, H.-Y., & Chen, D. (2011) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2011.5975384 · Cited by 51
“However, it may be incongruent with the view that the motor system shifts its variance to an ‘‘uncontrolled manifold’’ (Scholz and Schoner 1999; Latash et al. 2001, 2002; Todorov 2004).”
BackgroundQian, N., Jiang, Y., Jiang, Z., & Mazzoni, P. (2012) · Neural Computation · doi:10.1162/neco_a_00410 · Cited by 55
“This C matrix assumes that the fourth component of the state vector is unobservable (Todorov, 2004).”
BackgroundInfluentialRisk sensitivity in a motor task with speed-accuracy trade-off
Nagengast, A. J., Braun, D. A., & Wolpert, D. M. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00804.2010 · Cited by 48
Searching for simplicity in the analysis of neurons and behavior
Stephens, G. J., Osborne, L. C., & Bialek, W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010868108 · Cited by 48
“[11] Todorov, E (2004) Optimality principles in sensorimotor control.”
Background
Metadata
- Authors
- Todorov, E.
- Affiliations
- University of California San Diego (US)
- Corresponding author
- Todorov, Emanuel
- Venue
- Nature Neuroscience
- Published
- 2004-08-26
- Volume
- 7
- Issue
- 9
- Pages
- 907-915
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- PMC
- PMC1488877
- OpenAlex
- W2029776687
- Cited by
- 1,746
- References
- 129
- Citations by year
- 2026: 46 · 2025: 99 · 2024: 97 · 2023: 84 · 2022: 70 · 2021: 103 · 2020: 100 · 2019: 89 · 2018: 100 · 2017: 83 · 2016: 87 · 2015: 97 · 2014: 69 · 2013: 94 · 2012: 106
- FWCI
- 2.33
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Neuroscience (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Neurological Disorders and Stroke (R01NS045915)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- sensorimotor control, optimal control, cost function, feedback control law, motor learning, motor adaptation, movement trajectories, online motor control
- MeSH terms
- Adaptation, Physiological, Animals, Computer Simulation, Feedback, Humans, Models, Neurological, Movement, Psychomotor Performance, Stochastic Processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.