Dynamics systems vs. optimal control — a unifying view
Open accessAbstract
In the past, computational motor control has been approached from at least two major frameworks: the dynamic systems approach and the viewpoint of optimal control. The dynamic system approach emphasizes motor control as a process of self-organization between an animal and its environment. Nonlinear differential equations that can model entrainment and synchronization behavior are among the most favorable tools of dynamic systems modelers. In contrast, optimal control approaches view motor control as the evolutionary or development result of a nervous system that tries to optimize rather general organizational principles, e.g., energy consumption or accurate task achievement. Optimal control theory is usually employed to develop appropriate theories. Interestingly, there is rather little interaction between dynamic systems and optimal control modelers as the two approaches follow rather different philosophies and are often viewed as diametrically opposing. In this paper, we develop a computational approach to motor control that offers a unifying modeling framework for both dynamic systems and optimal control approaches. In discussions of several behavioral experiments and some theoretical and robotics studies, we demonstrate how our computational ideas allow both the representation of self-organizing processes and the optimization of movement based on reward criteria. Our modeling framework is rather simple and general, and opens opportunities to revisit many previous modeling…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This perspective could reconcile some differences between dynamic systems and optimal control treatments of computational motor control.
“This perspective could reconcile some differences between dynamic systems and optimal control treatments of computational motor control”
From Action and behavior: a free-energy formulation (2010) · cites this paper as Schaal et al. 2007
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588 · see citing works
Signal-dependent noise determines motor planning
Harris, C. M., & Wolpert, D. M. (1998) · Nature · doi:10.1038/29528 · Cited by 2,498 · see citing works
Forward modeling allows feedback control for fast reaching movements
Desmurget, M., & Grafton, S. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01537-0 · Cited by 1,300 · cited 2× · see citing works
“For the time being, the ‘‘desired trajectory’’ approach seems to be too restricted for general-purpose motor control and planning in dynamically changing environments, as needed in every biological motor system, and some biological evidence has been accumulated that completely preplanned desired trajectories may not e…”
BackgroundRhythmic arm movement is not discrete
Schaal, S., Sternad, D., Osu, R., & Kawato, M. (2004) · Nature Neuroscience · doi:10.1038/nn1322 · Cited by 368 · see citing works
Are central pattern generators understandable?
Selverston, A. I. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00006580 · Cited by 319 · see citing works
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1025696116075 · Cited by 317 · see citing works
Further progress in robot juggling: solvable mirror laws
Rizzi, A. A., & Koditschek, D. E. (2002) · Proceedings of the 1994 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.1994.350893 · Cited by 50 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · see citing works
Action and behavior: a free-energy formulation
Friston, K. J., Daunizeau, J., Kilner, J., & Kiebel, S. J. (2010) · Biological Cybernetics · doi:10.1007/s00422-010-0364-z · Cited by 866 · see citing works
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665 · see citing works
A tutorial on task-parameterized movement learning and retrieval
Calinon, S. (2016) · Intelligent Service Robotics · doi:10.1007/s11370-015-0187-9 · Cited by 422 · see citing works
What is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332 · see citing works
Dynamic movement primitives in robotics: A tutorial survey
Saveriano, M., Abu-Dakka, F. J., Kramberger, A., & Peternel, L. (2023) · The International Journal of Robotics Research · doi:10.1177/02783649231201196 · Cited by 267 · see citing works
Movement templates for learning of hitting and batting
Kober, J., Mülling, K., Krömer, O., Lampert, C. H., Schölkopf, B., & Peters, J. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509672 · Cited by 152 · see citing works
- Authors
- Schaal, S., Mohajerian, P., & Ijspeert, A.
- Affiliations
- University of Southern California (US)
- Corresponding author
- Schaal, Stefan
- Venue
- Progress in Brain Research
- Publisher
- Elsevier
- Published
- 2007
- Volume
- 165
- Pages
- 425-445
- ISSN
- 0079-6123 (ISSN-L)
- OpenAlex
- W1516801383
- Cited by
- 260
- References
- 8
- Citations by year
- 2026: 3 · 2025: 13 · 2024: 11 · 2023: 11 · 2022: 7 · 2021: 9 · 2020: 13 · 2019: 9 · 2018: 12 · 2017: 13 · 2016: 14 · 2015: 24 · 2014: 15 · 2013: 21 · 2012: 19
- FWCI
- 18.66
- Type
- book chapter
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- Progress in brain research (publishedVersion)
- PubMed (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Funders
- National Science Foundation
- Defense Advanced Research Projects Agency
- Japan Science and Technology Agency
- Exploratory Research for Advanced Technology
- Air Force Office of Scientific Research
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- computational motor control, dynamic systems approach, optimal control, self-organization, nonlinear differential equations, energy consumption, robotics
- MeSH terms
- Animals, Computer Simulation, Environment, Humans, Models, Biological, Motor Activity, Reward, Nonlinear Dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review