The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Linear Theory for Control of Nonlinear Stochastic Systems
Open accessAbstract
We address the role of noise and the issue of efficient computation in stochastic optimal control problems. We consider a class of nonlinear control problems that can be formulated as a path integral and where the noise plays the role of temperature. The path integral displays symmetry breaking and there exists a critical noise value that separates regimes where optimal control yields qualitatively different solutions. The path integral can be computed efficiently by Monte Carlo integration or by a Laplace approximation, and can therefore be used to solve high dimensional stochastic control problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Mathematical Theory of Optimal Processes
Pontryagin, L. S. (2018) · Routledge eBooks · doi:10.1201/9780203749319 · Cited by 3,713
The Mathematical Theory of Optimal Processes
Chambers, M. L., Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., Mishchenko, E. F., & Brown, D. E. (1965) · OR · doi:10.2307/3006724 · Cited by 3,243
Optimal Control and Estimation
Stengel, R. F. (1994) · Cited by 1,617
Yong, J., & Zhou, X. Y. (1999) · doi:10.1007/978-1-4612-1466-3 · Cited by 1,243
Exit probabilities and optimal stochastic control
Fleming, W. H. (1977) · Applied Mathematics & Optimization · doi:10.1007/bf01442148 · Cited by 199
Selected Papers on Mathematical Trends in Control Theory
Lefschetz, S., Bellman, R., & Kalaba, R. E. (1965) · Mathematics of Computation · doi:10.2307/2003708 · Cited by 157
Freeman, D. L., & Doll, J. D. (1984) · The Journal of Chemical Physics · doi:10.1063/1.446640 · Cited by 94
Miller, W. H. (1975) · The Journal of Chemical Physics · doi:10.1063/1.431444 · Cited by 93
Cited by
Aggressive driving with model predictive path integral control
Williams, G., Drews, P., Goldfain, B., Rehg, J. M., & Theodorou, E. A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487277 · Cited by 444
Efficient computation of optimal actions
Todorov, E. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0710743106 · Cited by 417
Learning variable impedance control
Buchli, J., Stulp, F., Theodorou, E., & Schaal, S. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911402527 · Cited by 337
What is optimal about motor control?
Friston, K. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.018 · Cited by 332
Optimal control as a graphical model inference problem
Kappen, H. J., Gómez, V., & Opper, M. (2012) · Machine Learning · doi:10.1007/s10994-012-5278-7 · Cited by 297
Self-citationThermodynamics as a theory of decision-making with information-processing costs
Ortega, P. A., & Braun, D. A. (2013) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2012.0683 · Cited by 255
Reinforcement learning of motor skills in high dimensions: A path integral approach
Theodorou, E., Buchli, J., & Schaal, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509336 · Cited by 252
General duality between optimal control and estimation
Todorov, E. (2008) · 2008 47th IEEE Conference on Decision and Control · doi:10.1109/cdc.2008.4739438 · Cited by 248
Active inference and agency: optimal control without cost functions
Friston, K., Samothrakis, S., & Montague, R. (2012) · Biological Cybernetics · doi:10.1007/s00422-012-0512-8 · Cited by 241
“In particular, formulating the problem in terms of Kullback–Leibler minimization (Kappen 2005a,b) and path integrals of cost functions using the Feynman–Kac formula (Theodorou et al. 2010; Braun et al. 2011).”
BackgroundMethodModel Predictive Path Integral Control using Covariance Variable Importance Sampling
Williams, G., Aldrich, A., & Theodorou, E. (2015) · arXiv · doi:10.48550/arxiv.1509.01149 · Cited by 71
(2010) · Uncertainty in Artificial Intelligence · Cited by 56
Tottori, T., & Kobayashi, T. J. (2023) · Entropy · doi:10.3390/e25020208 · Cited by 11
Metadata
- Authors
- Kappen, H. J.
- Venue
- Physical Review Letters
- Publisher
- American Physical Society (APS)
- Published
- 2005-11-07
- Volume
- 95
- Issue
- 20
- Pages
- 200201-200201
- ISSN
- 0031-9007 (ISSN-L)
- 1079-7114
- OpenAlex
- W2043962331
- Cited by
- 299
- References
- 10
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.