Finding efficient swimming strategies in a three-dimensional chaotic flow by reinforcement learning
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
We apply a reinforcement learning algorithm to show how smart particles can learn approximately optimal strategies to navigate in complex flows. In this paper we consider microswimmers in a paradigmatic three-dimensional case given by a stationary superposition of two Arnold-Beltrami-Childress flows with chaotic advection along streamlines. In such a flow, we study the evolution of point-like particles which can decide in which direction to swim, while keeping the velocity amplitude constant. We show that it is sufficient to endow the swimmers with a very restricted set of actions (six fixed swimming directions in our case) to have enough freedom to find efficient strategies to move upward and escape local fluid traps. The key ingredient is the learning-from-experience structure of the algorithm, which assigns positive or negative rewards depending on whether the taken action is, or is not, profitable for the predetermined goal in the long-term horizon. This is another example supporting the efficiency of the reinforcement learning approach to learn how to accomplish difficult tasks in complex fluid environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Purcell, E. M. (1977) · American Journal of Physics · doi:10.1119/1.10903 · Cited by 4,360
Cited by
A review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 270
Biferale, L., Bonaccorso, F., Buzzicotti, M., Clark Di Leoni, P., & Gustavsson, K. (2019) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5120370 · Cited by 121
Self-citationMachine learning strategies for path-planning microswimmers in turbulent flows
Alageshan, J. K., Verma, A. K., Bec, J., & Pandit, R. (2020) · Physical Review E · doi:10.1103/physreve.101.043110 · Cited by 88
“, (a) to optimise the soaring of a glider in thermal currents [3] and (b) the development of an optimal scheme in two- (2D) and three-dimensional (3D) fluid flows that are time independent [4, 5].”
BackgroundSurfing on Turbulence: A Strategy for Planktonic Navigation
Monthiller, R., Loisy, A., Koehl, M. A. R., Favier, B., & Eloy, C. (2022) · Physical Review Letters · doi:10.1103/physrevlett.129.064502 · Cited by 36
Metadata
- Authors
- Gustavsson, K., Biferale, L., Celani, A., & Colabrese, S.
- Venue
- The European Physical Journal E
- Published
- 2017-12
- Volume
- 40
- Issue
- 12
- Pages
- 110-110
- ISSN
- 1292-8941 (ISSN-L)
- 1292-895X
- OpenAlex
- W2768230101
- Cited by
- 76
- References
- 1
- FWCI
- 1.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Finding efficient swimming strategies in a three-dimensional chaotic flow by reinforcement learning. https://app.cochat.ai/papers/10.1140/epje/i2017-11602-9
- The paper
- Gustavsson, K., Biferale, L., Celani, A., & Colabrese, S. (2017). Finding efficient swimming strategies in a three-dimensional chaotic flow by reinforcement learning. The European Physical Journal E. https://doi.org/10.1140/epje/i2017-11602-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.