Synchronisation through learning for two self-propelled swimmers
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
The coordinated motion by multiple swimmers is a fundamental component in fish schooling. The flow field induced by the motion of each self-propelled swimmer implies non-linear hydrodynamic interactions among the members of a group. How do swimmers compensate for such hydrodynamic interactions in coordinated patterns? We provide an answer to this riddle though simulations of two, self-propelled, fish-like bodies that employ a learning algorithm to synchronise their swimming patterns. We distinguish between learned motion patterns and the commonly used a-priori specified movements, that are imposed on the swimmers without feedback from their hydrodynamic interactions. First, we demonstrate that two rigid bodies executing pre-specified motions, with an alternating leader and follower, can result in substantial drag-reduction and intermittent thrust generation. In turn, we study two self-propelled swimmers arranged in a leader-follower configuration, with a-priori specified body-deformations. These two self-propelled swimmers do not sustain their tandem configuration. The follower experiences either an increase or decrease in swimming speed, depending on the initial conditions, while the swimming of the leader remains largely unaffected. This indicates that a-priori specified patterns are not sufficient to sustain synchronised swimming. We then examine a tandem of swimmers where the leader has a steady gait and the follower learns to synchronize its motion, to overcome the forces induced by the leader's vortex wake. The follower employs reinforcement learning to adapt its swimming-kinematics so as to minimize its lateral deviations from the leader's path. Swimming in such a sustained synchronised tandem yields up to [Formula: see text] reduction in energy expenditure for the follower, in addition to a [Formula: see text] increase in its swimming-efficiency. The present results show that two self-propelled swimmers can be synchronised by adapting their motion patterns to compensate for flow-structure interactions. Moreover, swimmers can exploit the vortical structures of their flow field so that synchronised swimming is energetically beneficial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The V-RACER algorithm has proven suitable for control problems in complex flow fields34,118.”
From Sensing flow gradients is necessary for learning autonomous underwater navigation (2025) · cites this paper as [118]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1×
“An important aspect of this work is that the swimmer learns a parameterized approximation of Q(s, a) by training a Neural Network with experience replay [23].”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564 · cited 1×
“Hence, in this work the swimmer learns a parametrized approximation of Q(s, a) by training a Neural Network (NN) with experience replay (Lin 1992).”
MethodREVIEW—Review of Flow Interference Between Two Circular Cylinders in Various Arrangements
Zdravkovich, M. M. (1977) · Journal of Fluids Engineering · doi:10.1115/1.3448871 · Cited by 952 · cited 1×
“The forces experienced by the leader and follower in this setting are consistent with experimental and computational studies of tandem arrangements of cylinders in free flow [31, 42], where it has been observed that the follower can experience a substantial drag-reduction, and the leader is mostly unaffected by the pr…”
Fish Exploiting Vortices Decrease Muscle Activity
Liao, J. C., Beal, D. N., Lauder, G. V., & Triantafyllou, M. S. (2003) · Science · doi:10.1126/science.1088295 · Cited by 921 · cited 2×
“Studies investigating the response of solitary fish to unsteady flow [22] found that trout swimming behind obstacles exerted reduced effort for station-keeping.”
BackgroundMethodTwo circular cylinders in cross-flow: A review
Sumner, D. (2010) · Journal of Fluids and Structures · doi:10.1016/j.jfluidstructs.2010.07.001 · Cited by 920 · cited 1×
“The forces experienced by the leader and follower in this setting are consistent with experimental and computational studies of tandem arrangements of cylinders in free flow [31, 42], where it has been observed that the follower can experience a substantial drag-reduction, and the leader is mostly unaffected by the pr…”
Hydromechanics of Fish Schooling
WEIHS, D. (1973) · Nature · doi:10.1038/241290a0 · Cited by 689
Gilmanov, A., & Sotiropoulos, F. (2005) · Journal of Computational Physics · doi:10.1016/j.jcp.2005.01.020 · Cited by 563 · cited 1×
“We note that simulations of single swimmers performing optimised swimming motions have been performed over the last ten years [5, 11, 16, 19].”
BackgroundFish in larger shoals find food faster
Pitcher, T. J., Magurran, A. E., & Winfield, I. J. (1982) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00300175 · Cited by 537
Borazjani, I., & Sotiropoulos, F. (2008) · Journal of Experimental Biology · doi:10.1242/jeb.015644 · Cited by 512 · cited 1×
“We note that simulations of single swimmers performing optimised swimming motions have been performed over the last ten years [5, 11, 16, 19].”
BackgroundUpwash exploitation and downwash avoidance by flap phasing in ibis formation flight
Portugal, S. J., Hubel, T. Y., Fritz, J., Heese, S., Trobe, D., Voelkl, B., Hailes, S., Wilson, A. M., & Usherwood, J. R. (2014) · Nature · doi:10.1038/nature12939 · Cited by 465
The hydrodynamics of eel swimming
Tytell, E. D., & Lauder, G. V. (2004) · Journal of Experimental Biology · doi:10.1242/jeb.00968 · Cited by 436 · cited 1×
“estimate the swimming-efficiency using a modified form of the Froude efficiency proposed by [37]:”
MethodSimulations of optimized anguilliform swimming
Kern, S., & Koumoutsakos, P. (2006) · Journal of Experimental Biology · doi:10.1242/jeb.02526 · Cited by 420 · cited 1×
“We note that simulations of single swimmers performing optimised swimming motions have been performed over the last ten years [5, 11, 16, 19].”
BackgroundSelf-citationHigh-resolution simulations of the flow around an impulsively started cylinder using vortex methods
Koumoutsakos, P., & Leonard, A. (1995) · Journal of Fluid Mechanics · doi:10.1017/s0022112095002059 · Cited by 399 · cited 1×
“Approximating the vortex field by a linear superposition of vortical structures with strength Γi at locations ( ) x y , i i [21] the horizontal force acting on the object due to the vorticity in the flow is expressed as: Figure 2.”
BackgroundSelf-citationOn the role of form and kinematics on the hydrodynamics of self-propelled body/caudal fin swimming
Borazjani, I., & Sotiropoulos, F. (2010) · Journal of Experimental Biology · doi:10.1242/jeb.030932 · Cited by 281 · cited 1×
“Both these motions are comparable to the bodydeformation observed in sub-carangiform swimmers [2, 6].”
BackgroundAerobic capacity influences the spatial position of individuals within fish schools
Killen, S. S., Marras, S., Steffensen, J. F., & McKenzie, D. J. (2012) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2011.1006 · Cited by 275 · cited 3×
“Experiments that have investigated swimming of fish groups indicate a reduction in energy expenditure, based on respirometer readings and reduced tail-beat frequency [1, 18, 20, 24, 33].”
BackgroundHerskin, J., & Steffensen, J. F. (1998) · Journal of Fish Biology · doi:10.1111/j.1095-8649.1998.tb00986.x · Cited by 266 · cited 2×
“Experiments that have investigated swimming of fish groups indicate a reduction in energy expenditure, based on respirometer readings and reduced tail-beat frequency [1, 18, 20, 24, 33].”
BackgroundThe increased efficiency of fish swimming in a school
Hemelrijk, C., Reid, D., Hildenbrandt, H., & Padding, J. (2015) · Fish and Fisheries · doi:10.1111/faf.12072 · Cited by 248
Closed-loop separation control using machine learning
Gautier, N., Aider, J.-L., Duriez, T., Noack, B. R., Segond, M., & Abel, M. (2015) · Journal of Fluid Mechanics · doi:10.1017/jfm.2015.95 · Cited by 228 · cited 1×
“RL is well suited to flow control problems [12, 15] as it provides a feedback controller by maximising a numeric reward signal without requiring any prior knowledge about the underlying dynamics.”
BackgroundFish schooling as a basis for vertical axis wind turbine farm design
Whittlesey, R. W., Liska, S., & Dabiri, J. O. (2010) · Bioinspiration & Biomimetics · doi:10.1088/1748-3182/5/3/035005 · Cited by 209
Fish Schooling: A Possible Factor in Reducing Predation
Brock, V. E., & Riffenburgh, R. H. (1960) · ICES Journal of Marine Science · doi:10.1093/icesjms/25.3.307 · Cited by 201 · cited 1×
“Schooling has also been credited with serving diverse biological functions including defence from predators [8, 9], enhanced feeding and reproductive opportunities [28].”
BackgroundClosed-loop separation control using machine learning
Gautier, N., Aider, J. L., Duriez, T., Noack, B. R., Segond, M., & Abel, M. (2015) · CONICET Digital (CONICET) · Cited by 199
Herskin, J. (1998) · Journal of Fish Biology · doi:10.1006/jfbi.1998.0708 · Cited by 180
Simulations of single and multiple swimmers with non-divergence free deforming geometries
Gazzola, M., Chatelain, P., van Rees, W. M., & Koumoutsakos, P. (2011) · Journal of Computational Physics · doi:10.1016/j.jcp.2011.04.025 · Cited by 176 · cited 4×
“Swimmers and Numerical Methods We solve the two-dimensional, viscous, incompressible Navier–Stokes equations in velocity–vorticity form using remeshed vortex methods on wavelet-adapted grids [30], and a divergence-free penalisation technique to enforce the no-slip boundary condition [13].”
MethodResultInfluentialSelf-citationSvendsen, J. C., Skov, J., Bildsøe, M., & Steffensen, J. F. (2003) · Journal of Fish Biology · doi:10.1046/j.1095-8649.2003.00068.x · Cited by 168 · cited 2×
“Experiments that have investigated swimming of fish groups indicate a reduction in energy expenditure, based on respirometer readings and reduced tail-beat frequency [1, 18, 20, 24, 33].”
BackgroundEvidence against a hydrodynamic function for fish schools
PARTRIDGE, B. L., & PITCHER, T. J. (1979) · Nature · doi:10.1038/279418a0 · Cited by 166 · cited 1×
“The role of hydrodynamics in fish-schooling was later questioned [26], based on empirical observations of fish-schools which rarely displayed diamond formations.”
BackgroundSelf-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching
Lin, L.-J. (1992) · Reinforcement Learning · doi:10.1007/978-1-4615-3618-5_5 · Cited by 160
Hydrodynamic schooling of flapping swimmers
Becker, A. D., Masoud, H., Newbolt, J. W., Shelley, M., & Ristroph, L. (2015) · Nature Communications · doi:10.1038/ncomms9514 · Cited by 158 · cited 1×
“However, there is growing evidence supporting the hypothesis that fluid dynamics affects swimming patterns in fish schools [35] and related experimental model configurations [3] as well as flying patterns of birds [29].”
BackgroundModeling and simulation of fish-like swimming
Bergmann, M., & Iollo, A. (2010) · Journal of Computational Physics · doi:10.1016/j.jcp.2010.09.017 · Cited by 156 · cited 1×
“Bergmann and Iollo [4] presented short-time simulation of two and three self-propelled swimmers with prescribed kinematics that may eventually lead to the collision or divergence of the swimmers.”
BackgroundThe hydrodynamic advantages of synchronized swimming in a rectangular pattern
Daghooghi, M., & Borazjani, I. (2015) · Bioinspiration & Biomimetics · doi:10.1088/1748-3190/10/5/056018 · Cited by 156 · cited 3×
“Nonetheless, a coherent wake is observed near the swimmer even in that case (please see figure 6 in [10]).”
BackgroundFish schooling as a basis for vertical axis wind turbine farm design
Whittlesey, R. W., Liska, S., & Dabiri, J. O. (2010) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 147
The structure of schools of giant bluefin tuna in Cape Cod Bay
Partridge, B. L., Johansson, J. S., & Kalish, J. M. (1983) · Environmental Biology of Fishes · doi:10.1007/bf00692374 · Cited by 140
Reinforcement Learning and Wavelet Adapted Vortex Methods for Simulations of Self-propelled Swimmers
Gazzola, M., Hejazialhosseini, B., & Koumoutsakos, P. (2014) · SIAM Journal on Scientific Computing · doi:10.1137/130943078 · Cited by 138
Self-citationLearning to school in the presence of hydrodynamic interactions
Gazzola, M., Tchieu, A. A., Alexeev, D., de Brauer, A., & Koumoutsakos, P. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2015.686 · Cited by 137 · cited 2×
“Longtime simulations of multiple swimmers, have either pre-specified their spatial distribution and kinematics [10, 17] or they have employed potential flow models [15, 36].”
BackgroundSelf-citationBiomimetic Survival Hydrodynamics and Flow Sensing
Triantafyllou, M. S., Weymouth, G. D., & Miao, J. (2016) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-122414-034329 · Cited by 134
Taguchi, M., & Liao, J. C. (2011) · Journal of Experimental Biology · doi:10.1242/jeb.052027 · Cited by 133 · cited 1×
“The ensuing reduction in muscle activity was confirmed using neuromuscular measurements [22] and respirometer readings [34].”
MethodRisk of predation, hydrodynamic efficiency and their influence on school structure
Abrahams, M. V., & Colgan, P. W. (1985) · Environmental Biology of Fishes · doi:10.1007/bf00000931 · Cited by 128
Cushing, D. H., & Jones, F. (1968) · Nature · doi:10.1038/218918b0 · Cited by 128
Some Hydrodynamical Aspects of Fish Schooling
Weihs, D. (1975) · Springer eBooks · doi:10.1007/978-1-4757-1326-8_16 · Cited by 123 · cited 3×
“Nonetheless, he postulated that given the immense potential for energy savings, even intermittent utilization of the proposed arrangement could lead to a tangible benefit [40].”
BackgroundMethodLearning to school in the presence of hydrodynamic interactions
Gazzola, M., Tchieu, A., Alexeev, D., Brauer, A. D., & Koumoutsakos, P. (2016) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000113533 · Cited by 117
Self-citationReduced Metabolic Rates in Fishes as a Result of Induced Schooling
Parker, F. R. (1973) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1973)102<125:rmrifa>2.0.co;2 · Cited by 94
Breder, C. M. (1965) · Zoologica scientific contributions of the New York Zoological Society · doi:10.5962/p.206663 · Cited by 80
MRAG-I2D: Multi-resolution adapted grids for remeshed vortex methods on multicore architectures
Rossinelli, D., Hejazialhosseini, B., van Rees, W. M., Gazzola, M., Bergdorf, M., & Koumoutsakos, P. (2015) · Journal of Computational Physics · doi:10.1016/j.jcp.2015.01.035 · Cited by 58 · cited 1×
“Swimmers and Numerical Methods We solve the two-dimensional, viscous, incompressible Navier–Stokes equations in velocity–vorticity form using remeshed vortex methods on wavelet-adapted grids [30], and a divergence-free penalisation technique to enforce the no-slip boundary condition [13].”
MethodSelf-citationA kinematic model of Kármán gaiting in rainbow trout
Akanyeti, O., & Liao, J. C. (2013) · Journal of Experimental Biology · doi:10.1242/jeb.093245 · Cited by 42 · cited 1×
“Both these motions are comparable to the bodydeformation observed in sub-carangiform swimmers [2, 6].”
BackgroundDipole Interactions in Doubly Periodic Domains
Tsang, A. C. H., & Kanso, E. (2013) · Journal of Nonlinear Science · doi:10.1007/s00332-013-9174-5 · Cited by 36 · cited 1×
“Longtime simulations of multiple swimmers, have either pre-specified their spatial distribution and kinematics [10, 17] or they have employed potential flow models [15, 36].”
BackgroundPatterns and Mechanisms of Schooling Behavior in Fish
Pavlov, D. S., & Kasumyan, A. O. (2000) · Journal of Ichthyology · Cited by 26
Self-propelled swimming simulations of bio-inspired smart structures
Daghooghi, M., & Borazjani, I. (2016) · Bioinspiration & Biomimetics · doi:10.1088/1748-3190/11/5/056001 · Cited by 23
Self-propulsion of a counter-rotating cylinder pair in a viscous fluid
van Rees, W. M., Novati, G., & Koumoutsakos, P. (2015) · Physics of Fluids · doi:10.1063/1.4922314 · Cited by 22 · cited 1×
“We note also that synchronised motion has been obtained for viscous simulations of two cylinders performing rotary oscillations [38].”
BackgroundSelf-citationPurse Seining for Juvenile Salmon and Trout in the Columbia River Estuary
Johnsen, R. D., & Sims, C. W. (1973) · Transactions of the American Fisheries Society · doi:10.1577/1548-8659(1973)102<281:wqaflb>2.0.co;2 · Cited by 22
Research works printed but not linked: 2
- Breder C M, 1965, Zoologica, 50, 97
- Pavlov D S, 2000, J. Ichthyol., 40, 163
Cited by
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
“The extended DMD (Williams et al. 2015) and variational approach of conformation dynamics (VAC) (No´e & Nuske 2013; N¨uske et al. 2016) enrich the model with nonlinear measurements, leveraging kernel methods (Williams et al. 2015) and dictionary learning (Li et al. 2017).”
Self-citationA review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 270
Automating turbulence modelling by multi-agent reinforcement learning
Novati, G., de Laroussilhe, H. L., & Koumoutsakos, P. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00272-0 · Cited by 182
Self-citationScientific multi-agent reinforcement learning for wall-models of turbulent flows
Bae, H. J., & Koumoutsakos, P. (2022) · Nature Communications · doi:10.1038/s41467-022-28957-7 · Cited by 171
Self-citationDeep learning in computational mechanics: a review
Herrmann, L., & Kollmannsberger, S. (2024) · Computational Mechanics · doi:10.1007/s00466-023-02434-4 · Cited by 162
Metadata
- Authors
- Novati, G., Verma, S., Alexeev, D., Rossinelli, D., van Rees, W. M., & Koumoutsakos, P.
- Affiliations
- ETH Zurich (CH)
- Harvard University (US)
- Corresponding author
- Koumoutsakos, Petros
- Venue
- Bioinspiration & Biomimetics
- Publisher
- IOP Publishing
- Published
- 2017-03-29
- Volume
- 12
- Issue
- 3
- Pages
- 036001
- ISSN
- 1748-3182 (ISSN-L)
- 1748-3190
- OpenAlex
- W2950974717
- Cited by
- 157
- References
- 47
- Citations by year
- 2026: 15 · 2025: 17 · 2024: 24 · 2023: 24 · 2022: 22 · 2021: 24 · 2020: 10 · 2019: 7 · 2018: 10 · 2017: 2
- FWCI
- 7.29
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- iopscience.iop.org/info/page/text-and-data-mining (tdm)
- iopscience.iop.org/page/copyright (vor)
- Locations
- Bioinspiration & Biomimetics (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Funders
- European Research Council (Advanced Investigator Award; 2-7398)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Biomimetic flight and propulsion mechanisms
- Physical Sciences › Physics and Astronomy › Condensed Matter Physics › Micro and Nano Robotics
- Physical Sciences › Engineering › Control and Systems Engineering › Distributed Control Multi-Agent Systems
- Keywords
- self-propelled swimmers, fish schooling, hydrodynamic interactions, wake vortices, reinforcement learning, drag reduction, energy expenditure, flow-structure interaction, body deformation, swimming kinematics
- MeSH terms
- Algorithms, Animals, Cooperative Behavior, Fishes, Mass Behavior, Reinforcement, Psychology, Swimming, Biomimetics, Biomimetic Materials, Hydrodynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.