Finite Time Lyapunov Exponent Analysis of Model Predictive Control and Reinforcement Learning
Open accessThe DOI matches its Crossref record; 79 of the 81 references it cites were found in a registry or an index.
Abstract
Finite-time Lyapunov exponents (FTLEs) provide a powerful approach to compute time-varying analogs of invariant manifolds in unsteady fluid flow fields. These manifolds are useful to visualize the transport mechanisms of passive tracers advecting with the flow. However, many vehicles and mobile sensors are not passive, but are instead actuated according to some intelligent trajectory planning or control law; for example, model predictive control and reinforcement learning are often used to design energy-efficient trajectories in a dynamically changing background flow. In this work, we investigate the use of FTLE on such controlled agents to gain insight into optimal transport routes for navigation in known unsteady flows. We find that these controlled FTLE (cFTLE) coherent structures separate the flow field into different regions with similar costs of transport to the goal location. These separatrices are functions of the planning algorithm’s hyper-parameters, such as the optimization time horizon and the cost of actuation. Computing the invariant sets and manifolds of active agent dynamics in dynamic flow fields is useful in the context of robust motion control, hyperparameter tuning, and determining safe and collision-free trajectories for autonomous systems. Moreover, these cFTLE structures provide insight into effective deployment locations for mobile agents with actuation and energy constraints to traverse the ocean or atmosphere.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · cited 1×
“In this study, we use the deep deterministic policy gradient (DDPG) method [76] available in the stable baselines package [71] to demonstrate the use of cFTLE analysis on reinforcement learning policies.”
MethodModel predictive control: Theory and practice—A survey
García, C. E., Prett, D. M., & Morari, M. (1989) · Automatica · doi:10.1016/0005-1098(89)90002-2 · Cited by 5,284 · cited 1×
“Among the existing methods, MPC [47], [48] and reinforcement learning [49], [50] are among the most useful paradigms in modern control [51], and analyzing these control laws and policies with FTLE be the focus of this paper.”
MethodCasADi: a software framework for nonlinear optimization and optimal control
Andersson, J. A. E., Gillis, J., Horn, G., Rawlings, J. B., & Diehl, M. (2019) · Mathematical Programming Computation · doi:10.1007/s12532-018-0139-4 · Cited by 3,868 · cited 1×
“To solve the resulting optimization problems of MPC, we use the CasADi [69] and MPCTools [70] packages, which use an interior point filter-line search algorithm (IPOPT).”
MethodSastry, S. (1999) · Interdisciplinary Applied Mathematics · doi:10.1007/978-1-4757-3108-8 · Cited by 1,764 · cited 1×
“When using optimal control methods, the policy can often make the controlled system a non-smooth dynamical system [75].”
MethodOptimal Control and Estimation
Stengel, R. F. (1994) · Cited by 1,617
Shadden, S. C., Lekien, F., & Marsden, J. E. (2005) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2005.10.007 · Cited by 1,326 · cited 4×
“The finite-time Lyapunov exponent quantifies this stretching over a fixed, finite-time horizon, resulting in a scalar field over a domain of interest highlighting the most sensitive regions to perturbations in the initial conditions [9], [10], [11], [12], [13].”
BackgroundMethodInfluentialLagrangian Coherent Structures
Haller, G. (2015) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010313-141322 · Cited by 1,037
Wynn, R. B., Huvenne, V. A. I., Le Bas, T. P., Murton, B. J., Connelly, D. P., Bett, B. J., Ruhl, H. A., Morris, K. J., Peakall, J., Parsons, D. R., et al. (2014) · Marine Geology · doi:10.1016/j.margeo.2014.03.012 · Cited by 1,003
Stable-Baselines3: Reliable Reinforcement Learning Implementations
Raffin, A., Hill, A., Gleave, A., Kanervisto, A., Ernestus, M., & Dormann, N. (2021) · elib (German Aerospace Center) · Cited by 1,000
Collective Motion, Sensor Networks, and Ocean Sampling
Leonard, N. E., Paley, D. A., Lekien, F., Sepulchre, R., Fratantoni, D. M., & Davis, R. E. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.887295 · Cited by 946 · cited 1×
“Coordinated control of ocean gliders for adaptive ocean sensing has been exhaustively studied [30], [31], [32], [33].”
BackgroundAn objective definition of a vortex
HALLER, G. (2005) · Journal of Fluid Mechanics · doi:10.1017/s0022112004002526 · Cited by 943 · cited 1×
“Moreover, the FTLE has also been used in fluid dynamics applications to compute Lagrangian coherent structures (LCS), which are finite-time analogs of invariant manifolds that mediate the transport of material in unsteady fluid flows [9], [10], [13], [14], [15], [16], [17], [18].”
MethodData-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control
Brunton, S. L., & Kutz, J. N. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009089517 · Cited by 697
Self-citationA Tour of Reinforcement Learning: The View from Continuous Control
Recht, B. (2019) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-053018-023825 · Cited by 609
Lagrangian coherent structures from approximate velocity data
Haller, G. (2002) · Physics of Fluids · doi:10.1063/1.1477449 · Cited by 562 · cited 2×
“The original FTLE [9], [13], [14] primarily addressed dynamical systems of the form where the function f ( x ( t ) , t ) : R n × → n represents the system dynamics, t ∈ R represents time, and x ( t ) ∈ R n is the state of the system.”
BackgroundMethodChaotic Transport in Dynamical Systems
Wiggins, S. (1992) · Interdisciplinary Applied Mathematics · doi:10.1007/978-1-4757-3896-4 · Cited by 495
Multi-AUV Control and Adaptive Sampling in Monterey Bay
Fiorelli, E., Leonard, N. E., Bhatta, P., Paley, D. A., Bachmayer, R., & Fratantoni, D. M. (2006) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2006.880429 · Cited by 488
Ding, B., Cychowski, M. T., Xi, Y., Cai, W., & Huang, B. (2012) · Journal of Control Science and Engineering · doi:10.1155/2012/240898 · Cited by 456
An analytical study of transport, mixing and chaos in an unsteady vortical flow
Rom-Kedar, V., Leonard, A., & Wiggins, S. (1990) · Journal of Fluid Mechanics · doi:10.1017/s0022112090000167 · Cited by 455 · cited 1×
“This behavior has been exhaustively studied in dynamical systems theory [73], [74].”
BackgroundModel-based feedback control of autonomous underwater gliders
Leonard, N. E., & Graver, J. G. (2001) · IEEE Journal of Oceanic Engineering · doi:10.1109/48.972106 · Cited by 386 · cited 1×
“Coordinated control of ocean gliders for adaptive ocean sensing has been exhaustively studied [30], [31], [32], [33].”
BackgroundDetection of Lagrangian coherent structures in three-dimensional turbulence
GREEN, M. A., ROWLEY, C. W., & HALLER, G. (2007) · Journal of Fluid Mechanics · doi:10.1017/s0022112006003648 · Cited by 336
Monitoring ocean biogeochemistry with autonomous platforms
Chai, F., Johnson, K. S., Claustre, H., Xing, X., Wang, Y., Boss, E., Riser, S., Fennel, K., Schofield, O., & Sutton, A. (2020) · Nature Reviews Earth & Environment · doi:10.1038/s43017-020-0053-y · Cited by 277
Robotics in Remote and Hostile Environments
Bellingham, J. G., & Rajan, K. (2007) · Science · doi:10.1126/science.1146230 · Cited by 234 · cited 1×
“Trajectory planning in an unsteady flow field is an important problem for intelligent mobile agents, with applications including environmental monitoring and data collection [1], [2], [3], [4], [5], [6].”
BackgroundYilmaz, N. K., Evangelinos, C., Lermusiaux, P., & Patrikalakis, N. M. (2008) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2008.2002105 · Cited by 232 · cited 1×
“Assimilating in-situ observations obtained by mobile sensors in an adaptive fashion into ocean models has also been explored, for example with mixed integer programming algorithms [28], [29].”
BackgroundUncovering the Lagrangian Skeleton of Turbulence
Mathur, M., Haller, G., Peacock, T., Ruppert-Felsot, J. E., & Swinney, H. L. (2007) · Physical Review Letters · doi:10.1103/physrevlett.98.144502 · Cited by 212 · cited 1×
“More broadly, FTLE has also been used to compute coherent structures for a wide range of other flows [10], [59], [60], [61], [62], [63].”
MethodTodorov, E. (2006) · Bayesian Brain · doi:10.7551/mitpress/1535.003.0018 · Cited by 195
Oceanic mesoscale eddies as revealed by Lagrangian coherent structures
Beron‐Vera, F. J., Olascoaga, M. J., & Goni, G. J. (2008) · Geophysical Research Letters · doi:10.1029/2008gl033957 · Cited by 191
Adaptive modeling, adaptive data assimilation and adaptive sampling
Lermusiaux, P. F. J. (2007) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2007.02.014 · Cited by 178 · cited 1×
“Assimilating in-situ observations obtained by mobile sensors in an adaptive fashion into ocean models has also been explored, for example with mixed integer programming algorithms [28], [29].”
BackgroundScattering of inertial waves by an ocean front - Comments
Yamagata (1995) · Journal of Physical Oceanography · doi:10.1175/1520-0485(1995)025 · Cited by 177
Pollution release tied to invariant manifolds: A case study for the coast of Florida
Lekien, F., Coulliette, C., Mariano, A. J., Ryan, E. H., Shay, L. K., Haller, G., & Marsden, J. (2005) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2005.06.023 · Cited by 175 · cited 1×
“In the past, FTLE analysis has mostly been performed using passive drifters to study time-varying vector fields, such as ocean flows [55], [56], [57] and pollution transport models [58].”
BackgroundPENG, J., & Dabiri, J. O. (2009) · Journal of Fluid Mechanics · doi:10.1017/s0022112008005089 · Cited by 173 · cited 2×
“Similar studies have been performed in the past for biological applications, where FTLE was used to understand the behavior of actively propelling microswimmers [52], [53].”
BackgroundMethodCharacterization of Coherent Structures in the Cardiovascular System
Shadden, S. C., & Taylor, C. A. (2008) · Annals of Biomedical Engineering · doi:10.1007/s10439-008-9502-3 · Cited by 149 · cited 1×
“The FTLE method has been successfully applied to bio-propulsion [19], medicine [20], [21], the spread of microbes [22], and the study of aerodynamics [23], [24], among other domains.”
MethodFast computation of finite-time Lyapunov exponent fields for unsteady flows
Brunton, S. L., & Rowley, C. W. (2010) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3270044 · Cited by 148 · cited 2×
“The finite-time Lyapunov exponent quantifies this stretching over a fixed, finite-time horizon, resulting in a scalar field over a domain of interest highlighting the most sensitive regions to perturbations in the initial conditions [9], [10], [11], [12], [13].”
BackgroundSelf-citationPersistent transport barrier on the West Florida Shelf
Olascoaga, M. J., Rypina, I. I., Brown, M. G., Beron-Vera, F. J., Koçak, H., Brand, L. E., Halliwell, G. R., & Shay, L. K. (2006) · Geophysical Research Letters · doi:10.1029/2006gl027800 · Cited by 135 · cited 1×
“In the past, FTLE analysis has mostly been performed using passive drifters to study time-varying vector fields, such as ocean flows [55], [56], [57] and pollution transport models [58].”
BackgroundLarge-scale path planning for Underwater Gliders in ocean currents
Rao, D., & Williams, S. B. (2009) · Cited by 132
Optimized robust control invariance for linear discrete-time systems: Theoretical foundations
Raković, S. V., Kerrigan, E. C., Mayne, D. Q., & Kouramas, K. (2007) · Automatica · doi:10.1016/j.automatica.2006.11.006 · Cited by 124 · cited 1×
“Invariant sets are useful in optimal control from the perspective of analyzing robustness and designing model predictive control policies [77].”
BackgroundShadden, S. C., Lekien, F., Paduan, J. D., Chávez, F. P., & Marsden, J. E. (2008) · Deep Sea Research Part II Topical Studies in Oceanography · doi:10.1016/j.dsr2.2008.08.008 · Cited by 124
Successive bifurcations in a shallow-water model applied to the wind-driven ocean circulation
Speich, S., Dijkstra, H. A., & Ghil, M. (1995) · Nonlinear processes in geophysics · doi:10.5194/npg-2-241-1995 · Cited by 123 · cited 1×
“For the majority of this study, we consider this function to be given by the non-autonomous double-gyre equations [66], [67], [68], which is an accessible test case with a known simple analytical expression that can yet generate chaotic complex behavior and flow structures that generalize to more…”
BackgroundBiferale, L., Bonaccorso, F., Buzzicotti, M., Clark Di Leoni, P., & Gustavsson, K. (2019) · Chaos: An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5120370 · Cited by 121 · cited 1×
“Recent developments have made use of model predictive control (MPC) [37] and reinforcement learning (RL) algorithms [38], [39], [40], [41], [42] to find optimal paths in unsteady flow fields.”
BackgroundEnergy-optimal path planning by stochastic dynamically orthogonal level-set optimization
Subramani, D., & Lermusiaux, P. F. J. (2016) · Ocean Modelling · doi:10.1016/j.ocemod.2016.01.006 · Cited by 113 · cited 1×
“For example, graph search algorithms and stochastic optimization have been investigated for path planning [25], [26], [27].”
Learning efficient navigation in vortical flow fields
Gunnarson, P., Mandralis, I., Novati, G., Koumoutsakos, P., & Dabiri, J. O. (2021) · Nature Communications · doi:10.1038/s41467-021-27015-y · Cited by 108 · cited 1×
“Recent developments have made use of model predictive control (MPC) [37] and reinforcement learning (RL) algorithms [38], [39], [40], [41], [42] to find optimal paths in unsteady flow fields.”
BackgroundOptimal trajectory generation in ocean flows
Inanc, T., Shadden, S. C., & Marsden, J. E. (2005) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2005.1470035 · Cited by 105 · cited 2×
“Optimal control, including MPC, has been previously related to the passive FTLE in the past [43], [44], [45], [46].”
BackgroundToward adaptive robotic sampling of phytoplankton in the coastal ocean
Fossum, T. O., Fragoso, G. M., Davies, E. J., Ullgren, J. E., Mendes, R., Johnsen, G. H., Ellingsen, I. H., Eidsvik, J., Ludvigsen, M., & Rajan, K. (2019) · Science Robotics · doi:10.1126/scirobotics.aav3041 · Cited by 105 · cited 1×
“Trajectory planning in an unsteady flow field is an important problem for intelligent mobile agents, with applications including environmental monitoring and data collection [1], [2], [3], [4], [5], [6].”
BackgroundDissipative inertial transport patterns near coherent Lagrangian eddies in the ocean
Beron-Vera, F. J., Olascoaga, M. J., Haller, G., Farazmand, M., Trinanes, J. A., & Wang, Y. (2015) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4928693 · Cited by 97 · cited 1×
“In the past, FTLE analysis has mostly been performed using passive drifters to study time-varying vector fields, such as ocean flows [55], [56], [57] and pollution transport models [58].”
BackgroundLipinski, D., & Mohseni, K. (2010) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3270049 · Cited by 90
Lagrangian Coherent Structures
Shadden, S. C. (2011) · doi:10.1002/9783527639748.ch3 · Cited by 80
Zhang, Y., Ryan, J. P., Hobson, B. W., Kieft, B., Romano, A. E., Barone, B., Preston, C. M., Roman, B., Raanan, B. Y., Pargett, D. M., et al. (2021) · Science Robotics · doi:10.1126/scirobotics.abb9138 · Cited by 79
A Fast Method for Approximating Invariant Manifolds
Guckenheimer, J. M., & Vladimirsky, A. (2004) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/030600179 · Cited by 77 · cited 1×
“Invariant manifolds, cFTLE ridges in this case, play a crucial role in global bifurcations, which could be useful in understanding the change in stability described above [80], [81].”
BackgroundLagrangian coherent structures in low Reynolds number swimming
Wilson, M. M., Peng, J., Dabiri, J. O., & Eldredge, J. D. (2009) · Journal of Physics Condensed Matter · doi:10.1088/0953-8984/21/20/204105 · Cited by 66 · cited 2×
“Forward time cFTLE ridges form transport barriers similar to traditional FTLE ridges [19].”
BackgroundMethodLagrangian coherent structures are associated with fluctuations in airborne microbial populations
Tallapragada, P., Ross, S. D., & Schmale, D. G. (2011) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.3624930 · Cited by 62 · cited 1×
“The FTLE method has been successfully applied to bio-propulsion [19], medicine [20], [21], the spread of microbes [22], and the study of aerodynamics [23], [24], among other domains.”
MethodTime and Energy Optimal Path Planning in General Flows
Kularatne, D. N., Bhattacharya, S., & Hsieh, M. A. (2016) · doi:10.15607/rss.2016.xii.047 · Cited by 61
Detecting Vortex Formation and Shedding in Cylinder Wakes Using Lagrangian Coherent Structures
Rockwood, M. P., Taira, K., & Green, M. (2016) · AIAA Journal · doi:10.2514/1.j055051 · Cited by 52 · cited 1×
“More broadly, FTLE has also been used to compute coherent structures for a wide range of other flows [10], [59], [60], [61], [62], [63].”
MethodOptimal trajectory generation for a glider in time-varying 2D ocean flows B-spline model
Zhang, W., Inanc, T., Ober-Blobaum, S., & Marsden, J. E. (2008) · 2008 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2008.4543348 · Cited by 50 · cited 2×
“Alternatively, models that incorporate inertial effects can also be used [18], [44], [52].”
BackgroundLearning to swim in potential flow
Jiao, Y., Ling, F., Heydari, S., Heess, N., Merel, J., & Kanso, E. (2021) · Physical Review Fluids · doi:10.1103/physrevfluids.6.050505 · Cited by 47 · cited 1×
“Recent developments have made use of model predictive control (MPC) [37] and reinforcement learning (RL) algorithms [38], [39], [40], [41], [42] to find optimal paths in unsteady flow fields.”
BackgroundLagrangian coherent structures separate dynamically distinct regions in fluid flows
Kelley, D. H., Allshouse, M., & Ouellette, N. T. (2013) · Physical Review E · doi:10.1103/physreve.88.013017 · Cited by 45 · cited 1×
“These separatrices demarcate the boundaries between different regions in a domain of interest where passive tracers remain trapped [54].”
BackgroundLagrangian coherent structures and inertial particle dynamics
Madhavan, S., Brunton, S. L., & Riley, J. J. (2016) · Physical review. E · doi:10.1103/physreve.93.033108 · Cited by 42 · cited 2×
“Alternatively, models that incorporate inertial effects can also be used [18], [44], [52].”
BackgroundMethodSelf-citationMulti-vehicle cooperation and nearly fuel-optimal flock guidance in strong background flows
Song, Z., Lipinski, D., & Mohseni, K. (2017) · Ocean Engineering · doi:10.1016/j.oceaneng.2017.06.024 · Cited by 42 · cited 3×
“Algorithms inspired from computational fluid dynamics have also been used to explore coordinated control of swarms in flow fields [7], [8], [34], [35], [36].”
BackgroundMethodSelf-citationTalley, L. D., Rosso, I., Kamenkovich, I. V., Mazloff, M. R., Wang, J., Boss, E., Gray, A. R., Johnson, K. S., Key, R. M., Riser, S. C., et al. (2018) · Journal of Geophysical Research Oceans · doi:10.1029/2018jc014059 · Cited by 42 · cited 1×
“For instance, determining the deployment locations for intelligent mobile sensors is a challenging task with significant cost and schedule complications [72]. cFTLE can be potentially useful in finding locations where the control law is able to transport agents effectively.”
BackgroundGeometry of unsteady fluid transport during fluid–structure interactions
Franco, E., Pekarek, D., Peng, J., & Dabiri, J. O. (2007) · Journal of Fluid Mechanics · doi:10.1017/s0022112007007872 · Cited by 41 · cited 1×
“More broadly, FTLE has also been used to compute coherent structures for a wide range of other flows [10], [59], [60], [61], [62], [63].”
MethodMinimum time heading control of underpowered vehicles in time-varying ocean currents
Rhoads, B., Mezić, I., & Poje, A. C. (2013) · Ocean Engineering · doi:10.1016/j.oceaneng.2013.03.012 · Cited by 38 · cited 1×
“Trajectory planning in an unsteady flow field is an important problem for intelligent mobile agents, with applications including environmental monitoring and data collection [1], [2], [3], [4], [5], [6].”
BackgroundLagrangian structures and transport in turbulent magnetized plasmas
Padberg‐Gehle, K., Hauff, T., Jenko, F., & Junge, O. (2007) · New Journal of Physics · doi:10.1088/1367-2630/9/11/400 · Cited by 35 · cited 1×
“More broadly, FTLE has also been used to compute coherent structures for a wide range of other flows [10], [59], [60], [61], [62], [63].”
MethodThe `upstream wake' of swimming and flying animals and its correlation with propulsive efficiency
Peng, J., & Dabiri, J. O. (2008) · Journal of Experimental Biology · doi:10.1242/jeb.015883 · Cited by 33 · cited 1×
“More broadly, FTLE has also been used to compute coherent structures for a wide range of other flows [10], [59], [60], [61], [62], [63].”
MethodInvariant manifolds and global bifurcations
Guckenheimer, J. M., Krauskopf, B., Osinga, H. M., & Sandstede, B. (2015) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4915528 · Cited by 31 · cited 2×
“Invariant manifolds, cFTLE ridges in this case, play a crucial role in global bifurcations, which could be useful in understanding the change in stability described above [80], [81].”
BackgroundMaximal Sensitive Dependence and the Optimal Path to Epidemic Extinction
Forgoston, E., Bianco, S., Shaw, L. B., & Schwartz, I. B. (2010) · Bulletin of Mathematical Biology · doi:10.1007/s11538-010-9537-0 · Cited by 29 · cited 1×
“The FTLE method has been successfully applied to bio-propulsion [19], medicine [20], [21], the spread of microbes [22], and the study of aerodynamics [23], [24], among other domains.”
MethodA master-slave fluid cooperative control algorithm for optimal trajectory planning
Lipinski, D., & Mohseni, K. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5980401 · Cited by 28 · cited 1×
“Algorithms inspired from computational fluid dynamics have also been used to explore coordinated control of swarms in flow fields [7], [8], [34], [35], [36].”
MethodBuzzicotti, M., Biferale, L., Bonaccorso, F., Leoni, P. C. D., & Gustavsson, K. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77091-4_14 · Cited by 26
Fuel-efficient navigation in complex flows
Senatore, C., & Ross, S. D. (2008) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2008.4586663 · Cited by 25 · cited 1×
“Optimal control, including MPC, has been previously related to the passive FTLE in the past [43], [44], [45], [46].”
BackgroundTransport barriers to self-propelled particles in fluid flows
Berman, S., Buggeln, J. H., Brantley, D., Mitchell, K. A., & Solomon, T. H. (2021) · Physical Review Fluids · doi:10.1103/physrevfluids.6.l012501 · Cited by 25 · cited 1×
“Similar studies have been performed in the past for biological applications, where FTLE was used to understand the behavior of actively propelling microswimmers [52], [53].”
MethodEnergy–time optimal path planning in dynamic flows: Theory and schemes
Doshi, M. M., Bhabra, M. S., & Lermusiaux, P. F. J. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115865 · Cited by 25
Finite-horizon, energy-efficient trajectories in unsteady flows
Krishna, K., Song, Z., & Brunton, S. L. (2022) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.2021.0255 · Cited by 24 · cited 3×
“In previous work by the authors [37], it was found that large energy expenditure of active agents corresponded with the presence of large background FTLE.”
BackgroundSelf-citationFinite-time Lyapunov exponent-based analysis for compressible flows
Gonzalez, D. R., Speth, R. L., Gaitonde, D. V., & Lewis, M. J. (2016) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.4961066 · Cited by 22
Practical concerns of implementing a finite-time Lyapunov exponent analysis with under-resolved data
Rockwood, M. P., Loiselle, T., & Green, M. (2019) · Experiments in Fluids · doi:10.1007/s00348-018-2658-1 · Cited by 18 · cited 1×
“The FTLE method has been successfully applied to bio-propulsion [19], medicine [20], [21], the spread of microbes [22], and the study of aerodynamics [23], [24], among other domains.”
MethodLong-distance migration with minimal energy consumption in a thermal turbulent environment
Xu, A., Wu, H.-L., & Xi, H.-D. (2023) · Physical Review Fluids · doi:10.1103/physrevfluids.8.023502 · Cited by 17 · cited 1×
“Recent developments have made use of model predictive control (MPC) [37] and reinforcement learning (RL) algorithms [38], [39], [40], [41], [42] to find optimal paths in unsteady flow fields.”
BackgroundCooperative Control of a Team of Unmanned Vehicles Using Smoothed Particle Hydrodynamics
Lipinski, D., & Mohseni, K. (2010) · AIAA Guidance, Navigation, and Control Conference and Exhibit · doi:10.2514/6.2010-8316 · Cited by 15
Controlling Basin Breakout for Robots Operating in Uncertain Flow Environments
Heckman, C., Hsieh, M. A., & Schwartz, I. B. (2015) · Springer tracts in advanced robotics · doi:10.1007/978-3-319-23778-7_37 · Cited by 13 · cited 1×
“Optimal control, including MPC, has been previously related to the passive FTLE in the past [43], [44], [45], [46].”
BackgroundAnisotropic active Lagrangian particle swarm control in a meandering jet
Song, Z., & Mohseni, K. (2015) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc.2015.7402115 · Cited by 10 · cited 2×
“Algorithms inspired from computational fluid dynamics have also been used to explore coordinated control of swarms in flow fields [7], [8], [34], [35], [36].”
BackgroundMethodSelf-citationFeasible area coverage of a hurricane using micro-aerial vehicles
Lipinski, D. M., & Mohseni, K. (2014) · AIAA Atmospheric Flight Mechanics Conference · doi:10.2514/6.2014-0894 · Cited by 9 · cited 1×
“Algorithms inspired from computational fluid dynamics have also been used to explore coordinated control of swarms in flow fields [7], [8], [34], [35], [36].”
MethodNavigating Underactuated Agents by Hitchhiking Forecast Flows
Wiggert, M., Doshi, M. M., Lermusiaux, P. F. J., & Tomlin, C. J. (2022) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc51059.2022.9992375 · Cited by 9 · cited 1×
“Recent works along this direction in the context of navigating flow fields include [78], [79].”
BackgroundReal-Time Identification of Vortex Shedding in the Wake of a Circular Cylinder
Rockwood, M. P., & Green, M. (2018) · AIAA Journal · doi:10.2514/1.j057383 · Cited by 8 · cited 1×
“The FTLE method has been successfully applied to bio-propulsion [19], medicine [20], [21], the spread of microbes [22], and the study of aerodynamics [23], [24], among other domains.”
Method
Research works printed but not linked: 4
- bhatta, 2005, Coordination of an underwater glider fleet for adaptive ocean sampling, Proc Int Workshop Underwater Robot Int Adv Robot Programmed (IARP), 61
- risbeck, 2015, Mpctools Nonlinear model predictive control tools for casadi (python interface)
- speich, 1994, Interannual variability of the mid-latitude oceans: A new source of climate variability, Sist Terra, 3, 459
- 10.7551/mitpress/9780262042383.003.0012 · doi:10.7551/mitpress/9780262042383.003.0012
Cited by
Sensing flow gradients is necessary for learning autonomous underwater navigation
Jiao, Y., Hang, H., Merel, J., & Kanso, E. (2025) · Nature Communications · doi:10.1038/s41467-025-58125-6 · Cited by 23
Optimal tracking strategies in a turbulent flow
Calascibetta, C., Biferale, L., Borra, F., Celani, A., & Cencini, M. (2023) · Communications Physics · doi:10.1038/s42005-023-01366-y · Cited by 26
Uncertainties in the finite-time Lyapunov exponent in an ocean ensemble prediction model
Matuszak, M., Röhrs, J., Isachsen, P. E., & Idžanović, M. (2025) · Ocean science · doi:10.5194/os-21-401-2025 · Cited by 6
Super-resolution reconstruction of turbulent flows from a single Lagrangian trajectory
Wu, H.-L., Xu, A., & Xi, H.-D. (2026) · Journal of Fluid Mechanics · doi:10.1017/jfm.2025.11033 · Cited by 9
Surfing vortex rings for energy-efficient propulsion
Gunnarson, P. J., & Dabiri, J. O. (2025) · PNAS Nexus · doi:10.1093/pnasnexus/pgaf031 · Cited by 6
“Recent algorithmic approaches have involved data-driven techniques such as reinforcement learning, in which onboard flow measurements provided sufficient information to navigate through a variety of unsteady canonical and oceanic flow environments (e.g. (13 – 18)).”
Metadata
- Authors
- Krishna, K., Brunton, S. L., & Song, Z.
- Affiliations
- University of Washington (US)
- University of Hawaiʻi at Mānoa (US)
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 118916-118930
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4387831842
- Cited by
- 12
- References
- 81
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 1 · 2023: 2
- FWCI
- 4.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Science Foundation for the project ‘AI Institute in Dynamic Systems’ (2112085)
- U.S. Air Force Office of Scientific Research (FA9550-21-1-0178)
- Topics
- Physical Sciences › Mathematics › Mathematical Physics › Mathematical Dynamics and Fractals
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Quantum chaos and dynamical systems
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- finite-time Lyapunov exponents, model predictive control, reinforcement learning, coherent structures, invariant manifolds, unsteady flow, active agents, transportation costs, trajectory planning, autonomous navigation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.