The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Reinforcement learning for bluff body active flow control in experiments and simulations
Open accessAbstract
Significance: Reinforcement learning (RL) has been applied effectively in games and robotic manipulation. We demonstrate the effectiveness of RL in experimental fluid mechanics by applying it to reduce the drag of circular cylinders in turbulent flow, a canonical fluid–structure interaction problem. Although physics agnostic, RL managed to reduce the drag by 30 % or reach another specified optimum point very quickly. Following this discovery, we used high-fidelity simulations to probe the underlying physical mechanisms so that the discovered control techniques can be generalized to other similar flow problems. More broadly, RL-guided active control can lead to efficient exploration of additional flow-control strategies in experimental fluid mechanics, potentially paving the way for accelerating scientific discovery and different designs in flow-related engineering problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594 · cited 1×
“Among the machine-learning tools, reinforcement learning (RL) offers intriguing opportunities for quick progress, as it has demonstrated its potential for achieving “superhuman” performance in board games (3, 4) and a capability for tackling complex, high-dimensional continuous control tasks (5).”
BackgroundAddressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650 · cited 3×
“Algorithm 1: Reinforcement learning for active fluid control with TD3 Data Availability.”
BackgroundInfluentialVortex Dynamics in the Cylinder Wake
Williamson, C. H. K. (1996) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.28.010196.002401 · Cited by 3,550
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063 · cited 1×
“In recent years, machine learning has received increasing attention for fluid control problems (2) because it could provide a more efficient pathway to achieving effective solutions.”
BackgroundVortex Shedding from Oscillating Bluff Bodies
Bearman, P. (1984) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.16.010184.001211 · Cited by 1,525
Spectral/hp Element Methods for Computational Fluid Dynamics
Karniadakis, G., & Sherwin, S. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198528692.001.0001 · Cited by 1,473
Self-citationMastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.01815 · Cited by 1,102 · cited 1×
“Among the machine-learning tools, reinforcement learning (RL) offers intriguing opportunities for quick progress, as it has demonstrated its potential for achieving “superhuman” performance in board games (3, 4) and a capability for tackling complex, high-dimensional continuous control tasks (5).”
BackgroundControl of Flow Over a Bluff Body
Choi, H., Jeon, W.-P., & Kim, J. (2008) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fluid.39.050905.110149 · Cited by 1,067
On the formation and suppression of vortex ‘shedding’ at low Reynolds numbers
Strykowski, P. J., & Sreenivasan, K. R. (1990) · Journal of Fluid Mechanics · doi:10.1017/s0022112090000933 · Cited by 663
(1965) · Medical Entomology and Zoology · Cited by 652
Fundamentals of Kalman Filtering: A Practical Approach, Fourth Edition
(2015) · doi:10.2514/4.102776 · Cited by 641
Closed-Loop Turbulence Control: Progress and Challenges
Brunton, S. L., & Noack, B. R. (2015) · Applied Mechanics Reviews · doi:10.1115/1.4031175 · Cited by 623
Rabault, J., Kuchta, M., Jensen, A., Réglade, U., & Cerardi, N. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2019.62 · Cited by 575
Berger, E., & Wille, R. (1972) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.04.010172.001525 · Cited by 490
A Linear Systems Approach to Flow Control
Kim, J., & Bewley, T. R. (2007) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fluid.39.050905.110153 · Cited by 397
Lin, J. T., & Pao, Y. H. (1979) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.11.010179.001533 · Cited by 309
Direct shape optimization through deep reinforcement learning
Viquerat, J., Rabault, J., Kuhnle, A., Ghraieb, H., Larcher, A., & Hachem, E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110080 · Cited by 245
Flow Navigation by Smart Microswimmers via Reinforcement Learning
Colabrese, S., Gustavsson, K., Celani, A., & Biferale, L. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.158004 · Cited by 237
Learning to soar in turbulent environments
Reddy, G., Celani, A., Sejnowski, T. J., & Vergassola, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1606075113 · Cited by 170
Control of chaotic systems by deep reinforcement learning
Bucci, M. A., Semeraro, O., Allauzen, A., Wisniewski, G., Cordier, L., & Mathelin, L. (2019) · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rspa.2019.0351 · Cited by 143
Reinforcement Learning and Wavelet Adapted Vortex Methods for Simulations of Self-propelled Swimmers
Gazzola, M., Hejazialhosseini, B., & Koumoutsakos, P. (2014) · SIAM Journal on Scientific Computing · doi:10.1137/130943078 · Cited by 138
Simultaneous CFD evaluation of VIV suppression using smaller control cylinders
Zhu, H., Yao, J., Ma, Y., Zhao, H., & Tang, Y. (2015) · Journal of Fluids and Structures · doi:10.1016/j.jfluidstructs.2015.05.011 · Cited by 130
A robotic Intelligent Towing Tank for learning complex fluid-structure dynamics
Fan, D., Jodin, G., Consi, T. R., Bonfiglio, L., Ma, Y., Keyes, L. R., Karniadakis, G. E., & Triantafyllou, M. S. (2019) · Science Robotics · doi:10.1126/scirobotics.aay5063 · Cited by 96
Self-citationControlled gliding and perching through deep-reinforcement-learning
Novati, G., Mahadevan, L., & Koumoutsakos, P. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.093902 · Cited by 82
Fluid directed rigid body control using deep reinforcement learning
Ma, P., Tian, Y., Pan, Z., Ren, B., & Manocha, D. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201334 · Cited by 63
Efficient collective swimming by harnessing vortices through deep reinforcement learning
Verma, S., Novati, G., & Koumoutsakos, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800923115 · Cited by 10
Cited by
Physics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Self-citation
Metadata
- Authors
- Fan, D., Yang, L., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2020-10-05
- Volume
- 117
- Issue
- 42
- Pages
- 26091-26098
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W3090502885
- Cited by
- 270
- References
- 28
- FWCI
- 18.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.