The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow control
Open accessAbstract
We present the first application of an artificial neural network trained through a deep reinforcement learning agent to perform active flow control. It is shown that, in a two-dimensional simulation of the Kármán vortex street at moderate Reynolds number ($Re=100$), our artificial neural network is able to learn an active control strategy from experimenting with the mass flow rates of two jets on the sides of a cylinder. By interacting with the unsteady wake, the artificial neural network successfully stabilizes the vortex alley and reduces drag by approximately 8 %. This is performed while using small mass flow rates for the actuation, of the order of 0.5 % of the mass flow rate intersecting the cylinder cross-section once a new pseudo-periodic shedding regime is found. This opens the way to a new class of methods for performing active flow control.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities
Geuzaine, C., & Remacle, J. (2009) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.2579 · Cited by 7,814
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Automated Solution of Differential Equations by the Finite Element Method: The FEniCS Book
(2012) · Lecture Notes in Computational Science and Engineering · doi:10.1007/978-3-642-23099-8 · Cited by 2,204
Algorithm 832: UMFPACK V4.3---an unsymmetric-pattern multifrontal method
Davis, T. A. (2004) · ACM Transactions on Mathematical Software · doi:10.1145/992200.992206 · Cited by 1,422
Benchmarking Deep Reinforcement Learning for Continuous Control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114
Deep learning in fluid dynamics
Kutz, J. N. (2017) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.803 · Cited by 831
Benchmark Computations of Laminar Flow Around a Cylinder
Schäfer, M., Turek, S., Durst, F., Krause, E., & Rannacher, R. (1996) · Notes on Numerical Fluid Mechanics (NNFM) · doi:10.1007/978-3-322-89849-4_39 · Cited by 761
On the Computational Power of Neural Nets
Siegelmann, H. T., & Sontag, E. D. (1995) · Journal of Computer and System Sciences · doi:10.1006/jcss.1995.1013 · Cited by 692
Closed-Loop Turbulence Control: Progress and Challenges
Brunton, S. L., & Noack, B. R. (2015) · Applied Mechanics Reviews · doi:10.1115/1.4031175 · Cited by 623
Machine Learning Control – Taming Nonlinear Dynamics and Turbulence
Duriez, T., Brunton, S. L., & Noack, B. R. (2017) · Fluid Mechanics and Its Applications · doi:10.1007/978-3-319-40624-4 · Cited by 305
Visualizing the Hidden Activity of Artificial Neural Networks
Rauber, P. E., Fadel, S. G., Falcao, A. X., & Telea, A. C. (2017) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2598838 · Cited by 280
Model identification of reduced order fluid dynamics systems using deep learning
Wang, Z., Xiao, D., Fang, F., Govindan, R., Pain, C. C., & Guo, Y. (2018) · International Journal for Numerical Methods in Fluids · doi:10.1002/fld.4416 · Cited by 265
Closed-loop separation control using machine learning
Gautier, N., Aider, J.-L., Duriez, T., Noack, B. R., Segond, M., & Abel, M. (2015) · Journal of Fluid Mechanics · doi:10.1017/jfm.2015.95 · Cited by 228
Closed-loop separation control using machine learning
Gautier, N., Aider, J. L., Duriez, T., Noack, B. R., Segond, M., & Abel, M. (2015) · CONICET Digital (CONICET) · Cited by 199
A large-scale control strategy for drag reduction in turbulent boundary layers
Schoppa, W., & Hussain, F. (1998) · Physics of Fluids · doi:10.1063/1.869789 · Cited by 175
Performing particle image velocimetry using artificial neural networks: a proof-of-concept
Rabault, J., Kolaas, J., & Jensen, A. (2017) · Measurement Science and Technology · doi:10.1088/1361-6501/aa8b87 · Cited by 140
Self-citationA statistical learning strategy for closed-loop control of fluid flows
Guéniat, F., Mathelin, L., & Hussaini, M. Y. (2016) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-016-0392-y · Cited by 48
A comparison of finite element schemes for the incompressible Navier–Stokes equations
Valen‐Sendstad, K., Logg, A., Mardal, K., Narayanan, H. A., & Mortensen, M. (2012) · Lecture notes in computational science and engineering · doi:10.1007/978-3-642-23099-8_21 · Cited by 21
Efficient collective swimming by harnessing vortices through deep reinforcement learning
Verma, S., Novati, G., & Koumoutsakos, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800923115 · Cited by 10
Cited by
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
Machine learning in aerodynamic shape optimization
Li, J., Du, X., & Martins, J. R. R. A. (2022) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2022.100849 · Cited by 354
Unsupervised deep learning for super-resolution reconstruction of turbulence
Kim, H., Kim, J., Won, S., & Lee, C. (2021) · Journal of Fluid Mechanics · doi:10.1017/jfm.2020.1028 · Cited by 285
A review on deep reinforcement learning for fluid mechanics
Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E. (2021) · Computers & Fluids · doi:10.1016/j.compfluid.2021.104973 · Cited by 270
Self-citationReinforcement learning for bluff body active flow control in experiments and simulations
Fan, D., Yang, L., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2004939117 · Cited by 270
Metadata
- Authors
- Rabault, J., Kuchta, M., Jensen, A., Réglade, U., & Cerardi, N.
- Venue
- Journal of Fluid Mechanics
- Publisher
- Cambridge University Press (CUP)
- Published
- 2019-02-20
- Volume
- 865
- Pages
- 281-302
- ISSN
- 0022-1120 (ISSN-L)
- 1469-7645
- OpenAlex
- W2888317899
- Cited by
- 575
- References
- 31
- FWCI
- 20.17
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.