The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
A review on deep reinforcement learning for fluid mechanics
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Dynamic Programming and Markov Processes.
Freimer, M., & Howard, R. A. (1961) · Journal of the American Statistical Association · doi:10.2307/2282268 · Cited by 3,378
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Optimization Methods for Large-Scale Machine Learning
Bottou, L., Curtis, F. E., & Nocedal, J. (2018) · SIAM Review · doi:10.1137/16m1080173 · Cited by 3,128
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Bellman, R. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56038 · Cited by 2,408
Freimer, M., Bellman, R. E., & Dreyfus, S. E. (1964) · Journal of the American Statistical Association · doi:10.2307/2282884 · Cited by 2,153
High-Dimensional Continuous Control Using Generalized Advantage Estimation
Schulman, J., Moritz, P., Levine, S., Jordan, M., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1506.02438 · Cited by 2,103
Bellman, R. E., & Dreyfus, S. E. (1962) · Princeton University Press eBooks · doi:10.1515/9781400874651 · Cited by 1,971
The FEniCS Project Version 1.5
Alnæs, M. S., Blechta, J., Hake, J. E., Johansson, A., Kehlet, B., Logg, A., Richardson, C., Ring, J., Rognes, M. E., & Wells, G. N. (2015) · Department of Earth Sciences EPrints Repository · doi:10.11588/ans.2015.100.20553 · Cited by 1,877
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
An Introduction to Deep Reinforcement Learning
Vincent, F.-L., Peter, H., Riashat, I., Marc, G. B., & Joelle, P. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000071 · Cited by 1,286
An analysis of temporal-difference learning with function approximation
Tsitsiklis, J. N., & Van Roy, B. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/9.580874 · Cited by 1,194
Reinforcement learning for robots using neural networks
Lin, L.-J. (1992) · Defense Technical Information Center (DTIC) · Cited by 1,042
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Reinforcement Learning · doi:10.1007/978-1-4615-3618-5_2 · Cited by 903
Temporal Difference Learning and TD-Gammon
Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 764
Benchmark Computations of Laminar Flow Around a Cylinder
Schäfer, M., Turek, S., Durst, F., Krause, E., & Rannacher, R. (1996) · Notes on Numerical Fluid Mechanics (NNFM) · doi:10.1007/978-3-322-89849-4_39 · Cited by 761
Kendall, A., Hawke, J., Janz, D., Mazur, P., Reda, D., Allen, J.-M., Lam, V.-D., Bewley, A., & Shah, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793742 · Cited by 694
On the Computational Power of Neural Nets
Siegelmann, H. T., & Sontag, E. D. (1995) · Journal of Computer and System Sciences · doi:10.1006/jcss.1995.1013 · Cited by 692
Dynamic Programming and Markov Processes.
Kaufman, H., & Howard, R. A. (1961) · The American Mathematical Monthly · doi:10.2307/2312519 · Cited by 638
Superhuman AI for multiplayer poker
Brown, N., & Sandholm, T. (2019) · Science · doi:10.1126/science.aay2400 · Cited by 592
Rabault, J., Kuchta, M., Jensen, A., Réglade, U., & Cerardi, N. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2019.62 · Cited by 575
Self-citationAn introduction to deep reinforcement learning
François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018) · doi:10.1561/9781680835397 · Cited by 544
Liou, C.-Y., Cheng, W.-C., Liou, J.-W., & Liou, D.-R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.09.055 · Cited by 467
An Actor-Critic Algorithm for Sequence Prediction
Bahdanau, D., Brakel, P., Xu, K., Goyal, A., Lowe, R., Pineau, J., Courville, A., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1607.07086 · Cited by 423
Asymmetric Actor Critic for Image-Based Robot Learning
Pinto, L., Andrychowicz, M., Welinder, P., Zaremba, W., & Abbeel, P. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.008 · Cited by 343
Evolved Policy GradientsPreprint
Houthooft, R., Chen, R. Y., Isola, P., Stadie, B. C., Wolski, F., Ho, J., & Abbeel, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04821 · Cited by 238
Flow Navigation by Smart Microswimmers via Reinforcement Learning
Colabrese, S., Gustavsson, K., Celani, A., & Biferale, L. (2017) · Physical Review Letters · doi:10.1103/physrevlett.118.158004 · Cited by 237
Synchronisation through learning for two self-propelled swimmers
Novati, G., Verma, S., Alexeev, D., Rossinelli, D., van Rees, W. M., & Koumoutsakos, P. (2017) · Bioinspiration & Biomimetics · doi:10.1088/1748-3190/aa6311 · Cited by 157
Learning to school in the presence of hydrodynamic interactions
Gazzola, M., Tchieu, A. A., Alexeev, D., Brauer, A. D., & Koumoutsakos, P. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2015.686 · Cited by 157
Three-dimensional optimization of staggered finned circular and elliptic tubes in forced convection
Matos, R. S., Laursen, T. A., VARGAS, J. V. C., & Bejan, A. (2004) · International Journal of Thermal Sciences · doi:10.1016/j.ijthermalsci.2003.10.003 · Cited by 148
3D hair synthesis using volumetric variational autoencoders
Saito, S., Hu, L., Ma, C., Ibayashi, H., Luo, L., & Li, H. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275019 · Cited by 117
Learning to school in the presence of hydrodynamic interactions
Gazzola, M., Tchieu, A., Alexeev, D., Brauer, A. D., & Koumoutsakos, P. (2016) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000113533 · Cited by 117
Learning to Drive from Simulation without Real World Labels
Bewley, A., Rigley, J., Liu, Y., Hawke, J., Shen, R., Lam, V.-D., & Kendall, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793668 · Cited by 114
Self-learning how to swim at low Reynolds number
Tsang, A. C. H., Tong, P. W., Nallan, S., & Pak, O. S. (2020) · Physical Review Fluids · doi:10.1103/physrevfluids.5.074101 · Cited by 81
Finding efficient swimming strategies in a three-dimensional chaotic flow by reinforcement learning
Gustavsson, K., Biferale, L., Celani, A., & Colabrese, S. (2017) · The European Physical Journal E · doi:10.1140/epje/i2017-11602-9 · Cited by 74
Fluid directed rigid body control using deep reinforcement learning
Ma, P., Tian, Y., Pan, Z., Ren, B., & Manocha, D. (2018) · ACM Transactions on Graphics · doi:10.1145/3197517.3201334 · Cited by 63
Sensitivity of aerodynamic forces in laminar and turbulent flow past a square cylinder
Méliga, P., Boujo, É., Pujals, G., & Gallaire, F. (2014) · Physics of Fluids · doi:10.1063/1.4896941 · Cited by 52
A statistical learning strategy for closed-loop control of fluid flows
Guéniat, F., Mathelin, L., & Hussaini, M. Y. (2016) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-016-0392-y · Cited by 48
Synchronised Swimming of Two FishPreprint
Novati, G., Verma, S., Alexeev, D., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.04248 · Cited by 42
Swimming strategy of settling elongated micro-swimmers by reinforcement learning
Qiu, J., Huang, W., Xu, C., & Zhao, L. (2020) · Science China Physics Mechanics and Astronomy · doi:10.1007/s11433-019-1502-2 · Cited by 24
Efficient collective swimming by harnessing vortices through deep reinforcement learning
Verma, S., Novati, G., & Koumoutsakos, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1800923115 · Cited by 10
Cited by
Machine learning in aerodynamic shape optimization
Li, J., Du, X., & Martins, J. R. R. A. (2022) · Progress in Aerospace Sciences · doi:10.1016/j.paerosci.2022.100849 · Cited by 354
Metadata
- Authors
- Garnier, P., Viquerat, J., Rabault, J., Larcher, A., Kuhnle, A., & Hachem, E.
- Venue
- Computers & Fluids
- Publisher
- Elsevier BV
- Published
- 2021-07
- Volume
- 225
- Pages
- 104973
- ISSN
- 0045-7930 (ISSN-L)
- OpenAlex
- W2967095864
- Cited by
- 270
- References
- 51
- FWCI
- 17.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.