The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Deep neural networks for data-driven LES closure models
Open accessAbstract
In this work, we present a novel data-based approach to turbulence modeling for Large Eddy Simulation (LES) by artificial neural networks. We define the perfect LES formulation including the discretization operators and derive the associated perfect closure terms. We then generate training data for these terms from direct numerical simulations of decaying homogeneous isotropic turbulence. We design and train artificial neural networks based on local convolution filters to predict the underlying unknown non-linear mapping from the coarse grid quantities to the closure terms without a priori assumptions. We show that selecting both the coarse grid primitive variables as well as the coarse grid LES operator as input features significantly improves training results. All investigated networks are able to generalize from the data and learn approximations with a cross correlation of up to 47% and even 73% for the inner elements, demonstrating that the perfect closure can indeed be learned from the provided coarse grid data. Since the learned closure terms are approximate, a direct application leads to stability issues. We show how to employ the artificial neural network output to construct stable and accurate models. The best results have been achieved with a data-informed, temporally and spatially adaptive eddy viscosity closure. While further investigations into the generalizability of the approach is warranted, this work thus represents a starting point for further research into data-driven, optimal turbulence models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1993.341010 · Cited by 14,265
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · International Conference on Machine Learning · Cited by 13,995
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Neural networks: A comprehensive foundation
Tadeusiewicz, R. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)90080-2 · Cited by 7,218
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“Typically, for ANNs, this optimization is conducted in two steps (Rumelhart et al. 1986; Werbos 1990): (i) The backpropagation or backward pass through the network, which computes the partial derivatives of the cost function w.r.t. to all weights in the network via the chain rule, i.e. ∂C (ˆ Y ,Y (…”
MethodConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
On the approximate realization of continuous mappings by neural networks
Funahashi, K.-I. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90003-8 · Cited by 4,206 · cited 1×
“It is worth noting that while theoretical considerations show that MLP with one hidden layer can approximate any continuous function (Barron 1993; Cybenko 1989; Funahashi 1989), mathematically validated results for more complex networks and other network architectures are still missing.”
Background(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
(1989) · neural information processing systems · Cited by 3,736
A Neural Probabilistic Language Model
Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C., Jaz, K., Hofmann, T., Poggio, T., & Shawe-Taylor, J. S. (2000) · Cited by 3,479
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Universal approximation bounds for superpositions of a sigmoidal function
Barron, A. R. (1993) · IEEE Transactions on Information Theory · doi:10.1109/18.256500 · Cited by 2,804
Advances in Neural Information Processing Systems 37
(2024) · doi:10.52202/079017 · Cited by 2,791
A neural probabilistic language model
BengioYoshua, DucharmeRéjean, VincentPascal, & JanvinChristian (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944966 · Cited by 2,644
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335 · cited 2×
“We briefly investigated optimized variants (Ramachandran et al. 2018), but found no consistent improvement in network accuracy for our cases.”
BackgroundMethodReynolds averaged turbulence modelling using deep neural networks with embedded invariance
Ling, J., Kurzawski, A., & Templeton, J. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.615 · Cited by 1,624
A Logical Calculus of the Ideas Immanent in Nervous Activity (1943)
McCulloch, W., & Pitts, W. (2021) · Ideas That Created the Future · doi:10.7551/mitpress/12274.003.0011 · Cited by 1,111
Deep learning in fluid dynamics
Kutz, J. N. (2017) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.803 · Cited by 831
On the properties of similarity subgrid-scale models as deduced from measurements in a turbulent jet
Liu, S., Meneveau, C., & Katz, J. (1994) · Journal of Fluid Mechanics · doi:10.1017/s0022112094002296 · Cited by 748
Proceedings of the 26th Annual International Conference on Machine Learning
Danyluk, A., Bottou, L., & Littman, M. L. (2009) · Cited by 708
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1992) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02134016 · Cited by 703
53rd AIAA Aerospace Sciences Meeting
(2015) · doi:10.2514/masm15 · Cited by 676
The handbook of brain theory and neural networks
Rattay, F. (1996) · Simulation Practice and Theory · doi:10.1016/0928-4869(96)83761-x · Cited by 500
Neural Network Modeling for Near Wall Turbulent Flow
Milano, M., & Koumoutsakos, P. (2002) · Journal of Computational Physics · doi:10.1006/jcph.2002.7146 · Cited by 428
A Machine Learning Strategy to Assist Turbulence Model Development
Tracey, B. D., Duraisamy, K., & Alonso, J. J. (2015) · 53rd AIAA Aerospace Sciences Meeting · doi:10.2514/6.2015-1287 · Cited by 284
Neural networks based subgrid scale modeling in large eddy simulations
Sarghini, F., de Felice, G., & Santini, S. (2003) · Computers & Fluids · doi:10.1016/s0045-7930(01)00098-6 · Cited by 192
A neural network approach for the blind deconvolution of turbulent flows
Maulik, R., & San, O. (2017) · Journal of Fluid Mechanics · doi:10.1017/jfm.2017.637 · Cited by 187
Geneva, N., & Zabaras, N. J. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.01.021 · Cited by 158
A comparison study between MLP and convolutional neural network models for character recognition
Driss, S. B., Soua, M., Kachouri, R., & Akil, M. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2262589 · Cited by 90
Anderson, B. W., & Domaradzki, J. A. (2012) · Physics of Fluids · doi:10.1063/1.4729618 · Cited by 50
Real-Time Image and Video Processing: From Research to Reality
Kehtarnavaz, N., & Gamadia, M. (2008) · Synthesis lectures on image, video, and multimedia processing · doi:10.1007/978-3-031-02240-1 · Cited by 29
?Perfect? modeling framework for dynamic SGS model testing in large eddy simulation
Stefano, G. D., & Vasilyev, O. V. (2004) · Theoretical and Computational Fluid Dynamics · doi:10.1007/s00162-004-0146-0 · Cited by 27
Nadiga, B., & Livescu, D. (2007) · Physical Review E · doi:10.1103/physreve.75.046303 · Cited by 19
Peyrard, C., Mamalet, F., & García, C. (2015) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0005297200840091 · Cited by 19
Smagorinsky (1963) · doi:10.1175/1520-0493(1963)091<0099:gcewtp>2.3.co;2
Wallach, I., Dzamba, M., & Heifets, A. (2015) · arXiv · doi:10.48550/arxiv.1510.02855
Cited by
Machine learning–accelerated computational fluid dynamics
Kochkov, D., Smith, J. A., Alieva, A., Wang, Q., Brenner, M. P., & Hoyer, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101784118 · Cited by 1,042
Deep Learning Methods for Reynolds-Averaged Navier–Stokes Simulations of Airfoil Flows
Thuerey, N., Weißenow, K., Prantl, L., & Hu, X. (2020) · AIAA Journal · doi:10.2514/1.j058291 · Cited by 609
Enhancing computational fluid dynamics with machine learning
Vinuesa, R., & Brunton, S. L. (2022) · Nature Computational Science · doi:10.1038/s43588-022-00264-7 · Cited by 596
Learning data-driven discretizations for partial differential equations
Bar-Sinai, Y., Hoyer, S., Hickey, J., & Brenner, M. P. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814058116 · Cited by 543
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries
Kashefi, A., Rempe, D., & Guibas, L. J. (2021) · Physics of Fluids · doi:10.1063/5.0033376 · Cited by 295
Metadata
- Authors
- Beck, A., Flad, D., & Munz, C.-D.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 398
- Pages
- 108910
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2807826281
- Cited by
- 356
- References
- 52
- FWCI
- 19.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.