The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data
Open accessAbstract
Abstract Numerical simulations on fluid dynamics problems primarily rely on spatially or/and temporally discretization of the governing equation using polynomials into a finite-dimensional algebraic system. Due to the multi-scale nature of the physics and sensitivity from meshing a complicated geometry, such process can be computational prohibitive for most real-time applications (e.g., clinical diagnosis and surgery planning) and many-query analyses (e.g., optimization design and uncertainty quantification). Therefore, developing a cost-effective surrogate model is of great practical significance. Deep learning (DL) has shown new promises for surrogate modeling due to its capability of handling strong nonlinearity and high dimensionality. However, the off-the-shelf DL architectures, success of which heavily relies on the large amount of training data and interpolatory nature of the problem, fail to operate when the data becomes sparse. Unfortunately, data is often insufficient in most parametric fluid dynamics problems since each data point in the parameter space requires an expensive numerical simulation based on the first principle, e.g., Navier–Stokes equations. In this paper, we provide a physics-constrained DL approach for surrogate modeling of fluid flows without relying on any simulation data. Specifically, a structured deep neural network (DNN) architecture is devised to enforce the initial and boundary conditions, and the governing partial differential equations (i.e., Navier–Stokes equations) are incorporated into the loss of the DNN to drive the training. Numerical experiments are conducted on a number of internal flows relevant to hemodynamics applications, and the forward propagation of uncertainties in fluid properties and domain geometry is studied as well. The results show excellent agreement on the flow field and forward-propagated uncertainties between the DL surrogate approximations and the first-principle numerical simulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2017) · Cited by 11,625
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
Xiu, D., & Karniadakis, G. E. (2002) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827501387826 · Cited by 4,807
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Solving the quantum many-body problem with artificial neural networks
Carleo, G., & Troyer, M. (2017) · Science · doi:10.1126/science.aag2302 · Cited by 2,215
DGM: A deep learning algorithm for solving partial differential equations
Sirignano, J., & Spiliopoulos, K. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.029 · Cited by 2,208
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
Nonlinear Model Reduction via Discrete Empirical Interpolation
Chaturantabut, S., & Sorensen, D. C. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/090766498 · Cited by 1,925
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems
Benner, P., Gugercin, S., & Willcox, K. (2015) · SIAM Review · doi:10.1137/130932715 · Cited by 1,916
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
Predicting the output from a complex computer code when fast approximations are available
Kennedy, M. (2000) · Biometrika · doi:10.1093/biomet/87.1.1 · Cited by 1,605
The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems
E, W., & Yu, B. (2018) · Communications in Mathematics and Statistics · doi:10.1007/s40304-018-0127-z · Cited by 1,418
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Jagtap, A. D., Kawaguchi, K., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109136 · Cited by 1,127
Blumer, A., Ehrenfeucht, A., Haussler, D., & Warmuth, M. K. (1987) · Information Processing Letters · doi:10.1016/0020-0190(87)90114-1 · Cited by 1,054
Zhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005 · cited 1×
“Most modern deep learning frameworks such as PyTorch [60], TensorFlow [61], and Theano [62] have the AD implemented.”
MethodArtificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Brisman, J. L., Song, J. K., & Newell, D. W. (2006) · New England Journal of Medicine · doi:10.1056/nejmra052760 · Cited by 896
OpenFOAM: A C++ Library for Complex Physics Simulations
Jasak, H., Jemcov, A., & Tuković, Ž. (2007) · Cited by 884
E, W., Han, J., & Jentzen, A. (2017) · Communications in Mathematics and Statistics · doi:10.1007/s40304-017-0117-6 · Cited by 822
Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics
Najm, H. N. (2009) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fluid.010908.165248 · Cited by 768
Wang, J.-X., Wu, J.-L., & Xiao, H. (2017) · Physical Review Fluids · doi:10.1103/physrevfluids.2.034603 · Cited by 737
Self-citationMeng, X., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109020 · Cited by 713
Zhu, Y., & Zabaras, N. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.018 · Cited by 704
Berg, J., & Nyström, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.06.056 · Cited by 657
Spectral methods for uncertainty quantification : with applications to computational fluid dynamics
Maître, O. P. L., & Knio, O. (2010) · Springer eBooks · Cited by 589
Scarselli, F., & Chung Tsoi, A. (1998) · Neural Networks · doi:10.1016/s0893-6080(97)00097-x · Cited by 571
A Stochastic Radial Basis Function Method for the Global Optimization of Expensive Functions
Regis, R. G., & Shoemaker, C. A. (2007) · INFORMS Journal on Computing · doi:10.1287/ijoc.1060.0182 · Cited by 528
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.048 · Cited by 513
Berger, S. A., & Jou, L.-D. (2000) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fluid.32.1.347 · Cited by 502
Association of Hemodynamic Characteristics and Cerebral Aneurysm Rupture
Cebral, J. R., Mut, F., Weir, J., & Putman, C. M. (2011) · American Journal of Neuroradiology · doi:10.3174/ajnr.a2274 · Cited by 467
Tripathy, R. K., & Bilionis, I. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.036 · Cited by 464
Reduced Order Methods for Modeling and Computational Reduction
(2014) · Springer eBooks · doi:10.1007/978-3-319-02090-7 · Cited by 441
Neural algorithm for solving differential equations
Lee, H., & Kang, I. S. (1990) · Journal of Computational Physics · doi:10.1016/0021-9991(90)90007-n · Cited by 436
Adversarial uncertainty quantification in physics-informed neural networks
Yang, Y., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.027 · Cited by 414
Deep learning of vortex-induced vibrations
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.872 · Cited by 404
Large-Scale Optical Neural Networks Based on Photoelectric Multiplication
Hamerly, R., Bernstein, L., Sludds, A., Soljačić, M., & Englund, D. (2019) · Physical Review X · doi:10.1103/physrevx.9.021032 · Cited by 388
Machine learning strategies for systems with invariance properties
Ling, J., Jones, R., & Templeton, J. (2016) · Journal of Computational Physics · doi:10.1016/j.jcp.2016.05.003 · Cited by 386
Finite element model updating in structural dynamics by using the response surface method
Ren, W.-X., & Chen, H.-B. (2010) · Engineering Structures · doi:10.1016/j.engstruct.2010.04.019 · Cited by 374
Deep learning of vortex-induced vibrationsPreprint
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 361
An Alternative View: When Does SGD Escape Local Minima?Preprint
Kleinberg, R. D., Li, Y.-Z., & Yuan, Y. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1802.06175 · Cited by 349
Beck, C., E, W., & Jentzen, A. (2019) · Journal of Nonlinear Science · doi:10.1007/s00332-018-9525-3 · Cited by 308
Mo, S., Zabaras, N., Shi, X., & Wu, J. (2019) · Water Resources Research · doi:10.1029/2018wr024638 · Cited by 288
Baker, N., Alexander, F., Bremer, T., Hagberg, A., Kevrekidis, Y., Najm, H., Parashar, M., Patra, A., Sethian, J., Wild, S., et al. (2019) · doi:10.2172/1478744 · Cited by 282
Label-Free Supervision of Neural Networks with Physics and Domain Knowledge
Stewart, R., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10934 · Cited by 274
Model Order Reduction in Fluid Dynamics: Challenges and Perspectives
Lassila, T., Manzoni, A., Quarteroni, A. M., & Rozza, G. (2014) · Springer eBooks · doi:10.1007/978-3-319-02090-7_9 · Cited by 269
Data-driven science and engineering : machine learning, dynamical systems, and control
Brunton, S. L., & Kutz, J. N. (2019) · doi:10.1017/978-1-009-08951-7 · Cited by 242
Raissi, M., Yazdani, A. Z. K., & Karniadakis, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04327 · Cited by 235
Grohs, P., Hornung, F., Jentzen, A., & von Wurstemberger, P. (2023) · Memoirs of the American Mathematical Society · doi:10.1090/memo/1410 · Cited by 165
Karumuri, S., Tripathy, R., Bilionis, I., & Panchal, J. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109120 · Cited by 159
Model Reduction for Transport-Dominated Problems via Online Adaptive Bases and Adaptive Sampling
Peherstorfer, B. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1257275 · Cited by 147
Physics-Driven Regularization of Deep Neural Networks for Enhanced Engineering Design and Analysis
Nabian, M. A., & Meidani, H. (2019) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4044507 · Cited by 97
Imposing Hard Constraints on Deep Networks: Promises and LimitationsPreprint
Márquez-Neila, P., Salzmann, M., & Fua, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02025 · Cited by 91
Holland, J. R., Baeder, J. D., & Duraisamy, K. (2019) · AIAA SciTech Forum · doi:10.2514/6.2019-1884 · Cited by 91
Solving stochastic differential equations and Kolmogorov equations by means of deep learningPreprint
Beck, C., Becker, S. B. S., Grohs, P., Jaafari, N., & Jentzen, A. (2018) · arXiv (Cornell University) · Cited by 82
Learning Parameters and Constitutive Relationships with Physics Informed Deep Neural NetworksPreprint
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P. G., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03398 · Cited by 74
From Deep to Physics-Informed Learning of Turbulence: DiagnosticsPreprint
King, R., Hennigh, O., Mohan, A. T., & Chertkov, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07785 · Cited by 73
A Robust-Equitable Measure for Feature Ranking and Selection
Ding, A. A., Dy, J., Li, Y., & Chang, Y. (2017) · Journal of Machine Learning Research · Cited by 69
Machine learning action parameters in lattice quantum chromodynamics
Shanahan, P. E., Trewartha, D., & Detmold, W. (2018) · Physical Review D · doi:10.1103/physrevd.97.094506 · Cited by 65
Atkinson, S., & Zabaras, N. J. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.12.037 · Cited by 45
The Neural Network Approach to Inverse Problems in Differential EquationsPreprint
Xu, K., & Darve, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07758 · Cited by 41
Weakly-Supervised Deep Learning of Heat Transport via Physics Informed LossPreprint
Sharma, R., Farimani, A. B., Gomes, J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11374 · Cited by 28
Beck, C., Weinan, E., & Jentzen, A. (2017) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000314918 · Cited by 14
Wang, J.-X., Wu, J.-L., & Xiao, H. (2016) · arXiv · doi:10.48550/arxiv.1606.07987 · Cited by 1
Self-citation(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Self-citation
Metadata
- Authors
- Sun, L., Gao, H., Pan, S., & Wang, J.-X.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2020-04
- Volume
- 361
- Pages
- 112732
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W2948230027
- Cited by
- 1,045
- References
- 72
- FWCI
- 29.90
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.