The DOI matches its Crossref record; 90 of the 90 references it cites were found in a registry or an index.
Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
Open accessAbstract
Abstract Surrogate modeling and uncertainty quantification tasks for PDE systems are most often considered as supervised learning problems where input and output data pairs are used for training. The construction of such emulators is by definition a small data problem which poses challenges to deep learning approaches that have been developed to operate in the big data regime. Even in cases where such models have been shown to have good predictive capability in high dimensions, they fail to address constraints in the data implied by the PDE model. This paper provides a methodology that incorporates the governing equations of the physical model in the loss/likelihood functions. The resulting physics-constrained, deep learning models are trained without any labeled data (e.g. employing only input data) and provide comparable predictive responses with data-driven models while obeying the constraints of the problem at hand. This work employs a convolutional encoder-decoder neural network approach as well as a conditional flow-based generative model for the solution of PDEs, surrogate model construction, and uncertainty quantification tasks. The methodology is posed as a minimization problem of the reverse Kullback-Leibler (KL) divergence between the model predictive density and the reference conditional density, where the later is defined as the Boltzmann-Gibbs distribution at a given inverse temperature with the underlying potential relating to the PDE system of interest. The generalization capability of these models to out-of-distribution input is considered. Quantification and interpretation of the predictive uncertainty is provided for a number of problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Self-citationLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationLearning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
“[392] devised a physics-constrained deep learning model for high-dimensional UQ and surrogate modeling without labeled data.”
BackgroundDeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Physics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Self-citationWhen and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Self-citationA physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Interpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Transfer learning enhanced physics informed neural network for phase-field modeling of fracture
Goswami, S., Anitescu, C., Chakraborty, S., & Rabczuk, T. (2020) · Theoretical and Applied Fracture Mechanics · doi:10.1016/j.tafmec.2019.102447 · Cited by 900
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
von Rueden, L., Mayer, S., Beckh, K., Georgiev, B., Giesselbach, S., Heese, R., Kirsch, B., Walczak, M., Pfrommer, J., Pick, A., et al. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3079836 · Cited by 793
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
Self-citationPhysics-informed machine learning: case studies for weather and climate modelling
Kashinath, K., Mustafa, M., Albert, A., Wu, J.-L., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., et al. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0093 · Cited by 662
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Self-citationGao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Can deep learning beat numerical weather prediction?
Schultz, M. G., Betancourt, C., Gong, B., Kleinert, F., Langguth, M., Leufen, L. H., Mozaffari, A., & Stadtler, S. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0097 · Cited by 562
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P., Tartakovsky, G. D., & Barajas‐Solano, D. (2020) · Water Resources Research · doi:10.1029/2019wr026731 · Cited by 515
Self-citationPhysics-guided convolutional neural network (PhyCNN) for data-driven seismic response modeling
Zhang, R., Liu, Y., & Sun, H. (2020) · Engineering Structures · doi:10.1016/j.engstruct.2020.110704 · Cited by 506
Physics-informed multi-LSTM networks for metamodeling of nonlinear structures
Zhang, R., Liu, Y., & Sun, H. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113226 · Cited by 504
Deep learning in nano-photonics: inverse design and beyond
Wiecha, P. R., Arbouet, A., Girard, C., & Muskens, O. L. (2021) · Photonics Research · doi:10.1364/prj.415960 · Cited by 501
Inverse-designed spinodoid metamaterials
Kumar, S., Tan, S., Zheng, L., & Kochmann, D. M. (2020) · npj Computational Materials · doi:10.1038/s41524-020-0341-6 · Cited by 444
A comprehensive review of digital twin — part 1: modeling and twinning enabling technologies
Thelen, A., Zhang, X., Fink, O., Lu, Y., Ghosh, S., Youn, B. D., Todd, M. D., Mahadevan, S., Hu, C., & Hu, Z. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03425-4 · Cited by 441
Physics-Informed Neural Networks for Cardiac Activation Mapping
Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00042 · Cited by 410
Self-citationPhysics-Informed Neural Operator for Learning Partial Differential Equations
Li, Z., Zheng, H., Kovachki, N., Jin, D., Chen, H., Liu, B., Azizzadenesheli, K., & Anandkumar, A. (2024) · ACM / IMS Journal of Data Science · doi:10.1145/3648506 · Cited by 393
Xu, Y., Kohtz, S., Boakye, J., Gardoni, P., & Wang, P. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108900 · Cited by 372
Moseley, B., Markham, A., & Nissen-Meyer, T. (2023) · Advances in Computational Mathematics · doi:10.1007/s10444-023-10065-9 · Cited by 360
Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
Geneva, N., & Zabaras, N. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109056 · Cited by 339
Self-citationEfficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
Physics-Informed Deep Learning for Computational Elastodynamics without Labeled Data
Rao, C., Sun, H., & Liu, Y. (2021) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001947 · Cited by 330
Eighty Years of the Finite Element Method: Birth, Evolution, and Future
Liu, W. K., Li, S., & Park, H. S. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09740-9 · Cited by 322
Wang, J., Li, Y., Gao, R. X., & Zhang, F. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.04.004 · Cited by 317
Rai, R., & Sahu, C. K. (2020) · IEEE Access · doi:10.1109/access.2020.2987324 · Cited by 315
Amini Niaki, S., Haghighat, E., Campbell, T., Poursartip, A., & Vaziri, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113959 · Cited by 311
LIMITATIONS OF PHYSICS INFORMED MACHINE LEARNING FOR NONLINEAR TWO-PHASE TRANSPORT IN POROUS MEDIA
Fuks, O., & Tchelepi, H. A. (2020) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2020033905 · Cited by 303
PhyCRNet: Physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
Ren, P., Rao, C., Liu, Y., Wang, J.-X., & Sun, H. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114399 · Cited by 270
Understanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges
Farea, A., Yli-Harja, O., & Emmert-Streib, F. (2024) · AI · doi:10.3390/ai5030074 · Cited by 259
Faroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Towards a predictor for CO2 plume migration using deep neural networks
Wen, G., Tang, M., & Benson, S. M. (2021) · International Journal of Greenhouse Gas Control · doi:10.1016/j.ijggc.2020.103223 · Cited by 124
Qi, X., de Almeida, G. A. M., & Maldonado, S. (2024) · Journal of Hydrology · doi:10.1016/j.jhydrol.2024.131263 · Cited by 78
Basic Framework and Main Methods of Uncertainty Quantification
Zhang, J., Yin, J., & Wang, R. (2020) · Mathematical Problems in Engineering · doi:10.1155/2020/6068203 · Cited by 52
Advancing Fusion with Machine Learning Research Needs Workshop Report
Humphreys, D., Kupresanin, A., Boyer, M. D., Canik, J., Chang, C. S., Cyr, E. C., Granetz, R., Hittinger, J., Kolemen, E., Lawrence, E., et al. (2020) · Journal of Fusion Energy · doi:10.1007/s10894-020-00258-1 · Cited by 47
Metadata
- Authors
- Zhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 394
- Pages
- 56-81
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2908541468
- Cited by
- 1,030
- References
- 90
- FWCI
- 46.43
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.