The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
Open accessAbstract
Abstract Physics-informed neural networks (PINNs) have recently emerged as an alternative way of numerically solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, an auxiliary DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain in order to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to demonstrate the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
(2009) · Cited by 6,153
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationLearning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Self-citationScientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Self-citationPhysics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Self-citationPhysics-Informed Neural Networks for Heat Transfer Problems
Cai, S., Wang, Z., Wang, S., Perdikaris, P., & Karniadakis, G. E. (2021) · Journal of Heat Transfer · doi:10.1115/1.4050542 · Cited by 1,312
Self-citationYang, L., Meng, X., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109913 · Cited by 1,169
Self-citationfPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105
“In this paper, we focus on the identification of the parameters of fractional PDEs whose overall form is known but some coefficients and most importantly the operators themselves are not known.”
MethodInfluentialSelf-citationSun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Physics-Informed Neural Networks with Hard Constraints for Inverse Design
Lu, L., Pestourie, R., Yao, W., Wang, Z., Verdugo, F., & Johnson, S. G. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/21m1397908 · Cited by 771
Self-citationWu, C., Zhu, M., Tan, Q., Kartha, Y., & Lu, L. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115671 · Cited by 723
Self-citationGradient-enhanced physics-informed neural networks for forward and inverse PDE problems
Yu, J., Lu, L., Meng, X., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114823 · Cited by 722
Self-citationMeng, X., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109020 · Cited by 713
Self-citationPPINN: Parareal physics-informed neural network for time-dependent PDEs
Meng, X., Li, Z., Zhang, D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113250 · Cited by 654
Self-citationGao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Lu, L., Meng, X., Cai, S., Mao, Z., Goswami, S., Zhang, Z., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114778 · Cited by 514
Self-citationPhysics-Informed Generative Adversarial Networks for Stochastic Differential Equations
Yang, L., Zhang, D., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/18m1225409 · Cited by 482
Self-citationUncertainty quantification in scientific machine learning: Methods, metrics, and comparisons
Psaros, A. F., Meng, X., Zou, Z., Guo, L., & Karniadakis, G. E. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111902 · Cited by 455
Self-citationThe Role of Machine Learning in the Understanding and Design of Materials
Moosavi, S. M., Jablonka, K. M., & Smit, B. (2020) · Journal of the American Chemical Society · doi:10.1021/jacs.0c09105 · Cited by 433
Zhuang, X., Guo, H., Alajlan, N., Zhu, H., & Rabczuk, T. (2021) · European Journal of Mechanics - A/Solids · doi:10.1016/j.euromechsol.2021.104225 · Cited by 430
Yuan, L., Ni, Y.-Q., Deng, X.-Y., & Hao, S. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111260 · Cited by 422
Moseley, B., Markham, A., & Nissen-Meyer, T. (2023) · Advances in Computational Mathematics · doi:10.1007/s10444-023-10065-9 · Cited by 360
Hu, H., Qi, L., & Chao, X. (2024) · Thin-Walled Structures · doi:10.1016/j.tws.2024.112495 · Cited by 335
Physics-Informed Deep Learning for Computational Elastodynamics without Labeled Data
Rao, C., Sun, H., & Liu, Y. (2021) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001947 · Cited by 330
Deep learning of subsurface flow via theory-guided neural network
Wang, N., Zhang, D., Chang, H., & Li, H. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.124700 · Cited by 322
Self-citationAmini Niaki, S., Haghighat, E., Campbell, T., Poursartip, A., & Vaziri, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113959 · Cited by 311
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
Self-citationStiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics
Ji, W., Qiu, W., Shi, Z., Pan, S., & Deng, S. (2021) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.1c05102 · Cited by 307
Mattey, R., & Ghosh, S. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114474 · Cited by 278
PhyCRNet: Physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
Ren, P., Rao, C., Liu, Y., Wang, J.-X., & Sun, H. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114399 · Cited by 270
Metadata
- Authors
- Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 397
- Pages
- 108850
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2890968382
- Cited by
- 513
- References
- 62
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.