The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
Open accessAbstract
Abstract Physics-informed neural networks (PINNs) have recently emerged as an alternative way of numerically solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In particular, in addition to the deep neural network (DNN) for the solution, an auxiliary DNN is considered that represents the residual of the PDE. The residual is then combined with the mismatch in the given data of the solution in order to formulate the loss function. This framework is effective but is lacking uncertainty quantification of the solution due to the inherent randomness in the data or due to the approximation limitations of the DNN architecture. Here, we propose a new method with the objective of endowing the DNN with uncertainty quantification for both sources of uncertainty, i.e., the parametric uncertainty and the approximation uncertainty. We first account for the parametric uncertainty when the parameter in the differential equation is represented as a stochastic process. Multiple DNNs are designed to learn the modal functions of the arbitrary polynomial chaos (aPC) expansion of its solution by using stochastic data from sparse sensors. We can then make predictions from new sensor measurements very efficiently with the trained DNNs. Moreover, we employ dropout to quantify the uncertainty of DNNs in approximating the modal functions. We then design an active learning strategy based on the dropout uncertainty to place new sensors in the domain in order to improve the predictions of DNNs. Several numerical tests are conducted for both the forward and the inverse problems to demonstrate the effectiveness of PINNs combined with uncertainty quantification. This NN-aPC new paradigm of physics-informed deep learning with uncertainty quantification can be readily applied to other types of stochastic PDEs in multi-dimensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
(2009) · Cited by 6,153
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
Xiu, D., & Karniadakis, G. E. (2002) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827501387826 · Cited by 4,807
Self-citationBayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
An Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
(1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9 · Cited by 2,418
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 2,405
International Conference on Artificial Neural Networks
(1990) · Neural Networks · doi:10.1016/0893-6080(90)90065-s · Cited by 2,088
Inverse problems: A Bayesian perspective
Stuart, A. M. (2010) · Acta Numerica · doi:10.1017/s0962492910000061 · Cited by 1,791
Heat flow from the Earth's interior: Analysis of the global data set
Pollack, H. N., Hurter, S. J., & Johnson, J. R. (1993) · Reviews of Geophysics · doi:10.1029/93rg01249 · Cited by 1,593
Data-driven discovery of partial differential equations
Rudy, S. H., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2017) · Science Advances · doi:10.1126/sciadv.1602614 · Cited by 1,557
Hidden physics models: Machine learning of nonlinear partial differential equations
Raissi, M., & Karniadakis, G. E. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.11.039 · Cited by 1,349
Self-citationWeight Uncertainty in Neural Networks
Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1505.05424 · Cited by 1,342
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2013) · Journal of Machine Learning Research · doi:10.5555/2567709.2502622 · Cited by 1,333
Artificial Intelligence and Statistics
Ziegel, E. (1989) · Technometrics · doi:10.1080/00401706.1989.10488504 · Cited by 1,217
Bayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
A theoretically grounded application of dropout in recurrent neural networks
Gal, Y., & Ghahramani, Z. (2016) · Cambridge University Engineering Department Publications Database · Cited by 1,089
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10561 · Cited by 925
Self-citationE, W., Han, J., & Jentzen, A. (2017) · Communications in Mathematics and Statistics · doi:10.1007/s40304-017-0117-6 · Cited by 822
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.57 · Cited by 784
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks
Gal, Y., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.05287 · Cited by 766
Zhu, Y., & Zabaras, N. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.018 · Cited by 704
On the Complexity of Best Arm Identification in Multi-Armed Bandit Models
Kaufmann, E., Cappé, O., & Garivier, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.4443 · Cited by 661
Machine learning of linear differential equations using Gaussian processes
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.07.050 · Cited by 584
Self-citationAn Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_5 · Cited by 551
DeepCpG: accurate prediction of single-cell DNA methylation states using deep learning
Angermueller, C., Lee, H. J., Reik, W., & Stegle, O. (2017) · Genome Biology · doi:10.1186/s13059-017-1189-z · Cited by 536
44th AIAA Aerospace Sciences Meeting and Exhibit
(2006) · doi:10.2514/masm06 · Cited by 535
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
Yang, L., Zhang, D., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/18m1225409 · Cited by 482
Self-citationData-driven uncertainty quantification using the arbitrary polynomial chaos expansion
Oladyshkin, S., & Nowak, W. (2012) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2012.05.002 · Cited by 451
(2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8 · Cited by 351
Numerical Gaussian Processes for Time-Dependent and Nonlinear Partial Differential Equations
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2018) · SIAM Journal on Scientific Computing · doi:10.1137/17m1120762 · Cited by 318
Self-citationRaissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10566 · Cited by 312
Self-citationData-Driven Identification of Parametric Partial Differential Equations
Rudy, S., Alla, A., Brunton, S. L., & Kutz, J. N. (2019) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/18m1191944 · Cited by 301
Bayesian optimization with robust Bayesian neural networks
Springenberg, J. T., Klein, A., Falkner, S., & Hutter, F. (2016) · neural information processing systems · Cited by 300
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2015) · arXiv · doi:10.48550/arxiv.1511.02680 · Cited by 292
Variational Bayesian Inference with Stochastic Search
Paisley, J. W., Blei, D. M., & Jordan, M. I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6430 · Cited by 275
Damianou, A., & Lawrence, N. D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.0358 · Cited by 249
Doubly Stochastic Variational Bayes for non-Conjugate Inference
Titsias, M. K., & Lázaro-Gredilla, M. (2014) · Cited by 212
A deep learning solution approach for high-dimensional random differential equations
Nabian, M. A., & Meidani, H. (2019) · Probabilistic Engineering Mechanics · doi:10.1016/j.probengmech.2019.05.001 · Cited by 164
Raissi, M. (2023) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789811280306_0018 · Cited by 148
Dropout Inference in Bayesian Neural Networks with Alpha-divergencesPreprint
Li, Y., & Gal, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02914 · Cited by 146
Concrete DropoutPreprint
Gal, Y., Hron, J., & Kendall, A. (2017) · arXiv (Cornell University) · Cited by 132
Fast Predictive Image Registration
Yang, X., Kwitt, R., & Niethammer, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46976-8_6 · Cited by 127
Linear Operators and Stochastic Partial Differential Equations in Gaussian Process Regression
Särkkä, S. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21738-8_20 · Cited by 123
Soil Salinity Retrieval from Advanced Multi-Spectral Sensor with Partial Least Square Regression
Fan, X., Liu, Y., Tao, J., & Weng, Y. (2015) · Remote Sensing · doi:10.3390/rs70100488 · Cited by 116
Construction of confidence intervals for neural networks based on least squares estimation
Rivals, I., & Personnaz, L. (2000) · Neural Networks · doi:10.1016/s0893-6080(99)00080-5 · Cited by 86
Neural-net-induced Gaussian process regression for function approximation and PDE solution
Pang, G., Yang, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.01.045 · Cited by 78
Self-citationLearning Parameters and Constitutive Relationships with Physics Informed Deep Neural NetworksPreprint
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P. G., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03398 · Cited by 74
Variational Bayesian dropout: pitfalls and fixesPreprint
Hron, J., Matthews, A., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01969 · Cited by 23
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationLearning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Self-citationScientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Self-citationPhysics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Self-citation
Metadata
- Authors
- Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 397
- Pages
- 108850
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2890968382
- Cited by
- 513
- References
- 62
- FWCI
- 20.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.