The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs
Abstract
Physics-informed neural networks (PINNs) have recently been very successfully applied for efficiently approximating inverse problems for partial differential equations (PDEs). We focus on a particular class of inverse problems, the so-called data assimilation or unique continuation problems, and prove rigorous estimates on the generalization error of PINNs approximating them. An abstract framework is presented and conditional stability estimates for the underlying inverse problem are employed to derive the estimate on the PINN generalization error, providing rigorous justification for the use of PINNs in this context. The abstract framework is illustrated with examples of four prototypical linear PDEs. Numerical experiments, validating the proposed theory, are also presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Practical methods of optimization
(1988) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(88)90129-2 · Cited by 5,818
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Universal approximation bounds for superpositions of a sigmoidal function
Barron, A. R. (1993) · IEEE Transactions on Information Theory · doi:10.1109/18.256500 · Cited by 2,804
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Computer Methods in Applied Mechanics and Engineering
Argyris, J. (1990) · Applied Mechanics and Engineering · Cited by 2,073
Monte Carlo and quasi-Monte Carlo methods
Caflisch, R. E. (1998) · Acta Numerica · doi:10.1017/s0962492900002804 · Cited by 1,754
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
Introduction to Numerical Analysis
Stoer, J., & Bulirsch, R. (2002) · Texts in Applied Mathematics · doi:10.1007/978-0-387-21738-3 · Cited by 1,562
Hidden physics models: Machine learning of nonlinear partial differential equations
Raissi, M., & Karniadakis, G. E. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.11.039 · Cited by 1,349
Physics-informed neural networks for high-speed flows
Mao, Z., Jagtap, A. D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112789 · Cited by 1,282
Journal of Computational Physics
(2014) · Journal of Computational Physics · doi:10.1016/s0021-9991(14)00069-2 · Cited by 1,239
Jagtap, A. D., Kharazmi, E., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113028 · Cited by 1,208
Yang, L., Meng, X., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109913 · Cited by 1,169
D. Jagtap, A., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0164 · Cited by 1,130
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Jagtap, A. D., Kawaguchi, K., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109136 · Cited by 1,127
Foundations of Machine Learning
Singh, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3399990 · Cited by 1,123
fPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105
Error bounds for approximations with deep ReLU networks
Yarotsky, D. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.07.002 · Cited by 1,085
Bungartz, H.-J., & Griebel, M. (2004) · Acta Numerica · doi:10.1017/s0962492904000182 · Cited by 1,063
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
E, W., Han, J., & Jentzen, A. (2017) · Communications in Mathematics and Statistics · doi:10.1007/s40304-017-0117-6 · Cited by 822
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
Mathematics of thermoacoustic tomography
KUCHMENT, P., & KUNYANSKY, L. (2008) · European Journal of Applied Mathematics · doi:10.1017/s0956792508007353 · Cited by 341
Shukla, K., Di Leoni, P. C., Blackshire, J., Sparkman, D., & Karniadakis, G. E. (2020) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-020-00705-1 · Cited by 300
Machine learning for fast and reliable solution of time-dependent differential equations
Regazzoni, F., Dede’, L., & Quarteroni, A. M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.050 · Cited by 168
Deep learning observables in computational fluid dynamics
Lye, K. O., Mishra, S., & Ray, D. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109339 · Cited by 165
Self-citationAn artificial neural network as a troubled-cell indicator
Ray, D., & Hesthaven, J. S. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.029 · Cited by 162
A machine learning framework for data driven acceleration of computations of di erential equations
Mishra, S., & Seminar for Applied Mathematics (SAM), D.-M. (2018) · Mathematics in Engineering · doi:10.3934/mine.2018.1.118 · Cited by 109
Self-citationSolving stochastic differential equations and Kolmogorov equations by means of deep learningPreprint
Beck, C., Becker, S. B. S., Grohs, P., Jaafari, N., & Jentzen, A. (2018) · arXiv (Cornell University) · Cited by 82
Enhancing Accuracy of Deep Learning Algorithms by Training with Low-Discrepancy Sequences
Mishra, S., & Rusch, T. K. (2021) · SIAM Journal on Numerical Analysis · doi:10.1137/20m1344883 · Cited by 68
Self-citationEfficient approximation of solutions of parametric linear transport equations by ReLU DNNs
Laakmann, F., & Petersen, P. (2021) · Advances in Computational Mathematics · doi:10.1007/s10444-020-09834-7 · Cited by 42
A multi-level procedure for enhancing accuracy of machine learning algorithms
Lye, K. O., Mishra, S., & Molinaro, R. (2020) · European Journal of Applied Mathematics · doi:10.1017/s0956792520000224 · Cited by 36
Self-citationStabilized nonconforming finite element methods for data assimilation in incompressible flows
Burman, E., & Hansbo, P. (2017) · Mathematics of Computation · doi:10.1090/mcom/3255 · Cited by 11
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Physics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons
Psaros, A. F., Meng, X., Zou, Z., Guo, L., & Karniadakis, G. E. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111902 · Cited by 455
Lawal, Z. K., Yassin, H., Lai, D. T. C., & Che Idris, A. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6040140 · Cited by 263
Metadata
- Authors
- Mishra, S., & Molinaro, R.
- Venue
- IMA Journal of Numerical Analysis
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-06-17
- Volume
- 42
- Issue
- 2
- Pages
- 981-1022
- ISSN
- 0272-4979 (ISSN-L)
- 1464-3642
- OpenAlex
- W3176116059
- Cited by
- 336
- References
- 36
- FWCI
- 19.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.