The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Physics-Informed Neural Operator for Learning Partial Differential Equations
Open accessAbstract
In this article, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first hybrid approach incorporating data and PDE constraints at different resolutions to learn the operator. Specifically, in PINO, we combine coarse-resolution training data with PDE constraints imposed at a higher resolution. The resulting PINO model can accurately approximate the ground-truth solution operator for many popular PDE families and shows no degradation in accuracy even under zero-shot super-resolution, that is, being able to predict beyond the resolution of training data. PINO uses the Fourier neural operator (FNO) framework that is guaranteed to be a universal approximator for any continuous operator and discretization convergent in the limit of mesh refinement. By adding PDE constraints to FNO at a higher resolution, we obtain a high-fidelity reconstruction of the ground-truth operator. Moreover, PINO succeeds in settings where no training data is available and only PDE constraints are imposed, while previous approaches, such as the Physics-Informed Neural Network (PINN), fail due to optimization challenges, for example, in multi-scale dynamic systems such as Kolmogorov flows.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., et al. (2020) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.3803 · Cited by 31,882 · cited 2×
“Moreover, it is also evident that in many real-world applications, observational data often is available at only low resolutions [13], limiting the model’s ability to generalize.”
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063 · cited 4×
“Machine learning methods have recently shown promise in solving partial differential equations ( PDEs ) [1–5].”
InfluentialDeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
DGM: A deep learning algorithm for solving partial differential equations
Sirignano, J., & Spiliopoulos, K. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.029 · Cited by 2,208
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems
E, W., & Yu, B. (2018) · Communications in Mathematics and Statistics · doi:10.1007/s40304-018-0127-z · Cited by 1,418
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Machine learning–accelerated computational fluid dynamics
Kochkov, D., Smith, J. A., Alieva, A., Wang, Q., Brenner, M. P., & Hoyer, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101784118 · Cited by 1,042
Zhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
Neural Operator: Learning Maps Between Function SpacesPreprint
Kovachki, N., Li, Z., Liu, B., Azizzadenesheli, K., Bhattacharya, K., Stuart, A. M., & Anandkumar, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.08481 · Cited by 774
Self-citationSelf-Adaptive Physics-Informed Neural Networks
McClenny, L., & Braga-Neto, U. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4086448 · Cited by 674
Physics-informed machine learning: case studies for weather and climate modelling
Kashinath, K., Mustafa, M., Albert, A., Wu, J.-L., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., et al. (2021) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2020.0093 · Cited by 662
Self-citationMCMC Methods for Functions: Modifying\nOld Algorithms to Make Them Faster
Cotter, S. L., Roberts, G. O., Stuart, A. M., & White, D. (2012) · MIMS EPrints (University of Southampton) · Cited by 637
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Conference on Neural Information Processing Systems
Liu, L., Zhou, T., Long, G., Jiang, J., & Zhang, C. (2019) · UTS ePRESS (University of Technology Sydney) · Cited by 593
Lu, L., Meng, X., Cai, S., Mao, Z., Goswami, S., Zhang, Z., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114778 · Cited by 514
The 2D lid-driven cavity problem revisited
Bruneau, C.-H., & Saad, M. (2006) · Computers & Fluids · doi:10.1016/j.compfluid.2004.12.004 · Cited by 465
Model Reduction And Neural Networks For Parametric PDEs
Bhattacharya, K., Hosseini, B., Kovachki, N. B., & Stuart, A. M. (2021) · The SMAI Journal of computational mathematics · doi:10.5802/smai-jcm.74 · Cited by 329
Self-citationLIMITATIONS OF PHYSICS INFORMED MACHINE LEARNING FOR NONLINEAR TWO-PHASE TRANSPORT IN POROUS MEDIA
Fuks, O., & Tchelepi, H. A. (2020) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2020033905 · Cited by 303
Dwivedi, V., & Srinivasan, B. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.099 · Cited by 278
Towards Physics-informed Deep Learning for Turbulent Flow Prediction
Wang, R., Kashinath, K., Mustafa, M., Albert, A., & Yu, R. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403198 · Cited by 273
Jagtap, A. D., Kawaguchi, K., & Em Karniadakis, G. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0334 · Cited by 259
The Random Feature Model for Input-Output Maps between Banach Spaces
Nelsen, N. H., & Stuart, A. M. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m133957x · Cited by 233
86 PFLOPS Deep Potential Molecular Dynamics simulation of 100 million atoms with ab initio accuracy
Lu, D., Wang, H., Chen, M., Lin, L., Car, R., E, W., Jia, W., & Zhang, L. (2021) · Computer Physics Communications · doi:10.1016/j.cpc.2020.107624 · Cited by 225
Real-time high-resolution CO2 geological storage prediction using nested Fourier neural operators
Wen, G., Li, Z., Long, Q., Azizzadenesheli, K., Anandkumar, A., & Benson, S. M. (2023) · Energy & Environmental Science · doi:10.1039/d2ee04204e · Cited by 167
Self-citationA physics-informed operator regression framework for extracting data-driven continuum models
Patel, R. G., Trask, N., Wood, M. A., & Cyr, E. C. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113500 · Cited by 159
The Cost-Accuracy Trade-Off in Operator Learning with Neural Networks
de Hoop, M. V., Huang, D. Z., Qian, E., & Stuart, A. M. (2022) · Journal of Machine Learning · doi:10.4208/jml.220509 · Cited by 136
A learning-based multiscale method and its application to inelastic impact problems
Liu, B., Kovachki, N., Li, Z., Azizzadenesheli, K., Anandkumar, A., Stuart, A. M., & Bhattacharya, K. (2021) · Journal of the Mechanics and Physics of Solids · doi:10.1016/j.jmps.2021.104668 · Cited by 78
Self-citationOn the influence of over-parameterization in manifold based surrogates and deep neural operators
Kontolati, K., Goswami, S., Shields, M. D., & Karniadakis, G. E. (2023) · Journal of Computational Physics · doi:10.1016/j.jcp.2023.112008 · Cited by 51
MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs
Zhang, L. Z. L., Luo, T., Zhang, Y., Weinan, E., Xu, Z.-Q. J. X. Z.-Q. J., & Ma, Z. (2022) · Communications in Computational Physics · doi:10.4208/cicp.oa-2021-0257 · Cited by 42
Generic lithography modeling with dual-band optics-inspired neural networks
Yang, H., Li, Z., Sastry, K., Mukhopadhyay, S., Kilgard, M. J., Anandkumar, A., Khailany, B., Singh, V., & Ren, H. M. (2022) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3489517.3530580 · Cited by 38
Self-citationVariational training of neural network approximations of solution maps for physical models
Li, Y., Lu, J., & Mao, A. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109338 · Cited by 36
HypoSVI: Hypocenter inversion with Stein Variational Inference and Physics Informed Neural Networks
Smith, J., Ross, Z. E., Azizzadenesheli, K., et al. (2021) · doi:10.5194/egusphere-egu21-3371 · Cited by 14
Self-citation
Cited by
Scientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823
Self-citationRespecting causality for training physics-informed neural networks
Wang, S., Sankaran, S., & Perdikaris, P. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.116813 · Cited by 370
Neural operators for accelerating scientific simulations and design
Azizzadenesheli, K., Kovachki, N., Li, Z., Liu-Schiaffini, M., Kossaifi, J., & Anandkumar, A. (2024) · Nature Reviews Physics · doi:10.1038/s42254-024-00712-5 · Cited by 314
Self-citationFaroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Metadata
- Authors
- Li, Z., Zheng, H., Kovachki, N., Jin, D., Chen, H., Liu, B., Azizzadenesheli, K., & Anandkumar, A.
- Venue
- ACM / IMS Journal of Data Science
- Published
- 2024-05-20
- Volume
- 1
- Issue
- 3
- Pages
- 1-27
- ISSN
- 2831-3194 (ISSN-L)
- OpenAlex
- W4392004327
- Cited by
- 393
- References
- 39
- FWCI
- 50.42
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.