The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
Open accessAbstract
Deep learning has been shown to be an effective tool in solving partial differential equations (PDEs) through physics-informed neural networks (PINNs). PINNs embed the PDE residual into the loss function of the neural network, and have been successfully employed to solve diverse forward and inverse PDE problems. However, one disadvantage of the first generation of PINNs is that they usually have limited accuracy even with many training points. Here, we propose a new method, gradient-enhanced physics-informed neural networks (gPINNs), for improving the accuracy and training efficiency of PINNs. gPINNs leverage gradient information of the PDE residual and embed the gradient into the loss function. We tested gPINNs extensively and demonstrated the effectiveness of gPINNs in both forward and inverse PDE problems. Our numerical results show that gPINN performs better than PINN with fewer training points. Furthermore, we combined gPINN with the method of residual-based adaptive refinement (RAR), a method for improving the distribution of training points adaptively during training, to further improve the performance of gPINN, especially in PDEs with solutions that have steep gradients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Self-citationPhysics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationDeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Self-citationArtificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Self-citationAutomatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
D. Jagtap, A., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0164 · Cited by 1,130
fPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105 · cited 2×
“In some PDEs, it is possible to enforce the boundary conditions exactly and automatically by modifying the network architecture [20, 4, 25, 8], which eliminates the loss term of boundary conditions.”
BackgroundMethodSelf-citationArtificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Physics-Informed Neural Networks with Hard Constraints for Inverse Design
Lu, L., Pestourie, R., Yao, W., Wang, Z., Verdugo, F., & Johnson, S. G. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/21m1397908 · Cited by 771
Self-citationPhysics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
Self-citationWang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
PPINN: Parareal physics-informed neural network for time-dependent PDEs
Meng, X., Li, Z., Zhang, D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113250 · Cited by 654
Self-citationNeural‐network‐based approximations for solving partial differential equations
Dissanayake, M. W. M. G., & Phan‐Thien, N. (1994) · Communications in Numerical Methods in Engineering · doi:10.1002/cnm.1640100303 · Cited by 622
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations
Ross, A. S., Hughes, M. C., & Doshi-Velez, F. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/371 · Cited by 515
Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.048 · Cited by 513
Self-citationSukumar, N., & Srivastava, A. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114333 · Cited by 426
Physics-Informed Neural Networks for Cardiac Activation Mapping
Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00042 · Cited by 410
Efficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
Systems biology informed deep learning for inferring parameters and hidden dynamics
Yazdani, A., Lu, L., Raissi, M., & Karniadakis, G. E. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1007575 · Cited by 329
Self-citationA review of automatic differentiation and its efficient implementation
Margossian, C. C. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1305 · Cited by 321
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
Self-citationDwivedi, V., & Srinivasan, B. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.099 · Cited by 278
Improving generalization performance using double backpropagation
Drucker, H., & Le Cun, Y. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.165600 · Cited by 239
McFall, K. S., & Mahan, J. R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2020735 · Cited by 224
Sheng, H., & Yang, C. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110085 · Cited by 198
Liu, Z., Cai, W., & John Xu, Z.-Q. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0179 · Cited by 194
Dong, S. S., & Ni, N. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110242 · Cited by 192
Understanding and mitigating gradient pathologies in physics-informed neural networks
Wang, S., Teng, Y., & Perdikaris, P. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04536 · Cited by 176
A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems
Cai, W., Li, X., & Liu, L. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1310050 · Cited by 132
Self-Adaptive Physics-Informed Neural Networks using a Soft Attention MechanismPreprint
McClenny, L. D., & Braga-Neto, U. (2020) · arXiv (Cornell University) · doi:10.1016/j.jcp.2022.111722 · Cited by 114
Beidokhti, R. S., & Malek, A. (2009) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2009.05.003 · Cited by 108
Scaleable input gradient regularization for adversarial robustness
Finlay, C., & Oberman, A. M. (2020) · Machine Learning with Applications · doi:10.1016/j.mlwa.2020.100017 · Cited by 104
An Overview of Gradient-Enhanced Metamodels with Applications
Laurent, L., Riche, R. L., Soulier, B., & Boucard, P. (2017) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-017-9226-3 · Cited by 103
Multi-Scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains
Wang, B., Zhang, W., & Cai, W. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0192 · Cited by 71
SelectNet: Self-paced learning for high-dimensional partial differential equations
Gu, Y., Yang, H., & Zhou, C. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110444 · Cited by 68
Lagari, P. L., Tsoukalas, L. H., Safarkhani, S., & Lagaris, I. E. (2020) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213020500098 · Cited by 67
Unifying Adversarial Training Algorithms with Data Gradient Regularization
Ororbia, A. G., Kifer, D., & Giles, C. L. (2017) · Neural Computation · doi:10.1162/neco_a_00928 · Cited by 50
Physics-Informed Neural Networks with Hard Constraints for Inverse Design
Lu, L., Pestourie, R., Yao, W., Wang, Z., Verdugo, F., & Johnson, S. G. (2021) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 43
Self-citationSelf-Adaptive Physics-Informed Neural Networks using a Soft Attention MechanismPreprint
McClenny, L. D., & Braga-Neto, U. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.04544 · Cited by 42
Taylor-Mode Automatic Differentiation for Higher-Order Derivatives in JAX
Bettencourt, J., Johnson, M., & Duvenaud, D. (2019) · Cited by 20
Cited by
Wu, C., Zhu, M., Tan, Q., Kartha, Y., & Lu, L. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115671 · Cited by 723
Self-citationLu, L., Meng, X., Cai, S., Mao, Z., Goswami, S., Zhang, Z., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114778 · Cited by 514
Self-citationXu, C., Cao, B. T., Yuan, Y., & Meschke, G. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115852 · Cited by 255
Metadata
- Authors
- Yu, J., Lu, L., Meng, X., & Karniadakis, G. E.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2022-04
- Volume
- 393
- Pages
- 114823
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W3209909540
- Cited by
- 722
- References
- 42
- FWCI
- 48.69
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.