When and why PINNs fail to train: A neural tangent kernel perspective
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Self-citationAdvances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
(2010) · Cited by 14,134
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
DGM: A deep learning algorithm for solving partial differential equations
Sirignano, J., & Spiliopoulos, K. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.029 · Cited by 2,208
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
Neural Tangent Kernel: Convergence and Generalization in Neural Networks
Jacot, A., Gabriel, F., & Hongler, C. (2018) · arXiv · doi:10.48550/arxiv.1806.07572 · Cited by 1,562
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
Tancik, M., Srinivasan, P. P., Mildenhall, B., Fridovich-Keil, S., Raghavan, N., Singhal, U., Ramamoorthi, R., Barron, J. T., & Ng, R. (2020) · arXiv · doi:10.48550/arxiv.2006.10739 · Cited by 1,459
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Yang, L., Meng, X., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109913 · Cited by 1,169
fPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Zhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
Self-citationPhysics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Self-citationDeep Neural Networks as Gaussian Processes
Lee, J., Bahri, Y., Novak, R., Schoenholz, S. S., Pennington, J., & Sohl‐Dickstein, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00165 · Cited by 529
Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
John Xu, Z.-Q., Zhang, Y., Luo, T., Xiao, Y., & Ma, Z. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0085 · Cited by 522
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P., Tartakovsky, G. D., & Barajas‐Solano, D. (2020) · Water Resources Research · doi:10.1029/2019wr026731 · Cited by 515
Self-citationAn introduction to Gaussian processes
Stegle, O., & Borgwardt, K. M. (2010) · Cited by 421
Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
Raissi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06637 · Cited by 419
Adversarial uncertainty quantification in physics-informed neural networks
Yang, Y., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.027 · Cited by 414
Self-citationPhysics-Informed Neural Networks for Cardiac Activation Mapping
Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00042 · Cited by 410
Self-citationDeep learning of vortex-induced vibrations
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.872 · Cited by 404
Towards Understanding the Spectral Bias of Deep Learning
Cao, Y. J., Fang, Z., Wu, Y., Zhou, D., & Gu, Q. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/304 · Cited by 371
Deep learning of vortex-induced vibrationsPreprint
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 363
On Exact Computation with an Infinitely Wide Neural Net
Arora, S., Du, S. S., Hu, W. P., Li, Z., Salakhutdinov, R., & Wang, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.11955 · Cited by 358
Wide neural networks of any depth evolve as linear models under gradient descent *
Lee, J., Xiao, L., Schoenholz, S. S., Bahri, Y., Novak, R., Sohl-Dickstein, J., & Pennington, J. (2020) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/abc62b · Cited by 353
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
LIMITATIONS OF PHYSICS INFORMED MACHINE LEARNING FOR NONLINEAR TWO-PHASE TRANSPORT IN POROUS MEDIA
Fuks, O., & Tchelepi, H. A. (2020) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2020033905 · Cited by 303
GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
Zhao, C., Badrinarayanan, V., Lee, C., & Rabinovich, A. (2018) · International Conference on Machine Learning · Cited by 275
Frequency Bias in Neural Networks for Input of Non-Uniform DensityPreprint
Basri, R., Galun, M., Geifman, A., Jacobs, D. W., Kasten, Y., & Kritchman, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04560 · Cited by 268
The Convergence Rate of Neural Networks for Learned Functions of Different FrequenciesPreprint
Basri, R., Jacobs, D. W., Kasten, Y., & Kritchman, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00425 · Cited by 236
Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data
Sun, L., & Wang, J.-X. (2020) · Theoretical and Applied Mechanics Letters · doi:10.1016/j.taml.2020.01.031 · Cited by 223
Multi-Fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling
Liu, D., & Wang, Y. (2019) · Journal of Mechanical Design · doi:10.1115/1.4044400 · Cited by 182
SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss FunctionsPreprint
Heydari, A. A., Thompson, C. A., & Mehmood, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12355 · Cited by 180
Understanding and mitigating gradient pathologies in physics-informed neural networks
Wang, S., Teng, Y., & Perdikaris, P. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04536 · Cited by 176
Self-citationDeep Physical Informed Neural Networks for Metamaterial Design
Fang, Z., & Zhan, J. (2020) · IEEE Access · doi:10.1109/access.2019.2963375 · Cited by 174
Deep learning of free boundary and Stefan problems
Wang, S., & Perdikaris, P. G. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109914 · Cited by 162
Self-citationYang, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.04760 · Cited by 150
On the Spectral Bias of Neural Networks
Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F. A., Bengio, Y., & Courville, A. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.08734 · Cited by 139
Deep learning of turbulent scalar mixing
Raissi, M., Babaee, H., & Givi, P. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.124501 · Cited by 88
Physics-informed deep generative modelsPreprint
Yang, Y., & Perdikaris, P. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03511 · Cited by 84
Self-citationLearning Parameters and Constitutive Relationships with Physics Informed Deep Neural NetworksPreprint
Tartakovsky, A. M., Marrero, C. O., Perdikaris, P. G., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.03398 · Cited by 74
Self-citationAutoLoss: Learning Discrete Schedules for Alternate OptimizationPreprint
Xu, H., Zhang, H., Hu, Z., Liang, X., Salakhutdinov, R., & Xing, E. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.02442 · Cited by 35
Ruiz‐Hurtado, G., García‐Prieto, C. F., Pulido-Olmo, H., Velasco-Martin, J. P., Villa, P., Fernández-Valle, M. E., Boscá, L., Fernández‐Velasco, M., Regadera, J., Somoza, B., et al. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00042 · Cited by 31
Sandia National Laboratories (SNL-NM), A., Pang, G., (NNSA), U. N. N. S. A., Brown Univ., P., D’Elia, M., Parks, M., & Karniadakis, G. E. (2020) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/1614899 · Cited by 24
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationScientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Physics-Informed Neural Networks for Heat Transfer Problems
Cai, S., Wang, Z., Wang, S., Perdikaris, P., & Karniadakis, G. E. (2021) · Journal of Heat Transfer · doi:10.1115/1.4050542 · Cited by 1,312
Self-citationA physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Metadata
- Authors
- Wang, S., Yu, X., & Perdikaris, P.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2022-01
- Volume
- 449
- Pages
- 110768
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W3205073660
- Cited by
- 1,496
- References
- 48
- FWCI
- 59.37
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.