The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
CAN-PINN: A fast physics-informed neural network based on coupled-automatic–numerical differentiation method
Open accessAbstract
In this study, novel physics-informed neural network (PINN) methods for coupling neighboring support points and their derivative terms which are obtained by automatic differentiation (AD), are proposed to allow efficient training with improved accuracy. The computation of differential operators required for PINNs loss evaluation at collocation points are conventionally obtained via AD. Although AD has the advantage of being able to compute the exact gradients at any point, such PINNs can only achieve high accuracies with large numbers of collocation points, otherwise they are prone to optimizing towards unphysical solution. To make PINN training fast, the dual ideas of using numerical differentiation (ND)-inspired method and coupling it with AD are employed to define the loss function. The ND-based formulation for training loss can strongly link neighboring collocation points to enable efficient training in sparse sample regimes, but its accuracy is restricted by the interpolation scheme. The proposed coupled-automatic-numerical differentiation framework, labeled as can-PINN, unifies the advantages of AD and ND, providing more robust and efficient training than AD-based PINNs, while further improving accuracy by up to 1-2 orders of magnitude relative to ND-based PINNs. For a proof-of-concept demonstration of this can-scheme to fluid dynamic problems, two numerical-inspired instantiations of can-PINN schemes for the convection and pressure gradient terms were derived to solve the incompressible Navier-Stokes (N-S) equations. The superior performance of can-PINNs is demonstrated on several challenging problems, including the flow mixing phenomena, lid driven flow in a cavity, and channel flow over a backward facing step. The results reveal that for challenging problems like these, can-PINNs can consistently achieve very good accuracy whereas conventional AD-based PINNs fail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718 · cited 2×
“Despite the potential for a wide range of physic phenomena and applications, training an accurate PINN model remains a challenge [1].”
BackgroundHigh-Re solutions for incompressible flow using the Navier-Stokes equations and a multigrid method
Ghia, U., Ghia, K. N., & Shin, C. T. (1982) · Journal of Computational Physics · doi:10.1016/0021-9991(82)90058-4 · Cited by 4,299
Computational Fluid Mechanics and Heat Transfer
Anderson, D., Tannehill, J. C., & Pletcher, R. H. (2016) · CRC Press eBooks · doi:10.1201/b12884 · Cited by 3,682
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259
DGM: A deep learning algorithm for solving partial differential equations
Sirignano, J., & Spiliopoulos, K. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.029 · Cited by 2,208
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Physics-informed neural networks for high-speed flows
Mao, Z., Jagtap, A. D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112789 · Cited by 1,282
2015 IEEE International Conference on Computer Vision (ICCV)
(2015) · doi:10.1109/iccv33071.2015 · Cited by 1,253
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2019.25 · Cited by 823
Physics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
Wang, S., Wang, H., & Perdikaris, P. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113938 · Cited by 693
Berg, J., & Nyström, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.06.056 · Cited by 657
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Neural‐network‐based approximations for solving partial differential equations
Dissanayake, M. W. M. G., & Phan‐Thien, N. (1994) · Communications in Numerical Methods in Engineering · doi:10.1002/cnm.1640100303 · Cited by 622
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Rautiainen, M., Korhonen, T., Mutafungwa, E., Ovaska, E., Katasonov, A., Evesti, A., Ailisto, H. J., Quigley, A. J., Häkkilä, J., Milić-Frayling, N., et al. (2012) · Lecture notes in computer science · Cited by 522
Physics-informed multi-LSTM networks for metamodeling of nonlinear structures
Zhang, R., Liu, Y., & Sun, H. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113226 · Cited by 504
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
Yang, L., Zhang, D., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/18m1225409 · Cited by 482
Zobeiry, N., & Humfeld, K. D. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104232 · Cited by 449
Neural algorithm for solving differential equations
Lee, H., & Kang, I. S. (1990) · Journal of Computational Physics · doi:10.1016/0021-9991(90)90007-n · Cited by 436
Computational Fluid Mechanics and Heat Transfer
Anderson, D. A., Tannehill, J. C., Pletcher, R. H., Munipalli, R., & Shankar, V. (2020) · CRC Press eBooks · doi:10.1201/9781351124027 · Cited by 430
Gao, H., Zahr, M. J., & Wang, J. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114502 · Cited by 427
Haghighat, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113552 · Cited by 425
Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
Raissi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06637 · Cited by 419
Adversarial uncertainty quantification in physics-informed neural networks
Yang, Y., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.027 · Cited by 414
Deep learning of vortex-induced vibrations
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.872 · Cited by 404
Deep learning of vortex-induced vibrationsPreprint
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 361
Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
Geneva, N., & Zabaras, N. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109056 · Cited by 339
Efficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
Amini Niaki, S., Haghighat, E., Campbell, T., Poursartip, A., & Vaziri, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113959 · Cited by 311
LIMITATIONS OF PHYSICS INFORMED MACHINE LEARNING FOR NONLINEAR TWO-PHASE TRANSPORT IN POROUS MEDIA
Fuks, O., & Tchelepi, H. A. (2020) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2020033905 · Cited by 303
Shukla, K., Di Leoni, P. C., Blackshire, J., Sparkman, D., & Karniadakis, G. E. (2020) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-020-00705-1 · Cited by 300
Shin, Y., Darbon, J., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0193 · Cited by 284
PhyCRNet: Physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
Ren, P., Rao, C., Liu, Y., Wang, J.-X., & Sun, H. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114399 · Cited by 270
A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network
Fang, Z. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070878 · Cited by 237
Understanding and mitigating gradient pathologies in physics-informed neural networks
Wang, S., Teng, Y., & Perdikaris, P. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04536 · Cited by 176
Deep Physical Informed Neural Networks for Metamaterial Design
Fang, Z., & Zhan, J. (2020) · IEEE Access · doi:10.1109/access.2019.2963375 · Cited by 174
Solution of nonlinear ordinary differential equations by feedforward neural networks
Meade, A. J., & Fernandez, A. A. (1994) · Mathematical and Computer Modelling · doi:10.1016/0895-7177(94)00160-x · Cited by 172
Artificial neural network methods in quantum mechanics
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1997) · Computer Physics Communications · doi:10.1016/s0010-4655(97)00054-4 · Cited by 167
Ranade, R., Hill, C., & Pathak, J. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113722 · Cited by 167
NVIDIA SimNet™: An AI-Accelerated Multi-Physics Simulation Framework
Hennigh, O., Narasimhan, S., Nabian, M. A., Subramaniam, A., Tangsali, K., Fang, Z., Rietmann, M., Byeon, W., & Choudhry, S. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-77977-1_36 · Cited by 159
A nonlocal physics-informed deep learning framework using the peridynamic differential operator
Haghighat, E., Bekar, A. C., Madenci, E., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.114012 · Cited by 156
Neural Network Differential Equation and Plasma Equilibrium Solver
van Milligen, B. P., TRIBALDOS, V., & Jiménez, J. A. (1995) · Physical Review Letters · doi:10.1103/physrevlett.75.3594 · Cited by 143
Learning in Sinusoidal Spaces With Physics-Informed Neural Networks
Wong, J. C., Ooi, C. C., Gupta, A., & Ong, Y.-S. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3192362 · Cited by 123
Self-citationSelf-Adaptive Physics-Informed Neural Networks using a Soft Attention MechanismPreprint
McClenny, L. D., & Braga-Neto, U. (2020) · arXiv (Cornell University) · doi:10.1016/j.jcp.2022.111722 · Cited by 114
Physics-Driven Regularization of Deep Neural Networks for Enhanced Engineering Design and Analysis
Nabian, M. A., & Meidani, H. (2019) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4044507 · Cited by 113
Physics Informed Deep Learning for Flow and Transport in Porous Media
Fraces, C. G., & Tchelepi, H. A. (2021) · SPE Reservoir Simulation Conference · doi:10.2118/203934-ms · Cited by 109
Wandel, N., Weinmann, M., & Klein, R. (2021) · Physics of Fluids · doi:10.1063/5.0047428 · Cited by 71
Approaching Partial Differential Equations with Physics-Driven Deep Learning
Wandel, N. (2023) · bonndoc (University of Bonn) · Cited by 47
Can Transfer Neuroevolution Tractably Solve Your Differential Equations?
Wong, J.-C., Gupta, A., & Ong, Y. (2021) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3061854 · Cited by 35
Self-citationOptimally weighted loss functions for solving PDEs with Neural Networks
van der Meer, R., Oosterlee, C. W., & Borovykh, A. (2021) · Journal of Computational and Applied Mathematics · doi:10.1016/j.cam.2021.113887 · Cited by 24
An efficient multi-dimensional implementation of VSIAM3 and its applications to free surface flows
Yokoi, K., Furuichi, M., & Sakai, M. (2017) · Physics of Fluids · doi:10.1063/1.4996183 · Cited by 18
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Hu, H., Qi, L., & Chao, X. (2024) · Thin-Walled Structures · doi:10.1016/j.tws.2024.112495 · Cited by 335
Lawal, Z. K., Yassin, H., Lai, D. T. C., & Che Idris, A. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6040140 · Cited by 263
Faroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Xu, C., Cao, B. T., Yuan, Y., & Meschke, G. (2023) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.115852 · Cited by 255
Metadata
- Authors
- Chiu, P.-H., Wong, J. C., Ooi, C., Dao, M. H., & Ong, Y.-S.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2022-05
- Volume
- 395
- Pages
- 114909
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W3208953217
- Cited by
- 366
- References
- 64
- FWCI
- 24.58
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.