A-PINN: Auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Physics informed neural networks (PINNs) are a novel deep learning paradigm primed for solving forward and inverse problems of nonlinear partial differential equations (PDEs). By embedding physical information delineated by PDEs in feedforward neural networks, PINNs are trained as surrogate models for approximate solution to the PDEs without need of label data. Due to the excellent capability of neural networks in describing complex relationships, a variety of PINN-based methods have bene developed to solve different kinds of problems such as integer-order PDEs, fractional PDEs, stochastic PDEs and integro-differential equations (IDEs). However, for the state-of-the-art PINN methods in application to IDEs, integral discretization is a key prerequisite in order that IDEs can be transformed into ordinary differential equations (ODEs). However, integral discretization inevitably introduces discretization error and truncation error to the solution. In this study, we propose an auxiliary physics informed neural network (A-PINN) framework for solving forward and inverse problems of nonlinear IDEs. By defining auxiliary output variable(s) to represent the integral(s) in the governing equation and employing automatic differentiation of the auxiliary output to replace integral operator, the proposed A-PINN bypasses the limitation of integral discretization. Distinct from the neural network in the original PINN which only approximates the variables in the governing equation, in the proposed A-PINN framework, a multi-output neural network is constructed to simultaneously calculate the primary outputs and auxiliary outputs which respectively approximate the variables and integrals in the governing equation. Subsequently, the relationship between the primary outputs and auxiliary outputs is constrained by new output conditions in compliance with physical laws. By pursuing the first-order nonlinear Volterra IDE benchmark problem, we validate that the proposed A-PINN can obtain more accurate solution than the conventional PINN. We further demonstrate the good performance of A-PINN in solving the forward problems involving nonlinear Volterra IDE systems, nonlinear 2-dimensional Volterra IDE, and nonlinear Fredholm IDE. Finally, the A-PINN framework is implemented to solve the inverse problem of nonlinear IDEs and the results show that the unknown parameters can be satisfactorily discovered even with heavily noisy data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Physics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
Wang, S., Teng, Y., & Perdikaris, P. (2021) · SIAM Journal on Scientific Computing · doi:10.1137/20m1318043 · Cited by 2,048
Automatic Differentiation in Machine Learning: a Survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · Maynooth University ePrints and eTheses Archive (Maynooth University) · Cited by 2,029
When and why PINNs fail to train: A neural tangent kernel perspective
Wang, S., Yu, X., & Perdikaris, P. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110768 · Cited by 1,496
Physics-Informed Neural Networks for Heat Transfer Problems
Cai, S., Wang, Z., Wang, S., Perdikaris, P., & Karniadakis, G. E. (2021) · Journal of Heat Transfer · doi:10.1115/1.4050542 · Cited by 1,312
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Physics-informed neural networks for high-speed flows
Mao, Z., Jagtap, A. D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112789 · Cited by 1,282
Jagtap, A. D., Kharazmi, E., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113028 · Cited by 1,208
Yang, L., Meng, X., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109913 · Cited by 1,169
D. Jagtap, A., & Em Karniadakis, G. (2020) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0164 · Cited by 1,130
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Jagtap, A. D., Kawaguchi, K., & Karniadakis, G. E. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109136 · Cited by 1,127
fPINNs: Fractional Physics-Informed Neural Networks
Pang, G., Lu, L., & Karniadakis, G. E. (2019) · SIAM Journal on Scientific Computing · doi:10.1137/18m1229845 · Cited by 1,105
Transfer learning enhanced physics informed neural network for phase-field modeling of fracture
Goswami, S., Anitescu, C., Chakraborty, S., & Rabczuk, T. (2020) · Theoretical and Applied Fracture Mechanics · doi:10.1016/j.tafmec.2019.102447 · Cited by 900
Automatic differentiation in machine learning: a survey
Baydin, A. G., Pearlmutter, B. A., Radul, A., & Siskind, J. M. (2015) · arXiv (Cornell University) · doi:10.4230/lipics.ecoop.2019.25 · Cited by 823
hp-VPINNs: Variational physics-informed neural networks with domain decomposition
Kharazmi, E., Zhang, Z., & Karniadakis, G. E. M. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113547 · Cited by 818
Physics-informed neural networks for inverse problems in nano-optics and metamaterials
Chen, Y., Lu, L., Karniadakis, G. E., & Dal Negro, L. (2020) · Optics Express · doi:10.1364/oe.384875 · Cited by 701
PPINN: Parareal physics-informed neural network for time-dependent PDEs
Meng, X., Li, Z., Zhang, D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113250 · Cited by 654
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.048 · Cited by 513
Physics-informed multi-LSTM networks for metamodeling of nonlinear structures
Zhang, R., Liu, Y., & Sun, H. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113226 · Cited by 504
Zhu, Q., Liu, Z., & Yan, J. (2021) · Computational Mechanics · doi:10.1007/s00466-020-01952-9 · Cited by 497
Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations
Yang, L., Zhang, D., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/18m1225409 · Cited by 482
Adversarial uncertainty quantification in physics-informed neural networks
Yang, Y., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.027 · Cited by 414
Physics-Informed Neural Networks for Cardiac Activation Mapping
Sahli Costabal, F., Yang, Y., Perdikaris, P., Hurtado, D. E., & Kuhl, E. (2020) · Frontiers in Physics · doi:10.3389/fphy.2020.00042 · Cited by 410
He, Q., Barajas-Solano, D., Tartakovsky, G., & Tartakovsky, A. M. (2020) · Advances in Water Resources · doi:10.1016/j.advwatres.2020.103610 · Cited by 385
Efficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
Solving Allen-Cahn and Cahn-Hilliard Equations Using the Adaptive Physics Informed Neural Networks
L. Wight, C., & Zhao, J. (2021) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0086 · Cited by 294
Uncovering near-wall blood flow from sparse data with physics-informed neural networks
Arzani, A., Wang, J.-X., & D'Souza, R. M. (2021) · Physics of Fluids · doi:10.1063/5.0055600 · Cited by 273
Implicit Neural Representations with Periodic Activation Functions
Sitzmann, V., Martel, J., Bergman, A. W., Lindell, D. B., & Wetzstein, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.09661 · Cited by 261
Simulation of multi-species flow and heat transfer using physics-informed neural networks
Laubscher, R. (2021) · Physics of Fluids · doi:10.1063/5.0058529 · Cited by 229
Multi-fidelity Bayesian neural networks: Algorithms and applications
Meng, X., Babaee, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110361 · Cited by 196
Meta-learning PINN loss functions
Psaros, A. F., Kawaguchi, K., & Karniadakis, G. E. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111121 · Cited by 196
Non-invasive inference of thrombus material properties with physics-informed neural networks
Yin, M., Zheng, X., Humphrey, J. D., & Karniadakis, G. E. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113603 · Cited by 186
Deep Nitsche Method: Deep Ritz Method with Essential Boundary Conditions
Liao, Y., & Ming, P. (2021) · Communications in Computational Physics · doi:10.4208/cicp.oa-2020-0219 · Cited by 131
A Dynamic Analysis of Energy Storage With Renewable and Diesel Generation Using Volterra Equations
Sidorov, D., Muftahov, I., Tomin, N., Karamov, D. N., Panasetsky, D. A., Dreglea, A., Liu, F., & Foley, A. M. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2932453 · Cited by 83
Learning functional priors and posteriors from data and physics
Meng, X., Yang, L., Mao, Z., Ferrandis, J. D. Á., & Karniadakis, G. E. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111073 · Cited by 81
Huang, J., Wang, H., & Zhou, T. Z. T. (2022) · Communications in Computational Physics · doi:10.4208/cicp.oa-2021-0176 · Cited by 41
Kadeethum, T., Jørgensen, T. M., & Nick, H. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09638 · Cited by 20
Minakov, A. A., & Schick, C. H. (2021) · Symmetry · doi:10.3390/sym13020256 · Cited by 16
Cited by
Scientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
Faroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Metadata
- Authors
- Yuan, L., Ni, Y.-Q., Deng, X.-Y., & Hao, S.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2022-08
- Volume
- 462
- Pages
- 111260
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W4225995462
- Cited by
- 422
- References
- 43
- FWCI
- 28.61
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.