The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
fPINNs: Fractional Physics-Informed Neural Networks
Open accessAbstract
Physics-informed neural networks (PINNs), introduced in [M. Raissi, P. Perdikaris, and G. Karniadakis, J. Comput. Phys., 378 (2019), pp. 686--707], are effective in solving integer-order partial differential equations (PDEs) based on scattered and noisy data. PINNs employ standard feedforward neural networks (NNs) with the PDEs explicitly encoded into the NN using automatic differentiation, while the sum of the mean-squared PDE residuals and the mean-squared error in initial-boundary conditions is minimized with respect to the NN parameters. Here we extend PINNs to fractional PINNs (fPINNs) to solve space-time fractional advection-diffusion equations (fractional ADEs), and we study systematically their convergence, hence explaining both fPINNs and PINNs for the first time. Specifically, we demonstrate their accuracy and effectiveness in solving multidimensional forward and inverse problems with forcing terms whose values are only known at randomly scattered spatio-temporal coordinates ( black-box (BB) forcing terms). A novel element of the fPINNs is the hybrid approach that we introduce for constructing the residual in the loss function using both automatic differentiation for the integer-order operators and numerical discretization for the fractional operators. This approach bypasses the difficulties stemming from the fact that automatic differentiation is not applicable to fractional operators because the standard chain rule in integer calculus is not valid in fractional calculus. To discretize the fractional operators, we employ the Grünwald--Letnikov (GL) formula in one-dimensional fractional ADEs and the vector GL formula in conjunction with the directional fractional Laplacian in two- and three-dimensional fractional ADEs. We first consider the one-dimensional fractional Poisson equation and compare the convergence of the fPINNs against the finite difference method (FDM). We present the solution convergence using both the mean $L^2$ error as well as the standard deviation due to sensitivity to NN parameter initializations. Using different GL formulas we observe first-, second-, and third-order convergence rates for small size training sets but the error saturates for larger training sets. We explain these results by analyzing the four sources of numerical errors due to discretization, sampling, NN approximation, and optimization. The total error decays monotonically (below $10^{-5}$ for a third-order GL formula) but it saturates beyond that point due to the optimization error. We also analyze the relative balance between discretization and sampling errors and observe that the sampling size and the number of discretization points ( auxiliary points) should be comparable to achieve the highest accuracy. As we increase the depth of the NN up to certain value, the mean error decreases and the standard deviation increases, whereas the width has essentially no effect unless its value is either too small or too large. We next consider time-dependent fractional ADEs and compare white-box (WB) and BB forcing. We observe that for the WB forcing, our results are similar to the aforementioned cases; however, for the BB forcing fPINNs outperform FDM. Subsequently, we consider multidimensional time-, space-, and space-time-fractional ADEs using the directional fractional Laplacian and we observe relative errors of $10^{-3}\sim10^{-4}$. Finally, we solve several inverse problems in one, two, and three dimensions to identify the fractional orders, diffusion coefficients, and transport velocities and obtain accurate results given proper initializations even in the presence of significant noise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We also used the extended stochastic gradient descent Adam algorithm [18] to optimize the loss function.”
MethodRaissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384 · cited 4×
“We just need to add the parameters to be identified in the inverse problem to the list of parameters to be optimized in the forward problem without changing anything else [35].”
BackgroundMethodInfluentialSelf-citationModel-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 1×
“We can tune these attributes of NN architecture automatically by leveraging metalearning techniques [65, 66].”
MethodImproving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382 · cited 1×
“Additionally, the noise in the data can be naturally taken into account by employing regularization techniques, such as L(1), L(2) and L∞ regularization [32], early stopping [33], as well as dropout [34, 35].”
MethodDiscovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796 · cited 10×
“In this paper, we focus on the identification of the parameters of fractional PDEs whose overall form is known but some coefficients and most importantly the operators themselves are not known.”
BackgroundInfluentialNeural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974 · cited 1×
“We can tune these attributes of NN architecture automatically by leveraging meta-learning techniques [54].”
MethodArtificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412 · cited 1×
“In particular, we concentrate on physics-informed neural networks (PINNs) [7, 46, 19, 35], which belong to the second aforementioned category.”
BackgroundHidden physics models: Machine learning of nonlinear partial differential equations
Raissi, M., & Karniadakis, G. E. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.11.039 · Cited by 1,349 · cited 1×
“Other examples include, but not limited to, [21, 22, 23].”
BackgroundSelf-citationApplication of a fractional advection‐dispersion equation
Benson, D. A., Wheatcraft, S. W., & Meerschaert, M. M. (2000) · Water Resources Research · doi:10.1029/2000wr900031 · Cited by 1,301 · cited 1×
“Among these are solute transport in fractured and porous media [2, 3], acoustic wave propagation with frequency-dependent dissipation [4, 5, 6, 7], laminar and turbulent flows [8, 9, 10], viscoelastic constitutive laws [11], just to mention a few.”
BackgroundA fully discrete difference scheme for a diffusion-wave system
Sun, Z.-Z., & Wu, X. (2006) · Applied Numerical Mathematics · doi:10.1016/j.apnum.2005.03.003 · Cited by 1,235 · cited 2×
“The truncating error for the L1 scheme is (\Delta t) 2 - \gamma [44].”
Method
Research works printed but not linked: 15
- Blum A., 1988, Advances in Neural Information Processing Systems, 1, 494
- 10.1007/978-3-642-14574-2 · doi:10.1007/978-3-642-14574-2
- Glorot X., 2010, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 249
- 10.1007/978-3-319-40663-3_36 · doi:10.1007/978-3-319-40663-3_36
- 10.1007/978-3-662-43930-2 · doi:10.1007/978-3-662-43930-2
- Gulian M., 2018, Machine Learning of Space-Fractional Differential Equations, preprint, arXiv:1808.00931 · arXiv
- Jin B., 2015, IMA J. Numer. Anal., 36, 197
- Kilbas A. A. A., 2006, North-Holland Math. Stud. 204
- Lee J. D., 2016, Proceedings of the Conference on Learning Theory, 1246
- Lei L., 2017, Advances in Neural Information Processing Systems, 2348
- 10.1142/p614 · doi:10.1142/p614
- Meerschaert M. M., 2004, Fract. Calc. Appl. Anal., 7, 61
- Podlubny I., 1999, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications, Math. Sci. Eng. 198
- Samko S. G., 1993, Gordon and Breach
- Srivastava N., 2014, J. Mach. Learn. Res., 15, 1929
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Self-citationLearning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Self-citationScientific Machine Learning Through Physics–Informed Neural Networks: Where we are and What’s Next
Cuomo, S., Di Cola, V. S., Giampaolo, F., Rozza, G., Raissi, M., & Piccialli, F. (2022) · Journal of Scientific Computing · doi:10.1007/s10915-022-01939-z · Cited by 2,784
“The solution proposed in Pang et al [128], is then extended in Kharazmi et al [77] where they address also time-dependent fractional orders.”
BackgroundMethodInfluentialDeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
“Finally we note that with AD we differentiate the NN and therefore we can deal with noisy data [42].”
BackgroundMethodInfluentialSelf-citationPhysics-informed neural networks (PINNs) for fluid mechanics: a review
Cai, S., Mao, Z., Wang, Z., Yin, M., & Karniadakis, G. E. (2021) · Acta Mechanica Sinica · doi:10.1007/s10409-021-01148-1 · Cited by 2,084
“Beneficial due to the high flexibility and the expressive ability in function approximation, PINNs have been extended to solve various classes of PDEs, e.g., integro-differential equations [21], fractional equations [21], surfaces PDEs [22] and stochastic differential equations [23].”
MethodSelf-citation
Metadata
- Authors
- Pang, G., Lu, L., & Karniadakis, G. E.
- Venue
- SIAM Journal on Scientific Computing
- Published
- 2019-01
- Volume
- 41
- Issue
- 4
- Pages
- A2603-A2626
- ISSN
- 1064-8275 (ISSN-L)
- 1095-7197
- OpenAlex
- W2900501930
- Cited by
- 1,105
- References
- 38
- Citations by year
- 2026: 253 · 2025: 260 · 2024: 195 · 2023: 155 · 2022: 119 · 2021: 82 · 2020: 35 · 2019: 6
- FWCI
- 28.01
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- SIAM Journal on Scientific Computing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Army Research Office (W911NF-18-1-0301, W911NF-15-1-0562)
- U.S. Department of Energy (DE-SC0019434, DE-SC0019453)
- Topics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Physical Sciences › Mathematics › Modeling and Simulation › Fractional Differential Equations Solutions
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- physics-informed neural networks, fractional advection-diffusion equation, fractional Poisson equation, convergence analysis, inverse problems, sampling error, optimization error
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: fPINNs: Fractional Physics-Informed Neural Networks. https://app.cochat.ai/papers/10.1137/18m1229845
- The paper
- Pang, G., Lu, L., & Karniadakis, G. E. (2019). fPINNs: Fractional Physics-Informed Neural Networks. SIAM Journal on Scientific Computing. https://doi.org/10.1137/18m1229845
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.