PhyCRNet: Physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
Open accessThe DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Abstract
Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks (PINNs) to solve PDEs as a basis for data-driven modeling and inverse analysis. However, the majority of existing PINN methods, based on fully-connected NNs, pose intrinsic limitations to low-dimensional spatiotemporal parameterizations. Moreover, since the initial/boundary conditions (I/BCs) are softly imposed via penalty, the solution quality heavily relies on hyperparameter tuning. To this end, we propose the novel physics-informed convolutional-recurrent learning architectures (PhyCRNet and PhyCRNet-s) for solving PDEs without any labeled data. Specifically, an encoder-decoder convolutional long short-term memory network is proposed for low-dimensional spatial feature extraction and temporal evolution learning. The loss function is defined as the aggregated discretized PDE residuals, while the I/BCs are hard-encoded in the network to ensure forcible satisfaction (e.g., periodic boundary padding). The networks are further enhanced by autoregressive and residual connections that explicitly simulate time marching. The performance of our proposed methods has been assessed by solving three nonlinear PDEs (e.g., 2D Burgers' equations, the $\lambda$-$\omega$ and FitzHugh Nagumo reaction-diffusion equations), and compared against the start-of-the-art baseline algorithms. The numerical results demonstrate the superiority of our proposed methodology in the context of solution accuracy, extrapolability and generalizability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · cited 1×
“Besides, it is worthwhile to mention that we do not consider batch normalization [70] in PhyCRNet in view of the limited amount of input variables and its deficiency to super-resolution [71].”
BackgroundSemi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
(2017) · Cited by 11,625
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Shi, W., Caballero, J., Huszar, F., Totz, J., Aitken, A. P., Bishop, R., Rueckert, D., & Wang, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.207 · Cited by 7,570
Isogeometric analysis: CAD, finite elements, NURBS, exact geometry and mesh refinement
Hughes, T. J. R., Cottrell, J. A., & Bazilevs, Y. (2005) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2004.10.008 · Cited by 6,335
The finite element method. Linear static and dynamic finite element analysis
Zimmermann, T. (1987) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/0045-7825(87)90013-2 · Cited by 5,080
The Finite Element Method: Linear Static and Dynamic Finite Element Analysis
Hughes, T. J. R. (1987) · Cited by 4,852
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Geometric Deep Learning: Going beyond Euclidean data
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., & Vandergheynst, P. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2693418 · Cited by 3,661
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu, L., Jin, P., Pang, G., Zhang, Z., & Karniadakis, G. E. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00302-5 · Cited by 3,418
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
DeepXDE: A Deep Learning Library for Solving Differential Equations
Lu, L., Meng, X., Mao, Z., & Karniadakis, G. E. (2021) · SIAM Review · doi:10.1137/19m1274067 · Cited by 2,512
Artificial neural networks for solving ordinary and partial differential equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712178 · Cited by 2,412
Samaniego, E., Anitescu, C., Goswami, S., Nguyen-Thanh, V. M., Guo, H., Hamdia, K., Zhuang, X., & Rabczuk, T. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112790 · Cited by 2,104
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Raissi, M., Yazdani, A., & Karniadakis, G. E. (2020) · Science · doi:10.1126/science.aaw4741 · Cited by 2,103
Solving high-dimensional partial differential equations using deep learning
Han, J., Jentzen, A., & E, W. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1718942115 · Cited by 1,722
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Defferrard, M., Bresson, X., & Vandergheynst, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.09375 · Cited by 1,673
Deconvolution and Checkerboard Artifacts
Odena, A., Dumoulin, V., & Olah, C. (2016) · Distill · doi:10.23915/distill.00003 · Cited by 1,640
Data-driven discovery of partial differential equations
Rudy, S. H., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2017) · Science Advances · doi:10.1126/sciadv.1602614 · Cited by 1,557
The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems
E, W., & Yu, B. (2018) · Communications in Mathematics and Statistics · doi:10.1007/s40304-018-0127-z · Cited by 1,418
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Physics-informed neural networks for high-speed flows
Mao, Z., Jagtap, A. D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112789 · Cited by 1,282
Serial Order: A Parallel Distributed Processing Approach
Jordan, M. I. (1997) · Advances in Psychology · doi:10.1016/s0166-4115(97)80111-2 · Cited by 1,242
Jin, X., Cai, S., Li, H., & Karniadakis, G. E. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109951 · Cited by 1,210
Neural Operator: Graph Kernel Network for Partial Differential EquationsPreprint
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A. M., & Anandkumar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03485 · Cited by 1,150
Sun, L., Gao, H., Pan, S., & Wang, J.-X. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112732 · Cited by 1,045
Self-citationZhu, Y., Zabaras, N., Koutsourelakis, P.-S., & Perdikaris, P. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.024 · Cited by 1,030
Fourier Neural Operator for Parametric Partial Differential Equations
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., & Anandkumar, A. (2020) · arXiv · doi:10.48550/arxiv.2010.08895 · Cited by 1,021
Artificial Neural Networks for Solving Ordinary and Partial Differential Equations
Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998) · Cited by 944
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Salimans, T., & Kingma, D. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07868 · Cited by 883
Zhu, Y., & Zabaras, N. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.018 · Cited by 704
Kissas, G., Yang, Y., Hwuang, E., Witschey, W. R., Detre, J. A., & Perdikaris, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112623 · Cited by 647
Gao, H., Sun, L., & Wang, J.-X. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.110079 · Cited by 621
Self-citationPhysics-informed learning of governing equations from scarce data
Chen, Z., Liu, Y., & Sun, H. (2021) · Nature Communications · doi:10.1038/s41467-021-26434-1 · Cited by 609
Self-citationPrediction of aerodynamic flow fields using convolutional neural networks
Bhatnagar, S., Afshar, Y., Pan, S., Duraisamy, K., & Kaushik, S. (2019) · Computational Mechanics · doi:10.1007/s00466-019-01740-0 · Cited by 575
Learning data-driven discretizations for partial differential equations
Bar-Sinai, Y., Hoyer, S., Hickey, J., & Brenner, M. P. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1814058116 · Cited by 543
Neural-network methods for boundary value problems with irregular boundaries
Lagaris, I. E., Likas, A. C., & Papageorgiou, D. G. (2000) · IEEE Transactions on Neural Networks · doi:10.1109/72.870037 · Cited by 521
Zhang, D., Lu, L., Guo, L., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.048 · Cited by 513
Physics-guided convolutional neural network (PhyCNN) for data-driven seismic response modeling
Zhang, R., Liu, Y., & Sun, H. (2020) · Engineering Structures · doi:10.1016/j.engstruct.2020.110704 · Cited by 506
Self-citationPhysics-informed multi-LSTM networks for metamodeling of nonlinear structures
Zhang, R., Liu, Y., & Sun, H. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113226 · Cited by 504
Self-citationSimulation-based optimal bayesian experimental design for nonlinear systems
Huan, X., & Marzouk, Y. M. (2013) · Journal of Computational Physics · doi:10.1016/j.jcp.2012.08.013 · Cited by 438 · cited 1×
“Over the past decade, thanks to the great advances in deep learning, many attempts have been devoted to this resurgent topic, which have led to a proliferation of studies in scientific machine learning [6–15] with growing attention on modeling and simulation of PDE systems.”
BackgroundA physics-informed variational DeepONet for predicting crack path in quasi-brittle materials
Goswami, S., Yin, M., Yu, Y., & Karniadakis, G. E. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114587 · Cited by 425
Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
Raissi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06637 · Cited by 419
Deep learning of vortex-induced vibrations
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · Journal of Fluid Mechanics · doi:10.1017/jfm.2018.872 · Cited by 404
Shan, Q., Li, Z., Jia, J., & Tang, C.-K. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409106 · Cited by 363
Deep learning of vortex-induced vibrationsPreprint
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 361
Extraction of mechanical properties of materials through deep learning from instrumented indentation
Lu, L., Dao, M., Kumar, P., Ramamurty, U., Karniadakis, G. E., & Suresh, S. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1922210117 · Cited by 352
Physics-informed deep learning for incompressible laminar flows
Rao, C., Sun, H., & Liu, Y. (2020) · Theoretical and Applied Mechanics Letters · doi:10.1016/j.taml.2020.01.039 · Cited by 342
Self-citationModeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
Geneva, N., & Zabaras, N. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109056 · Cited by 339
Physics-Informed Deep Learning for Computational Elastodynamics without Labeled Data
Rao, C., Sun, H., & Liu, Y. (2021) · Journal of Engineering Mechanics · doi:10.1061/(asce)em.1943-7889.0001947 · Cited by 330
Self-citationModel Reduction And Neural Networks For Parametric PDEs
Bhattacharya, K., Hosseini, B., Kovachki, N. B., & Stuart, A. M. (2021) · The SMAI Journal of computational mathematics · doi:10.5802/smai-jcm.74 · Cited by 329
Zhang, D., Guo, L., & Karniadakis, G. E. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1260141 · Cited by 308
Wide Activation for Efficient and Accurate Image Super-Resolution
Yu, J., Fan, Y., Yang, J., Xu, N., Wang, Z., Wang, X., & Huang, T. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.08718 · Cited by 301
Shukla, K., Di Leoni, P. C., Blackshire, J., Sparkman, D., & Karniadakis, G. E. (2020) · Journal of Nondestructive Evaluation · doi:10.1007/s10921-020-00705-1 · Cited by 300
Predictive large-eddy-simulation wall modeling via physics-informed neural networks
Yang, X. I. A., Zafar, S., Wang, J.-X., & Xiao, H. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.034602 · Cited by 286
Self-citationData driven governing equations approximation using deep neural networks
Qin, T., Wu, K., & Xiu, D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.06.042 · Cited by 284
Bresson, X., & Laurent, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07553 · Cited by 224
Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data
Sun, L., & Wang, J.-X. (2020) · Theoretical and Applied Mechanics Letters · doi:10.1016/j.taml.2020.01.031 · Cited by 223
Self-citationNon-invasive inference of thrombus material properties with physics-informed neural networks
Yin, M., Zheng, X., Humphrey, J. D., & Karniadakis, G. E. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113603 · Cited by 186
Transformers for modeling physical systems
Geneva, N., & Zabaras, N. (2022) · Neural Networks · doi:10.1016/j.neunet.2021.11.022 · Cited by 186
Sparse dynamics for partial differential equations
Schaeffer, H., Caflisch, R., Hauck, C. D., & Osher, S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1302752110 · Cited by 172
Wessels, H., Weißenfels, C., & Wriggers, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113127 · Cited by 171
Ranade, R., Hill, C., & Pathak, J. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113722 · Cited by 167
A physics-informed operator regression framework for extracting data-driven continuum models
Patel, R. G., Trask, N., Wood, M. A., & Cyr, E. C. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113500 · Cited by 159
Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction
Belbute-Peres, F. D. A., Economon, T. D., & Kolter, J. Z. (2020) · arXiv · doi:10.48550/arxiv.2007.04439 · Cited by 152
Cai, S., Li, H., Zheng, F., Kong, F., Dao, M., Karniadakis, G. E., & Suresh, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2100697118 · Cited by 142
Winovich, N., Ramani, K., & Lin, G. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.05.026 · Cited by 130
A physics-constrained data-driven approach based on locally convex reconstruction for noisy database
He, Q., & Chen, J. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.112791 · Cited by 95
Wang, Z., Huan, X., & Garikipati, K. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113706 · Cited by 53
Zhang, J., & Shields, M. D. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.01.045 · Cited by 40
Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics
Seo, S., Meng, C., & Liu, Y. (2020) · International Conference on Learning Representations · Cited by 39
Self-citationGMLS-Nets: A Framework for Learning from Unstructured Data
Sandia National Laboratories (SNL), A., Trask, N., Patel, R., Gross, B., & Atzberger, P. J. (2019) · doi:10.2172/1763256 · Cited by 35
Hard Encoding of Physics for Learning Spatiotemporal DynamicsPreprint
Rao, C., Sun, H. Y., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.00557 · Cited by 14
Self-citationTransformers for Modeling Physical Systems
Geneva, N., & Zabaras, N. J. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5148523 · Cited by 8
Embedding Physics to Learn Spatiotemporal Dynamics from Sparse Data.Preprint
Rao, C., Sun, H., & Liu, Y. (2021) · arXiv (Cornell University) · Cited by 2
Self-citationChen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
Chiu, P.-H., Wong, J. C., Ooi, C., Dao, M. H., & Ong, Y.-S. (2022) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2022.114909 · Cited by 366
Hu, H., Qi, L., & Chao, X. (2024) · Thin-Walled Structures · doi:10.1016/j.tws.2024.112495 · Cited by 335
Faroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Metadata
- Authors
- Ren, P., Rao, C., Liu, Y., Wang, J.-X., & Sun, H.
- Venue
- Computer Methods in Applied Mechanics and Engineering
- Publisher
- Elsevier BV
- Published
- 2022-02
- Volume
- 389
- Pages
- 114399
- ISSN
- 0045-7825 (ISSN-L)
- OpenAlex
- W3173549089
- Cited by
- 270
- References
- 87
- FWCI
- 12.99
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.