The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Data driven governing equations approximation using deep neural networks
Open accessAbstract
We present a numerical framework for approximating unknown governing equations using observation data and deep neural networks (DNN). In particular, we propose to use residual network (ResNet) as the basic building block for equation approximation. We demonstrate that the ResNet block can be considered as a one-step method that is exact in temporal integration. We then present two multi-step methods, recurrent ResNet (RT-ResNet) method and recursive ReNet (RS-ResNet) method. The RT-ResNet is a multi-step method on uniform time steps, whereas the RS-ResNet is an adaptive multi-step method using variable time steps. All three methods presented here are based on integral form of the underlying dynamical system. As a result, they do not require time derivative data for equation recovery and can cope with relatively coarsely distributed trajectory data. Several numerical examples are presented to demonstrate the performance of the methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
(2016) · Cited by 11,679
Approximation capabilities of multilayer feedforward networks
Hornik, K. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90009-t · Cited by 6,091
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Construction of a genetic toggle switch in Escherichia coli
Gardner, T. S., Cantor, C. R., & Collins, J. J. (2000) · Nature · doi:10.1038/35002131 · Cited by 4,268
Distilling Free-Form Natural Laws from Experimental Data
Schmidt, M., & Lipson, H. (2009) · Science · doi:10.1126/science.1165893 · Cited by 2,890
Universal approximation bounds for superpositions of a sigmoidal function
Barron, A. R. (1993) · IEEE Transactions on Information Theory · doi:10.1109/18.256500 · Cited by 2,804
Detecting Causality in Complex Ecosystems
Sugihara, G., May, R., Ye, H., Hsieh, C.-H., Deyle, E., Fogarty, M., & Munch, S. (2012) · Science · doi:10.1126/science.1227079 · Cited by 2,539
Leshno, M., Lin, V. Y., Pinkus, A., & Schocken, S. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80131-5 · Cited by 2,121
Neural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097
Data-driven discovery of partial differential equations
Rudy, S. H., Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2017) · Science Advances · doi:10.1126/sciadv.1602614 · Cited by 1,557
Approximation theory of the MLP model in neural networks
Pinkus, A. (1999) · Acta Numerica · doi:10.1017/s0962492900002919 · Cited by 1,529
Hidden physics models: Machine learning of nonlinear partial differential equations
Raissi, M., & Karniadakis, G. E. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.11.039 · Cited by 1,349
On the Number of Linear Regions of Deep Neural Networks
Montúfar, G., Pascanu, R., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1402.1869 · Cited by 840
Automated reverse engineering of nonlinear dynamical systems
Bongard, J., & Lipson, H. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609476104 · Cited by 792
Gear, C. W., Hyman, J. M., Kevrekidid, P. G., Kevrekidis, I. G., Runborg, O., & Theodoropoulos, C. (2003) · Communications in Mathematical Sciences · doi:10.4310/cms.2003.v1.n4.a5 · Cited by 776
Zhu, Y., & Zabaras, N. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.018 · Cited by 704
Non-intrusive reduced order modeling of nonlinear problems using neural networks
Hesthaven, J. S., & Ubbiali, S. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.02.037 · Cited by 616
Chaos as an intermittently forced linear system
Brunton, S. L., Brunton, B. W., Proctor, J. L., Kaiser, E., & Kutz, J. N. (2017) · Nature Communications · doi:10.1038/s41467-017-00030-8 · Cited by 608
Machine learning of linear differential equations using Gaussian processes
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.07.050 · Cited by 584
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review
Poggio, T., Mhaskar, H., Rosasco, L., Miranda, B., & Liao, Q. (2017) · International Journal of Automation and Computing · doi:10.1007/s11633-017-1054-2 · Cited by 559
On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures
Bianchini, M., & Scarselli, F. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2293637 · Cited by 500
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · Nature Communications · doi:10.1038/s41467-017-02388-1 · Cited by 497
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · RePEc: Research Papers in Economics · doi:10.17169/refubium-964 · Cited by 465
Tripathy, R. K., & Bilionis, I. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.08.036 · Cited by 464
Numerical Differentiation of Noisy, Nonsmooth Data
Chartrand, R. (2011) · ISRN Applied Mathematics · doi:10.5402/2011/164564 · Cited by 444
(2016) · Conference on Learning Theory · Cited by 443
Learning partial differential equations via data discovery and sparse optimization
Schaeffer, H. (2017) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2016.0446 · Cited by 432
Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
Raissi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06637 · Cited by 419
Equation-free mechanistic ecosystem forecasting using empirical dynamic modeling
Ye, H., Beamish, R. J., Glaser, S. M., Grant, S. C. H., Hsieh, C.-H., Richards, L. J., Schnute, J. T., & Sugihara, G. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1417063112 · Cited by 367
Neural Networks and Statistical Learning
Du, K.-L., & Swamy, M. N. S. (2014) · Springer eBooks · doi:10.1007/978-1-4471-5571-3 · Cited by 356
Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical SystemsPreprint
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01236 · Cited by 330
Heterogeneous multiscale method: A general methodology for multiscale modeling
E, W., Engquist, B., & Huang, Z. (2003) · Physical Review B · doi:10.1103/physrevb.67.092101 · Cited by 280
Identification of distributed parameter systems: A neural net based approach
González-García, R., Rico-Martínez, R., & Kevrekidis, I. G. (1998) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00191-4 · Cited by 244
Sparse model selection via integral terms
Schaeffer, H., & McCalla, S. G. (2017) · Physical Review E · doi:10.1103/physreve.96.023302 · Cited by 225
Neural Networks and Statistical Learning
Du, K.-L., & Swamy, M. N. S. (2019) · Springer eBooks · doi:10.1007/978-1-4471-7452-3 · Cited by 212
Giannakis, D., & Majda, A. J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1118984109 · Cited by 205
The Power of Depth for Feedforward Neural Networks
Eldan, R., & Shamir, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.03965 · Cited by 200
Automated adaptive inference of phenomenological dynamical models
Daniels, B. C., & Nemenman, I. (2015) · Nature Communications · doi:10.1038/ncomms9133 · Cited by 194
PDE-Net: Learning PDEs from Data
Long, Z., Lu, Y., Ma, X., & Dong, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09668 · Cited by 184
Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
Rudy, S. H., Nathan Kutz, J., & Brunton, S. L. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.06.056 · Cited by 180
Exact Recovery of Chaotic Systems from Highly Corrupted Data
Tran, G., & Ward, R. (2017) · Multiscale Modeling & Simulation · doi:10.1137/16m1086637 · Cited by 168
An artificial neural network as a troubled-cell indicator
Ray, D., & Hesthaven, J. S. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.04.029 · Cited by 162
Multi-level Residual Networks from Dynamical Systems ViewPreprint
Chang, B., Meng, L., Haber, E., Tung, F., & Begert, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10348 · Cited by 161
Automated refinement and inference of analytical models for metabolic networks
Schmidt, M. D., Vallabhajosyula, R. R., Jenkins, J. W., Hood, J. E., Soni, A. S., Wikswo, J. P., & Lipson, H. (2011) · Physical Biology · doi:10.1088/1478-3975/8/5/055011 · Cited by 144
Amplitude Equations from Spatiotemporal Binary-Fluid Convection Data
Voss, H. U., Kolodner, P. R., Abel, M., & Kurths, J. (1999) · Physical Review Letters · doi:10.1103/physrevlett.83.3422 · Cited by 111
Deep multiscale model learning
Wang, Y., Cheung, S. W., Chung, E. T., Efendiev, Y. R., & Wang, M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.109071 · Cited by 97
Daniels, B. C., & Nemenman, I. M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0119821 · Cited by 95
A machine learning approach for efficient uncertainty quantification using multiscale methods
Chan, S., & Elsheikh, A. H. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.10.034 · Cited by 83
Numerical aspects for approximating governing equations using data
Wu, K., & Xiu, D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.01.030 · Cited by 67
Self-citationBartlett, P. L., Evans, S. N., & Long, P. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05012 · Cited by 45
Cited by
PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network
Long, Z., Lu, Y., & Dong, B. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108925 · Cited by 549
A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate
Guo, H., Zhuang, X., & Rabczuk, T. (2019) · Computers, Materials & Continua · doi:10.32604/cmc.2019.06660 · Cited by 466
Efficient training of physics‐informed neural networks via importance sampling
Nabian, M. A., Gladstone, R. J., & Meidani, H. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12685 · Cited by 330
Stiff-PINN: Physics-Informed Neural Network for Stiff Chemical Kinetics
Ji, W., Qiu, W., Shi, Z., Pan, S., & Deng, S. (2021) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.1c05102 · Cited by 307
Disentangling Physical Dynamics From Unknown Factors for Unsupervised Video Prediction
Le Guen, V., & Thome, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01149 · Cited by 306
Metadata
- Authors
- Qin, T., Wu, K., & Xiu, D.
- Venue
- Journal of Computational Physics
- Publisher
- Elsevier BV
- Published
- 2019-10
- Volume
- 395
- Pages
- 620-635
- ISSN
- 0021-9991 (ISSN-L)
- OpenAlex
- W2951629468
- Cited by
- 284
- References
- 54
- FWCI
- 16.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.