Learning data-driven discretizations for partial differential equations
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length- and timescales. Often, it is computationally intractable to resolve the finest features in the solution. The only recourse is to use approximate coarse-grained representations, which aim to accurately represent long-wavelength dynamics while properly accounting for unresolved small-scale physics. Deriving such coarse-grained equations is notoriously difficult and often ad hoc. Here we introduce data-driven discretization, a method for learning optimized approximations to PDEs based on actual solutions to the known underlying equations. Our approach uses neural networks to estimate spatial derivatives, which are optimized end to end to best satisfy the equations on a low-resolution grid. The resulting numerical methods are remarkably accurate, allowing us to integrate in time a collection of nonlinear equations in 1 spatial dimension at resolutions 4× to 8× coarser than is possible with standard finite-difference methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(2020) · Electromagnetic Processes · doi:10.2307/j.ctv131bv37.5 · Cited by 21,966
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Greiner, W. (1998) · Theoretical Physics · doi:10.1007/978-1-4612-0587-6 · Cited by 6,657
Discovering governing equations from data by sparse identification of nonlinear dynamical systems
Brunton, S. L., Proctor, J. L., & Kutz, J. N. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517384113 · Cited by 4,796
Interaction of "Solitons" in a Collisionless Plasma and the Recurrence of Initial States
Zabusky, N. J., & Kruskal, M. D. (1965) · Physical Review Letters · doi:10.1103/physrevlett.15.240 · Cited by 4,149
Axiomatic attribution for deep networks
Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087
Numerical Methods for Conservation Laws
LeVeque, R. J. (1992) · Birkhäuser Basel eBooks · doi:10.1007/978-3-0348-8629-1 · Cited by 3,632
Perturbation Methods in Fluid Mechanics
(1965) · Nature · doi:10.1038/206226b0 · Cited by 3,472
Uniformly high order accurate essentially non-oscillatory schemes, III
Harten, A., Engquist, B., Osher, S., & Chakravarthy, S. R. (1987) · Journal of Computational Physics · doi:10.1016/0021-9991(87)90031-3 · Cited by 3,002
Learning Important Features Through Propagating Activation Differences
Shrikumar, A., Greenside, P., & Kundaje, A. (2017) · arXiv · doi:10.48550/arxiv.1704.02685 · Cited by 2,761
Proceedings of the 19th International Conference on Artificial Intelligence and Statistics 2016
Murray, I., & Graham, M. M. (2016) · Cited by 2,115
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 2,114
Turbulence: The Legacy of A. N. Kolmogorov
Frisch, U., & Donnelly, R. J. (1996) · Physics Today · doi:10.1063/1.881555 · Cited by 1,957
Shu, C.-W. (1998) · Lecture Notes in Mathematics · doi:10.1007/bfb0096355 · Cited by 1,919
Reynolds averaged turbulence modelling using deep neural networks with embedded invariance
Ling, J., Kurzawski, A., & Templeton, J. (2016) · Journal of Fluid Mechanics · doi:10.1017/jfm.2016.615 · Cited by 1,624
Deep learning for universal linear embeddings of nonlinear dynamics
Lusch, B., Kutz, J. N., & Brunton, S. L. (2018) · Nature Communications · doi:10.1038/s41467-018-07210-0 · Cited by 1,424
Direct numerical simulation of turbulent channel flow up to
Lee, M., & Moser, R. D. (2015) · Journal of Fluid Mechanics · doi:10.1017/jfm.2015.268 · Cited by 1,364
Deep learning to represent subgrid processes in climate models
Rasp, S., Pritchard, M. S., & Gentine, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1810286115 · Cited by 1,044
Density Functional Theory: A Practical Introduction
Sholl, D. S., & Steckel, J. A. (2009) · University of North Texas Digital Library (University of North Texas) · Cited by 968
Handbook of Differential Equations
Ames, W. F., & Zwillinger, D. (1990) · Mathematics of Computation · doi:10.2307/2008707 · Cited by 821
Handbook of Differential Equations
(1992) · Elsevier eBooks · doi:10.1016/c2013-0-11746-1 · Cited by 733
Advanced Numerical Approximation of Nonlinear Hyperbolic Equations
Cockburn, B., Shu, C.-W., Johnson, C., & Tadmor, E. (1998) · Lecture Notes in Mathematics · doi:10.1007/bfb0096351 · Cited by 530
Deep Fluids: A Generative Network for Parameterized Fluid Simulations
Kim, B., Azevedo, V. C., Thuerey, N., Kim, T., Gross, M., & Solenthaler, B. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13619 · Cited by 372
Deep neural networks for data-driven LES closure models
Beck, A., Flad, D., & Munz, C.-D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108910 · Cited by 356
Equation-Free Multiscale Computation: Algorithms and Applications
Kevrekidis, I. G., & Samaey, G. (2009) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.59.032607.093610 · Cited by 280
RAISR: Rapid and Accurate Image Super Resolution
Romano, Y., Isidoro, J., & Milanfar, P. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629284 · Cited by 280
Accelerating Eulerian Fluid Simulation With Convolutional Networks
Tompson, J., Schlachter, K., Sprechmann, P., & Perlin, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.03597 · Cited by 280
Identification of distributed parameter systems: A neural net based approach
González-García, R., Rico-Martínez, R., & Kevrekidis, I. G. (1998) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00191-4 · Cited by 244
Deep Dynamical Modeling and Control of Unsteady Fluid FlowsPreprint
Morton, J., Witherden, F., Antony Jameson, B., & Kochenderfer, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07472 · Cited by 195
BLADE: Filter learning for general purpose computational photography
Getreuer, P., Garcia‐Dorado, I., Isidoro, J. R., Choi, S., Ong, F., & Milanfar, P. (2018) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2018.8368476 · Cited by 29
Clay, M. P., Buaria, D., Gotoh, T., & Yeung, P. K. (2017) · Computer Physics Communications · doi:10.1016/j.cpc.2017.06.009 · Cited by 14
Cited by
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Haghighat, E., Raissi, M., Moure, A., Gomez, H., & Juanes, R. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113741 · Cited by 1,305
Deep learning for the design of photonic structures
Ma, W., Liu, Z., Kudyshev, Z. A., Boltasseva, A., Cai, W., & Liu, Y. (2021) · Nature Photonics · doi:10.1038/s41566-020-0685-y · Cited by 1,136
Machine learning–accelerated computational fluid dynamics
Kochkov, D., Smith, J. A., Alieva, A., Wang, Q., Brenner, M. P., & Hoyer, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2101784118 · Cited by 1,042
Self-citationData-driven discovery of coordinates and governing equations
Champion, K., Lusch, B., Kutz, J. N., & Brunton, S. L. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1906995116 · Cited by 909
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
Metadata
- Authors
- Bar-Sinai, Y., Hoyer, S., Hickey, J., & Brenner, M. P.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2019-07-16
- Volume
- 116
- Issue
- 31
- Pages
- 15344-15349
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2891039272
- Cited by
- 543
- References
- 36
- FWCI
- 26.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.