The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
A Comprehensive Deep Learning-Based Approach to Reduced Order Modeling of Nonlinear Time-Dependent Parametrized PDEs
Open accessAbstract
Conventional reduced order modeling techniques such as the reduced basis (RB) method (relying, e.g., on proper orthogonal decomposition (POD)) may incur in severe limitations when dealing with nonlinear time-dependent parametrized PDEs, as these are strongly anchored to the assumption of modal linear superimposition they are based on. For problems featuring coherent structures that propagate over time such as transport, wave, or convection-dominated phenomena, the RB method may yield inefficient reduced order models (ROMs) when very high levels of accuracy are required. To overcome this limitation, in this work, we propose a new nonlinear approach to set ROMs by exploiting deep learning (DL) algorithms. In the resulting nonlinear ROM, which we refer to as DL-ROM, both the nonlinear trial manifold (corresponding to the set of basis functions in a linear ROM) as well as the nonlinear reduced dynamics (corresponding to the projection stage in a linear ROM) are learned in a non-intrusive way by relying on DL algorithms; the latter are trained on a set of full order model (FOM) solutions obtained for different parameter values. We show how to construct a DL-ROM for both linear and nonlinear time-dependent parametrized PDEs. Moreover, we assess its accuracy and efficiency on different parametrized PDE problems. Numerical results indicate that DL-ROMs whose dimension is equal to the intrinsic dimensionality of the PDE solutions manifold are able to efficiently approximate the solution of parametrized PDEs, especially in cases for which a huge number of POD modes would have been necessary to achieve the same degree of accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
(2016) · Cited by 11,679
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Impulses and Physiological States in Theoretical Models of Nerve Membrane
FitzHugh, R. (1961) · Biophysical Journal · doi:10.1016/s0006-3495(61)86902-6 · Cited by 6,258
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · cited 1×
“As nonlinear activation function we employ the ELU function [18] defined as”
MethodAn Active Pulse Transmission Line Simulating Nerve Axon
Nagumo, J., Arimoto, S., & Yoshizawa, S. (1962) · Proceedings of the IRE · doi:10.1109/jrproc.1962.288235 · Cited by 4,194
The global k-means clustering algorithm
Likas, A., Vlassis, N., & J. Verbeek, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00060-2 · Cited by 3,733
Nonlinear Model Reduction via Discrete Empirical Interpolation
Chaturantabut, S., & Sorensen, D. C. (2010) · SIAM Journal on Scientific Computing · doi:10.1137/090766498 · Cited by 1,925
A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems
Benner, P., Gugercin, S., & Willcox, K. (2015) · SIAM Review · doi:10.1137/130932715 · Cited by 1,916
Barrault, M., Maday, Y., Nguyen, N. C., & Patera, A. T. (2004) · Comptes Rendus. Mathématique · doi:10.1016/j.crma.2004.08.006 · Cited by 1,530
Hidden physics models: Machine learning of nonlinear partial differential equations
Raissi, M., & Karniadakis, G. E. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2017.11.039 · Cited by 1,349
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,345
(1993) · Cited by 1,173
Raissi, M., Perdikaris, P. G., & Karniadakis, G. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10561 · Cited by 925
A simple two-variable model of cardiac excitation
Aliev, R. R., & Panfilov, A. V. (1996) · Chaos, Solitons & Fractals · doi:10.1016/0960-0779(95)00089-5 · Cited by 786
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders
Lee, K., & Carlberg, K. T. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108973 · Cited by 752
Lip reading sentences in the wild
Chung, J. S., Senior, A., Vinyals, O., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.367 · Cited by 702
Carlberg, K., Farhat, C., Cortial, J., & Amsallem, D. (2013) · Journal of Computational Physics · doi:10.1016/j.jcp.2013.02.028 · Cited by 658
Non-intrusive reduced order modeling of nonlinear problems using neural networks
Hesthaven, J. S., & Ubbiali, S. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.02.037 · Cited by 616
Reduced Basis Methods for Partial Differential Equations
Quarteroni, A. M., Manzoni, A., & Negri, F. (2015) · Unitext · doi:10.1007/978-3-319-15431-2 · Cited by 562
Self-citationFace aging with conditional generative adversarial networks
Antipov, G., Baccouche, M., & Dugelay, J.-L. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8296650 · Cited by 515
Nonlinear model order reduction based on local reduced‐order bases
Amsallem, D., Zahr, M. J., & Farhat, C. (2012) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.4371 · Cited by 501
Mohan, A. T., & Gaitonde, D. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09269 · Cited by 349
Model Reduction And Neural Networks For Parametric PDEs
Bhattacharya, K., Hosseini, B., Kovachki, N. B., & Stuart, A. M. (2021) · The SMAI Journal of computational mathematics · doi:10.5802/smai-jcm.74 · Cited by 329
Reduced order modeling for nonlinear structural analysis using Gaussian process regression
Guo, M., & Hesthaven, J. S. (2018) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.07.017 · Cited by 277
Data-driven reduced order modeling for time-dependent problems
Guo, M., & Hesthaven, J. S. (2019) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.10.029 · Cited by 260
Gonzalez, F. J., & Balajewicz, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01346 · Cited by 231
Data-assisted reduced-order modeling of extreme events in complex dynamical systems
Wan, Z. Y., Vlachas, P., Koumoutsakos, P., & Sapsis, T. (2018) · PLOS ONE · doi:10.1371/journal.pone.0197704 · Cited by 225
Machine learning for fast and reliable solution of time-dependent differential equations
Regazzoni, F., Dede’, L., & Quarteroni, A. M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.050 · Cited by 168
Self-citationA Theoretical Analysis of Deep Neural Networks and Parametric PDEs
Kutyniok, G., Petersen, P., Raslan, M., & Schneider, R. (2022) · Constructive Approximation · doi:10.1007/s00365-021-09551-4 · Cited by 163
Neural network closures for nonlinear model order reduction
San, O., & Maulik, R. (2018) · Advances in Computational Mathematics · doi:10.1007/s10444-018-9590-z · Cited by 152
Model Reduction for Transport-Dominated Problems via Online Adaptive Bases and Adaptive Sampling
Peherstorfer, B. (2020) · SIAM Journal on Scientific Computing · doi:10.1137/19m1257275 · Cited by 147
Amsallem, D., Zahr, M. J., & Washabaugh, K. M. (2015) · Advances in Computational Mathematics · doi:10.1007/s10444-015-9409-0 · Cited by 130
Wang, Q., Ripamonti, N., & Hesthaven, J. S. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109402 · Cited by 123
DR-RNN: A deep residual recurrent neural network for model reductionPreprint
Kani, J. N., & Elsheikh, A. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00939 · Cited by 104
Speech pattern discrimination and multilayer perceptrons
Bourlard, H., & Wellekens, C. J. (1989) · Computer Speech & Language · doi:10.1016/0885-2308(89)90011-9 · Cited by 89
Error modeling for surrogates of dynamical systems using machine learning
Trehan, S., Carlberg, K., & Durlofsky, L. J. (2017) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.5583 · Cited by 75
Atrial and ventricular fibrillation: computational simulation of spiral waves in cardiac tissue
Göktepe, S., Wong, J., & Kuhl, E. (2009) · Archive of Applied Mechanics · doi:10.1007/s00419-009-0384-0 · Cited by 55
Freno, B. A., & Carlberg, K. (2019) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2019.01.024 · Cited by 51
Parish, E., & Carlberg, K. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.112990 · Cited by 41
Cited by
Model Reduction And Neural Networks For Parametric PDEs
Bhattacharya, K., Hosseini, B., Kovachki, N. B., & Stuart, A. M. (2021) · The SMAI Journal of computational mathematics · doi:10.5802/smai-jcm.74 · Cited by 329
Metadata
- Authors
- Fresca, S., Dede’, L., & Manzoni, A.
- Venue
- Journal of Scientific Computing
- Published
- 2021-04-12
- Volume
- 87
- Issue
- 2
- ISSN
- 0885-7474 (ISSN-L)
- 1573-7691
- OpenAlex
- W3000293971
- Cited by
- 309
- References
- 49
- FWCI
- 17.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.