The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Reduced-order modeling of advection-dominated systems with recurrent neural networks and convolutional autoencoders
Open accessAbstract
A common strategy for the dimensionality reduction of nonlinear partial differential equations (PDEs) relies on the use of the proper orthogonal decomposition (POD) to identify a reduced subspace and the Galerkin projection for evolving dynamics in this reduced space. However, advection-dominated PDEs are represented poorly by this methodology since the process of truncation discards important interactions between higher-order modes during time evolution. In this study, we demonstrate that encoding using convolutional autoencoders (CAEs) followed by a reduced-space time evolution by recurrent neural networks overcomes this limitation effectively. We demonstrate that a truncated system of only two latent space dimensions can reproduce a sharp advecting shock profile for the viscous Burgers equation with very low viscosities, and a six-dimensional latent space can recreate the evolution of the inviscid shallow water equations. Additionally, the proposed framework is extended to a parametric reduced-order model by directly embedding parametric information into the latent space to detect trends in system evolution. Our results show that these advection-dominated systems are more amenable to low-dimensional encoding and time evolution by a CAE and recurrent neural network combination than the POD-Galerkin technique.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
Berkooz, G., Holmes, P., & Lumley, J. L. (1993) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.25.010193.002543 · Cited by 4,431
Solving Ordinary Differential Equations II
Hairer, E., & Wanner, G. (1996) · Springer Series in Computational Mathematics · doi:10.1007/978-3-642-05221-7 · Cited by 4,342
Weighted Essentially Non-oscillatory Schemes
Liu, X.-D., Osher, S., & Chan, T. (1994) · Journal of Computational Physics · doi:10.1006/jcph.1994.1187 · Cited by 3,437
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335
Deep learning for universal linear embeddings of nonlinear dynamics
Lusch, B., Kutz, J. N., & Brunton, S. L. (2018) · Nature Communications · doi:10.1038/s41467-018-07210-0 · Cited by 1,424
Self-citationDynamic Mode Decomposition with Control
Proctor, J. L., Brunton, S. L., & Kutz, J. N. (2016) · SIAM Journal on Applied Dynamical Systems · doi:10.1137/15m1013857 · Cited by 1,124
Granger causality analysis in neuroscience and neuroimaging
Seth, A. K., Barrett, A. B., & Barnett, L. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4399-14.2015 · Cited by 928
Model Reduction for Flow Analysis and Control
Rowley, C. W., & Dawson, S. T. M. (2017) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010816-060042 · Cited by 792
Model reduction of dynamical systems on nonlinear manifolds using deep convolutional autoencoders
Lee, K., & Carlberg, K. T. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108973 · Cited by 752
Carlberg, K., Bou‐Mosleh, C., & Farhat, C. (2010) · International Journal for Numerical Methods in Engineering · doi:10.1002/nme.3050 · Cited by 700
Modal Analysis of Fluid Flows: Applications and Outlook
Taira, K., Hemati, M. S., Brunton, S. L., Sun, Y., Duraisamy, K., Bagheri, S., Dawson, S. T. M., & Yeh, C.-A. (2020) · AIAA Journal · doi:10.2514/1.j058462 · Cited by 634
Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networksPreprint
Vlachas, P. R., Byeon, W., Koumoutsakos, P., Wan, Z. Y., & Sapsis, T. P. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 424
A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problems
Tang, M., Liu, Y., & Durlofsky, L. J. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109456 · Cited by 394
Projection-based model reduction: Formulations for physics-based machine learning
Swischuk, R., Mainini, L., Peherstorfer, B., & Willcox, K. (2019) · Computers & Fluids · doi:10.1016/j.compfluid.2018.07.021 · Cited by 372
Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks
Vlachas, P. R., Byeon, W., Wan, Z. Y., Sapsis, T. P., & Koumoutsakos, P. (2018) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2017.0844 · Cited by 358
Reduced-Order Modelling for Flow Control
(2011) · CISM International Centre for Mechanical Sciences · doi:10.1007/978-3-7091-0758-4 · Cited by 331
Galerkin v. least-squares Petrov–Galerkin projection in nonlinear model reduction
Carlberg, K., Barone, M., & Antil, H. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2016.10.033 · Cited by 314
Mohan, A. T., & Gaitonde, D. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09269 · Cited by 304
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries
Kashefi, A., Rempe, D., & Guibas, L. J. (2021) · Physics of Fluids · doi:10.1063/5.0033376 · Cited by 295
Wang, Q., Hesthaven, J. S., & Ray, D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.01.031 · Cited by 286
Kosambi, D. D. (2016) · Springer eBooks · doi:10.1007/978-81-322-3676-4_15 · Cited by 276
Optimal Model Management for Multifidelity Monte Carlo Estimation
Peherstorfer, B., Willcox, K. E., & Gunzburger, M. (2016) · SIAM Journal on Scientific Computing · doi:10.1137/15m1046472 · Cited by 269
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
Berkooz, G. (1993) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fluid.25.1.539 · Cited by 250
Latent ODEs for Irregularly-Sampled Time SeriesPreprint
Rubanova, Y., Chen, R. T. Q., & Duvenaud, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.03907 · Cited by 235
Gonzalez, F. J., & Balajewicz, M. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01346 · Cited by 206
Physics-informed Autoencoders for Lyapunov-stable Fluid Flow PredictionPreprint
Erichson, N. B., Muehlebach, M., & Mahoney, M. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10866 · Cited by 174
Multi-level convolutional autoencoder networks for parametric prediction of spatio-temporal dynamics
Xu, J., & Duraisamy, K. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113379 · Cited by 171
An artificial neural network framework for reduced order modeling of transient flows
San, O., Maulik, R., & Ahmed, M. (2019) · Communications in Nonlinear Science and Numerical Simulation · doi:10.1016/j.cnsns.2019.04.025 · Cited by 168
Self-citationNeural network closures for nonlinear model order reduction
San, O., & Maulik, R. (2018) · Advances in Computational Mathematics · doi:10.1007/s10444-018-9590-z · Cited by 153
Self-citationData-Driven Filtered Reduced Order Modeling of Fluid Flows
Xie, X., Mohebujjaman, M., Rebholz, L. G., & Iliescu, T. (2018) · SIAM Journal on Scientific Computing · doi:10.1137/17m1145136 · Cited by 146
Mohan, A. T., Daniel, D., Chertkov, M., & Livescu, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.00033 · Cited by 129
Time-series learning of latent-space dynamics for reduced-order model closure
Maulik, R., Mohan, A. T., Lusch, B., Madireddy, S., Balaprakash, P., & Livescu, D. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132368 · Cited by 125
Self-citationWang, Q., Ripamonti, N., & Hesthaven, J. S. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109402 · Cited by 123
Active flow control using machine learning: A brief review
Ren, F., Hu, H., & Tang, H. (2020) · Journal of Hydrodynamics · doi:10.1007/s42241-020-0026-0 · Cited by 121
Renganathan, S. A., Maulik, R., & Rao, V. (2020) · Physics of Fluids · doi:10.1063/1.5144661 · Cited by 96
Self-citationExploration and prediction of fluid dynamical systems using auto-encoder technology
Agostini, L. M. (2020) · Physics of Fluids · doi:10.1063/5.0012906 · Cited by 89
Physically constrained data‐driven correction for reduced‐order modeling of fluid flows
Mohebujjaman, M., Rebholz, L. G., & Iliescu, T. (2018) · International Journal for Numerical Methods in Fluids · doi:10.1002/fld.4684 · Cited by 82
An intrinsic stabilization scheme for proper orthogonal decomposition based low-dimensional models
Kalb, V. L., & Deane, A. E. (2007) · Physics of Fluids · doi:10.1063/1.2723149 · Cited by 72
A Reduced Order Deep Data Assimilation model
Quilodrán-Casas, C., Arcucci, R., Wu, P., Pain, C. C., & Guo, Y. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132615 · Cited by 71
Optimal reduced space for Variational Data Assimilation
Arcucci, R., Mottet, L., Pain, C. C., & Guo, Y. (2018) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.042 · Cited by 60
A long short-term memory embedding for hybrid uplifted reduced order models
Ahmed, S. E., San, O., Rasheed, A., & Iliescu, T. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132471 · Cited by 58
Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation
Maulik, R., Botsas, T., Ramachandra, N., Mason, L. R., & Pan, I. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132797 · Cited by 43
Self-citationFan, D., Zhang, B., Zhou, Y., & Noack, B. R. (2020) · Physics of Fluids · doi:10.1063/5.0033156 · Cited by 43
Galerkin Method for Nonlinear Dynamics
Noack, B. R., Schlegel, M., Morzyński, M., et al. (2011) · Courses and lectures · doi:10.1007/978-3-7091-0758-4_3 · Cited by 36
GMLS-Nets: A Framework for Learning from Unstructured Data
Sandia National Laboratories (SNL), A., Trask, N., Patel, R., Gross, B., & Atzberger, P. J. (2019) · doi:10.2172/1763256 · Cited by 35
A dynamic closure modeling framework for model order reduction of geophysical flows
Rahman, S. M., Ahmed, S. E., & San, O. (2019) · Physics of Fluids · doi:10.1063/1.5093355 · Cited by 33
Neural network representability of fully ionized plasma fluid model closures
Maulik, R., Garland, N., Burby, J. W., Tang, X.-Z., & Balaprakash, P. (2020) · Physics of Plasmas · doi:10.1063/5.0006457 · Cited by 26
Self-citationRen, J., Wang, H., Xing, J., Luo, K., & Fan, J. (2020) · Physics of Fluids · doi:10.1063/5.0028877 · Cited by 18
Metadata
- Authors
- Maulik, R., Lusch, B., & Balaprakash, P.
- Venue
- Physics of Fluids
- Publisher
- AIP Publishing
- Published
- 2021-03-01
- Volume
- 33
- Issue
- 3
- ISSN
- 1070-6631 (ISSN-L)
- 1089-7666
- OpenAlex
- W3004360475
- Cited by
- 299
- References
- 49
- FWCI
- 19.39
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.