The DOI matches its DataCite record; 2 of the 2 references it cites were found in a registry or an index.
Augmented Neural ODEs
Open accessAbstract
We show that Neural Ordinary Differential Equations (ODEs) learn representations that preserve the topology of the input space and prove that this implies the existence of functions Neural ODEs cannot represent. To address these limitations, we introduce Augmented Neural ODEs which, in addition to being more expressive models, are empirically more stable, generalize better and have a lower computational cost than Neural ODEs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The empirical forgetting rate exhibits the predicted inverse square-root relationship with capacity, following ε_observed(C) ≈ 0.68·C^-0.48, which closely approximates the theoretical C^-0.5 dependence.
“The empirical forgetting rate exhibits the predicted inverse square-root relationship with capacity, following:”
From Mitigating catastrophic forgetting in lifelong learning: a hybrid architecture integrating neural ordinary differential equations with memory-augmented transformers (2025) · cites this paper as [23]
The Neural ODE and Scaling sections compare augmented and standard neural ODEs on loss, computational cost, and parameter efficiency; they do not report a forgetting rate. Searches for “forgetting rate,” the coefficients 0.68 and 0.48, and inverse-square-root capacity scaling found no passage supporting the claimed relationship. (LLM, conf=0.77)
Experimental — accuracy not yet measuredNeural ODEs offer theoretical support for mitigating catastrophic forgetting through their continuous parameter space and trajectory-based representations, which enable gradual knowledge integration rather than abrupt parameter shifts.
“From a lifelong learning perspective, neural ODEs offer theoretical support for mitigating catastrophic forgetting through their continuous parameter space and trajectory-based representations, which enable gradual knowledge integration rather than abrupt parameter shifts23.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Flagged first, then by citations
Research works printed but not linked: 19
- Shair Ahmad and Antonio Ambrosetti. A Textbook on Ordinary Differential Equations, volume 88. Springer, 2015.
- Lynton Ardizzone, Jakob Kruse, Sebastian Wirkert, Daniel Rahner, Eric W Pellegrini, Ralf S Klessen, Lena Maier-Hein, Carsten Rother, and Ullrich Köthe. Analyzing inverse problems with invertible neural networks. arXiv preprint arXiv:1808.04730, 2018. · arXiv
- Mark Anthony Armstrong. Basic Topology. Springer Science & Business Media, 2013.
- Jens Behrmann, David Duvenaud, and Jörn-Henrik Jacobsen. Invertible residual networks. arXiv preprint arXiv:1811.00995, 2018. · arXiv
- Tian Qi Chen, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. Neural ordinary differential equations. In 32nd Conference on Neural Information Processing Systems, 2018.
- Earl A Coddington and Norman Levinson. Theory of Ordinary Differential Equations. Tata McGraw- Hill Education, 1955.
- Laurent Dinh, Jascha Sohl-Dickstein, and Samy Bengio. Density estimation using real nvp. arXiv preprint arXiv:1605.08803, 2016. · arXiv
- Will Grathwohl, Ricky TQ Chen, Jesse Betterncourt, Ilya Sutskever, and David Duvenaud. Ffjord: Free-form continuous dynamics for scalable reversible generative models. arXiv preprint arXiv:1810.01367, 2018. · arXiv
- Eldad Haber and Lars Ruthotto. Stable architectures for deep neural networks. Inverse Problems, 34 (1):014004, 2017.
- Durk P Kingma and Prafulla Dhariwal. Glow: Generative flow with invertible 1x1 convolutions. In Advances in Neural Information Processing Systems, pp. 10215-10224, 2018.
- Hongzhou Lin and Stefanie Jegelka. Resnet with one-neuron hidden layers is a universal approximator. In 32nd Conference on Neural Information Processing Systems, 2018.
- Yiping Lu, Aoxiao Zhong, Quanzheng Li, and Bin Dong. Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations. arXiv preprint arXiv:1710.10121, 2017. · arXiv
- George Papamakarios, Theo Pavlakou, and Iain Murray. Masked autoregressive flow for density estimation. In Advances in Neural Information Processing Systems, pp. 2338-2347, 2017.
- Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. Scikit-learn: Machine learning in python. Journal of machine learning research, 12(Oct):2825-2830, 2011.
- Lars Ruthotto and Eldad Haber. Deep neural networks motivated by partial differential equations. arXiv preprint arXiv:1804.04272, 2018. · arXiv
- Bao Wang, Binjie Yuan, Zuoqiang Shi, and Stanley J Osher. Enresnet: Resnet ensemble via the Feynman-Kac formalism. arXiv preprint arXiv:1811.10745, 2018. · arXiv
- E Weinan. A proposal on machine learning via dynamical systems. Communications in Mathematics and Statistics, 5(1):1-11, 2017.
- Saining Xie, Ross Girshick, Piotr Dollár, Zhuowen Tu, and Kaiming He. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1492-1500, 2017.
- Laurent Younes. Shapes and Diffeomorphisms, volume 171. Springer Science & Business Media, 2010.
Cited by
Sorted by citations
Barbieri, S., Kemp, J., Perez-Concha, O., Kotwal, S., Gallagher, M., Ritchie, A., & Jorm, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-58053-z · Cited by 86
Zhou, S., & Li, Q. (2025) · Scientific Reports · doi:10.1038/s41598-025-31685-9
Metadata
- Authors
- Dupont, E., Doucet, A., & Teh, Y. W.
- Affiliations
- University of Oxford (GB)
- ORCID
- Teh, Yee Whye
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2019
- Volume
- 32
- Pages
- 3134-3144
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1904.01681
- OpenAlex
- W2926003515
- Cited by
- 285
- References
- 2
- Citations by year
- 2026: 15 · 2025: 36 · 2024: 57 · 2023: 42 · 2022: 39 · 2021: 54 · 2020: 26 · 2019: 16
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- U.S. Department of Defense
- DeepMind
- European Commission
- Defence Science and Technology Laboratory (EP/R013616/1)
- Multidisciplinary University Research Initiative
- Engineering and Physical Sciences Research Council (EP/R013616/1)
- Office of Defense Programs
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Physical Sciences › Mathematics › Numerical Analysis › Numerical Solvers for Ordinary Differential Equations
- Keywords
- neural ordinary differential equations, model expressiveness, training stability, generalization, computational cost
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
