The DOI matches its DataCite record; 50 of the 55 references it cites were found in a registry or an index.
Neural Ordinary Differential Equations
Open accessAbstract
We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a black-box differential equation solver. These continuous-depth models have constant memory cost, adapt their evaluation strategy to each input, and can explicitly trade numerical precision for speed. We demonstrate these properties in continuous-depth residual networks and continuous-time latent variable models. We also construct continuous normalizing flows, a generative model that can train by maximum likelihood, without partitioning or ordering the data dimensions. For training, we show how to scalably backpropagate through any ODE solver, without access to its internal operations. This allows end-to-end training of ODEs within larger models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Compared to well-known deep learning models like ResNet and U-Net, neural ODE models are more efficient in terms of memory and parameters.”
From A review of deep learning-based deformable medical image registration (2022) · cites this paper as [163]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, the dynamics of optimization are naturally continuous.”
From A review of deep learning-based deformable medical image registration (2022) · cites this paper as [163]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When the score function is approximated by the time-dependent score-based model, which is typically a neural network, this is an example of a neural ODE (Chen et al., 2018).”
From Score-Based Generative Modeling through Stochastic Differential Equations (2020) · cites this paper as Chen et al., 2018
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Neural ODE models have the advantage of adaptive computing, making them potentially appropriate for application in medical applications.”
From A review of deep learning-based deformable medical image registration (2022) · cites this paper as [163]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
(2017) · Cited by 11,625
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Theory of Ordinary Differential Equations
Coddington, E. A., Levinson, N., & Teichmann, T. (1956) · Physics Today · doi:10.1063/1.3059875 · Cited by 6,221
The Mathematical Theory of Optimal Processes
Bellman, R., Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., Mishchenko, E. F., Trirogoff, Κ. N., & Neustadt, L. W. (1965) · Econometrica · doi:10.2307/1911909 · Cited by 4,212
CasADi: a software framework for nonlinear optimization and optimal control
Andersson, J. A. E., Gillis, J., Horn, G., Rawlings, J. B., & Diehl, M. (2018) · Mathematical Programming Computation · doi:10.1007/s12532-018-0139-4 · Cited by 4,200
Solving ordinary differential equations I. nonstiff problems
Hairer, E., Nørsett, S. P., & Wanner, G. (1987) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(87)90083-8 · Cited by 4,077
Research works printed but not linked: 8
- Brandon Amos and J Zico Kolter. OptNet: Differentiable optimization as a layer in neural networks. In International Conference on Machine Learning , pages 136-145, 2017.
- David Ha, Andrew Dai, and Quoc V Le. Hypernetworks. arXiv preprint arXiv:1609.09106 , 2016. · arXiv
- Zachary C Lipton, David Kale, and Randall Wetzel. Directly modeling missing data in sequences with RNNs: Improved classification of clinical time series. In Proceedings of the 1st Machine Learning for Healthcare Conference , volume 56 of Proceedings of Machine Learning Research , pages 253270. PMLR, 18-19 Aug 2016. URL http://proceedings.mlr.press/v56/Lipton16.html .
- Yiping Lu, Aoxiao Zhong, Quanzheng Li, and Bin Dong. Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations. arXiv preprint arXiv:1710.10121 , 2017. · arXiv
- Dougal Maclaurin, David Duvenaud, and Ryan P Adams. Autograd: Reverse-mode differentiation of native Python. In ICML workshop on Automatic Machine Learning , 2015.
- Danilo Jimenez Rezende and Shakir Mohamed. Variational inference with normalizing flows. arXiv preprint arXiv:1505.05770 , 2015. · arXiv
- Hossein Soleimani, James Hensman, and Suchi Saria. Scalable joint models for reliable uncertaintyaware event prediction. IEEE transactions on pattern analysis and machine intelligence , 2017a.
- Jos Stam. Stable fluids. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques , pages 121-128. ACM Press/Addison-Wesley Publishing Co., 1999.
Cited by
Sorted by citations
Denoising Diffusion Probabilistic Models
Ho, J., Jain, A., & Abbeel, P. (2020) · arXiv · doi:10.48550/arxiv.2006.11239 · Cited by 8,712
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Sherstinsky, A. (2020) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2019.132306 · Cited by 5,680
Denoising Diffusion Implicit Models
Song, J., Meng, C., & Ermon, S. (2020) · arXiv · doi:10.48550/arxiv.2010.02502 · Cited by 2,507
RoFormer: Enhanced transformer with rotary position embedding
Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957
Score-Based Generative Modeling through Stochastic Differential Equations
Song, Y., Sohl-Dickstein, J., Kingma, D. P., Kumar, A., Ermon, S., & Poole, B. (2020) · arXiv · doi:10.48550/arxiv.2011.13456 · Cited by 1,953
Time-series forecasting with deep learning: a survey
Lim, B. Y., & Zohren, S. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0209 · Cited by 2,242
Diffusion Models: A Comprehensive Survey of Methods and Applications
Yang, L., Zhang, Z., Song, Y., Hong, S., Xu, R., Zhao, Y., Zhang, W., Cui, B., & Yang, M.-H. (2024) · ACM Computing Surveys · doi:10.1145/3626235 · Cited by 1,704
Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing
Monga, V., Li, Y., & Eldar, Y. C. (2021) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.3016905 · Cited by 1,589
Hu, X., Xu, L., Lin, X., & Pecht, M. (2020) · Joule · doi:10.1016/j.joule.2019.11.018 · Cited by 1,320
Normalizing Flows: An Introduction and Review of Current Methods
Kobyzev, I., Prince, S. J. D., & Brubaker, M. A. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2992934 · Cited by 1,516
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M. S., & Kumar, V. (2022) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 1,498
Spatial-Temporal Graph ODE Networks for Traffic Flow Forecasting
Fang, Z., Long, Q., Song, G., & Xie, K. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467430 · Cited by 727
PointFlow: 3D Point Cloud Generation With Continuous Normalizing Flows
Yang, G., Huang, X., Hao, Z., Liu, M.-Y., Belongie, S., & Hariharan, B. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00464 · Cited by 656
Universal Differential Equations for Scientific Machine Learning
Rackauckas, C., Ma, Y., Martensen, J., Warner, C., Zubov, K., Supekar, R., Skinner, D., Ramadhan, A., & Edelman, A. (2020) · doi:10.21203/rs.3.rs-55125/v1 · Cited by 643
Diffusion Probabilistic Models for 3D Point Cloud Generation
Luo, S., & Hu, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00286 · Cited by 726
Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey
Jin, G., Liang, Y., Fang, Y., Shao, Z., Huang, J., Zhang, J., & Zheng, Y. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3333824 · Cited by 692
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
On Interpretability of Artificial Neural Networks: A Survey
Fan, F., Xiong, J., Li, M., & Wang, G. (2021) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2021.3066428 · Cited by 607
A Survey on Generative Diffusion Models
Cao, H., Tan, C., Gao, Z., Xu, Y., Chen, G., Heng, P., & Li, S. Z. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3361474 · Cited by 834
PDE-Net 2.0: Learning PDEs from data with a numeric-symbolic hybrid deep network
Long, Z., Lu, Y., & Dong, B. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.108925 · Cited by 552
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and GaugesPreprint
Bronstein, M. M., Bruna, J., Cohen, T., & Veličković, P. (2021) · arXiv (Cornell University) · doi:10.4230/oasics.dx.2026.1 · Cited by 2,094
Hamiltonian Neural NetworksPreprint
Greydanus, S., Dzamba, M., & Yosinski, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01563 · Cited by 657
Machine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 576
Machine learning and artificial intelligence to aid climate change research and preparedness
Huntingford, C., Jeffers, E. S., Bonsall, M. B., Christensen, H. M., Lees, T., & Yang, H. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/ab4e55 · Cited by 469
FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models
Grathwohl, W., Chen, R. T. Q., Bettencourt, J., Sutskever, I., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1810.01367 · Cited by 796
Self-citationArtificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 411
Deep learning of vortex-induced vibrationsPreprint
Raissi, M., Wang, Z., Triantafyllou, M. S., & Karniadakis, G. E. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 361
Hasani, R., Lechner, M., Amini, A., Rus, D. L., & Grosu, R. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16936 · Cited by 373
A-ViT: Adaptive Tokens for Efficient Vision Transformer
Yin, H., Vahdat, A., Alvarez, J. M., Mallya, A., Kautz, J., & Molchanov, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01054 · Cited by 360
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 465
Physics-Informed Neural Networks for Power Systems
Misyris, G. S., Venzke, A., & Chatzivasileiadis, S. (2020) · IEEE Power Engineering Society General Meeting · doi:10.1109/pesgm41954.2020.9282004 · Cited by 358
Neural circuit policies enabling auditable autonomy
Lechner, M., Hasani, R., Amini, A., Henzinger, T. A., Rus, D. L., & Grosu, R. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00237-3 · Cited by 330
Cheng, S. L., Quilodrán-Casas, C., Ouala, S., Farchi, A., Liu, C., Tandeo, P., Fablet, R., Lucor, D., Iooss, B., Brajard, J., et al. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123537 · Cited by 351
DeepFake Detection for Human Face Images and Videos: A Survey
Malik, A., Kuribayashi, M., Abdullahi, S. M., & Khan, A. N. (2022) · IEEE Access · doi:10.1109/access.2022.3151186 · Cited by 297
Data driven governing equations approximation using deep neural networks
Qin, T., Wu, K., & Xiu, D. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.06.042 · Cited by 283
Combustion machine learning: Principles, progress and prospects
Ihme, M., Chung, W. T., & Mishra, A. (2022) · Progress in Energy and Combustion Science · doi:10.1016/j.pecs.2022.101010 · Cited by 300
A Survey on Safety-Critical Driving Scenario Generation—A Methodological Perspective
Ding, W., Xu, C., Arief, M., Lin, H., Li, B., & Zhao, D. X. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3259322 · Cited by 320
Faroughi, S. A., Pawar, N. M., Fernandes, C. B. P., Raissi, M., Das, S., Kalantari, N. K., & Mahjour, S. K. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 430
Liu, Y., Yang, Z., Yu, Z., Liu, Z., Liu, D., Lin, H., Li, M., Ma, S., Avdeev, M., & Shi, S. (2023) · Journal of Materiomics · doi:10.1016/j.jmat.2023.05.001 · Cited by 294
Occupancy Flow: 4D Reconstruction by Learning Particle Dynamics
Niemeyer, M., Mescheder, L., Oechsle, M., & Geiger, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00548 · Cited by 247
Perspectives on the integration between first-principles and data-driven modeling
Bradley, W., Kim, J., Kilwein, Z., Blakely, L., Eydenberg, M., Jalvin, J., Laird, C., & Boukouvala, F. (2022) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2022.107898 · Cited by 231
Structural identification with physics-informed neural ordinary differential equations
Lai, Z., Mylonas, C., Nagarajaiah, S., & Chatzi, E. (2021) · Journal of Sound and Vibration · doi:10.1016/j.jsv.2021.116196 · Cited by 238
Kim, Y., Choi, Y., Widemann, D. P., & Zohdi, T. I. (2021) · Journal of Computational Physics · doi:10.1016/j.jcp.2021.110841 · Cited by 271
Neural Radiance Flow for 4D View Synthesis and Video Processing
Du, Y., Zhang, Y., Yu, H.-X., Tenenbaum, J. B., & Wu, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01406 · Cited by 225
Countering Malicious DeepFakes: Survey, Battleground, and Horizon
Juefei-Xu, F., Wang, R., Huang, Y., Guo, Q., Ma, L., & Liu, Y. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01606-8 · Cited by 191
Transformers for modeling physical systems
Geneva, N., & Zabaras, N. J. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.11.022 · Cited by 228
A deep learning enabler for nonintrusive reduced order modeling of fluid flows
Pawar, S. A., Rahman, S. M., Vaddireddy, H., San, O., Rasheed, A., & Vedula, P. (2019) · Physics of Fluids · doi:10.1063/1.5113494 · Cited by 183
SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems
Jin, P., Zhang, Z., Zhu, A., Tang, Y., & Karniadakis, G. E. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.08.017 · Cited by 234
Multivariate Time Series Forecasting With Dynamic Graph Neural ODEs
Jin, M., Zheng, Y., Li, Y.-F., Chen, S., Yang, B., & Pan, S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3221989 · Cited by 200
Bridging observations, theory and numerical simulation of the ocean using machine learning
Sonnewald, M., Lguensat, R., Jones, D. C., Dueben, P. D., Brajard, J., & Balaji, V. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/ac0eb0 · Cited by 200
Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
Rudy, S., Kutz, J. N., & Brunton, S. L. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.06.056 · Cited by 180
Neumann Networks for Linear Inverse Problems in Imaging
Gilton, D., Ongie, G., & Willett, R. M. (2019) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2019.2948732 · Cited by 193
Chen, J., Liu, Y., Wei, S., Bian, Z., Subramanian, S., Carass, A., Prince, J. L., & Du, Y. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103385 · Cited by 209
A Selective Overview of Deep Learning
Fan, J., Ma, C., & Zhong, Y. (2021) · Statistical Science · doi:10.1214/20-sts783 · Cited by 203
Gehrig, D., Rüegg, M., Gehrig, M., Hidalgo‐Carrió, J., & Scaramuzza, D. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3060707 · Cited by 182
MotionDiffuser: Controllable Multi-Agent Motion Prediction Using Diffusion
Jiang, C. M., Cornman, A., Park, C., Sapp, B., Zhou, Y., & Anguelov, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00930 · Cited by 208
An artificial neural network framework for reduced order modeling of transient flows
San, O., Maulik, R., & Ahmed, M. (2019) · Communications in Nonlinear Science and Numerical Simulation · doi:10.1016/j.cnsns.2019.04.025 · Cited by 170
Variational Graph Neural Networks for Road Traffic Prediction in Intelligent Transportation Systems
Zhou, F., Yang, Q., Zhong, T., Chen, D., & Zhang, N. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3009280 · Cited by 174
Deep Equilibrium Architectures for Inverse Problems in Imaging
Gilton, D., Ongie, G., & Willett, R. M. (2021) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2021.3118944 · Cited by 167
Kashefi, A., & Mukerji, T. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111510 · Cited by 164
Applications of artificial intelligence/machine learning to high-performance composites
Wang, Y., Wang, K., & Zhang, C. (2024) · Composites Part B Engineering · doi:10.1016/j.compositesb.2024.111740 · Cited by 177
Stiff neural ordinary differential equations
Kim, S., Ji, W., Deng, S., Ma, Y., & Rackauckas, C. (2021) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/5.0060697 · Cited by 160
Algorithms for solving high dimensional PDEs: from nonlinear Monte Carlo to machine learning
Weinan, E., Han, J., & Jentzen, A. (2021) · Nonlinearity · doi:10.1088/1361-6544/ac337f · Cited by 161
Spatiotemporal data mining: a survey on challenges and open problems
Hamdi, A., Shaban, K. B., Erradi, A., Mohamed, A. M. S., Rumi, S. K., & Salim, F. D. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09994-y · Cited by 174
A tutorial review of neural network modeling approaches for model predictive control
Ren, Y. M., Alhajeri, M. S., Luo, J., Chen, S., Abdullah, F., Wu, Z., & Christofides, P. D. (2022) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2022.107956 · Cited by 164
Zhou, W., Kamata, S., Wang, H., Wong, M. S., & Hou, H. C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128751 · Cited by 151
Learning Dynamic Alignment via Meta-filter for Few-shot Learning
Xu, C., Fu, Y., Liu, C., Wang, C., Li, J., Huang, F., Zhang, L., & Xue, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00514 · Cited by 145
Wessels, H., Weißenfels, C., & Wriggers, P. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113127 · Cited by 152
Data Learning: Integrating Data Assimilation and Machine Learning
Buizza, C., Quilodrán-Casas, C., Nadler, P., Mack, J., Marrone, S., Titus, Z., Cornec, C. M. A. L., Heylen, E., Dur, T. H., Ruiz, L. G. B., et al. (2021) · Journal of Computational Science · doi:10.1016/j.jocs.2021.101525 · Cited by 142
A Survey on Large-Scale Machine Learning
Wang, M., Fu, W., He, X., Hao, S., & Wu, X. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3015777 · Cited by 158
CTAB-GAN+: enhancing tabular data synthesis
Zhao, Z., Kunar, A., Birke, R., der Scheer, H. V., & Chen, L. Y. (2024) · Frontiers in Big Data · doi:10.3389/fdata.2023.1296508 · Cited by 139
Raissi, M., Yazdani, A. Z. K., & Karniadakis, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04327 · Cited by 139
Medical digital twins: enabling precision medicine and medical artificial intelligence
Sadée, C., Testa, S., Barba, T., Hartmann, K., Schuessler, M., Thieme, A. H., Church, G. M., Okoye, I. J., Hernandez‐Boussard, T., Hood, L., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.02.004 · Cited by 167
On learning Hamiltonian systems from data
Bertalan, T., Dietrich, F., Mezić, I., & Kevrekidis, I. G. (2019) · Chaos An Interdisciplinary Journal of Nonlinear Science · doi:10.1063/1.5128231 · Cited by 136
Enhanced Sampling with Machine Learning
Mehdi, S., Smith, Z., Herron, L., Zou, Z., & Tiwary, P. (2024) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-083122-125941 · Cited by 164
Constructing Neural Network Based Models for Simulating Dynamical Systems
Legaard, C. M., Schranz, T., Schweiger, G., Drgoňa, J., Falay, B., Gomes, C. Â. G., Iosifidis, A., Abkar, M., & Larsen, P. G. (2022) · ACM Computing Surveys · doi:10.1145/3567591 · Cited by 159
Temporal Knowledge Graph Completion: A Survey
Cai, B., Xiang, Y., Gao, L., Zhang, H., Li, Y., & Li, J. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/734 · Cited by 133
Yao.jl: Extensible, Efficient Framework for Quantum Algorithm Design
Luo, X.-Z., Liu, J.-G., Zhang, P., & Wang, L. (2020) · Quantum · doi:10.22331/q-2020-10-11-341 · Cited by 157
do Nascimento, R. G., Fricke, K., & Viana, F. A. C. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103996 · Cited by 142
EDICT: Exact Diffusion Inversion via Coupled Transformations
Wallace, B., Gokul, A., & Naik, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02158 · Cited by 179
Machine Learning in Pharmacometrics: Opportunities and Challenges
McComb, M., Bies, R., & Ramanathan, M. (2022) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.14801 · Cited by 128
Dourado, A. D. P., & Viana, F. A. C. (2020) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4047173 · Cited by 130
Yuan, B., Shen, C., Luna, A., Korkut, A., Marks, D. S., Ingraham, J., & Sander, C. (2020) · Cell Systems · doi:10.1016/j.cels.2020.11.013 · Cited by 125
Lu, J. J.-Q., Deng, K., Zhang, X., Liu, G., & Guan, Y. (2021) · iScience · doi:10.1016/j.isci.2021.102804 · Cited by 141
BarrierNet: Differentiable Control Barrier Functions for Learning of Safe Robot Control
Xiao, W., Wang, T.-H. J., Hasani, R., Chahine, M., Amini, A., Li, X., & Rus, D. L. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2023.3249564 · Cited by 143
Time-series learning of latent-space dynamics for reduced-order model closure
Maulik, R., Mohan, A. T., Lusch, B., Madireddy, S., Balaprakash, P., & Livescu, D. (2020) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2020.132368 · Cited by 125
Why Should We Add Early Exits to Neural Networks?
Scardapane, S., Scarpiniti, M., Baccarelli, E., & Uncini, A. (2020) · Cognitive Computation · doi:10.1007/s12559-020-09734-4 · Cited by 125
Scientific AI in materials science: a path to a sustainable and scalable paradigm
DeCost, B., Hattrick-Simpers, J. R., Trautt, Z., Kusne, A. G., Campo, E. M., & Green, M. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ab9a20 · Cited by 131
Bhowmik, A., Castelli, I. E., García-Lastra, J. M., Jørgensen, P. B., Winther, O., & Vegge, T. (2019) · Energy storage materials · doi:10.1016/j.ensm.2019.06.011 · Cited by 122
How to train your neural ODE: the world of Jacobian and kinetic regularizationPreprint
Finlay, C., Jacobsen, J.-H., Nurbekyan, L., & Oberman, A. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02798 · Cited by 120
ChemNODE: A neural ordinary differential equations framework for efficient chemical kinetic solvers
Owoyele, O., & Pal, P. (2021) · Energy and AI · doi:10.1016/j.egyai.2021.100118 · Cited by 118
Ma, Y., Dixit, V., Innes, M., Guo, X., & Rackauckas, C. (2021) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec49654.2021.9622796 · Cited by 117
NeuralSim: Augmenting Differentiable Simulators with Neural Networks
Heiden, E., Millard, D., Coumans, E., Sheng, Y., & Sukhatme, G. S. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560935 · Cited by 137
Deep generative modeling for protein design
Strokach, A. V., & Kim, P. M. (2021) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.11.008 · Cited by 122
Machine learning on neutron and x-ray scattering and spectroscopies
Chen, Z., Andrejevic, N., Drucker, N. C., Nguyen, T., Xian, R. P., Smidt, T., Wang, Y., Ernstorfer, R., Tennant, D. M., Chan, M. K. Y., et al. (2021) · Chemical Physics Reviews · doi:10.1063/5.0049111 · Cited by 121
Fatigue damage characterization for composite laminates using deep learning and laser ultrasonic
Tao, C., Zhang, C., Ji, H., & Qiu, J. (2021) · Composites Part B Engineering · doi:10.1016/j.compositesb.2021.108816 · Cited by 116
Data-driven prediction in dynamical systems: recent developments
Ghadami, A., & Epureanu, B. I. (2022) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2021.0213 · Cited by 129
Augmenting physical models with deep networks for complex dynamics forecasting*
Yin, Y., Guen, V. L., Donà, J., de Bézenac, E., Ayed, I., Thome, N., & Gallinari, P. (2021) · Journal of Statistical Mechanics Theory and Experiment · doi:10.1088/1742-5468/ac3ae5 · Cited by 125
Virtual brain twins: from basic neuroscience to clinical use
Wang, H., Triebkorn, P., Breyton, M., Dollomaja, B., Lemaréchal, J.-D., Petkoski, S., Sorrentino, P., Depannemaecker, D., Hashemi, M., & Jirsa, V. (2024) · National Science Review · doi:10.1093/nsr/nwae079 · Cited by 127
Assessment of unsteady flow predictions using hybrid deep learning based reduced-order models
Bukka, S. R., Gupta, R., Magee, A., & Jaiman, R. K. (2021) · Physics of Fluids · doi:10.1063/5.0030137 · Cited by 118
Metadata
- Authors
- Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D.
- Affiliations
- University of Toronto (CA)
- ORCID
- Rubanova, Yulia
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- Volume
- 31
- Pages
- 6572-6583
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1806.07366
- OpenAlex
- W2808746463
- Cited by
- 2,097
- References
- 55
- Citations by year
- 2026: 38 · 2025: 370 · 2024: 509 · 2023: 387 · 2022: 258 · 2021: 297 · 2020: 153 · 2019: 76 · 2018: 8
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Mathematics › Numerical Analysis › Numerical Solvers for Ordinary Differential Equations
- Keywords
- neural ordinary differential equations, continuous-time neural networks, continuous normalizing flows, ResNet, memory-efficient neural networks, generative models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
