The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.
A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
Open accessAbstract
This paper takes a step towards temporal reasoning in a dynamically changing video, not in the pixel space that constitutes its frames, but in a latent space that describes the non-linear dynamics of the objects in its world. We introduce the Kalman variational auto-encoder, a framework for unsupervised learning of sequential data that disentangles two latent representations: an object's representation, coming from a recognition model, and a latent state describing its dynamics. As a result, the evolution of the world can be imagined and missing data imputed, both without the need to generate high dimensional frames at each time step. The model is trained end-to-end on videos of a variety of simulated physical systems, and outperforms competing methods in generative and missing data imputation tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The hippocampal system and machine learning architectures that attempt to reproduce its functioning afford spatiotemporal trajectories.
“as afforded by the hippocampal system and machine learning architectures that attempt to reproduce its functioning”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Fraccaro et al., 2017
According to IWMT, coherent self-world modeling likely requires organizing information into spatiotemporal trajectories.
“According to IWMT, coherent self-world modeling likely also requires organizing this information into spatiotemporal trajectories”
From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Fraccaro et al., 2017
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
‘What’ and ‘where’ in the human brain
Ungerleider, L. G., & Haxby, J. V. (1994) · Current Opinion in Neurobiology · doi:10.1016/0959-4388(94)90066-3 · Cited by 1,913 · cited 1×
“nnis ball, we can imagine its trajectory, and prepare ourselves in advance to catch it. Although the act of recognising the tennis ball is seemingly independent of our intuition of Newtonian dynamics [31], very little of this assumption has yet been captured in the end-to-end models that presently mark the path toward…”
Background
Flagged first, then by citations
Cited by
Sorted by citations
Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Turkmen, C., Gasthaus, J., Bohlke-Schneider, M., Salinas, D., Stella, L., et al. (2023) · ACM Computing Surveys · doi:10.1145/3533382 · Cited by 382
Stochastic latent actor–critic: Deep reinforcement learning with a latent variable model
Lee, A. X., Nagabandi, A., Abbeel, P., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1907.00953 · Cited by 159
Safron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133
“…into spatiotemporal trajectories, as afforded by the hippocampal system and machine learning architectures that attempt to reproduce its functioning (Fraccaro et al., 2017; Ha and Schmidhuber, 2018; Whittington et al., 2018; Wu et al., 2018), and as suggested by impaired counterfactual modeling…”
Background
Metadata
- Authors
- Fraccaro, M., Kamronn, S., Paquet, U., & Winther, O.
- Affiliations
- Technical University of Denmark (DK)
- Alphabet (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- Volume
- 30
- Pages
- 3601-3610
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1710.05741
- OpenAlex
- W2751471435
- Cited by
- 229
- References
- 3
- Citations by year
- 2025: 8 · 2024: 20 · 2023: 25 · 2022: 36 · 2021: 45 · 2020: 49 · 2019: 35 · 2018: 10 · 2017: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- disentangled representations, unsupervised learning, nonlinear dynamics, latent space, temporal reasoning, video, missing data imputation, generative models, object recognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
