Learning Weighted Submanifolds With Variational Autoencoders and Riemannian Variational Autoencoders
Open accessAbstract
Manifold-valued data naturally arises in medical imaging. In cognitive neuroscience for instance, brain connectomes base the analysis of coactivation patterns between different brain regions on the analysis of the correlations of their functional Magnetic Resonance Imaging (fMRI) time series - an object thus constrained by construction to belong to the manifold of symmetric positive definite matrices. One of the challenges that naturally arises in these studies consists in finding a lower-dimensional subspace for representing such manifold-valued and typically high-dimensional data. Traditional techniques, like principal component analysis, are ill-adapted to tackle non-Euclidean spaces and may fail to achieve a lower-dimensional representation of the data - thus potentially pointing to the absence of lower-dimensional representation of the data. However, these techniques are restricted in that: (i) they do not leverage the assumption that the connectomes belong on a pre-specified manifold, therefore discarding information; (ii) they can only fit a linear subspace to the data. In this paper, we are interested in variants to learn potentially highly curved submanifolds of manifold-valued data. Motivated by the brain connectomes example, we investigate a latent variable generative model, which has the added benefit of providing us with uncertainty estimates - a crucial quantity in the medical applications we are considering. While latent variable models have been proposed to learn linear and nonlinear spaces for Euclidean data, or geodesic subspaces for manifold data, no intrinsic latent variable model exists to learn non-geodesic subspaces for manifold data. This paper fills this gap and formulates a Riemannian variational autoencoder with an intrinsic generative model of manifold-valued data. We evaluate its performances on synthetic and real datasets, by introducing the formalism of weighted Riemannian submanifolds.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In 2020, Lee and Lee [648] used GraphCNN and GAN with an Uncertainty-Aware Mesh Decoder for 3D face reconstruction on CASIA-Webface, COMA, 300W-LP, CelebA, and AFLW2000-3D.
“Lee and Lee [648] | | 2020 | CASIA- Webface, COMA, 300W-LP, CelebA, AFLW2000- 3D | 3D face reconstruc- tion | CASIA-Webface: 494k images, COMA: 20,000 different meshes for 12 various subjects, 300W-LP: 60k | N/A | GraphCNN and GAN | Uncertainty- Aware Mesh Dec”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [648]
Section 2.2.3 introduces a Riemannian variational autoencoder, not a GraphCNN/GAN mesh decoder. Section 7 reports experiments on brain connectomes from the Human Connectome Project, rather than 3D face reconstruction on the listed datasets. No page numbers are available in our copy. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · see citing works
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965 · see citing works
LIII. On lines and planes of closest fit to systems of points in space
Karl Pearson, F. R. S. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 13,658 · see citing works
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · see citing works
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A. J., & Müller, K. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,121 · see citing works
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,822 · see citing works
The WU-Minn Human Connectome Project: An overview
Van Essen, D. C., Smith, S. M., Barch, D. M., Behrens, T. E. J., Yacoub, E., & Ugurbil, K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.041 · Cited by 5,651 · see citing works
Probabilistic Principal Component Analysis
Tipping, M. E., & Bishop, C. M. (1999) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00196 · Cited by 3,679 · see citing works
Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data
Donoho, D. L., & Grimes, C. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1031596100 · Cited by 1,704 · see citing works
Hastie, T., & Stuetzle, W. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478797 · Cited by 940 · see citing works
Principal Geodesic Analysis for the Study of Nonlinear Statistics of Shape
Fletcher, P. T., Lu, C., Pizer, S. M., & Joshi, S. C. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.831793 · Cited by 790 · see citing works
Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements
Pennec, X. (2006) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-006-6228-4 · Cited by 752 · see citing works
Tolstikhin, I., Bousquet, O., Gelly, S., & Schölkopf, B. (2018) · MPG.PuRe (Max Planck Society) · Cited by 602 · see citing works
Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching
Bronstein, A. M., Bronstein, M. M., & Kimmel, R. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0508601103 · Cited by 555 · see citing works
Classification of covariance matrices using a Riemannian-based kernel for BCI applications
Barachant, A., Bonnet, S., Congedo, M., & Jutten, C. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.039 · Cited by 493 · see citing works
An introduction to nonlinear dimensionality reduction by maximum variance unfolding
Weinberger, K. Q., & Saul, L. K. (2006) · Cited by 243 · see citing works
INTRINSIC SHAPE ANALYSIS: GEODESIC PCA FOR RIEMANNIAN MANIFOLDS MODULO ISOMETRIC LIE GROUP ACTIONS
Huckemann, S., Hotzand, T., Munk, A., et al. (2007) · GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) · Cited by 137 · see citing works
The Riemannian Geometry of Deep Generative Models
Shao, H., Kumar, A., & Fletcher, P. T. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00071 · Cited by 131 · see citing works
C&H/CRC Monographs on Statistics & Applied Probability
(2010) · Monographs on statistics and applied probability · doi:10.1201/chmonstaapp · Cited by 125 · see citing works
A unified model for probabilistic principal surfaces
Chang, K., & Ghosh, J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.899944 · Cited by 112 · see citing works
Barycentric subspace analysis on manifolds
Pennec, X. (2018) · The Annals of Statistics · doi:10.1214/17-aos1636 · Cited by 70 · see citing works
Probabilistic Principal Geodesic Analysis
Zhang, M., & Fletcher, P. T. (2013) · neural information processing systems · Cited by 57 · see citing works
Principal Curves on Riemannian Manifolds
Hauberg, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2496166 · Cited by 46 · see citing works
Optimization over geodesics for exact principal geodesic analysis
Sommer, S., Lauze, F., & Nielsen, M. (2013) · Advances in Computational Mathematics · doi:10.1007/s10444-013-9308-1 · Cited by 43 · see citing works
Panaretos, V. M., Pham, T. T., & Yao, Z. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.849199 · Cited by 26 · see citing works
Flagged first, then by citations
Research works printed but not linked: 9
- Nikolai Chernov. Circular and linear regression : fitting circles and lines by least squares. Monographs on statistics and applied probability. CRC Press/Taylor & Francis, Boca Raton, 2011. 6
- Trevor Cox and Michael Cox. Multidimensional Scaling. Springer h edition, 2000. 2
- Diederik P. Kingma and Max Welling. Auto-Encoding Vari- ational Bayes. In Proceedings of the 2nd International Con- ference on Learning Representations (ICLR), 2014. 2, 3
- N. Miolane, A. Le Brigant, B. Hou, C. Donnat, M. Jorda, J. Mathe, X. Pennec, and S. Holmes. Geomstats: a python module for computations and statistics on manifolds. Sub- mitted to JMLR, 2019. 6
- Victor M. Panaretos, Tung Pham, and Zhigang Yao. Princi- pal flows. Journal of the American Statistical Association, 109(505):424-436, 2014. 2
- Mikhail Postnikov. Riemannian Geometry. Encyclopaedia of Mathem. Sciences. Springer, 2001. 6
- Danilo J Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. In Proceedings of the 31st Inter- national Conference on Machine Learning, 2014. 3
- Michael E Tipping and Christopher M Bishop. Probabilis- tic Principal Component Analysis. Source: Journal of the Royal Statistical Society. Series B (Statistical Methodology), 61(3):611-622, 1999. 2, 6
- Miaomiao Zhang and P. Thomas Fletcher. Probabilistic prin- cipal geodesic analysis. Advances in Neural Information Processing Systems, pages 1-9, 2013. 2, 4
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 2,720 · see citing works
- Authors
- Miolane, N., & Holmes, S.
- Affiliations
- Stanford University (US)
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 14491-14499
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2990349966
- Cited by
- 16
- References
- 25
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 2 · 2022: 5 · 2021: 3 · 2020: 2
- FWCI
- 1.13
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Topological and Geometric Data Analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Keywords
- manifold-valued data, brain connectome, symmetric positive definite matrices, uncertainty estimation, dimensionality reduction, non-Euclidean data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review