The DOI matches its DataCite record; 13 of the 14 references it cites were found in a registry or an index.
Auto-Encoding Variational Bayes
Open accessAbstract
How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational inference and learning algorithm that scales to large datasets and, under some mild differentiability conditions, even works in the intractable case. Our contributions are two-fold. First, we show that a reparameterization of the variational lower bound yields a lower bound estimator that can be straightforwardly optimized using standard stochastic gradient methods. Second, we show that for i.i.d. datasets with continuous latent variables per datapoint, posterior inference can be made especially efficient by fitting an approximate inference model (also called a recognition model) to the intractable posterior using the proposed lower bound estimator. Theoretical advantages are reflected in experimental results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In fact, displaced vacuum states have Gaussian distributions in phase space, so the network has a resemblance to a variational autoencoder [121].”
From Continuous-variable quantum neural networks (2019) · cites this paper as [121]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A large amount of machine learning research is devoted to circumventing this problem by instead maximizing a suitable lower bound on this quantity, referred to as the evidence lower bound (ELBO) and sometimes as negative variational free energy.7”
From The overfitted brain hypothesis (2021) · cites this paper as [7]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We implement action chunking policy with Transformers [69], an architecture designed for sequence modeling, and train it as a conditional VAE (CVAE) [59, 34] to capture the variability in human data.”
From Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware (2023) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The forward process variances β t can be learned by reparameterization [33] or held constant as hyperparameters”
From Denoising Diffusion Probabilistic Models (2020) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Variational Autoencoders (VAEs) [99] are effective methods to model the posterior.”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [99]
The cited source says what the claim attributes to it.
In the citing paper
“Earlier efforts in this field focused on deep-learning-based generative models, including Generative Adversarial Networks (GANs) [268], Variational AutoEncoders (VAEs) [269], Normalizing Flows [270], and diffusion-based models [271] for high-quality image generation.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [269]
The cited source says what the claim attributes to it.
In the citing paper
“Generative approaches, such as auto-encoders (Tran et al. 2017; Lee et al. 2019), GANs (Goodfellow et al. 2014), and VAEs (Kingma and Welling 2013), offer a straightforward solution to handle this setting, but these methods are neithor flexible nor efficient as SMIL.”
From SMIL: Multimodal Learning with Severely Missing Modality (2021) · cites this paper as Kingma and Welling 2013
The cited source says what the claim attributes to it.
In the citing paper
“We highlight that our method is better than typical generative designs, such as Autoencoder (AE) (Tran et al. 2017), Variational Autoencoder (VAE) (Kingma and Welling 2013), or Generative Adversarial Network (GAN) (Goodfellow et al. 2014), since they often require a significant amount of full-modality data to learn from, which is usually not available in severely missing modality learning.”
From SMIL: Multimodal Learning with Severely Missing Modality (2021) · cites this paper as Kingma and Welling 2013
The cited source says what the claim attributes to it.
In the citing paper
“In contrast to deterministic approaches, [Liao et al., 2021] adopts probabilistic entity representations, based on variational Bayesian inference [Kingma and Welling, 2013], to jointly model the entity features and the uncertainty.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Kingma and Welling, 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. (1987) · Physics Letters B · doi:10.1016/0370-2693(87)91197-x · Cited by 4,081
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Stochastic Variational InferencePreprint
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. W. (2012) · arXiv (Cornell University) · doi:10.5555/2567709.2502622 · Cited by 1,991
EM Algorithms for PCA and SPCA
Roweis, S. T. (1997) · Cited by 780
Black Box Variational InferencePreprint
Ranganath, R., Gerrish, S., & Blei, D. M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.0118 · Cited by 735
Variational Bayesian Inference with Stochastic SearchPreprint
Paisley, J. W., Blei, D. M., & Jordan, M. I. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6430 · Cited by 372
Efficient Learning of Deep Boltzmann Machines
Salakhutdinov, R., & Larochelle, H. (2010) · Cited by 352
Fast Inference in Sparse Coding Algorithms with Applications to Object RecognitionPreprint
Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1010.3467 · Cited by 222
Sample-based non-uniform random variate generation
Devroye, L. (1986) · Winter Simulation Conference · doi:10.1145/318242.318443 · Cited by 216
Research works printed but not linked: 4
- [BTL13] Yoshua Bengio and ´ Eric Thibodeau-Laufer. Deep generative stochastic networks trainable by backprop. arXiv preprint arXiv:1306.1091 , 2013. · arXiv
- [DHS10] John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research , 12:21212159, 2010.
- [HDFN95] Geoffrey E Hinton, Peter Dayan, Brendan J Frey, and Radford M Neal. The' wakesleep' algorithm for unsupervised neural networks. SCIENCE , pages 1158-1158, 1995.
- [RMW14] Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and variational inference in deep latent gaussian models. arXiv preprint arXiv:1401.4082 , 2014. · arXiv
Cited by
Sorted by citations
Items 1,001–1,100 of 1,231
DeepMicro: Deep representation learning for disease prediction based on microbiome data
Oh, M., & Zhang, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-63159-5 · Cited by 190
Virtual screening of inorganic materials synthesis parameters with deep learning
Kim, E., Huang, K., Jegelka, S., & Olivetti, E. (2017) · npj Computational Materials · doi:10.1038/s41524-017-0055-6 · Cited by 190
Deep learning for small and big data in psychiatry
Koppe, G., Meyer-Lindenberg, A., & Durstewitz, D. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0767-z · Cited by 189
Learning to generate images with perceptual similarity metrics
Snell, J., Ridgeway, K., Liao, R., Roads, B. D., Mozer, M. C., & Zemel, R. S. (2017) · 2017 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2017.8297089 · Cited by 186
MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference
Yang, J., Li, A., Xiao, S., Lu, W., & Gao, X. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2021.3102487 · Cited by 184
Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data
Yu, N., Skripniuk, V., Abdelnabi, S., & Fritz, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01418 · Cited by 195
Unmasking DeepFakes with simple Features
Durall, R., Keuper, M., Pfreundt, F.-J., & Keuper, J. (2019) · arXiv · doi:10.48550/arxiv.1911.00686 · Cited by 184
A Cookbook of Self-Supervised Learning
Balestriero, R., Ibrahim, M., Sobal, V., Morcos, A., Shekhar, S., Goldstein, T., Bordes, F., Bardes, A., Mialon, G., Tian, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.12210 · Cited by 182
“As SSL established a distinct paradigm from traditional reconstruction-based unsupervised learning methods such as (denoising, variational) Autoencoders [Vincent et al., 2008, 2010, Kingma and Welling, 2013], our vocabulary for understanding SSL in a unified view is limited.”
MethodIlyas, H., Javed, A., & Malik, K. M. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110124 · Cited by 186
Missing data in multi-omics integration: Recent advances through artificial intelligence
Flores, J. E., Claborne, D. M., Weller, Z. D., Webb-Robertson, B.-J. M., Waters, K. M., & Bramer, L. M. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1098308 · Cited by 181
Resource-rational decision making
Bhui, R., Lai, L., & Gershman, S. J. (2021) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2021.02.015 · Cited by 168
Hughes, R. T., Zhu, L., & Bednarz, T. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.604234 · Cited by 178
Ghimire, P., Kim, K., & Acharya, M. (2024) · Buildings · doi:10.3390/buildings14010220 · Cited by 175
Gmail Smart Compose: Real-Time Assisted Writing
Chen, M. X., Lee, B. N., Bansal, G., Cao, Y., Zhang, S., Lu, J., Tsay, J., Wang, Y., Dai, A. M., Chen, Z., et al. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330723 · Cited by 169
Fleming, S. J., Chaffin, M. D., Arduini, A., Akkad, A.-D., Banks, E., Marioni, J. C., Philippakis, A. A., Ellinor, P. T., & Babadi, M. (2019) · doi:10.1101/791699 · Cited by 164
Cobolt: integrative analysis of multimodal single-cell sequencing data
Gong, B., Zhou, Y., & Purdom, E. (2021) · Genome Biology · doi:10.1186/s13059-021-02556-z · Cited by 168
Learning Model-Agnostic Counterfactual Explanations for Tabular Data
Pawelczyk, M., Broelemann, K., & Kasneci, G. (2020) · Proceedings of The Web Conference 2020 · doi:10.1145/3366423.3380087 · Cited by 167
Higgins, I., Chang, L., Langston, V., Hassabis, D., Summerfield, C., Tsao, D., & Botvinick, M. (2021) · Nature Communications · doi:10.1038/s41467-021-26751-5 · Cited by 162
Data augmentation for enhancing EEG-based emotion recognition with deep generative models.
Luo, Y., Zhu, L.-Z., Wan, Z.-Y., & Lu, B.-L. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abb580 · Cited by 162
Blundell, C., Uria, B., Pritzel, A., Li, Y., Ruderman, A., Leibo, J. Z., Rae, J., Wierstra, D., & Hassabis, D. (2016) · arXiv · doi:10.48550/arxiv.1606.04460 · Cited by 162
Stochastic latent actor–critic: Deep reinforcement learning with a latent variable model
Lee, A. X., Nagabandi, A., Abbeel, P., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1907.00953 · Cited by 159
Leveraging Uncertainty in Machine Learning Accelerates Biological Discovery and Design
Hie, B., Bryson, B. D., & Berger, B. (2020) · Cell Systems · doi:10.1016/j.cels.2020.09.007 · Cited by 154
VideoGPT: Video Generation using VQ-VAE and Transformers
Yan, W., Zhang, Y., Abbeel, P., & Srinivas, A. (2021) · arXiv · doi:10.48550/arxiv.2104.10157 · Cited by 156
Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1709.08568 · Cited by 155
Variational autoencoders for cancer data integration: design principles and computational practice
Simidjievski, N., Bodnar, C., Tariq, I., Scherer, P., Andres Terre, H., Shams, Z., Jamnik, M., & Liò, P. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.01205 · Cited by 145
Fast and precise single-cell data analysis using a hierarchical autoencoder
Tran, D., Nguyen, H., Tran, B., La Vecchia, C., Luu, H. N., & Nguyen, T. (2021) · Nature Communications · doi:10.1038/s41467-021-21312-2 · Cited by 145
Safron, A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00030 · Cited by 133
The Advent of Generative Chemistry
Vanhaelen, Q., Lin, Y.-C., & Zhavoronkov, A. (2020) · ACS Medicinal Chemistry Letters · doi:10.1021/acsmedchemlett.0c00088 · Cited by 151
Bayesian Recurrent Neural Networks
Fortunato, M., Blundell, C., & Vinyals, O. (2017) · arXiv · doi:10.48550/arxiv.1704.02798 · Cited by 145
SenseGen: A deep learning architecture for synthetic sensor data generation
Alzantot, M., Chakraborty, S., & Srivastava, M. (2017) · 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917555 · Cited by 153
Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation
Dorent, R., Joutard, S., Modat, M., Ourselin, S., & Vercauteren, T. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32245-8_9 · Cited by 160
“[5] proposed to optimise, with respect to (φ, θ), the evidence lower-bound (ELBO):”
BackgroundDark control: The default mode network as a reinforcement learning agent
Dohmatob, E., Dumas, G., & Bzdok, D. (2020) · Human Brain Mapping · doi:10.1002/hbm.25019 · Cited by 121
Active Learning for Deep Object Detection via Probabilistic Modeling
Choi, J., Elezi, I., Lee, H.-J., Farabet, C., & Alvarez, J. M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01010 · Cited by 135
“2, and obtain the class probability distribution for the k-th mixture by using the reparameterization trick [25] of applying Gaussian noise and variance Σp to μ k p [24]:”
MethodTemporal Knowledge Graph Completion: A Survey
Cai, B., Xiang, Y., Gao, L., Zhang, H., Li, Y., & Li, J. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/734 · Cited by 133
A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
Mubarak, R., Alsboui, T., Alshaikh, O., Inuwa-Dutse, I., Khan, S., & Parkinson, S. (2023) · IEEE Access · doi:10.1109/access.2023.3344653 · Cited by 132
A Multi-Task Deep Learning Architecture for Maritime Surveillance Using AIS Data Streams
Nguyen, D., Vadaine, R., Hajduch, G., Garello, R., & Fablet, R. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00044 · Cited by 143
Hierarchical Reinforcement Learning: A Survey and Open Research Challenges
Hutsebaut-Buysse, M., Mets, K., & Latré, S. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4010009 · Cited by 129
Indicators and criteria of consciousness in animals and intelligent machines: an inside-out approach
Pennartz, C. M. A., Farisco, M., & Evers, K. (2019) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2019.00025 · Cited by 121
Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
Liu, X., Gong, C., & Liu, Q. (2022) · arXiv · doi:10.48550/arxiv.2209.03003 · Cited by 124
Neural Structural Correspondence Learning for Domain Adaptation
Ziser, Y., & Reichart, R. (2017) · Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · doi:10.18653/v1/k17-1040 · Cited by 122
DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models
Wen, H., Lin, Y., Xia, Y., Wan, H., Wen, Q., Zimmermann, R., & Liang, Y. (2023) · Proceedings of the 31st ACM International Conference on Advances in Geographic Information Systems · doi:10.1145/3589132.3625614 · Cited by 130
Ig-VAE: Generative modeling of protein structure by direct 3D coordinate generation
Eguchi, R. R., Choe, C. A., & Huang, P.-S. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010271 · Cited by 141
An Appraisal of Incremental Learning Methods
Luo, Y., Yin, L., Bai, W., & Mao, K. (2020) · Entropy · doi:10.3390/e22111190 · Cited by 120
Deep Learning: A Bayesian Perspective
Polson, N. G., & Sokolov, V. (2017) · Bayesian Analysis · doi:10.1214/17-ba1082 · Cited by 120
Toward an integration of deep learning and neuroscience
Marblestone, A. H., Wayne, G., & Kording, K. P. (2016) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2016.00094 · Cited by 119
Luo, S., Su, Y., Peng, X., Wang, S., Peng, J., & Ma, J. (2022) · doi:10.1101/2022.07.10.499510 · Cited by 151
Deep active inference as variational policy gradients
Millidge, B. (2020) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2020.102348 · Cited by 115
Diffusion Models, Image Super-Resolution, and Everything: A Survey
Moser, B. B., Shanbhag, A. S., Raue, F., Frolov, S., Palacio, S., & Dengel, A. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3476671 · Cited by 117
Seninge, L., Anastopoulos, I., Ding, H., & Stuart, J. (2021) · Nature Communications · doi:10.1038/s41467-021-26017-0 · Cited by 107
“More recently, deep generative models such as variational autoencoders 7 (VAEs) have proven to be extremely useful for the probabilistic modeling of single-cell transcriptomes, such as scVI and scGen 8 – 10 .”
BackgroundMethodInfluentialPopularity Bias is not Always Evil: Disentangling Benign and Harmful Bias for Recommendation
Zhao, Z., Chen, J., Zhou, S., He, X., Cao, X., Zhang, F., & Wu, W. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3218994 · Cited by 117
Self-Supervised Feature Learning by Learning to Spot Artifacts
Jenni, S., & Favaro, P. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00289 · Cited by 115
Generative AI for brain image computing and brain network computing: a review
Gong, C., Jing, C., Chen, X., Pun, C. M., Huang, G., Saha, A., Nieuwoudt, M., Li, H.-X., Hu, Y., & Wang, S. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1203104 · Cited by 111
Discovery of drug-omics associations in type 2 diabetes with generative deep-learning models
Allesøe, R. L., Lundgaard, A. T., Hernández Medina, R., Aguayo-Orozco, A., Johansen, J., Nissen, J. N., Brorsson, C., Mazzoni, G., Niu, L., Biel, J. H., et al. (2023) · Nature Biotechnology · doi:10.1038/s41587-022-01520-x · Cited by 111
MelNet: a generative model for audio in the frequency domain
Vasquez, S., & Lewis, M. (2019) · arXiv · doi:10.48550/arxiv.1906.01083 · Cited by 107
Blind Hyperspectral Unmixing Using Autoencoders: A Critical Comparison
Palsson, B., Sveinsson, J. R., & Ulfarsson, M. O. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3140154 · Cited by 107
Predictive Coding: a Theoretical and Experimental Review
Millidge, B., Seth, A., & Buckley, C. L. (2021) · arXiv · doi:10.48550/arxiv.2107.12979 · Cited by 106
Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
Motwani, S., Baranchuk, M., Strohmeier, M., Bolina, V., Torr, P., Hammond, L., & Witt, C. D. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-2336 · Cited by 106
NodeSLAM: Neural object descriptors for multi-view shape reconstruction
Sucar, E., Wada, K., & Davison, A. (2020) · 2020 International Conference on 3D Vision (3DV) · doi:10.1109/3dv50981.2020.00105 · Cited by 108
Deep Deterministic Uncertainty: A New Simple Baseline
Mukhoti, J., Kirsch, A., van Amersfoort, J., Torr, P. H. S., & Gal, Y. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.02336 · Cited by 116
Students' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504
Biologically informed deep learning to query gene programs in single-cell atlases
Lotfollahi, M., Rybakov, S., Hrovatin, K., Hediyeh-zadeh, S., Talavera-López, C., Misharin, A. V., & Theis, F. J. (2023) · Nature Cell Biology · doi:10.1038/s41556-022-01072-x · Cited by 100
Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2
Borji, A. (2022) · arXiv · doi:10.48550/arxiv.2210.00586 · Cited by 100
Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
Chen, T., Zhang, R., & Hinton, G. (2022) · arXiv · doi:10.48550/arxiv.2208.04202 · Cited by 97
Ueltzhöffer, K. (2018) · Biological Cybernetics · doi:10.1007/s00422-018-0785-7 · Cited by 98
Mastering Diverse Domains through World Models
Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2023) · arXiv · doi:10.48550/arxiv.2301.04104 · Cited by 124
Khosravy, M., Nakamura, K., Hirose, Y., Nitta, N., & Babaguchi, N. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3140687 · Cited by 94
Symbol Emergence in Cognitive Developmental Systems: A Survey
Taniguchi, T., Piater, J., Worgotter, F., Ugur, E., Hoffmann, M., Jamone, L., Nagai, T., Rosman, B., Matsuka, T., Iwahashi, N., et al. (2019) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2867772 · Cited by 92
Deep Learning Under Privileged Information Using Heteroscedastic Dropout
Lambert, J., Sener, O., & Savarese, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00926 · Cited by 93
Zhang, X., Zhang, J., Sun, K., Yang, X., Dai, C., & Guo, Y. (2019) · 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983228 · Cited by 93
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models
Shi, Y., Siddharth, N., Paige, B., & Torr, P. H. S. (2019) · arXiv · doi:10.48550/arxiv.1911.03393 · Cited by 186
“Background We employ a VAE (Kingma and Welling, 2014) to learn a multi-modal generative model over modalities m = 1 , . . . , M of the form p Θ ( z , x 1: M ) = p ( z ) M m =1 p θ m ( x m | z ) , with the likelihoods p θ m ( x m | z ) parametrised by deep neural networks (decoders) with parameters…”
BackgroundMethodPrivacy-Preserving Adversarial Networks
Tripathy, A., Wang, Y., & Ishwar, P. (2019) · 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton) · doi:10.1109/allerton.2019.8919758 · Cited by 87
In silico proof of principle of machine learning-based antibody design at unconstrained scale
Akbar, R., Robert, P. A., Weber, C. R., Widrich, M., Frank, R., Pavlović, M., Scheffer, L., Chernigovskaya, M., Snapkov, I., Slabodkin, A., et al. (2022) · mAbs · doi:10.1080/19420862.2022.2031482 · Cited by 94
Distributed Variational Representation Learning
Aguerri, I. E., & Zaidi, A. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2928806 · Cited by 84
Learning Canonical Representations for Scene Graph to Image Generation
Herzig, R., Bar, A., Xu, H., Chechik, G., Darrell, T., & Globerson, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_13 · Cited by 92
Extractive Opinion Summarization in Quantized Transformer Spaces
Angelidis, S., Amplayo, R. K., Suhara, Y., Wang, X., & Lapata, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00366 · Cited by 85
Latent Independent Excitation for Generalizable Sensor-based Cross-Person Activity Recognition
Qian, H., Pan, S. J., & Miao, C. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17416 · Cited by 85
MIRA: joint regulatory modeling of multimodal expression and chromatin accessibility in single cells
Lynch, A. W., Theodoris, C. V., Long, H. W., Brown, M., Liu, X. S., & Meyer, C. A. (2022) · Nature Methods · doi:10.1038/s41592-022-01595-z · Cited by 80
Mosaic integration and knowledge transfer of single-cell multimodal data with MIDAS
He, Z., Hu, S., Chen, Y., An, S., Zhou, J., Liu, R., Shi, J., Wang, J., Dong, G., Shi, J., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-023-02040-y · Cited by 84
Youkachen, S., Ruchanurucks, M., Phatrapomnant, T., & Kaneko, H. (2019) · 2019 10th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES) · doi:10.1109/ictemsys.2019.8695928 · Cited by 87
PathVQA: 30000+ Questions for Medical Visual Question Answering
He, X., Zhang, Y., Mou, L., Xing, E., & Xie, P. (2020) · arXiv · doi:10.48550/arxiv.2003.10286 · Cited by 79
Generative AI for self-adaptive systems: State of the art and research roadmap
Li, J., Zhang, M., Li, N., Weyns, D., Jin, Z., & Tei, K. (2024) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3686803 · Cited by 77
Deep neural networks predicting oil movement in a development unit
Temirchev, P., Simonov, M., Kostoev, R., Burnaev, E., Oseledets, I., Akhmetov, A., Margarit, A., Sitnikov, A., & Koroteev, D. (2020) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2019.106513 · Cited by 75
World Models for Autonomous Driving: An Initial Survey
Guan, Y., Liao, H., Li, Z., Hu, J., Yuan, R., Zhang, G., & Xu, C. (2025) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3398357 · Cited by 76
Longitudinal self-supervised learning
Zhao, Q., Liu, Z., Adeli, E., & Pohl, K. M. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102051 · Cited by 71
A Disentangling Invertible Interpretation Network for Explaining Latent Representations
Esser, P., Rombach, R., & Ommer, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00924 · Cited by 72
ModelScope Text-to-Video Technical Report
Wang, J., Yuan, H., Chen, D., Zhang, Y., Wang, X., & Zhang, S. (2023) · arXiv · doi:10.48550/arxiv.2308.06571 · Cited by 73
Information generation as a functional basis of consciousness
Kanai, R., Chang, A., Yu, Y., Magrans de Abril, I., Biehl, M., & Guttenberg, N. (2019) · Neuroscience of Consciousness · doi:10.1093/nc/niz016 · Cited by 72
Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation
Gan, Y., Yang, Z., Yue, X., Sun, L., & Yang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.02069 · Cited by 72
Wang, J., Sun, T., Liu, B., Cao, Y., & Zhu, H. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/514 · Cited by 73
“[Kingma and Welling, 2013; Rezende et al., 2014] proposes variational auto-encoder (VAE) that uses the encoder to form the approximate posterior, then trains the generative decoder to approximate the inputs of the encoder with variational Proceedings of the Twenty-Eighth International Joint Conference on Artificial In…”
BackgroundMethodInfluentialHarnessing generative AI to decode enzyme catalysis and evolution for enhanced engineering
Xie, W. J., & Warshel, A. (2023) · National Science Review · doi:10.1093/nsr/nwad331 · Cited by 69
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
Mandlekar, A., Xu, D., Wong, J., Nasiriany, S., Wang, C., Kulkarni, R., Fei-Fei, L., Savarese, S., Zhu, Y., & Martín-Martín, R. (2021) · arXiv · doi:10.48550/arxiv.2108.03298 · Cited by 66
Bayesian genome scale modelling identifies thermal determinants of yeast metabolism
Li, G., Hu, Y., Zrimec, J., Luo, H., Wang, H., Zelezniak, A., Ji, B., & Nielsen, J. (2021) · Nature Communications · doi:10.1038/s41467-020-20338-2 · Cited by 57
Cheng, F., Wang, F., Tang, J., Zhou, Y., Fu, Z., Zhang, P., Haines, J. L., Leverenz, J. B., Gan, L., Hu, J., et al. (2024) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101379 · Cited by 63
SwinVRNN: A Data‐Driven Ensemble Forecasting Model via Learned Distribution Perturbation
Hu, Y., Chen, L., Wang, Z., & Li, H. (2023) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2022ms003211 · Cited by 63
Design of synthetic promoters for cyanobacteria with generative deep-learning model
Seo, E., Choi, Y.-N., Shin, Y. R., Kim, D., & Lee, J. W. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad451 · Cited by 61
Yan, Y., Wang, D., Zhou, G., & Chen, Q. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3107586 · Cited by 60
Foundation Models for Decision Making: Problems, Methods, and Opportunities
Yang, S., Nachum, O., Du, Y., Wei, J., Abbeel, P., & Schuurmans, D. (2023) · arXiv · doi:10.48550/arxiv.2303.04129 · Cited by 60
Wasserstein Introspective Neural Networks
Lee, K., Xu, W., Fan, F., & Tu, Z. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00390 · Cited by 56
Lopez, R., Nazaret, A., Langevin, M., Samaran, J., Regier, J., Jordan, M. I., & Yosef, N. (2019) · arXiv · doi:10.48550/arxiv.1905.02269 · Cited by 105
Solving quantum statistical mechanics with variational autoregressive networks and quantum circuits
Liu, J.-G., Mao, L., Zhang, P., & Wang, L. (2021) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/aba19d · Cited by 57
Metadata
- Authors
- Kingma, D. P., & Welling, M.
- Affiliations
- University of Amsterdam (NL)
- ORCID
- Welling, Max
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2013
- arXiv
- 1312.6114
- OpenAlex
- W1959608418
- Cited by
- 20,067
- References
- 14
- Citations by year
- 2026: 414 · 2025: 1878 · 2024: 2998 · 2023: 2873 · 2022: 2374 · 2021: 3248 · 2020: 2621 · 2019: 1977 · 2018: 962 · 2017: 461 · 2016: 160 · 2015: 74 · 2014: 19 · 2013: 1
- Type
- posted content
- Language
- en
- Open access
- green
- dare.uva.nl
- Licence
- Locations
- UvA-DARE (University of Amsterdam) (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Keywords
- autoencoder, variational inference, stochastic variational inference, variational lower bound, reparameterization, continuous latent variables, recognition model, large-scale machine learning, stochastic gradient optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
