The DOI matches its OpenAlex record; 59 of the 59 references it cites were found in a registry or an index.
NVAE: A Deep Hierarchical Variational Autoencoder
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
A Style-Based Generator Architecture for Generative Adversarial Networks
Karras, T., Laine, S., & Aila, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00453 · Cited by 11,714
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438
Searching for activation functions
Ramachandran, P., Zoph, B., & Le, Q. V. (2017) · arXiv · doi:10.48550/arxiv.1710.05941 · Cited by 2,335 · cited 1×
“We also apply a regularization on the norm of scaling parameters in BN layers to ensure that a small mismatch in statistics is not amplified by BN. Swish Activation: The Swish activation [47], f ( u ) = u 1+ e − u , has been recently shown promising results in many applications [48, 49].”
MethodDensity estimation using Real NVP
Dinh, L., Sohl-Dickstein, J., & Bengio, S. (2016) · arXiv · Cited by 2,067
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061 · cited 1×
“…as reducing the gap between approximate and true posterior distributions [3, 4, 5, 6, 7, 8, 9, 10], formulating tighter bounds [11, 12, 13, 14], reducing the gradient noise [15, 16], extending VAEs to discrete variables [17, 18, 19, 20, 21, 22, 23], or tackling posterior collapse [24, 25, 26, 27].”
BackgroundAutoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2016) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 1,990
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Pixel Recurrent Neural Networks
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,437
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
Maddison, C. J., Mnih, A., & Teh, Y. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00712 · Cited by 1,359
DRAW: A Recurrent Neural Network For Image Generation
Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., & Wierstra, D. (2015) · International Conference on Machine Learning · Cited by 1,285
Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv · doi:10.48550/arxiv.1802.05751 · Cited by 1,085 · cited 1×
“63] 78.45 - - - - MAE [64] 77.98 2.95 - - - Lossy VAE [65] 78.53 2.95 - - - MaCow [66] - 3.16 - 0.67 - Autoregressive Models SPN [67] - - 3.85 0.61 - PixelSNAIL [34] - 2.85 3.80 - - Image Transformer [68] - 2.90 3.77 - - PixelCNN++ [69] - 2.92 - - - PixelRNN [41] - 3.00 3.86 - - Gated PixelCNN [70] - 3.03 3.83 - - We…”
InfluentialWeight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Salimans, T., & Kingma, D. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07868 · Cited by 883
Generating diverse high-fidelity images with vq-vae-2
Razavi, A., Oord, A. V. D., & Vinyals, O. (2019) · arXiv · doi:10.48550/arxiv.1906.00446 · Cited by 709
Importance Weighted Autoencoders
Burda, Y., Grosse, R., & Salakhutdinov, R. (2015) · arXiv · doi:10.48550/arxiv.1509.00519 · Cited by 644
Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1701.05517 · Cited by 584
Training Deep Nets with Sublinear Memory Cost
Chen, T., Xu, B., Zhang, C., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1604.06174 · Cited by 561
REBAR: Low-variance, unbiased gradient estimates for discrete latent variable modelsPreprint
Tucker, G., Mnih, A., Maddison, C. J., Lawson, D., & Sohl‐Dickstein, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07370 · Cited by 322
Discrete Variational AutoencodersPreprint
Rolfe, J. T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.02200 · Cited by 270
Ho, J., Chen, X., Srinivas, A., Duan, Y., & Abbeel, P. (2019) · arXiv · Cited by 245
Auxiliary Deep Generative Models
Maaløe, L., Sønderby, C. K., Sønderby, S. K., & Winther, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.05473 · Cited by 241
BIVA: A Very Deep Hierarchy of Latent Variables for Generative ModelingPreprint
Maaløe, L., Fraccaro, M., Liévin, V., & Winther, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02102 · Cited by 211
The challenge of realistic music generation: modelling raw audio at scalePreprint
Dieleman, S., van den Oord, A., & Simonyan, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.10474 · Cited by 211
Spectral Norm Regularization for Improving the Generalizability of Deep Learning
Yoshida, Y., & Miyato, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10941 · Cited by 205
Training Deep and Recurrent Networks with Hessian-Free Optimization
Martens, J., & Sutskever, I. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_27 · Cited by 202
On the Quantitative Analysis of Decoder-Based Generative ModelsPreprint
Wu, Y., Burda, Y., Salakhutdinov, R., & Grosse, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04273 · Cited by 202
Towards Conceptual Compression
(2016) · arXiv (Cornell University) · Cited by 185
Residual Flows for Invertible Generative Modeling
Chen, R. T. Q., Behrmann, J., Duvenaud, D., & Jacobsen, J.-H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02735 · Cited by 170
Improving Variational Inference with Inverse Autoregressive Flow
Kingma, D. P., Salimans, T., Józefowicz, R., Chen, X., Sutskever, I., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04934 · Cited by 164
Bias Correction of Learned Generative Models using Likelihood-Free Importance WeightingPreprint
Grover, A., Song, J., Agarwal, A., Tran, K., Kapoor, A., Horvitz, E., & Ermon, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.09531 · Cited by 133
Rényi divergence variational inference
Li, Y., & Turner, R. E. (2016) · Apollo (University of Cambridge) · doi:10.17863/cam.21344 · Cited by 113
Rényi Divergence Variational InferencePreprint
Li, Y., & Turner, R. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02311 · Cited by 103
Sticking the Landing: Simple, Lower-Variance Gradient Estimators for Variational Inference
Roeder, G., Wu, Y., & Duvenaud, D. (2017) · arXiv · doi:10.48550/arxiv.1703.09194 · Cited by 84
Augmented Normalizing Flows: Bridging the Gap Between Generative Flows and Latent Variable ModelsPreprint
Huang, C.-W., Dinh, L., & Courville, A. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07101 · Cited by 82
DVAE++: Discrete Variational Autoencoders with Overlapping TransformationsPreprint
Vahdat, A., Macready, W. G., Bian, Z., Khoshaman, A. H., & Andriyash, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04920 · Cited by 69
Self-citationDVAE#: Discrete Variational Autoencoders with Relaxed Boltzmann PriorsPreprint
Vahdat, A., Andriyash, E., & Macready, W. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07445 · Cited by 58
Self-citationMAE: Mutual Posterior-Divergence Regularization for Variational AutoEncodersPreprint
Ma, X., Zhou, C., & Hovy, E. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01498 · Cited by 37
PixelVAE++: Improved PixelVAE with Discrete PriorPreprint
Sadeghi, H., Andriyash, E., Vinci, W., Buffoni, L., & Amin, M. H. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.09948 · Cited by 33
VFlow: More Expressive Generative Flows with Variational Data AugmentationPreprint
Chen, J., Lu, C., Chenli, B., Zhu, J., & Tian, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09741 · Cited by 30
Bidirectional Helmholtz MachinesPreprint
Bornschein, J., Shabanian, S., Fischer, A., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03877 · Cited by 22
Undirected Graphical Models as Approximate PosteriorsPreprint
Vahdat, A., Andriyash, E., & Macready, W. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03440 · Cited by 16
Self-citationOpening the Black Box of Deep Neural Networks via Information
Shwartz-Ziv, R., & Tishby, N. (2017) · arXiv · doi:10.48550/arxiv.1703.00810
Cited by
High-Resolution Image Synthesis with Latent Diffusion Models
Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01042 · Cited by 20,302
Diffusion Models Beat GANs on Image Synthesis
Dhariwal, P., & Nichol, A. (2021) · arXiv · doi:10.48550/arxiv.2105.05233 · Cited by 3,362
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01268 · Cited by 2,514
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511
“Child, Vahdat and Kautz [5, 50] generate images using VAEs with a hierarchy of latent codes that increase progressively with resolution.”
Background
Metadata
- Authors
- Vahdat, A., & Kautz, J.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2020-07-08
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2007.03898
- OpenAlex
- W3041956526
- Cited by
- 350
- References
- 59
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.