Recent Advances in Autoencoder-Based Representation Learning
Open accessThe DOI matches its OpenAlex record; 65 of the 65 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., & Efros, A. A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.244 · Cited by 23,602 · cited 1×
“Image-to-image translation methods [86, 87] (translating, e.”
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930 · cited 1×
“Image-to-image translation methods [87, 88] (translating, e.g., semantic label maps into images) can be implemented by training encoder-decoder architectures to translate between two domains (i.e., in both directions) while enforcing the translated data to match the respective domain distribution.”
MethodAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
(2017) · International Conference on Machine Learning · Cited by 6,382
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“Early approaches to learn abstract representations using autoencoders include stacking single-layer autoencoders [65] to build deep architectures and imposing a sparsity prior to the latent variables [66].”
BackgroundCategorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
(2017) · International Conference on Learning Representations · Cited by 3,248
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Random Features for Large-Scale Kernel Machines
Rahimi, A., & Recht, B. (2007) · Cited by 2,783
Neural Discrete Representation Learning
Oord, A. V. D., Vinyals, O., & Kavukcuoglu, K. (2017) · arXiv · doi:10.48550/arxiv.1711.00937 · Cited by 2,729
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
Rezende, D. J., Mohamed, S., & Wierstra, D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.4082 · Cited by 2,405
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910
Conditional Image Generation with PixelCNN Decoders
van den Oord, A., Kalchbrenner, N., Vinyals, O., Espeholt, L., Graves, A., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05328 · Cited by 1,833
Measuring Statistical Dependence with Hilbert-Schmidt Norms
Gretton, A., Bousquet, O., Smola, A., & Schölkopf, B. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564089_7 · Cited by 1,560
Tutorial on Variational Autoencoders
Doersch, C. (2016) · arXiv · doi:10.48550/arxiv.1606.05908 · Cited by 1,470
Pixel Recurrent Neural Networks
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,437
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
Maddison, C. J., Mnih, A., & Teh, Y. W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00712 · Cited by 1,359
A 3D Face Model for Pose and Illumination Invariant Face Recognition
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., & Vetter, T. (2009) · 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance · doi:10.1109/avss.2009.58 · Cited by 1,326
Diverse Image-to-Image Translation via Disentangled Representations
Lee, H.-Y., Tseng, H.-Y., Huang, J.-B., Singh, M., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01246-5_3 · Cited by 1,225
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03657 · Cited by 1,156
Keeping the neural networks simple by minimizing the description length of the weights
Hinton, G. E., & van Camp, D. (1993) · Proceedings of the sixth annual conference on Computational learning theory - COLT '93 · doi:10.1145/168304.168306 · Cited by 994 · cited 1×
“Analyzing the VAE framework through the lens of Bits-Back coding [53, 54], Chen et al. [19] identify the so-called information preference property: The second term in L VAE (1) encourages the latent code z ∼ q φ ( z | x ) to only store the information that cannot be modeled locally (i.e.,…”
MethodToward Controlled Generation of TextPreprint
Hu, Z., Yang, Z., Liang, X., Salakhutdinov, R., & Xing, E. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00955 · Cited by 992
Information Theoretical Analysis of Multivariate Correlation
Watanabe, S. (1960) · IBM Journal of Research and Development · doi:10.1147/rd.41.0066 · Cited by 748
Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations
Locatello, F., Bauer, S., Lučić, M., Rätsch, G., Gelly, S., Schölkopf, B., & Bachem, O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12359 · Cited by 710
Self-citationDeep Convolutional Inverse Graphics Network
Kulkarni, T. D., Whitney, W., Kohli, P., & Tenenbaum, J. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.03167 · Cited by 653
Kim, H., & Mnih, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05983 · Cited by 617
Donahue, J., Krähenbühl, P., & Darrell, T. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.09782 · Cited by 616
Autoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.09300 · Cited by 599
Adversarially Learned Inference
Dumoulin, V., Belghazi, M. I., Poole, B., Mastropietro, O., Lamb, A., Arjovsky, M., & Courville, A. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.00704 · Cited by 579
A framework for the quantitative evaluation of disentangled representations
Eastwood, C., & Williams, C. K. I. (2018) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 538
Decomposing Motion and Content for Natural Video Sequence Prediction
Villegas, R., Yang, J., Hong, S., Lin, X., & Lee, H. (2017) · arXiv · doi:10.48550/arxiv.1706.08033 · Cited by 488 · cited 1×
“Somewhat related, Villegas et al. [70], Denton and Birodkar [71], Fraccaro et al. [72] propose autoencoder models for video sequence prediction with separate encoders disentangling the latent code into pose and content.”
BackgroundSeeing 3D Chairs: Exemplar Part-Based 2D-3D Alignment Using a Large Dataset of CAD Models
Aubry, M., Maturana, D., Efros, A. A., Russell, B. C., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.487 · Cited by 473
Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations
Agustsson, E., Mentzer, F., Tschannen, M., Cavigelli, L., Timofte, R., Benini, L., & Van Gool, L. (2017) · arXiv · doi:10.48550/arxiv.1704.00648 · Cited by 403
Self-citationEstimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization
Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2068870 · Cited by 379
Information dropout: learning optimal representations through noisy computation
Achille, A., & Soatto, S. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2784440 · Cited by 356
The Variational Fair Autoencoder
Louizos, C., Swersky, K., Li, Y., Welling, M., & Zemel, R. S. (2016) · Data Archiving and Networked Services (DANS) · Cited by 346
InfoVAE: Information Maximizing Variational Autoencoders
Zhao, S., Song, J., & Ermon, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02262 · Cited by 328
Deep Variational Information Bottleneck
Alemi, A. A., Fischer, I., Dillon, J. V., & Murphy, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00410 · Cited by 321
Understanding disentangling in $\beta$-VAEPreprint
Burgess, C., Higgins, I., Pal, A., Matthey, L., Watters, N., Desjardins, G., & Lerchner, A. (2018) · arXiv (Cornell University) · Cited by 294
Variational inference for Monte Carlo objectivesPreprint
Mnih, A., & Rezende, D. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06725 · Cited by 293
Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm
Liu, Q., & Wang, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04471 · Cited by 292
A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
Fraccaro, M., Kamronn, S., Paquet, U., & Winther, O. (2017) · arXiv · doi:10.48550/arxiv.1710.05741 · Cited by 229
Chen, X., Kingma, D. P., Salimans, T., Duan, Y., Dhariwal, P., Schulman, J., Sutskever, I., & Abbeel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02731 · Cited by 226
Variational Approaches for Auto-Encoding Generative Adversarial Networks
Rosca, M., Lakshminarayanan, B., Warde-Farley, D., & Mohamed, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04987 · Cited by 217
Disentangling factors of variation in deep representations using adversarial training
Mathieu, M., Zhao, J., Sprechmann, P., Ramesh, A., & LeCun, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03383 · Cited by 213
Unsupervised Learning of Disentangled Representations from Video
Denton, E., & Birodkar, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10915 · Cited by 205
Learning Disentangled Representations with Semi-Supervised Deep Generative ModelsPreprint
Siddharth, N., Paige, B., van de Meent, J.-W., Desmaison, A., Goodman, N. D., Kohli, P., Wood, F., & Torr, P. H. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00400 · Cited by 181
Structured Disentangled RepresentationsPreprint
Esmaeili, B., Wu, H., Jain, S., Bozkurt, A., Siddharth, N., Paige, B., Brooks, D. H., Dy, J., & van de Meent, J.-W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.02086 · Cited by 180
Learning Disentangled Joint Continuous and Discrete RepresentationsPreprint
Dupont, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.00104 · Cited by 179
ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matching
Li, C., Liu, H., Chen, C., Pu, Y., Chen, L., Henao, R., & Carin, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.01215 · Cited by 168
Information Constraints on Auto-Encoding Variational BayesPreprint
Lopez, R., Regier, J., Jordan, M. I., & Yosef, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08672 · Cited by 149
SOM-VAE: Interpretable Discrete Representation Learning on Time SeriesPreprint
Fortuin, V., Hüser, M., Locatello, F., Strathmann, H., & Rätsch, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02199 · Cited by 140
Detach and Adapt: Learning Cross-Domain Disentangled Deep Representation
Liu, Y., Yeh, Y.-Y., Fu, T.-C., Wang, S., Chiu, W.-C., & Wang, Y.-C. F. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00924 · Cited by 132
Learning Deep Disentangled Embeddings with the F-Statistic LossPreprint
Ridgeway, K., & Mozer, M. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05312 · Cited by 131
Learning Hierarchical Features from Deep Generative Models
Zhao, S., Song, J., & Ermon, S. (2017) · International Conference on Machine Learning · Cited by 130
Learning to Decompose and Disentangle Representations for Video Prediction
Hsieh, J.-T., Liu, B., Huang, D.-A., Fei-Fei, L., & Niebles, J. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04166 · Cited by 108
A Two-Step Disentanglement Method
Hadad, N., Wolf, L., & Shahar, M. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00087 · Cited by 79
TherML: Thermodynamics of Machine LearningPreprint
Alemi, A. A., & Fischer, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04162 · Cited by 20
Composing graphical models with neural networks for structured representations and fast inference
Johnson, M. J., Duvenaud, D., Wiltschko, A. B., Datta, S. R., & Adams, R. P. (2016) · arXiv · doi:10.48550/arxiv.1603.06277
Cited by
Deep learning in cancer diagnosis, prognosis and treatment selection
Tran, K. A., Kondrashova, O., Bradley, A., Williams, E. D., Pearson, J. V., & Waddell, N. (2021) · Genome Medicine · doi:10.1186/s13073-021-00968-x · Cited by 932
A survey on deep learning for multimodal data fusion
Gao, J., Li, P., Chen, Z., & Zhang, J. (2020) · Neural Computation · doi:10.1162/neco_a_01273 · Cited by 821
“More autoencoder variants can be found in Michael et al. (2018).”
BackgroundDeep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661
Ranjbarzadeh, R., Caputo, A., Tirkolaee, E. B., Jafarzadeh Ghoushchi, S., & Bendechache, M. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106405 · Cited by 333
Transformers in Time-Series Analysis: A Tutorial
Ahmed, S., Nielsen, I. E., Tripathi, A., Siddiqui, S., Ramachandran, R. P., & Rasool, G. (2023) · Circuits, Systems, and Signal Processing · doi:10.1007/s00034-023-02454-8 · Cited by 305
Metadata
- Authors
- Tschannen, M., Bachem, O., & Lučić, M.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-12-12
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.05069
- OpenAlex
- W2904849495
- Cited by
- 329
- References
- 65
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.