The DOI matches its Crossref record; 206 of the 206 references it cites were found in a registry or an index.
Auto-Encoders in Deep Learning—A Review with New Perspectives
Open accessAbstract
Deep learning, which is a subfield of machine learning, has opened a new era for the development of neural networks. The auto-encoder is a key component of deep structure, which can be used to realize transfer learning and plays an important role in both unsupervised learning and non-linear feature extraction. By highlighting the contributions and challenges of recent research papers, this work aims to review state-of-the-art auto-encoder algorithms. Firstly, we introduce the basic auto-encoder as well as its basic concept and structure. Secondly, we present a comprehensive summarization of different variants of the auto-encoder. Thirdly, we analyze and study auto-encoders from three different perspectives. We also discuss the relationships between auto-encoders, shallow models and other deep learning models. The auto-encoder and its variants have successfully been applied in a wide range of fields, such as pattern recognition, computer vision, data generation, recommender systems, etc. Then, we focus on the available toolkits for auto-encoders. Finally, this paper summarizes the future trends and challenges in designing and training auto-encoders. We hope that this survey will provide a good reference when using and designing AE models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
(2014) · Cited by 33,419
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Abdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
Analysis of a complex of statistical variables into principal components.
Hotelling, H. (1933) · Journal of Educational Psychology · doi:10.1037/h0071325 · Cited by 9,633
On the limited memory BFGS method for large scale optimization
Liu, D. C., & Nocedal, J. (1989) · Mathematical Programming · doi:10.1007/bf01589116 · Cited by 8,560
Methods of conjugate gradients for solving linear systems
Hestenes, M. R., & Stiefel, E. (1952) · Journal of Research of the National Bureau of Standards · doi:10.6028/jres.049.044 · Cited by 8,132
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 6,938
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Image Style Transfer Using Convolutional Neural Networks
Gatys, L. A., Ecker, A. S., & Bethge, M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.265 · Cited by 6,025
Emergence of simple-cell receptive field properties by learning a sparse code for natural images
Olshausen, B. A., & Field, D. J. (1996) · Nature · doi:10.1038/381607a0 · Cited by 5,694
Function minimization by conjugate gradients
Fletcher, R. (1964) · The Computer Journal · doi:10.1093/comjnl/7.2.149 · Cited by 4,939
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150
Locality-constrained Linear Coding for image classification
Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., & Gong, Y. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540018 · Cited by 3,100
Updating quasi-Newton matrices with limited storage
Nocedal, J. (1980) · Mathematics of Computation · doi:10.1090/s0025-5718-1980-0572855-7 · Cited by 2,958
An analysis of single-layer networks in unsupervised feature learning
Coates, A., Ng, A. Y., & Lee, H. (2011) · Cited by 2,758
Deep learning-based classification of hyperspectral data
Chen, Y., Lin, Z., Zhao, X., Wang, G., & Gu, Y. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2329330 · Cited by 2,679
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
Deep learning for visual understanding: A review
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,178
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061
Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction
Masci, J., Meier, U., Cireşan, D., & Schmidhuber, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_7 · Cited by 1,955
Gong, D., Liu, L., Le, V., Saha, B., Mansour, M. R., Venkatesh, S., & Van Den Hengel, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00179 · Cited by 1,930
Collaborative Knowledge Base Embedding for Recommender Systems
Zhang, F., Yuan, N. J., Lian, D., Xie, X., & Ma, W.-Y. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939673 · Cited by 1,749
Collaborative Deep Learning for Recommender Systems
Wang, H., Wang, N., & Yeung, D.-Y. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783273 · Cited by 1,657
Semi-Supervised Learning with Deep Generative Models
Kingma, D. P., Rezende, D. J., Mohamed, S., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1406.5298 · Cited by 1,415
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,345
Facial Expression Analysis under Partial Occlusion: A Survey
Zhang, L., Verma, B., Tjondronegoro, D., & Chandran, V. (2019) · ACM Computing Surveys · doi:10.1145/3158369 · Cited by 1,258
Image Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · Cited by 1,237
Contractive Auto-Encoders: Explicit Invariance During Feature Extraction
Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011) · International Conference on Machine Learning · Cited by 1,190
AutoRec: Autoencoders Meet Collaborative Filtering
Sedhain, S., Menon, A. K., Sanner, S., & Xie, L. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742726 · Cited by 1,175
(1993) · Cited by 1,173
Efficient Learning of Sparse Representations with an Energy-Based Model
Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0147 · Cited by 1,106
Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition
Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383157 · Cited by 1,086
Generalized principal component analysis (GPCA)
Vidal, R., Ma, Y., & Sastry, S. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.244 · Cited by 1,038
A Connection Between Score Matching and Denoising Autoencoders
Vincent, P. (2011) · Neural Computation · doi:10.1162/neco_a_00142 · Cited by 1,011
Training feedforward neural networks using genetic algorithms
Montana, D. J., & Davis, L. D. (1989) · International Joint Conference on Artificial Intelligence · Cited by 1,006
Collaborative Denoising Auto-Encoders for Top-N Recommender Systems
Wu, Y., DuBois, C., Zheng, A. X., & Ester, M. (2016) · Proceedings of the Ninth ACM International Conference on Web Search and Data Mining · doi:10.1145/2835776.2835837 · Cited by 1,001
Auto-encoder based dimensionality reduction
Wang, Y., Yao, H., & Zhao, S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.104 · Cited by 976
Hinton, G. (2009) · Scholarpedia · doi:10.4249/scholarpedia.5947 · Cited by 885
Chen, Z., & Li, W. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2669947 · Cited by 883
On optimization methods for deep learning
Ngiam, J., Coates, A., Lahiri, A., Prochnow, B., Le, Q. V., & Ng, A. Y. (2011) · International Conference on Machine Learning · Cited by 862
Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images
Xu, J., Xiang, L., Liu, Q., Gilmore, H., Wu, J., Tang, J., & Madabhushi, A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2458702 · Cited by 854
Learning a Deep Compact Image Representation for Visual Tracking
Wang, N., & Yeung, D. (2013) · neural information processing systems · Cited by 836
A SURVEY OF NONLINEAR CONJUGATE GRADIENT METHODS
Hager, W. W., & Zhang, H. (2005) · Cited by 779
Sparse Feature Learning for Deep Belief Networks
Ranzato, M., Boureau, Y.-L., & LeCun, Y. (2007) · neural information processing systems · Cited by 744
Medical Image Denoising Using Convolutional Denoising Autoencoders
Gondara, L. (2016) · 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW) · doi:10.1109/icdmw.2016.0041 · Cited by 737
Convolutional Neural Network With Data Augmentation for SAR Target Recognition
Ding, J., Chen, B., Liu, H., & Huang, M. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2513754 · Cited by 708
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664
Yuan, X., Huang, B., Wang, Y., Yang, C., & Gui, W. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2809730 · Cited by 635
Autoencoding beyond pixels using a learned similarity metric
Larsen, A., Sønderby, S. K., Larochelle, H., & Winther, O. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.09300 · Cited by 599
Stochastic Gradient Learning in Neural Networks
Bottou, L. (1991) · Cited by 584
Combinations of genetic algorithms and neural networks: a survey of the state of the art
Schaffer, J. D., Whitley, D., & Eshelman, L. J. (2003) · [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks · doi:10.1109/cogann.1992.273950 · Cited by 570
CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training
Bao, J., Chen, D., Wen, F., Li, H., & Hua, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.299 · Cited by 569
Variational Autoencoder for Deep Learning of Images, Labels and Captions
Pu, Y., Gan, Z., Henao, R., Yuan, X., Li, C., Stevens, A., & Carin, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.08976 · Cited by 562
Generating 3D Faces Using Convolutional Mesh Autoencoders
Ranjan, A., Bolkart, T., Sanyal, S., & Black, M. J. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01219-9_43 · Cited by 560
Saliency-Guided Unsupervised Feature Learning for Scene Classification
Zhang, F., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2357078 · Cited by 542
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7443.001.0001 · Cited by 525
Deep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39593-2_1 · Cited by 513
A review on deep learning for recommender systems: challenges and remedies
Batmaz, Z., Yurekli, A., Bilge, A., & Kaleli, C. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-018-9654-y · Cited by 504
Facial expression recognition via learning deep sparse autoencoders
Zeng, N., Zhang, H., Song, B., Liu, W., Li, Y., & Dobaie, A. M. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.08.043 · Cited by 489
Shin, H.-C., Orton, M. R., Collins, D. J., Doran, S. J., & Leach, M. O. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.277 · Cited by 488
Wetzel, S. J. (2017) · Physical Review E · doi:10.1103/physreve.96.022140 · Cited by 488
Ketkar, N. (2017) · Apress eBooks · doi:10.1007/978-1-4842-2766-4 · Cited by 476
Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction
Wang, W., Huang, Y., Wang, Y., & Wang, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.79 · Cited by 445
Independent Component Analysis: A Tutorial Introduction
Stone, J. V. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3717.001.0001 · Cited by 445
Background Prior-Based Salient Object Detection via Deep Reconstruction Residual
Han, J., Zhang, D., Hu, X., Guo, L., Ren, J., & Wu, F. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2014.2381471 · Cited by 444
Deep Feature Learning for Medical Image Analysis with Convolutional Autoencoder Neural Network
Chen, M., Shi, X., Zhang, Y., Wu, D., & Guizani, M. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2017.2717439 · Cited by 443
Object-Centric Auto-Encoders and Dummy Anomalies for Abnormal Event Detection in Video
Ionescu, R. T., Khan, F. S., Georgescu, M.-I., & Shao, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00803 · Cited by 425
Deep Collaborative Filtering via Marginalized Denoising Auto-encoder
Li, S., Kawale, J., & Fu, Y. (2015) · Proceedings of the 24th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2806416.2806527 · Cited by 422
A Sufficient Condition for Convergences of Adam and RMSProp
Zou, F., Shen, L., Jie, Z., Zhang, W., & Liu, W. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01138 · Cited by 419
Stacked Convolutional Denoising Auto-Encoders for Feature Representation
Du, B., Xiong, W., Wu, J., Zhang, L., Zhang, L., & Tao, D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2536638 · Cited by 416
Evolutionary artificial neural networks: a review
Ding, S., Li, H., Su, C., Yu, J., & Jin, F. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-011-9270-6 · Cited by 412
Hyvärinen, A., Hurri, J., & Hoyer, P. O. (2009) · Computational Imaging and Vision · doi:10.1007/978-1-84882-491-1 · Cited by 398
Higher Order Contractive Auto-Encoder
Rifai, S., Mesnil, G., Vincent, P., Muller, X., Bengio, Y., Dauphin, Y., & Glorot, X. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23783-6_41 · Cited by 397
Tao, C., Pan, H., Li, Y., & Zou, Z. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2482520 · Cited by 397
Using very deep autoencoders for content-based image retrieval.
Krizhevsky, A., & Hinton, G. E. (2011) · The European Symposium on Artificial Neural Networks · Cited by 391
Deep Structured Energy Based Models for Anomaly Detection
Zhai, S., Cheng, Y., Lu, W., & Zhang, Z. (2016) · arXiv · doi:10.48550/arxiv.1605.07717 · Cited by 334
A study of deep convolutional auto-encoders for anomaly detection in videos
Ribeiro, M., Lazzaretti, A. E., & Lopes, H. S. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.07.016 · Cited by 308
High-Resolution SAR Image Classification via Deep Convolutional Autoencoders
Geng, J., Fan, J., Wang, H., Ma, X., Li, B., & Chen, F. (2015) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2015.2478256 · Cited by 291
ICA with Reconstruction Cost for Efficient Overcomplete Feature Learning
Le, Q. V., Karpenko, A., Ngiam, J., & Ng, A. Y. (2011) · Cited by 283
Learning invariant features through topographic filter maps
Kavukcuoglu, K., Ranzato, M., Fergus, R., & LeCun, Y. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206545 · Cited by 274
Fan, Y., Wen, G., Li, D., Qiu, S., Levine, M. D., & Xiao, F. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2020.102920 · Cited by 269
Improving Neural Networks with Dropout
Srivastava, N. (2013) · Cited by 268
Unsupervised learning of distributions on binary vectors using two layer networks
Freund, Y., & Haussler, D. H. (1991) · Cited by 267
A Survey of Recommender Systems Based on Deep Learning
Mu, R. (2018) · IEEE Access · doi:10.1109/access.2018.2880197 · Cited by 254
Dimension Reduction With Extreme Learning Machine
Kasun, L. L. C., Yang, Y., Huang, G.-B., & Zhang, Z. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2570569 · Cited by 248
Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses
Kan, M., Shan, S., Chang, H., & Chen, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.243 · Cited by 243
Context-Aware Deep Feature Compression for High-Speed Visual Tracking
Choi, J., Chang, H. J., Fischer, T., Yun, S., Lee, K., Jeong, J., Demiris, Y., & Choi, J. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00057 · Cited by 229
Characterizing the sparseness of neural codes
Willmore, B., & Tolhurst, D. J. (2001) · Network: Computation in Neural Systems · doi:10.1080/net.12.3.255.270 · Cited by 229
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration
Wang, M., Ni, B., Hua, X.-S., & Chua, T.-S. (2012) · ACM Computing Surveys · doi:10.1145/2333112.2333120 · Cited by 219
Hosseini-Asl, E., Zurada, J. M., & Nasraoui, O. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2479223 · Cited by 216
Single Sample Face Recognition via Learning Deep Supervised Autoencoders
Gao, S., Zhang, Y., Jia, K., Lu, J., & Zhang, Y. (2015) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2015.2446438 · Cited by 214
Human action recognition using genetic algorithms and convolutional neural networks
Ijjina, E. P., & Chalavadi, K. M. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.01.012 · Cited by 209
Chung, Y.-A., Wu, C.-C., Shen, C.-H., Lee, H.-Y., & Lee, L.-S. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-82 · Cited by 202
A Zero-Shot Framework for Sketch Based Image Retrieval
Yelamarthi, S. K., Reddy, S. K., Mishra, A., & Mittal, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_19 · Cited by 198
Chen, L., Zhou, M., Su, W., Wu, M., She, J., & Hirota, K. (2018) · Information Sciences · doi:10.1016/j.ins.2017.10.044 · Cited by 196
Sabokrou, M., Fathy, M., & Hoseini, M. (2016) · Electronics Letters · doi:10.1049/el.2016.0440 · Cited by 189
Deep autoencoder neural networks for gene ontology annotation predictions
Chicco, D., Sadowski, P., & Baldi, P. (2014) · Proceedings of the 5th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics · doi:10.1145/2649387.2649442 · Cited by 182
Toolkits and Libraries for Deep Learning
Erickson, B. J., Korfiatis, P., Akkus, Z., Kline, T., & Philbrick, K. (2017) · Journal of Digital Imaging · doi:10.1007/s10278-017-9965-6 · Cited by 176
Supervised autoencoders: Improving generalization performance with unsupervised regularizers
Le, L., Patterson, A., & White, M. (2018) · neural information processing systems · Cited by 171
Makhzani, A., & Frey, B. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.2752 · Cited by 167
Autoencoder-based deep metric learning for network intrusion detection
Andresini, G., Appice, A., & Malerba, D. (2021) · Information Sciences · doi:10.1016/j.ins.2021.05.016 · Cited by 166
A selectional auto-encoder approach for document image binarization
Calvo-Zaragoza, J., & Gallego, A.-J. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.011 · Cited by 165
A survey of autoencoder-based recommender systems
Zhang, G., Liu, Y., & Jin, X. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-018-8052-6 · Cited by 164
What regularized auto-encoders learn from the data-generating distribution
AlainGuillaume, & BengioYoshua (2014) · Journal of Machine Learning Research · doi:10.5555/2627435.2750359 · Cited by 162
Using convolutional features and a sparse autoencoder for land-use scene classification
Othman, E. M. A., Bazi, Y., Alajlan, N., Alhichri, H. S., & Melgani, F. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1171928 · Cited by 158
Denoising Adversarial Autoencoders
Creswell, A., & Bharath, A. A. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2852738 · Cited by 158
Li, J., Xia, C., & Chen, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2762594 · Cited by 157
Convolutional Sparse Autoencoders for Image Classification
Luo, W., Li, J., Yang, J. J., Xu, W. H., & Zhang, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2712793 · Cited by 156
Deep Learning Representation using Autoencoder for 3D Shape Retrieval
Zhu, Z., Wang, X., Bai, S., Yao, C., & Bai, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.08.127 · Cited by 154
A Deep Learning Approach to Link Prediction in Dynamic Networks
Li, X., Du, N., Li, H., Li, K., Gao, J., & Zhang, A. (2014) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611973440.33 · Cited by 149
Two-Stage Learning to Predict Human Eye Fixations via SDAEs
Han, J., Zhang, D., Wen, S., Guo, L., Liu, T., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2404432 · Cited by 141
Wang, L., Schwing, A. G., & Lazebnik, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07068 · Cited by 141
Cyberbullying Detection Based on Semantic-Enhanced Marginalized Denoising Auto-Encoder
Zhao, R., & Mao, K. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2531682 · Cited by 138
Improving Speech Emotion Recognition with Unsupervised Representation Learning on Unlabeled Speech
Neumann, M., & Vu, N. T. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682541 · Cited by 138
DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval
Xie, J., Dai, G., Zhu, F., Wong, E. K., & Fang, Y. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2596722 · Cited by 136
Deep Supervised and Contractive Neural Network for SAR Image Classification
Geng, J., Wang, H., Fan, J., & Ma, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2645226 · Cited by 135
Zeng, N., Wang, Z., Zhang, H., & Alsaadi, F. E. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9396-6 · Cited by 134
Deep extreme learning machines: supervised autoencoding architecture for classification
Tissera, M. D., & McDonnell, M. D. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.03.110 · Cited by 127
Genetic algorithms for evolving deep neural networks
David, O. E., & Greental, I. (2014) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/2598394.2602287 · Cited by 127
Relational Stacked Denoising Autoencoder for Tag Recommendation
Wang, H., Shi, X., & Yeung, D. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9548 · Cited by 125
Towards latent context-aware recommendation systems
Unger, M., Bar, A., Shapira, B., & Rokach, L. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.04.020 · Cited by 121
Age invariant face recognition and retrieval by coupled auto-encoder networks
Xu, C., Liu, Q., & Ye, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.10.010 · Cited by 120
Marginalized Denoising Auto-encoders for Nonlinear Representations
Chen, M., Weinberger, K. Q., Sha, F., & Bengio, Y. (2014) · International Conference on Machine Learning · Cited by 115
Representation learning via Dual-Autoencoder for recommendation
Zhuang, F., Zhang, Z., Qian, M., Shi, C., Xie, X., & He, Q. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.03.009 · Cited by 115
Wang, Y., Xie, Z., Xu, K., Dou, Y., & Lei, Y. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.10.035 · Cited by 109
Autoencoder with recurrent neural networks for video forgery detection
D'Avino, D., Cozzolino, D., Poggi, G., & Verdoliva, L. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.7.mwsf-330 · Cited by 109
Gabor filter bank with deep autoencoder based face recognition system
Hammouche, R., Attıa, A., Akhrouf, S., & Akhtar, Z. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116743 · Cited by 109
Feature learning based on SAE–PCA network for human gesture recognition in RGBD images
Li, S., Yu, B., Wu, W., Su, S., & Ji, R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.06.086 · Cited by 108
Deep neural network for halftone image classification based on sparse auto-encoder
Zhang, Y., Zhang, E., & Chen, W. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.032 · Cited by 108
A Unified Energy-Based Framework for Unsupervised Learning
Ranzato, M., Boureau, Y.-L., Chopra, S., & LeCun, Y. (2007) · International Conference on Artificial Intelligence and Statistics · Cited by 105
A CNN-Based End-to-End Learning Framework Toward Intelligent Communication Systems
Wu, N., Wang, X., Lin, B., & Zhang, K. (2019) · IEEE Access · doi:10.1109/access.2019.2926843 · Cited by 105
Autoencoder-Based Collaborative Filtering
Ouyang, Y., Liu, W., Rong, W., & Xiong, Z. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-12643-2_35 · Cited by 103
Adversarial Auto-Encoders for Speech Based Emotion Recognition
Sahu, S., Gupta, R., Sivaraman, G., AbdAlmageed, W., & Espy-Wilson, C. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1421 · Cited by 101
Page segmentation of historical document images with convolutional autoencoders
Chen, K., Seuret, M., Liwicki, M., Hennebert, J., & Ingold, R. (2015) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2015.7333914 · Cited by 100
A novel deep hybrid recommender system based on auto-encoder with neural collaborative filtering
Liu, Y., Wang, S., Khan, M. S., & He, J. (2018) · Big Data Mining and Analytics · doi:10.26599/bdma.2018.9020019 · Cited by 100
Multimodal video classification with stacked contractive autoencoders
Liu, Y., Xiao-qing, F., & Zhou, Z. (2015) · Signal Processing · doi:10.1016/j.sigpro.2015.01.001 · Cited by 96
3D object retrieval with stacked local convolutional autoencoder
Leng, B., Guo, S., Zhang, X., & Xiong, Z. (2014) · Signal Processing · doi:10.1016/j.sigpro.2014.09.005 · Cited by 91
Lv, F., Han, M., & Qiu, T. (2017) · IEEE Access · doi:10.1109/access.2017.2706363 · Cited by 88
High-resolution remote-sensing imagery retrieval using sparse features by auto-encoder
Zhou, W., Shao, Z., Diao, C., & Cheng, Q. (2015) · Remote Sensing Letters · doi:10.1080/2150704x.2015.1074756 · Cited by 85
Multi-Stage Variational Auto-Encoders for Coarse-to-Fine Image Generation
Cai, L., Gao, H., & Ji, S. (2019) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611975673.71 · Cited by 82
Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis
Zhang, X., Dou, H., Ju, T., Xu, J., & Zhang, S. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2461671 · Cited by 78
Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration
Wang, R., & Tao, D. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2541318 · Cited by 78
Learning Continuous Attractors in Recurrent Networks
Seung, H. S. (1997) · neural information processing systems · Cited by 75
Wang, Y., Liu, M., Bao, Z., & Zhang, S. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3490-5 · Cited by 72
Provable ICA with Unknown Gaussian Noise, and Implications for Gaussian Mixtures and Autoencoders
Arora, S., Ge, R., Moitra, A., & Sachdeva, S. (2015) · Algorithmica · doi:10.1007/s00453-015-9972-2 · Cited by 69
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Eskimez, Ş. E., Duan, Z., & Heinzelman, W. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462685 · Cited by 69
Cheng, G., Zhou, P., Han, J., Guo, L., & Han, J. (2015) · IET Computer Vision · doi:10.1049/iet-cvi.2014.0270 · Cited by 67
The Potential Energy of an Autoencoder
Kamyshanska, H., & Memisevic, R. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2362140 · Cited by 66
Bottom–Up Visual Saliency Estimation With Deep Autoencoder-Based Sparse Reconstruction
Xia, C., Qi, F., & Shi, G. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2512898 · Cited by 66
Augmented Variational Autoencoders for Collaborative Filtering with Auxiliary Information
Lee, W., Song, K., & Moon, I. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132972 · Cited by 65
An ensemble of deep neural networks for object tracking
Zhou, X., Xie, L., Zhang, P., & Zhang, Y. (2014) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2014.7025169 · Cited by 61
Stacked deep convolutional auto-encoders for emotion recognition from facial expressions
Ruiz-Garcia, A., Elshaw, M., Altahhan, A., & Palade, V. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966040 · Cited by 60
HSAE: A Hessian regularized sparse auto-encoders
Liu, W., Ma, T., Tao, D., & You, J. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.07.119 · Cited by 59
PCA-Initialized Deep Neural Networks Applied to Document Image Analysis
Seuret, M., Alberti, M., Liwicki, M., & Ingold, R. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.148 · Cited by 59
Creation of a deep convolutional auto-encoder in Caffe
Turchenko, V., & Luczak, A. (2017) · IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS) · doi:10.1109/idaacs.2017.8095172 · Cited by 58
Dynamic video anomaly detection and localization using sparse denoising autoencoders
Narasimhan, M., & Kamath, S. S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4940-2 · Cited by 57
Simple Sparsification Improves Sparse Denoising Autoencoders in Denoising Highly Corrupted Images
Cho, K. (2013) · International Conference on Machine Learning · Cited by 55
Regularized estimation of image statistics by Score Matching
Kingma, D. P., & LeCun, Y. (2010) · neural information processing systems · Cited by 50
Multi-task learning using variational auto-encoder for sentiment classification
Lu, G., Zhao, X., Yin, J. P., Yang, W., & Li, B. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.06.027 · Cited by 49
Using deep autoencoders for facial expression recognition
Usman, M., Latif, S., & Qadir, J. (2017) · International Conference on Emerging Technologies · doi:10.1109/icet.2017.8281753 · Cited by 47
Co-saliency detection via inter and intra saliency propagation
Ge, C., Fu, K., Liu, F., Bai, L., & Yang, J. (2016) · Signal Processing Image Communication · doi:10.1016/j.image.2016.03.005 · Cited by 42
Mid-Level Feature Representation via Sparse Autoencoder for Remotely Sensed Scene Classification
Li, E., Du, P., Samat, A., Meng, Y., & Che, M. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2621011 · Cited by 41
Kuen, J., Lim, K. M., & Lee, C. P. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.02.012 · Cited by 38
Using Different Cost Functions to Train Stacked Auto-Encoders
Amaral, T., Silva, L. M., Alexandre, L. A., Kandaswamy, C., Santos, J. M., & de Sá, J. M. (2013) · Mexican International Conference on Artificial Intelligence · doi:10.1109/micai.2013.20 · Cited by 38
Revisit Long Short-Term Memory: An Optimization Perspective
Lyu, Q., & Zhu, J. (2015) · Cited by 38
Dropout Training of Matrix Factorization and Autoencoder for Link Prediction in Sparse Graphs
Zhai, S., & Zhang, Z. M. (2015) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611974010.51 · Cited by 37
Knyaz, V. A., Выголов, О. В., Kniaz, V. V., Vizilter, Y. V., Сергеевич, Г. В., Lühmann, T., & Conen, N. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.252 · Cited by 37
Learning 3D faces from 2D images via Stacked Contractive Autoencoder
Zhang, J., Li, K., Liang, Y., & Li, N. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.11.062 · Cited by 36
Severely Blurred Object Tracking by Learning Deep Image Representations
Ding, J., Huang, Y., Liu, W., & Huang, K. (2015) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2015.2406231 · Cited by 34
Recommendation with Social Relationships via Deep Learning
Rafailidis, D., & Crestani, F. (2017) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3121050.3121057 · Cited by 30
${k}$ -Sparse Autoencoder-Based Automatic Modulation Classification With Low Complexity
Ali, A., & Yangyu, F. (2017) · IEEE Communications Letters · doi:10.1109/lcomm.2017.2717821 · Cited by 24
Denoising adversarial autoencoders: classifying skin lesions using limited labelled training data
Creswell, A., Pouplin, A., & Bharath, A. A. (2018) · IET Computer Vision · doi:10.1049/iet-cvi.2018.5243 · Cited by 23
Learning Disentangled Representations with Wasserstein Auto-Encoders
Rubenstein, P. K., Schölkopf, B., & Tolstikhin, I. (2018) · MPG.PuRe (Max Planck Society) · Cited by 22
Locality-Constrained Sparse Auto-Encoder for Image Classification
Luo, W., Yang, J., Xu, W., & Fu, T. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2384196 · Cited by 21
Learning Product Codebooks Using Vector-Quantized Autoencoders for Image Retrieval
Wu, H., & Flierl, M. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969272 · Cited by 20
Efficient Feature Coding Based on Auto-encoder Network for Image Classification
Xie, G.-S., Zhang, X.-Y., & Liu, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16865-4_41 · Cited by 19
Multi-Entity Dependence Learning With Rich Context via Conditional Variational Auto-Encoder
Tang, L., Xue, Y., Chen, D., & Gomes, C. P. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11335 · Cited by 18
Sparse Autoencoder with Attention Mechanism for Speech Emotion Recognition
Sun, T.-W., & Wu, A.-Y. A. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771593 · Cited by 17
Sample reconstruction with deep autoencoder for one sample per person face recognition
Zhang, Y., & Peng, H. F. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0322 · Cited by 16
Dimensionality reduction of radio map with nonlinear autoencoder
Lee, M. K., & Han, D. (2012) · Electronics Letters · doi:10.1049/el.2011.4039 · Cited by 15
Video Event Detection via Multi-modality Deep Learning
Jhuo, I., & Lee, D. T. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.125 · Cited by 15
Single Sample Face Recognition from Video via Stacked Supervised Auto-Encoder
Vega, P. J. S., Feitosa, R. Q., Ayma, V. H., & Happ, P. N. (2016) · SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) · doi:10.1109/sibgrapi.2016.022 · Cited by 15
Fashion coordinates recommendation based on user behavior and visual clothing style
Gu, S., Liu, X., Cai, L., & Shen, J. (2017) · International Conference on Communication and Information Processing (ICCIP) · doi:10.1145/3162957.3162982 · Cited by 15
Domain independent static video summarization using sparse autoencoders and K-means clustering
Mohan, J., & Nair, P. (. ). M. S. (2019) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-169906 · Cited by 15
Abnormal event detection based on deep autoencoder fusing optical flow
Qiao, M., Wang, T., Li, J., Li, C., Lin, Z., & Snoussi, H. (2017) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2017.8029129 · Cited by 13
Cited by
Autoencoders and their applications in machine learning: a survey
Berahmand, K., Daneshfar, F., Salehi, E. S., Li, Y., & Xu, Y. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10662-6 · Cited by 593
Akkem, Y., Biswas, S. K., & Varanasi, A. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.107881 · Cited by 271
Metadata
- Authors
- Chen, S., & Guo, W.
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2023-04-07
- Volume
- 11
- Issue
- 8
- Pages
- 1777
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W4363650848
- Cited by
- 318
- References
- 206
- FWCI
- 27.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.