The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Stacked Convolutional Denoising Auto-Encoders for Feature Representation
Abstract
Deep networks have achieved excellent performance in learning representation from visual data. However, the supervised deep models like convolutional neural network require large quantities of labeled data, which are very expensive to obtain. To solve this problem, this paper proposes an unsupervised deep network, called the stacked convolutional denoising auto-encoders, which can map images to hierarchical representations without any label information. The network, optimized by layer-wise training, is constructed by stacking layers of denoising auto-encoders in a convolutional way. In each layer, high dimensional feature maps are generated by convolving features of the lower layer with kernels learned by a denoising auto-encoder. The auto-encoder is trained on patches extracted from feature maps in the lower layer to learn robust feature detectors. To better train the large network, a layer-wise whitening technique is introduced into the model. Before each convolutional layer, a whitening layer is embedded to sphere the input data. By layers of mapping, raw images are transformed into high-level feature representations which would boost the performance of the subsequent support vector machine classifier. The proposed algorithm is evaluated by extensive experimentations and demonstrates superior classification performance to state-of-the-art unsupervised networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
An analysis of single-layer networks in unsupervised feature learning
Coates, A., Ng, A. Y., & Lee, H. (2011) · International Conference on Artificial Intelligence and Statistics · Cited by 4,673
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Sparse coding with an overcomplete basis set: A strategy employed by V1?
Olshausen, B. A., & Field, D. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00169-7 · Cited by 3,642
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
Bag-of-visual-words and spatial extensions for land-use classification
Yang, Y., & Newsam, S. (2010) · Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1869790.1869829 · Cited by 2,969
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206757 · Cited by 2,828
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359
Information processing in dynamical systems: foundations of harmony theory
Smolensky, P. (1986) · The MIT Press eBooks · Cited by 2,233
The “independent components” of natural scenes are edge filters
Bell, A. J., & Sejnowski, T. J. (1997) · Vision Research · doi:10.1016/s0042-6989(97)00121-1 · Cited by 2,201
Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction
Masci, J., Meier, U., Cireşan, D., & Schmidhuber, J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_7 · Cited by 1,955
Zeiler, M. D., Krishnan, D., Taylor, G. W., & Fergus, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539957 · Cited by 1,666
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,345
Adaptive deconvolutional networks for mid and high level feature learning
Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126474 · Cited by 1,217
A Theoretical Analysis of Feature Pooling in Visual Recognition
Boureau, Y.-L., Ponce, J., & LeCun, Y. (2010) · Cited by 1,196
Solving large scale linear prediction problems using stochastic gradient descent algorithms
Zhang, T. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015332 · Cited by 1,106
Stochastic Pooling for Regularization of Deep Convolutional Neural Networks
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 755
Learning Convolutional Feature Hierarchies for Visual Recognition
Kavukcuoglu, K., Sermanet, P., Boureau, Y.-L., Gregor, K., Mathieu, M., & LeCun, Y. (2010) · neural information processing systems · Cited by 604
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvprw.2009.5206757 · Cited by 496
Shin, H.-C., Orton, M. R., Collins, D. J., Doran, S. J., & Leach, M. O. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.277 · Cited by 488
Graph-Regularized Low-Rank Representation for Destriping of Hyperspectral Images
Lu, X., Wang, Y., & Yuan, Y. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2012.2226730 · Cited by 337
Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding
Zhang, L., Zhang, Q., Zhang, L., Tao, D., Huang, X., & Du, B. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.12.016 · Cited by 278
Self-citationScene Recognition by Manifold Regularized Deep Learning Architecture
Yuan, Y., Mou, L., & Lu, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2359471 · Cited by 214
A Sparse Representation-Based Binary Hypothesis Model for Target Detection in Hyperspectral Images
Zhang, Y., Du, B., & Zhang, L. (2015) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2337883 · Cited by 195
Self-citationStacks of convolutional Restricted Boltzmann Machines for shift-invariant feature learning
Norouzi, M., Ranjbar, M., & Mori, G. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206577 · Cited by 185
Semi-Supervised Multitask Learning for Scene Recognition
Lu, X., Li, X., & Mou, L. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2362959 · Cited by 179
Learning Deep and Wide: A Spectral Method for Learning Deep Networks
Shao, L., Wu, D., & Li, X. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2308519 · Cited by 163
Selecting Receptive Fields in Deep Networks
Coates, A. (2024) · neural information processing systems · doi:10.57702/4h3zav33 · Cited by 152
Stacked Extreme Learning Machines
Zhou, H., Huang, G.-B., Lin, Z., Wang, H., & Soh, Y. C. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2363492 · Cited by 151
Two-Stage Learning to Predict Human Eye Fixations via SDAEs
Han, J., Zhang, D., Wen, S., Guo, L., Liu, T., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2404432 · Cited by 150
Learning Deep Hierarchical Visual Feature Coding
Goh, H., Thome, N., Cord, M., & Lim, J. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2307532 · Cited by 111
Cresceptron: a self-organizing neural network which grows adaptively
Weng, J., Ahuja, N., & Huang, T. S. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1992.287150 · Cited by 92
Image Super-Resolution Via Double Sparsity Regularized Manifold Learning
Lu, X., Yuan, Y., & Yan, P. (2013) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2244798 · Cited by 84
Hierarchical Feature Extraction With Local Neural Response for Image Recognition
Li, H., Wei, Y., Li, L., & Chen, C. L. P. (2012) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2208743 · Cited by 48
Rank Preserving Sparse Learning for Kinect Based Scene Classification
Tao, D., Jin, L., Zhao, Y., & Li, X. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2264285 · Cited by 47
Self-citationDiscriminative Hash Tracking With Group Sparsity
Du, D., Zhang, L., Lu, H., Mei, X., & Li, X. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2457618 · Cited by 16
Self-citationImage Search Reranking With Hierarchical Topic Awareness
Tian, X., Yang, L., Lu, Y., et al. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2366740 · Cited by 11
Cited by
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926
Cheng, G., Xie, X., Han, J., Guo, L., & Xia, G.-S. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3005403 · Cited by 995
Scene Classification With Recurrent Attention of VHR Remote Sensing Images
Wang, Q., Liu, S., Chanussot, J., & Li, X. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2864987 · Cited by 613
Image denoising using deep CNN with batch renormalization
Tian, C., Xu, Y., & Zuo, W. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.08.022 · Cited by 589
Real-Time Superpixel Segmentation by DBSCAN Clustering Algorithm
Shen, J., Hao, X., Liang, Z., Liu, Y., Wang, W., & Shao, L. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2616302 · Cited by 384
Metadata
- Authors
- Du, B., Xiong, W., Wu, J., Zhang, L., Zhang, L., & Tao, D.
- Venue
- IEEE Transactions on Cybernetics
- Published
- 2017-04
- Volume
- 47
- Issue
- 4
- Pages
- 1017-1027
- ISSN
- 2168-2267 (ISSN-L)
- 2168-2275
- OpenAlex
- W2321627895
- Cited by
- 416
- References
- 53
- FWCI
- 39.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.