The DOI matches its Crossref record; 274 of the 286 references it cites were found in a registry or an index.
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Abstract
Convolutional neural networks (CNNs) have been applied to visual tasks since the late 1980s. However, despite a few scattered applications, they were dormant until the mid-2000s when developments in computing power and the advent of large amounts of labeled data, supplemented by improved algorithms, contributed to their advancement and brought them to the forefront of a neural network renaissance that has seen rapid progression since 2012. In this review, which focuses on the application of CNNs to image classification tasks, we cover their development, from their predecessors up to recent state-of-the-art deep learning systems. Along the way, we analyze (1) their early successes, (2) their role in the deep learning renaissance, (3) selected symbolic works that have contributed to their recent popularity, and (4) several improvement attempts by reviewing contributions and challenges of over 300 publications. We also introduce some of their current trends and remaining challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Therefore, the output features include the specific pose information of objects, which means that CapsNet has the ability to recognize the orientation.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
In the citing paper
“Some experiments have proved that CapsNet is able to reach state-ofthe-art results.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
In the citing paper
“Although it did not achieve satisfactory results on complicated large-scale data sets, like CIFAR-100 or ImageNet, we can see that it is potential.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Research works printed but not linked: 86
- Abdulkader A., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition, 1
- Arora S., 2014, Proceedings of the 31th International Conference Machine Learning, 584
- Ba J., 2013, Advances in neural information processing systems, 26, 3084
- Ba J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Bachman P., 2016, Advances in neural information processing systemsm, 29, 4826
- Baldi P., 2013, Advances in neural information processing systems, 26, 3084
- Belkin M., 2006, Journal of Machine Learning Research, 7, 2399
- Bengio Y., 2014, Proceedings of the 31st International Conference Machine Learning, 226
- Bulo S., 2014, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 81
- Chellapilla K., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition.
- Chellapilla K., 2006, Proceedings of the 18th Annual Symposium on Electronic Imaging, 6067
- Chellapilla K., 2006, Proceedings of the 10th Internstional Workshop on Frontiers in Handwriting Recognition, 1
- Choromanska A., 2015, Proceedings 18th International Conference on Artificial Intelligence and Statistics, 192
- Clevert D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Coates A., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 215
- Collobert R., 2006, Journal of Machine Learning Research, 7, 1687
- Courbariaux M., 2015, Advances in neural information processing systems, 28, 3123
- Courbariaux M., 2016, Advances in neural information processing systems, 29, 1
- Deng L., 2014, APSIPA Transactions on Signal and Information Processing, 3, 1
- Denil M., 2013, Advances in neural information processing systems, 26, 2148
- Denton E. L., 2014, Advances in neural information processing systems, 27, 1269
- Dettmers T., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Duchi J., 2011, Journal of Machine Learning Research, 12, 2121
- Erhan D., 2010, Journal of Machine Learning Research, 11, 625
- Filho D. P., 2009, Proceedings of the XXII Brazilian Symposium on Computer Graphics and Image Processing, 1
- Fukushima K., 1979, Proceedings of the 6th International Joint Conference on Artificial Intelligence, 291
- Glorot X., 2010, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 249
- Glorot X., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 315
- Goodfellow I., 2016, Deep learning
- Goodfellow I., 2014, Advances in neural information processing systems, 27, 2672
- Goodfellow I. J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Goodfellow I. J., 2013, Proceedings of the 30th International Conference Machine Learning, 1319
- Han S., 2016, Proceedings of the 3rd International Conference on Learning Representations, 1
- Huang G. B., 2007, Labeled faces in the wild: A database for studying face recognition in unconstrained environments
- Iandola F. N., 2016, SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and 1MB model size
- Ioffe S., 2015, Proceedings of the 32nd International Conference Machine Learning, 448
- Jaderberg M., 2015, Advances in neural information processing systems, 28, 2017
- Jin J., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Karpathy A., 2016, CS231n: Convolutional neural networks for visual recognition
- Karpathy A., 2016, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3128
- Kennedy J., 1995, Proceedings of the 6th International Symposium on Micro Machine and Human Science, 39
- Krizhevsky A., 2012, Advances in neural information processing systems, 25, 1097
- Kulkarni T. D., 2015, Advances in neural information processing systemsm, 28, 2539
- Lebedev V., 2014, Speeding-up convolutional neural networks using fine-tuned CP-decomposition
- LeCun Y., 1989, Connections in perspective, 143
- LeCun Y., 1989, Advances in neural information processing systems, 2, 396
- Lee C., 2015, Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, 562
- Leibo J. Z., 2011, Advances in neural information processing systems, 24, 711
- Levine S., 2016, Journal of Machine Learning Research, 17, 1
- Li S., 2016, Demystifying ResNet
- Li Z., 2016, Advances in neural information processing systemsm, 1
- Lin M., 2013, Network in network
- Linnainmaa S., 1970, The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors
- Liu W., 2016, Proceedings of the 33rd International Conference Machine Learning, 507
- Maas A. L., 2013, Proceedings of the 30th International Conference Machine Learning, 1
- Maharaj A. V., 2015, Improving the adversarial robustness of ConvNets by reduction of input dimensionality
- Mishkin D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- National Data Science Bowl | Kaggle, 2016, Kaggle.com
- Netzer Y., 2011, Advances in neural information processing systems, 24 (NIPS) Workshop on Deep Learning and Unsupervised Feature Learning, 1
- Novikov A., 2015, Advances in neural information processing systems, 28
- Ranzato M., 2006, Advances in neural information processing systems, 19, 1137
- Recht B., 2011, Advances in neural information processing systems, 24, 693
- Rippel O., 2014, Proceedings of the 30th International Conference on Machine Learning, 1746
- Rippel O., 2015, Advances in neural information processing systems, 28, 2449
- Romero A., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Sabour S., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Sermanet P., 2012, Proceedings of the 21st International Conference on Pattern Recognition, 3288
- Snoek J., 2012, Advances in neural information processing systems, 25, 2951
- Sontag E. D., 1998, NATO ASI Series F Computer and Systems Sciences, 168, 69
- Srivastava N., 2014, Journal of Machine Learning Research, 15, 1929
- Srivastava N., 2013, Advances in neural information processing systems, 26, 2094
- Srivastava R. K., 2015, Advances in neural information processing systems, 28, 2377
- Srivastava R. K., 2015, Highway networks
- Steinkrau D., 2005, Proceedings of the 8th International Conference on Document Analysis and Recognition, 1115
- Stollenga M. F., 2014, Advances in neural information processing systems, 27, 3545
- Sun Y., 2014, Advances in neural information processing systems, 27, 1988
- Sutskever I., 2013, Proceedings of the 30th International Conference Machine Learning, 1139
- Szegedy C., 2014, Proceedings of the 1st International Conference on Learning Representations, 1
- Wager S., 2013, Advances in neural information processing systems, 26, 351
- Wan L., 2013, Proceedings of the 30th International Conference Machine Learning, 1058
- Wang S. I., 2013, Proceedings of the 30th International Conference Machine Learning, 118
- Wang Y., 2016, Advances in neural information processing systems, 29, 1
- Weinberger K. Q., 2005, Advances in neural information processing systems, 18, 1473
- Yang J., 2009, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1794
- Zhai S., 2016, Advances in neural information processing systems, 29, 1
- Zinkevich M., 2010, Advances in neural information processing systemsm, 23, 2595
Cited by
Sorted by citations
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Yu, Y., Si, X., Hu, C., & Zhang, J. (2019) · Neural Computation · doi:10.1162/neco_a_01199 · Cited by 5,870
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273
“Rawat and Wang [14] reviewed CNN for image recognition.”
BackgroundResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data
Diakogiannis, F. I., Waldner, F., Caccetta, P. A., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,295
A State-of-the-Art Survey on Deep Learning Theory and Architectures
Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S. K. E., Sidike, P., Nasrin, M. S., Hasan, M., Essen, B. C. V., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,722
Deep learning in spiking neural networks
Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T., & Maida, A. S. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.12.002 · Cited by 1,522
“This type of network has shown outstanding performance in image recognition [2], [135],”
Metadata
- Authors
- Rawat, W., & Wang, Z.
- Affiliations
- University of South Africa (ZA)
- ORCID
- Wang, Zenghui
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2017-09
- Volume
- 29
- Issue
- 9
- Pages
- 2352-2449
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2622826443
- Cited by
- 3,503
- References
- 286
- Citations by year
- 2026: 181 · 2025: 393 · 2024: 470 · 2023: 535 · 2022: 580 · 2021: 589 · 2020: 432 · 2019: 234 · 2018: 84 · 2017: 3
- FWCI
- 85.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- convolutional neural networks, image classification, deep learning, history of neural networks, annotated dataset, computer vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
