Cited by 3,503Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningAdvanced Image and Video Retrieval Techniques

The DOI matches its Crossref record; 274 of the 286 references it cites were found in a registry or an index.

Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review

Rawat, Waseem, Wang, Zenghui·2017·Neural Computation

Abstract

Convolutional neural networks (CNNs) have been applied to visual tasks since the late 1980s. However, despite a few scattered applications, they were dormant until the mid-2000s when developments in computing power and the advent of large amounts of labeled data, supplemented by improved algorithms, contributed to their advancement and brought them to the forefront of a neural network renaissance that has seen rapid progression since 2012. In this review, which focuses on the application of CNNs to image classification tasks, we cover their development, from their predecessors up to recent state-of-the-art deep learning systems. Along the way, we analyze (1) their early successes, (2) their role in the deep learning renaissance, (3) selected symbolic works that have contributed to their recent popularity, and (4) several improvement attempts by reviewing contributions and challenges of over 300 publications. We also introduce some of their current trends and remaining challenges.

Overview

Integrity signals

Registry

Crossref · 10.1162/neco_a_00990

Cites

274 of 274 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Items 201–274 of 274

Flagged first, then by citations

12 of the 286 references couldn’t be matched to a known paper.

Research works printed but not linked: 86

  1. Abdulkader A., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition, 1
  2. Arora S., 2014, Proceedings of the 31th International Conference Machine Learning, 584
  3. Ba J., 2013, Advances in neural information processing systems, 26, 3084
  4. Ba J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
  5. Bachman P., 2016, Advances in neural information processing systemsm, 29, 4826
  6. Baldi P., 2013, Advances in neural information processing systems, 26, 3084
  7. Belkin M., 2006, Journal of Machine Learning Research, 7, 2399
  8. Bengio Y., 2014, Proceedings of the 31st International Conference Machine Learning, 226
  9. Bulo S., 2014, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 81
  10. Chellapilla K., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition.
  11. Chellapilla K., 2006, Proceedings of the 18th Annual Symposium on Electronic Imaging, 6067
  12. Chellapilla K., 2006, Proceedings of the 10th Internstional Workshop on Frontiers in Handwriting Recognition, 1
  13. Choromanska A., 2015, Proceedings 18th International Conference on Artificial Intelligence and Statistics, 192
  14. Clevert D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
  15. Coates A., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 215
  16. Collobert R., 2006, Journal of Machine Learning Research, 7, 1687
  17. Courbariaux M., 2015, Advances in neural information processing systems, 28, 3123
  18. Courbariaux M., 2016, Advances in neural information processing systems, 29, 1
  19. Deng L., 2014, APSIPA Transactions on Signal and Information Processing, 3, 1
  20. Denil M., 2013, Advances in neural information processing systems, 26, 2148
  21. Denton E. L., 2014, Advances in neural information processing systems, 27, 1269
  22. Dettmers T., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
  23. Duchi J., 2011, Journal of Machine Learning Research, 12, 2121
  24. Erhan D., 2010, Journal of Machine Learning Research, 11, 625
  25. Filho D. P., 2009, Proceedings of the XXII Brazilian Symposium on Computer Graphics and Image Processing, 1
  26. Fukushima K., 1979, Proceedings of the 6th International Joint Conference on Artificial Intelligence, 291
  27. Glorot X., 2010, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 249
  28. Glorot X., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 315
  29. Goodfellow I., 2016, Deep learning
  30. Goodfellow I., 2014, Advances in neural information processing systems, 27, 2672
  31. Goodfellow I. J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
  32. Goodfellow I. J., 2013, Proceedings of the 30th International Conference Machine Learning, 1319
  33. Han S., 2016, Proceedings of the 3rd International Conference on Learning Representations, 1
  34. Huang G. B., 2007, Labeled faces in the wild: A database for studying face recognition in unconstrained environments
  35. Iandola F. N., 2016, SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and 1MB model size
  36. Ioffe S., 2015, Proceedings of the 32nd International Conference Machine Learning, 448
  37. Jaderberg M., 2015, Advances in neural information processing systems, 28, 2017
  38. Jin J., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
  39. Karpathy A., 2016, CS231n: Convolutional neural networks for visual recognition
  40. Karpathy A., 2016, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3128
  41. Kennedy J., 1995, Proceedings of the 6th International Symposium on Micro Machine and Human Science, 39
  42. Krizhevsky A., 2012, Advances in neural information processing systems, 25, 1097
  43. Kulkarni T. D., 2015, Advances in neural information processing systemsm, 28, 2539
  44. Lebedev V., 2014, Speeding-up convolutional neural networks using fine-tuned CP-decomposition
  45. LeCun Y., 1989, Connections in perspective, 143
  46. LeCun Y., 1989, Advances in neural information processing systems, 2, 396
  47. Lee C., 2015, Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, 562
  48. Leibo J. Z., 2011, Advances in neural information processing systems, 24, 711
  49. Levine S., 2016, Journal of Machine Learning Research, 17, 1
  50. Li S., 2016, Demystifying ResNet
  51. Li Z., 2016, Advances in neural information processing systemsm, 1
  52. Lin M., 2013, Network in network
  53. Linnainmaa S., 1970, The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors
  54. Liu W., 2016, Proceedings of the 33rd International Conference Machine Learning, 507
  55. Maas A. L., 2013, Proceedings of the 30th International Conference Machine Learning, 1
  56. Maharaj A. V., 2015, Improving the adversarial robustness of ConvNets by reduction of input dimensionality
  57. Mishkin D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
  58. National Data Science Bowl | Kaggle, 2016, Kaggle.com
  59. Netzer Y., 2011, Advances in neural information processing systems, 24 (NIPS) Workshop on Deep Learning and Unsupervised Feature Learning, 1
  60. Novikov A., 2015, Advances in neural information processing systems, 28
  61. Ranzato M., 2006, Advances in neural information processing systems, 19, 1137
  62. Recht B., 2011, Advances in neural information processing systems, 24, 693
  63. Rippel O., 2014, Proceedings of the 30th International Conference on Machine Learning, 1746
  64. Rippel O., 2015, Advances in neural information processing systems, 28, 2449
  65. Romero A., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
  66. Sabour S., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
  67. Sermanet P., 2012, Proceedings of the 21st International Conference on Pattern Recognition, 3288
  68. Snoek J., 2012, Advances in neural information processing systems, 25, 2951
  69. Sontag E. D., 1998, NATO ASI Series F Computer and Systems Sciences, 168, 69
  70. Srivastava N., 2014, Journal of Machine Learning Research, 15, 1929
  71. Srivastava N., 2013, Advances in neural information processing systems, 26, 2094
  72. Srivastava R. K., 2015, Advances in neural information processing systems, 28, 2377
  73. Srivastava R. K., 2015, Highway networks
  74. Steinkrau D., 2005, Proceedings of the 8th International Conference on Document Analysis and Recognition, 1115
  75. Stollenga M. F., 2014, Advances in neural information processing systems, 27, 3545
  76. Sun Y., 2014, Advances in neural information processing systems, 27, 1988
  77. Sutskever I., 2013, Proceedings of the 30th International Conference Machine Learning, 1139
  78. Szegedy C., 2014, Proceedings of the 1st International Conference on Learning Representations, 1
  79. Wager S., 2013, Advances in neural information processing systems, 26, 351
  80. Wan L., 2013, Proceedings of the 30th International Conference Machine Learning, 1058
  81. Wang S. I., 2013, Proceedings of the 30th International Conference Machine Learning, 118
  82. Wang Y., 2016, Advances in neural information processing systems, 29, 1
  83. Weinberger K. Q., 2005, Advances in neural information processing systems, 18, 1473
  84. Yang J., 2009, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1794
  85. Zhai S., 2016, Advances in neural information processing systems, 29, 1
  86. Zinkevich M., 2010, Advances in neural information processing systemsm, 23, 2595

Cited by

Sorted by citations

See all 3,503

Metadata

Authors
Rawat, W., & Wang, Z.
Affiliations
University of South Africa (ZA)
Venue
Neural Computation
Publisher
MIT Press
Published
2017-09
Volume
29
Issue
9
Pages
2352-2449
ISSN
  • 0899-7667 (ISSN-L)
  • 1530-888X
OpenAlex
W2622826443
Cited by
3,503
References
286
Citations by year
2026: 181 · 2025: 393 · 2024: 470 · 2023: 535 · 2022: 580 · 2021: 589 · 2020: 432 · 2019: 234 · 2018: 84 · 2017: 3
FWCI
85.59
Type
journal article
Language
en
Open access
closed
Locations
  • Neural Computation (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
convolutional neural networks, image classification, deep learning, history of neural networks, annotated dataset, computer vision

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review