CoChat

Convolutional Neural Networks: A Survey

Open access
Krichen, Moez · 2023 · Computers

The DOI matches its Crossref record; 199 of the 199 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) has become a cornerstone of modern technology, revolutionizing industries from healthcare to finance. Convolutional neural networks (CNNs) are a subset of AI that have emerged as a powerful tool for various tasks including image recognition, speech recognition, natural language processing (NLP), and even in the field of genomics, where they have been utilized to classify DNA sequences. This paper provides a comprehensive overview of CNNs and their applications in image recognition tasks. It first introduces the fundamentals of CNNs, including the layers of CNNs, convolution operation (Conv_Op), Feat_Maps, activation functions (Activ_Func), and training methods. It then discusses several popular CNN architectures such as LeNet, AlexNet, VGG, ResNet, and InceptionNet, and compares their performance. It also examines when to use CNNs, their advantages and limitations, and provides recommendations for developers and data scientists, including preprocessing the data, choosing appropriate hyperparameters (Hyper_Param), and evaluating model performance. It further explores the existing platforms and libraries for CNNs such as TensorFlow, Keras, PyTorch, Caffe, and MXNet, and compares their features and functionalities. Moreover, it estimates the cost of using CNNs and discusses potential cost-saving strategies. Finally, it reviews recent developments in CNNs, including attention mechanisms, capsule networks, transfer learning, adversarial training, quantization and compression, and enhancing the reliability and efficiency of CNNs through formal methods. The paper is concluded by summarizing the key takeaways and discussing the future directions of CNN research and development.

Overview

Integrity signals

Registry

Crossref · 10.3390/computers12080151

Cites

199 of 199 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 199 references

Research works printed but not linked: 9

  1. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
  2. Bengio, Y., Goodfellow, I., and Courville, A. (2017). Deep Learning, MIT Press.
  3. Gan, 2019, Research of facial beauty prediction based on deep convolutional features using double activation layer, Acta Electonica Sin., 47, 636
  4. Simon, 2019, Shallow cnn with lstm layer for tuberculosis detection in microscopic images, Int. J. Recent Technol. Eng., 7, 56
  5. Ndong, P.S.B., Adoni, W.Y.H., Nahhal, T., Kimpolo, C., Krichen, M., Byed, A.E., Assayad, I., and Mutombo, F.K. (2021). Advances on Smart and Soft Computing: Proceedings of ICACIn 2021, Springer.
  6. Mehdi, C.A., Nour-Eddine, J., and Mohamed, E. (2022, January 22–27). Regularization in CNN: A Mathematical Study for L 1, L 2 and Dropout Regularizers. Proceedings of the International Conference on Advanced Intelligent Systems for Sustainable Development, Rabat, Morocco. · DOI
  7. Moolayil, J., Moolayil, J., and John, S. (2019). Learn Keras for Deep Neural Networks, Springer. · DOI
  8. Wu, P. (2021-, January 27). PyTorch 2.0: The Journey to Bringing Compiler Technologies to the Core of PyTorch (Keynote). Proceedings of the 21st ACM/IEEE International Symposium on Code Generation and Optimization, Virtual.
  9. Rundong, 2022, Multidimensional Linear Data Processing Based on OpenCL Kernel Function in MXNet Framework, Front. Data Domputing, 4, 29

Cited by

See all 869

Metadata

Authors
Krichen, M.
Affiliations
University of Sfax (TN)
Corresponding author
Krichen, Moez
Venue
Computers
Publisher
MDPI AG
Published
2023-07-28
Volume
12
Issue
8
Pages
151
ISSN
2073-431X (ISSN-L)
OpenAlex
W4385342469
Cited by
623
References
199
Citations by year
2026: 144 · 2025: 242 · 2024: 189 · 2023: 48
FWCI
56.55
Type
journal article
Language
en
Open access
Locations
  • Computers (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
Keywords
convolutional neural networks, image recognition, convolutional neural network architecture, LeNet, AlexNet, VGG, ResNet, InceptionNet, activation functions, hyperparameter optimization, deep learning libraries, attention mechanism, capsule networks, transfer learning, adversarial training, model compression, formal verification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.