The DOI matches its Crossref record; 56 of the 57 references it cites were found in a registry or an index.
CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope
Open accessAbstract
Computer vision is becoming an increasingly trendy word in the area of image processing. With the emergence of computer vision applications, there is a significant demand to recognize objects automatically. Deep CNN (convolution neural network) has benefited the computer vision community by producing excellent results in video processing, object recognition, picture classification and segmentation, natural language processing, speech recognition, and many other fields. Furthermore, the introduction of large amounts of data and readily available hardware has opened new avenues for CNN study. Several inspirational concepts for the progress of CNN have been investigated, including alternative activation functions, regularization, parameter optimization, and architectural advances. Furthermore, achieving innovations in architecture results in a tremendous enhancement in the capacity of the deep CNN. Significant emphasis has been given to leveraging channel and spatial information, with a depth of architecture and information processing via multi-path. This survey paper focuses mainly on the primary taxonomy and newly released deep CNN architectures, and it divides numerous recent developments in CNN architectures into eight groups. Spatial exploitation, multi-path, depth, breadth, dimension, channel boosting, feature-map exploitation, and attention-based CNN are the eight categories. The main contribution of this manuscript is in comparing various architectural evolutions in CNN by its architectural change, strengths, and weaknesses. Besides, it also includes an explanation of the CNN’s components, the strengths and weaknesses of various CNN variants, research gap or open challenges, CNN applications, and the future research direction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The CNN has found applications in NLP, such as language modeling and analysis, despite RNNs being deemed more appropriate for these purposes (Bhatt et al. 2021).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Bhatt et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Advances In Deep Learning On Graphs (Gsp'18 Workshop)Preprint
Defferrard, M., Bresson, X., & Vandergheynst, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.09375 · Cited by 7,021
3D Convolutional Neural Networks for Human Action Recognition
Ji, S., Xu, W., Yang, M., & Yu, K. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.59 · Cited by 6,313
Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“Nonetheless, training more deep and high-capacity CNN architectures consumes a substantial amount of memory and computing resources [68,69]; • The fundamental disadvantage of CNNs is their inability to be applied in real-time.”
BackgroundA Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Action Recognition with Improved Trajectories
Wang, H., & Schmid, C. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.441 · Cited by 3,407
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
A survey of the recent architectures of deep convolutional neural networks
Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09825-6 · Cited by 3,137
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Deep learning for visual understanding: A review
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
A Dataset for Breast Cancer Histopathological Image Classification
Spanhol, F. A., Oliveira, L. S., Petitjean, C., & Heutte, L. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2496264 · Cited by 1,944
Image Super-Resolution Using Dense Skip Connections
Tong, T., Li, G., Liu, X., & Gao, Q. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.514 · Cited by 1,425
Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs
Simonovsky, M., & Komodakis, N. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.11 · Cited by 1,391
Matrix capsules with EM routing
Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918
Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition
Abdel‐Hamid, O., Mohamed, A., Jiang, H., & Penn, G. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288864 · Cited by 917
Arrhythmia detection using deep convolutional neural network with long duration ECG signals
Yıldırım, Ö., Pławiak, P., Tan, R., & Acharya, U. R. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.09.009 · Cited by 886
Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model
Gidaris, S., & Komodakis, N. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.135 · Cited by 801
Action Recognition in Video Sequences using Deep Bi-Directional LSTM With CNN Features
Ullah, A., Ahmad, J., Muhammad, K., Sajjad, M., & Baik, S. W. (2017) · IEEE Access · doi:10.1109/access.2017.2778011 · Cited by 765
The Expressive Power of Neural Networks: A View from the WidthPreprint
Zhou, L., Pu, H., Wang, F., Hu, Z., & Wang, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02540 · Cited by 647
Multi-view Face Detection Using Deep Convolutional Neural Networks
Farfade, S., Saberian, M. J., & Li, L.-J. (2015) · International Conference on Multimedia Retrieval · doi:10.1145/2671188.2749408 · Cited by 591
Applying convolutional neural network for network intrusion detection
Vinayakumar, R., Soman, K. P., & Poornachandran, P. (2017) · International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8126009 · Cited by 578
Deep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39593-2_1 · Cited by 568
Recent progress in semantic image segmentation
Liu, X., Deng, Z., & Yang, Y. (2018) · Artificial Intelligence Review · doi:10.1007/s10462-018-9641-3 · Cited by 538
SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels
Fey, M., Lenssen, J. E., Weichert, F., & Muller, H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00097 · Cited by 459
Convolutional neural network for video fire and smoke detection
Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J., Moreau, É., & Fnaiech, F. (2016) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2016.7793196 · Cited by 382
Predicting the Computational Cost of Deep Learning Models
Justus, D., Brennan, J., Bonner, S., & McGough, A. S. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622396 · Cited by 319
A convolutional neural network neutrino event classifier
Aurisano, A., Radovic, A., Rocco, D., Himmel, A., Messier, M. D., Niner, E., Pawloski, G., Psihas, F., Sousa, A., & Vahle, P. (2016) · Journal of Instrumentation · doi:10.1088/1748-0221/11/09/p09001 · Cited by 271
Beyond Frame-level CNN: Saliency-Aware 3-D CNN With LSTM for Video Action Recognition
Wang, X., Gao, L., Song, J., & Shen, H. T. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2611485 · Cited by 264
Shallow vs. Deep Sum-Product Networks
Delalleau, O., & Bengio, Y. (2011) · Cited by 248
Welling, M., Sebe, N., Matas, J., & Leibe, B. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46478-7 · Cited by 244
Sequential Deep Trajectory Descriptor for Action Recognition With Three-Stream CNN
Shi, Y., Tian, Y., Wang, Y., & Huang, T. (2017) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2666540 · Cited by 225
DeepThin: A novel lightweight CNN architecture for traffic sign recognition without GPU requirements
Haque, W. A., Arefin, S., Shihavuddin, A., & Hasan, M. A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114481 · Cited by 131
Speech Emotion Recognition Using Deep Neural Network Considering Verbal and Nonverbal Speech Sounds
Huang, K.-Y., Wu, C., Hong, Q.-B., Su, M.-H., & Chen, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682283 · Cited by 123
Chouhan, N., Khan, A., & Khan, H. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105612 · Cited by 113
Patel, C. I., Labana, D. L., Pandya, S., Modi, K. J., Ghayvat, H., & Awais, M. A. (2020) · Sensors · doi:10.3390/s20247299 · Cited by 103
Self-citationHuman action recognition using fusion of features for unconstrained video sequences
Patel, C. I., Garg, S., Zaveri, T., Banerjee, A., & Patel, R. (2016) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2016.06.004 · Cited by 77
Self-citationDetecting Driver Drowsiness in Real Time Through Deep Learning Based Object Detection
Shakeel, M. F., Bajwa, N., Anwaar, A. M., Sohail, A., Khan, A., & Haroon-Ur-Rashid (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20521-8_24 · Cited by 66
Fine-to-coarse knowledge transfer for low-res image classification
Peng, X., Hoffman, J., Yu, S. X., & Saenko, K. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7533047 · Cited by 61
Car plate recognition based on CNN using embedded system with GPU
Lee, S., Son, K.-Y., Kim, H., & Park, J. (2017) · Conference on Human System Interactions · doi:10.1109/hsi.2017.8005037 · Cited by 50
Action recognition from extremely low-resolution thermal image sequence
Kawashima, T., Kawanishi, Y., Ide, I., Murase, H., Deguchi, D., Aizawa, T., & Kawade, M. (2017) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2017.8078497 · Cited by 49
Effect of Depth and Width on Local Minima in Deep Learning
Kawaguchi, K., Huang, J., & Kaelbling, L. P. (2019) · Neural Computation · doi:10.1162/neco_a_01195 · Cited by 48
Madrazo, C. F., Heredia, I., Iglesias, L. L., & de Lucas, J. M. (2019) · EPJ Web of Conferences · doi:10.1051/epjconf/201921406017 · Cited by 30
An Energy-Efficient FPGA-Based Embedded System for CNN Application
Xie, W., Zhang, C., Zhang, Y., Hu, C., Jiang, H., & Wang, Z. (2018) · IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC) · doi:10.1109/edssc.2018.8487057 · Cited by 27
LR-CNN for fine-grained classification with varying resolution
Chevalier, M., Thome, N., Cord, M., Fournier, J., Hénaff, G., & Dusch, E. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351374 · Cited by 24
Disentangled Dynamic Graph Deep Generation
Zhang, W., Zhang, L., Pfoser, D., & Zhao, L. (2021) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976700.83 · Cited by 21
Flagged first, then by citations
1 of the 57 references couldn’t be matched to a known paper.
Research works printed but not linked: 16
- Balázs, C.C. (2001). Approximation with Artificial Neural Networks. [Master’s Thesis, Eötvös Loránd University].
- Ioffe, S. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv.
- Hanin, B. (2017). Approximating Continuous Functions by ReLU Nets of Minimal width. arXiv.
- Nguyen, Q. (2018). Neural Networks Should Be Wide Enough to Learn Disconnected Decision Regions. arXiv.
- Lin, C. (2020). GRCNN: Graph Recognition Convolutional Neural Network for Synthesizing Programs from Flow Charts. arXiv.
- Ma, D. (2020). MFRNet: A New CNN Architecture for Post-Processing and In-loop Filtering. arXiv.
- Alexey, B. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
- Aex, B. (2021). Net2Vis—A Visual Grammar for Automatically Generating Publication-Tailored CNN Architecture Visualizations. arXiv.
- Zou, C., Zheng, Y., Su, Q., and Fu, H. (2018). Chiew-Lan Tai Sketch-R2CNN: An Attentive Network for Vector Sketch Recognition. arXiv.
- Zheng, G. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv.
- Defferrard, M. (2016). Convolutional neural networks on graphs with fast localized spectral filtering. Adv. Neural Inf. Process. Syst., 3844–3852.
- Kipf, T.N. (2016). Semi-supervised classification with graph convolutional networks. arXiv.
- Chen, J. (2018). Fastgcn: Fast learning with graph convolutional networks via importance sampling. arXiv.
- Liao, R. (2019). Lanczosnet: Multiscale deep graph convolutional networks. arXiv.
- Velickovic, P. (2017). Graph attention networks. arXiv.
- De Vries, H. (2016, January 27–29). Deep learning vector quantization. Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium.
Cited by
Sorted by citations
A review of convolutional neural networks in computer vision
Zhao, X., Wang, L., Zhang, Y., Han, X., Deveci, M., & Parmar, M. D. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10721-6 · Cited by 1,477
Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., & Hussain, A. (2023) · Information Fusion · doi:10.1016/j.inffus.2022.09.025 · Cited by 783
Alahi, M. E. E., Sukkuea, A., Tina, F. W., Nag, A., Kurdthongmee, W., Suwannarat, K., & Mukhopadhyay, S. C. (2023) · Sensors · doi:10.3390/s23115206 · Cited by 740
Taye, M. M. (2023) · Computation · doi:10.3390/computation11030052 · Cited by 812
A Study of CNN and Transfer Learning in Medical Imaging: Advantages, Challenges, Future Scope
Salehi, A. W., Khan, S., Gupta, G., Alabduallah, B. I., Almjally, A., Alsolai, H., Siddiqui, T., & Mellit, A. (2023) · Sustainability · doi:10.3390/su15075930 · Cited by 682
Metadata
- Authors
- Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., & Ghayvat, H.
- Affiliations
- Parul University (IN)
- Computer Science & Engineering, DEPSTAR, Changa, Gujarat 388421, India
- Symbiosis International University (IN)
- Sankalchand Patel University (IN)
- Linnaeus University (SE)
- Corresponding author
- Patel, Chirag
- Venue
- Electronics
- Publisher
- MDPI AG
- Published
- 2021-10-11
- Volume
- 10
- Issue
- 20
- Pages
- 2470
- ISSN
- 2079-9292 (ISSN-L)
- OpenAlex
- W3206824631
- Cited by
- 890
- References
- 57
- Citations by year
- 2026: 100 · 2025: 266 · 2024: 270 · 2023: 189 · 2022: 63 · 2021: 2
- FWCI
- 47.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Electronics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- convolutional neural networks, convolutional neural network architecture, object recognition, image classification, image segmentation, attention-based CNN, channel attention, multipath networks, depthwise convolution, activation functions, regularization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review