Convolutional Neural Networks: A Survey
Open accessThe DOI matches its Crossref record; 199 of the 199 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) has become a cornerstone of modern technology, revolutionizing industries from healthcare to finance. Convolutional neural networks (CNNs) are a subset of AI that have emerged as a powerful tool for various tasks including image recognition, speech recognition, natural language processing (NLP), and even in the field of genomics, where they have been utilized to classify DNA sequences. This paper provides a comprehensive overview of CNNs and their applications in image recognition tasks. It first introduces the fundamentals of CNNs, including the layers of CNNs, convolution operation (Conv_Op), Feat_Maps, activation functions (Activ_Func), and training methods. It then discusses several popular CNN architectures such as LeNet, AlexNet, VGG, ResNet, and InceptionNet, and compares their performance. It also examines when to use CNNs, their advantages and limitations, and provides recommendations for developers and data scientists, including preprocessing the data, choosing appropriate hyperparameters (Hyper_Param), and evaluating model performance. It further explores the existing platforms and libraries for CNNs such as TensorFlow, Keras, PyTorch, Caffe, and MXNet, and compares their features and functionalities. Moreover, it estimates the cost of using CNNs and discusses potential cost-saving strategies. Finally, it reviews recent developments in CNNs, including attention mechanisms, capsule networks, transfer learning, adversarial training, quantization and compression, and enhancing the reliability and efficiency of CNNs through formal methods. The paper is concluded by summarizing the key takeaways and discussing the future directions of CNN research and development.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, RobotReviewer/RobotSearch employs an ensemble classifier, combining multiple CNN models (Krichen 2023) and soft-margin Support Vector Machines (Boser et al. 1992) in order to categorise articles based on their risk of bias assessment (either low or high/unclear) and concurrently extract sentences that substantiate these judgements.”
From Artificial intelligence for literature reviews: opportunities and challenges (2024) · cites this paper as Krichen 2023
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
Understanding of a convolutional neural network
Albawi, S., Mohammed, T. A., & Al-Zawi, S. (2017) · 2017 International Conference on Engineering and Technology (ICET) · doi:10.1109/icengtechnol.2017.8308186 · Cited by 3,986 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772
Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.01.021 · Cited by 2,628
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566 · cited 1×
“Attention mechanisms are a powerful tool for improving the performance of CNNs [178–182].”
The forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866
Chowdhury, S., Dey, P., Joel-Edgar, S., Bhattacharya, S., Rodriguez-Espindola, O., Abadie, A., & Truong, L. (2023) · Human Resource Management Review · doi:10.1016/j.hrmr.2022.100899 · Cited by 927
A transfer convolutional neural network for fault diagnosis based on ResNet-50
Wen, L., Li, X., & Gao, L. (2020) · Neural Computing and Applications · doi:10.1007/s00521-019-04097-w · Cited by 764
An Analysis Of Convolutional Neural Networks For Image Classification
Sharma, N., Jain, V., & Mishra, A. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.05.198 · Cited by 701
A General Survey on Attention Mechanisms in Deep Learning
Brauwers, G., & Frasincar, F. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3126456 · Cited by 695 · cited 1×
“Attention mechanisms are a powerful tool for improving the performance of CNNs [178–182].”
An Empirical Study of Spatial Attention Mechanisms in Deep Networks
Zhu, X., Cheng, D., Zhang, Z., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00679 · Cited by 659
Future Progress in Artificial Intelligence: A Survey of Expert Opinion
Müller, V. C., & Bostrom, N. (2016) · Synthese Library · doi:10.1007/978-3-319-26485-1_33 · Cited by 655
Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training
Zhang, H., Chang, H., Ma, B., Wang, N., & Chen, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58555-6_16 · Cited by 651
Rahman, T., Chowdhury, M. E. H., Khandakar, A., Islam, K. R., Islam, K. F., Mahbub, Z. B., Kadir, M. A., & Kashem, S. (2020) · Applied Sciences · doi:10.3390/app10093233 · Cited by 638 · cited 1×
“Transfer learning is a technique that allows CNNs to leverage the knowledge learned from one task to improve performance on a second, related task [188–192].”
A Study of CNN and Transfer Learning in Medical Imaging: Advantages, Challenges, Future Scope
Salehi, A. W., Khan, S., Gupta, G., Alabduallah, B. I., Almjally, A., Alsolai, H., Siddiqui, T., & Mellit, A. (2023) · Sustainability · doi:10.3390/su15075930 · Cited by 570 · cited 1×
“Transfer learning is a technique that allows CNNs to leverage the knowledge learned from one task to improve performance on a second, related task [188–192].”
Deep Learning With TensorFlow: A Review
Pang, B., Nijkamp, E., & Wu, Y. N. (2020) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998619872761 · Cited by 541
Introduction to Artificial Intelligence
Ertel, W. (2017) · Undergraduate Topics in Computer Science · doi:10.1007/978-3-319-58487-4 · Cited by 524
Identification of Plant-Leaf Diseases Using CNN and Transfer-Learning Approach
Hassan, S. M., Maji, A. K., Jasiński, M., Leonowicz, Z., & Jasińska, E. (2021) · Electronics · doi:10.3390/electronics10121388 · Cited by 498
Paymode, A. S., & Malode, V. B. (2022) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2021.12.002 · Cited by 432
Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networks
Shen, L., Lin, Z., & Huang, Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46478-7_29 · Cited by 421 · cited 1×
“During training, the CNN learns to associate the extracted features with the correct labels through a process of back propagation and optimization [35–38].”
Simple convolutional neural network on image classification
Guo, T., Dong, J., Li, H., & Gao, Y. (2017) · 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)( · doi:10.1109/icbda.2017.8078730 · Cited by 408 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
A Review of Convolutional Neural Network Applied to Fruit Image Processing
Naranjo-Torres, J., Mora, M., Hernández-García, R., Barrientos, R. J., Fredes, C., & Valenzuela, A. (2020) · Applied Sciences · doi:10.3390/app10103443 · Cited by 406 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
Koonce, B. (2021) · Apress eBooks · doi:10.1007/978-1-4842-6168-2 · Cited by 389
Vehicle Type Classification Using a Semisupervised Convolutional Neural Network
Dong, Z., Wu, Y., Pei, M., & Jia, Y. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2402438 · Cited by 387
Optimizing the Convolution Operation to Accelerate Deep Neural Networks on FPGA
Ma, Y., Cao, Y., Vrudhula, S., & Seo, J.-S. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2815603 · Cited by 343 · cited 1×
“The convolution operation (Conv_Op) is a mathematical operation that is commonly used in signal processing, image processing, and computer vision [65–67].”
Dogo, E. M., Afolabi, O. J., Nwulu, N. I., Twala, B., & Aigbavboa, C. O. (2018) · 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS) · doi:10.1109/ctems.2018.8769211 · Cited by 335
Facial Emotion Recognition Using Transfer Learning in the Deep CNN
Akhand, M. A. H., Roy, S., Siddique, N., Kamal, M. A. S., & Shimamura, T. (2021) · Electronics · doi:10.3390/electronics10091036 · Cited by 333
Deep Convolutional Neural Network Architecture With Reconfigurable Computation Patterns
Tu, F., Yin, S., Ouyang, P., Tang, S., Liu, L., & Wei, S. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2688340 · Cited by 319
Liu, H., Liu, T., Zhang, Z., Sangaiah, A. K., Yang, B., & Li, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3143605 · Cited by 288 · cited 1×
“CNNs can offer significant improvements in accuracy and efficiency compared to traditional ML algorithms, particularly for tasks such as image classification, object detection, and natural language processing [176,177].”
Kwabena Patrick, M., Felix Adekoya, A., Abra Mighty, A., & Edward, B. Y. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.09.014 · Cited by 282
EMG Pattern Recognition in the Era of Big Data and Deep Learning
Phinyomark, A., & Scheme, E. (2018) · Big Data and Cognitive Computing · doi:10.3390/bdcc2030021 · Cited by 272 · cited 1×
“Deep learning (DL) [9–11], which involves training neural networks with multiple layers, is a powerful subclass of ML that has shown remarkable success in various applications such as image and speech recognition [12,13].”
ThiNet: Pruning CNN Filters for a Thinner Net
Luo, J.-H., Zhang, H., Zhou, H.-Y., Xie, C.-W., Wu, J., & Lin, W. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858232 · Cited by 262
Liu, H., Zheng, C., Li, D., Shen, X., Lin, K., Wang, J., Zhang, Z., Zhang, Z., & Xiong, N. N. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3128240 · Cited by 260
Zheng, Q., Yang, M., Yang, J., Zhang, Q., & Zhang, X. (2018) · IEEE Access · doi:10.1109/access.2018.2810849 · Cited by 259
Jabbar, R., Shinoy, M., Kharbeche, M. B. M., Al‐Khalifa, K. N., Krichen, M., & Barkaoui, K. (2020) · IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT) · doi:10.1109/iciot48696.2020.9089484 · Cited by 255 · cited 2×
“[153] Developed a lightweight CNN-based model for driver sleepiness detection, achieving high accuracy rates and suitable for embedded systems and Android devices.”
Self-citationAlexNet Convolutional Neural Network for Disease Detection and Classification of Tomato Leaf
Chen, H.-C., Widodo, A. M., Wisnujati, A., Rahaman, M., Lin, J. C.-W., Chen, L., & Weng, C.-E. (2022) · Electronics · doi:10.3390/electronics11060951 · Cited by 254
Ullah, F. U. M., Ullah, A., Haq, I. U., Rho, S., & Baik, S. W. (2020) · IEEE Access · doi:10.1109/access.2019.2963045 · Cited by 222
Designing and training of a dual CNN for image denoising
Tian, C., Xu, Y., Zuo, W., Du, B., Lin, C.-W., & Zhang, D. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106949 · Cited by 219
Liu, H., Zhang, C., Deng, Y., Xie, B., Liu, T., & Li, Y.-F. (2025) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3238548 · Cited by 219 · cited 1×
“By understanding the role of each layer, researchers and practitioners can design more effective CNN architectures for a wide range of computer vision tasks [62–64].”
EHPE: Skeleton Cues-Based Gaussian Coordinate Encoding for Efficient Human Pose Estimation
Liu, H., Liu, T., Chen, Y., Zhang, Z., & Li, Y.-F. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3197364 · Cited by 213 · cited 1×
“By understanding the role of each layer, researchers and practitioners can design more effective CNN architectures for a wide range of computer vision tasks [62–64].”
A Lightweight Optical Flow CNN —Revisiting Data Fidelity and Regularization
Hui, T.-W., Tang, X., & Loy, C. C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2976928 · Cited by 210
ElSayed, M. S., Le-Khac, N.-A., Albahar, M. A., & Jurcut, A. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103160 · Cited by 207 · cited 1×
“Regularization techniques are utilized to prevent overfitting in neural networks, which occurs when the model performs well on the training data but poorly on new unseen data [106–110].”
Development of a LeNet-5 Gas Identification CNN Structure for Electronic Noses
Wei, G., Li, G., Zhao, J., & He, A. (2019) · Sensors · doi:10.3390/s19010217 · Cited by 199
Li, M., Soltanolkotabi, M., & Oymak, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11680 · Cited by 189 · cited 1×
“Early stopping: This technique stops the training process early based on a validation set performance metric, which helps to prevent the model from overfitting to the training data [122–125].”
An End-to-End Dense-InceptionNet for Image Copy-Move Forgery Detection
Zhong, J.-L., & Pun, C.-M. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2957693 · Cited by 187
Learn Keras for Deep Neural Networks
Moolayil, J. (2018) · Apress eBooks · doi:10.1007/978-1-4842-4240-7 · Cited by 182 · cited 1×
“Keras provides a simple and intuitive interface for building and training neural networks, making it an ideal choice for beginners or for rapid prototyping [159–163].”
Liu, T., Liu, H., Yang, B. X., & Zhang, Z. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3266366 · Cited by 178
Optimization and acceleration of convolutional neural networks: A survey
Habib, G., & Qureshi, S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.10.004 · Cited by 175 · cited 1×
“During training, the CNN learns to associate the extracted features with the correct labels through a process of back propagation and optimization [35–38].”
Classification of Garments from Fashion MNIST Dataset Using CNN LeNet-5 Architecture
Kayed, M., Anter, A. M., & Hadeer, M. (2020) · International Conference on Innovative Trends in Computer Engineering (ITCE) · doi:10.1109/itce48509.2020.9047776 · Cited by 169 · cited 1×
“The LeNet architecture consists of two Conv_Lays, followed by two fully connected layers [126–129].”
Regularization of deep neural networks with spectral dropout
Khan, S. H., Hayat, M., & Porikli, F. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.09.009 · Cited by 160
Sudha, V., & GaneshBabu, T. R. (2020) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2020.012008 · Cited by 158
A Fortran-Keras Deep Learning Bridge for Scientific Computing
Ott, J., Pritchard, M., Best, N., Linstead, E. J., Curcic, M., & Baldi, P. (2020) · Scientific Programming · doi:10.1155/2020/8888811 · Cited by 155
Attention Mechanisms and Their Applications to Complex Systems
Hernández, A., & Amigó, J. M. (2021) · Entropy · doi:10.3390/e23030283 · Cited by 153
Monkeypox Detection Using CNN with Transfer Learning
Altun, M., Gürüler, H., Özkaraca, O., Khan, F. N., Khan, J., & Lee, Y. (2023) · Sensors · doi:10.3390/s23041783 · Cited by 153
CBIR system using Capsule Networks and 3D CNN for Alzheimer's disease diagnosis
Kruthika, K. R., Rajeswari, & Maheshappa, H. D. (2018) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2018.12.001 · Cited by 152 · cited 1×
“Capsule networks are a recent development in CNNs that aim to improve the ability of the model to represent hierarchical relationships between objects in an image [183–187].”
Fabric Defect Detection Using Activation Layer Embedded Convolutional Neural Network
Ouyang, W., Xu, B., Hou, J., & Yuan, X. (2019) · IEEE Access · doi:10.1109/access.2019.2913620 · Cited by 150 · cited 1×
“Activation layer: The activation layer applies a non-linear activation function to the output of the previous layer [46–48].”
Yao, R., Wang, N., Liu, Z., Chen, P., & Sheng, X. (2021) · Sensors · doi:10.3390/s21020626 · Cited by 149 · cited 1×
“In a long short-term memory (LSTM) CNN, an LSTM layer is used to learn long-term dependencies in the input sequence [59–61].”
A Comparative Study of CNN and AlexNet for Detection of Disease in Potato and Mango leaf
Arya, S., & Singh, R. K. (2019) · International Conference on Issues and Challenges in Intelligent Computing Techniques · doi:10.1109/icict46931.2019.8977648 · Cited by 148
A Review of Plant Phenotypic Image Recognition Technology Based on Deep Learning
Xiong, J., Yu, D., Liu, S., Shu, L., Wang, X., & Liu, Z. (2021) · Electronics · doi:10.3390/electronics10010081 · Cited by 148 · cited 1×
“Deep learning (DL) [9–11], which involves training neural networks with multiple layers, is a powerful subclass of ML that has shown remarkable success in various applications such as image and speech recognition [12,13].”
An Overview of the Attention Mechanisms in Computer Vision
Yang, X. C. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1693/1/012173 · Cited by 147
Alam, N.-A., Ahsan, M., Based, M. A., & Haider, J. (2021) · Technologies · doi:10.3390/technologies9010009 · Cited by 141 · cited 1×
“Figure 4 shows a simplified illustration of a CNN used for image classification [39–41].”
An analysis of convolutional neural networks for speech recognition
Huang, J.-T., Li, J., & Gong, Y. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178920 · Cited by 140 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
A Five Convolutional Layer Deep Convolutional Neural Network for Plant Leaf Disease Detection
Pandian, J. A., Kanchanadevi, K., Kumar, V. D., Jasińska, E., Goňo, R., Leonowicz, Z. M., & Jasiński, M. (2022) · Electronics · doi:10.3390/electronics11081266 · Cited by 140
Fesseha, A., Xiong, S., Emiru, E. D., Diallo, M., & Dahou, A. (2021) · Information · doi:10.3390/info12020052 · Cited by 139
Noisy training for deep neural networks in speech recognition
Yin, S., Liu, C., Zhang, Z., Lin, Y., Wang, D., Tejedor, J., Zheng, T. F., & Li, Y. (2015) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-014-0047-0 · Cited by 136 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
Programming with TensorFlow: Solution for Edge Computing Applications
(2021) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-57077-4 · Cited by 134
Application of Convolutional Neural Network in Natural Language Processing
Wang, W., & Gang, J. (2018) · IEEE International Conference on Information Systems and Computer Aided Education (ICISCAE) · doi:10.1109/iciscae.2018.8666928 · Cited by 123
Giménez, M., Palanca, J., & Botti, V. J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.08.096 · Cited by 117 · cited 1×
“Convolutional neural networks (CNNs) [14–16] are a popular type of ML model that have been widely utilized for various tasks, including image recognition [17–20], speech recognition [21–25], and NLP [26–30].”
Introduction to convolutional neural network using Keras; an understanding from a statistician
Lee, H., & Song, J. (2019) · Communications for Statistical Applications and Methods · doi:10.29220/csam.2019.26.6.591 · Cited by 117 · cited 1×
“Keras provides a simple and intuitive interface for building and training neural networks, making it an ideal choice for beginners or for rapid prototyping [159–163].”
Are Formal Methods Applicable To Machine Learning And Artificial Intelligence?
Krichen, M., Mihoub, A., Alzahrani, M. Y., Adoni, W. Y. H., & Nahhal, T. (2022) · International Conference of Smart Systems and Emerging Technologies (SMARTTECH) · doi:10.1109/smarttech54121.2022.00025 · Cited by 116
Self-citationEarly stopping by correlating online indicators in neural networks
Ferro, M. V., Doval, Y., Ribadas, F. J., & Bilbao, V. M. D. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.11.035 · Cited by 116
RunPool: A Dynamic Pooling Layer for Convolution Neural Network
Jie, H. J., & Wanda, P. (2020) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.d.200120.002 · Cited by 112 · cited 1×
“Pooling layer: The pooling layer is used to reduce the spatial dimensions of the feature maps produced by the convolutional layer [44,45].”
Intelligent handwritten recognition using hybrid CNN architectures based-SVM classifier with dropout
Ali, A. A. A., & Suresha, M. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.01.012 · Cited by 110
Olive Disease Classification Based on Vision Transformer and CNN Models
Alshammari, H. H., Gasmi, K., Ltaifa, I. B., Krichen, M., Ammar, L. B., & Mahmood, M. A. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/3998193 · Cited by 110
Self-citationTransform Quantization for CNN Compression
Young, S. I., Wang, Z., Taubman, D., & Girod, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3084839 · Cited by 109 · cited 1×
“Quantization and compression are techniques that reduce the memory and computational requirements of CNNs [198–201].”
A fully connected layer elimination for a binarizec convolutional neural network on an FPGA
Nakahara, H., Fujii, T., & Sato, S. (2017) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.23919/fpl.2017.8056771 · Cited by 108 · cited 1×
“Fully connected layer: The fully connected layer is a traditional neural network layer that connects every neuron in the previous layer to every neuron in the current layer [53–56].”
The Role of Activation Function in CNN
Wang, H., Yizhou, W., Yaqin, L., & Zhili, S. (2020) · International Conference on Information Technology and Computer Application (ITCA) · doi:10.1109/itca52113.2020.00096 · Cited by 107 · cited 1×
“Activation functions (Activ_Funcs) are an essential component in CNNs that introduce non-linearity into the model [80–85].”
Athisayamani, S., Antonyswamy, R. S., Sarveshwaran, V., Almeshari, M. Y., Alzamil, Y., & Ravi, V. (2023) · Diagnostics · doi:10.3390/diagnostics13040668 · Cited by 102
Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters Revisited
Barroso-Laguna, A., & Mikolajczyk, K. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3145820 · Cited by 101
Wang, J., Liu, Y., Hu, Y., Shi, H., & Mei, T. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3478324 · Cited by 96
Dua, S., Kumar, S. S., Albagory, Y. A., Ramalingam, R., Dumka, A., Singh, R., Rashid, M. U., Gehlot, A., Alshamrani, S. S., & AlGhamdi, A. S. (2022) · Applied Sciences · doi:10.3390/app12126223 · Cited by 96
MOOC Dropout Prediction Using FWTS-CNN Model Based on Fused Feature Weighting and Time Series
Zheng, Y., Gao, Z., Wang, Y., & Fu, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3045157 · Cited by 93 · cited 1×
“Dropout: This technique randomly drops out some of the neurons in the network during training, which helps to prevent the model from relying too heavily on any one feature and can improve generalization performance [119–121].”
Cataract Detection Using Convolutional Neural Network with VGG-19 Model
Khan, M. S. M., Ahmed, M., Rasel, R. Z., & Khan, M. M. (2021) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot52608.2021.9454244 · Cited by 92
Robust Vehicle Detection in Aerial Images Based on Cascaded Convolutional Neural Networks
Zhong, J., Leí, T., & Yao, G. (2017) · Sensors · doi:10.3390/s17122720 · Cited by 91
The Impact of Filter Size and Number of Filters on Classification Accuracy in CNN
Ahmed, W. S., & Karim, A. A. A. (2020) · doi:10.1109/csase48920.2020.9142089 · Cited by 89
Rolling-Element Bearing Fault Diagnosis Using Improved LeNet-5 Network
Wan, L., Chen, Y., Li, H., & Li, C. (2020) · Sensors · doi:10.3390/s20061693 · Cited by 88
Emotional Speech Recognition Using Deep Neural Networks
Van, L. T., Thủy, Đ. T., Xuan, T. L., & Castelli, E. (2022) · Sensors · doi:10.3390/s22041414 · Cited by 88
Finger vein recognition based on lightweight CNN combining center loss and dynamic regularization
Zhao, D., Ma, H., Yang, Z., Li, J., & Tian, W. (2020) · Infrared Physics & Technology · doi:10.1016/j.infrared.2020.103221 · Cited by 87
FPDeep: Acceleration and Load Balancing of CNN Training on FPGA Clusters
Geng, T., Wang, T., Sanaullah, A., Yang, C., Xu, R., Patel, R., & Herbordt, M. (2018) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2018.00021 · Cited by 81
Mondal, A., & Shrivastava, V. K. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106183 · Cited by 78
Artificial intelligence, at Africa’s door
Marwala, T. (2019) · The UNESCO Courier · doi:10.18356/d94175df-en · Cited by 74
Optimization of a Pre-Trained AlexNet Model for Detecting and Localizing Image Forgeries
Samir, S., Emary, E., El-Sayed, K., & Onsi, H. M. (2020) · Information · doi:10.3390/info11050275 · Cited by 72 · cited 1×
“AlexNet is a CNN architecture developed by Alex Krizhevsky et al. in 2012, which achieved state-of-the-art performance on the ImageNet dataset [130–132].”
He, Y., Chen, H., Liu, D., & Zhang, L. (2021) · Applied Sciences · doi:10.3390/app11199345 · Cited by 68
Bilal, A., Shafiq, M., Fang, F., Waqar, M., Ullah, I., Ghadi, Y. Y., Long, H., & Zeng, R. (2022) · Sensors · doi:10.3390/s22249603 · Cited by 67
Parcham, E., Ilbeygi, M., & Amini, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115649 · Cited by 67
Alani, A. A. (2017) · Information · doi:10.3390/info8040142 · Cited by 66
Deep Convolutional Neural Network Based Image Spam Classification
Srinivasan, S., Ravi, V., Sowmya, V., Krichen, M., Noureddine, D. B., Shashank, A., & Soman, K. P. (2020) · International Conference on Data Science and Machine Learning Applications (CDMA) · doi:10.1109/cdma47397.2020.00025 · Cited by 61
Self-citationLearn TensorFlow 2.0: Implement Machine Learning and Deep Learning Models with Python
Singh, P. K., & Manure, A. (2019) · Apress eBooks · doi:10.1007/978-1-4842-5558-2 · Cited by 61
A Formal Testing Model for Operating Room Control System using Internet of Things
Krichen, M., Mechti, S., Alroobaea, R., Said, E., Singh, P., Khalaf, O. I., & Masud, M. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2021.014090 · Cited by 58
Self-citationSay, D., Zidi, S., Qaisar, S. M., & Krichen, M. (2023) · Sensors · doi:10.3390/s23146422 · Cited by 58 · cited 2×
“The proposed method in [149] uses a convolutional neural network (CNN) and data augmentation to identify multi-class welding errors in X-ray pictures (see Figures 8 and 9).”
Self-citationChannel and filter parallelism for large-scale CNN training
Dryden, N., Maruyama, N., Moon, T., Benson, T., Snir, M., & Essen, B. V. (2019) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3295500.3356207 · Cited by 57
Automatic Compiler Based FPGA Accelerator for CNN Training
Venkataramanaiah, S. K., Ma, Y., Yin, S., Nurvithadhi, E., Dasu, A. R., Cao, Y. K., & Seo, J.-S. (2019) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2019.00034 · Cited by 57 · cited 1×
“Training a CNN involves adjusting the weights and biases of the model so that it produces accurate predictions on the training data [94–99].”
Detection of COVID 19 from CT Image by The Novel LeNet-5 CNN Architecture
Islam, M. R., & Matin, A. (2020) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit51783.2020.9392723 · Cited by 56 · cited 1×
“The LeNet architecture consists of two Conv_Lays, followed by two fully connected layers [126–129].”
Improving Strong-Scaling of CNN Training by Exploiting Finer-Grained Parallelism
Dryden, N., Maruyama, N., Benson, T., Moon, T., Snir, M., & Essen, B. V. (2019) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2019.00031 · Cited by 55
Adaptive Spatiotemporal InceptionNet for Traffic Flow Forecasting
Wang, Y., Jing, C., Huang, W., Jin, S., & Lv, X. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3237205 · Cited by 55
Statistical Karyotype Analysis Using CNN and Geometric Optimization
Xie, N., Li, X., Li, K., Yang, Y., & Shen, H. T. (2019) · IEEE Access · doi:10.1109/access.2019.2951723 · Cited by 54 · cited 1×
“Optimization algorithms are utilized to update the weights and biases of a neural network during training to minimize the Loss_Func [104,105].”
Intrusion Detection by Deep Learning with TensorFlow
Chockwanich, N., & Visoottiviseth, V. (2019) · International Conference on Advanced Communication Technology · doi:10.23919/icact.2019.8701969 · Cited by 52
Variational-Based Mixed Noise Removal With CNN Deep Learning Regularization
Wang, F., Huang, H., & Liu, J. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2940496 · Cited by 52 · cited 1×
“Regularization techniques are utilized to prevent overfitting in neural networks, which occurs when the model performs well on the training data but poorly on new unseen data [106–110].”
Jiang, P., Xue, Y., & Neri, F. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110229 · Cited by 50
Convolutional neural network simplification via feature map pruning
Zou, J., Rui, T., Zhou, Y., Yang, C., & Zhang, S. (2018) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2018.01.036 · Cited by 49
Li, X., Li, D., Ren, W., & Zhang, J.-S. (2022) · Sensors · doi:10.3390/s22186825 · Cited by 48
Ding, C., Wang, Z., Ding, Q., & Zhao, Y. (2022) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2022.100888 · Cited by 47
Lu, W., Sun, H., Chu, J., Huang, X., & Yu, J. (2018) · IEEE Access · doi:10.1109/access.2018.2851942 · Cited by 46
Yang, C., Wang, Y., Wang, X., & Geng, L. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.2985727 · Cited by 46
Application of Convolutional Neural Network in Natural Language Processing
Li, P., Li, J., & Wang, G. (2018) · International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP) · doi:10.1109/iccwamtip.2018.8632576 · Cited by 46
Du, Y., Yang, R., Chen, Z., Wang, L., Weng, X., & Liu, X. (2020) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.2169 · Cited by 45 · cited 1×
“It is designed for efficient computation of deep neural networks, including CNNs, and includes a wide range of pre-trained models that can be utilized for various computer vision tasks [169–173].”
Qu, S., Li, B., Wang, Y., Xu, D., Zhao, X., & Zhang, L. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218724 · Cited by 45 · cited 1×
“Quantization and compression are techniques that reduce the memory and computational requirements of CNNs [198–201].”
Krichen, M., Cheikhrouhou, O., Lahami, M., Alroobaea, R., & Maâlej, A. J. (2018) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-94180-6_34 · Cited by 43
Self-citationA Novel Fault Diagnosis Method Based on SWT and VGG-LSTM Model for Hydraulic Axial Piston Pump
Zhu, Y., Su, H., Tang, S., Zhang, S., Zhou, T., & Wang, J. (2023) · Journal of Marine Science and Engineering · doi:10.3390/jmse11030594 · Cited by 43 · cited 1×
“VGG is a CNN architecture developed by Karen Simonyan and Andrew Zisserman in 2014, which achieved state-of-the-art performance on the ImageNet dataset [133–137].”
Automatic modulation classification based on joint feature map and convolutional neural network
Wang, F., Yang, C., Huang, S., & Wang, H. (2019) · IET Radar Sonar & Navigation · doi:10.1049/iet-rsn.2018.5549 · Cited by 42
Adaptation of Convolution and Batch Normalization Layer for CNN Implementation on FPGA
Sledević, T. (2019) · IEEE Open Conference of Electrical, Electronic and Information Sciences (eStream) · doi:10.1109/estream.2019.8732160 · Cited by 42 · cited 1×
“• Batch normalization layer: The batch normalization layer normalizes the output of the previous layer by subtracting the mean and dividing by the standard deviation of the batch [49,50].”
A Formal Framework for Conformance Testing of Distributed Real-Time Systems
Krichen, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17653-1_12 · Cited by 41
Self-citationKumar, G. K., Parimalasundar, E., Elangovan, D., Padmanaban, S., Iannuzzo, F., & Holm‐Nielsen, J. B. (2020) · Energies · doi:10.3390/en13061299 · Cited by 40
Caffe CNN-based classification of hyperspectral images on GPU
Garea, A. S., Heras, D. B., & Argüello, F. (2018) · The Journal of Supercomputing · doi:10.1007/s11227-018-2300-2 · Cited by 39
Suitable CNN Weight Initialization and Activation Function for Javanese Vowels Classification
Dewa, C. K., & Afiahayati (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.512 · Cited by 39
Dense Layer Dropout Based CNN Architecture for Automatic Modulation Classification
Dileep, P., Das, D., & Bora, P. K. (2020) · National Conference on Communications · doi:10.1109/ncc48643.2020.9055989 · Cited by 39 · cited 1×
“Dropout layer: The dropout layer randomly drops out a percentage of the neurons in the previous layer during training [51,52].”
A model-based approach to combine conformance and load tests: an eHealth case study
Krichen, M., Maâlej, A. J., & Lahami, M. (2018) · International Journal of Critical Computer-Based Systems · doi:10.1504/ijccbs.2018.096437 · Cited by 39
Self-citationA Method of Speech Coding for Speech Recognition Using a Convolutional Neural Network
Kubanek, M., Bobulski, J., & Kulawik, J. (2019) · Symmetry · doi:10.3390/sym11091185 · Cited by 38
Convolutional Neural Networks: A Roundup and Benchmark of Their Pooling Layer Variants
Galanis, N.-I., Vafiadis, P., Mirzaev, K.-G., & Papakostas, G. A. (2022) · Algorithms · doi:10.3390/a15110391 · Cited by 38 · cited 1×
“Pooling layer: The pooling layer is used to reduce the spatial dimensions of the feature maps produced by the convolutional layer [44,45].”
State Identification Problems for Timed Automata
Krichen, M., & Tripakis, S. (2005) · Lecture notes in computer science · doi:10.1007/11430230_13 · Cited by 38 · cited 1×
“Formal methods can provide a high degree of confidence in the correctness of a system by proving that it meets a set of formal specifications and requirements [207–210].”
Self-citationInteresting Properties of the Real-Time Conformance Relation tioco
Krichen, M., & Tripakis, S. (2006) · Lecture notes in computer science · doi:10.1007/11921240_22 · Cited by 36 · cited 1×
“Formal methods can help to address these challenges by providing a rigorous approach to designing and verifying CNNs. Formal methods are a set of mathematical techniques for specifying, modeling, and verifying systems [202–206].”
Self-citationModel-Based Conformance Testing of WS-BPEL Compositions
Maâlej, A. J., Krichen, M., & Jmaïel, M. (2012) · IEEE Annual Computer Software and Applications Conference Workshops (COMPSACW) · doi:10.1109/compsacw.2012.86 · Cited by 35
Self-citationInvestigation of Padding Schemes for Faster R-CNN on Vehicle Detection
Wiranata, A., Wibowo, S. A., Patmasari, R., Rahmania, R., & Mayasari, R. (2018) · International Conference on Control, Electronics, Renewable Energy and Communications (ICCEREC) · doi:10.1109/iccerec.2018.8712086 · Cited by 33 · cited 1×
“Padding, stride, and filters are important parameters in CNNs that determine the size and resolution of the output feature maps (Feat_Maps) [86–93].”
CNN Convolutional layer optimisation based on quantum evolutionary algorithm
Lu, T.-C. (2020) · Connection Science · doi:10.1080/09540091.2020.1841111 · Cited by 33 · cited 1×
“A CNN typically consists of multiple layers, each with a specific function in the network: • Convolutional layer: The convolutional layer is the core building block of a CNN [42,43].”
Jeong, D. U., & Lim, K. M. (2021) · Scientific Reports · doi:10.1038/s41598-021-99975-6 · Cited by 33
Runtime testing approach of structural adaptations for dynamic and distributed systems
Lahami, M., Krichen, M., & Jmaïel, M. (2015) · International Journal of Computer Applications in Technology · doi:10.1504/ijcat.2015.070489 · Cited by 32 · cited 1×
“Formal methods can help to address these challenges by providing a rigorous approach to designing and verifying CNNs. Formal methods are a set of mathematical techniques for specifying, modeling, and verifying systems [202–206].”
Self-citationLiu, K., Qin, S., Ning, J., Xin, P., Wang, Q., Chen, Y., Zhao, W., Zhang, E., & Lang, N. (2023) · Cancers · doi:10.3390/cancers15112974 · Cited by 31
Vigneshwaran, B., Maheswari, R. V., Kalaivani, L., Shanmuganathan, V., Rho, S., Kadry, S., & Lee, M. Y. (2021) · Energy Reports · doi:10.1016/j.egyr.2020.12.044 · Cited by 29
An Adaptive Offset Activation Function for CNN Image Classification Tasks
Jiang, Y., Xie, J., & Zhang, D. (2022) · Electronics · doi:10.3390/electronics11223799 · Cited by 29
Wang, S., Hong, J., & Yang, M. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6798-3 · Cited by 28
Naseri, H., & Mehrdad, V. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14603-x · Cited by 28
Visual Speech Recognition for Kannada Language Using VGG16 Convolutional Neural Network
Shashidhar, R., Kulkarni, S. P., Gururaj, H. L., Ravi, V., & Krichen, M. (2023) · Acoustics · doi:10.3390/acoustics5010020 · Cited by 28 · cited 2×
“[150] Developed a novel dataset and machine-learning-based VSR technique for Kannada, achieving 91.90% accuracy.”
InfluentialSelf-citationArtificial Neural Networks with TensorFlow 2: ANN Architecture Machine Learning Projects
Sarang, P. (2020) · Apress eBooks · doi:10.1007/978-1-4842-6150-7 · Cited by 27
Deepfake Face Detection Using Deep InceptionNet Learning Algorithm
Theerthagiri, P., & Nagaladinne, G. B. (2023) · IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS) · doi:10.1109/sceecs57921.2023.10063128 · Cited by 27
Design on Intelligent Feature Graphics Based on Convolution Operation
Li, Y., & Tang, Y. (2022) · Mathematics · doi:10.3390/math10030384 · Cited by 24
Robust SAR Automatic Target Recognition Based on Transferred MS-CNN with L2-Regularization
Zhai, Y., Deng, W., Xu, Y., Ke, Q., Gan, J., Sun, B. S., Zeng, J., & Piuri, V. (2019) · Computational Intelligence and Neuroscience · doi:10.1155/2019/9140167 · Cited by 23
Abouelmagd, L. M., Darwish, A., Snåšel, V., & Hassanien, A. E. (2022) · Cluster Computing · doi:10.1007/s10586-022-03703-2 · Cited by 23
Review of convolutional neural network optimization and training in image processing
Ren, Y., & Cheng, X. (2019) · Tenth International Symposium on Precision Engineering Measurements and Instrumentation · doi:10.1117/12.2512087 · Cited by 22
Optimizing Weight Value Quantization for CNN Inference
Nogami, W., Ikegami, T., O’uchi, S., Takano, R., & Kudoh, T. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852331 · Cited by 22
Gradient rectified parameter unit of the fully connected layer in convolutional neural networks
Zheng, T., Wang, Q., Shen, Y., & Lin, X. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108797 · Cited by 22
L2 regularized deep convolutional neural networks for fire detection
Roy, S. S., Goti, V., Sood, A. K., Roy, H., Gavrila, T. B., Floroian, D., Paraschiv, N., & Mohammadi-Ivatloo, B. (2022) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-219281 · Cited by 21
Prediction of Prospecting Target Based on ResNet Convolutional Neural Network
Gao, L., Huang, Y., Zhang, X., Liu, Q., & Chen, Z. (2022) · Applied Sciences · doi:10.3390/app122211433 · Cited by 21 · cited 1×
“ResNet is a CNN architecture developed by Kaiming He et al. in 2015, which introduced the concept of residual connections to address the problem of vanishing gradients in deep networks [138–143].”
Wei, Q., & Wang, W. (2017) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/69/1/012156 · Cited by 20 · cited 1×
“Some commonly utilized regularization techniques include: • L1 regularization: This technique adds a penalty to the Loss_Func proportional to the absolute value of the weights, which encourages the model to have sparse weights and can lead to feature selection [111–114].”
Safder, I., Hassan, S., & Aljohani, N. R. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3186334 · Cited by 20 · cited 1×
“For example, in a recurrent CNN (RCNN), a recurrent layer is added to the network to capture temporal dependencies in the input sequence [57,58].”
CNN adversarial attack mitigation using perturbed samples training
Hashemi, A. S., & Mozaffari, S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10379-6 · Cited by 20
Ramachandran, D., Kumar, R. S., Alkhayyat, A. H., Malik, R. Q., Srinivasan, P., Priya, G. G., & Adigo, A. G. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/6348424 · Cited by 19
BPLight-CNN: A Photonics-Based Backpropagation Accelerator for Deep Learning
Dang, D., Chittamuru, S. V. R., Pasricha, S., Mahapatra, R., & Sahoo, D. (2021) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3446212 · Cited by 18
Recurrence along Depth: Deep Convolutional Neural Networks with Recurrent Layer AggregationPreprint
Zhao, J., Fang, Y., & Li, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.11852 · Cited by 18 · cited 1×
“For example, in a recurrent CNN (RCNN), a recurrent layer is added to the network to capture temporal dependencies in the input sequence [57,58].”
Study on the influence of variable stride scale change on image recognition in CNN
Guo, C., Liu, Y.-L., & Jiao, X. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6861-0 · Cited by 17
Automated CNN back-propagation pipeline generation for FPGA online training
Mazouz, A., & Bridges, C. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-021-01147-2 · Cited by 16 · cited 1×
“Back propagation is an algorithm utilized to efficiently compute the gradients of the Loss_Func with respect to the weights and biases of a neural network [100–103].”
Improving the Performance of Distributed MXNet with RDMA
Li, M., Wen, K., Han, L., Jin, X., Wu, Z., An, H., & Chi, M. (2018) · International Journal of Parallel Programming · doi:10.1007/s10766-018-00623-w · Cited by 15 · cited 1×
“It provides a wide range of tools and libraries for building and deploying DL models, including CNNs [174,175].”
Jabbar, R., Krichen, M., Fetais, N., & Barkaoui, K. (2020) · International Conference on Enterprise Information Systems · doi:10.5220/0009592102610268 · Cited by 15
Self-citationAtika, L., Nurmaini, S., Partan, R. U., & Sukandi, E. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6040141 · Cited by 15 · cited 1×
“ResNet is a CNN architecture developed by Kaiming He et al. in 2015, which introduced the concept of residual connections to address the problem of vanishing gradients in deep networks [138–143].”
Evaluation of Convolution Operation Based on the Interpretation of Deep Learning on 3-D Point Cloud
Zhao, B., Hua, X., Yu, K., Tao, W., He, X., Feng, S., & Tian, P. (2020) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2020.3020321 · Cited by 14 · cited 1×
“The convolution operation (Conv_Op) is a mathematical operation that is commonly used in signal processing, image processing, and computer vision [65–67].”
A novel scaled-gamma-tanh (SGT) activation function in 3D CNN applied for MRI classification
Khagi, B., & Kwon, G. (2022) · Scientific Reports · doi:10.1038/s41598-022-19020-y · Cited by 13
Accelerating 3D Convolutional Neural Networks Using 3D Fast Fourier Transform
Fang, C., He, L., Wang, H., Wei, J., & Wang, Z. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401765 · Cited by 12
Automatic Seizure Detection Using Modified CNN Architecture and Activation Layer
Khan, I. D., Farooq, O., & Khan, Y. U. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2318/1/012013 · Cited by 12
Model Based Testing for Real-Time Systems
Krichen, M. (2007) · doi:10.13140/rg.2.2.23748.88961 · Cited by 12
Self-citationZhu, G., Fan, Y., Li, F., Choi, A. T. H., Tan, Z., Cheng, Y., Li, K., Wang, S., Luo, C., Liu, H., et al. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120439 · Cited by 11 · cited 1×
“Adversarial attacks are a type of attack where an attacker adds small, imperceptible perturbations to the input data, causing the model to misclassify the input [193–197].”
Aruna, R., Devi, M. S., Anand, A., Dutta, U., & Sagar, C. N. S. (2023) · International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT) · doi:10.1109/icaect57570.2023.10117792 · Cited by 11 · cited 1×
“• L2 regularization: This technique adds a penalty to the Loss_Func proportional to the square of the weights, which encourages the model to have small weights and can help to prevent overfitting [115–118].”
Virtual Adversarial Training for DS-CNN Based Small-Footprint Keyword Spotting
Wang, X., Sun, S., & Xie, L. (2019) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru46091.2019.9003745 · Cited by 10
Kim, J., & Cho, J. (2021) · Applied Sciences · doi:10.3390/app11114940 · Cited by 10
A Correntropy Based Artificial Neural Network using Early Stopping for Daily Peak Load Forecasting
Sato, N., Fukuyama, Y., Iizaka, T., & Matsui, T. (2020) · Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) · doi:10.23919/sice48898.2020.9240336 · Cited by 8
Optimization of CNN in Capsule Networks for Alzheimer’s Disease Prediction Using CT Images
Ananya, P. R., Pachisia, V., & Ushasukhanya, S. (2022) · Advances in intelligent systems and computing · doi:10.1007/978-981-16-5652-1_49 · Cited by 8
Jannat, T., Hossain, M. A., & Sayeed, A. (2022) · International Conference on Computer and Information Technology (ICCIT) · doi:10.1109/iccit57492.2022.10055091 · Cited by 8
Rodríguez-Lois, E., Vázquez-Padín, D., Pérez‐González, F., & Comesaña, P. (2022) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco55093.2022.9909784 · Cited by 7
Regularization in CNN: A Mathematical Study for $$L_1$$, $$L_2$$ and Dropout Regularizers
Mehdi, C. A., Joudar, N., & Ettaouil, M. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-26384-2_38 · Cited by 7
Character Recognition using Adjustment Convolutional Network with Dropout Layer
Setiawan, W. (2021) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/1125/1/012049 · Cited by 6 · cited 1×
“Dropout layer: The dropout layer randomly drops out a percentage of the neurons in the previous layer during training [51,52].”
An Scrupulous Framework to Forecast the Weather using CNN with Back Propagation Method
Raj, V., Kumar, R. S., & Kumar, N. S. (2022) · International Conference on Advances in Computing, Communication Control and Networking (ICAC3N) · doi:10.1109/icac3n56670.2022.10074346 · Cited by 6
Smooth Group L1/2 Regularization for Pruning Convolutional Neural Networks
Bao, Y., Liu, Z., Luo, Z., & Yang, S. (2022) · Symmetry · doi:10.3390/sym14010154 · Cited by 5 · cited 1×
“Some commonly utilized regularization techniques include: • L1 regularization: This technique adds a penalty to the Loss_Func proportional to the absolute value of the weights, which encourages the model to have sparse weights and can lead to feature selection [111–114].”
Kushchenko, A. S., Ternovoy, N. E., Popov, M. G., & Yakunin, A. N. (2022) · IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering · doi:10.1109/elconrus54750.2022.9755741 · Cited by 5 · cited 1×
“The Conv_Op can be performed using various methods, including the direct method, the Fourier method, and the fast Fourier transform (FFT) method [68–73].”
Conformance testing for quality assurance of clustering architectures
Maâlej, A. J., Makhlouf, Z. B., Krichen, M., & Jmaïel, M. (2013) · doi:10.1145/2489300.2489338 · Cited by 4
Self-citationTóth, L., & Gosztolya, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-26061-3_49 · Cited by 4 · cited 1×
“Adversarial attacks are a type of attack where an attacker adds small, imperceptible perturbations to the input data, causing the model to misclassify the input [193–197].”
Yang, C., Yang, Z., Hou, J., & Su, Y. (2021) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs53924.2021.9665520 · Cited by 4 · cited 1×
“Fully connected layer: The fully connected layer is a traditional neural network layer that connects every neuron in the previous layer to every neuron in the current layer [53–56].”
Web Service Anti-patterns Detection Using CNN with Varying Sequence Padding Size
Tummalapalli, S., Kumar, L., & Murthy, N. L. B. (2022) · Studies in systems, decision and control · doi:10.1007/978-981-19-6893-8_13 · Cited by 4
Jaramillo-Munera, Y., Sepulveda-Cano, L. M., Castro-Ospina, A. E., Duque‐Muñoz, L., & Martinez-Vargas, J. D. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-32213-6_16 · Cited by 4
Energy Efficient CNN Inference Accelerator Using Fast Fourier Transform
Chung, Y.-C., Cheng, P.-H., & Li, Y. (2019) · International Symposium on VLSI Design, Automation and Test · doi:10.1109/vlsi-dat.2019.8741633 · Cited by 3
The Quantitative Relationship between Adversarial Training and Robustness of CNN Model
Wang, J., Lu, M., Ai, J., & Sun, X. (2020) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa51864.2020.00092 · Cited by 3
Classification of Pneumonia using InceptionNet, ResNet and CNN
Vijaya, N., Chinta, M., Kavya, E., & Sumanth Varma, L. (2022) · International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) · doi:10.1109/csitss57437.2022.10026402 · Cited by 3
Ameryan, M., & Schomaker, L. (2023) · Journal on Computing and Cultural Heritage · doi:10.1145/3587168 · Cited by 3 · cited 1×
“Early stopping: This technique stops the training process early based on a validation set performance metric, which helps to prevent the model from overfitting to the training data [122–125].”
On Construction of a Caffe Deep Learning Framework based on Intel Xeon Phi
Yang, C., Liu, J., Chan, Y.-W., Kristiani, E., & Kuo, C.-F. (2018) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-030-02607-3_9 · Cited by 2
Queued Commuter Counting System by using Caffe Deep Learning Technique
Mopung, C., Hama, H., Moonngam, P., & Chucherd, S. (2021) · Warasan Witthayasat Mahawitthayalai Naresuan · Cited by 2
Sentiment Analysis of Tweets by Convolution Neural Network with L1 and L2 Regularization
Rangra, A., Sehgal, V. K., & Shukla, S. (2018) · Communications in computer and information science · doi:10.1007/978-981-13-3140-4_32 · Cited by 1
Intelligent Traffic Light Control System using Caffe Model: A Deep Learning Strategy
Jaspin, K., Ajitha, E., Rose, J. D., & Sherin, K. M. (2023) · Winter Summit on Smart Computing and Networks (WiSSCoN) · doi:10.1109/wisscon56857.2023.10133847 · Cited by 1
Research works printed but not linked: 9
- Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
- Bengio, Y., Goodfellow, I., and Courville, A. (2017). Deep Learning, MIT Press.
- Gan, 2019, Research of facial beauty prediction based on deep convolutional features using double activation layer, Acta Electonica Sin., 47, 636
- Simon, 2019, Shallow cnn with lstm layer for tuberculosis detection in microscopic images, Int. J. Recent Technol. Eng., 7, 56
- Ndong, P.S.B., Adoni, W.Y.H., Nahhal, T., Kimpolo, C., Krichen, M., Byed, A.E., Assayad, I., and Mutombo, F.K. (2021). Advances on Smart and Soft Computing: Proceedings of ICACIn 2021, Springer.
- Mehdi, C.A., Nour-Eddine, J., and Mohamed, E. (2022, January 22–27). Regularization in CNN: A Mathematical Study for L 1, L 2 and Dropout Regularizers. Proceedings of the International Conference on Advanced Intelligent Systems for Sustainable Development, Rabat, Morocco. · DOI
- Moolayil, J., Moolayil, J., and John, S. (2019). Learn Keras for Deep Neural Networks, Springer. · DOI
- Wu, P. (2021-, January 27). PyTorch 2.0: The Journey to Bringing Compiler Technologies to the Core of PyTorch (Keynote). Proceedings of the 21st ACM/IEEE International Symposium on Code Generation and Optimization, Virtual.
- Rundong, 2022, Multidimensional Linear Data Processing Based on OpenCL Kernel Function in MXNet Framework, Front. Data Domputing, 4, 29
Cited by
A Comprehensive Overview and Comparative Analysis on Deep Learning Models
Perumal, T., Mustapha, N., Mohamed, R., & Shiri, F. M. (2024) · Journal on artificial intelligence · doi:10.32604/jai.2024.054314 · Cited by 664
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246
“Finally, RobotReviewer/RobotSearch employs an ensemble classifier, combining multiple CNN models [101] and soft-margin Support Vector Machines [102] in order to categorise articles based on their risk of bias assessment (either low or high/unclear) and concurrently extract sentences that…”
Deep Convolutional Neural Networks in Medical Image Analysis: A Review
Mienye, I. D., Swart, T. G., Obaido, G., Jordan, M., & Ilono, P. (2025) · Information · doi:10.3390/info16030195 · Cited by 242
“Medical image analysis requires robust algorithms capable of extracting subtle patterns from high-dimensional and often noisy datasets, a challenge that CNNs are uniquely equipped to address [11–13].”
Khanam, R., Hussain, M., Hill, R., & Allen, P. (2024) · IEEE Access · doi:10.1109/access.2024.3425166 · Cited by 237
Generative Artificial Intelligence in Education: Advancing Adaptive and Personalized Learning
Guettala, M., Bourekkache, S., Kazar, O., & Harous, S. (2024) · Acta Informatica Pragensia · doi:10.18267/j.aip.235 · Cited by 218
Metadata
- Authors
- Krichen, M.
- Affiliations
- University of Sfax (TN)
- Corresponding author
- Krichen, Moez
- ORCID
- Krichen, Moez
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2023-07-28
- Volume
- 12
- Issue
- 8
- Pages
- 151
- ISSN
- 2073-431X (ISSN-L)
- OpenAlex
- W4385342469
- Cited by
- 623
- References
- 199
- Citations by year
- 2026: 144 · 2025: 242 · 2024: 189 · 2023: 48
- FWCI
- 56.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Computers (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- convolutional neural networks, image recognition, convolutional neural network architecture, LeNet, AlexNet, VGG, ResNet, InceptionNet, activation functions, hyperparameter optimization, deep learning libraries, attention mechanism, capsule networks, transfer learning, adversarial training, model compression, formal verification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.