The DOI matches its Crossref record; 274 of the 286 references it cites were found in a registry or an index.
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Abstract
Convolutional neural networks (CNNs) have been applied to visual tasks since the late 1980s. However, despite a few scattered applications, they were dormant until the mid-2000s when developments in computing power and the advent of large amounts of labeled data, supplemented by improved algorithms, contributed to their advancement and brought them to the forefront of a neural network renaissance that has seen rapid progression since 2012. In this review, which focuses on the application of CNNs to image classification tasks, we cover their development, from their predecessors up to recent state-of-the-art deep learning systems. Along the way, we analyze (1) their early successes, (2) their role in the deep learning renaissance, (3) selected symbolic works that have contributed to their recent popularity, and (4) several improvement attempts by reviewing contributions and challenges of over 300 publications. We also introduce some of their current trends and remaining challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Therefore, the output features include the specific pose information of objects, which means that CapsNet has the ability to recognize the orientation.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
In the citing paper
“Some experiments have proved that CapsNet is able to reach state-ofthe-art results.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
In the citing paper
“Although it did not achieve satisfactory results on complicated large-scale data sets, like CIFAR-100 or ImageNet, we can see that it is potential.”
From A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects (2022) · cites this paper as [186]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Flagged first, then by citations
12 of the 286 references couldn’t be matched to a known paper.
Research works printed but not linked: 86
- Abdulkader A., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition, 1
- Arora S., 2014, Proceedings of the 31th International Conference Machine Learning, 584
- Ba J., 2013, Advances in neural information processing systems, 26, 3084
- Ba J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Bachman P., 2016, Advances in neural information processing systemsm, 29, 4826
- Baldi P., 2013, Advances in neural information processing systems, 26, 3084
- Belkin M., 2006, Journal of Machine Learning Research, 7, 2399
- Bengio Y., 2014, Proceedings of the 31st International Conference Machine Learning, 226
- Bulo S., 2014, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 81
- Chellapilla K., 2006, Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition.
- Chellapilla K., 2006, Proceedings of the 18th Annual Symposium on Electronic Imaging, 6067
- Chellapilla K., 2006, Proceedings of the 10th Internstional Workshop on Frontiers in Handwriting Recognition, 1
- Choromanska A., 2015, Proceedings 18th International Conference on Artificial Intelligence and Statistics, 192
- Clevert D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Coates A., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 215
- Collobert R., 2006, Journal of Machine Learning Research, 7, 1687
- Courbariaux M., 2015, Advances in neural information processing systems, 28, 3123
- Courbariaux M., 2016, Advances in neural information processing systems, 29, 1
- Deng L., 2014, APSIPA Transactions on Signal and Information Processing, 3, 1
- Denil M., 2013, Advances in neural information processing systems, 26, 2148
- Denton E. L., 2014, Advances in neural information processing systems, 27, 1269
- Dettmers T., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Duchi J., 2011, Journal of Machine Learning Research, 12, 2121
- Erhan D., 2010, Journal of Machine Learning Research, 11, 625
- Filho D. P., 2009, Proceedings of the XXII Brazilian Symposium on Computer Graphics and Image Processing, 1
- Fukushima K., 1979, Proceedings of the 6th International Joint Conference on Artificial Intelligence, 291
- Glorot X., 2010, Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 249
- Glorot X., 2011, Proceedings of the 14th International Conference on Artificial Intelligence and Statistics, 315
- Goodfellow I., 2016, Deep learning
- Goodfellow I., 2014, Advances in neural information processing systems, 27, 2672
- Goodfellow I. J., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Goodfellow I. J., 2013, Proceedings of the 30th International Conference Machine Learning, 1319
- Han S., 2016, Proceedings of the 3rd International Conference on Learning Representations, 1
- Huang G. B., 2007, Labeled faces in the wild: A database for studying face recognition in unconstrained environments
- Iandola F. N., 2016, SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and 1MB model size
- Ioffe S., 2015, Proceedings of the 32nd International Conference Machine Learning, 448
- Jaderberg M., 2015, Advances in neural information processing systems, 28, 2017
- Jin J., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Karpathy A., 2016, CS231n: Convolutional neural networks for visual recognition
- Karpathy A., 2016, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3128
- Kennedy J., 1995, Proceedings of the 6th International Symposium on Micro Machine and Human Science, 39
- Krizhevsky A., 2012, Advances in neural information processing systems, 25, 1097
- Kulkarni T. D., 2015, Advances in neural information processing systemsm, 28, 2539
- Lebedev V., 2014, Speeding-up convolutional neural networks using fine-tuned CP-decomposition
- LeCun Y., 1989, Connections in perspective, 143
- LeCun Y., 1989, Advances in neural information processing systems, 2, 396
- Lee C., 2015, Proceedings of the 18th International Conference on Artificial Intelligence and Statistics, 562
- Leibo J. Z., 2011, Advances in neural information processing systems, 24, 711
- Levine S., 2016, Journal of Machine Learning Research, 17, 1
- Li S., 2016, Demystifying ResNet
- Li Z., 2016, Advances in neural information processing systemsm, 1
- Lin M., 2013, Network in network
- Linnainmaa S., 1970, The representation of the cumulative rounding error of an algorithm as a Taylor expansion of the local rounding errors
- Liu W., 2016, Proceedings of the 33rd International Conference Machine Learning, 507
- Maas A. L., 2013, Proceedings of the 30th International Conference Machine Learning, 1
- Maharaj A. V., 2015, Improving the adversarial robustness of ConvNets by reduction of input dimensionality
- Mishkin D., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- National Data Science Bowl | Kaggle, 2016, Kaggle.com
- Netzer Y., 2011, Advances in neural information processing systems, 24 (NIPS) Workshop on Deep Learning and Unsupervised Feature Learning, 1
- Novikov A., 2015, Advances in neural information processing systems, 28
- Ranzato M., 2006, Advances in neural information processing systems, 19, 1137
- Recht B., 2011, Advances in neural information processing systems, 24, 693
- Rippel O., 2014, Proceedings of the 30th International Conference on Machine Learning, 1746
- Rippel O., 2015, Advances in neural information processing systems, 28, 2449
- Romero A., 2015, Proceedings of the 3rd International Conference on Learning Representations, 1
- Sabour S., 2016, Proceedings of the 4th International Conference on Learning Representations, 1
- Sermanet P., 2012, Proceedings of the 21st International Conference on Pattern Recognition, 3288
- Snoek J., 2012, Advances in neural information processing systems, 25, 2951
- Sontag E. D., 1998, NATO ASI Series F Computer and Systems Sciences, 168, 69
- Srivastava N., 2014, Journal of Machine Learning Research, 15, 1929
- Srivastava N., 2013, Advances in neural information processing systems, 26, 2094
- Srivastava R. K., 2015, Advances in neural information processing systems, 28, 2377
- Srivastava R. K., 2015, Highway networks
- Steinkrau D., 2005, Proceedings of the 8th International Conference on Document Analysis and Recognition, 1115
- Stollenga M. F., 2014, Advances in neural information processing systems, 27, 3545
- Sun Y., 2014, Advances in neural information processing systems, 27, 1988
- Sutskever I., 2013, Proceedings of the 30th International Conference Machine Learning, 1139
- Szegedy C., 2014, Proceedings of the 1st International Conference on Learning Representations, 1
- Wager S., 2013, Advances in neural information processing systems, 26, 351
- Wan L., 2013, Proceedings of the 30th International Conference Machine Learning, 1058
- Wang S. I., 2013, Proceedings of the 30th International Conference Machine Learning, 118
- Wang Y., 2016, Advances in neural information processing systems, 29, 1
- Weinberger K. Q., 2005, Advances in neural information processing systems, 18, 1473
- Yang J., 2009, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1794
- Zhai S., 2016, Advances in neural information processing systems, 29, 1
- Zinkevich M., 2010, Advances in neural information processing systemsm, 23, 2595
Cited by
Sorted by citations
Items 601–700 of 1,000
Ramakrishna, R., Hamid, Z. A., Zaki, W. M. D. W., Huddin, A. B., & Mathialagan, R. D. (2020) · PeerJ · doi:10.7717/peerj.10346 · Cited by 43
Cohn, R., Anderson, I. E., Prost, T., Tiarks, J. A., White, E. M. H., & Holm, E. A. (2021) · JOM · doi:10.1007/s11837-021-04713-y · Cited by 40
Model-free short-term fluid dynamics estimator with a deep 3D-convolutional neural network
López‐Martín, M., Clainche, S. L., & Carro, B. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114924 · Cited by 39
Privacy-preserving federated neural network learning for disease-associated cell classification
Sav, S., Bossuat, J.-P., Troncoso-Pastoriza, J. R., Claassen, M., & Hubaux, J. (2022) · Patterns · doi:10.1016/j.patter.2022.100487 · Cited by 46
Wang, M.-F., Dong, C., Gao, Y., Li, J., Han, M., & Wang, L. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.844978 · Cited by 41
Açıkgöz, H., & Korkmaz, D. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105965 · Cited by 38
Persson, N. E., Rafshoon, J., Naghshpour, K., Fast, T., Chu, P., McBride, M., Risteen, B. E., Grover, M. A., & Reichmanis, E. (2017) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.7b10510 · Cited by 38
Monteiro, J., Martins, B., Murrieta‐Flores, P., & Pires, J. M. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8080327 · Cited by 39
“, ensembles of decision trees [22] or deep learning methods based on convolutional neural networks [23,24]) to combine different types of ancillary data, in order to disaggregate historical census data into a 200 m resolution grid.”
BackgroundMethodA Method of Speech Coding for Speech Recognition Using a Convolutional Neural Network
Kubanek, M., Bobulski, J., & Kulawik, J. (2019) · Symmetry · doi:10.3390/sym11091185 · Cited by 38
“There is a picture at CNN and its architecture reflects this.”
BackgroundMethodInfluentialJayalakshmi, G. S., & Kumar, V. S. (2019) · International Conference on Computational Intelligence in Data Science (ICCIDS) · doi:10.1109/iccids.2019.8862143 · Cited by 38
“Deep learning method allows for automatic feature extraction and improved classification even with very little dataset [17].”
MethodMaddah, M., Mandegar, M. A., Dame, K., Grafton, F., Loewke, K. E., & Ribeiro, A. J. S. (2020) · Journal of Pharmacological and Toxicological Methods · doi:10.1016/j.vascn.2020.106895 · Cited by 35
Asim, M. N., Khan, M. U. G., Ibrahim, M. A., Mahmood, W., Dengel, A. R., & Ahmed, S. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05321-8 · Cited by 47
Miao, R., Jiang, Z., Zhou, Q., Wu, Y., Gao, Y., Zhang, J., & Jiang, Z. (2021) · Machine Vision and Applications · doi:10.1007/s00138-020-01158-2 · Cited by 40
“In recent years, many improved algorithms have been proposed based on CNN [22, 23].”
MethodA Privacy-Preserving Iot-Based Fire Detector
Altowaijri, A. H., Alfaifi, M. S., Alshawi, T. A., Ibrahim, A. B., & Alshebeili, S. A. (2021) · IEEE Access · doi:10.1109/access.2021.3069588 · Cited by 38
“It is a specialized artificial neural network used to process multidimensional input data [24].”
BackgroundMethodMicroscopy deep learning predicts virus infections and reveals mechanics of lytic-infected cells
Andriasyan, V., Yakimovich, A., Petkidis, A., Georgi, F., Witte, R., Püntener, D., & Greber, U. F. (2021) · iScience · doi:10.1016/j.isci.2021.102543 · Cited by 51
“They replicate and assemble progeny capsids in the cell nucleus (Berk, 2013; Roizman and Knipe, 2001).”
BackgroundDiagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images
Ba, W., Wang, R., Yin, G., Song, Z., Zou, J., Zhong, C., Yang, J., Yu, G., Yang, H., Zhang, L., et al. (2021) · Translational Oncology · doi:10.1016/j.tranon.2021.101161 · Cited by 39
“One of the deep learning algorithms, the convolutional neural network (CNN) has been proven to have great potential to classify images and detect objects in pictures [1, 2].”
BackgroundMANIFOLD LEARNING-BASED POLYNOMIAL CHAOS EXPANSIONS FOR HIGH-DIMENSIONAL SURROGATE MODELS
Kontolati, K., Loukrezis, D., dos Santos, K. R. M., Giovanis, D. G., & Shields, M. D. (2022) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2022039936 · Cited by 38
Pose Estimation and Correcting Exercise Posture
Kanase, R., Kumavat, A. N., Sinalkar, R. D., & Somani, S. (2021) · ITM Web of Conferences · doi:10.1051/itmconf/20214003031 · Cited by 42
AI-Based Image Processing for COVID-19 Detection in Chest CT Scan Images
Kaheel, H., Hussein, A., & Chehab, A. (2021) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2021.645040 · Cited by 40
“This type of problems has been solved in recent years using deep learning models that leverage several layers of nonlinear acquired knowledge processing, for the extraction and transformation of functions as well as for pattern classification and analysis (Rawat and Wang, 2017).”
BackgroundThalagala, S., & Walgampaya, C. (2021) · International Research Conference on Smart Computing and Systems Engineering (SCSE) · doi:10.1109/scse53661.2021.9568315 · Cited by 39
Image-Data-Driven Slope Stability Analysis for Preventing Landslides Using Deep Learning
Azmoon, B., Biniyaz, A., Liu, Z. “., & Sun, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3123501 · Cited by 42
“However, improvements in multiple layers of nonlinear information processing, GPUs, and large data sets enabled deep learning with CNNs to revolutionize image classification [41], [42].”
BackgroundImage-Based Hot Pepper Disease and Pest Diagnosis Using Transfer Learning and Fine-Tuning
Gu, Y. H., Yin, H., Jin, D., Park, J.-H., & Yoo, S. J. (2021) · Frontiers in Plant Science · doi:10.3389/fpls.2021.724487 · Cited by 38
Using Deep Learning in Real-Time for Clothing Classification with Connected Thermostats
Medina, A., Méndez, J. I., Ponce, P., Peffer, T. E., Meier, A., & Molina, A. (2022) · Energies · doi:10.3390/en15051811 · Cited by 38
“A CNN handles multiple dimensions due to the convolutional layers [40].”
BackgroundWenqing, Z., Ren, G., Wang, J., Wang, J., Hu, Y., Lin, Z., Li, W., Zhao, Y., Li, W., & Wang, N. (2022) · Remote Sensing · doi:10.3390/rs14112630 · Cited by 38
“In deep learning, CNN is the dominant supervised learning algorithm for classification because it has proved to be superior to the traditional machine learning classification methods [26].”
MethodDitria, E. M., Sievers, M., Lopez-Marcano, S., Jinks, E. L., & Connolly, R. M. (2020) · Environmental Monitoring and Assessment · doi:10.1007/s10661-020-08653-z · Cited by 41
Capsulenet-Based Spatial–Spectral Classifier for Hyperspectral Images
Arun, P. V., Buddhiraju, K. M., & Porwal, A. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2913097 · Cited by 37
Xiao, Y., Hu, Y., Quan, W., Yang, Y., Lai, W., Wang, X., Zhang, X., Zhang, B., Wu, Y., Wu, Q., et al. (2021) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2021-318844 · Cited by 37
A Novel Encoder-Decoder Model for Multivariate Time Series Forecasting
Zhang, H., Li, S., Chen, Y., Dai, J., & Yi, Y. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/5596676 · Cited by 39
Naderi, H., Shojaei, A., & Ly, R. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.104959 · Cited by 37
Amasya, H., Jaju, P. P., Ezhov, M., Gusarev, M., Atakan, C., Sanders, A., Manulius, D., Golitskya, M., Shrivastava, K., Singh, A., et al. (2023) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.22973 · Cited by 39
“14 In 2022, Chang et al. developed a multitasking InceptionV3 model for the radiographic diagnosis of periodontitis.”
BackgroundLee, M. C. M., Parker, C. H., Liu, L. W., Farahvash, A., & Jeyalingam, T. (2024) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2024.01.021 · Cited by 37
Enhancing Alzheimer’s disease diagnosis and staging: a multistage CNN framework using MRI
Ali, M. U., Kim, K., Khalid, M., Farrash, M., Zafar, A., & Lee, S. W. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1395563 · Cited by 42
Hayashi, Y. (2019) · Frontiers in Robotics and AI · doi:10.3389/frobt.2019.00024 · Cited by 38
Noise can speed backpropagation learning and deep bidirectional pretraining
Kosko, B., Audhkhasi, K., & Osoba, O. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.04.004 · Cited by 41
A Deep-Learning-Based Denoising Method for Multiarea Surface Seismic Data
Dong, X., Zhong, T., & Li, Y. (2020) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2020.2989450 · Cited by 38
“The main function of Conv is to automatically extract features [14], [16], and the concrete expression is shown in the following equation: pConv = w × xConv + b (1)”
BackgroundMethodPPCensor: Architecture for real-time pornography detection in video streaming
Mallmann, J., Santin, A. O., Viegas, E. K., dos Santos, R. R., & Geremias, J. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.06.017 · Cited by 38
Illustrative Discussion of MC-Dropout in General Dataset: Uncertainty Estimation in Bitcoin
Alarab, I., Prakoonwit, S., & Nacer, M. I. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10424-x · Cited by 37
Wei, B., Zhao, X., Shi, L., Xu, L., Liu, T., & Zhang, J. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac0d60 · Cited by 38
“CNN is an architecture inspired by the nat-ural visual-perception mechanism and can be used to identify the visual rules from an original image without large amounts of preprocessing [22].”
MethodTwo-Stage Evolutionary Neural Architecture Search for Transfer Learning
Wen, Y.-W., Peng, S.-H., & Ting, C.-K. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3097937 · Cited by 36
Redundancy reduced depthwise separable convolution for glaucoma classification using OCT images
Sunija, A. P., Gopi, V. P., & Palanisamy, P. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.103192 · Cited by 37
Acne Detection by Ensemble Neural Networks
Zhang, H., & Ma, T. (2022) · Sensors · doi:10.3390/s22186828 · Cited by 45
Lam, C.-N., Niculescu, S., & Bengoufa, S. (2023) · Remote Sensing · doi:10.3390/rs15082001 · Cited by 37
Residual Deep Convolutional Neural Network for EEG Signal Classification in EpilepsyPreprint
Lu, D., & Triesch, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.08100 · Cited by 37
“In recent years, image classification and object recognition methods based on convolutional neural networks (CNNs) have achieved impressive results [14].”
BackgroundA facial recognition using a combination of a novel one dimension deep CNN and LDA
Sahan, J. M., Abbas, E. I., & Abood, Z. M. (2021) · Materials Today Proceedings · doi:10.1016/j.matpr.2021.07.325 · Cited by 36
Ye, X., Cao, Y., Liu, A., Wang, X., Zhao, Y., & Hu, N. (2023) · Structural Health Monitoring · doi:10.1177/14759217231158786 · Cited by 40
“From classic CNNs to P-CNN CNNs have been applied in a wide range of fields, such as image processing, 47 damage detection, 11,34,48 speech recognition, 49 data anomaly detection, 50 faulty data detection, 42,51 and signal classification.”
MethodComparative Study on Spoken Language Identification Based on Deep Learning
Heracleous, P., Takai, K., Yasuda, K., Mohammad, Y. F. O., & Yoneyama, A. (2018) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2018.8553347 · Cited by 36
“Convolutional neural networks have been successfully applied to sentence classification [18], image classification [19], facial expression recognition [20], and in speech emotion recognition [21].”
MethodAslan, S., Hocke, L. M., Schwarz, N. F., & Frederick, B. B. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.05.049 · Cited by 36
“We used a convolutional neural network (CNN) architecture, which has found a number of applications in computer vision in general [12–16] and medical imaging in particular [17, 18], as well as for time series analysis [19, 20].”
MethodHeracleous, P., & Yoneyama, A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220386 · Cited by 36
Mangena, T., Hassan, S., & Santos, M. G. (2020) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/staa750 · Cited by 36
A Study of Multispectral Technology and Two-Dimension Autoencoder for Coal and Gangue Recognition
Lai, W., Zhou, M., Hu, F., Bian, K., & Song, H. (2020) · IEEE Access · doi:10.1109/access.2020.2983740 · Cited by 34
“The Convolutional Neural Networks (CNN), which has developed rapidly since 2012, has achieved excellent results in the areas of image recognition and target detection [18], [19].”
BackgroundMemory-Efficient Dataflow Inference for Deep CNNs on FPGA
Petrică, L., Alonso, T., Kroes, M., Fraser, N. J., Cotöfană, S., & Blott, M. (2020) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/icfpt51103.2020.00016 · Cited by 42
Skin Lesion Classification Using Convolutional Neural Network for Melanoma Recognition
Dutta, A., Hasan, M. K., & Ahmad, M. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-16-0586-4_5 · Cited by 38
Grasp Classification With Weft Knit Data Glove Using a Convolutional Neural Network
Ayodele, E., Bao, T., Zaidi, S. A. R., Hayajneh, A. M., Scott, J., Zhang, Z., & McLernon, D. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3059028 · Cited by 37
“However, maximum 273 pooling has become the benchmark in state-of-the-art CNN 274 approaches [34].”
BackgroundA Neural Network Estimation of Ankle Torques From Electromyography and Accelerometry
Siu, H. C., Sloboda, J., McKindles, R. J., & Stirling, L. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3104761 · Cited by 40
Kumari, N., Dwivedi, R. K., Bhatt, A. K., & Belwal, R. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06473-x · Cited by 39
“Measures DT [44] KNN [37] SVM [43] NN [42] CNN [31] Fuzzy [32] FCNN [32] [31] SA-CSO-FCNN”
MethodDevelopment of CNN Transfer Learning for Dyslexia Handwriting Recognition
Rosli, M. S. A. B., Isa, I. S., Ramlan, S. A., Sulaiman, S. N., & Maruzuki, M. I. F. (2021) · IEEE International Conference on Control System, Computing and Engineering · doi:10.1109/iccsce52189.2021.9530971 · Cited by 42
Cassava Leaf Disease Recognition Using Convolutional Neural Networks
Mathulaprangsan, S., & Lanthong, K. (2021) · International Conference on Orange Technology (ICOT) · doi:10.1109/icot54518.2021.9680655 · Cited by 36
Infrared and visible image fusion based on residual dense network and gradient loss
Li, J., Liu, J., Zhou, S., Zhang, Q., & Kasabov, N. K. (2022) · Infrared Physics & Technology · doi:10.1016/j.infrared.2022.104486 · Cited by 36
A Classification of Arab Ethnicity Based on Face Image Using Deep Learning Approach
Al-Humaidan, N. A., & Prince, M. (2021) · IEEE Access · doi:10.1109/access.2021.3069022 · Cited by 35
“Convolutional layers in CNN work as feature extractors, so there is no need for a separate feature extraction step [38].”
BackgroundAutomated seed identification with computer vision: challenges and opportunities
Zhao, L., Haque, S. M. R., & Wang, R. (2022) · Seed Science and Technology · doi:10.15258/sst.2022.50.1.s.05 · Cited by 40
A Systematic Review of Deep Learning Microalgae Classification and Detection
Madkour, D. M., Shapiai, M. I., Mohamad, S. E., Aly, H., Ismail, Z. H., & Ibrahim, M. Z. (2023) · IEEE Access · doi:10.1109/access.2023.3280410 · Cited by 40
“Image classification techniques are diverse from either traditional techniques or modern learning techniques [15].”
BackgroundMethodNon-linear Time Series Prediction using Improved CEEMDAN, SVD and LSTM
Poongadan, S., & Lineesh, M. C. (2024) · Neural Processing Letters · doi:10.1007/s11063-024-11622-z · Cited by 38
Palm Vein Recognition with Deep Hashing Network
Zhong, D., Liu, S., Wang, W., & Du, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03398-9_4 · Cited by 35
A deep learning approach to ship detection using satellite imagery
Stofa, M. M., Zulkifley, M. A., & Zaki, S. Z. M. (2020) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/540/1/012049 · Cited by 35
“Since then, lots of research have been done on CNNs with improvement in various factors such as activation function, optimization technique, network architecture and regularization mechanism [17].”
BackgroundConvolutional neural networks for enhanced classification mechanisms of metamodels
Nguyen, P. T., Ruscio, D. D., Pierantonio, A., Rocco, J. D., & Iovino, L. (2020) · Journal of Systems and Software · doi:10.1016/j.jss.2020.110860 · Cited by 36
Calabrese, B., Velázquez, R., Del-Valle-Soto, C., Fazio, R. D., Giannoccaro, N. I., & Visconti, P. (2020) · Energies · doi:10.3390/en13226104 · Cited by 35
“Deep Neural Networks (DNN), especially Convolutional Neural Networks (CNNs) have proven to be very effective in areas such as image recognition and classification [14,15].”
BackgroundFrom convolutional neural networks to models of higher‐level cognition (and back again)
Battleday, R. M., Peterson, J. C., & Griffiths, T. L. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14593 · Cited by 39
“38, 44, and 45.”
Liu, Y., Zhang, D., & Gooi, H. B. (2020) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2019.02510 · Cited by 37
Contractor, S., & Roughan, M. (2021) · Frontiers in Marine Science · doi:10.3389/fmars.2021.637759 · Cited by 36
“, involving image recognition (Rawat and Wang, 2017), natural language processing (Young et al.”
BackgroundUsing Deep Learning Neural Network in Artificial Intelligence Technology to Classify Beef Cuts
Sunil, G. C., Saidul, B., Zhang, Y., Reed, D. D., Ahsan, M., Berg, E. P., & Sun, X. (2021) · Frontiers in Sensors · doi:10.3389/fsens.2021.654357 · Cited by 40
Unsafe Construction Behavior Classification Using Deep Convolutional Neural Network
Hung, P. D., & Su, N. T. (2021) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661821020073 · Cited by 38
Deep learning-based classification models for beehive monitoring
Berkaya, S. K., Günal, E. Ş., & Günal, S. (2021) · Ecological Informatics · doi:10.1016/j.ecoinf.2021.101353 · Cited by 39
Sharif, M. I., Khan, M. A., Alqahtani, A., Nazir, M., Alsubai, S., Binbusayyis, A., & Damaševičius, R. (2022) · Electronics · doi:10.3390/electronics11030334 · Cited by 35
Deep learning-based on-line image analysis for continuous industrial crystallization processes
Zong, S., Zhou, G., Li, M., & Wang, X. (2022) · Particuology · doi:10.1016/j.partic.2022.07.002 · Cited by 37
Artificial Intelligence in Cryo-Electron Microscopy
Chung, J. M., Durie, C. L., & Lee, J. (2022) · Life · doi:10.3390/life12081267 · Cited by 35
“In particular, CNN-based models excel in image classification and particle recognition steps, which are the most fundamental steps in the cryo-EM image processing workflow [86].”
MethodA novel Siamese deep hashing model for histopathology image retrieval
Alizadeh, S. M., Helfroush, M. S., & Müller, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120169 · Cited by 35
Deep learning in digital pathology for personalized treatment plans of cancer patients
Wen, Z., Wang, S., Yang, D. M., Xie, Y., Chen, M., Bishop, J., & Xiao, G. (2023) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2023.02.003 · Cited by 34
An Efficient Deep Learning Model for Eye Disease Classification
Saini, A., Guleria, K., & Sharma, S. (2023) · International Research Conference on Smart Computing and Systems Engineering (SCSE) · doi:10.1109/scse59836.2023.10215000 · Cited by 34
“The convolutional layer's output is subjected to an activation function in the activation layer [18].”
BackgroundChen, Y., Wang, S., Liu, Y., Deng, H., Gao, H., Cao, M., Zhang, C., Cheng, X., & Xie, L. (2024) · Chemical Engineering Journal · doi:10.1016/j.cej.2024.156293 · Cited by 34
Residual neural network-based fully convolutional network for microstructure segmentation
Jang, J., Van, D., Jang, H., Baik, D. H., Yoo, S. D., Park, J., Mhin, S., Mazumder, J., & Lee, S. H. (2019) · Science and Technology of Welding & Joining · doi:10.1080/13621718.2019.1687635 · Cited by 34
“Recently, a variety of CNN algorithms have been developed and the accuracy has continued to show improvements [25].”
BackgroundOptimal Autonomous Driving Through Deep Imitation Learning and Neuroevolution
Jalali, S. M. J., Kebria, P. M., Khosravi, A., Saleh, K., Nahavandi, D., & Nahavandi, S. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914582 · Cited by 34
“For more details regarding the training process of CNN using gradient decent algorithm, refer to [60].”
MethodArtificial intelligence in the diagnosis, treatment and prevention of urinary stones
Yang, B., Veneziano, D., & Somani, B. K. (2020) · Current Opinion in Urology · doi:10.1097/mou.0000000000000820 · Cited by 34
“For this reason, a convolutional neural network (CNN) is utilized for images, which allows for the fact that elements of interest can appear anywhere in an image [8].”
Xu, W., Yang, W., Chen, S., Wu, C., Chen, P., & Lan, Y. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105762 · Cited by 34
Weakly-Supervised Image Hashing through Masked Visual-Semantic Graph-based Reasoning
Jin, L., Li, Z., Pan, Y., & Tang, J. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3414022 · Cited by 33
“Graph-based reasoning has been successfully applied to many tasks such as image classification [30, 42], visual question answer [1, 45] and image retrieval [17, 37].”
MethodBenchmarking Deep Learning Models for Driver Distraction Detection
Mase, J. M., Chapman, P., Figueredo, G. P., & Torres, M. T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64580-9_9 · Cited by 36
Livieris, I. E., Stavroyiannis, S., Pintelas, E. G., Kotsilieris, T., & Pintelas, P. (2021) · Evolving Systems · doi:10.1007/s12530-020-09361-2 · Cited by 36
How to evaluate deep learning for cancer diagnostics – factors and recommendations
Daneshjou, R., He, B. D., Ouyang, D., & Zou, J. (2021) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2021.188515 · Cited by 35
Detection of Cataract Based on Image Features Using Convolutional Neural Networks
Weni, I., Utomo, P. E. P., Hutabarat, B. F., & Alfalah, M. (2021) · IJCCS (Indonesian Journal of Computing and Cybernetics Systems) · doi:10.22146/ijccs.61882 · Cited by 34
“It is an improved version of multilayer perceptron or other networks [6], [7].”
BackgroundMethodQu, H. Y., Minacapelli, C. D., Tait, C., Gupta, K., Bhurwal, A., Catalano, C., Dafalla, R. A., Metaxas, D., & Rustgi, V. K. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106153 · Cited by 38
CNN based Covid-aid: Covid 19 Detection using Chest X-ray
Singh, S., Sapra, P., Garg, A., & Vishwakarma, D. K. (2021) · International Conference on Computing Methodologies and Communication (ICCMC) · doi:10.1109/iccmc51019.2021.9418407 · Cited by 35
“CNN's usually demonstrate high-accuracy results in the area of image and object recognition [16] which is why we used this approach.”
MethodHyAdamC: A New Adam-Based Hybrid Optimization Algorithm for Convolution Neural Networks
Kim, K. S., & Choi, Y. S. (2021) · Sensors · doi:10.3390/s21124054 · Cited by 35
“Accordingly, a sophisticated and robust optimization algorithm is needed to train such large-scale CNN models effectively [43].”
MethodPian, F., Wang, Q., Wang, M., Shan, P., Li, Z., & Ma, Z. (2021) · Spectrochimica Acta Part A Molecular and Biomolecular Spectroscopy · doi:10.1016/j.saa.2021.120229 · Cited by 35
Li, K., Wang, J., & Yao, J. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102497 · Cited by 34
Chitra, B., & Kumar, S. S. (2021) · Soft Computing · doi:10.1007/s00500-021-06138-w · Cited by 34
“Three major layers such as convolutional, activation, and pooling layer present in the convolutional base (Rawat and Wang 2017).”
BackgroundRao, J., Yang, F., Mo, H., Kollmannsberger, S., & Rank, E. (2022) · Journal of Sound and Vibration · doi:10.1016/j.jsv.2022.117418 · Cited by 34
“For a detailed survey on CNNs, we refer to [26, 27, 28, 29].”
BackgroundGuo, Y., Khishe, M., Mohammadi, M., Rashidi, S., & Nateri, M. S. (2021) · International Journal of Fuzzy Systems · doi:10.1007/s40815-021-01195-7 · Cited by 34
“Many positive features of the DCNNs have made them more popular in various computer vision tasks [58].”
BackgroundDynamic and adaptive fault-tolerant asynchronous federated learning using volunteer edge devices
Morell, J. Á., & Alba, E. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.02.024 · Cited by 35
Muhammad, L. J., Haruna, A. A., Usman, S. S., & Mohammed, M. B. (2022) · Health and Technology · doi:10.1007/s12553-022-00711-5 · Cited by 35
An improved YOLOv5s method based bruises detection on apples using cold excitation thermal images
Lin, P., Yang, H., Cheng, S., Guo, F., Wang, L., & Lin, Y. (2023) · Postharvest Biology and Technology · doi:10.1016/j.postharvbio.2023.112280 · Cited by 34
Rosso, M. M., Aloisio, A., Randazzo, V., Tanzi, L., Cirrincione, G., & Marano, G. C. (2023) · Integrated Computer-Aided Engineering · doi:10.3233/ica-230709 · Cited by 34
Metadata
- Authors
- Rawat, W., & Wang, Z.
- Affiliations
- University of South Africa (ZA)
- ORCID
- Wang, Zenghui
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2017-09
- Volume
- 29
- Issue
- 9
- Pages
- 2352-2449
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2622826443
- Cited by
- 3,503
- References
- 286
- Citations by year
- 2026: 181 · 2025: 393 · 2024: 470 · 2023: 535 · 2022: 580 · 2021: 589 · 2020: 432 · 2019: 234 · 2018: 84 · 2017: 3
- FWCI
- 85.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neural Computation (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Keywords
- convolutional neural networks, image classification, deep learning, history of neural networks, annotated dataset, computer vision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review