The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Deep Residual Learning for Image Recognition: A Survey
Open accessAbstract
Deep Residual Networks have recently been shown to significantly improve the performance of neural networks trained on ImageNet, with results beating all previous methods on this dataset by large margins in the image classification task. However, the meaning of these impressive numbers and their implications for future research are not fully understood yet. In this survey, we will try to explain what Deep Residual Networks are, how they achieve their excellent results, and why their successful implementation in practice represents a significant advance over existing techniques. We also discuss some open questions related to residual learning as well as possible applications of Deep Residual Networks beyond ImageNet. Finally, we discuss some issues that still need to be resolved before deep residual learning can be applied on more complex problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
A comprehensive review of deep learning-based single image super-resolution
Bashir, S. M. A., Wang, Y., Khan, M., & Niu, Y. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.621 · Cited by 172
RetractedDeep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
(2018) · Cited by 3,510
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
Image Super-Resolution via Deep Recursive Residual Network
Tai, Y., Yang, J., & Liu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.298 · Cited by 2,415
Deep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
CHURCH, K. W. (2017) · Natural Language Engineering · doi:10.1017/s1351324916000334 · Cited by 974
Adaptive batch normalization for practical domain adaptation
Li, Y., Wang, N., Shi, J., Hou, X., & Liu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.005 · Cited by 601
Shafiq, M., Tian, Z., Bashir, A. K., Du, X., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002255 · Cited by 541
Self-citationA fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis
Wang, S., Zha, Y., Li, W., Wu, Q., Li, X., Niu, M., Wang, M., Qiu, X., Li, H., Yu, H., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.00775-2020 · Cited by 490
Deep residual learning for image steganalysis
Wu, S., Zhong, S., & Liu, Y. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4440-4 · Cited by 442
A comprehensive survey of AI-enabled phishing attacks detection techniques
Basit, A., Zafar, M., Liu, X., Javed, A. R., Jalil, Z., & Kifayat, K. (2021) · Telecommunication Systems · doi:10.1007/s11235-020-00733-2 · Cited by 429
Koonce, B. (2021) · Apress eBooks · doi:10.1007/978-1-4842-6168-2 · Cited by 389
Pest identification via deep residual learning in complex background
Cheng, X., Zhang, Y., Chen, Y., Wu, Y., & Yue, Y. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.08.005 · Cited by 383
Very Deep Convolutional Neural Networks for Noise Robust Speech Recognition
Qian, Y., Bi, M., Tan, T., & Yu, K. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2602884 · Cited by 343
Facial Emotion Recognition Using Transfer Learning in the Deep CNN
Akhand, M. A. H., Roy, S., Siddique, N., Kamal, M. A. S., & Shimamura, T. (2021) · Electronics · doi:10.3390/electronics10091036 · Cited by 333
Population–Urbanization–Energy Nexus: A Review
Avtar, R., Tripathi, S., Aggarwal, A. K., & Kumar, P. (2019) · Resources · doi:10.3390/resources8030136 · Cited by 277
IoT malicious traffic identification using wrapper-based feature selection mechanisms
Shafiq, M., Tian, Z., Bashir, A. K., Du, X., & Guizani, M. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101863 · Cited by 266
Self-citationShafiq, M., Tian, Z., Bashir, A. K., Jolfaei, A., & Yu, X. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102177 · Cited by 223
Self-citationJaved, A. R., Usman, M., Rehman, S. U., Khan, M. U., & Haghighi, M. S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025875 · Cited by 223
A Novel Hybrid Deep Learning Model for Sentiment Classification
Salur, M. U., & Aydin, I. (2020) · IEEE Access · doi:10.1109/access.2020.2982538 · Cited by 222
Star–galaxy classification using deep convolutional neural networks
Kim, E. J., & Brunner, R. J. (2017) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw2672 · Cited by 221
Visual Camera Re-Localization from RGB and RGB-D Images Using DSAC
Brachmann, E., & Rother, C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3070754 · Cited by 217
Multiaccuracy: Black-Box Post-Processing for Fairness in Classification
Kim, M. P., Ghorbani, A., & Zou, J. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314287 · Cited by 193
Unsupervised Pretraining Transfers Well Across Languages
Riviere, M., Joulin, A., Mazare, P.-E., & Dupoux, E. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054548 · Cited by 186
Experiences of Internet traffic monitoring with tstat
Finamore, A., Mellia, M., Meo, M., Munafo, M. M., Torino, P. D., & Rossi, D. (2011) · IEEE Network · doi:10.1109/mnet.2011.5772055 · Cited by 185
Multi-classification approaches for classifying mobile app traffic
Aceto, G., Ciuonzo, D., Montieri, A., & Pescapé, A. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.11.007 · Cited by 181
ResNeXt and Res2Net Structures for Speaker Verification
Zhou, T., Zhao, Y., & Wu, J. (2021) · 2021 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383531 · Cited by 181
Deep semantic segmentation for automated driving: Taxonomy, roadmap and challenges
Siam, M., Elkerdawy, S., Jagersand, M., & Yogamani, S. (2017) · 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317714 · Cited by 178
A Hybrid CNN–LSTM Network for the Classification of Human Activities Based on Micro-Doppler Radar
Zhu, J., Chen, H., & Ye, W. (2020) · IEEE Access · doi:10.1109/access.2020.2971064 · Cited by 166
Karar, M. E., Hemdan, E. E., & Shouman, M. A. (2020) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00199-4 · Cited by 154
Assessing sustainable development prospects through remote sensing: A review
Avtar, R., Komolafe, A. A., Kouser, A., Singh, D., Yunus, A. P., Dou, J., Kumar, P., Dasgupta, R., Johnson, B. A., Minh, H. V. T., et al. (2020) · Remote Sensing Applications Society and Environment · doi:10.1016/j.rsase.2020.100402 · Cited by 149
Exploring Renewable Energy Resources Using Remote Sensing and GIS—A Review
Avtar, R., Sahu, N., Aggarwal, A. K., Chakraborty, S., Kharrazi, A., Yunus, A. P., Dou, J., & Kurniawan, T. A. (2019) · Resources · doi:10.3390/resources8030149 · Cited by 144
EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks
Zhang, P., Xue, J., Lan, C., Zeng, W., Gao, Z., & Zheng, N. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2937724 · Cited by 126
Afzal, M. Z., Kölsch, A., Ahmed, S., & Liwicki, M. (2017) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2017.149 · Cited by 120
Android Malware Detection Based on a Hybrid Deep Learning Model
Lu, T., Du, Y., Ouyang, L., Chen, Q., & Wang, X. (2020) · Security and Communication Networks · doi:10.1155/2020/8863617 · Cited by 112
Packet-based Network Traffic Classification Using Deep Learning
Lim, H.-K., Kim, J.-B., Heo, J.-S., Kim, K., Hong, Y.-G., & Han, Y. (2019) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic.2019.8669045 · Cited by 111
ResBCDU-Net: A Deep Learning Framework for Lung CT Image Segmentation
Jalali, Y., Fateh, M., Rezvani, M., Abolghasemi, V., & Anisi, M. H. (2021) · Sensors · doi:10.3390/s21010268 · Cited by 105
LiteDepthwiseNet: A Lightweight Network for Hyperspectral Image Classification
Cui, B., Dong, X., Zhan, Q., Peng, J., & Sun, W. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3062372 · Cited by 98
Singh, A. K., Kumar, A., Mahmud, M., Kaiser, M. S., & Kishore, A. (2021) · Cognitive Computation · doi:10.1007/s12559-021-09848-3 · Cited by 97
Çınar, A., & Tuncer, S. A. (2021) · SN Applied Sciences · doi:10.1007/s42452-021-04485-9 · Cited by 92
Bearing Fault Detection Using Scalogram and Switchable Normalization-Based CNN (SN-CNN)
Neupane, D., Kim, Y., & Seok, J. (2021) · IEEE Access · doi:10.1109/access.2021.3089698 · Cited by 88
Quantum Supremacy Circuit Simulation on Sunway TaihuLight
Li, R., Wu, B., Ying, M., Sun, X., & Yang, G. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2947511 · Cited by 87
Allegra, A., Tonacci, A., Sciaccotta, R., Genovese, S., Musolino, C., Pioggia, G., & Gangemi, S. (2022) · Cancers · doi:10.3390/cancers14030606 · Cited by 87
Multi-level residual network VGGNet for fish species classification
Prasetyo, E. A., Suciati, N., & Fatichah, C. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.05.015 · Cited by 86
A hybrid quantum–classical neural network with deep residual learning
Liang, Y., Peng, W., Zheng, Z., Sílven, O., & Zhao, G. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.05.028 · Cited by 81
CIFAR-10 and CIFAR-100 Datasets
Krizhevsky, A. (2024) · TIB Data Manager · doi:10.57702/49zdxji5 · Cited by 80
Adaptive Weight Decay for Deep Neural Networks
Nakamura, K., & Hong, B. (2019) · IEEE Access · doi:10.1109/access.2019.2937139 · Cited by 78
FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search
Fang, J., Sun, Y., Zhang, Q., Peng, K., Li, Y., Liu, W., & Wang, X. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3044416 · Cited by 73
Galea, C., & Farrugia, R. A. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2788002 · Cited by 72
A Power-Efficient Optimizing Framework FPGA Accelerator Based on Winograd for YOLO
Bao, C., Xie, T., Feng, W., Chang, L., & Yu, C. (2020) · IEEE Access · doi:10.1109/access.2020.2995330 · Cited by 65
Al-Kharraz, M., Elrefaei, L. A., & Fadel, M. (2020) · IEEE Access · doi:10.1109/access.2020.3019937 · Cited by 63
Deep learning based spectral CT imaging
Wu, W., Hu, D., Niu, C., Broeke, L. V., Butler, A. P. H., Cao, P., Atlas, J., Chernoglazov, A. I., Vardhanabhuti, V., & Wang, G. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.026 · Cited by 60
Remote Sensing Data Augmentation Through Adversarial Training
Lv, N., Ma, H., Chen, C., Pei, Q., Zhou, Y., Xiao, F., & Li, J. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3110842 · Cited by 54
Deep learning for COVID-19 chest CT (computed tomography) image analysis: A lesson from lung cancer
Jiang, H., Tang, S., Liu, W., & Zhang, Y. (2021) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2021.02.016 · Cited by 51
Large-scale distributed L-BFGS
Najafabadi, M. M., Khoshgoftaar, T. M., Villanustre, F., et al. (2017) · Journal Of Big Data · doi:10.1186/s40537-017-0084-5 · Cited by 50
Feng, Z., Nie, D., Wang, L., & Shen, D. G. (2018) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2018.8363713 · Cited by 45
Transfer Learning Method for Very Deep CNN for Text Classification and Methods for its Evaluation
Shun, M., & Shibata, C. (2018) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2018.10220 · Cited by 38
A general framework for maximizing likelihood under incomplete data
Couso, I., & Didier Dubois, A. (2017) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2017.10.030 · Cited by 31
Kumar, D., Taylor, G. W., & Wong, A. K. C. (2017) · Journal of Computational Vision and Imaging Systems · doi:10.15353/vsnl.v3i1.166 · Cited by 28
Training Very Deep CNNs for General Non-Blind Deconvolution
Wang, R., & Tao, D. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2815084 · Cited by 27
Image recognition based on deep residual shrinkage Network
Li, Y., & Chen, H. (2021) · International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) · doi:10.1109/aiea53260.2021.00077 · Cited by 27
Severity Grading and Early Retinopathy Lesion Detection through Hybrid Inception-ResNet Architecture
Yasin, S., Iqbal, N., Ali, T. M., et al. (2021) · Sensors · doi:10.3390/s21206933 · Cited by 26
Hyperparameter Optimization for Deep Residual Learning in Image Classification
Jafar, A., & Myungho, L. (2020) · IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C) · doi:10.1109/acsos-c51401.2020.00024 · Cited by 22
A residual dense network assisted sparse view reconstruction for breast computed tomography
Fu, Z., Tseng, H. W., Vedantham, S., Karellas, A., & Bilgin, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-77923-0 · Cited by 21
Li, L., Jin, W., & Huang, Y. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02769-6 · Cited by 20
Jennings, J. M., Loyd, B. J., Miner, T. M., Yang, C. C., Stevens‐Lapsley, J. E., & Dennis, D. A. (2019) · The Bone & Joint Journal · doi:10.1302/0301-620x.101b7.bjj-2018-1420.r1 · Cited by 14
Efficient clustering for aggregate loads: An unsupervised pretraining based method
Ruhang, X. (2020) · Energy · doi:10.1016/j.energy.2020.118617 · Cited by 14
Datta, A., & Swamidass, S. J. (2022) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0010877400003116 · Cited by 12
An Adaptive and Asymmetric Residual Hash for Fast Image Retrieval
Cheng, S., Wang, L., & Du, A. (2019) · IEEE Access · doi:10.1109/access.2019.2922738 · Cited by 11
Effects of image compression on face image manipulation detection: A case study on facial retouching
Rathgeb, C., Bernardo, K., Haryanto, N. E., & Busch, C. (2021) · IET Biometrics · doi:10.1049/bme2.12027 · Cited by 9
Deep networks with stochastic depth for acoustic modelling
Chen, D., Zhang, W., Xu, X., et al. (2016) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipa.2016.7820692 · Cited by 7
Cal-Net: Jointly Learning Classification and Calibration On Imbalanced Binary Classification Tasks
Datta, A., Flynn, N. R., & Swamidass, S. J. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534411 · Cited by 6
Fujii, T., Sei, Y., Tahara, Y., Orihara, R., & Ohsuga, A. (2019) · The International journal of networked and distributed computing · doi:10.2991/ijndc.k.190710.002 · Cited by 3
Image Recognition Based on an Improved Deep Residual Shrinkage NetworkPreprint
Yang, Z., Wu, B., Wang, Z., Li, Y., & Feng, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4013383 · Cited by 2
Cited by
Taye, M. M. (2023) · Computers · doi:10.3390/computers12050091 · Cited by 1,057
Raza, S. M., Abidi, S. M. H., Masuduzzaman, M., & Shin, S. Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131357 · Cited by 13
Metadata
- Authors
- Shafiq, M., & Gu, Z.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2022-09-07
- Volume
- 12
- Issue
- 18
- Pages
- 8972
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W4295122555
- Cited by
- 1,023
- References
- 79
- FWCI
- 64.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.