ResNet or DenseNet? Introducing Dense Shortcuts to ResNet
Open accessAbstract
ResNet or DenseNet? Nowadays, most deep learning based approaches are implemented with seminal backbone networks, among them the two arguably most famous ones are ResNet and DenseNet. Despite their competitive performance and overwhelming popularity, inherent drawbacks exist for both of them. For ResNet, the identity shortcut that stabilizes training might limit its representation capacity, and DenseNet mitigates it with multi-layer feature concatenation. However, the dense concatenation causes a new problem of requiring high GPU memory and more training time. Partially due to this, it is not a trivial choice between ResNet and DenseNet. This paper provides a unified perspective of dense summation to analyze them, which facilitates a better understanding of their core difference. We further propose dense weighted normalized shortcuts as a solution to the dilemma between them. Our proposed dense shortcut inherits the design philosophy of simple design in ResNet and DenseNet. On several benchmark datasets, the experimental results show that the proposed DSNet achieves significantly better results than ResNet, and achieves comparable performance as DenseNet but requiring fewer computation resources.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ResNet and DenseNet were selected in this study because the simple design strategy produces good performance.
“One reason that ResNet and DenseNet are exceptionally selected in this study is that the simple design strategy produces good performance [22].”
From Deep Learning for Improving the Effectiveness of Routine Prenatal Screening for Major Congenital Heart Diseases (2022) · cites this paper as [22]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 56,035 · see citing works
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · see citing works
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667 · see citing works
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · see citing works
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818 · see citing works
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853 · see citing works
Self-citationGrad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513 · see citing works
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,745 · see citing works
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465 · see citing works
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741 · see citing works
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381 · see citing works
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · see citing works
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244 · see citing works
Instance Normalization: The Missing Ingredient for Fast StylizationPreprint
Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2016) · arXiv.org · doi:10.48550/arxiv.1607.08022 · Cited by 4,239 · see citing works
Wu, Y., & He, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_1 · Cited by 3,601 · see citing works
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447 · see citing works
Res2Net: A New Multi-Scale Backbone Architecture
Gao, S., Cheng, M., Zhao, K., Zhang, X., Yang, M., & Torr, P. H. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2938758 · Cited by 3,423 · see citing works
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural NetworksPreprint
Salimans, T., & Kingma, D. P. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1602.07868 · Cited by 2,284 · see citing works
Deep Networks with Stochastic Depth
Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104 · see citing works
Understanding deep image representations by inverting them
Mahendran, A., & Vedaldi, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299155 · Cited by 1,827 · see citing works
How Does Batch Normalization Help Optimization? (No, It Is Not About Internal Covariate Shift)Preprint
Santurkar, S., Tsipras, D., Ilyas, A., & Ma̧dry, A. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1805.11604 · Cited by 1,788 · see citing works
Deeply-Supervised NetsPreprint
Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5185 · Cited by 1,661 · see citing works
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912 · see citing works
CondenseNet: An Efficient DenseNet Using Learned Group Convolutions
Huang, G., Liu, S., Maaten, L. V. D., & Weinberger, K. Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00291 · Cited by 904 · see citing works
FractalNet: Ultra-Deep Neural Networks without ResidualsPreprint
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07648 · Cited by 810 · see citing works
Dual Path NetworksPreprint
Chen, Y., Li, J., Xiao, H., Jin, X., Yan, S., & Feng, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01629 · Cited by 714 · see citing works
Weight normalization: a simple reparameterization to accelerate training of deep neural networks
Salimans, T., & Kingma, D. P. (2016) · neural information processing systems · Cited by 617 · see citing works
Unsupervised Intra-Domain Adaptation for Semantic Segmentation Through Self-Supervision
Pan, F., Shin, I., Rameau, F., Lee, S., & Kweon, I. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00382 · Cited by 407 · see citing works
Self-citationInterleaved Group Convolutions
Zhang, T., Qi, G.-J., Xiao, B., & Wang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.469 · Cited by 323 · see citing works
FractalNet: Ultra-Deep Neural Networks without Residuals.
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · International Conference on Learning Representations · Cited by 315 · see citing works
Kim, D., Woo, S., Lee, J., & Kweon, I. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00988 · Cited by 166 · see citing works
Self-citationUnderstanding Adversarial Examples From the Mutual Influence of Images and Perturbations
Zhang, C., Benz, P., Imtiaz, T., & Kweon, I. S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01453 · Cited by 144 · see citing works
Self-citationMemory-Efficient Implementation of DenseNetsPreprint
Pleiss, G., Chen, D., Huang, G. M., Li, T., van der Maaten, L., & Weinberger, K. Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06990 · Cited by 129 · see citing works
Revisiting Internal Covariate Shift for Batch Normalization
Awais, M., Iqbal, M. T. B., & Bae, S. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3026784 · Cited by 95 · see citing works
Targeted Attack for Deep Hashing Based Retrieval
Bai, J., Chen, B., Li, Y., Wu, D., Guo, W., Xia, S., & Yang, E. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_36 · Cited by 86 · see citing works
Recurrent Temporal Aggregation Framework for Deep Video Inpainting
Kim, D., Woo, S., Lee, J., & Kweon, I. S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2958083 · Cited by 71 · see citing works
Self-citationRevisiting Batch Normalization for Improving Corruption Robustness
Benz, P., Zhang, C., Karjauv, A., & Kweon, I. S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00054 · Cited by 66 · see citing works
Self-citationCD-UAP: Class Discriminative Universal Adversarial Perturbation
Zhang, C., Benz, P., Imtiaz, T., & Kweon, I.-S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6154 · Cited by 55 · see citing works
Self-citationWang, W., Li, X., Lü, T., & Yang, J. J. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/391 · Cited by 52 · see citing works
Double Targeted Universal Adversarial Perturbations
Benz, P., Zhang, C., Imtiaz, T., & Kweon, I. S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69538-5_18 · Cited by 52 · see citing works
Self-citationDeepPTZ: Deep Self-Calibration for PTZ Cameras
Zhang, C., Rameau, F., Kim, J., Argaw, D. M., Bazin, J., & Kweon, I. S. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093629 · Cited by 47 · see citing works
Self-citationUnsupervised Intra-domain Adaptation for Semantic Segmentation through Self-SupervisionPreprint
Pan, F., Shin, I., Rameau, F., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07703 · Cited by 40 · see citing works
Self-citationAdversarial Attack on Deep Product Quantization Network for Image Retrieval
Feng, Y., Chen, B., Dai, T., & Xia, S. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6708 · Cited by 39 · see citing works
Gradients explode - Deep Networks are shallow - ResNet explainedPreprint
Philipp, G., Song, D. X., & Carbonell, J. (2017) · arXiv (Cornell University) · Cited by 34 · see citing works
Robustness May Be at Odds with Fairness: An Empirical Study on Class-wise AccuracyPreprint
Benz, P., Zhang, C., Karjauv, A., & Kweon, I. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13365 · Cited by 32 · see citing works
Self-citationRevisiting Residual Networks with Nonlinear Shortcuts.
Zhang, C., Rameau, F., Lee, S., Kim, J., Benz, P., Argaw, D. M., Bazin, J., & Kweon, I. S. (2019) · KAIST Institutional Repository (KAIST) · Cited by 27 · see citing works
Self-citationKim, M., Woo, S., Kim, D., & Kweon, I. S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00097 · Cited by 21 · see citing works
Self-citationTowards an Adversarially Robust Normalization ApproachPreprint
Awais, M., Shamshad, F., & Bae, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11007 · Cited by 18 · see citing works
Intriguing properties of adversarial training at scalePreprint
Xie, C., & Yuille, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.03787 · Cited by 16 · see citing works
Data from Model: Extracting Data from Non-robust and Robust ModelsPreprint
Benz, P., Zhang, C., Imtiaz, T., & Kweon, I.-S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06196 · Cited by 8 · see citing works
Self-citationBenz, P., Zhang, C., & Kweon, I. S. (2021) · arXiv (Cornell University) · Cited by 8 · see citing works
Self-citationUnderstanding Adversarial Examples from the Mutual Influence of Images and PerturbationsPreprint
Zhang, C., Benz, P., Imtiaz, T., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06189 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
2 of the 66 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Khanam, R., Hussain, M., Hill, R. C., & Allen, P. (2024) · IEEE Access · doi:10.1109/access.2024.3425166 · Cited by 273 · see citing works
A Comprehensive Survey of Deep Learning Approaches in Image Processing
Τρίγκα, Μ., & Dritsas, E. (2025) · Sensors · doi:10.3390/s25020531 · Cited by 159 · see citing works
Chauhan, T., Palivela, H., & Tiwari, S. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100020 · Cited by 104 · see citing works
Eye Know You Too: Toward Viable End-to-End Eye Movement Biometrics for User Authentication
Lohr, D. J., & Komogortsev, O. V. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3201369 · Cited by 90 · see citing works
Classification of Breast Cancer Histopathological Images Using DenseNet and Transfer Learning
Wakili, M. A., Shehu, H. A., Sharif, M. H., Sharif, M. H. U., Umar, A., Kusetoğulları, H., İnce, İ. F., & Uyaver, Ş. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/8904768 · Cited by 88 · see citing works
Delamination detection in CFRP laminates using deep transfer learning with limited experimental data
Azad, M. M., Kumar, P., & Kim, H. S. (2024) · Journal of Materials Research and Technology · doi:10.1016/j.jmrt.2024.02.067 · Cited by 64 · see citing works
Revisiting Batch Normalization for Improving Corruption Robustness
Benz, P., Zhang, C., Karjauv, A., & Kweon, I. S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00054 · Cited by 66 · see citing works
Self-citationNurmaini, S., Partan, R. U., Bernolian, N., Sapitri, A. I., Tutuko, B., Rachmatullah, M. N., Darmawahyuni, A., Firdaus, F., & Mose, J. C. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11216454 · Cited by 61 · see citing works
Nillmani, Jain, P. K., Sharma, N., Kalra, M. M., Višković, K., Saba, L., & Suri, J. S. (2022) · Diagnostics · doi:10.3390/diagnostics12030652 · Cited by 65 · see citing works
Depth-Wise Separable Convolution Attention Module for Garbage Image Classification
Liu, F., Xu, H. F., Qi, M., Liu, D., Wang, J., & Kong, J. (2022) · Sustainability · doi:10.3390/su14053099 · Cited by 56 · see citing works
Brightness as an Augmentation Technique for Image Classification
Kandel, I., Castelli, M., & Manzoni, L. (2022) · Emerging Science Journal · doi:10.28991/esj-2022-06-04-015 · Cited by 55 · see citing works
Acoustic-Based Deep Learning Architectures for Lung Disease Diagnosis: A Comprehensive Overview
Sfayyih, A. H., Sabry, A. H., Jameel, S. M., Sulaiman, N., Raafat, S. M., Humaidi, A. J., & Alkubaisi, Y. M. (2023) · Diagnostics · doi:10.3390/diagnostics13101748 · Cited by 52 · see citing works
Saranya, K., Karthikeyan, U., Kumar, A., Salau, A. O., & Tin, T. T. (2025) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-00765-z · Cited by 51 · see citing works
GCCNet: A Novel Network Leveraging Gated Cross-Correlation for Multi-View Classification
Zeng, Y., Zhang, R., Zhang, H., Qiao, S., Huang, F., Tian, Q., & Peng, Y. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3521733 · Cited by 47 · see citing works
Zhou, W., Persello, C., Li, M., & Stein, A. (2023) · Remote Sensing of Environment · doi:10.1016/j.rse.2023.113767 · Cited by 46 · see citing works
Zhang, C., Benz, P., Karjauv, A., & Kweon, I. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16441 · Cited by 41 · see citing works
Self-citationHuang, P., Tseng, Y.-H., Tsai, C., Chen, J., Yang, S.-C., Chiu, F., Chen, Z., Hwang, J., Chuang, E. Y.-Y., Wang, Y., et al. (2022) · Biomedicines · doi:10.3390/biomedicines10020394 · Cited by 40 · see citing works
Palombo, M., Valindria, V. V., Singh, S., Chiou, E., Giganti, F., Pye, H., Whitaker, H. C., Atkinson, D., Punwani, S., Alexander, D. C., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-30182-1 · Cited by 39 · see citing works
Kommanduri, R., & Ghorai, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127444 · Cited by 38 · see citing works
Wei, X., Deng, C. J., Fang, W., Xie, C., Liu, S., Lu, M., Wang, F., & Wang, Y. (2024) · Industrial Crops and Products · doi:10.1016/j.indcrop.2024.118279 · Cited by 35 · see citing works
A Comparative Analysis of Various Transfer Learning Approaches Skin Cancer Detection
Ashim, L. K., Suresh, N., & Prasannakumar, C. V. (2021) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei51242.2021.9452854 · Cited by 34 · see citing works
Yang, C.-J., Lin, C., Wang, C., Wang, J., Chen, R., Su, F., Lee, Y.-J., Lui, C., Yeh, L., & Fang, Y.-H. D. (2022) · Diagnostics · doi:10.3390/diagnostics12051121 · Cited by 34 · see citing works
Deep crowd anomaly detection: state-of-the-art, challenges, and future research directions
Sharif, M. H., Jiao, L., & Omlin, C. W. P. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-024-11092-8 · Cited by 37 · see citing works
Melanoma Skin Cancer Detection Using Recent Deep Learning Models
Guergueb, T., & Akhloufi, M. A. (2021) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc46164.2021.9631047 · Cited by 29 · see citing works
Shamsuddin, D., Danilevicz, M. F., Al-Mamun, H. A., Bennamoun, M., & Edwards, D. (2024) · Remote Sensing · doi:10.3390/rs16214043 · Cited by 29 · see citing works
Sun, J., Xu, M., Ru, J., James-Bott, A., Xiong, D., Wang, X., & Cribbs, A. P. (2023) · European Journal of Medicinal Chemistry · doi:10.1016/j.ejmech.2023.115500 · Cited by 26 · see citing works
A deep convolutional neural network for the classification of imbalanced breast cancer dataset
Eshun, R. B., Bikdash, M. U., & Islam, A. K. M. K. (2024) · Healthcare Analytics · doi:10.1016/j.health.2024.100330 · Cited by 25 · see citing works
Universal Adversarial Training with Class-Wise Perturbations
Benz, P., Zhang, C., Karjauv, A., & Kweon, I. S. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428419 · Cited by 24 · see citing works
Self-citationParasitic egg recognition using convolution and attention network
AlDahoul, N., Karim, H. B. A., Momo, M. A., Escobar, F. I. F., Magallanes, V. A., & Tan, M. J. T. (2023) · Scientific Reports · doi:10.1038/s41598-023-41711-3 · Cited by 24 · see citing works
URNet: A U-Shaped Residual Network for Lightweight Image Super-Resolution
Wang, Y., Zhao, L. F., Liu, L., Hu, H., & Tao, W. (2021) · Remote Sensing · doi:10.3390/rs13193848 · Cited by 22 · see citing works
Kim, M., Woo, S., Kim, D., & Kweon, I. S. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00097 · Cited by 21 · see citing works
Self-citationViT-Based Multi-Scale Classification Using Digital Signal Processing and Image Transformation
Kim, G.-I., & Chung, K. (2024) · IEEE Access · doi:10.1109/access.2024.3389808 · Cited by 20 · see citing works
Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness
Zhang, C., Zhang, C., Zhang, C., Niu, A., Feng, J., Yoo, C. D., & Kweon, I. S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20056-4_42 · Cited by 18 · see citing works
Self-citationYOLF-ShipPnet: Improved RetinaNet with Pyramid Vision Transformer
Qiu, Z.-R., Rong, S.-Y., & Ye, L.-K. (2023) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-023-00235-4 · Cited by 14 · see citing works
Rodrigues, I. R., Dantas, M. S. M., Filho, A. T. D. O., Barbosa, G. B. N., Bezerra, D., de Souza, R. G., Marquezini, M. V., Endo, P. T., Kelner, J., & Sadok, D. F. H. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-022-04936-z · Cited by 16 · see citing works
MSF-YOLO: A multi-scale features fusion-based method for small object detection
Yang, F., Zhou, J., Chen, Y., Liao, J., & Yang, M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17818-0 · Cited by 16 · see citing works
Matthijs, L., Delande, L., Tobel, J. D., Büyükçakır, B., Claes, P. D., Vandermeulen, D., & Thevissen, P. W. (2024) · International Journal of Legal Medicine · doi:10.1007/s00414-024-03298-w · Cited by 16 · see citing works
Abu, M., Zahri, N. A. H., Amir, A., IZHAM, M., Yaakub, A., Anwar, S. A., & Ahmad, M. I. (2022) · Diagnostics · doi:10.3390/diagnostics12051258 · Cited by 14 · see citing works
System identification methods for dynamic models of brain activity
Griffith, T. D., & Hubbard, J. E. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102765 · Cited by 14 · see citing works
FedDebug: Systematic Debugging for Federated Learning Applications
Gill, W., Anwar, A., & Gulzar, M. A. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00053 · Cited by 13 · see citing works
Singh, M., Dalmia, S., & Ranjan, R. K. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18701-2 · Cited by 12 · see citing works
Cross-domain gesture recognition via WiFi signals with deep learning
Li, B., Chen, J., Yu, X., Yang, Z. M., & Zhang, J. (2024) · Ad Hoc Networks · doi:10.1016/j.adhoc.2024.103654 · Cited by 12 · see citing works
Sarıtürk, B., & Şeker, D. Z. (2022) · Advances in Space Research · doi:10.1016/j.asr.2022.05.010 · Cited by 12 · see citing works
Shyni, H. M., & Chitra, E. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106600 · Cited by 11 · see citing works
Daly, K., & Olukoya, O. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107959 · Cited by 12 · see citing works
Self-Supervised Monocular Depth and Motion Learning in Dynamic Scenes: Semantic Prior to Rescue
Lee, S., Rameau, F., Im, S., & Kweon, I. S. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01641-5 · Cited by 11 · see citing works
Self-citationBoosting Online Feature Transfer via Separable Feature Fusion
Li, L., Liang, S.-N., Yang, Y., & Jin, Z. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891976 · Cited by 11 · see citing works
Bias Detection and Generalization in AI Algorithms on Edge for Autonomous Driving
Katare, D., Kourtellis, N., Park, S., Perino, D., Janssen, M., & Ding, A. Y. (2022) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec54971.2022.00050 · Cited by 11 · see citing works
Ashiku, L., & Dağli, C. H. (2023) · Transplantation Proceedings · doi:10.1016/j.transproceed.2022.12.005 · Cited by 11 · see citing works
Mao, X., Tian, Y., Jin, T., & Bo, D. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129607 · Cited by 10 · see citing works
Activity Recognition in Smart Homes via Feature-Rich Visual Extraction of Locomotion Traces
Zolfaghari, S., Massa, S. M., & Riboni, D. (2023) · Electronics · doi:10.3390/electronics12091969 · Cited by 9 · see citing works
A Multi-stage Deep Model for Crop Variety and Disease Prediction
Nennuri, R., Kumar, R. H., Prathyusha, G., Tejaswini, K., Kanishka, G., & Sunitha, G. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-27524-1_6 · Cited by 9 · see citing works
Deep Learning Methods for Bug Bite Classification: An End-to-End System
Ilijoski, B., Dineva, K. T., Tojtovska, B., Petrov, P., Mladenovska, T., Trajanoska, M., Gjorshoska, I., & Lameski, P. (2023) · Applied Sciences · doi:10.3390/app13085187 · Cited by 9 · see citing works
Lunagaria, M., Katkar, V. D., & Vaghela, K. N. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130954 · Cited by 9 · see citing works
Efficient deep-narrow residual networks using dilated pooling for scene recognition
Qiao, Z., Yuan, X., Zhang, R., Chen, T., & Zhang, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121018 · Cited by 8 · see citing works
Self-citationReal-Time Audio-Visual End-To-End Speech Enhancement
Zhu, Z., Yang, H., Tang, M., Yang, Z., Eskimez, Ş. E., & Wang, H. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094724 · Cited by 8 · see citing works
Gong, A., Fu, W., Li, H., Guo, N., & Pan, T. (2024) · Frontiers in Endocrinology · doi:10.3389/fendo.2024.1364519 · Cited by 8 · see citing works
Convolutional Neural Networks for Omnidirectional Image Quality Assessment: A Benchmark
Sendjasni, A., Larabi, M., & Cheikh, F. A. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3181235 · Cited by 8 · see citing works
Serna, C. G., Romero-Palomo, F., Arcadu, F., Funk, J., Schumacher, V. L., & Janowczyk, A. R. (2022) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2022.100126 · Cited by 8 · see citing works
A Deep Learning-Based No-Reference Quality Metric for High-Definition Images Compressed With HEVC
Xiang, J., Tohidypour, H. R., Wang, Y., Nasiopoulos, P., & Pourazad, M. T. (2023) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2023.3277193 · Cited by 8 · see citing works
Paaß, G., & Giesselbach, S. (2023) · Artificial intelligence: foundations, theory, and algorithms/Artificial intelligence: Foundations, theory, and algorithms · doi:10.1007/978-3-031-23190-2_2 · Cited by 8 · see citing works
Adaptive Learning Model for Detecting Wheat Diseases
Abdalla, M., Mohamed, O., & Azmi, E. M. (2024) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2024.01505130 · Cited by 7 · see citing works
Zhang, J., Wei, X., Song, Z., Chen, Z., & Jin, J. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.109940 · Cited by 7 · see citing works
A Hybrid Deep Transfer Learning Framework for Delamination Identification in Composite Laminates
Yazdani, M. H., Azad, M. M., Khalid, S., & Kim, H. S. (2025) · Sensors · doi:10.3390/s25030826 · Cited by 9 · see citing works
Transforming pulmonary health care: the role of artificial intelligence in diagnosis and treatment
Farha, F., Abass, S., Khan, S. M., Ali, J., Parveen, B., Ahmad, S., & Parveen, R. (2025) · Expert Review of Respiratory Medicine · doi:10.1080/17476348.2025.2491723 · Cited by 7 · see citing works
Nesheli, S. J., Sabet, M., Koozari, A., Mirzaghavami, P. S., Eftekhar, A., Elhaie, M., Rouhi, S., Lariche, N. J., Abidi, M., & Rezaeijo, S. M. (2025) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-025-09444-8 · Cited by 7 · see citing works
Artificial Intelligence of Behavior for Human Emotion Recognition in Closed Environments
Alvarez-Garcia, G.-A., Cañón, C. L. Z., García-Sánchez, A.-J., Garcı́a-Haro, J., Sarria-Paja, M., & Asorey-Cacheda, R. (2024) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2024.3463173 · Cited by 7 · see citing works
Lightweight Pedestrian Detection Based on Feature Multiplexed Residual Network
Sha, M., Zeng, K., Tao, Z., Wang, Z., & Liu, Q. (2023) · Electronics · doi:10.3390/electronics12040918 · Cited by 7 · see citing works
Gan, Z., & Subaşı, A. (2023) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2023.105118 · Cited by 7 · see citing works
Azar, A. S., Ghafari, A., Najar, M. O., Rikan, S. B., Ghafari, R., Khamene, M. F., & Sheikhzadeh, P. (2021) · Frontiers in biomedical technologies · doi:10.18502/fbt.v8i2.6517 · Cited by 6 · see citing works
Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency
Lee, S., Im, S., Lin, S. C.-F., & Kweon, I. S. (2021) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v35i3.16281 · Cited by 106 · see citing works
Self-citationFederated transfer learning for distributed drought stage prediction
Raza, M. O., Umar, A., Rasheed, J., Aşuroğlu, T., & Alsubai, S. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00288-8 · Cited by 5 · see citing works
Shan, D., Yang, M., Huang, L., Panduo, D., & Qu, B. (2025) · Medical Physics (Lancaster) · doi:10.1002/mp.70003 · Cited by 8 · see citing works
Robust Watermarking for Neural Network Models Using Residual Network
Wang, L., Wang, Z., Li, X., & Qin, C. (2022) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp55362.2022.9949601 · Cited by 5 · see citing works
Visualizing Portable Executable Headers for Ransomware Detection: A Deep Learning-Based Approach
Dam, T. Q., Nguyen, N., Le, V. T., Le, T. D., Uwizeyemungu, S., & Dinh, T. L. (2024) · JUCS - Journal of Universal Computer Science · doi:10.3897/jucs.104901 · Cited by 5 · see citing works
Sun, C., Bao, Y., Bao, Y., Vandansambuu, B., Bayarsaikhan, S., Gantumur, B., Chantsal, N., Hai, Q., Bai, X. Y., Tang, G., et al. (2024) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2024.1310046 · Cited by 5 · see citing works
RACH Traffic Prediction in Massive Machine Type Communications
Mehri, H., Mehrpouyan, H., & Chen, H. (2025) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2025.3542760 · Cited by 5 · see citing works
Ahmed, U., Lin, J. C., & Srivastava, G. (2021) · IEEE Internet of Things Magazine · doi:10.1109/iotm.001.2100088 · Cited by 5 · see citing works
Ahmed, U., Lin, J. C., & Srivastava, G. (2022) · Wireless Networks · doi:10.1007/s11276-022-03076-9 · Cited by 5 · see citing works
SSP Framework: A New Approach to Designing Lightweight Convolutional Neural Networks
Turay, T., & Vladimirova, T. (2022) · IEEE Access · doi:10.1109/access.2022.3208924 · Cited by 5 · see citing works
Anomaly Detection in Red Reflex Images Using Deep Learning Approaches
Kriangsakdachai, S., Palakvangsa-Na-Ayudhya, S., Kusakunniran, W., Ayudhya, W. D. N., Chantrasagul, C., Manasboonpermpool, R., Sathianvichitr, K., Sangsre, P., & Surachatkumtonekul, T. (2022) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon55691.2022.9977626 · Cited by 5 · see citing works
IoT based application designing of Deep Fake Test for Face animation
Sridevi, K., Kumar, K. S., Sameera, D., Garapati, Y., Krishnamadhuri, D., & Bethu, S. (2022) · International Conference on Cloud and Big Data Computing (ICCBDC) · doi:10.1145/3555962.3555967 · Cited by 5 · see citing works
Cao, Y., Sui, B., Zhang, S., & Qin, H. (2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2023.3251364 · Cited by 5 · see citing works
Verma, A., Koundal, D., Jain, S., Doegar, A., & Ranjan, R. (2025) · Potato Research · doi:10.1007/s11540-025-09945-y · Cited by 4 · see citing works
Enhanced Zero-Shot YOLOv10 for Multi-Class Tiny-Object Detection of Steel Surface Defects
Liu, T. (2024) · International Conference on Robotics and Computer Vision (ICRCV) · doi:10.1109/icrcv62709.2024.10758607 · Cited by 4 · see citing works
Evaluating the Performance of DenseNet in ECG Report Automation
Husain, G., Siddiqua, A., & Toma, M. (2025) · Electronics · doi:10.3390/electronics14091837 · Cited by 4 · see citing works
Ning, Y., Yu, Q., Fan, X., Jiang, W., Chen, X., Jiang, H., Xie, K., Liu, R., Zhou, Y., Zhang, X., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-17393-4 · Cited by 4 · see citing works
Ji, X., Liu, C., Hu, J., Li, S., Wang, L., Cheng, X., Liu, C., & Zhang, Y. (2026) · European journal of medical research · doi:10.1186/s40001-025-03395-5 · Cited by 4 · see citing works
Sitepu, A. C., & Liu, C.-M. (2024) · IEEE Access · doi:10.1109/access.2024.3426350 · Cited by 4 · see citing works
Pneumonia Detection Using Deep Transfer Learning in Gender Specific Chest X-ray Images
Sakib, S. N., Masud, R., Rubaiat, S. Y., Bepery, C., Sarker, M., & Hasan, M. K. (2021) · 2021 International Conference on Electronics, Communications and Information Technology (ICECIT) · doi:10.1109/icecit54077.2021.9641281 · Cited by 4 · see citing works
ML-Stealer: Stealing Prediction Functionality of Machine Learning Models with Mere Black-Box Access
Liu, G., Wang, S., Wan, B., Wang, Z., & Wang, C. (2021) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom53373.2021.00083 · Cited by 4 · see citing works
Deep Feature Detection Approach for COVID-19 Classification based on X-ray Images
Noor, A., Pattanaik, P. A., Khan, M. Z., Alromema, W., & Noor, T. H. (2023) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2023.0140514 · Cited by 4 · see citing works
Building Usage Classification Using a Transformer-based Multimodal Deep Learning Method
Zhou, W., Persello, C., & Stein, A. (2023) · Joint Urban Remote Sensing Event (JURSE) · doi:10.1109/jurse57346.2023.10144168 · Cited by 4 · see citing works
A novel framework for quantitative rhinoplasty evaluation by ResNet convolutional neural network
Bouchani, Z., Zoroofi, R. A., & Sadeghi, M. R. (2024) · Biomedical Engineering Advances · doi:10.1016/j.bea.2024.100112 · Cited by 4 · see citing works
Lv, J., & Chen, Y. (2026) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-026-01176-4 · Cited by 3 · see citing works
2D-SNet: A Lightweight Network for Person Re-Identification on the Small Data Regime
Li, W., Shao, S., Qiu, Z., Zhu, Z., & Song, A. (2023) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2023.3332285 · Cited by 3 · see citing works
Pinasthika, K., Utaminingrum, F., Lin, C., Wada, C., & Shih, T. K. (2024) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2024.100216 · Cited by 3 · see citing works
Relation Explore Convolutional Block Attention Module for Skin Lesion Classification
Su, Q., Hamed, H. N. A., & Zhou, D. (2024) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70002 · Cited by 3 · see citing works
Breast Cancer Detection Using ResNet and DenseNet Architecture
Pavlović, T., Popović, T., & Čakić, S. (2025) · doi:10.1109/it64745.2025.10930260 · Cited by 3 · see citing works
- Authors
- Zhang, C., Benz, P., Argaw, D. M., Lee, S., Kim, J., Rameau, F., Bazin, J.-C., & Kweon, I. S.
- Affiliations
- Korea Advanced Institute of Science and Technology (KR)
- Venue
- 2021 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2021-01
- Pages
- 3549-3558
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W3120903390
- Cited by
- 174
- References
- 66
- Citations by year
- 2026: 14 · 2025: 36 · 2024: 40 · 2023: 36 · 2022: 31 · 2021: 17
- FWCI
- 10.14
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Winter Conference on Applications of Computer Vision (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- ResNet, DenseNet, feature concatenation, network design, GPU memory efficiency, computational cost
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review