The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Selective Kernel Networks
Open accessAbstract
In standard Convolutional Neural Networks (CNNs), the receptive fields of artificial neurons in each layer are designed to share the same size. It is well-known in the neuroscience community that the receptive field size of visual cortical neurons are modulated by the stimulus, which has been rarely considered in constructing CNNs. We propose a dynamic selection mechanism in CNNs that allows each neuron to adaptively adjust its receptive field size based on multiple scales of input information. A building block called Selective Kernel (SK) unit is designed, in which multiple branches with different kernel sizes are fused using softmax attention that is guided by the information in these branches. Different attentions on these branches yield different sizes of the effective receptive fields of neurons in the fusion layer. Multiple SK units are stacked to a deep network termed Selective Kernel Networks (SKNets). On the ImageNet and CIFAR benchmarks, we empirically show that SKNet outperforms the existing state-of-the-art architectures with lower model complexity. Detailed analyses show that the neurons in SKNet can capture target objects with different scales, which verifies the capability of neurons for adaptively adjusting their receptive field sizes according to the input. The code and models are available at https://github.com/implus/SKNet.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Research works printed but not linked: 27
- 10.1167/15.9.7 · DOI
- 10.1073/pnas.89.17.8366 · DOI · Paper page
- 10.1016/0006-8993(78)90937-X · DOI · Paper page
- 10.1038/11197 · DOI · Paper page
- 10.1109/CVPR.2018.00474 · DOI · Paper page
- 10.18653/v1/D15-1044 · DOI · Paper page
- mnih, 2014, Recurrent models of visual attention, NIPS
- nair, 2010, Rectified linear units improve restricted boltzmann machines, ICML
- abdi, 2016, Multi-residual networks. arxiv preprint
- jia, 2016, Dynamic filter networks, NIPS
- krizhevsky, 2009, Learning multiple layers of features from tiny images
- 10.1109/ICCV.2015.172 · DOI · Paper page
- larochelle, 2010, Learning to combine foveal glimpses with a third-order boltzmann machine, NIPS
- 10.1109/CVPR.2017.75 · DOI · Paper page
- zhang, 2018, Image super-resolution using very deep residual channel attention networks, 10.1007/978-3-030-01234-2_18 · DOI · Paper page
- zhang, 2017, Residual networks of residual networks: Multilevel residual networks, Transactions on Circuits and Systems for Video Technology
- 10.1109/34.730558 · DOI · Paper page
- jaderberg, 2015, Spatial transformer networks, NIPS
- 10.1109/CVPR.2017.200 · DOI · Paper page
- chen, 2018, Person search via a mask-guided two-stream cnn model, 10.1007/978-3-030-01234-2_45 · DOI
- 10.1109/32.666826 · doi:10.1109/32.666826
- chen, 2017, Dual path networks, NIPS
- 10.1109/CVPR.2016.503 · DOI · Paper page
- 10.1007/978-3-030-01234-2_1 · DOI · Paper page
- 10.1109/FG.2018.00088 · DOI
- 10.1109/CVPR.2017.634 · DOI · Paper page
- 10.1109/CVPR.2015.7298594 · DOI · Paper page
Cited by
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259
“, ResNet, ResNeXt), there are still some specific modules and operations designed for CNNs and not considered in this work, such as SE [22], SK [35], dilated convolution [73], model pruning [19], and NAS [60].”
MethodSelf-citationA review on the attention mechanism of deep learning
Niu, Z., Zhong, G., & Yu, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.091 · Cited by 3,379
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566
“[114] to propose an automatic selection operation called selective kernel (SK) convolution.”
BackgroundAn Empirical Study of Training Self-Supervised Vision Transformers
Chen, X., Xie, S., & He, K. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00950 · Cited by 1,648
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., Manmatha, R., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00309 · Cited by 1,648
Going deeper with Image Transformers
Touvron, H., Cord, M., Sablayrolles, A., Synnaeve, G., & Jegou, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00010 · Cited by 1,259
DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution
Qiao, S., Chen, L.-C., & Yuille, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01008 · Cited by 1,245
Dai, Y., Gieseke, F., Oehmcke, S., Wu, Y., & Barnard, K. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00360 · Cited by 1,274
LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference
Graham, B., El-Nouby, A., Touvron, H., Stock, P., Joulin, A., Jegou, H., & Douze, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01204 · Cited by 935
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J. M., & Luo, P. (2021) · arXiv · doi:10.48550/arxiv.2105.15203 · Cited by 5,090
Self-citationDynamic Neural Networks: A Survey
Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3117837 · Cited by 848
COVID-19 Detection Through Transfer Learning Using Multimodal Imaging Data
Horry, M. J., Chakraborty, S., Paul, M., Ulhaq, A., Pradhan, B., Saha, M., & Shukla, N. (2020) · IEEE Access · doi:10.1109/access.2020.3016780 · Cited by 472
Chen, X., Lin, K.-Y., Wang, J., Wu, W., Qian, C., Li, H., & Zeng, G. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58621-8_33 · Cited by 488
Rethinking Bottleneck Structure for Efficient Mobile Network Design
Zhou, D., Hou, Q., Chen, Y., Feng, J., & Yan, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58580-8_40 · Cited by 292
A Survey on Semi-, Self- and Unsupervised Learning for Image Classification
Schmarje, L., Santarossa, M., Schroder, S.-M., & Koch, R. (2021) · IEEE Access · doi:10.1109/access.2021.3084358 · Cited by 246
Vision Transformers Are Robust Learners
Paul, S., & Chen, P.-Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20103 · Cited by 244
PAIP 2019: Liver cancer segmentation challenge
Kim, Y. J., Jang, H., Lee, K., Park, S., Min, S.-G., Hong, C., Park, J. H., Lee, K., Kim, J., Hong, W., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101854 · Cited by 131
Mitigating face recognition bias via group adaptive classifier
Gong, S., Liu, X., & Jain, A. K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00342 · Cited by 92
Research on Improved YOLOv5 for Low-Light Environment Object Detection
Wang, J., Yang, P., Liu, Y., Shang, D., Hui, X., Song, J., & Chen, X. (2023) · Electronics · doi:10.3390/electronics12143089 · Cited by 79
Lamaakal, I., Maleh, Y., El Makkaoui, K., Ouahbi, I., Pławiak, P., Alfarraj, O., Almousa, M., & Abd El-Latif, A. A. (2025) · Sensors · doi:10.3390/s25051318 · Cited by 60
Zhu, J., Li, X., Jin, P., Xu, Q., Sun, Z., & Song, X. (2020) · Sensors · doi:10.3390/s21010027 · Cited by 51
“The first kind is explicit attention, such as SENet [16], Residual Attention [17], CBAM [18], SKNet [19], ResneSt [20], etc.”
Self-citationOdusami, M., Maskeliūnas, R., & Damaševičius, R. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13101496 · Cited by 42
“By varying the kernel size, the convolution operation can adapt to different spatial scales present in the input image [37,38].”
BackgroundA channel-spatial-temporal attention-based network for vibration-based damage detection
Liao, S., Liu, H., Yang, J., & Ge, Y. (2022) · Information Sciences · doi:10.1016/j.ins.2022.05.042 · Cited by 31
Self-citationRecaptured screen image demoiréing in raw domain
Yue, H., Cheng, Y., Mao, Y., Cao, C., & Yang, J. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3198333 · Cited by 26
Self-citationNon-Maximum Suppression Guided Label Assignment for Object Detection in Crowd Scenes
Jiang, H., Zhang, X., & Xiang, S. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3293333 · Cited by 16
Zhang, X., Yin, H., Ling, F., Zhan, J., & Zhou, Y. (2023) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011330 · Cited by 15
Dai, Y., Xue, C., & Zhou, L. (2022) · PLOS ONE · doi:10.1371/journal.pone.0263729 · Cited by 6
MoCoLSK: Modality-Conditioned High-Resolution Downscaling for Land Surface Temperature
Dai, Q., Yuan, C., Dai, Y., Li, Y., Li, X., Ni, K., Xu, J., Shu, X., & Yang, J. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3547945 · Cited by 5
Self-citation
Metadata
- Authors
- Li, X., Wang, W., Hu, X., & Yang, J.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 510-519
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2922509574
- Cited by
- 3,134
- References
- 22
- FWCI
- 91.76
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.