The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Dynamic Convolution: Attention Over Convolution Kernels
Open accessAbstract
Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited representation capability. To address this issue, we present Dynamic Convolution, a new design that increases model complexity without increasing the network depth or width. Instead of using a single convolution kernel per layer, dynamic convolution aggregates multiple parallel convolution kernels dynamically based upon their attentions, which are input dependent. Assembling multiple kernels is not only computationally efficient due to the small kernel size, but also has more representation power since these kernels are aggregated in a non-linear way via attention. By simply using dynamic convolution for the state-of-the-art architecture MobileNetV3-Small, the top-1 accuracy of ImageNet classification is boosted by 2.9% with only 4% additional FLOPs and 2.9 AP gain is achieved on COCO keypoint detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Squeeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356 · cited 4×
“Efficient CNNs: Recently, designing efficient CNN architectures [14, 11, 25, 10, 40, 22] has been an active research area.”
BackgroundInfluentialDeep High-Resolution Representation Learning for Human Pose Estimation
Sun, K., Xiao, B., Liu, D., & Wang, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00584 · Cited by 5,984
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Research works printed but not linked: 29
- hongyi, 0, mixup: Beyond empirical risk minimization, International Conference on Learning Representations
- zhang, 0, Lq-nets: Learned quantization for highly accurate and compact deep neural networks, the European Conference on Computer Vision (ECCV)
- 10.1007/978-3-030-01231-1_29 · DOI · Paper page
- zuxuan, 0, Blockdrop: Dynamic inference paths in residual networks, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- wu, 2017, Shift A zero flop zero parameter alternative to spatial convolutions
- 10.1109/CVPR.2019.01099 · DOI · Paper page
- yu, 0, Slimmable neural networks, International Conference on Learning Representations
- 10.1109/CVPR.2019.00748 · DOI · Paper page
- brandon, 2019, Condconv: Conditionally parameterized convolutions for efficient inference, NeurIPS
- 10.1109/CVPR.2018.00716 · DOI · Paper page
- howard, 2017, Mobilenets Efficient convolutional neural networks for mobile vision applications
- huang, 0, Multi-scale dense networks for resource efficient image classification, International Conference on Learning Representations
- iandola, 2016, Squeezenet: Alexnet-level accuracy with 50x fewer parameters and <1mb model size, CoRR abs/1602 07360
- lin, 2017, Runtime neural pruning, Advances in neural information processing systems, 2181
- lin, 0, Microsoft coco: Common objects in context, European Conference on Computer Vision, 740
- liu, 0, DARTS: Differentiable architecture search, International Conference on Learning Representations
- 10.1109/CVPR.2019.00881 · DOI · Paper page
- courbariaux, 2015, Binaryconnect: Training deep neural networks with binary weights during propagations, Advances in Neural IInformation Processing Systems, 3123
- guo, 2019, Single path one-shot neural architecture search with uniform sampling
- 10.1007/978-3-030-01261-8_25 · DOI · Paper page
- 10.1109/ICCV.2019.00200 · DOI · Paper page
- han, 0, Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding, International Conference on Learning Representations (ICLR), 10
- cai, 0, ProxylessNAS: Direct neural architecture search on target task and hardware, International Conference on Learning Representations
- 10.1007/978-3-030-01234-2_48 · DOI · Paper page
- liu, 0, Dynamic deep neural networks: Optimizing accuracy -efficiency trade-offs by selective execution, AAAI Conference on Artificial Intelligence (AAAI)
- 10.1609/aaai.v33i01.33014780 · DOI · Paper page
- zhu, 0, Trained ternary quantization, International Conference on Learning Representations (ICLR)
- nair, 2010, Hinton. Rectified linear units improve restricted boltzmann machines, ICML
- 10.1109/CVPR.2018.00907 · DOI · Paper page
Cited by
Attention mechanisms in computer vision: A survey
Guo, M.-H., Xu, T.-X., Liu, J.-J., Liu, Z.-N., Jiang, P.-T., Mu, T.-J., Zhang, S.-H., Martin, R. R., Cheng, M.-M., & Hu, S.-M. (2022) · Computational Visual Media · doi:10.1007/s41095-022-0271-y · Cited by 2,566
“[116] proposed dynamic convolution, a novel operator design that increases representational power with negligible additional computational cost and does not change the width or depth of the network in parallel with CondConv [174].”
BackgroundSelf-citationGoing deeper with Image Transformers
Touvron, H., Cord, M., Sablayrolles, A., Synnaeve, G., & Jegou, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00010 · Cited by 1,259
DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution
Qiao, S., Chen, L.-C., & Yuille, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01008 · Cited by 1,245
Conditional DETR for Fast Training Convergence
Meng, D., Chen, X., Fan, Z., Zeng, G., Li, H., Yuan, Y., Sun, L., & Wang, J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00363 · Cited by 1,055
Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition
Chen, Y., Zhang, Z., Yuan, C., Li, B., Deng, Y., & Hu, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01311 · Cited by 1,039
Self-citation
Metadata
- Authors
- Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 11027-11036
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3034421924
- Cited by
- 1,477
- References
- 15
- FWCI
- 44.36
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dynamic Convolution: Attention Over Convolution Kernels. https://app.cochat.ai/papers/10.1109/cvpr42600.2020.01104
- The paper
- Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020). Dynamic Convolution: Attention Over Convolution Kernels. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/cvpr42600.2020.01104
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.