Dynamic Neural Networks: A Survey

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

Long Short-Term Memory

Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325

Densely Connected Convolutional Networks

Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566

Squeeze-and-Excitation Networks

Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667

CBAM: Convolutional Block Attention Module

Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853

Language Models are Few-Shot Learners

Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372

MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications

Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204

Robust Real-Time Face Detection

Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097

Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex

Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680

Squeeze-and-Excitation Networks

Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157

Non-local Neural Networks

Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596 · cited 1×

Learning Deep Features for Discriminative Localization

Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428

ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., & Hu, Q. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01155 · Cited by 9,641 · cited 1×

Learning Spatiotemporal Features with 3D Convolutional Networks

Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.510 · Cited by 9,593

Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset

Carreira, J., & Zisserman, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.502 · Cited by 9,570

Deformable Convolutional Networks

Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513

Neural Architecture Search with Reinforcement LearningPreprint

Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705

Adaptive Mixtures of Local Experts

Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384

Spatial transformer networks

Jaderberg, M., Simonyan, K., Zisserman, A., & Kavukcuoglu, K. (2015) · arXiv · doi:10.48550/arxiv.1506.02025 · Cited by 5,137

Simple model of spiking neurons

Izhikevich, E. M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820440 · Cited by 4,828

AutoAugment: Learning Augmentation Strategies From Data

Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00020 · Cited by 4,445

Dynamic Routing Between Capsules

Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167

Residual Attention Network for Image Classification

Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073

Networks of spiking neurons: The third generation of neural network models

Maass, W. (1997) · Neural Networks · doi:10.1016/s0893-6080(97)00011-7 · Cited by 3,711

Categorical Reparameterization with Gumbel-Softmax

Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616

Transformers in Vision: A Survey

Khan, S., Naseer, M., Hayat, M., Zamir, S. W., Khan, F. S., & Shah, M. (2022) · ACM Computing Surveys · doi:10.1145/3505244 · Cited by 3,595

Neural network-based face detection

Rowley, H. A., Baluja, S., & Kanade, T. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.655647 · Cited by 3,554

Selective Kernel Networks

Li, X., Wang, W., Hu, X., & Yang, J. J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00060 · Cited by 3,472

On calibration of modern neural networks

Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435

KPConv: Flexible and Deformable Convolution for Point Clouds

Thomas, H., Qi, C. R., Deschaud, J., Marcotegui, B., Goulette, F., & Guibas, L. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00651 · Cited by 3,400

Recurrent Models of Visual AttentionPreprint

Mnih, V., Heess, N., Graves, A., & Kavukcuoglu, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.6247 · Cited by 3,393

DARTS: Differentiable architecture search

Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248

Semantic Image Synthesis With Spatially-Adaptive Normalization

Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974

Deformable ConvNets V2: More Deformable, Better Results

Zhu, X., Hu, H., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00953 · Cited by 2,943

Learning Efficient Convolutional Networks through Network Slimming

Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761

Multimodal Unsupervised Image-to-Image Translation

Huang, X., Liu, M.-Y., Belongie, S., & Kautz, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01219-9_11 · Cited by 2,710

Measurement Reliability and Validity

(2000) · Research Methods in Applied Settings · doi:10.4324/9781410605337-29 · Cited by 2,541

Film: Visual reasoning with a general conditioning layer

Perez, E., Strub, F., De Vries, H., Dumoulin, V., & Courville, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11671 · Cited by 2,490

Democracy Barometer. Methodology. Version 4.

Merkel, W., Bochsler, D., Bousbah, K., Bühlmann, M., Giebler, H., Hänni, M., Heyne, L., Müller, L., Ruth, S., & Weßels, B. (2004) · Intellectum (Universidad de La Sabana) · doi:10.1007/s13398-014-0173-7.2 · Cited by 2,331

SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning

Chen, L., Zhang, H., Xiao, J., Nie, L., Shao, J., Liu, W., & Chua, T. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.667 · Cited by 2,089

Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

Bengio, Y., Léonard, N., & Courville, A. (2013) · arXiv · doi:10.48550/arxiv.1308.3432 · Cited by 1,910

Binarized Neural Networks

Hubara, I., Soudry, D., & Yaniv, R. E. (2016) · arXiv · doi:10.48550/arxiv.1602.02505 · Cited by 1,667

Dynamic Convolution: Attention Over Convolution Kernels

Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01104 · Cited by 1,633

Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition

Fu, J., Zheng, H., & Mei, T. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.476 · Cited by 1,469

Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts

Ma, J., Zhao, Z., Yi, X., Chen, J., Hong, L., & Ed, H. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3220007 · Cited by 1,458

Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph

Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433

Deep Convolutional Network Cascade for Facial Point Detection

Sun, Y. J., Wang, X., & Tang, X. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.446 · Cited by 1,405

Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs

Simonovsky, M., & Komodakis, N. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.11 · Cited by 1,391

A convolutional neural network cascade for face detection

Li, H., Lin, Z., Shen, X., Brandt, J., & Hua, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299170 · Cited by 1,390

BranchyNet: Fast inference via early exiting from deep neural networks

Teerapittayanon, S., McDanel, B., & Kung, H. T. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900006 · Cited by 1,326

PointRend: Image Segmentation As Rendering

Kirillov, A., Wu, Y., He, K., & Girshick, R. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00982 · Cited by 1,284

VideoBERT: A Joint Model for Video and Language Representation Learning

Sun, C., Myers, A., Vondrick, C., Murphy, K. P., & Schmid, C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00756 · Cited by 1,255

CARAFE: Content-Aware ReAssembly of FEatures

Wang, J., Chen, K., Xu, R., Liu, Z., Loy, C. C., & Lin, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00310 · Cited by 1,204

Speeding up Convolutional Neural Networks with Low Rank Expansions

Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.88 · Cited by 1,164

Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition

Zheng, H., Fu, J., Mei, T., & Luo, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.557 · Cited by 1,045

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Fedus, W., Zoph, B., & Shazeer, N. (2021) · arXiv · doi:10.48550/arxiv.2101.03961 · Cited by 1,005

HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition

Yan, Z., Zhang, H., Piramuthu, R., Jagadeesh, V., DeCoste, D., Di, W., & Yu, Y. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.314 · Cited by 936 · cited 2×

Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Shazeer, N., Mirhoseini, A., Maziarz, K., Davis, A., Le, Q., Hinton, G., & Dean, J. (2017) · arXiv · doi:10.48550/arxiv.1701.06538 · Cited by 933

Matrix capsules with EM routing

Hinton, G. E., Sabour, S., & Frosst, N. (2018) · International Conference on Learning Representations · Cited by 918

CondenseNet: An Efficient DenseNet Using Learned Group Convolutions

Huang, G., Liu, S., Maaten, L. V. D., & Weinberger, K. Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00291 · Cited by 904

AutoInt

Song, W., Shi, C., Xiao, Z., Duan, Z., Xu, Y., Zhang, M., & Tang, J. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357925 · Cited by 869

Concurrent Spatial and Channel ‘Squeeze & Excitation’ in Fully Convolutional Networks

Roy, A. G., Navab, N., & Wachinger, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00928-1_48 · Cited by 869

An Attentive Survey of Attention Models

Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3465055 · Cited by 860

Predicting Parameters in Deep Learning

Denil, M., Shakibi, B., Dinh, L., Ranzato, M., & de Freitas, N. (2013) · arXiv · doi:10.48550/arxiv.1306.0543 · Cited by 853

Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP.

Murata, A., Gallese, V., Luppino, G., Kaseda, M., & Sakata, H. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.83.5.2580 · Cited by 841

Multiple Object Recognition with Visual Attention

Ba, J., Mnih, V., & Kavukcuoglu, K. (2014) · arXiv · doi:10.48550/arxiv.1412.7755 · Cited by 808

The application of two-level attention models in deep convolutional neural network for fine-grained image classification

Xiao, T., Xu, Y., Yang, K., Zhang, J., Peng, Y., & Zhang, Z. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298685 · Cited by 807

Integrating Multimodal Information in Large Pretrained Transformers

Rahman, W., Hasan, M. K., Lee, S., Zadeh, A. B., Mao, C., Morency, L., & Hoque, M. E. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.214 · Cited by 778

Video Frame Interpolation via Adaptive Separable Convolution

Niklaus, S., Mai, L., & Liu, F. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.37 · Cited by 746

Multi-Scale Dense Networks for Resource Efficient Image ClassificationPreprint

Huang, G. M., Chen, D., Li, T., Wu, F., van der Maaten, L. J. P., & Weinberger, K. Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09844 · Cited by 741

SkipNet: Learning Dynamic Routing in Convolutional Networks

Wang, X., Yu, F., Dou, Z.-Y., Darrell, T., & Gonzalez, J. E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_25 · Cited by 681

Dynamic Filter Networks

Jia, X., Brabandere, B. D., Tuytelaars, T., & Gool, L. V. (2016) · neural information processing systems · Cited by 681

An Empirical Study of Spatial Attention Mechanisms in Deep Networks

Zhu, X., Cheng, D., Zhang, Z., Lin, S., & Dai, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00679 · Cited by 659

Deep Video Super-Resolution Network Using Dynamic Upsampling Filters Without Explicit Motion Compensation

Jo, Y., Oh, S. W., Kang, J., & Kim, S. J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00340 · Cited by 619

Exploit All the Layers: Fast and Accurate CNN Object Detector with Scale Dependent Pooling and Cascaded Rejection Classifiers

Yang, F., Choi, W., & Lin, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.234 · Cited by 608

Gather-Excite: Exploiting Feature Context in Convolutional Neural NetworksPreprint

Hu, J., Shen, L., Albanie, S., Sun, G., & Vedaldi, A. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.1810.12348 · Cited by 593

End-to-End Learning of Action Detection from Frame Glimpses in Videos

Yeung, S., Russakovsky, O., Mori, G., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.293 · Cited by 585

CondConv: Conditionally Parameterized Convolutions for Efficient InferencePreprint

Yang, B., Bender, G., Le, Q. V., & Ngiam, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04971 · Cited by 582

Meta-SR: A Magnification-Arbitrary Network for Super-Resolution

Hu, X., Mu, H., Zhang, X., Wang, Z., Tan, T., & Sun, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00167 · Cited by 546

Deep Neural Decision Forests

Kontschieder, P., Fiterau, M., Criminisi, A., & Bulò, S. R. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.172 · Cited by 535

Video Frame Interpolation via Adaptive Convolution

Niklaus, S., Mai, L., & Liu, F. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.244 · Cited by 515

Session-Based Social Recommendation via Dynamic Graph Attention Networks

Song, W., Xiao, Z., Wang, Y., Charlin, L., Zhang, M., & Tang, J. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3290989 · Cited by 507

SpotTune: Transfer Learning Through Adaptive Fine-Tuning

Guo, Y., Shi, H., Kumar, A., Grauman, K., Rosing, T., & Feris, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00494 · Cited by 506

DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference

Xin, J., Tang, R., Lee, J., Yu, Y., & Lin, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.204 · Cited by 476

Why ReLU Networks Yield High-Confidence Predictions Far Away From the Training Data and How to Mitigate the Problem

Hein, M., Andriushchenko, M., & Bitterwolf, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00013 · Cited by 473

Universal Transformers

Dehghani, M., Gouws, S., Vinyals, O., Uszkoreit, J., & Kaiser, Ł. (2018) · arXiv · doi:10.48550/arxiv.1807.03819 · Cited by 467

BlockDrop: Dynamic Inference Paths in Residual Networks

Wu, Z., Nagarajan, T., Kumar, A., Rennie, S., Davis, L. S., Grauman, K., & Feris, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00919 · Cited by 465

DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification

Rao, Y., Zhao, W., Liu, B., Lu, J., Zhou, J., & Hsieh, C.-J. (2021) · arXiv · doi:10.48550/arxiv.2106.02034 · Cited by 448

Neural Aggregation Network for Video Face Recognition

Yang, J., Ren, P., Zhang, D., Chen, D., Wen, F., Li, H., & Hua, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.554 · Cited by 423

Distilling a neural network into a soft decision tree

Frosst, N., & Hinton, G. (2017) · arXiv · doi:10.48550/arxiv.1711.09784 · Cited by 407

Attention-Based Multimodal Fusion for Video Description

Hori, C., Hori, T., Lee, T.-Y., Zhang, Z., Harsham, B., Hershey, J. R., Marks, T. K., & Sumi, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.450 · Cited by 401

Learning Factored Representations in a Deep Mixture of ExpertsPreprint

Eigen, D., Ranzato, M., & Sutskever, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4314 · Cited by 401

Runtime Neural Pruning

Lin, J., Rao, Y., Lu, J., & Zhou, J. (2017) · neural information processing systems · Cited by 399

Learning feed-forward one-shot learnersPreprint

Bertinetto, L., Henriques, J. F., Valmadre, J., Torr, P. H. S., & Vedaldi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05233 · Cited by 398

Modulating early visual processing by languagePreprint

de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 397

SEAN: Image Synthesis With Semantic Region-Adaptive Normalization

Zhu, P., Abdal, R., Qin, Y., & Wonka, P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00515 · Cited by 396

Hierarchical Multiscale Recurrent Neural Networks

Chung, J., Ahn, S., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.01704 · Cited by 386

Deep Progressive Reinforcement Learning for Skeleton-Based Action Recognition

Tang, Y.-S., Tian, Y., Lu, J.-W., Li, P.-Y., & Zhou, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00558 · Cited by 383

SRM: A Style-Based Recalibration Module for Convolutional Neural Networks

Lee, H., Kim, H., & Nam, H. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00194 · Cited by 379

Convolutional Networks with Adaptive Inference Graphs

Veit, A., & Belongie, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_1 · Cited by 373

Squeeze-and-Attention Networks for Semantic Segmentation

Zhong, Z., Lin, Z. Q., Bidart, R., Hu, X., Daya, I. B., Li, Z., Zheng, W., Li, J., & Wong, A. K. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01308 · Cited by 361

Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks

Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.131 · Cited by 357

Pixel-Adaptive Convolutional Neural Networks

Su, H., Jampani, V., Sun, D., Gallo, O., Learned-Miller, E., & Kautz, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01142 · Cited by 348

Spatially Adaptive Computation Time for Residual Networks

Figurnov, M., Collins, M. D., Zhu, Y., Zhang, L., Huang, J., Vetrov, D., & Salakhutdinov, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.194 · Cited by 345

Conditional Computation in Neural Networks for faster modelsPreprint

Bengio, E., Bacon, P., Pineau, J., & Precup, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06297 · Cited by 345

Adaptive Computation Time for Recurrent Neural Networks

Graves, A. (2016) · arXiv · doi:10.48550/arxiv.1603.08983 · Cited by 335

Deep Multimodal Fusion by Channel ExchangingPreprint

Wang, Y.-K., Huang, W.-B., Sun, F.-C., Xu, T.-Y., Rong, Y., & Huang, J.-Z. (2020) · Neural Information Processing Systems · doi:10.48550/arxiv.2011.05005 · Cited by 325

Dynamic Multi-Scale Filters for Semantic Segmentation

He, J., Deng, Z., & Qiao, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00366 · Cited by 320

Dynamic Channel Pruning: Feature Boosting and SuppressionPreprint

Gao, X., Zhao, Y., Dudziak, Ł., Mullins, R., & Xu, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05331 · Cited by 308

FastBERT: a Self-distilling BERT with Adaptive Inference Time

Liu, W., Zhou, P., Wang, Z., Zhao, Z., Deng, H., & Ju, Q. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.537 · Cited by 307

More is Less: A More Complicated Network with Less Inference Complexity

Dong, X., Huang, J., Yang, Y., & Yan, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.205 · Cited by 305

Attend, Infer, Repeat: Fast Scene Understanding with Generative ModelsPreprint

Eslami, S. M. A., Heess, N., Weber, T., Tassa, Y., Szepesvári, D., Kavukcuoglu, K., & Hinton, G. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.08575 · Cited by 288

ReasoNet

Shen, Y., Huang, P.-S., Gao, J., & Chen, W. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098177 · Cited by 276

Not All Pixels Are Equal: Difficulty-Aware Semantic Segmentation via Deep Layer Cascade

Li, X., Liu, Z., Luo, P., Loy, C. C., & Tang, X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.684 · Cited by 273

Listen to Look: Action Recognition by Previewing Audio

Gao, R., Oh, T.-H., Grauman, K. L., & Torresani, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01047 · Cited by 269

Cnvlutin: Ineffectual-Neuron-Free Deep Neural Network Computing

Albericio, J., Judd, P., Hetherington, T., Aamodt, T. M., Jerger, N. E., & Moshovos, A. (2016) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2016.11 · Cited by 266

Resolution Adaptive Networks for Efficient Inference

Yang, L., Han, Y., Chen, X., Song, S., Dai, J., & Huang, G. M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00244 · Cited by 261

Adaptive Neural Networks for Efficient Inference

Bolukbasi, T., Wang, J., Dekel, O., & Saligrama, V. (2017) · arXiv · doi:10.48550/arxiv.1702.07811 · Cited by 251

Real-Time Pedestrian Detection with Deep Network Cascades

Angelova, A., Krizhevsky, A., Vanhoucke, V., Ogale, A. S., & Ferguson, D. (2015) · British Machine Vision Conference (BMVC) · doi:10.5244/c.29.32 · Cited by 244

Multi-Horizon Time Series Forecasting with Temporal Attention Learning

Fan, C., Zhang, Y., Pan, Y., Li, X., Zhang, C., Yuan, R., Wu, D., Wang, W., Pei, J., & Huang, H. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330662 · Cited by 228

SCSampler: Sampling Salient Clips From Video for Efficient Action Recognition

Korbar, B., Tran, D., & Torresani, L. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00633 · Cited by 227

BERT Loses Patience: Fast and Robust Inference with Early ExitPreprint

Zhou, W., Xu, C., Ge, T., McAuley, J., Xu, K., & Wei, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04152 · Cited by 227

AdaFrame: Adaptive Frame Selection for Fast Video Recognition

Wu, Z., Xiong, C., Ma, C., Socher, R., & Davis, L. S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00137 · Cited by 225

Spatio-Temporal Filter Adaptive Network for Video Deblurring

Zhou, S., Zhang, J., Pan, J., Zuo, W., Xie, H., & Ren, J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00257 · Cited by 218

An Efficient Group Recommendation Model With Multiattention-Based Neural Networks

Huang, Z., Xu, X., Zhu, H., & Zhou, M. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2955567 · Cited by 215

Shallow-Deep Networks: Understanding and Mitigating Network OverthinkingPreprint

Kaya, Y., Hong, S., & Dumitraş, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07052 · Cited by 212

Skip RNN: Learning to Skip State Updates in Recurrent Neural NetworksPreprint

Campos, V., Jou, B., Giró-i-Nieto, X., Torres, J., & Chang, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.06834 · Cited by 207

SBNet: Sparse Blocks Network for Fast Inference

Ren, M., Pokrovsky, A., Yang, B., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00908 · Cited by 198

Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-Offs by Selective Execution

Liu, L., & Deng, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11630 · Cited by 193

Adaptive Convolution for Multi-Relational Learning

Jiang, X., Wang, Q., & Wang, B. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1103 · Cited by 192

Learning Dynamic Routing for Semantic Segmentation

Li, Y., Song, L., Chen, Y., Li, Z., Zhang, X., Wang, X., & Sun, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00858 · Cited by 191

Dynamic ReLU

Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_21 · Cited by 190

Attention-Aware Deep Reinforcement Learning for Video Face Recognition

Rao, Y., Lu, J., & Zhou, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.424 · Cited by 189

Spatial-Adaptive Network for Single Image Denoising

Chang, M., Li, Q., Feng, H., & Xu, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_11 · Cited by 181

SnaPEA: Predictive Early Activation for Reducing Computation in Deep Convolutional Neural Networks

Akhlaghi, V., Yazdanbakhsh, A., Samadi, K., Gupta, R. K., & Esmaeilzadeh, H. (2018) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca.2018.00061 · Cited by 180

Dynamic Convolutions: Exploiting Spatial Sparsity for Faster Inference

Verelst, T., & Tuytelaars, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00239 · Cited by 179

Channel Gating Neural NetworksPreprint

Hua, W., Zhou, Y. J., De, C., Zhang, Z., & Suh, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12549 · Cited by 176

Dynamic Region-Aware Convolution

Chen, J., Wang, X., Guo, Z., Zhang, X., & Sun, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00797 · Cited by 172

Routing Networks: Adaptive Selection of Non-linear Functions for Multi-Task LearningPreprint

Rosenbaum, C., Klinger, T., & Riemer, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01239 · Cited by 171

Learned Image Downscaling for Upscaling Using Content Adaptive Resampler

Sun, W., & Chen, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2970248 · Cited by 169

Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image SynthesisPreprint

Liu, X., Yin, G., Shao, J., Wang, X., & Li, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06809 · Cited by 169

AR-Net: Adaptive Frame Resolution for Efficient Action Recognition

Meng, Y., Lin, C.-C., Panda, R., Sattigeri, P., Karlinsky, L., Oliva, A., Saenko, K., & Feris, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_6 · Cited by 167

Online Video Deblurring via Dynamic Temporal Blending Network

Kim, T. H., Lee, K. M., Schölkopf, B., & Hirsch, M. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.435 · Cited by 165

Compact Generalized Non-local NetworkPreprint

Yue, K., Sun, M., Yuan, Y., Zhou, F., Ding, E., & Xu, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.13125 · Cited by 165

The Right Tool for the Job: Matching Model and Instance Complexities

Schwartz, R., Stanovsky, G., Swayamdipta, S., Dodge, J., & Smith, N. A. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.593 · Cited by 163

Dynamic Slimmable Network

Li, C., Wang, G., Wang, B., Liang, X., Li, Z., & Chang, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00850 · Cited by 160

Learning to Zoom: A Saliency-Based Sampling Layer for Neural Networks

Recasens, A., Kellnhofer, P., Stent, S., Matusik, W., & Torralba, A. B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_4 · Cited by 158

StNet: Local and Global Spatial-Temporal Modeling for Action Recognition

He, D., Zhou, Z., Gan, C., Li, F., Liu, X., Li, Y., Wang, L., & Wen, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018401 · Cited by 153

Adaptive Weighting Multi-Field-Of-View CNN for Semantic Segmentation in Pathology

Tokunaga, H., Teramoto, Y., Yoshizawa, A., & Bise, R. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01288 · Cited by 151

Improved Techniques for Training Adaptive Deep Networks

Li, H., Zhang, H., Qi, X., Yang, R., & Huang, G. M. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00198 · Cited by 146

Implicit Semantic Data Augmentation for Deep NetworksPreprint

Wang, Y., Pan, X., Song, S., Zhang, H., Wu, C., & Huang, G. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12220 · Cited by 146

Multi-Agent Reinforcement Learning Based Frame Sampling for Effective Untrimmed Video Recognition

Wu, W., He, D., Tan, X., Chen, S., & Wen, S. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00632 · Cited by 144

Anisotropic Convolutional Networks for 3D Semantic Scene Completion

Li, J., Han, K., Wang, P., Liu, Y., & Yuan, X. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00341 · Cited by 144

Segmentation-Aware Convolutional Networks Using Local Attention Masks

Harley, A. W., Derpanis, K. G., & Kokkinos, I. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.539 · Cited by 142 · cited 4×

Neural Style Transfer via Meta Networks

Shen, F., Yan, S., & Zeng, G. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00841 · Cited by 139

AdaBits: Neural Network Quantization With Adaptive Bit-Widths

Jin, Q., Yang, L., & Liao, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00222 · Cited by 139

Dynamic Video Segmentation Network

Xu, Y.-S., Fu, T.-J., Yang, H.-K., & Lee, C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00686 · Cited by 136

Scale-Aware Face Detection

Hao, Z., Liu, Y., Qin, H., Yan, J., Li, X., & Hu, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.207 · Cited by 134

Neural Decision Forests for Semantic Image Labelling

Bulò, S. R., & Kontschieder, P. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.18 · Cited by 133

MetaAnchor: Learning to Detect Objects with Customized AnchorsPreprint

Yang, T., Zhang, X., Li, Z., Zhang, W., & Sun, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00980 · Cited by 133

Dynamic Computational Time for Visual Attention

Li, Z., Yang, Y., Liu, X., Zhou, F., Wen, S., & Xu, W. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.145 · Cited by 132

HydraNets: Specialized Dynamic Architectures for Efficient Inference

Shazeer, N., Fatahalian, K., Mark, W. R., & Mullapudi, R. T. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00843 · Cited by 131

Glance and Focus: a Dynamic Approach to Reducing Spatial Redundancy in Image ClassificationPreprint

Wang, Y., Lv, K., Huang, R., Song, S., Yang, L., & Huang, G. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05300 · Cited by 131

Big/little deep neural network for ultra low power inference

Park, E., Kim, D., Kim, S., Kim, Y.-D., Kim, G., Yoon, S., & Yoo, S. (2015) · 2015 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS) · doi:10.1109/codesisss.2015.7331375 · Cited by 130

LambdaNetworks: Modeling Long-Range Interactions Without Attention

Bello, I. (2021) · arXiv · doi:10.48550/arxiv.2102.08602 · Cited by 129

Synetgy

Yang, Y., Huang, Q., Wu, B., Zhang, T., Ma, L., Gambardella, G., Blott, M., Lavagno, L., Vissers, K., Wawrzynek, J., et al. (2019) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3289602.3293902 · Cited by 128

Funnel Activation for Visual Recognition

Ma, N., Zhang, X., & Sun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58621-8_21 · Cited by 120

Adaptive Focus for Efficient Video Recognition

Wang, Y., Chen, Z., Jiang, H., Song, S., Han, Y., & Huang, G. M. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01594 · Cited by 120

TAFE-Net: Task-Aware Feature Embeddings for Low Shot Learning

Wang, X., Yu, F., Wang, R., Darrell, T., & Gonzalez, J. E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00193 · Cited by 118

Learning to Skim Text

Yu, A. W., Lee, H., & Le, Q. V. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1172 · Cited by 116

DynamoNet: Dynamic Action and Motion Network

Diba, A., Sharma, V., Gool, L. V., & Stiefelhagen, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00629 · Cited by 111

Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image RecognitionPreprint

Wang, Y., Huang, R., Song, S., Huang, Z., & Huang, G. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.15075 · Cited by 110

WeightNet: Revisiting the Design Space of Weight Networks

Ma, N., Zhang, X., Huang, J., & Sun, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_46 · Cited by 108

Efficient Segmentation: Learning Downsampling Near Semantic Boundaries

Marin, D., He, Z., Vajda, P., Chatterjee, P., Tsai, S. S., Yang, F., & Boykov, Y. Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00222 · Cited by 107

Spatially Adaptive Inference with Stochastic Feature Sampling and Interpolation

Xie, Z., Zhang, Z., Zhu, X., Huang, G. M., & Lin, S. C.-F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58452-8_31 · Cited by 107

Differentiable Patch Selection for Image Recognition

Cordonnier, J.-B., Mahendran, A., Dosovitskiy, A., Weissenborn, D., Uszkoreit, J., & Unterthiner, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00238 · Cited by 105

Conditioned Regression Models for Non-blind Single Image Super-Resolution

Riegler, G., Schulter, S., Rüther, M., & Bischof, H. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.67 · Cited by 104

Incorporating Side Information by Adaptive Convolution

Kang, D., Dhar, D., & Chan, A. B. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01345-8 · Cited by 100

Spanet: Spatial Pyramid Attention Network for Enhanced Image Recognition

Guo, J., Ma, X., Sansom, A., McGuire, M., Kalaani, A., Chen, Q., Tang, S., Yang, Q. X., & Fu, S. (2020) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102906 · Cited by 99

You Look Twice: GaterNet for Dynamic Filter Selection in CNNs

Chen, Z., Li, Y., Samy Bengio, A., & Si, S. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00939 · Cited by 98

FrameExit: Conditional Early Exiting for Efficient Video Recognition

Ghodrati, A., Bejnordi, B. E., & Habibian, A. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01535 · Cited by 98

Depth-Adaptive TransformerPreprint

Elbayad, M., Gu, J., Grave, É., & Auli, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10073 · Cited by 96

Low-Rank Approximations for Conditional Feedforward Computation in Deep Neural NetworksPreprint

Davis, A., & Arel, I. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.4461 · Cited by 91

Dynamic Sampling Networks for Efficient Action Recognition in Videos

Zheng, Y.-D., Liu, Z., Lü, T., & Wang, L. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3007826 · Cited by 88

Position-Based Content Attention for Time Series Forecasting with Sequence-to-Sequence RNNs

Cinar, Y. G., Mirisaee, H., Goswami, P., Gaussier, É., Aït-Bachir, A., & Strijov, V. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70139-4_54 · Cited by 87

Watching a Small Portion could be as Good as Watching All: Towards Efficient Video Classification

Fan, H., Xu, Z., Zhu, L., Yan, C. C., Ge, J., & Yang, Y. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/98 · Cited by 85

Dual Dynamic Inference: Enabling More Efficient, Adaptive, and Controllable Deep Inference

Wang, Y., Shen, J., Hu, T.-K., Xu, P., Nguyen, T. M., Baraniuk, R. G., Wang, Z., & Lin, Y. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2979669 · Cited by 83

Action Search: Spotting Actions in Videos and Its Application to Temporal Action Localization

Alwassel, H., Heilbron, F. C., & Ghanem, B. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01240-3_16 · Cited by 82

Question-Guided Hybrid Convolution for Visual Question Answering

Gao, P., Li, H., Li, S., Lu, P., Li, Y., Hoi, S. C. H., & Wang, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_29 · Cited by 79

Adaptive Neural TreesPreprint

Tanno, R., Arulkumaran, K., Alexander, D. C., Criminisi, A., & Nori, A. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06699 · Cited by 78

Neural Speed Reading via Skim-RNNPreprint

Seo, M., Min, S., Farhadi, A., & Hajishirzi, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02085 · Cited by 77

Deep Mixture of Experts via Shallow EmbeddingPreprint

Wang, X., Yu, F., Dunlap, L., Ma, Y.-A., Wang, R., Mirhoseini, A., Darrell, T., & Gonzalez, J. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.01531 · Cited by 77

Dynamic Capacity NetworksPreprint

Almahairi, A., Ballas, N., Cooijmans, T., Zheng, Y., Larochelle, H., & Courville, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.07838 · Cited by 76

Adaptively Connected Neural Networks

Wang, G., Wang, K., & Lin, L. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00188 · Cited by 75

SeerNet: Predicting Convolutional Neural Network Feature-Map Sparsity Through Low-Bit Quantization

Cao, S., Ma, L., Xiao, W., Zhang, C., Liu, Y., Zhang, L., Nie, L., & Yang, Z. Q. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01147 · Cited by 73

SimMIM: a Simple Framework for Masked Image Modeling

Xie, Z., Zhang, Z., Cao, Y., Lin, Y., Bao, J., Yao, Z., Dai, Q., & Hu, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00943 · Cited by 1,495

Domain Generalization: A Survey

Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315

Deep learning modelling techniques: Current progress, applications, advantages, and challenges

Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079

Nonlinear Transform Source-Channel Coding for Semantic Communications

Dai, J., Wang, S., Tan, K., Si, Z., Qin, X., Niu, K., & Zhang, P. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180802 · Cited by 395

FLatten Transformer: Vision Transformer using Focused Linear Attention

Han, D., Pan, X., Han, Y., Song, S., & Huang, G. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00548 · Cited by 386

Neural network developments: A detailed survey from static to dynamic models

Verma, P. R., Singh, N. P., Pantola, D., & Cheng, X. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109710 · Cited by 26

Exploits and advances in dynamic neural networks

Chia, K. J., Maul, T., Chen, Z., Jauw, V. L., & Yap, Y. J. (2026) · Neural Computing and Applications · doi:10.1007/s00521-026-12187-9

Dynamic inference techniques for deep neural networks

Zhang, Z., & Shi, L. (2023) · Applied and Computational Engineering · doi:10.54254/2755-2721/2/20220534 · Cited by 1

A survey on dynamic neural networks: From computer vision to multi-modal sensor fusion

Montello, F., Güldenring, R., Scardapane, S., & Nalpantidis, L. (2026) · Image and Vision Computing · doi:10.1016/j.imavis.2026.105980 · Cited by 10

The Design of Dynamic Neural Networks for Efficient Learning and Inference

Wang, X. (2020) · eScholarship (California Digital Library)