The DOI matches its Crossref record; 278 of the 280 references it cites were found in a registry or an index.
Dynamic Neural Networks: A Survey
Open accessAbstract
Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to different inputs, leading to notable advantages in terms of accuracy, computational efficiency, adaptiveness, etc. In this survey, we comprehensively review this rapidly developing area by dividing dynamic networks into three main categories: 1) sample-wise dynamic models that process each sample with data-dependent architectures or parameters; 2) spatial-wise dynamic networks that conduct adaptive computation with respect to different spatial locations of image data; and 3) temporal-wise dynamic models that perform adaptive inference along the temporal dimension for sequential data such as videos and texts. The important research problems of dynamic networks, e.g., architecture design, decision making scheme, optimization technique and applications, are reviewed systematically. Finally, we discuss the open problems in this field together with interesting future research directions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, DNNs enhance expressive ability by dynamically adjusting the network depth or activating certain specific modules as needed.”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [130]
In the citing paper
“DNNs[130] offer a potential solution, advancing the research of SOC estimation through their abilities to adaptively adjust their structure and parameters based on input data during the inference phase, providing greater flexibility than traditional static networks.”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [130]
In the citing paper
“DNNs, however, allocate computational resources efficiently by activating specific modules as needed.”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [130]
In the citing paper
“In contrast, static networks maintain fixed configurations post-training, which may be suboptimal in practical applications due to limited representational ability and inflexible resource allocation.”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [130]
In the citing paper
“DNNs are compatible with existing NN technologies and can seamlessly incorporate various advanced DL technologies.”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [130]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Self-citationSqueeze-and-Excitation Networks
Hu, J., Shen, L., & Sun, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00745 · Cited by 35,667
CBAM: Convolutional Block Attention Module
Woo, S., Park, J., Lee, J.-Y., & Kweon, I. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_1 · Cited by 25,853
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Research works printed but not linked: 7
- 10.5555/2999134.2999257 · DOI
- 10.18653/vl/n19-142 · DOI
- Ha, Hypernetworks
- Dosovitskiy, An image is worth 16x16 words: Transformers for image recognition at scale
- Pan, VA-RED 2: Video adaptive redundancy reduction
- 10.5555/3045118.3045336 · DOI
- Gumbel, 1954, Statistical Theory of Extreme Values and Some Practical Applications(NBS Applied Mathematics Series)
Cited by
Sorted by citations
Items 201–300 of 946
AlignMiF: Geometry-Aligned Multimodal Implicit Field for LiDAR-Camera Joint Synthesis
Tang, T., Wang, G., Lao, Y., Chen, P., Liu, J., Lin, L., Yu, K., & Liang, X. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02006 · Cited by 16
DPNet: Dynamic Pooling Network for Accurate and Efficient Size-Aware Tiny Object Detection
Gong, L., Chen, H., Chen, Y., Yao, T., Li, C., Zhao, S., & Han, G. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3559921 · Cited by 16
SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting
Xu, J., Pan, J., Zhou, Y., Chen, S., Li, J., Lian, Y., Wu, J., & Dai, G. (2025) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3695053.3730996 · Cited by 15
Learning Hierarchical Dynamics with Spatial Adjacency for Image Enhancement
Liang, Y., Wang, B., Ren, W., Liu, J., Wang, W., & Zuo, W. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548322 · Cited by 15
ACF: An Adaptive Compression Framework for Multimodal Network in Embedded Devices
Cai, Q., Liu, X., Zhang, K., Xie, X. N., Tong, X., & Li, K. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3303350 · Cited by 15
Contrastive representation learning on dynamic networks
Jiao, P., Chen, H., Tang, H., Bao, Q., Zhang, L., Zhao, Z., & Wu, H. (2024) · Neural Networks · doi:10.1016/j.neunet.2024.106240 · Cited by 15
Revisiting the Trade-Off Between Accuracy and Robustness via Weight Distribution of Filters
Wei, X., Zhao, S., & Li, B. H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3411035 · Cited by 15
Wang, Q., Yu, C., Chen, S., Fang, W. W., & Xiong, N. N. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020093 · Cited by 15
Durán, F., Martínez, M., Lago, P., & Martínez‐Fernández, S. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112574 · Cited by 15
DyDiT++: Diffusion Transformers With Timestep and Spatial Dynamics for Efficient Visual Generation
Zhao, W., Han, Y., Tang, J., Wang, K., Luo, H., Song, Y., Huang, G. M., Wang, F., & You, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3654201 · Cited by 15
Self-citationPhilipp, M., Alperovich, A., Gutt‐Will, M., Mathis, A., Saur, S. C., Raabe, A., & Mathis-Ullrich, F. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00179 · Cited by 15
A Two-Level Dynamic Adaptive Network for Medical Image Fusion
Huang, W., Zhang, H., Quan, X., & Wang, J. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3169546 · Cited by 15
Contrastive Haze-Aware Learning for Dynamic Remote Sensing Image Dehazing
Nie, J., Wei, W., Zhang, L., Yuan, J., Wang, Z., & Li, H. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3220940 · Cited by 15
CNO-LSTM: A Chaotic Neural Oscillatory Long Short-Term Memory Model for Text Classification
Shi, N., Chen, Z., Chen, L., & Lee, R. (2022) · IEEE Access · doi:10.1109/access.2022.3228600 · Cited by 15
Learning to Class-Adaptively Manipulate Embeddings for Few-Shot Learning
Zhou, F., Wei, W., Zhang, L., & Zhang, Y. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3248798 · Cited by 15
Towards Inference Efficient Deep Ensemble Learning
Li, Z., Ren, K., Yang, Y., Jiang, X., Yang, Y., & Li, D. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26048 · Cited by 16
Adapting Neural Networks at Runtime: Current Trends in At-Runtime Optimizations for Deep Learning
Sponner, M., Waschneck, B., & Kumar, A. S. (2024) · ACM Computing Surveys · doi:10.1145/3657283 · Cited by 15
Fine-grained Visible Watermark Removal
Niu, L., Zhao, X., Zhang, B., & Zhang, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01173 · Cited by 14
Enabling Large Dynamic Neural Network Training with Learning-based Memory Management
Ren, J., Xu, D., Yang, S., Zhao, J., Li, Z., Navasca, C., Wang, C., Xu, H., & Li, D. (2024) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca57654.2024.00066 · Cited by 14
MTdyg: Multi-scale transformers with continuous time dynamic graph model for link prediction
Xu, L., Pan, Z., Chen, H., & Wang, S. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112245 · Cited by 14
Empirical Study on Real Estate Mass Appraisal Based on Dynamic Neural Networks
Chen, C., Ma, X., & Xiao-jia, Z. (2024) · Buildings · doi:10.3390/buildings14072199 · Cited by 14
Stego-STFAN: A Novel Neural Network for Video Steganography
Vergara, G. F., Fernandes, P. A. G., Serrano, A. L. M., de Mendonça, F. L. L., Rodrigues, G. A. P., Bispo, G. D., Gonçalves, V. P., Albuquerque, R. D. O., & de Sousa, R. T. (2024) · Computers · doi:10.3390/computers13070180 · Cited by 14
Xiong, W. (2024) · IEEE Access · doi:10.1109/access.2024.3443876 · Cited by 14
Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator
Cao, Z., Cheng, Y., Zhou, Z., Chen, Y., Hu, Y., Lu, A., Liu, J., & Li, Z. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3474743 · Cited by 14
Dynamic Convolutional Neural Networks Based on Adaptive 2D Memristors
Hong, H., Chen, X., Cho, W., Yoo, H. Y., Oh, J., Kim, M., Hwang, G., Yang, Y., Sun, L., Wang, Z., et al. (2024) · Advanced Functional Materials · doi:10.1002/adfm.202422321 · Cited by 14
Dynamic proximal unrolling network for compressive imaging
Yang, Y., Tao, R., Wei, K., & Fu, Y. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.08.034 · Cited by 14
Lu, Y., Jiang, S., Cao, T., & Shu, Y. (2022) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3560905.3568501 · Cited by 14
Wang, Q., Fang, W. W., & Xiong, N. N. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3293506 · Cited by 14
PAD-Net: An Efficient Framework for Dynamic Networks
He, S., Ding, L., Dong, D., Liu, B., Yu, F., & Tao, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.803 · Cited by 16
MMExit: Enabling Fast and Efficient Multi-modal DNN Inference with Adaptive Network Exits
Hou, X., Liu, J., Tang, X., Li, C., Cheng, K.-T. T., Li, L., & Guo, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39698-4_29 · Cited by 14
Xia, G., & Bouganis, C.-S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01593 · Cited by 14
Tao, D., Li, J., Du, K., & Lu, Z. (2026) · Bulletin of Earthquake Engineering · doi:10.1007/s10518-026-02408-w · Cited by 13
Zhang, Q., Jiang, C., Han, R., Yang, G., Wang, J., Chang, H. T., & Liu, F. (2024) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2024.3418014 · Cited by 13
Dynamic Slimmable Network for Speech Separation
Elminshawi, M., Chetupalli, S. R., & Habets, E. A. P. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3445304 · Cited by 13
Yang, Y., Du, Y., Zhang, L., Li, G., Chen, Y., Cheng, G., & Song, S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3521971 · Cited by 13
Self-citationXiao, R., Wang, H., Wang, L., & Hong, Y. (2025) · International Conference on Big Data, Computational Intelligence, and Applications (BDCIA) · doi:10.1117/12.3059792 · Cited by 13
Self-citationVerma, P. R., Pantola, D., & Singh, N. P. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110937 · Cited by 13
Maghdid, S. S., Rashid, T. A., & Askar, S. K. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00797-w · Cited by 13
Dong, J., Jiang, J., Jiang, K., Li, J., & Zhang, Y. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.02870 · Cited by 13
Edge-Cloud Collaborated Object Detection via Difficult-Case Discriminator
Cao, Z., Li, Z., Chen, Y., Pan, H., Hu, Y., & Liu, J. (2023) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs57875.2023.00062 · Cited by 13
Multiscale Dynamic Curvelet Scattering Network
Gao, J., Jiao, L., Liu, X., Li, L., Chen, P., Liu, F., & Yang, S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3223212 · Cited by 13
One Person, One Model—Learning Compound Router for Sequential Recommendation
Liu, Z., Cheng, M., Li, Z., Liu, Q., & Chen, E. (2022) · Proceedings · doi:10.1109/icdm54844.2022.00039 · Cited by 13
On The Design and Training Strategies for Rnn-Based Online Neural Speech Separation Systems
Li, K., & Luo, Y. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096724 · Cited by 13
Memory-Friendly Scalable Super-Resolution via Rewinding Lottery Ticket Hypothesis
Lin, J. F., Luo, X., Hong, M., Qu, Y., Xie, Y., & Wu, Z. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01384 · Cited by 13
AdaSem: Adaptive Goal-Oriented Semantic Communications for End-to-End Camera Relocalization
Liao, Q., & Tung, T.-Y. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621397 · Cited by 13
Boosting medical image segmentation via conditional-synergistic convolution and lesion decoupling
Yang, H., Chen, Q., Fu, K., Zhu, L., Jin, L., Qiu, B., Ren, Q., Du, H., & Lu, Y. (2022) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2022.102110 · Cited by 13
Yu, H., Liu, D., Zhang, Z., & Wang, J. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3312488 · Cited by 12
Inference serving with end-to-end latency SLOs over dynamic edge networks
Nigade, V., Bauszat, P., Bal, H. E., & Wang, L. (2024) · Real-Time Systems · doi:10.1007/s11241-024-09418-4 · Cited by 12
A knowledge-informed dynamic correlation modeling framework for lane-level traffic flow prediction
Jiang, R., Wang, S., Ma, W., Zhang, Y., Fan, P., & Jia, D. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103327 · Cited by 12
Dynamic Deep Neural Network Adversarial Attacks for Edge-based IoT Devices
Ayyat, M., Nukavarapu, S. K., & Nadeem, T. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001235 · Cited by 12
AMC: Adaptive Multi-expert Collaborative Network for Text-guided Image Retrieval
Zhu, H., Wei, Y., Zhao, Y., Zhang, C., & Huang, S. (2023) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3584703 · Cited by 12
Wang, X., Zhao, Q., Zhang, C., Wang, B., Wang, L., & Liu, W. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119624 · Cited by 12
Liu, J., Liao, X., & Dong, J. S. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3318416 · Cited by 12
Energy Consumption Prediction and Optimization of Electric Vehicles Based on RLS and Improved SOA
Liu, C. (2024) · IEEE Access · doi:10.1109/access.2024.3375355 · Cited by 12
Meta-GF: Training Dynamic-Depth Neural Networks Harmoniously
Sun, Y., Li, J., & Xu, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20083-0_41 · Cited by 12
A divide and conquer framework for Knowledge Editing
Han, X., Li, R., Li, X., & Pan, J. Z. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110826 · Cited by 12
Scenario-Aware Learning Approaches to Adaptive Channel Estimation
Li, R., Sun, J. Z., Xue, J., & Masouros, C. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3330878 · Cited by 11
Tveitstøl, T., Tveter, M., T, A. S. P., Hatlestad‐Hall, C., Yazidi, A., Hammer, H. L., & Haraldsen, I. (2024) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2023.1272791 · Cited by 11
Zhang, X., Jiao, P., Gao, M., Li, T., Wu, Y., Wu, H., & Zhao, Z. (2024) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2024.3377548 · Cited by 11
Content-Aware Dynamic In-Loop Filter With Adjustable Complexity for VVC Intra Coding
Man, H., Wang, H., Lu, R., Wan, Z., Xiaopeng Fan, B., & Zhao, D. (2025) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2025.3535784 · Cited by 11
Self-citationParameter Disentanglement for Diverse Representations
Wang, J., Guo, J., Wang, R., Zhang, Z., Fu, L., & Ye, Q. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020087 · Cited by 11
DSNet: Dynamic Stitchable Neural Network for Hyperspectral Image Classification
Feng, S., Zhao, Z., Xi, B., Zhao, C., Li, W., Tao, R., & Li, Y. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3589364 · Cited by 11
A survey of large language models for data challenges in graphs
Li, M., Zhang, P., Xing, W., Zheng, Y., Zaporojets, K., Chen, J., Zhang, R., Zhang, Y., Gong, S., Hu, J. S., et al. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129643 · Cited by 11
Exploiting neuro-inspired dynamic sparsity for energy-efficient intelligent perception
Zhou, S., Gao, C., Delbrück, T., Verhelst, M., & Liu, S. (2025) · Nature Communications · doi:10.1038/s41467-025-65387-7 · Cited by 11
Khan, M. T., Ding, Y., & Goussetis, G. (2026) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2026.3656642 · Cited by 11
exploring Fine-Grained Sparsity in Convolutional Neural Networks for Efficient Inference
Wang, L., Guo, Y., Dong, X., Wang, Y., Ying, X., Lin, Z., & An, W. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3193925 · Cited by 11
Self-citationGradMDM: Adversarial Attack on Dynamic Networks
Pan, J., Foo, L. G., Zheng, Q., Fan, Z., Rahmani, H., Ke, Q., & Liu, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3263619 · Cited by 11
Yang, G., Zhang, L., Bu, C., Wang, S., Wu, H., & Song, A. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3321639 · Cited by 11
RRTrN: A lightweight and effective backbone for scene text recognition
Zhou, Q., Gao, J., Yuan, Y., & Wang, Q. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122769 · Cited by 11
Dynamics-Aware Adversarial Attack of Adaptive Neural Networks
Tao, A., Duan, Y., Wang, Y., Lu, J., & Zhou, J. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3351680 · Cited by 11
Self-citationHuman-Inspired Facial Sketch Synthesis with Dynamic Adaptation
Gao, F., Zhu, Y., Jiang, C., & Wang, N. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00665 · Cited by 11
Deep Incubation: Training Large Models by Divide-and-Conquering
Ni, Z., Wang, Y., Yu, J., Jiang, H., Cao, Y., & Huang, G. M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01590 · Cited by 11
Self-citationYu, J., Zhang, L., Cheng, D., Huang, W., Wu, H., & Song, A. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3457830 · Cited by 11
Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing
Liu, Z., Han, J., Hong, L., Xu, H., Chen, K., Xu, C., & Li, Z. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i2.20079 · Cited by 11
Street Floor Segmentation for a Wheeled Mobile Robot
Hyun, J., Woo, S., & Kim, E. (2022) · IEEE Access · doi:10.1109/access.2022.3227203 · Cited by 11
Zhang, Y., Zhang, W., Wang, S., Lin, N., Yu, Y., He, Y., Wang, B., Jiang, H., Lin, P., Xu, X., et al. (2024) · Science Advances · doi:10.1126/sciadv.ado1058 · Cited by 10
SLEXNet: Adaptive Inference Using Slimmable Early Exit Neural Networks
Kütükçü, B., Baidya, S., & Dey, S. (2024) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3689632 · Cited by 10
Deep Feature Surgery: Towards Accurate and Efficient Multi-exit Networks
Gong, C., Chen, Y., Luo, Q., Lu, Y., Li, T., Zhang, Y., Sun, Y., & Zhang, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72967-6_24 · Cited by 10
Confidence-Based Fusion of AC-LSTM and Kalman Filter for Accurate Space Target Trajectory Prediction
Wang, C., Zhang, J., Wang, J., & Wu, Y. (2025) · Aerospace · doi:10.3390/aerospace12040347 · Cited by 10
A survey on dynamic neural networks: From computer vision to multi-modal sensor fusion
Montello, F., Güldenring, R., Scardapane, S., & Nalpantidis, L. (2026) · Image and Vision Computing · doi:10.1016/j.imavis.2026.105980 · Cited by 10
Dynamic nsNET2: Efficient Deep Noise Suppression with Early Exiting
Miccini, R., Zniber, A., Laroche, C., Piechowiak, T., Schoeberl, M., Pezzarossa, L., Karrakchou, O., Sparsø, J., & Ghogho, M. (2023) · Machine learning for signal processing ... · doi:10.1109/mlsp55844.2023.10285925 · Cited by 10
Boosting Convolutional Neural Networks With Middle Spectrum Grouped Convolution
Su, Z., Zhang, J., Liu, T., Liu, Z., Zhang, S., Pietikäinen, M., & Liu, L. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3355489 · Cited by 10
USDN: A Unified Sample-wise Dynamic Network with Mixed-Precision and Early-Exit
Jeon, J.-Y., Nguyen, X. T., Ryu, S., & Lee, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00070 · Cited by 10
Li, B., Chen, H., An, Z., Yu, Y., Jia, Y. G., Chen, L., & Sun, M. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112275 · Cited by 10
Retraining-free Model Quantization via One-Shot Weight-Coupling Learning
Tang, C., Meng, Y., Jiang, J., Xie, S., Lu, R., Ma, X., Wang, Z., & Zhu, W. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01501 · Cited by 10
Concept Neural Network Based on Time-Delay Regret for Dynamic Stream Learning
Mi, Y. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3535636 · Cited by 10
Model-Distributed Inference in Multi-Source Edge Networks
Li, P., Seferoğlu, H., & Koyuncu, E. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193154 · Cited by 10
Gao, X. (2023) · Results in Engineering · doi:10.1016/j.rineng.2023.101495 · Cited by 10
Reliable Evaluation of Adversarial Transferability
Yu, W., Gu, J., Li, Z., & Torr, P. H. S. (2025) · IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · doi:10.1109/satml64287.2025.00049 · Cited by 10
Slim-Tasnet: A Slimmable Neural Network for Speech Separation
Elminshawi, M., Chetupalli, S. R., & Habets, E. A. P. (2023) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa58266.2023.10248143 · Cited by 9
DynaSpa: Exploiting Spatial Sparsity for Efficient Dynamic DNN Inference on Devices
Liu, R., Leng, Y., Tian, S., Hu, S., Chen, R., & Yao, S. (2024) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3666025.3699348 · Cited by 9
FDformer: A Fuzzy Dynamic Transformer-Based Network for Efficient Industrial Time Series Prediction
Ren, L., Zhao, T., & Wang, H. (2025) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2025.3549920 · Cited by 9
Self-citationLi, J., Fu, M., Li, D., Qi, J., Yang, J., & Yang, S. (2025) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2025.180245 · Cited by 9
Learning to Inference Adaptively for Multimodal Large Language Models
Xu, Z., Nguyen, K. D., Mukherjee, P., Bagchi, S., Chaterji, S., Liang, Y., & Li, Y. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00339 · Cited by 9
Adaptive Semantic Token Communication for Transformer-Based Edge Inference
Devoto, A., Pomponi, J., Merluzzi, M., Lorenzo, P. D., & Scardapane, S. (2026) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2026.3659819 · Cited by 9
DynaShare: Task and Instance Conditioned Parameter Sharing for Multi-Task Learning
Rahimian, E., Javadi, G., Tung, F., & Oliveira, G. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00477 · Cited by 9
Butola, R., Li, Y., & Kola, S. R. (2023) · IEEE Transactions on Electron Devices · doi:10.1109/ted.2023.3312634 · Cited by 9
Yu, Y., Yu, L., Zhai, J., Chen, P., & Yu, C. (2023) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2023.3318732 · Cited by 9
DESTINE: Dynamic Goal Queries with Temporal Transductive Alignment for Trajectory Prediction
Karim, R., Shabestary, S. M. A., & Rasouli, A. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611124 · Cited by 9
Adaptive dynamic inference for few-shot left atrium segmentation
Chen, J., Li, X., Zhang, H., Cho, Y., Hwang, S. H., Gao, Z., & Yang, G. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103321 · Cited by 9
Metadata
- Authors
- Han, Y., Huang, G., Song, S., Yang, L., Wang, H., & Wang, Y.
- Affiliations
- Tsinghua University (CN)
- Beijing Academy of Artificial Intelligence (CN)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2022-11-01
- Volume
- 44
- Issue
- 11
- Pages
- 7436-7456
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3204647170
- Cited by
- 848
- References
- 280
- Citations by year
- 2026: 162 · 2025: 213 · 2024: 191 · 2023: 170 · 2022: 74
- FWCI
- 7.34
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science and Technology Major Project (2018AAA0100701)
- National Natural Science Foundation of China (61906106, 62022048)
- Tsinghua University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- dynamic neural networks, adaptive computation, adaptive inference, architectural design, decision-making scheme, optimization methods, sequential data, video analysis, text analysis
- MeSH terms
- Algorithms, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review