BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 201–300 of 1,000
ILFO: Adversarial Attack on Adaptive Neural Networks
Haque, M., Chauhan, A., Liu, C., & Yang, W. P. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01427 · Cited by 52
Edge intelligence secure frameworks: Current state and future challenges
Villar-Rodríguez, E., Arostegi, M., Torre-Bastida, A. I., Regueiro, C., & López-de-Armentia, J. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103278 · Cited by 53
Efficient adaptive inference for deep convolutional neural networks using hierarchical early exits
Passalis, N., Raitoharju, J., Tefas, A., & Gabbouj, M. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107346 · Cited by 51
Zhong, Z., Bao, W., Wang, J., Zhu, X., & Zhang, X. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3514501 · Cited by 50
Prompt-Driven Dynamic Object-Centric Learning for Single Domain Generalization
Li, D., Wu, A., Wang, Y., & Han, Y. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01667 · Cited by 50
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation
Zhao, W., Tang, J., Han, Y., Song, Y., Wang, K., Huang, G., Wang, F., & You, Y. (2024) · neural information processing systems · doi:10.52202/079017-3643 · Cited by 49
Energy-efficient deep learning inference on edge devices
Daghero, F., Pagliari, D. J., & Poncino, M. (2020) · Advances in computers · doi:10.1016/bs.adcom.2020.07.002 · Cited by 49
Learning to Stop While Learning to PredictPreprint
Chen, X., Dai, H., Li, Y., Gao, X., & Song, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05082 · Cited by 49
A Dynamic Deep Neural Network Design for Efficient Workload Allocation in Edge Computing
Lo, C., Su, Y.-Y., Lee, C.-Y., & Chang, S.-C. (2017) · 2017 IEEE International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2017.49 · Cited by 48
“It is observed that under the same overall accuracy requirements, our fine-grained AO criteria is able to report more classification results than CDL and BranchyNet.”
BackgroundMethodInfluentialEPNet: Learning to Exit with Flexible Multi-Branch Network
Dai, X., Kong, X., & Guo, T. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411973 · Cited by 48
EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices
Fang, W. W., Feng, X., Ding, Y., Xiong, N. N., & Leung, V. C. M. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3044930 · Cited by 48
Auditing Membership Leakages of Multi-Exit Networks
Li, Z., Liu, Y., He, X., Yu, N., Backes, M., & Zhang, Y. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3559359 · Cited by 48
Li, W., Hacid, H., Almazrouei, E., & Debbah, M. A. (2023) · AI · doi:10.3390/ai4030039 · Cited by 47
Fixing Overconfidence in Dynamic Neural Networks
Meronen, L., Trapp, M., Pilzer, A., Yang, L., & Solin, A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00266 · Cited by 47
UniPCGC: Towards Practical Point Cloud Geometry Compression via an Efficient Unified Approach
Wang, K., & Gao, W. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i12.33387 · Cited by 48
Fast yet Safe: Early-Exiting with Risk Control
Jazbec, M., Timans, A., Veljković, T. H., Sakmann, K., Zhang, D., Naesseth, C. A., & Nalisnick, E. (2024) · neural information processing systems · doi:10.52202/079017-4124 · Cited by 48
Survey of Attacks and Defenses on Edge-Deployed Neural Networks
Isakov, M., Gadepally, V. N., Gettings, K., & Kinsy, M. A. (2019) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2019.8916519 · Cited by 47
Liu, J., & Zhang, Q. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984333 · Cited by 47
AdaSpring: Context-adaptive and Runtime-evolutionary Deep Model Compression for Mobile Applications
Liu, S., Guo, B., Ma, K., Yu, Z., & Du, J. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3448125 · Cited by 47
HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling
Bouzidi, H., Odema, M., Ouarnoughi, H., Faruque, M. A. A., & Niar, S. (2023) · Design, Automation, and Test in Europe · doi:10.23919/date56975.2023.10137095 · Cited by 47
A Survey on Dynamic Neural Networks for Natural Language Processing
Xu, C., & McAuley, J. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.180 · Cited by 47
The Dark Side of Dynamic Routing Neural Networks: Towards Efficiency Backdoor Injection
Chen, S., Chen, H., Haque, M., Liu, C., & Yang, W. H. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02355 · Cited by 46
Adaptive Deep Neural Network Inference Optimization with EENet
İlhan, F., Chow, K.-H., Hu, S., Huang, T., Tekin, S. F., Wei, W., Wu, Y., Lee, M., Kompella, R. R., Latapie, H. M., et al. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00140 · Cited by 46
Pantheon: Preemptible Multi-DNN Inference on Mobile Edge GPUs
Han, L., Zhou, Z., & Li, Z. (2024) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3643832.3661878 · Cited by 46
Fast inference in convolutional neural networks based on sequential three-way decisions
Savchenko, A. V. (2021) · Information Sciences · doi:10.1016/j.ins.2021.01.068 · Cited by 46
Fine-Grained Elastic Partitioning for Distributed DNN Towards Mobile Web AR Services in the 5G Era
Ren, P., Qiao, X., Huang, Y., Liu, L., Pu, C., & Dustdar, S. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3098816 · Cited by 46
Farhadi, M. R., Ghasemi, M., & Yang, Y. (2019) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2019.8916237 · Cited by 45
Intelligent Offloading for NOMA-Assisted MEC via Dual Connectivity
Li, C., Wang, H., & Song, R. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3020542 · Cited by 45
A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language ModelsPreprint
Zhang, L., Fang, L., Duan, C., He, M., Pan, L., Xiao, P., Huang, S., Zhai, Y., Hu, X., Yu, P. S., et al. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.08712 · Cited by 46
Offloaded Execution of Deep Learning Inference at Edge: Challenges and Insights
Dey, S., Mondal, J., & Mukherjee, A. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730817 · Cited by 44
Dynamic Compression Ratio Selection for Edge Inference Systems With Hard Deadlines
Huang, X., & Zhou, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2997128 · Cited by 44
Multi-Exit Semantic Segmentation Networks
Kouris, A., Venieris, S. I., Laskaridis, S., & Lane, N. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19803-8_20 · Cited by 44
Early Exiting with Ensemble Internal ClassifiersPreprint
Sun, T., Zhou, Y., Liu, X., Zhang, X., Jiang, H., Cao, Z., Huang, X., & Qiu, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.13792 · Cited by 44
Jeon, S., Choi, Y., Cho, Y., & Cha, H. (2023) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3581791.3596845 · Cited by 43
PArtNNer: Platform-Agnostic Adaptive Edge-Cloud DNN Partitioning for Minimizing End-to-End Latency
Ghosh, S. K., Raha, A., Raghunathan, V., & Raghunathan, A. (2023) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3630266 · Cited by 44
ApproxNet: Content and Contention-Aware Video Object Classification System for Embedded Clients
Xu, R., Kumar, R., Wang, P., Bai, P., Meghanath, G., Chaterji, S., Mitra, S., & Bagchi, S. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3463530 · Cited by 43
Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital-Twin-Assisted Approach
Hu, S., Li, M., Gao, J., Zhou, C., & Shen, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3336600 · Cited by 42
Edge-AI: A systematic review on architectures, applications, and challenges
Gauttam, H., Nain, G., Pattanaik, K. K., & Mendes, P. (2025) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2025.104375 · Cited by 42
Baccarelli, E., Scarpiniti, M., Momenzadeh, A., & Ahrabi, S. S. (2021) · IEEE Access · doi:10.1109/access.2021.3058021 · Cited by 43
Joint multi-user DNN partitioning and task offloading in mobile edge computing
Liao, Z., Hu, W., Huang, J., & Wang, J. (2023) · Ad Hoc Networks · doi:10.1016/j.adhoc.2023.103156 · Cited by 42
Zhu, J., Meng, W., Sun, M., Yang, J., & Song, Z. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3274642 · Cited by 42
Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers
Dutson, M., Li, Y., & Gupta, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01551 · Cited by 41
Efficient Prompting via Dynamic In-Context LearningPreprint
Zhou, W., Jiang, Y. E., Cotterell, R., & Sachan, M. (2023) · arXiv (Cornell University) · doi:10.3929/ethz-b-000653704 · Cited by 41
On the Opportunities of Green Computing: A SurveyPreprint
Zhou, Y., Lin, X., Zhang, X., Wang, M., Jiang, G., Lu, H., Wu, Y., Zhang, K., Yang, Z., Wang, K., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.00447 · Cited by 41
Inference Time Optimization Using BranchyNet Partitioning
Pacheco, R. G., & Couto, R. S. (2020) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc50000.2020.9219647 · Cited by 40
Torres, D. R., Martín, C., Rubio, B., & Díáz, M. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102214 · Cited by 40
Adaptive Feeding: Achieving Fast and Accurate Detections by Adaptively Combining Object Detectors
Zhou, H.-Y., Gao, B.-B., & Wu, J. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.379 · Cited by 40
Dynamic Early Exit Scheduling for Deep Neural Network Inference through Contextual Bandits
Ju, W., Bao, W., Ge, L., & Yuan, D. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482335 · Cited by 39
Learning-Based Edge-Device Collaborative DNN Inference in IoVT Networks
Xu, X., Yan, K., Han, S., Wang, B., Tao, X., & Zhang, P. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3317785 · Cited by 39
DREAM: A Dynamic Scheduler for Dynamic Real-time Multi-model ML Workloads
Kim, S., Kwon, H., Song, J., Jo, J., Chen, Y., Lai, L., & Chandra, V. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3623278.3624753 · Cited by 39
Baccarelli, E., Scardapane, S., Scarpiniti, M., Momenzadeh, A., & Uncini, A. (2020) · Information Sciences · doi:10.1016/j.ins.2020.02.041 · Cited by 39
It's always personal: Using Early Exits for Efficient On-Device CNN Personalisation
Leontiadis, I., Laskaridis, S., Venieris, S. I., & Lane, N. D. (2021) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/3446382.3448359 · Cited by 39
Enabling DNN Acceleration With Data and Model Parallelization Over Ubiquitous End Devices
Huang, Y., Qiao, X., Lai, W., Dustdar, S., Zhang, J., & Li, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3112715 · Cited by 39
Enabling Low Latency Edge Intelligence based on Multi-exit DNNs in the Wild
Huang, Z., Dong, F., Shen, D., Zhang, J., Wang, H., Cai, G., & He, Q. (2021) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00075 · Cited by 39
Input-Aware Dynamic Timestep Spiking Neural Networks for Efficient In-Memory Computing
Li, Y., Moitra, A., Geller, T., & Panda, P. (2023) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac56929.2023.10247869 · Cited by 39
HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization ChallengesPreprint
Yang, X., Zhang, L., Qian, H., Song, L., & Bian, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.15196 · Cited by 39
PervasiveFL: Pervasive Federated Learning for Heterogeneous IoT Systems
Xia, J., Liu, T., Ling, Z., Wang, T., Fu, X., & Chen, M. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3197491 · Cited by 38
NetTailor: Tuning the Architecture, Not Just the Weights
Morgado, P. M., & Vasconcelos, N. M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00316 · Cited by 38
Berestizshevsky, K., & Even, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_26 · Cited by 38
SkipBERT: Efficient Inference with Shallow Layer Skipping
Wang, J., Chen, K., Chen, G., Shou, L., & McAuley, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.503 · Cited by 38
Stochastic Cumulative DNN Inference With RL-Aided Adaptive IoT Device-Edge Collaboration
Qu, K., Zhuang, W., Wu, W. R., Li, M., Shen, X., Li, X., & Shi, W. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3280746 · Cited by 38
MSD: Multi-Self-Distillation Learning via Multi-classifiers within Deep Neural NetworksPreprint
Luan, Y., Zhao, H., Yang, Z. C., & Dai, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09418 · Cited by 38
You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model
Tang, S., Wang, Y., Kong, Z., Zhang, T., Li, Y., Ding, C., Wang, Y., Liang, Y., & Xu, D. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01038 · Cited by 37
“The main assumption of early exiting method is that the intermediate representations of some easy samples in test sets have enough information for final predictions [44, 51].”
BackgroundHuang, Y., Qiao, X., Tang, J., Ren, P., Liu, L., Pu, C., & Chen, J. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155379 · Cited by 37
S2DNAS: Transforming Static CNN Model for Dynamic Inference via Neural Architecture Search
Yuan, Z., Wu, B., Sun, G., Liang, Z., Zhao, S., & Bi, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_11 · Cited by 37
Learning Unmasking Policies for Diffusion Language ModelsPreprint
Jazbec, M., Olausson, T., Béthune, L., Ablin, P., Kirchhof, M., Monteiro, J., Turrisi, V., Ramapuram, J., & Cuturi, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.09106 · Cited by 39
Task Scheduling with Optimized Transmission Time in Collaborative Cloud-Edge Learning
Huang, Y., Zhu, Y., Fan, X., Ma, X., Wang, F., Liu, J., Wang, Z., & Cui, Y. (2018) · 2018 27th International Conference on Computer Communication and Networks (ICCCN) · doi:10.1109/icccn.2018.8487352 · Cited by 36
Halpern, M., Boroujerdian, B., Mummert, T., Duesterwald, E., & Reddi, V. J. (2019) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass.2019.00012 · Cited by 36
ADDA: Adaptive Distributed DNN Inference Acceleration in Edge Computing Environment
Wang, H., Cai, G., Huang, Z., & Dong, F. (2019) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads47876.2019.00069 · Cited by 36
CRIME: Input-Dependent Collaborative Inference for Recurrent Neural Networks
Pagliari, D. J., Chiaro, R., Macii, E., & Poncino, M. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.3021199 · Cited by 36
GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning
Zhu, W., Wang, X., Ni, Y., & Xie, G. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.242 · Cited by 36
Samikwa, E., Maio, A. D., & Braun, T. I. (2022) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc49033.2022.9700550 · Cited by 36
DISNET: Distributed Micro-Split Deep Learning in Heterogeneous Dynamic IoT
Samikwa, E., Maio, A. D., & Braun, T. I. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3313514 · Cited by 36
Accelerating Image Classification using Feature Map Similarity in Convolutional Neural Networks
Park, K., & Kim, D.-H. (2018) · Applied Sciences · doi:10.3390/app9010108 · Cited by 36
Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking TokensPreprint
Chen, W.-L., Peng, L., Tan, T., Zhao, C., Chen, B. J., Lin, Z., Go, A., & Meng, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.13517 · Cited by 37
Khusheef, A. S., Shahbazi, M., & Hashemi, R. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124605 · Cited by 35
Calibration-Aided Edge Inference Offloading via Adaptive Model Partitioning of Deep Neural Networks
Pacheco, R. G., Couto, R. S., & Simeone, O. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500760 · Cited by 35
Xu, R., Lee, J., Wang, P., Bagchi, S., Li, Y., & Chaterji, S. (2022) · European Conference on Computer Systems · doi:10.1145/3492321.3519577 · Cited by 35
Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit AssignmentPreprint
Ororbia, A. G. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/xukqf · Cited by 36
Energy-Efficient Approximate Edge Inference Systems
Ghosh, S. K., Raha, A., & Raghunathan, V. (2023) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3589766 · Cited by 34
DNA: A General Dynamic Neural Network Accelerator
Liu, L., Yu, J., Wang, M., Li, X., Han, Y., & Wang, Y. (2025) · IEEE Transactions on Computers · doi:10.1109/tc.2025.3587617 · Cited by 34
RADE: resource-efficient supervised anomaly detection using decision tree-based ensemble methods
Vargaftik, S., Keslassy, I., Orda, A., & Ben-Itzhak, Y. (2021) · Machine Learning · doi:10.1007/s10994-021-06047-x · Cited by 34
SEE: Scheduling Early Exit for Mobile DNN Inference during Service Outage
Wang, Z., Bao, W., Yuan, D., Ge, L., Tran, N. H. K., & Zomaya, A. Y. (2019) · ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM) · doi:10.1145/3345768.3355917 · Cited by 34
QuickLoc: Adaptive Deep-Learning for Fast Indoor Localization with Mobile Devices
Tiku, S., Kale, P., & Pasricha, S. (2021) · ACM Transactions on Cyber-Physical Systems · doi:10.1145/3461342 · Cited by 34
Resource Efficient Domain Adaptation
Jiang, J., Wang, X., Long, M., & Wang, J. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413701 · Cited by 34
ELF: An Early-Exiting Framework for Long-Tailed ClassificationPreprint
Duggal, R., Freitas, S., Dhamnani, S., Chau, D. H., & Sun, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11979 · Cited by 34
A Survey on Deep Neural Network Partition over Cloud, Edge and End DevicesPreprint
Xu, D., He, X., Su, T., & Wang, Z. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.10020 · Cited by 34
Effective Heterogeneous Federated Learning via Efficient Hypernetwork-based Weight Generation
Shin, Y., Lee, K., Lee, S., Choi, Y. R., Kim, H., & Ko, J. (2024) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3666025.3699326 · Cited by 33
Energy-Efficient and Accuracy-Aware DNN Inference With IoT Device-Edge Collaboration
Jiang, W., Han, H., Feng, D., Qian, L., Wang, Q., & Xia, X. (2025) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2025.3536311 · Cited by 33
Cost-effective ensemble models selection using deep reinforcement learning
Birman, Y., Hindi, S., Katz, G., & Shabtai, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.07.011 · Cited by 33
Towards Transmission-Friendly and Robust CNN Models over Cloud and Device
Ding, C., Lu, Z., Juefei-Xu, F., Boddeti, V. N., Li, Y., & Cao, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3186496 · Cited by 33
Deep Learning on Energy Harvesting IoT Devices: Survey and Future Challenges
Lv, M., & Xu, E. (2022) · IEEE Access · doi:10.1109/access.2022.3225092 · Cited by 34
Do we need early exit networks in human activity recognition?
Lattanzi, E., Contoli, C., & Freschi, V. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106035 · Cited by 33
Learning Instance-wise Sparsity for Accelerating Deep Models
Liu, C., Wang, Y., Han, K., Xu, C., & Xu, C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/416 · Cited by 33
Entropy After for reasoning model early exitingPreprint
Wang, X., McInerney, J., Wang, L., & Kallus, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.26522 · Cited by 33
(2017) · doi:10.1145/3132211.3134456 · Cited by 32
“Instead, “early exits" are possible [51].”
Wang, X., Xu, Z., & Sui, X. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1538277 · Cited by 32
Infer-EDGE: Dynamic DNN Inference Optimization in Just-in-Time Edge-AI Implementations
Mounesan, M., Zhang, X., & Debroy, S. (2025) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms57970.2025.11073623 · Cited by 32
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques
Girija, S. S., Arora, L., Kapoor, S., Pradhan, D., Raj, A., & Shetgaonkar, A. (2025) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac65507.2025.00224 · Cited by 32
GlanceNets — efficient convolutional neural networks with adaptive hard example mining
Sun, H., & Pang, Y. (2018) · Science China Information Sciences · doi:10.1007/s11432-018-9497-0 · Cited by 32
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.