BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 601–700 of 1,000
ESAI: Efficient Split Artificial Intelligence via Early Exiting Using Neural Architecture Search
Zeinali, B., Zhuang, D., & Chang, J. M. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3485677 · Cited by 12
Contention Grading and Adaptive Model Selection for Machine Vision in Embedded Systems
Kütükçü, B., Baidya, S., Raghunathan, A., & Dey, S. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3520134 · Cited by 12
Revisiting Single-gated Mixtures of ExpertsPreprint
Royer, A., Karmanov, I., Skliar, A., Bejnordi, B. E., & Blankevoort, T. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.05497 · Cited by 12
Jointly-Learned Exit and Inference for a Dynamic Neural Network : JEI-DNN
Regol, F., Chataoui, J., & Coates, M. (2023) · International Conference on Learning Representations · doi:10.48550/arxiv.2310.09163 · Cited by 12
Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural NetworksPreprint
Zuo, L., Ding, Y., Jing, M., Yang, K., & Yu, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.07862 · Cited by 12
Dr.LLM: Dynamic Layer Routing in LLMs
Heakl, A., Gubri, M., Khan, S., Yun, S., & Oh, S. J. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2510.12773 · Cited by 12
AntiNODE: Evaluating Efficiency Robustness of Neural ODEs
Haque, M., Chen, S., Haque, W., Liu, C., & Yang, W. H. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00164 · Cited by 11
WASP: Efficient Power Management Enabling Workload-Aware, Self-Powered AIoT Devices
Hou, X., Tang, X., Liu, J., Li, C., Liang, L., & Cheng, K.-T. T. (2024) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2024.3408167 · Cited by 11
Joint Exit Selection and Offloading Decision for Applications Based on Deep Neural Networks
Narmeen, R., Mach, P., Bečvář, Z., & Ahmad, I. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3444898 · Cited by 11
Yin, K., Ji, X., Wang, Y., & Wang, Z. (2024) · Defence Technology · doi:10.1016/j.dt.2024.08.015 · Cited by 11
DAdEE: Unsupervised Domain Adaptation in Early Exit PLMs
Bajpai, D. J., & Hanawal, M. K. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.371 · Cited by 12
IoT-Edge Splitting With Pruned Early-Exit CNNs for Adaptive Inference
Korol, G., & Beck, A. C. S. (2025) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2025.3543445 · Cited by 11
Ou, J., Guo, J., Jiang, S., Wang, Z., Qin, L., Yao, S., & Tian, W. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1384 · Cited by 11
FREE: Fast and Robust Vision Language Models with Early Exits
Bajpai, D. J., & Hanawal, M. K. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.1209 · Cited by 11
Choi, H. M., & Seo, D. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3680582 · Cited by 11
Energy-Latency Attacks: A New Adversarial Threat to Deep Learning
Meftah, H. F. Z. B., Hamidouche, W., Fezza, S. A., & Déforges, O. (2026) · ACM Computing Surveys · doi:10.1145/3785666 · Cited by 11
A Construction Kit for Efficient Low Power Neural Network Accelerator Designs
Jokic, P., Azarkhish, E., Bonetti, A., Pons, M., Emery, S., & Benini, L. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3520127 · Cited by 11
An Empirical Study on Adaptive Inference for Pretrained Language Model
Liu, W., Zhao, X. W., Zhao, Z., Ju, Q., Yang, X., & Lü, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3114188 · Cited by 11
PAME: precision-aware multi-exit DNN serving for reducing latencies of batched inferences
Zhang, S., Cui, W., Chen, Q., Zhang, Z., Guan, Y., Leng, J., Li, C., & Guo, M. (2022) · International Conference on Supercomputing · doi:10.1145/3524059.3532366 · Cited by 11
Joint Architecture Design and Workload Partitioning for DNN Inference on Industrial IoT Clusters
Fang, W. W., Xu, W., Yu, C., & Xiong, N. N. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3551638 · Cited by 11
User-Distribution-Aware Federated Learning for Efficient Communication and Fast Inference
Cui, Y., Zhang, Z., Wang, N., Li, L., Chang, C.-W., & Wei, T. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3327513 · Cited by 11
Using Early Exits for Fast Inference in Automatic Modulation Classification
Mohammed, E., Mashaal, O., & Abou-Zeid, H. (2023) · Globecom · doi:10.1109/globecom54140.2023.10436917 · Cited by 11
Liang, Y.-P., Chang, C.-M., & Chung, C.-C. (2024) · Sensors · doi:10.3390/s24072265 · Cited by 11
UR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers
Jia, H., Kwon, Y. D., Ma, D., Pham, N., Qendro, L., Vu, T. N., & Mascolo, C. (2024) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom59722.2024.10494467 · Cited by 11
Early-Exit with Class Exclusion for Efficient Inference of Neural Networks
Wang, J., Li, B., & Zhang, G. L. (2024) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas59952.2024.10595861 · Cited by 11
Efficient NPU–GPU scheduling for real-time deep learning inference on mobile devices
Yu, C., Wang, M., Chen, S., Wang, W., Fang, W. W., Chen, Y., & Xiong, N. N. (2025) · Journal of Real-Time Image Processing · doi:10.1007/s11554-025-01670-6 · Cited by 11
Sun, Z., Si, Z., Zang, X., Zheng, K., Song, Y., Zhang, X., & Xu, J. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714800 · Cited by 11
NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks
Ham, S., Park, J., Han, D.-J., & Moon, J. (2023) · neural information processing systems · doi:10.52202/075280-1801 · Cited by 11
Teacher and Student Joint Learning for Compact Facial Landmark Detection Network
Lee, H. J., Baddar, W. J., Kim, H. G., Kim, S. T., & Ro, Y. M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73603-7_40 · Cited by 11
ABC: Abstract prediction Before Concreteness
Kim, J.-E., Bradford, R. M., Yoon, M.-K., & Shao, Z. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116479 · Cited by 11
Certify or Predict: Boosting Certified Robustness with Compositional Architectures
Müller, M. N., Balunović, M., & Vechev, M. (2021) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000529937 · Cited by 11
Raha, A., Ghosh, S. K., Mohapatra, D., Mathaikutty, D. A., Sung, R., Brick, C., & Raghunathan, V. (2021) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd53106.2021.00015 · Cited by 11
Vashist, A., Shanmugham, S. V. V., Ganguly, A., & Dinakarrao, S. M. P. (2022) · International Conference on Consumer Electronics · doi:10.1109/icce53296.2022.9730182 · Cited by 11
Enabling resource-efficient edge intelligence with compressive sensing-based deep learning
Machidon, A. L., & Pejović, V. (2022) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/3528416.3530230 · Cited by 11
Dynamic Neural Network for MIMO Detection
Yang, Y., Gao, F., Wang, M., Xue, J., & Xu, Z. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180794 · Cited by 11
Kundu, S., Sundaresan, S., Pedram, M., & Beerel, P. A. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00238 · Cited by 11
Addad, Y., Lechervy, A., & Jurie, F. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00161 · Cited by 11
Byzantine-Tolerant Inference in Distributed Deep Intelligent System: Challenges and Opportunities
Choi, J., Hakimi, Z., Sampson, J., & Narayanan, V. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2933807 · Cited by 11
Dynamic-stride-net: deep convolutional neural network with dynamic stride
Yang, Z., Xu, Y., Dai, W., & Xiong, H. (2019) · Optoelectronic Imaging and Multimedia Technology · doi:10.1117/12.2537799 · Cited by 11
LoADPart: Load-Aware Dynamic Partition of Deep Neural Networks for Edge Offloading
Liu, H., Zheng, W., Li, L., & Guo, M. (2022) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs54860.2022.00053 · Cited by 11
Layerwise Recall and the Geometry of Interwoven Knowledge in LLMsPreprint
Lei, G., & Cooper, S. J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.10871 · Cited by 11
Learning to Skip the Middle Layers of TransformersPreprint
Lawson, T., & Aitchison, L. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.21103 · Cited by 11
DSD: A Distributed Speculative Decoding Solution for Edge-Cloud Agile Large Model ServingPreprint
Yu, F., Li, L., McDanel, B., & Zhang, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.21669 · Cited by 11
Self-citationKuhse, D., Teper, H., Buschjäger, S., Wang, C.-Y., & Chen, J.-J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.17497 · Cited by 11
Dynamic Compositional Graph Convolutional Network for Efficient Composite Human Motion Prediction
Zhang, W., Zhao, S., Meng, F., Wu, S., & Liu, M. (2023) · Proceedings of the 31st ACM International Conference on Multimedia · doi:10.1145/3581783.3612532 · Cited by 10
Zhao, Y., Li, S., & Feng, X. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755609 · Cited by 10
Dynamic Hierarchical Neural Network Offloading in IoT Edge Networks
Seifeddine, W., Adjih, C., & Achir, N. (2021) · doi:10.23919/pemwn53042.2021.9664700 · Cited by 10
CONTINUER: Maintaining Distributed DNN Services During Edge Failures
Majeed, A. A., Kilpatrick, P., Spence, I. T. A., & Varghese, B. (2022) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge55608.2022.00029 · Cited by 10
Filtering Out High Noise Data for Distributed Deep Neural Networks
Cui, Y., Li, L., Tao, Z., Chen, M., & Wei, T. (2022) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2022.3208027 · Cited by 10
Liao, Z., Zhang, X., He, S., & Tang, Q. (2023) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2023.103720 · Cited by 10
Toward Inference Delivery Networks: Distributing Machine Learning With Optimality Guarantees
Salem, T. S., Castellano, G., Neglia, G., Pianese, F., & Araldo, A. (2023) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2023.3305922 · Cited by 10
On the impact of black-box deployment strategies for edge AI on latency and model performance
Singh, J., Fallahzadeh, E., Adams, B., & Hassan, A. E. (2026) · Empirical Software Engineering · doi:10.1007/s10664-025-10714-1 · Cited by 10
Algorithms for Canvas-Based Attention Scheduling with Resizing
Hu, Y. C., Gokarn, I., Liu, S., Misra, A., & Abdelzaher, T. (2024) · IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) · doi:10.1109/rtas61025.2024.00035 · Cited by 10
Haseena Rahmath, P., Chaurasia, K., Gupta, A., & Srivastava, V. (2024) · International Journal of Remote Sensing · doi:10.1080/01431161.2024.2370501 · Cited by 10
Kim, J.-W., & Lee, H.-S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3439852 · Cited by 10
Early-Exit Meets Model-Distributed Inference at Edge Networks
Colocrese, M., Koyuncu, E., & Seferoğlu, H. (2024) · IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN) · doi:10.1109/lanman61958.2024.10621887 · Cited by 10
Dynamic Batching and Early-Exiting for Accurate and Timely Edge Inference
She, Y., Shi, T., Wang, J., & Liu, B. (2024) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2024-spring62846.2024.10682995 · Cited by 10
Regret Bounds for Online Learning for Hierarchical Inference
Al-Atat, G., Datta, P., Moharir, S., & Champati, J. P. (2024) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3641512.3686392 · Cited by 10
AI Model Modulation with Logits Redistribution
Wang, Z., Ma, Z., Feng, X., Mei, Z., Ma, E., Wang, D., Xue, M., & Bai, G. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714737 · Cited by 10
EdgeBoost: Confidence boosting for resource constrained inference via selective offloading
Said, N., & Landsiedel, O. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111437 · Cited by 10
Multi-exit Kolmogorov–Arnold networks: enhancing accuracy and parsimony
Bagrow, J. P., & Bongard, J. (2025) · Machine Learning Science and Technology · doi:10.1088/2632-2153/adf9bd · Cited by 10
Conditional Information Gain Networks
Biçici, U. C., Keskin, C., & Akarun, L. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545384 · Cited by 10
URNet: User-Resizable Residual Networks with Conditional Gating Module
Lee, S., Chang, S., & Kwak, N. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5886 · Cited by 10
Efficient Keyword Spotting through Hardware-Aware Conditional Execution of Deep Neural Networks
Giraldo, J. S. P., O'Connor, C., & Verhelst, M. (2019) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa47632.2019.9035275 · Cited by 10
Liu, J., & Zhang, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3001620 · Cited by 10
Tu, C.-H., Sun, Q., & Cheng, M.-H. (2021) · The Journal of Supercomputing · doi:10.1007/s11227-021-03795-4 · Cited by 10
Developing a Miniature Energy-Harvesting-Powered Edge Device with Multi-Exit Neural Network
Li, Y., Wu, Y., Zhang, X., Hamed, E. A., Hu, J., & Lee, I. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401799 · Cited by 10
BasisNet: Two-stage Model Synthesis for Efficient Inference
Zhang, M., Chu, C.-T., Zhmoginov, A., Howard, A., Jou, B., Zhu, Y., Zhang, L., Hwa, R., & Kovashka, A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00344 · Cited by 10
Dutson, M., Li, Y., & Gupta, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20083-0_17 · Cited by 10
Lee, S., Lee, J., & Lee, K. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3141392 · Cited by 10
Towards improving fast adversarial training in multi-exit network
Chen, S., Shen, H., Wang, R., & Wang, X. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.015 · Cited by 10
Dynamically throttleable neural networks
Liu, H., Parajuli, S., Hostetler, J., Chai, S. M., & Bhanu, B. (2022) · Machine Vision and Applications · doi:10.1007/s00138-022-01311-z · Cited by 10
Huang, Z., Dong, F., Shen, D., Wang, H., Guo, X., & Fu, S. (2022) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3545008.3545071 · Cited by 10
Zhou, W., Bras, R. J. L., & Choi, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.664 · Cited by 10
BSL: Sustainable Collaborative Inference in Intelligent Transportation Systems
Luo, C., Chen, J., Feng, X., Zhang, J., & Li, J. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3308370 · Cited by 10
Fast Intent Classification for Spoken Language Understanding Systems
Tyagi, A., Sharma, V., Gupta, R., Samson, L., Zhuang, N., Wang, Z., & Campbell, B. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054240 · Cited by 10
DNN Inference Acceleration with Partitioning and Early Exiting in Edge Computing
Li, C., Xu, H., Xu, Y., Wang, Z., & Huang, L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85928-2_37 · Cited by 10
Learning Instance-wise Sparsity for Accelerating Deep ModelsPreprint
Liu, C., Wang, Y., Han, K., Xu, C., & Xu, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.11840 · Cited by 10
Surprisal-Triggered Conditional Computation with Neural NetworksPreprint
Lugosch, L., Nowrouzezahrai, D., & Meyer, B. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01659 · Cited by 10
Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference LossPreprint
Iuzzolino, M. L., Mozer, M. C., & Bengio, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.09808 · Cited by 10
Graceful Degradation and Related FieldsPreprint
Dymond, J. (2021) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.2106.11119 · Cited by 10
Pruning Early Exit NetworksPreprint
Görmez, A., & Koyuncu, E. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.03644 · Cited by 10
GLEAM: Greedy Learning for Large-Scale Accelerated MRI ReconstructionPreprint
Ozturkler, B., Sahiner, A., Ergen, T., Desai, A., Sandino, C. M., Vasanawala, S. S., Pauly, J. M., Mardani, M., & Pilancı, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.08393 · Cited by 10
Securing Multi-turn Conversational Language Models From Distributed Backdoor TriggersPreprint
Tong, T., Xu, J., Liu, Q., & Chen, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.04151 · Cited by 10
End-Edge Coordinated Inference for Real-Time BYOD Malware Detection using Deep Learning
Tan, X., Li, H., Wang, L., & Xu, Z. (2020) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc45663.2020.9120765 · Cited by 9
Super-Resolution-Empowered Adaptive Medical Video Streaming in Telemedicine Systems
Han, H., & Lv, J. C. (2022) · Electronics · doi:10.3390/electronics11182944 · Cited by 9
Personalized Federated Learning with Multi-branch Architecture
Mori, J., Yoshiyama, T., Furukawa, R., & Teranishi, I. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191899 · Cited by 9
Design Space Exploration for CNN Offloading to FPGAs at the Edge
Korol, G., Jordan, M. G., Rutzig, M. B., Castrillón, J., & Beck, A. C. S. (2023) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi59464.2023.10238644 · Cited by 9
Zhang, Z., Liu, Z., Zhao, Y., Qiu, C., Zhang, C., & Wang, X. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3344850 · Cited by 9
Class Based Thresholding in Early Exit Semantic Segmentation Networks
Görmez, A., & Koyuncu, E. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3386110 · Cited by 9
GloNets: Globally Connected Neural Networks
Cecco, A. D., Metta, C., Fantozzi, M., Morandin, F., & Parton, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-58547-0_5 · Cited by 9
The Entanglement of Communication and Computing in Enabling Edge Intelligence
Li, J., & Mahmoodi, T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3391923 · Cited by 9
Elastic DNN Inference With Unpredictable Exit in Edge Computing
Huang, J., Gao, Y. C., & Dong, W. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3441946 · Cited by 9
UCBEE: A Multi Armed Bandit Approach for Early-Exit in Neural Networks
Pacheco, R. G., Bajpai, D. J., Shifrin, M., Couto, R. S., Menasché, D. S., Hanawal, M. K., & Campista, M. E. M. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3479076 · Cited by 9
SecureEI: Proactive intellectual property protection of AI models for edge intelligence
Li, P., Huang, J., Zhang, S., & Qi, C. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110825 · Cited by 9
Towards Low-Cost and Energy-Aware Inference for EdgeAI Services via Model Swapping
Trihinas, D., Michael, P., & Symeonides, M. (2024) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e61754.2024.00026 · Cited by 9
EC5: Edge–cloud collaborative computing framework with compressive communication
Tan, J., Liu, F., Wang, B., Wu, Q., & Chen, C. L. P. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107715 · Cited by 9
AdaScale: Dynamic Context-Aware DNN Scaling via Automated Adaptation Loop on Mobile Devices
Wang, Y., Liu, S., Guo, B., Zhang, B., Ma, K., Ding, Y., Luo, H., Li, Y., & Yu, Z. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3542490 · Cited by 9
Multilevel Neural Network for Reducing Expected Inference Time
Putra, T. A., & Leu, J. (2019) · IEEE Access · doi:10.1109/access.2019.2952577 · Cited by 9
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.