BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 501–600 of 1,000
A Probabilistic Re-Intepretation of Confidence Scores in Multi-Exit Models
Pomponi, J., Scardapane, S., & Uncini, A. (2021) · Entropy · doi:10.3390/e24010001 · Cited by 16
Edge-Cloud Cooperation for DNN Inference via Reinforcement Learning and Supervised Learning
Zhang, T., Li, Z., Chen, Y., Lam, K.-Y., & Zhao, J. (2022) · IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) · doi:10.1109/ithings-greencom-cpscom-smartdata-cybermatics55523.2022.00050 · Cited by 16
Fresa, A., & Champati, J. P. (2022) · ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM) · doi:10.1145/3551659.3559044 · Cited by 16
Stop or Forward: Dynamic Layer Skipping for Efficient Action Recognition
Seon, J., Hwang, J., Mun, J., & Han, B. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00336 · Cited by 16
Unsupervised Early Exit in DNNs with Multiple Exits
U, H. N. N., Hanawal, M. K., & Bhardwaj, A. (2022) · International Conference on AI-ML Systems (AIMLSystems) · doi:10.1145/3564121.3564137 · Cited by 16
Branchy Deep Learning Based Real-Time Defect Detection Under Edge-Cloud Fusion Architecture
Wang, J., Wu, Y., & Chen, Y. (2023) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2023.3285654 · Cited by 16
ATHEENA: A Toolflow for Hardware Early-Exit Network Automation
Biggs, B., Bouganis, C.-S., & Constantinides, G. A. (2023) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm57271.2023.00022 · Cited by 16
An Efficient Distributed Deep Learning Framework for Fog-Based IoT Systems
Chang, Y., Huang, X., Shao, Z., & Yang, Y. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014056 · Cited by 16
PicSys: Energy-Efficient Fast Image Search on Distributed Mobile Networks
Felemban, N. M., Mehmeti, F., Khamfroush, H., Lu, Z., Rallapalli, S., Chan, K., & Porta, T. L. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2963150 · Cited by 16
Enable Pipeline Processing of DNN Co-inference Tasks In the Mobile-Edge Cloud
Hu, S., Dong, C., & Wen, W. (2021) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs52626.2021.9449178 · Cited by 16
Efficient Graph Neural Network Inference at Large ScalePreprint
Gao, X., Zhang, W., Shao, Y., Nguyen, Q. V. H., Cui, B., & Yin, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.00495 · Cited by 16
SMG: A System-Level Modality Gating Facility for Fast and Energy-Efficient Multimodal Computing
Hou, X., Tang, P., Li, C., Liu, J., Xu, C., Cheng, K.-T. T., & Guo, M. (2023) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss59052.2023.00033 · Cited by 15
Air-CAD: Edge-Assisted Multi-Drone Network for Real-time Crowd Anomaly Detection
Tan, Y., Li, Q., Peng, J., Yuan, Z., & Jiang, Y. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645362 · Cited by 15
NetML: An NFV Platform with Efficient Support for Machine Learning Applications
Dhakal, A., & Ramakrishnan, K. K. (2019) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft.2019.8806698 · Cited by 15
Communication-efficient View-Pooling for Distributed Multi-View Neural Networks
Singhal, M., Raghunathan, V., & Raghunathan, A. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116528 · Cited by 15
INVITED: Computation on Sparse Neural Networks and its Implications for Future Hardware
Sun, F., Qin, M., Zhang, T., Liu, L., Chen, Y.-K., & Xie, Y. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218645 · Cited by 15
Training for multi-resolution inference using reusable quantization terms
Zhang, S. Q., McDanel, B., Kung, H. T., & Dong, X. (2021) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3445814.3446741 · Cited by 15
Self-citationDeep learning in multiagent systems
Esterle, L. (2022) · Elsevier eBooks · doi:10.1016/b978-0-32-385787-1.00022-1 · Cited by 15
PTEENet: Post-Trained Early-Exit Neural Networks Augmentation for Inference Cost Optimization
Lahiany, A., & Aperstein, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3187002 · Cited by 15
Liu, Y., Hao, T., Liu, H., Mu, Y., Weng, H., & Wang, F. L. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3587464 · Cited by 15
MMExit: Enabling Fast and Efficient Multi-modal DNN Inference with Adaptive Network Exits
Hou, X., Liu, J., Tang, X., Li, C., Cheng, K.-T. T., Li, L., & Guo, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-39698-4_29 · Cited by 15
Yu, H., Liu, D., Zhang, Z., & Wang, J. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3312488 · Cited by 15
HashReID: Dynamic Network with Binary Codes for Efficient Person Re-identification
Nikhal, K., Ma, Y., Bhattacharyya, S. S., & Riggan, B. S. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00594 · Cited by 15
A New Frontier of AI: On-Device AI Training and Personalization
Moon, J., Lee, H., Chu, J., Park, D. S., Hong, S. B., Seo, H., Jeong, D., Kong, S., & Ham, M. (2024) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3639477.3639716 · Cited by 15
Strypsteen, T., & Bertrand, A. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3225019 · Cited by 15
The streaming rollout of deep networks - towards fully model-parallel executionPreprint
Fischer, V., Köhler, J., & Pfeil, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04965 · Cited by 15
Collaboration of Experts: Achieving 80% Top-1 Accuracy on ImageNet with 100M FLOPsPreprint
Zhang, Y., Chen, Z., & Zhong, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03815 · Cited by 15
Fluid Batching: Exit-Aware Preemptive Serving of Early-Exit Neural Networks on Edge NPUsPreprint
Kouris, A., Venieris, S. I., Laskaridis, S., & Lane, N. D. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.13443 · Cited by 15
BlockLLM: Multi-tenant Finer-grained Serving for Large Language ModelsPreprint
Hu, B., Li, J., Xu, L., Lee, M., Jajoo, A., Kim, G.-W., Xu, H., & Akella, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.18322 · Cited by 16
AdaPonderLM: Gated Pondering Language Models with Token-Wise Adaptive DepthPreprint
Song, S., Li, H., Wang, Z., Zeng, B., Song, F., Wang, Y., Xu, Z. J., He, Z., & Lin, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.01914 · Cited by 15
Nian, B., Zhang, Y., Zhang, Y., & Shi, H. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3285553 · Cited by 14
Transformer Inference Acceleration in Edge Computing Environment
Li, M., Zhang, W., & Xia, D. (2023) · IEEE International Symposium on Cluster, Cloud and Internet Computing Workshops (CCGridW) · doi:10.1109/ccgridw59191.2023.00030 · Cited by 14
EENet: Energy Efficient Neural Networks with Run-time Power Management
Li, X., Shen, Y., Zou, A., & Ma, Y. (2023) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac56929.2023.10247701 · Cited by 14
CACTUS: Dynamically Switchable Context-aware micro-Classifiers for Efficient IoT Inference
Rastikerdar, M. M., Huang, J., Fang, S., Guan, H., & Ganesan, D. (2024) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3643832.3661888 · Cited by 14
Yu, J., Zhang, L., Cheng, D., Huang, W., Wu, H., & Song, A. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3457830 · Cited by 15
Li, N., Iosifidis, A., & Zhang, Q. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3518399 · Cited by 14
Optimizing Edge Offloading Decisions for Object Detection
Qiu, J., Wang, R., Hu, B., Guérin, R. A., & Lu, C. (2024) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec62691.2024.00021 · Cited by 14
Distributed Collaborative Inference System in Next-Generation Networks and Communication
Zhang, C., Zheng, X., Tao, X., Hu, C., Zhang, W., & Zhu, L. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3527679 · Cited by 14
Elmoghazy, S. S., Shouman, M. A., Elminir, H. K., & Selim, G. E. I. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11189-8 · Cited by 14
DataStates: Towards Lightweight Data Models for Deep Learning
Nicolae, B. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-63393-6_8 · Cited by 14
Shi, Y., Yang, K., Yang, Z., & Zhou, Y. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823817-2.00013-9 · Cited by 14
Re-thinking computation offload for efficient inference on IoT devices with duty-cycled radios
Huang, J., Guan, H., & Ganesan, D. (2023) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3570361.3592514 · Cited by 15
Gao, X., Liu, Y., Huang, T., & Hou, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126690 · Cited by 14
FastNER: Speeding up Inferences for Named Entity Recognition Tasks
Zhang, Y., Gao, X., Zhu, W., & Wang, X. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46661-8_13 · Cited by 14
DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models
Tang, P., Zhu, P., Li, T., Appalaraju, S., Mahadevan, V., & Manmatha, R. (2024) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2024.findings-naacl.9 · Cited by 15
Elastic Neural Networks for Classification
Zhou, Y., Bai, Y., Bhattacharyya, S. S., & Huttunen, H. J. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771475 · Cited by 14
Testudo: Collaborative Intelligence for Latency-Critical Autonomous Systems
Odema, M., Chen, L., Levorato, M., & Faruque, M. A. A. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3211480 · Cited by 14
Dynamic Representations Toward Efficient Inference on Deep Neural Networks by Decision Gates
Shafiee, M. S., Shafiee, M. J., & Wong, A. M. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00093 · Cited by 14
Improving the Accuracy of Early Exits in Multi-Exit Architectures via Curriculum Learning
Bakhtiarnia, A., Zhang, Q., & Iosifidis, A. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533875 · Cited by 14
The Shallow End: Empowering Shallower Deep-Convolutional Networks through Auxiliary OutputsPreprint
Guo, Y. F., Chen, J., Du, Q., van den Hengel, A., Shi, Q., & Tan, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01773 · Cited by 14
Stability-Informed Initialization of Neural Ordinary Differential EquationsPreprint
Westny, T., Mohammadi, A., Jung, D., & Frisk, E. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.15890 · Cited by 14
EE-Tuning: An Economical yet Scalable Solution for Tuning Early-Exit Large Language ModelsPreprint
Pan, X., Chen, Y., Li, Y., Ding, B., & Zhou, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.00518 · Cited by 14
Gull: A Generative Multifunctional Audio CodecPreprint
Luo, Y., Yu, J., Chen, H., Gu, R., & Weng, C. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.04947 · Cited by 14
On Uncertainty In Natural Language ProcessingPreprint
Ulmer, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.03446 · Cited by 14
A Survey of Early Exit Deep Neural Networks in NLPPreprint
Bajpai, D. J., & Hanawal, M. K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.07670 · Cited by 14
Multimodality Self-distillation for Fast Inference of Vision and Language Pretrained Models
Kong, J., Wang, J., Yu, L.-C., & Zhang, X. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3384060 · Cited by 13
CapEEN: Image Captioning with Early Exits and Knowledge Distillation
Bajpai, D. J., & Hanawal, M. K. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.376 · Cited by 13
Towards a Unified Framework for Split Learning
Radovič, B., Canini, M., Horváth, S., Pejović, V., & Vepakomma, P. (2025) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3721146.3721936 · Cited by 13
A Binarized Segmented ResNet Based on Edge Computing for Re-Identification
Chen, Y., Yang, T., Li, C., & Zhang, Y. (2020) · Sensors · doi:10.3390/s20236902 · Cited by 13
Energy-efficient neural networks with near-threshold processors and hardware accelerators
Nunez-Yanez, J. L., & Howard, N. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102062 · Cited by 13
Dynamic Path Based DNN Synergistic Inference Acceleration in Edge Computing Environment
Meng, Z., Zhou, B., Wang, H., Dong, F., & Zhao, W. (2021) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads53394.2021.00076 · Cited by 13
Dynamic Deep Neural Network Adversarial Attacks for Edge-based IoT Devices
Ayyat, M., Nukavarapu, S. K., & Nadeem, T. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001235 · Cited by 13
Avoid Overthinking in Self-Supervised Models for Speech Recognition
Berrebbi, D., Yan, B., & Watanabe, S. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10095335 · Cited by 13
USDN: A Unified Sample-wise Dynamic Network with Mixed-Precision and Early-Exit
Jeon, J.-Y., Nguyen, X. T., Ryu, S., & Lee, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00070 · Cited by 13
DECC: Delay-Aware Edge-Cloud Collaboration for Accelerating DNN Inference
Zhuang, Z., Chen, J., Xu, W., Qi, Q., Guo, S., Wang, J., Lu, L., Yang, H., & Liao, J. (2024) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2024.3404551 · Cited by 13
Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels
Jankowski, M., Gündüz, D., & Mikolajczyk, K. (2024) · IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN) · doi:10.1109/icmlcn59089.2024.10624796 · Cited by 13
Not all domains are equally complex: Adaptive Multi-Domain Learning
Senhaji, A., Raitoharju, J., Gabbouj, M., & Iosifidis, A. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412215 · Cited by 13
BPNet: Branch-pruned Conditional Neural Network for Systematic Time-accuracy Tradeoff
Park, K., Oh, C., & Yi, Y. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218545 · Cited by 13
EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP.
Tambe, T., Hooper, C. R. C., Pentecost, L., Yang, E.-Y., Donato, M., Sanh, V., Rush, A. M., Brooks, D. M., & Wei, G.-Y. (2020) · Cited by 13
Low Cost Early Exit Decision Unit Design for CNN Accelerator
Kim, G., & Park, J. (2020) · International SoC Design Conference · doi:10.1109/isocc50952.2020.9333079 · Cited by 13
Scalable Quantitative Verification for Deep Neural Networks
Baluta, T., Chua, Z. L., Meel, K. S., & Saxena, P. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion52605.2021.00115 · Cited by 13
eDeepSave: Saving DNN Inference using Early Exit During Handovers in Mobile Edge Environment
Ju, W., Yuan, D., Bao, W., Ge, L., & Zhou, B. B. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3447267 · Cited by 13
Hardening Hardware Accelerartor Based CNN Inference Phase Against Adversarial Noises
Odetola, T. A., Adeyemo, A. A., & Hasan, S. R. (2022) · IEEE International Symposium on Hardware Oriented Security and Trust (HOST) · doi:10.1109/host54066.2022.9840017 · Cited by 13
TeamNet: A Collaborative Inference Framework on the Edge
Fang, Y., Jin, Z., & Zheng, R. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00148 · Cited by 13
Students are the Best Teacher: Exit-Ensemble Distillation with Multi-ExitsPreprint
Lee, H., & Lee, J.-S. (2021) · arXiv.org · doi:10.48550/arxiv.2104.00299 · Cited by 12
ECLM: Efficient Edge-Cloud Collaborative Learning with Continuous Environment AdaptationPreprint
Zhuang, Y., Zheng, Z., Shao, Y., Li, B., Wu, F., & Chen, G. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.11083 · Cited by 13
On the Role of Depth and Looping for In-Context Learning with Task DiversityPreprint
Gatmiry, K., Saunshi, N., Reddi, S. J., Jegelka, S., & Kumar, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.21698 · Cited by 13
Shan, W., Meng, L., Zheng, T., Luo, Y., Li, B., Wang, J., Xiao, T., & Zhu, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2412.01455 · Cited by 13
Beyond Linear Probes: Dynamic Safety Monitoring for Language ModelsPreprint
Oldfield, J., Torr, P. H. S., Patras, I., Bibi, A., & Barez, F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.26238 · Cited by 13
Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy OptimizationPreprint
Zhai, Z., Li, B., Xiao, B., Li, M., & Wang, X. E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.14853 · Cited by 13
SLEXNet: Adaptive Inference Using Slimmable Early Exit Neural Networks
Kütükçü, B., Baidya, S., & Dey, S. (2024) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3689632 · Cited by 12
SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers
Navaneet, K. L., Koohpayegani, S. A., Sleiman, E., & Pirsiavash, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02341 · Cited by 12
An Early Exit Deep Neural Network for Fast Inference Intrusion Detection
Simioni, J. A., Viegas, E. K., Santin, A. O., & Horchulhack, P. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707974 · Cited by 12
A survey on dynamic neural networks: From computer vision to multi-modal sensor fusion
Montello, F., Güldenring, R., Scardapane, S., & Nalpantidis, L. (2026) · Image and Vision Computing · doi:10.1016/j.imavis.2026.105980 · Cited by 12
EA-Vit: Efficient Adaptation for Elastic Vision Transformer
Zhu, C., Zhao, W., Zhang, H., Zhou, Y., Tang, W., Tang, W., Yuan, Z., Shang, Y., Peng, X., Wang, K. W., et al. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.00104 · Cited by 12
Communication Efficient Cooperative Edge AI via Event-Triggered Computation Offloading
Zhou, Y., You, C., & Huang, K. (2025) · IEEE Transactions on Communications · doi:10.1109/tcomm.2025.3649672 · Cited by 12
DNN Partitioning for Cooperative Inference in Edge Intelligence: Modeling, Solutions, Toolchains
Hao, Y., Ding, N., Xia, W., Ge, H., & Xu, L. (2026) · ACM Computing Surveys · doi:10.1145/3786145 · Cited by 14
Onboard Optimization and Learning: A Survey
Pavel, M. I., Hu, S., Pratama, M., & Kowalczyk, R. (2026) · IEEE Access · doi:10.1109/access.2026.3664956 · Cited by 12
Shang, W., Dai, T., Chen, T., Zhang, F., & Ding, J. (2026) · IEEE Access · doi:10.1109/access.2026.3715276 · Cited by 13
An Adaptive Task Migration Scheduling Approach for Edge‐Cloud Collaborative Inference
Zhang, B., Li, Y., Zhang, S., Zhang, Y., & Zhu, B. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/8804530 · Cited by 12
Lü, K., Du, Z., Li, J., & Min, G. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3218173 · Cited by 12
Digital Twin-Assisted Adaptive DNN Inference in Industrial Internet of Things
Hu, S., Li, M., Gao, J., Zhou, C., & Shen, X. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001005 · Cited by 12
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings
Rotem, D., Hassid, M., Mamou, J., & Schwartz, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.829 · Cited by 12
ResMap: Exploiting Sparse Residual Feature Map for Accelerating Cross-Edge Video Analytics
Chen, N., Zhang, S., Zhang, S., Yan, Y., Chen, Y., & Lu, S. (2023) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom53939.2023.10228990 · Cited by 12
Choi, M., Yun, W. J., Son, S. B., Park, S., & Kim, J. (2023) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2023.3319437 · Cited by 12
Edge-Centric Optimization of Multi-modal ML-Driven eHealth Applications
Kanduri, A., Shahhosseini, S., Naeini, E. K., Alikhani, H., Liljeberg, P., Dutt, N. D., & Rahmani, A. M. (2023) · Springer eBooks · doi:10.1007/978-3-031-40677-5_5 · Cited by 12
Zhang, Y., Zhang, W., Wang, S., Lin, N., Yu, Y., He, Y., Wang, B., Jiang, H., Lin, P., Xu, X., et al. (2024) · Science Advances · doi:10.1126/sciadv.ado1058 · Cited by 12
Search, Examine and Early-Termination: Fake News Detection with Annotation-Free Evidences
Yang, Y., Zhou, Y., Ying, Q., Qian, Z., & Zhang, X. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240649 · Cited by 12
Li, Y., Gao, Y., Shao, M., Tonecha, J. T., Wu, Y., Hu, J., & Lee, I. (2021) · Journal of Low Power Electronics and Applications · doi:10.3390/jlpea11030034 · Cited by 12
SmartSplit: Latency-Energy-Memory Optimisation for CNN Splitting on Smartphone Environment
Prakash, I., Bansal, A., Verma, R., & Shorey, R. (2022) · International Conference on Communication Systems & Networks (COMSNETS) · doi:10.1109/comsnets53615.2022.9668610 · Cited by 12
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.