BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 701–800 of 1,000
Conditional information gain networks as sparse mixture of experts
Biçici, U. C., & Akarun, L. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108151 · Cited by 9
Kosta, A. K., Anwar, M. A., Panda, P., Raychowdhury, A., & Roy, K. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812320 · Cited by 9
Genetic Algorithm-Based Online-Partitioning BranchyNet for Accelerating Edge Inference
Na, J., Zhang, H., Lian, J., & Zhang, B. (2023) · Sensors · doi:10.3390/s23031500 · Cited by 9
Khalilian, S., & Meratnia, N. (2023) · International Workshop on Edge Systems, Analytics and Networking (EdgeSys) · doi:10.1145/3578354.3592872 · Cited by 9
Kim, S.-H., Nam, H., & Park, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3286034 · Cited by 9
On-demand Edge Inference Scheduling with Accuracy and Deadline Guarantee
She, Y., Li, M., Yang, J., Xu, M., Wang, J., & Liu, B. (2023) · International Workshop on Quality of Service · doi:10.1109/iwqos57198.2023.10188769 · Cited by 9
RAI4IoE: Responsible AI for Enabling the Internet of Energy
Xue, M., Nepal, ., Liu, L., Sethuvenkatraman, S., Yuan, X., Rudolph, C., Sun, R., & Eisenhauer, G. (2023) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa58951.2023.00012 · Cited by 9
LightFF: Lightweight Inference for Forward-Forward Algorithm
Aminifar, A., Huang, B., Abtahi, A., & Aminifar, A. (2024) · Frontiers in artificial intelligence and applications · doi:10.3233/faia240682 · Cited by 9
Hardware-Software Co-design Approach for Deep Learning Inference
Paul, D., Singh, J., & Mathew, J. (2019) · International Conference on Smart Computing and Communications (ICSCC) · doi:10.1109/icscc.2019.8843626 · Cited by 9
Challenges and Opportunities of DNN Model Execution Caching
Gilman, G. R., Ogden, S. S., Walls, R. J., & Guo, T. (2019) · doi:10.1145/3366622.3368147 · Cited by 9
Learning to Visualize Music Through Shot Sequence for Automatic Concert Video Mashup
Wei, W.-L., Lin, J., Liu, T.-L., Tyan, H.-R., Wang, H., & Liao, H.-Y. M. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.3003631 · Cited by 9
Towards memory-efficient inference in edge video analytics
Padmanabhan, A., Iyer, A. P., Ananthanarayanan, G., Shu, Y., Karianakis, N., Xu, G. H., & Netravali, R. (2021) · doi:10.1145/3477083.3480150 · Cited by 9
Multi-Exit Vision Transformer for Dynamic Inference
Bakhtiarnia, A., Zhang, Q., & Iosifidis, A. (2021) · Scopus (Elsevier) · doi:10.5281/zenodo.5604479 · Cited by 9
Self-Adaptive Approximate Mobile Deep Learning
Knez, T., Machidon, O. M., & Pejović, V. (2021) · Electronics · doi:10.3390/electronics10232958 · Cited by 9
FedBranch: Heterogeneous Federated Learning via Multi-Branch Neural Network
Cui, J., Wu, Q., Zhou, Z., & Chen, X. (2022) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc55456.2022.9880769 · Cited by 9
Batch-Shaped Channel Gated Networks.Preprint
Bejnordi, B. E., Blankevoort, T., & Welling, M. (2019) · arXiv (Cornell University) · Cited by 9
Fingerprinting Multi-exit Deep Neural Network Models via Inference TimePreprint
Dong, T., Qiu, H., Zhang, T., Li, J., Li, H., & Lu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.03175 · Cited by 9
Temporal Early Exits for Efficient Video Object DetectionPreprint
Sabet, A., Hare, J. S., Al‐Hashimi, B. M., & Merrett, G. V. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4001359 · Cited by 9
Temporal Early Exits for Efficient Video Object DetectionPreprint
Sabet, A., Hare, J. S., Al‐Hashimi, B. M., & Merrett, G. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11208 · Cited by 9
Fair Multi-Exit Framework for Facial Attribute ClassificationPreprint
Chiu, C.-H., Chung, H.-W., Chen, Y.-J., Shi, Y., & Ho, T.-Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.02989 · Cited by 9
Early-exit Convolutional Neural NetworksPreprint
Demir, E., & Akbaş, E. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2409.05336 · Cited by 9
BEEM: Boosting Performance of Early Exit DNNs using Multi-Exit Classifiers as Experts
Bajpai, D. J., & Hanawal, M. K. (2025) · International Conference on Learning Representations · doi:10.48550/arxiv.2502.00745 · Cited by 9
Text Fluoroscopy: Detecting LLM-Generated Text through Intrinsic Features
Yu, X., Chen, K., Yang, Q., Zhang, W., & Yu, N. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.885 · Cited by 8
RL-Agent-based Early-Exit DNN Architecture Search Framework
Taheri, M., Patne, P. A. G. G. D. P. G. D., Cherezova, N., Mahani, A. K., Herglotz, C., & Jenihhin, M. (2025) · IEEE International Symposium on Design and Diagnostics of Electronic Circuits & Systems (DDECS) · doi:10.1109/ddecs63720.2025.11006795 · Cited by 8
SELA: Smart Edge LLM Agent to Optimize Response Trade-offs of AI Assistants
Tuli, S., Casale, G., & Roveri, M. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749483 · Cited by 8
Are Generative Models Underconfident? Better Quality Estimation with Boosted Model Probability
Dinh, T. A., & Niehues, J. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.166 · Cited by 8
Three-way classification for sequences of observations
Savchenko, A. V., & Savchenko, L. V. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119540 · Cited by 8
Accelerating Deep Neural Network Tasks Through Edge-Device Adaptive Inference
Zhang, X., Teng, Y., Wang, N., Sun, B., & Hu, G. (2023) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc56721.2023.10293996 · Cited by 8
A Closer Look at Branch Classifiers of Multi-Exit Architectures
Lin, S., Ji, B., Ji, R., & Yao, A. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103900 · Cited by 8
Zhao, B., Hu, C., Zhu, W., Hu, S., & Zhang, X. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3387281 · Cited by 8
Distributed LSTM-based Slice Resource Allocation for Beyond 5G Networks
Ehsanian, A., & Spyropoulos, T. (2024) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/icnc59896.2024.10556119 · Cited by 8
Tang, Y., Li, X., Li, H., Yang, Z., Wang, X., & Leung, V. C. M. (2024) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc57260.2024.10571207 · Cited by 8
Energy Time Fairness: Balancing Fair Allocation of Energy and Time for GPU Workloads
Liang, Q., Hanafy, W. A., Bashir, N., Irwin, D., & Shenoy, P. J. (2023) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3583740.3628435 · Cited by 8
Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference
Wójcik, B., Devoto, A., Pustelnik, K., Minervini, P., & Scardapane, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i20.35453 · Cited by 8
Engineering a multi model fallback system for edge devices
Kadve, G., Chowdhury, A., Singh, V. K., & Pal, A. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.105165 · Cited by 9
Chen, Z., Tao, M., Xie, R., Nie, H., & Chen, Q. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3580773 · Cited by 8
EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI
Kong, H., Liu, D., Huai, S., Luo, X., Subramaniam, R., Makaya, C., Lin, Q., & Liu, W. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3276938 · Cited by 8
CoAxNN: Optimizing on-device deep learning with conditional approximate neural networks
Li, G., Ma, X., Yu, Q., Liu, L., Liu, H., & Wang, X. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102978 · Cited by 8
Underprovisioned GPUs: On Sufficient Capacity for Real-Time Mission-Critical Perception
Hu, Y. C., Gokarn, I., Liu, S., Misra, A., & Abdelzaher, T. (2023) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn58024.2023.10230127 · Cited by 8
Energy-Efficient RISC-V-Based Vector Processor for Cache-Aware Structurally-Pruned Transformers
Min, J. G., Kam, D., Byun, Y., Park, G., & Lee, Y. (2023) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped58423.2023.10244508 · Cited by 8
Elastic DNN Inference with Unpredictable Exit in Edge Computing
Huang, J., Gao, Y., & Dong, W. (2023) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs57875.2023.00009 · Cited by 8
Wang, H., Wang, Y., Liu, T., Zhao, T., & Gao, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.283 · Cited by 8
Haque, M., & Yang, W. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00163 · Cited by 8
Dynamic hierarchical intrusion detection task offloading in IoT edge networks
Sahi, M., Auluck, N., Azim, A., & Maruf, M. A. (2024) · Software Practice and Experience · doi:10.1002/spe.3338 · Cited by 8
AFMtrack: Attention-Based Feature Matching for Multiple Object Tracking
Bui, D. C., Hoang, H. A., & Yoo, M. (2024) · IEEE Access · doi:10.1109/access.2024.3411617 · Cited by 8
Adaptive Deep Learning for Efficient Visual Pose Estimation Aboard Ultra-Low-Power Nano-Drones
Motetti, B. A., Crupi, L., Elshaigi, M. O. M. E., Risso, M., Pagliari, D. J., Palossi, D., & Burrello, A. (2024) · Design, Automation, and Test in Europe · doi:10.23919/date58400.2024.10546577 · Cited by 8
Compressing deep convolutional neural networks in visual emotion recognition
Rassadin, A. G., & Savchenkov, A. V. (2017) · International Conference on Information Technology and Nanotechnology (ITNT) · doi:10.18287/1613-0073-2017-1901-207-213 · Cited by 8
CoDiNet: Path Distribution Modeling With Consistency and Diversity for Dynamic Routing
Wang, H., Qin, Z., Li, S., & Li, X. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3084680 · Cited by 8
Xie, C., Pagliari, D. J., & Calimera, A. (2022) · Conference on Ph.D. Research in Microelectronics and Electronics · doi:10.1109/prime55000.2022.9816801 · Cited by 8
Collaborative Object Detectors Adaptive to Bandwidth and Computation
Assine, J. S., Filho, J. C. S. S., & Junior, E. A. D. V. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746043 · Cited by 8
EBJR: Energy-Based Joint Reasoning for Adaptive Inference
Akbari, M. E., Banitalebi-Dehkordi, A., & Zhang, Y. (2021) · British Machine Vision Conference (BMVC) · doi:10.5244/c.35.145 · Cited by 8
Automated Customization of On-Device Inference for Quality-of-Experience Enhancement
Bai, Y., Chen, L., Ren, S., & Xu, J. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3208207 · Cited by 8
SoftSkip: Empowering Multi-Modal Dynamic Pruning for Single-Stage Referring Comprehension
Weerakoon, D., Subbaraju, V., Tran, T., & Misra, A. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548432 · Cited by 8
Ganapathy, S., Venkataramani, S., Sriraman, G., Ravindran, B., & Raghunathan, A. (2020) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3372882 · Cited by 8
TargetFinder: privacy preserving target search through IoT cameras
Khazbak, Y., Qiu, J., Tan, T., & Cao, G. (2019) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1145/3302505.3310083 · Cited by 8
Kwan, E., & Nunez-Yanez, J. L. (2020) · Electronics · doi:10.3390/electronics9111765 · Cited by 8
Scarpiniti, M., Baccarelli, E., Momenzadeh, A., & Ahrabi, S. S. (2021) · Applied Sciences · doi:10.3390/app11010377 · Cited by 8
AdaMM: Adaptive Object Movement and Motion Tracking in Hierarchical Edge Computing System
Kim, J., Lee, J., & Kim, T. (2021) · Sensors · doi:10.3390/s21124089 · Cited by 8
Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation
Yang, J., Bhalgat, Y. S., Chang, S., Porikli, F., & Kwak, N. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00276 · Cited by 8
Single-Training Collaborative Object Detectors Adaptive to Bandwidth and ComputationPreprint
Assine, J. S., Filho, J. C. S. S., & Junior, E. A. D. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.00591 · Cited by 8
Synergy of Edge Intelligence and Blockchain: A Comprehensive SurveyPreprint
Wang, X., Ren, X., Qiu, C., Xiong, Z., Yao, H., & Leung, V. C. M. (2021) · doi:10.36227/techrxiv.14724360.v1 · Cited by 8
Accelerating Large Language Model Inference with Self-Supervised Early ExitsPreprint
Valade, F. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.21082 · Cited by 8
Estimating Machine Translation DifficultyPreprint
Proietti, L., Perrella, S., Zouhar, V., Navigli, R., & Kocmi, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.10175 · Cited by 9
ADEPT: Adaptive Dynamic Early-Exit Process for TransformersPreprint
Yoo, S., Malla, S., Choi, C., Lu, W. D., & Choi, J. H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.03700 · Cited by 8
Efficient Deployment of Deep Neural Networks on Hardware Devices for Edge AI
Bouzidi, H. (2024) · theses.fr (ABES) · doi:10.70675/a25bbd6cz8a5bz4d93za232z46df005062c4 · Cited by 8
Xu, C., Shu, J., Wang, Z., & Wang, J. (2025) · International Journal of Digital Earth · doi:10.1080/17538947.2025.2517824 · Cited by 7
DarkDistill: Difficulty-Aligned Federated Early-Exit Network Training on Heterogeneous Devices
Qu, L., Li, S., Zhou, Z., Liu, B., Xu, Y., & Tong, Y. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3711896.3736902 · Cited by 7
Kalyanapu, J., Dizani, F., Asher, D., Ghanbari, A., Cammarota, R., Aysu, A., & Ajorpaz, S. M. (2025) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3725843.3756097 · Cited by 7
On-Orbit Space AI: Federated, Multi-Agent, and Collaborative Algorithms for Satellite Constellations
Wang, Z. (2026) · Algorithms · doi:10.3390/a19040318 · Cited by 7
LLM-as-Scheduler: Agentic Workflow Dynamic Scheduling
Xiang, D., Chu, K., Xu, W., Zhang, W., & Zhang, W. (2026) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2026.acl-long.581 · Cited by 7
Multiple-Stage Knowledge Distillation
Xu, C.-Y., Bai, N., Gao, W.-J., Li, T., Li, M., Li, G., & Zhang, Y. (2022) · Applied Sciences · doi:10.3390/app12199453 · Cited by 8
Class-Aware Neural Networks for Efficient Intrusion Detection on Edge Devices
Ayyat, M., Nadeem, T., & Krawczyk, B. (2023) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/secon58729.2023.10287462 · Cited by 7
Prediction Privacy in Distributed Multi-Exit Neural Networks: Vulnerabilities and Solutions
Kannan, T., Feamster, N., & Hoffmann, H. (2023) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3576915.3623069 · Cited by 7
ScrollNet: Dynamic Weight Importance for Continual Learning
Yang, F., Wang, K., & van de Weijer, J. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00359 · Cited by 7
A multi-level collaborative self-distillation learning for improving adaptive inference efficiency
Zhang, L., Li, J., Zhang, B., & Guo, Y. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01572-3 · Cited by 7
On Optimizing Resources for Real‐Time End‐to‐End Machine Learning in Heterogeneous Edges
Nguyen, M., & Truong, H. (2024) · Software Practice and Experience · doi:10.1002/spe.3383 · Cited by 7
EdgeTA: Neuron-Grained Scaling of Foundation Models in Edge-Side Retraining
Zhang, Q., Han, R., Liu, C. H., Wang, G., Guo, S., & Chen, L. Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3504859 · Cited by 7
ENHANCING GREEN COMPUTING THROUGH ENERGY-AWARE TRAINING: AN EARLY STOPPING PERSPECTIVE
Taşdelen, A. (2024) · Karabuk University - Computer Engineering and Software Engineering Departments · doi:10.71074/ctc.1594291 · Cited by 7
Distributing Inference Tasks Over Interconnected Systems Through Dynamic DNNs
Singhal, C., Wu, Y., Malandrino, F., Levorato, M., & Chiasserini, C. F. (2025) · IEEE Transactions on Networking · doi:10.1109/ton.2025.3543848 · Cited by 7
Ma, Y., Wang, Y., & Tang, B. (2025) · Electronics · doi:10.3390/electronics14081647 · Cited by 7
E3: Early Exiting with Explainable AI for Real-Time and Accurate DNN Inference in Edge-Cloud Systems
Lin, C., Chen, Z., Zhang, Z., & Liu, J. (2025) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3715014.3722076 · Cited by 7
RACENet: Real-time Adaptive Class-aware Early-exit Networks for Edge Devices
Ayyat, M., Osman, M., & Nadeem, T. (2025) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom64205.2025.00035 · Cited by 7
DSCD: Large Language Model Detoxification with Self-Constrained Decoding
Dong, M., Zhang, J., Zheng, B., Tu, X., Hu, P., & He, T. (2025) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2025.emnlp-main.197 · Cited by 7
Russian Doll Network: Learning Nested Networks for Sample-Adaptive Dynamic Inference
Jiang, B., & Mu, Y. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00042 · Cited by 7
Fast and accurate edge resource scaling for 5G/6G networks with distributed deep neural networks
Γιαννακάς, Θ., Spyropoulos, T., & Smid, O. (2022) · IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) · doi:10.1109/wowmom54355.2022.00021 · Cited by 7
Fine-grained Cloud Edge Collaborative Dynamic Task Scheduling Based on DNN Layer-Partitioning
Wang, X., Li, X., Wang, N., & Qin, X. (2022) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn57253.2022.00037 · Cited by 7
MBSNN: A multi-branch scalable neural network for resource-constrained IoT devices
Wang, H., Li, L., Cui, Y., Wang, N., Shen, F., & Wei, T. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102931 · Cited by 7
Attention-based variable-size feature compression module for edge inference
Li, S., Ma, C., Zhang, Y., Li, L., Wang, C., Cui, X., & Liu, J. (2023) · The Journal of Supercomputing · doi:10.1007/s11227-023-05779-y · Cited by 7
Intelligence Inference on IoT Devices
Zhang, Q., Li, Y., Zhang, D., Murturi, I., Pujol, V. C., Dustdar, S., & Wang, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-50514-0_9 · Cited by 7
Degradable inference for energy autonomous vision applications
Montanari, A., Alloulah, M., & Kawsar, F. (2019) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3341162.3349337 · Cited by 7
NetCut: Real-Time DNN Inference Using Layer Removal
Zandigohar, M., Erdogmus, D., & Schirner, G. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9474052 · Cited by 7
Toward the Predictability of Dynamic Real-Time DNN Inference
Pang, W., Jiang, X., Lv, M., Gao, T. F., Liu, D., & Yi, W. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3120329 · Cited by 7
Accelerating Pretrained Language Model Inference Using Weighted Ensemble Self-distillation
Kong, J., Wang, J., & Zhang, X. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88480-2_18 · Cited by 7
TreeNet Based Fast Task Decomposition for Resource-Constrained Edge Intelligence
Dong, L., Zhai, Y., Shen, J., Fahmideh, M., Wu, J., Tchaye-Kondi, J., & Zhu, L. (2022) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2022.3187118 · Cited by 7
A Strategy to Accelerate the Inference of a Complex Deep Neural Network
Haseena Rahmath, P., Srivastava, V., & Chaurasia, K. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-19-7615-5_5 · Cited by 7
Anticipate, Ensemble and Prune: Improving Convolutional Neural Networks via Aggregated Early Exits
Sarti, S., Lomurno, E., & Matteucci, M. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.08.190 · Cited by 7
Rodríguez, I., Campos, C., & Fdez‐Riverola, F. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126835 · Cited by 7
SHARCS: Efficient Transformers Through Routing with Dynamic Width Sub-networks
Salehi, M., Mehta, S., Kusupati, A., Farhadi, A., & Hajishirzi, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.706 · Cited by 7
Progressive Painterly Image Harmonization from Low-Level Styles to High-Level Styles
Niu, L., Hong, Y., Cao, J., & Zhang, L. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28232 · Cited by 7
Learning to Compose SuperWeights for Neural Parameter Allocation Search
Teterwak, P., Nelson, S., Dryden, N., Bashkirova, D., Saenko, K., & Plummer, B. A. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00273 · Cited by 7
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.