BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 801–900 of 1,000
Learning Personalized Modular Network Guided by Structured Knowledge
Liang, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00915 · Cited by 7
MBS: Macroblock Scaling for CNN Model Reduction
Lin, Y., Chou, C., & Chang, E. Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00933 · Cited by 7
Towards Edge Computing Based Distributed Data Analytics Framework in Smart Grids
Song, C., Li, T., Huang, X., Wang, Z., & Zeng, P. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-24274-9_25 · Cited by 7
SGAD: Soft-Guided Adaptively-Dropped Neural NetworkPreprint
Wang, Z., Sun, F., Lin, J. T., Wang, Z., & Yuan, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01430 · Cited by 7
Learning to Accelerate Approximate Methods for Solving Integer Programming via Early FixingPreprint
Li, L., & Wu, B. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.02087 · Cited by 7
Slimmable Pruned Neural NetworksPreprint
Kuratsu, H., & Nakamura, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2212.03415 · Cited by 7
Yan, Y., & Li, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2301.08353 · Cited by 7
EERO: Early Exit with Reject Option for Efficient Classification with limited budgetPreprint
Valade, F., Hebiri, M., & Gay, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.03779 · Cited by 7
Hierarchical Skip Decoding for Efficient Autoregressive Text GenerationPreprint
Zhu, Y., Yang, X., Wu, Y., & Zhang, W. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2403.14919 · Cited by 7
AdaDecode: Accelerating LLM Decoding with Adaptive Layer ParallelismPreprint
Wei, Z., Chen, W., Zhu, X., & Yu, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.03700 · Cited by 7
The Alignment Curse: Modality Alignment Supercharges Audio Attacks via Text TransferPreprint
Chen, Y., Yu, J., Liu, A., Wu, B., Torr, P. H. S., & Bibi, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.02557 · Cited by 7
Timing Channels in Adaptive Neural Networks
Akinsanya, A., & Brennan, T. (2024) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2024.24125 · Cited by 6
Wright, G. A., Cappellazzo, U., Zaiem, S., Raj, D., Yang, L. O., Falavigna, D., Ali, M. N., & Brutti, A. (2024) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10627008 · Cited by 6
Tian, J., Li, X., & Qin, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651115 · Cited by 6
Wang, L., Yan, Y., Huang, D., Pan, Y., Cheang, C. F., Luo, K., & Li, J. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3540853 · Cited by 6
An Accelerating Method of YOLOv7 Based on Lightweight Network Architecture
Wang, J., & Xu, K. (2025) · Applied Sciences · doi:10.3390/app15052528 · Cited by 6
TINIEE: Traffic-Aware Adaptive In-Network Intelligence via Early-Exit Strategy
Kim, H., Yoon, S., Bae, C., Lee, S., & Pack, S. (2024) · IEEE Transactions on Networking · doi:10.1109/ton.2026.3689743 · Cited by 6
AI: It's All About Inference Now
Gschwind, M. K. (2025) · Queue · doi:10.1145/3733701 · Cited by 6
Ensemble early exit network on human activity recognition using wearable sensors
Yu, J., Zhang, L., Cheng, D., Bu, C., Liu, L., Wu, H., & Song, A. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111409 · Cited by 6
Position-Aware Depth Decay Decoding (D3): Boosting Large Language Model Inference Efficiency
Fan, S., Fang, X., Xing, X., Peng, H., Shang, S., & Wang, Y. (2025) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2025.findings-acl.154 · Cited by 6
EPEE: towards efficient and effective foundation models in biomedicine
Zhan, Z., Zhou, S., Zhou, H., Liu, Z., & Zhang, R. (2026) · npj Health Systems · doi:10.1038/s44401-026-00083-2 · Cited by 6
Special Sessions - Hardware-Software Co-Design for Machine Learning Systems Made Open-Source
Tahoori, M. B., Meyers, V., Roodsari, M. S., Xu, H., Becker, J., Harbaum, T., Frombach, F., Hoefer, J., Sotiropoulos, G., Henkel, J., et al. (2025) · International Conference on Hardware/Software Codesign and System Synthesis · doi:10.1145/3742873.3756928 · Cited by 6
On dissipativity of cross-entropy loss in training ResNets — A turnpike towards architecture search
Püttschneider, J., & Faulwasser, T. (2026) · Automatica · doi:10.1016/j.automatica.2025.112767 · Cited by 6
Li, Q., Gao, M., Zhai, W., Wu, W., Wang, C., & Abdelmoniem, A. M. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116300 · Cited by 6
Etefaghi, A., & Sharifian, S. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-022-04728-5 · Cited by 6
FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exits
Karpikova, P., Radionova, E., Yaschenko, A., Andrei, S., Kostyushko, L., Fabbricatore, R., & Aleksei, I. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01158 · Cited by 6
The Adversarial Implications of Variable-Time Inference
Biton, D., Misra, A., Levy, E., Kotak, J., Bitton, R., Schuster, R., Papernot, N., Elovici, Y., & Nassi, B. (2023) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3605764.3623912 · Cited by 6
A Rotating Object Detector with Convolutional Dynamic Adaptive Matching
Yu, L., Zhou, Y., Li, X., Hu, S., & Jing, D. (2024) · Applied Sciences · doi:10.3390/app14020633 · Cited by 6
FPGA Acceleration of Dynamic Neural Networks: Challenges and Advancements
Dimitriou, A., Biggs, B., Hare, J. S., & Merrett, G. V. (2024) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins61597.2024.10622127 · Cited by 6
Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting
Hamed, O., Bakkali, S., Blaschko, M. B., Moens, S., & Landeghem, J. V. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70546-5_16 · Cited by 6
Split Edge-Cloud Neural Networks for Better Adversarial Robustness
Douch, S., Abid, M. R., Zine-Dine, K., Bouzidi, D., & Benhaddou, D. (2024) · IEEE Access · doi:10.1109/access.2024.3487435 · Cited by 6
Realization of Early-Exit Dynamic Neural Networks on Reconfigurable Hardware
Dimitriou, A., Xun, L., Hare, J. S., & Merrett, G. V. (2024) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2024.3519055 · Cited by 6
RCNet: Resilient Collaborative DNN Inference for Wireless Networks With High Packet Loss
Liang, Y., Chang, J., Zang, M., & Wu, J. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3563980 · Cited by 6
BERT Lost Patience Won't Be Robust to Adversarial Slowdown
Coalson, Z., Ritter, G., Bobba, R. B., & Hong, S. (2023) · neural information processing systems · doi:10.52202/075280-2732 · Cited by 6
Roy, D., Srinivasan, G., Panda, P., Tomsett, R., Desai, N. V., Ganti, R., & Roy, K. (2019) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp.2019.00027 · Cited by 6
Accelerating on-device DNN inference during service outage through scheduling early exit
Wang, Z., Bao, W., Yuan, D., Ge, L., Tran, N. H. K., & Zomaya, A. Y. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.08.005 · Cited by 6
Analyzing Distributed Deep Neural Network Deployment on Edge and Cloud Nodes in IoT Systems
Ashouri, M., Lorig, F., Davidsson, P., Spalazzese, R., & Svorobej, S. (2020) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge50951.2020.00017 · Cited by 6
Network with Sub-networks: Layer-wise Detachable Neural Network
Fuengfusin, N., & Tamukoh, H. (2020) · Journal of Robotics Networking and Artificial Life · doi:10.2991/jrnal.k.201215.006 · Cited by 6
Xarchakos, I., & Koudas, N. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3094997 · Cited by 6
Robust and Efficient Uncertainty Aware Biosignal Classification via Early Exit Ensembles
Campbell, A., Qendro, L., Lió, P., & Mascolo, C. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746330 · Cited by 6
Joint Model, Task Partitioning and Privacy Preserving Adaptation for Edge DNN Inference
Jiang, J., Li, H., & Wang, L. (2022) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc51071.2022.9771620 · Cited by 6
Kiaghadi, A., Huang, J., Homayounfar, S. Z., Andrew, T. L., & Ganesan, D. (2022) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3498361.3538931 · Cited by 6
MSNet: Multi-Resolution Synergistic Networks for Adaptive Inference
Hang, R., Qian, X., & Liu, Q. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3218891 · Cited by 6
Hierarchical neural network with efficient selection inference
Mi, J., Li, N., Huang, K.-Y., Li, W., & Zhou, L. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.02.015 · Cited by 6
Rethinking Online Knowledge Distillation with Multi-exits
Lee, H., & Lee, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-26351-4_25 · Cited by 6
FPT: Improving Prompt Tuning Efficiency via Progressive Training
Huang, Y., Qin, Y., Wang, H., Yin, Y., Sun, M., Liu, Z., & Liu, Q. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.511 · Cited by 6
A Study on the Energy Sustainability of Early Exit Networks for Human Activity Recognition
Lattanzi, E., Contoli, C., & Freschi, V. (2023) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2023.3303270 · Cited by 6
Branchy-TEE: Deep Learning Security Inference Acceleration Using Trusted Execution Environment
Wang, Y., Deng, K. Y., Meng, F., Chen, Z., Yin, M., & Yang, R. (2023) · Proceedings/Proceedings of the ... International Conference on Software Engineering and Knowledge Engineering · doi:10.18293/seke2023-131 · Cited by 6
Dynamic-HDC: A Two-Stage Dynamic Inference Framework for Brain-Inspired Hyperdimensional Computing
Chuang, Y.-C., Chang, C.-Y., & Wu, A.-Y. A. (2023) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2023.3328857 · Cited by 6
AI Workload Allocation Methods for Edge-Cloud Computing: A Review
Rafea, S. A., & Jasim, A. D. (2023) · Al-Iraqia Journal of Scientific Engineering Research · doi:10.58564/ijser.2.4.2023.125 · Cited by 6
Vision Transformer Computation and Resilience for Dynamic Inference
Sreedhar, K., Clemons, J., Venkatesan, R., Keckler, S. W., & Horowitz, M. (2024) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass61541.2024.00027 · Cited by 7
Triple-partition Network: Collaborative Neural Network based on the ‘End Device-Edge-Cloud’
Gao, Z., Miao, D., Zhao, L., Mo, Z., Qi, G., & Yan, L. (2021) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc49053.2021.9417243 · Cited by 6
Cloud-Edge Inference under Communication Constraints: Data Quantization and Early Exit
Gao, Y. Q., Wang, W., Wang, D., Wang, H., & Zhang, Z. (2022) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs56560.2022.9940360 · Cited by 6
Rohlfs, C. (2023) · Image and Vision Computing · doi:10.1016/j.imavis.2023.104696 · Cited by 6
Enabling Adaptive Intelligence in Cloud-Augmented Multiple Robots Systems
Zhang, S., Li, Y., Liu, B., Fu, S., & Liu, X. (2019) · IEEE International Symposium on Service-Oriented System Engineering (SOSE) · doi:10.1109/sose.2019.00057 · Cited by 6
Latency Guaranteed Edge Inference via Dynamic Compression Ratio Selection
Huang, X., & Zhou, S. (2020) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc45663.2020.9120768 · Cited by 6
SECS: Efficient Deep Stream Processing via Class Skew DichotomyPreprint
Feng, B., Wan, K., Yang, S., & Ding, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.06691 · Cited by 6
Orthogonalized SGD and Nested Architectures for Anytime Neural NetworksPreprint
Wan, C., Hoffmann, H., Lu, S., & Maire, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.06635 · Cited by 6
Class Means as an Early Exit Decision Mechanism.Preprint
Görmez, A., & Koyuncu, E. (2021) · arXiv (Cornell University) · Cited by 6
Synergy of Edge Intelligence and Blockchain: A Comprehensive SurveyPreprint
Wang, X., Ren, X., Qiu, C., Xiong, Z., Yao, H., & Leung, V. C. M. (2021) · doi:10.36227/techrxiv.14724360 · Cited by 6
PAUMER: Patch Pausing Transformer for Semantic SegmentationPreprint
Courdier, E., Sivaprasad, P. T., & Fleuret, F. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.00586 · Cited by 6
Omidsajedi, S. N., Reddy, R., Yi, J., Herbst, J., Lipps, C., & Schotten, H. D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.18264 · Cited by 6
Unlocking Visual Secrets: Inverting Features with Diffusion Priors for Image Reconstruction
Zhang, S. Q., Li, Z., Guo, C., Mahloujifar, S., Dangwal, D., Suh, G. E., DeSalvo, B., & Liu, C. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2412.10448 · Cited by 6
Early Stopping Tabular In-Context LearningPreprint
Küken, J., Purucker, L., & Hutter, F. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.21387 · Cited by 6
Fieback, L., Balar, N., Spiegelberg, J., & Gottschalk, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.12137 · Cited by 6
Dong, J., Jiang, J., Jiang, K., Li, J., & Zhang, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2502.21130 · Cited by 6
Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language ModelsPreprint
Yang, C.-Y., Lo, S.-Y., & Liu, Y.-L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.12412 · Cited by 6
Adaptive token selection for efficient detection transformer with dual teacher supervision
Yuan, M., Zhang, W., Yan, C., Gong, T., Zhang, Y., & Ying, J. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.112036 · Cited by 5
DistrEE: Distributed Early Exit of Deep Neural Network Inference on Edge Devices
Peng, X., Wu, X., Xu, L., Wang, L., & Fei, A. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901763 · Cited by 5
Kurian, T., & Thangam, S. (2025) · IEEE Access · doi:10.1109/access.2025.3572415 · Cited by 5
Huang, Z.-H., Lin, Y.-T., & Chen, H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130813 · Cited by 5
Liu, X., Zhang, L., Huang, W., Cheng, D., Wu, H., & Song, A. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113861 · Cited by 5
Robben, O., Khalilian, S., & Meratnia, N. (2025) · International Conference on Federated Learning Technologies and Applications (FLTA) · doi:10.1109/flta67013.2025.11336357 · Cited by 5
Adaptive Fault Resilience for Early-Exit DNNs
Kodamanchili, R. M., Cherezova, N., Taheri, M., & Jenihhin, M. (2025) · IEEE International Test Conference in Asia (ITC-Asia) · doi:10.1109/itc-asia67627.2025.00027 · Cited by 5
ReBoot: Encrypted Training of Deep Neural Networks with CKKS Bootstrapping
Pirillo, A., & Colombo, L. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i29.39670 · Cited by 5
CondNAS: Neural Architecture Search for Conditional CNNs
Park, G., & Yi, Y. (2022) · Electronics · doi:10.3390/electronics11071101 · Cited by 5
IMF: Integrating Matched Features Using Attentive Logit in Knowledge Distillation
Kim, J., Lee, H., & Woo, S. S. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/108 · Cited by 5
Partitioning multi-layer edge network for neural network collaborative computing
Li, Q., Zhou, M., Ren, T.-F., Jiang, C.-B., & Chen, Y. (2023) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-023-02284-x · Cited by 5
MTD: Multi-Timestep Detector for Delayed Streaming Perception
Huang, Y., & Chen, N. (2023) · Lecture notes in computer science · doi:10.1007/978-981-99-8435-0_27 · Cited by 5
Research on Deep Learning Model and Optimization Algorithm in Edge Computing
Liu, X., Zhang, Y., Wang, Z., & Yang, J. (2023) · International Conference on Applied Machine Learning (ICAML) · doi:10.1109/icaml60083.2023.00054 · Cited by 5
Dynamic image super-resolution via progressive contrastive self-distillation
Zhang, Z., Xie, Y., Zhang, C., Wang, Y., Qu, Y., Lin, S., Ma, L., & Tian, Q. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110502 · Cited by 5
Bring it On: Kinetic Energy Harvesting to Spark Machine Learning Computations in IoTs
Shukla, S., & Dinakarrao, S. M. P. (2024) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed60706.2024.10528702 · Cited by 5
Lin, J., Li, M., Zhang, S. Q., & Leon‐Garcia, A. (2024) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3673038.3673154 · Cited by 5
Priority-Aware Model-Distributed Inference at Edge Networks
Li, T., & Seferoğlu, H. (2025) · IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN) · doi:10.1109/icmlcn64995.2025.11140464 · Cited by 5
Distributed Inference on Mobile Edge and Cloud: An Early Exit Based Clustering Approach
Bajpai, D. J., & Hanawal, M. K. (2025) · International Conference on Communications · doi:10.1109/icc52391.2025.11161749 · Cited by 5
Inference Routing Over Multi-Hop Edge Networks
Xu, C., Liu, Y., & Yang, J. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3613490 · Cited by 5
AutoPath: Image-Specific Inference for 3D Segmentation
Sun, D., Wang, Y., Ni, D., & Wang, T. (2020) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2020.00049 · Cited by 5
Dynamic Multi-path Neural Network
Su, Y., Wu, Y., Chen, K., Liang, D., & Hu, X. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412836 · Cited by 5
A Safety Assurable Human-Inspired Perception Architecture
Salay, R., & Czarnecki, K. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14862-0_22 · Cited by 5
Implementation of Edge-cloud Cooperative CNN Inference on an IoT Platform
Wang, Y., Shibamura, H., Ng, K., & Inoue, K. (2022) · IEEE International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC) · doi:10.1109/mcsoc57363.2022.00060 · Cited by 5
Zouridakis, P., & Dinakarrao, S. M. P. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3313097 · Cited by 5
Fast and Accurate FSA System Using ELBERT: An Efficient and Lightweight BERT
Lu, S., Zhou, C., Xie, K., Lin, J., & Wang, Z. (2023) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2023.3322825 · Cited by 5
Adaptive Early-Exit Inference in Graph Neural Networks Based Hyperspectral Image Classification
Haseena Rahmath, P., & Chaurasia, K. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-64847-2_41 · Cited by 5
Habara, T., Sato, T. G., & Awano, H. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1420119 · Cited by 5
A stable and efficient dynamic ensemble method for pothole detection
Bekku, H., Kume, T., Tsuge, A., & Nakazawa, J. (2024) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2024.101973 · Cited by 5
Mitigating Hallucination Issues in Small-Parameter LLMs through Inter-Layer Contrastive Decoding
Li, F., zhang, X., & Zhang, P. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650644 · Cited by 5
FlexIR: Towards Flexible and Manipulable Image Restoration
Yin, Z., Lin, G., Hu, M., Zhang, H., & Zheng, Y. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3680825 · Cited by 5
Rahmani, A., & Ghatee, M. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107365 · Cited by 5
Enabling Collaborative and Green Generative AI Inference in Edge Networks
Tian, M., Liu, Z., Qiu, C., Wang, X., Niyato, D. T., & Leung, V. C. M. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901548 · Cited by 5
DyCE: Dynamically Configurable Exiting for deep learning compression and real-time scaling
Wang, Q., Cardiff, B., Frappé, A., Larras, B., & John, D. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107837 · Cited by 5
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.