BranchyNet: Fast inference via early exiting from deep neural networks
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Deep neural networks are state of the art methods for many learning tasks due to their ability to extract increasingly better features at each network layer. However, the improved performance of additional layers in a deep network comes at the cost of added latency and energy usage in feedforward inference. As networks continue to get deeper and larger, these costs become more prohibitive for real-time and energy-sensitive applications. To address this issue, we present BranchyNet, a novel deep network architecture that is augmented with additional side branch classifiers. The architecture allows prediction results for a large portion of test samples to exit the network early via these branches when samples can already be inferred with high confidence. BranchyNet exploits the observation that features learned at an early layer of a network may often be sufficient for the classification of many data points. For more difficult samples, which are expected less frequently, BranchyNet will use further or all network layers to provide the best likelihood of correct prediction. We study the BranchyNet architecture using several well-known networks (LeNet, AlexNet, ResNet) and datasets (MNIST, CIFAR10) and show that it can both improve accuracy and significantly reduce the inference time of the network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In contrast, EE-ensemble method employs only half as many exits (only EEs) compared to QUTE, and the EE's regularization effect helps network accuracy (Teerapittayanon et al., 2016).”
From QUTE: Quantifying Uncertainty in TinyML with Early-exit-assisted ensembles for model-monitoring (2024) · cites this paper as Teerapittayanon et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
(2010) · Cited by 14,134
Cited by
Items 401–500 of 1,000
Wang, Q., Wang, K., Li, Q. '., Yang, Z., Jin, G., & Hong, W. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3017686 · Cited by 23
ICNN: The Iterative Convolutional Neural Network
Neshatpour, K., Homayoun, H., & Sasan, A. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3355553 · Cited by 23
Accelerating Inference in Large Language Models with a Unified Layer Skipping StrategyPreprint
Liu, Y., Meng, F., & Zhou, J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.06954 · Cited by 23
Fast and Cost-effective Speculative Edge-Cloud Decoding with Early Exits
Venkatesha, Y., Kundu, S., & Panda, P. (2025) · Transactions on machine learning research · doi:10.48550/arxiv.2505.21594 · Cited by 23
Dělen: Enabling Flexible and Adaptive Model-serving for Multi-tenant Edge AI
Liang, Q., Hanafy, W. A., Bashir, N., Ali-Eldin, A., Irwin, D., & Shenoy, P. J. (2023) · IEEE/ACM International Conference on Internet-of-Things Design and Implementation (IoTDI) · doi:10.1145/3576842.3582375 · Cited by 22
Knowing When to Stop: Delay-Adaptive Spiking Neural Network Classifiers With Reliability Guarantees
Chen, J., Park, S., & Simeone, O. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3431996 · Cited by 22
CeeBERT: Cross-Domain Inference in Early Exit BERT
Bajpai, D. J., & Hanawal, M. K. (2024) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2024.findings-acl.101 · Cited by 22
Generalization in multi-objective machine learning
Súkeník, P., & Lampert, J. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10616-1 · Cited by 22
Local Critic Training for Model-Parallel Learning of Deep Neural Networks
Lee, H., Hsieh, C., & Lee, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3057380 · Cited by 22
DMS: Dynamic Model Scaling for Quality-Aware Deep Learning Inference in Mobile and Embedded Devices
Kang, W., Kim, D.-Y., & Park, J. (2019) · IEEE Access · doi:10.1109/access.2019.2954546 · Cited by 22
AnytimeNet: Controlling Time-Quality Tradeoffs in Deep Neural Network Architectures
Kim, J.-E., Bradford, R. M., & Shao, Z. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116280 · Cited by 22
Budget RNNs: Multi-Capacity Neural Networks to Improve In-Sensor Inference Under Energy Budgets
Kannan, T., & Hoffmann, H. (2021) · IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) · doi:10.1109/rtas52030.2021.00020 · Cited by 22
Artificial intelligence in edge devices
Singh, A., Saini, K., Nagar, V., Aseri, V., Sankhla, M. S., Pandit, P. P., & Chopade, R. L. (2022) · Advances in computers · doi:10.1016/bs.adcom.2022.02.013 · Cited by 22
EREBA: black-box energy testing of adaptive neural networks
Haque, M., Yadlapalli, Y., Yang, W. M., & Liu, C. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510088 · Cited by 22
Combining DNN partitioning and early exit
Ebrahimi, M., Veith, A. D. S., Gabel, M., & de Lara, E. (2022) · International Workshop on Edge Systems, Analytics and Networking (EdgeSys) · doi:10.1145/3517206.3526270 · Cited by 22
Zheng, Y., Zhang, T., Mu, X., Liu, Y., & Huang, R. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2025.3568870 · Cited by 21
DyDiT++: Diffusion Transformers With Timestep and Spatial Dynamics for Efficient Visual Generation
Zhao, W., Han, Y., Tang, J., Wang, K., Luo, H., Song, Y., Huang, G. M., Wang, F., & You, Y. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3654201 · Cited by 21
Temporal Early Exiting for Streaming Speech Commands Recognition
Tang, R., Kumar, K., Xin, J., Vyas, P., Li, W., Yang, G., Mao, Y., Murray, C., & Lin, J. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746863 · Cited by 21
Zhang, P., Huang, F., Wu, D., Yang, B., Yang, Z., & Tan, L. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3240884 · Cited by 21
LoCoExNet: Low-Cost Early Exit Network for Energy Efficient CNN Accelerator Design
Jo, J., Kim, G., Kim, S., & Park, J. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3282579 · Cited by 21
DyCL: Dynamic Neural Network Compilation Via Program Rewriting and Graph Optimization
Chen, S., Wei, S., Liu, C., & Yang, W. P. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3598082 · Cited by 21
Private Inference for Deep Neural Networks: A Secure, Adaptive, and Efficient Realization
Cheng, K., Xi, N., Liu, X., Zhu, X., Gao, H., Zhang, Z., & Shen, Y. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3305754 · Cited by 21
Modularity in Deep Learning: A Survey
Sun, H., & Guyon, I. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-37963-5_40 · Cited by 21
Resource-Efficient DNN Inference With Early Exiting in Serverless Edge Computing
Guo, X., Dong, F., Shen, D., Huang, Z., & Zhang, J. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3514993 · Cited by 21
Learning motion blur robust vision transformers for real-time UAV tracking
Wu, Y., Wang, X., Zeng, D., Ye, H., Xie, X., Zhao, Q., & Li, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129445 · Cited by 21
Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flows
Yoo, G. R., & Owhadi, H. (2021) · Physica D Nonlinear Phenomena · doi:10.1016/j.physd.2021.132952 · Cited by 21
A Throughput-Latency Co-Optimised Cascade of Convolutional Neural Network Classifiers
Kouris, A., Venieris, S. I., & Bouganis, C.-S. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116248 · Cited by 21
An Integrated Cloud-Edge-Device Adaptive Deep Learning Service for Cross-Platform Web
Huang, Y., Qiao, X., Tang, J., Ren, P., Liu, L., Pu, C., & Chen, J. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3122279 · Cited by 21
Entropy-based Stability-Plasticity for Lifelong Learning
Araujo, V., Hurtado, J., Soto, Á., & Moens, M. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00416 · Cited by 21
Learning Instance and Task-Aware Dynamic Kernels for Few-Shot Learning
Ma, R., Fang, P., Avraham, G., Zuo, Y., Zhu, T., Drummond, T. W., & Harandi, M. T. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20044-1_15 · Cited by 21
Architecting Efficient Multi-modal AIoT Systems
Hou, X., Liu, J., Tang, X., Li, C., Chen, J., Liang, L., Cheng, K.-T. T., & Guo, M. (2023) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3579371.3589066 · Cited by 21
Magic Pyramid: Accelerating Inference with Early Exiting and Token PruningPreprint
He, X., Keivanloo, I., Xu, Y. T., He, X., Zeng, B., Rajagopalan, S., & Chilimbi, T. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00230 · Cited by 21
Spike-Based Anytime Perception
Dutson, M., Li, Y., & Gupta, M. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00526 · Cited by 20
He, J., Li, K., Zang, Y., Fu, H., Fu, Q., Xing, J., & Cheng, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29129 · Cited by 20
Resource-aware Deployment of Dynamic DNNs over Multi-tiered Interconnected Systems
Singhal, C., Wu, Y., Malandrino, F., Levorato, M., & Chiasserini, C. F. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621218 · Cited by 20
Optimization of Offloading Policies for Accuracy-Delay Tradeoffs in Hierarchical Inference
Beytur, H. B., Aydin, A. G., Veciana, G. A. D., & Vikalo, H. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621325 · Cited by 20
Rauch, R., Bečvář, Z., Mach, P., & Gazda, J. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3520637 · Cited by 20
PALBERT: Teaching ALBERT to Ponder
Balagansky, N., & Gavrilov, D. (2022) · neural information processing systems · doi:10.52202/068431-1018 · Cited by 20
Towards Inference Delivery Networks: Distributing Machine Learning with Optimality Guarantees
Salem, T. S., Castellano, G., Neglia, G., Pianese, F., & Araldo, A. (2021) · Mediterranean Communication and Computer Networking Conference (MedComNet) · doi:10.1109/medcomnet52149.2021.9501272 · Cited by 20
Context-Aware Convolutional Neural Network over Distributed System in Collaborative Computing
Choi, J., Hakimi, Z., Shin, P. W., Sampson, J., & Narayanan, V. (2019) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3316781.3317792 · Cited by 20
Privacy Vulnerability of Split Computing to Data-Free Model Inversion AttacksPreprint
Dong, X., Yin, H., Álvarez, J. M., Kautz, J., Molchanov, P. A., & Kung, H. T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06304 · Cited by 20
Self-citationAISYN: AI-driven Reinforcement Learning-Based Logic Synthesis FrameworkPreprint
Pasandi, G., Pratty, S., & Forsyth, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.06415 · Cited by 20
Estimating Machine Translation Difficulty
Proietti, L., Perrella, S., Zouhar, V., Navigli, R., & Kocmi, T. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.1317 · Cited by 19
Enabling Inference and Training of Deep Learning Models for AI Applications on IoT Edge Devices
Sharma, D., & Sarkar, S. (2022) · Internet of things · doi:10.1007/978-3-030-87059-1_10 · Cited by 19
Towards scalable and efficient Deep-RL in edge computing: A game-based partition approach
Dai, H., Wu, J., Wang, Y., & Xu, C. (2022) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2022.06.006 · Cited by 19
Uncertainty Quantification in Machine Learning for Biosignal Applications - A Review
de Jong, I. P., Sburlea, A. I., & Valdenegro-Toro, M. (2026) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-026-00249-5 · Cited by 20
Multi-Modal Data and Model Reduction for Enabling Edge Fusion in Connected Vehicle Environments
Thornton, S., & Dey, S. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3378182 · Cited by 19
I-SplitEE: Image Classification in Split Computing DNNs with Early Exits
Bajpai, D. J., Jaiswal, A. S., & Hanawal, M. K. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622954 · Cited by 19
Dai, S., Luo, Z., Luo, W., Wang, S., Dai, C., Guo, B., & Zhou, X. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3482288 · Cited by 19
COMSPLIT: A Communication-Aware Split Learning Design for Heterogeneous IoT Platforms
Ninković, V., Vukobratović, D., Mišković, D., & Zennaro, M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3487246 · Cited by 19
Securing Multi-turn Conversational Language Models From Distributed Backdoor Attacks
Tong, T., Liu, Q., Xu, J., & Chen, M. (2024) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2024.findings-emnlp.750 · Cited by 19
Hanif, M. A., Chattopadhyay, N., Ouni, B., & Shafique, M. (2025) · IEEE Access · doi:10.1109/access.2025.3571995 · Cited by 19
Gatekeeper: Improving Model Cascades Through Confidence Tuning
Rabanser, S., Rauschmayr, N., Kulshrestha, A., Poklukar, P., Jitkrittum, W., Augenstein, S., Wang, C., & Tombari, F. (2025) · neural information processing systems · doi:10.52202/085713-0656 · Cited by 19
TargetFinder: A Privacy Preserving System for Locating Targets through IoT Cameras
Khazbak, Y., Qiu, J., Tan, T., & Cao, G. (2020) · ACM Transactions on Internet of Things · doi:10.1145/3375878 · Cited by 19
Cost-effective land cover classification for remote sensing images
Li, D., Wang, S., He, Q., & Yang, Y. J. (2022) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-022-00335-0 · Cited by 19
Adaptive and Collaborative Edge Inference in Task Stream with Latency Constraint
Song, J., Liu, Z., Wang, X., Qiu, C., & Chen, X. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500892 · Cited by 19
Boosting Mobile CNN Inference through Semantic Memory
Li, Y., Zhang, C., Han, S., Zhang, L. L., Yin, B., Liu, Y., & Xu, M. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475399 · Cited by 19
An Adaptive Device-Edge Co-Inference Framework Based on Soft Actor-Critic
Niu, T., Teng, Y., Han, Z., & Zou, P. (2022) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc51071.2022.9771550 · Cited by 19
PICO: Pipeline Inference Framework for Versatile CNNs on Diverse Mobile Devices
Yang, X., Xu, Z., Qi, Q., Wang, J., Sun, H., Liao, J., & Guo, S. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3265111 · Cited by 19
Getting the Best Out of Both Worlds: Algorithms for Hierarchical Inference at the Edge
Moothedath, V. N., Champati, J. P., & Gross, J. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3366501 · Cited by 19
Neshatpour, K., Behnia, F., Homayoun, H., & Sasan, A. (2019) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2019.8697497 · Cited by 19
Dynamic Domain Adaptation for Efficient Inference
Li, S., Zhang, J., Ma, W., Liu, C. H., & Li, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00774 · Cited by 19
Anytime Neural Prediction via Slicing Networks VerticallyPreprint
Lee, H., & Shin, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02609 · Cited by 19
Cascadia: An Efficient Cascade Serving System for Large Language ModelsPreprint
Jiang, Y., Fu, F., Zhao, W., Rabanser, S., Zhang, J., Lane, N. D., & Yuan, B. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.04203 · Cited by 19
Edge ai: leveraging the full potential of deep learning
Shuvo, M. M. H. (2022) · Studies in Computational Intelligence · doi:10.1007/978-3-031-14748-7_2 · Cited by 18
Designing Efficient DNNs via Hardware-Aware Neural Architecture Search and Beyond
Luo, X., Liu, D., Huai, S., Kong, H., Chen, H., & Liu, W. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3100249 · Cited by 18
Preva: Protecting Inference Privacy through Policy-based Video-frame Transformation
Lu, R., Shi, S., Wang, D., Hu, C., & Zhang, B. (2022) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec54971.2022.00021 · Cited by 18
T-RecX: Tiny-Resource Efficient Convolutional neural networks with early-eXit
Ghanathe, N. P., & Wilton, S. J. E. (2023) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/3587135.3592204 · Cited by 18
Hu, D., Wu, S., Wang, J., & Shi, D. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3339975 · Cited by 18
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
Venkatesh, S., Marinescu, R. V., & Eshraghian, J. K. (2024) · Neuro Inspired Computational Elements Conference (NICE) · doi:10.1109/nice61972.2024.10549198 · Cited by 18
Optimal Branch Location for Cost-effective Inference on Branchynet
Chiang, C.-H., Liu, P., Wang, D., Hong, D., & Wu, J. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671948 · Cited by 18
AdaEE: Adaptive Early-Exit DNN Inference Through Multi-Armed Bandits
Pacheco, R. G., Shifrin, M., Couto, R. S., Menasché, D. S., Hanawal, M. K., & Campista, M. E. M. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10279243 · Cited by 18
Towards Efficient Coarse-to-Fine Networks for Action and Gesture Recognition
Quader, N., Lu, J., Dai, P., & Li, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58577-8_3 · Cited by 18
Cloud–edge cooperation for meteorological radar big data: a review of data quality control
Hu, Z., Xu, X., Zhang, Y., Tang, H., Cheng, Y., Qian, C., & Khosravi, M. R. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00581-w · Cited by 18
DyFiP: explainable AI-based dynamic filter pruning of convolutional neural networks
Sabih, M., Hannig, F., & Teich, J. (2022) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3517207.3526982 · Cited by 18
Any-Precision Deep Neural NetworksPreprint
Yu, H., Li, H., Shi, H., Huang, T. S., & Hua, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07346 · Cited by 18
Memory-efficient Energy-adaptive Inference of Pre-Trained Models on Batteryless Embedded SystemsPreprint
Farina, P., Biswas, M., Yıldız, E., Akhunov, K., Ahmed, S., Islam, B., & Yıldırım, K. S. (2024) · arXiv (Cornell University) · doi:10.3217/tyv7-yh17 · Cited by 18
Sparse Layers are Critical to Scaling Looped Language ModelsPreprint
Lee, R., Biloki, J., Hu, J. E., & May, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.09165 · Cited by 18
Wang, Q., Yu, C., Chen, S., Fang, W. W., & Xiong, N. N. (2025) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020093 · Cited by 17
DPNet: Dynamic Pooling Network for Accurate and Efficient Size-Aware Tiny Object Detection
Gong, L., Chen, H., Chen, Y., Yao, T., Li, C., Zhao, S., & Han, G. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3559921 · Cited by 18
Huang, Y., Qiao, X., Ren, P., Liu, L., Pu, C., & Chen, J. (2019) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00149 · Cited by 17
Henna, S., & Davy, A. (2020) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2020.2978846 · Cited by 17
Edge Intelligence: Challenges and Opportunities
Hu, H., & Jiang, C. (2020) · International Conference on Computer, Information and Telecommunication Systems · doi:10.1109/cits49457.2020.9232575 · Cited by 17
Model Optimization Method Based on Vertical Federated Learning
Yang, K., Song, Z., Zhang, Y., Zhou, Y., Sun, X., & Wang, J. (2021) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas51556.2021.9401521 · Cited by 17
A Calibrated Multiexit Neural Network for Detecting Urothelial Cancer Cells
Lilli, L., Giarnieri, E., & Scardapane, S. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/5569458 · Cited by 17
Empowering Adaptive Early-Exit Inference with Latency Awareness
Tan, X., Li, H., Wang, L., Huang, X., & Xu, Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17181 · Cited by 17
HAR: Hardness Aware Reweighting for Imbalanced Datasets
Duggal, R., Freitas, S., Dhamnani, S., Chau, D. H., & Sun, J. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671807 · Cited by 17
Li, Y., Wu, Y., Zhang, X., Hu, J., & Lee, I. (2022) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2022.3171308 · Cited by 17
Wang, Q., Fang, W. W., & Xiong, N. N. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3293506 · Cited by 17
Cascade-Aware Training of Language ModelsPreprint
Wang, C., Augenstein, S., Rush, K., Jitkrittum, W., Narasimhan, H., Rawat, A. S., Menon, A. K., & Go, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.00060 · Cited by 17
Niu, C., Ding, Y., Lu, J., Huang, Z., Zeng, H., Dai, Y., Tu, X., Lv, C., Wu, F., & Chen, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.15300 · Cited by 17
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
Gema, A. P., Jin, C., Abdulaal, A., Diethe, T., Teare, P., Alex, B., Minervini, P., & Saseendran, A. (2025) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2025.findings-emnlp.531 · Cited by 16
Lightweight Edge-Cloud Cooperative Inference for Small and Medium Models under WAN Constraints
Liao, J., Chang, F., Xia, T., Huang, Z., Huang, X., & Zhou, Y. (2026) · International Conference on Electronic Information Engineering, Big Data and Computer Technology (EIBDCT) · doi:10.1109/eibdct69742.2026.11566691 · Cited by 16
Ding, Y., Fang, W. W., Liu, M., Wang, M., Cheng, Y., & Xiong, N. N. (2022) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2022.11.008 · Cited by 16
Hydra: Hybrid-model federated learning for human activity recognition on heterogeneous devices
Wang, P., Ouyang, T., Wu, Q., Huang, Q., Gong, J., & Chen, X. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.103052 · Cited by 16
Inference serving with end-to-end latency SLOs over dynamic edge networks
Nigade, V., Bauszat, P., Bal, H. E., & Wang, L. (2024) · Real-Time Systems · doi:10.1007/s11241-024-09418-4 · Cited by 16
Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator
Cao, Z., Cheng, Y., Zhou, Z., Chen, Y., Hu, Y., Lu, A., Liu, J., & Li, Z. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3474743 · Cited by 16
Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical
Behera, A. P., Daubaris, P., Bravo, I., Gallego, J., Morabito, R., Widmer, J., & Champati, J. P. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3583477 · Cited by 16
Towards Efficient Inference: Adaptively Cooperate in Heterogeneous IoT Edge Cluster
Yang, X., Qi, Q., Wang, J., Guo, S., & Liao, J. (2021) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00011 · Cited by 16
Kim, N., Park, H., Lee, D., Kang, S.-B., Lee, J., & Choi, K. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3092205 · Cited by 16
Metadata
- Authors
- Teerapittayanon, S., McDanel, B., & Kung, H. T.
- Affiliations
- Harvard University (US)
- Venue
- 2016 23rd International Conference on Pattern Recognition (ICPR)
- Publisher
- IEEE
- Published
- 2016-12
- Pages
- 2464-2469
- ISSN
- 1041-3278 (ISSN-L)
- OpenAlex
- W2962677625
- Cited by
- 1,326
- References
- 27
- Citations by year
- 2026: 182 · 2025: 195 · 2024: 184 · 2023: 219 · 2022: 160 · 2021: 161 · 2020: 119 · 2019: 69 · 2018: 23 · 2017: 12 · 2016: 2
- FWCI
- 12.26
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition (publishedVersion)
- Funders
- Intel Corporation
- Nvidia
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- early exit, inference acceleration, deep learning architectures, inference latency reduction, energy-efficient inference, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.