DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Breakthroughs from the field of deep learning are radically changing how sensor data are interpreted to extract the high-level information needed by mobile apps. It is critical that the gains in inference accuracy that deep models afford become embedded in future generations of mobile apps. In this work, we present the design and implementation of DeepX, a software accelerator for deep learning execution. DeepX signif- icantly lowers the device resources (viz. memory, computation, energy) required by deep learning that currently act as a severe bottleneck to mobile adoption. The foundation of DeepX is a pair of resource control algorithms, designed for the inference stage of deep learning, that: (1) decompose monolithic deep model network architectures into unit- blocks of various types, that are then more efficiently executed by heterogeneous local device processors (e.g., GPUs, CPUs); and (2), perform principled resource scaling that adjusts the architecture of deep models to shape the overhead each unit-blocks introduces. Experiments show, DeepX can allow even large-scale deep learning models to execute efficently on modern mobile processors and significantly outperform existing solutions, such as cloud-based offloading.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The work in [205] introduces a software-based deep learning accelerator to support AI/DL training on mobile hardware.”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [205]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Simulation results demonstrates its superior performance in terms of low execution time and energy consumption in AI hardware running, compared to cloud offloading-based approaches.”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [205]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
(2006) · Springer eBooks · Cited by 8,123
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,149
Research works printed but not linked: 5
- zhizheng, 2015, Automatic Speaker Verification Spoofing and Countermeasures Challenge (ASVspoof 2015) Database, Centre for Speech Technology Research University of Edinburgh
- cplex, 2010, 12.2 User's Manual, IBM
- 10.1109/msp.2012.2205597 · DOI · Paper page
- bengio, 2015, Deep learning, MIT Press
- priyantha, 0, Enabling energy efficient continuous sensing on mobile nhones with littlerock, IPSN '10
Cited by
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455
“Model Compression • Weight pruning and quantization to reduce storage and computation [70]–[77]”
BackgroundMethodInfluentialDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“The work in [205] introduces a software-based deep learning accelerator to support AI/DL training on mobile hardware.”
MethodConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“, GPUs, CPUs) on the end device [154], 2) distributed edge nodes [155], [156], or 3) collaborative “end-edge-cloud” architecture [12], [49], [157], [158].”
BackgroundDeep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
6G Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., Niyato, D., Dobre, O., & Poor, H. V. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3103320 · Cited by 1,452
A Survey of Machine and Deep Learning Methods for Internet of Things (IoT) Security
Al-Garadi, M. A., Mohamed, A., Al-Ali, A. K., Du, X., Ali, I., & Guizani, M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988293 · Cited by 1,392
Network Intrusion Detection for IoT Security Based on Learning Techniques
Chaabouni, N., Mosbah, M., Zemmari, A., Sauvignac, C., & Faruki, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2896380 · Cited by 940
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances
Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022) · Sensors · doi:10.3390/s22041476 · Cited by 625
“[160] proposes a SOC-based architecture for optimizing deep neural network inference, while Lane et al.”
MethodEfficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436
“DeepX [284] uses SVD to compress layers to get compact network architecture.”
MethodDynamic Adaptive DNN Surgery for Inference Acceleration on the Edge
Hu, C., Bao, W., Wang, D., & Liu, F. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737614 · Cited by 416
“DeepX [23] explored the opportunities to use mobile GPUs to enable real-time deep learning inferences.”
BackgroundDistributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3218527 · Cited by 408
Machine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2022) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 402
UNPU: An Energy-Efficient Deep Neural Network Accelerator With Fully Variable Weight Bit Precision
Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2865489 · Cited by 335
Yadav, S. K., Tiwari, K., Pandey, H. M., & Akbar, S. A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106970 · Cited by 311
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Self-citationNestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision
Fang, B., Zeng, X., & Zhang, M. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241559 · Cited by 291
Multimodal Deep Learning for Activity and Context Recognition
Radu, V., Tong, C., Bhattacharya, S., Lane, N. D., Mascolo, C., Marina, M. K., & Kawsar, F. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3161174 · Cited by 281
“In fact, little multimodal study of this aspect of our work exists, although broad understanding of resource-limited deep learning is accelerating [4, 11, 26, 29, 37, 38, 59, 68] and we expect many existing results to extend to multimodal formulations, though this still remains to be verified.”
BackgroundSelf-citationEdge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 272
Edge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 256
He, Y., Guo, J., & Zheng, X. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2842228 · Cited by 255
Survey on Deep Neural Networks in Speech and Vision Systems
Alam, M., Samad, M. D., Vidyaratne, L., Glandon, A., & Iftekharuddin, K. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.053 · Cited by 252
End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey
Wang, Y., Yang, C., Lan, S., Zhu, L., & Zhang, Y. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3393230 · Cited by 237
Bhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236
Self-citationEdgeMoE: Empowering Sparse Large Language Models on Mobile Devices
Yi, R., Guo, L., Wei, S., Zhou, A., Wang, S., & Xu, M. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3546466 · Cited by 226
Squeezing Deep Learning into Mobile and Embedded Devices
Lane, N. D., Bhattacharya, S., Mathur, A., Georgiev, P., Forlivesi, C., & Kawsar, F. (2017) · IEEE Pervasive Computing · doi:10.1109/mprv.2017.2940968 · Cited by 224
Self-citationDigital Twin Reference Model Development to Prevent Operators’ Risk in Process Plants
Bevilacqua, M., Bottani, E., Ciarapica, F. E., Costantino, F., Di Donato, L., Ferraro, A., Mazzuto, G., Monteriù, A., Nardini, G., Ortenzi, M., et al. (2020) · Sustainability · doi:10.3390/su12031088 · Cited by 219
PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning
Niu, W., Ma, X., Lin, S., Wang, S., Qian, X., Lin, X., Wang, Y., & Ren, B. (2020) · Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3373376.3378534 · Cited by 216
Sudo RM -RF: Efficient Networks for Universal Audio Source Separation
Tzinis, E., Wang, Z., & Smaragdis, P. (2020) · Machine learning for signal processing ... · doi:10.1109/mlsp49062.2020.9231900 · Cited by 215
Liang, Y., Samtani, S., Guo, B., & Yu, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3004077 · Cited by 214
GAMMA: automating the HW mapping of DNN models on accelerators via genetic algorithm
Kao, S.-C., & Krishna, T. (2020) · doi:10.1145/3400302.3415639 · Cited by 212
Machine Learning in Real-Time Internet of Things (IoT) Systems: A Survey
Bian, J., Arafat, A. A., Xiong, H., Li, J., Li, L., Chen, H., Wang, J., Dou, D., & Guo, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3161050 · Cited by 201
Zhang, X., Cao, Z., & Dong, W. (2020) · IEEE Access · doi:10.1109/access.2020.3013005 · Cited by 200
Graph Neural Networks in IoT: A Survey
Dong, G., Tang, M., Wang, Z., Gao, J., Guo, S., Cai, L., Gutierrez, R., Campbel, B., Barnes, L. E., & Boukhechba, M. (2023) · ACM Transactions on Sensor Networks · doi:10.1145/3565973 · Cited by 196
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188
Not Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud
Wang, J., Zhang, J., Bao, W., Zhu, X., Cao, B., & Yu, P. S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220106 · Cited by 188
DeepCache: Principled Cache for Mobile Deep Vision
Xu, M., Zhu, M., Liu, Y., Lin, F. X., & Liu, X. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241563 · Cited by 185
A First Look at Deep Learning Apps on Smartphones
Xu, M., Liu, J., Liu, Y., Lin, F. X., Liu, Y., & Liu, X. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313591 · Cited by 182
An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and Applications
Ajani, T. S., Imoize, A. L., & Atayero, A. A. (2021) · Sensors · doi:10.3390/s21134412 · Cited by 176
Efficient Live Migration of Edge Services Leveraging Container Layered Storage
Ma, L., Yi, S., Carter, N., & Li, Q. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2871842 · Cited by 175
“Several computation offloading schemes frommobile devices to edge servers have been investigated [13], [14], [15], [16].”
BackgroundFast On-device LLM Inference with NPUs
Xu, D., Zhang, H., Yang, L., Liu, R., Huang, G., Xu, M., & Liu, X. (2025) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3669940.3707239 · Cited by 175
AI augmented Edge and Fog computing: Trends and challenges
Tuli, S., Mirhakimi, F., Pallewatta, S., Zawad, S., Casale, G., Javadi, B., Yan, F., Buyya, R., & Jennings, N. R. (2023) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2023.103648 · Cited by 172
Yadav, S. P., Zaidi, S., Mishra, A., & Yadav, V. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09647-x · Cited by 169
Recurrent Neural Networks: An Embedded Computing Perspective
Rezk, N. M., Purnaprajna, M., Nordström, T., & Ul-Abdin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2982416 · Cited by 168
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160
“In [32], [33], Lane et al. first explored the feasibility of running deep neural networks on mobile devices for audio-sensing applications.”
BackgroundDeep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions
Chen, Y., Zheng, B., Zhang, Z., Wang, Q., Shen, C., & Zhang, Q. (2021) · ACM Computing Surveys · doi:10.1145/3398209 · Cited by 159
“DeepX [94] is the first software-based deep learning accelerator that takes an essential first step towards mobile deep learning.”
Automated ASD detection using hybrid deep lightweight features extracted from EEG signals
Baygin, M., Dogan, S., Tuncer, T., Datta Barua, P., Faust, O., Arunkumar, N., Abdulhay, E. W., Emma Palmer, E., & Rajendra Acharya, U. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104548 · Cited by 158
High-Throughput CNN Inference on Embedded ARM Big.LITTLE Multicore Processors
Wang, S., Ananthanarayanan, G., Zeng, Y., Goel, N., Pathania, A., & Mitra, T. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2019.2944584 · Cited by 158
Edge Intelligence: A Review of Deep Neural Network Inference in Resource-Limited Environments
Ngo, D., Park, H.-C., & Kang, B. (2025) · Electronics · doi:10.3390/electronics14122495 · Cited by 151
ConfuciuX: Autonomous Hardware Resource Assignment for DNN Accelerators using Reinforcement Learning
Kao, S.-C., Jeong, G., & Krishna, T. (2020) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro50266.2020.00058 · Cited by 150
TensorRT-Based Framework and Optimization Methodology for Deep Learning Inference on Jetson Boards
Jeong, E., Kim, J., & Ha, S. (2022) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3508391 · Cited by 150
Cachier: Edge-Caching for Recognition Applications
Drolia, U., Guo, K., Tan, J., Gandhi, R., & Narasimhan, P. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.94 · Cited by 148
Zhang, R., Liu, G., Liu, Y., Zhao, C., Wang, J., Xu, Y., Niyato, D. T., Kang, J., Li, Y., Mao, S., et al. (2026) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2026.3651702 · Cited by 148
AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learning
Kim, Y. G., & Wu, C.-J. (2021) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3466752.3480129 · Cited by 142
DeepWear: Adaptive Local Offloading for On-Wearable Deep Learning
Xu, M., Qian, F., Zhu, M., Huang, F., Pushp, S., & Liu, X. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2893250 · Cited by 138
“However, DeepX only distributes partitioned submodels onto different local processors while DeepWear performs collaborative DL inference on two devices and thus needs to take into consideration the data transfer overhead and many other external factors that play important roles in making off-loading decisions.”
BackgroundMethodInfluentialFlexible high-resolution object detection on edge devices with tunable latency
Jiang, S., Lin, Z., Li, Y., Shu, Y., & Liu, Y. (2021) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3447993.3483274 · Cited by 137
Wu, J., Wang, Y., Wu, Z., Wang, Z., Veeraraghavan, A., & Lin, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09228 · Cited by 137
Meta-HAR: Federated Representation Learning for Human Activity Recognition
Li, C., Niu, D., Jiang, B., Zuo, X., & Yang, J. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450006 · Cited by 133
In-Situ AI: Towards Autonomous and Incremental Deep Learning for IoT Systems
Song, M., Zhong, K., Zhang, J., Hu, Y., Liu, D., Zhang, W., Wang, J., & Li, T. (2018) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00018 · Cited by 131
Latency and throughput characterization of convolutional neural networks for mobile computer vision
Hanhirova, J., Kämäräinen, T., Seppälä, S., Siekkinen, M., Hirvisalo, V., & Ylä-Jääski, A. (2018) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3204949.3204975 · Cited by 130
Frugal following: power thrifty object detection and tracking for mobile augmented reality
Apicharttrisorn, K., Ran, X., Chen, J., Krishnamurthy, S. V., & Roy–Chowdhury, A. K. (2019) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3356250.3360044 · Cited by 125
Artificial Intelligence of Things: A Survey
Siam, M. S. I., Ahn, H., Liu, L., Alam, S., Shen, H., Cao, Z., Shroff, N. B., Krishnamachari, B., Srivastava, M. B., & Zhang, M. (2024) · ACM Transactions on Sensor Networks · doi:10.1145/3690639 · Cited by 123
CoDL: efficient CPU-GPU co-execution for deep learning inference on mobile devices
Jia, F., Zhang, D., Cao, T., Jiang, S., Liu, Y., Ren, J., & Zhang, Y. (2022) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3498361.3538932 · Cited by 121
Edge Intelligence: Architectures, Challenges, and Applications
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 120
Push the Limit of Acoustic Gesture Recognition
Wang, Y., Shen, J., & Zheng, Y. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3032278 · Cited by 117
Dou, F., Ye, J., Yuan, G., Lu, Q., Niu, W., Sun, H., Guan, L., Lu, G., Mai, G., Liu, N., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.07438 · Cited by 117
MEC: Memory-efficient Convolution for Deep Neural NetworkPreprint
Cho, M., & Brand, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06873 · Cited by 116
A survey on deploying mobile deep learning applications: A systemic and technical perspective
Wang, Y., Wang, J., Zhang, W., Zhan, Y., Guo, S., Zheng, Q., & Wang, X. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.06.001 · Cited by 110
Federated Self-Supervised Learning of Multisensor Representations for Embedded Intelligence
Saeed, A., Salim, F. D., Ozcelebi, T., & Lukkien, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3009358 · Cited by 106
Elsisi, M., Amer, M., Dababat, A., & Su, C. (2023) · Energy · doi:10.1016/j.energy.2023.128256 · Cited by 106
AI on the edge: a comprehensive review
Su, W., Li, L., Liu, F., He, M., & Liang, X. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10141-4 · Cited by 105
Matsubara, Y., Callegaro, D., Baidya, S., Levorato, M., & Singh, S. (2020) · IEEE Access · doi:10.1109/access.2020.3039714 · Cited by 104
Deep Learning Inference Parallelization on Heterogeneous Processors With TensorRT
Jeong, E., Kim, J., Tan, S., Lee, J., & Ha, S. (2021) · IEEE Embedded Systems Letters · doi:10.1109/les.2021.3087707 · Cited by 103
Soft errors in DNN accelerators: A comprehensive review
Ibrahim, Y., Wang, H., Liu, J., Wei, J., Chen, L., Rech, P., Adam, K., & Guo, G. (2020) · Microelectronics Reliability · doi:10.1016/j.microrel.2020.113969 · Cited by 102
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01942 · Cited by 102
Adaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · ACM SIGPLAN Notices · doi:10.1145/3299710.3211336 · Cited by 102
LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
Kang, W., Lee, K., Lee, J., Shin, I., & Chwa, H. S. (2021) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss52674.2021.00038 · Cited by 100
Towards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices
Zhang, S., Li, Y., Liu, X., Guo, S., Wang, W., Wang, J., Ding, B., & Wu, D. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397315 · Cited by 99
Enforcing security in Internet of Things frameworks: A Systematic Literature Review
Aly, M., Khomh, F., Haoues, M., Quintero, A., & Yacout, S. (2019) · Internet of Things · doi:10.1016/j.iot.2019.100050 · Cited by 98
Mobile Foundation Model as Firmware
Yuan, J., Yang, C., Cai, D., Wang, S., Yuan, X., Zhang, Z., Li, X., Zhang, D., Mei, H., Jia, X., et al. (2024) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3636534.3649361 · Cited by 96
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search
Zhan, Z., Gong, Y., Zhao, P., Yuan, G., Niu, W., Wu, Y., Zhang, T., Jayaweera, M., Kaeli, D. R., Ren, B., et al. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00478 · Cited by 95
Li, D., Tasci, S., Ghosh, S., Zhu, J., Zhang, J., & Heck, L. (2019) · Proceedings of the 4th ACM/IEEE Symposium on Edge Computing · doi:10.1145/3318216.3363317 · Cited by 94
MobiSR: Efficient On-Device Super-Resolution through Heterogeneous Mobile Processors
Lee, R., Venieris, S. I., Dudziak, Ł., Bhattacharya, S., & Lane, N. D. (2019) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3300061.3345455 · Cited by 94
Self-citationHirtzlin, T., Bocquet, M., Penkovsky, B., Klein, J.-O., Nowak, E., Vianello, E., Portal, J.-M., & Querlioz, D. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.01383 · Cited by 93
“For example, Lane et al. (2016) analyses the energy consumption of inference on CPUs and GPUs: operating a fully connected neural network with two hidden layers of 1,000 neurons requires 7 to 100 millijoules on a low-power CPU (from NVIDIA Tegra K1 or Qualcomm Snapdragon 800 systems on the chip)…”
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design
Cai, Y., Li, H., Yuan, G., Niu, W., Li, Y., Tang, X., Ren, B., & Wang, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16179 · Cited by 93
Zhao, T., Xie, Y., Wang, Y., Cheng, J., Guo, X., Hu, B., & Chen, Y. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3153408 · Cited by 92
Push the Limit of Acoustic Gesture Recognition
Wang, Y., Shen, J., & Zheng, Y. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155402 · Cited by 91
Presotto, R., Civitarese, G., & Bettini, C. (2022) · Personal and Ubiquitous Computing · doi:10.1007/s00779-022-01688-8 · Cited by 91
Adaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems · doi:10.1145/3211332.3211336 · Cited by 90
Optimal Model Placement and Online Model Splitting for Device-Edge Co-Inference
Yan, J., Bi, S., & Zhang, Y. A. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3165824 · Cited by 88
Deep learning for compressive sensing: a ubiquitous systems perspective
Machidon, A. L., & Pejović, V. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10259-5 · Cited by 87
SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget
Kong, R., Li, Y., Feng, Q., Wang, W., Ye, X., Ouyang, Y., Kong, L., & Liu, Y. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.363 · Cited by 86
A Survey of Deep Learning on CPUs: Opportunities and Co-Optimizations
Mittal, S., Rajput, P., & Subramoney, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3071762 · Cited by 85
Efficient Deep Learning Approaches for Health Informatics
Navamani, T. M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-816718-2.00014-2 · Cited by 84
A RR interval based automated apnea detection approach using residual network
Wang, L., Lin, Y., & Wang, J. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.05.002 · Cited by 82
Towards Device-Agnostic Mobile Cough Detection with Convolutional Neural Networks
Barata, F., Kipfer, K., Weber, M., Tinschert, P., Fleisch, E., & Kowatsch, T. (2019) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2019.8904554 · Cited by 81
Integration of federated learning with IoT for smart cities applications, challenges, and solutions
Ghadi, Y. Y., Mazhar, T., Shah, S. F. A., Haq, I., Ahmad, W., Ouahada, K., & Hamam, H. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1657 · Cited by 79
Pervasive Agriculture: IoT-Enabled Greenhouse for Plant Growth Control
Somov, A., Shadrin, D., Fastovets, I., Nikitin, A., Matveev, S., seledets, I., & Hrinchuk, O. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.2873849 · Cited by 78
ApNet: Approximation-Aware Real-Time Neural Network
Bateni, S., & Liu, C. (2018) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss.2018.00017 · Cited by 77
Metadata
- Authors
- Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F.
- Affiliations
- Bell (Canada) (CA)
- University of Cambridge (GB)
- University of Bologna (IT)
- Venue
- 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)
- Publisher
- IEEE
- Published
- 2016-04
- Pages
- 1-12
- OpenAlex
- W4236853429
- Cited by
- 450
- References
- 34
- Citations by year
- 2026: 47 · 2025: 40 · 2024: 30 · 2023: 39 · 2022: 55 · 2021: 62 · 2020: 74 · 2019: 52 · 2018: 32 · 2017: 15 · 2016: 4
- FWCI
- 26.45
- Type
- conference paper
- Language
- en
- Open access
- Locations
- ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) (publishedVersion)
- Apollo (University of Cambridge) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Apollo
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Keywords
- deep learning inference, mobile devices, low-power inference, model decomposition, heterogeneous processors, energy efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.