Deep Learning With Edge Computing: A Review
The DOI matches its Crossref record; 129 of the 141 references it cites were found in a registry or an index.
Abstract
Deep learning is currently widely used in a variety of applications, including computer vision and natural language processing. End devices, such as smartphones and Internet-of-Things sensors, are generating data that need to be analyzed in real time using deep learning or used to train deep learning models. However, deep learning inference and training require substantial computation resources to run quickly. Edge computing, where a fine mesh of compute nodes are placed close to end devices, is a viable way to meet the high computation and low-latency requirements of deep learning on edge devices and also provides additional benefits in terms of privacy, bandwidth efficiency, and scalability. This paper aims to provide a comprehensive review of the current state of the art at the intersection of deep learning and edge computing. Specifically, it will provide an overview of applications where deep learning is used at the network edge, discuss various approaches for quickly executing deep learning inference across a combination of end devices, edge servers, and the cloud, and describe the methods for training deep learning models across multiple edge devices. It will also discuss open challenges in terms of systems performance, network technologies and management, benchmarks, and privacy. The reader will take away the following concepts from this paper: understanding scenarios where deep learning at the network edge can be useful, understanding common techniques for speeding up deep learning inference and performing distributed training on edge devices, and understanding recent trends and opportunities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As mentioned in Section 2.1, the progress of DL is very fast but when it comes to application in Edge or IoT devices then a huge gap is noticeable [67].”
From A survey on deep transfer learning to edge computing for mitigating the COVID-19 pandemic (2020) · cites this paper as [67]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2016) · Cited by 31,590
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Edge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733
Calibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
An overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
VQA: Visual Question Answering
Antol, S., Agrawal, A., Lu, J., Mitchell, M., Batra, D., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.279 · Cited by 4,487
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
Bleu: a method for automatic evaluation of machine translation
Papineni, K. (2024) · doi:10.57702/ljteqmrb · Cited by 3,672
The case for vm-based cloudlets in mobile computing
Satyanarayanan, M., Bahl, P., Caceres, R., & Davies, N. (2009) · IEEE Pervasive Computing · doi:10.1109/mprv.2009.82 · Cited by 3,660
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,199
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
The emergence of edge computing
Satyanarayanan, M. (2017) · Computer · doi:10.1109/mc.2017.9 · Cited by 2,832
Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors
Huang, J., Rathod, V., Sun, C., Zhu, M., Korattikara, A., Fathi, A., Fischer, I., Wojna, Z., Song, Y., Guadarrama, S., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.351 · Cited by 2,743
MatConvNet: Convolutional Neural Networks for MATLAB
Vedaldi, A., & Lenc, K. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2807412 · Cited by 2,444
Real-time status: How often should one update?
Kaul, S., Yates, R., & Gruteser, M. (2012) · 2012 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2012.6195689 · Cited by 2,360
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356
On the momentum term in gradient descent learning algorithms
Qian, N. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00116-6 · Cited by 2,312
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., & He, K. (2017) · arXiv · doi:10.48550/arxiv.1706.02677 · Cited by 2,294 · cited 1×
“[129] did gradient sparsification combined with other training tricks such as momentum correction [138] and warm-up training [139] techniques to speed up training convergence.”
BackgroundMAUI: making smartphones last longer with code offload
Cuervo, E., Balasubramanian, A., Cho, D.-K., Wolman, A., Saroiu, S., Chandra, R., & Bahl, P. (2010) · Proceedings of the 8th international conference on Mobile systems, applications, and services · doi:10.1145/1814433.1814441 · Cited by 2,281
SecureML: A System for Scalable Privacy-Preserving Machine Learning
Mohassel, P., & Zhang, Y. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.12 · Cited by 1,936
Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing
Li, H., Ota, K., & Dong, M. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700202 · Cited by 1,566
Investigating Ad Transparency Mechanisms in Social Media: A Case Study of Facebook's Explanations
Andreou, A., Venkatadri, G., Goga, O., Gummadi, K. P., Loiseau, P., & Mislove, A. (2018) · Proceedings 2018 Network and Distributed System Security Symposium · doi:10.14722/ndss.2018.23191 · Cited by 1,477
Deep Learning for IoT Big Data and Streaming Analytics: A Survey
Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471
BranchyNet: Fast inference via early exiting from deep neural networks
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900006 · Cited by 1,326
(2016) · International Conference on Machine Learning · Cited by 1,270
Recent Trends in Deep Learning Based Natural Language Processing
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02709 · Cited by 1,192
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.226 · Cited by 843
Oblivious Neural Network Predictions via MiniONN Transformations
Liu, J., Juuti, M., Lu, Y., & Asokan, N. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134056 · Cited by 691
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667 · cited 2×
“DeepSense [56] is one framework geared toward IoT data fusion leveraging spatiotemporal relationships.”
BackgroundJoint Deep Learning for Pedestrian Detection
Ouyang, W., & Wang, X. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.257 · Cited by 660
ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA
Han, S., Kang, J., Mao, H., Hu, Y., Li, X., Li, Y., Xie, D., Luo, H., Yao, S., Wang, Y., et al. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021745 · Cited by 591
Edge Assisted Real-time Object Detection for Mobile Augmented Reality
Liu, L., Li, H., & Gruteser, M. (2019) · The 25th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3300061.3300116 · Cited by 552
Revisiting Distributed Synchronous SGD
Pan, X., Chen, J., Monga, R., Bengio, S., & Józefowicz, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05800 · Cited by 548
Self-citationDeep learning with Elastic Averaging SGDPreprint
Zhang, S., Choromanska, A., & LeCun, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6651 · Cited by 545
DeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters
Zhao, Z., Barijough, K. M., & Gerstlauer, A. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2858384 · Cited by 502
Towards wearable cognitive assistance
Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., & Satyanarayanan, M. (2014) · Proceedings of the 12th annual international conference on Mobile systems, applications, and services · doi:10.1145/2594368.2594383 · Cited by 476
Chameleon: scalable adaptation of video analytics
Jiang, J., Ananthanarayanan, G., Bodik, P., Sen, S., & Stoica, I. (2018) · Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3230543.3230574 · Cited by 467
DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics
Ran, X., Chen, H., Zhu, X., Liu, Z., & Chen, J. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485905 · Cited by 450
Self-citationDeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450
Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection
Mirsky, Y., Doitshman, T., Elovici, Y., & Shabtai, A. (2018) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2018.23204 · Cited by 441
Large scale distributed neural network training through online distillationPreprint
Anil, R., Pereyra, G., Passos, A., Ormándi, R., Dahl, G. E., & Hinton, G. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03235 · Cited by 440
Intrusion Detection with Neural Networks
Ryan, J., Lin, M.-J., & Miikkulainen, R. P. (1997) · Cited by 416
Accelerating Deep Convolutional Neural Networks Using Specialized Hardware
Ovtcharov, K., Ruwase, O., Kim, J.-Y., Fowers, J., Strauß, K., & Chung, E. S. (2015) · Cited by 412
Chameleon: A Hybrid Secure Computation Framework for Machine Learning Applications
Riazi, M. S., Weinert, C., Tkachenko, O., Songhori, E. M., Schneider, T., & Koushanfar, F. (2018) · Proceedings of the 2018 on Asia Conference on Computer and Communications Security · doi:10.1145/3196494.3196522 · Cited by 410
Han, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 367
Odessa: enabling interactive perception applications on mobile devices
Ra, M.-R., Sheth, A., Mummert, L., Pillai, P., Wetherall, D., & Govindan, R. (2011) · Proceedings of the 9th international conference on Mobile systems, applications, and services · doi:10.1145/1999995.2000000 · Cited by 361
Glimpse: Continuous, Real-Time Object Recognition on Mobile Devices
Chen, T. Y.-H., Ravindranath, L., Deng, S., Bahl, P., & Balakrishnan, H. (2015) · Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2809695.2809711 · Cited by 358
Liu, C., Cao, Y., Luo, Y., Chen, G., Vokkarane, V., Yunsheng, M., Chen, S., & Hou, P. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2017.2662008 · Cited by 333 · cited 1×
“[92] built a food recognition system with two preprocessing steps: first, they discard blurry images, and second, they crop the image so that it only contains the objects of interest.”
BackgroundMoDNN: Local distributed mobile computing system for Deep Neural Network
Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331
(2017) · Networked Systems Design and Implementation · Cited by 329
DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications
Huynh, L. N., Lee, Y., & Balan, R. K. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081360 · Cited by 329
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · ACM SIGARCH Computer Architecture News · doi:10.1145/2872887.2750389 · Cited by 290
VideoEdge: Processing Camera Streams using Hierarchical Clusters
Hung, C.-C., Ananthanarayanan, G., Bodik, P., Golubchik, L., Yu, M., Bahl, P., & Philipose, M. (2018) · 2018 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00016 · Cited by 287
Gaze Prediction in Dynamic 360° Immersive Videos
Xu, Y., Dong, Y., Wu, J., Sun, Z., Shi, Z., Yu, J., & Gao, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00559 · Cited by 273
The Design and Implementation of a Wireless Video Surveillance System
Zhang, T., Chowdhery, A., Bahl, P. (., Jamieson, K., & Banerjee, S. (2015) · Proceedings of the 21st Annual International Conference on Mobile Computing and Networking · doi:10.1145/2789168.2790123 · Cited by 272
Resource-efficient machine learning in 2 KB RAM for the internet of things
Kumar, A., Goyal, S., & Varma, M. (2017) · International Conference on Machine Learning · Cited by 262
LAVEA: latency-aware video analytics on edge computing platform
Yi, S., Hao, Z., Zhang, Q., Zhang, Q., Shi, W., & Li, Q. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134459 · Cited by 244
Bhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236
A deep reinforcement learning-based framework for content caching
Zhong, C., Gursoy, M. C., & Velipasalar, S. (2018) · 2018 52nd Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2018.8362276 · Cited by 231
Cellular Network Traffic Scheduling With Deep Reinforcement Learning
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11339 · Cited by 218 · cited 1×
“Using deep learning for network functions, such as for intrusion detection [49], [50] and wireless scheduling [51], has been proposed.”
BackgroundOn-Demand Deep Model Compression for Mobile Devices: A Usage-Driven Model Selection Framework
Liu, S., Lin, Y., Zhou, Z., Nan, K., Liu, H., & Du, J. (2018) · Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3210240.3210337 · Cited by 217
Chen, Z., Hu, W., Wang, J., Zhao, S., Amos, B., Wu, G., Ha, K., Elgazzar, K., Pillai, P., Klatzky, R., et al. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134458 · Cited by 213
When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8486403 · Cited by 209
DianNao family: energy-efficient hardware accelerators for machine learning
Chen, Y., Chen, T., Xu, Z., Sun, N., & Temam, O. (2016) · Communications of the ACM · doi:10.1145/2996864 · Cited by 205
Not Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud
Wang, J., Zhang, J., Bao, W., Zhu, X., Cao, B., & Yu, P. S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220106 · Cited by 188
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGPLAN Notices · doi:10.1145/3093336.3037698 · Cited by 185
DeepSecure: Scalable Provably-Secure Deep Learning
Rouhani, B. D., Riazi, M. S., & Koushanfar, F. (2018) · 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.2018.8465894 · Cited by 176
Energy characterization and optimization of image sensing toward continuous mobile vision
LiKamWa, R., Priyantha, B., Philipose, M., Zhong, L., & Bahl, P. (2013) · Proceeding of the 11th annual international conference on Mobile systems, applications, and services · doi:10.1145/2462456.2464448 · Cited by 175
Efficient service handoff across edge servers via docker container migration
Ma, L., Yi, S., & Li, Q. (2017) · Proceedings of the Second ACM/IEEE Symposium on Edge Computing · doi:10.1145/3132211.3134460 · Cited by 169
When Weather Matters: IoT-Based Electrical Load Forecasting for Smart Grid
Li, L., Ota, K., & Dong, M. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1700168 · Cited by 165
Gazelle: A Low Latency Framework for Secure Neural Network Inference
Juvekar, C., Vaikuntanathan, V., & Chandrakasan, A. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05507 · Cited by 164
Deep Reinforcement Learning for Mobile Edge Caching: Review, New Features, and Open Issues
Zhu, H., Cao, Y., Wang, W., Jiang, T., & Jin, S. (2018) · IEEE Network · doi:10.1109/mnet.2018.1800109 · Cited by 153 · cited 1×
“There are generally two approaches to apply deep learning in a caching system: use deep learning for content popularity prediction or use deep reinforcement learning to decide a caching policy [53].”
BackgroundFastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural NetworkPreprint
Kusupati, A., Singh, M., Bhatia, K., Kumar, A., Jain, P., & Varma, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.02358 · Cited by 151
RF Sensing in the Internet of Things: A General Deep Learning Framework
Wang, X., Wang, X., & Mao, S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701277 · Cited by 129
Privacy-preserving Machine Learning through Data ObfuscationPreprint
Zhang, T., He, Z., & Lee, R. B.-L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01860 · Cited by 95
Adaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems · doi:10.1145/3211332.3211336 · Cited by 90 · cited 1×
“[23] proposed using reinforcement learning and traditional machine learning, respectively, to choose the right hyperparameters for mobile devices, which is useful in edge scenarios.”
MethodYou can teach elephants to dance: agile VM handoff for edge computing
Ha, K., Abe, Y., Eiszler, T., Chen, Z., Hu, W., Amos, B., Upadhyaya, R., Pillai, P. S., & Satyanarayanan, M. (2017) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3132211.3134453 · Cited by 87
Li, Y., Park, J., Alian, M., Yuan, Y., Qu, Z., Pan, P., Wang, R., Schwing, A. G., Esmaeilzadeh, H., & Kim, N. S. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00023 · Cited by 87
How to scale distributed deep learning?
Jin, P. H., Yuan, Q., Iandola, F., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1611.04581 · Cited by 85
Distributed deep learning on edge-devices: Feasibility via adaptive compression
Hardy, C., Merrer, E. L., & Séricola, B. (2017) · IEEE International Symposium on Network Computing and Applications (NCA) · doi:10.1109/nca.2017.8171350 · Cited by 85
Saputra, Y. M., Hoang, D. T., Nguyen, D. N., Dutkiewicz, E., Niyato, D. T., & Kim, D. I. (2019) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2912365 · Cited by 85
DeepCham: Collaborative Edge-Mediated Adaptive Deep Learning for Mobile Object Recognition
Li, D., Salonidis, T., Desai, N. V., & Chuah, M. C. (2016) · 2016 IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2016.38 · Cited by 84
Characterization of 360-degree Videos
Afzal, S., Chen, J., & Ramakrishnan, K. K. (2017) · doi:10.1145/3097895.3097896 · Cited by 78
Self-citationGossip training for deep learning
Blot, M., Picard, D., Cord, M., & Thome, N. (2016) · arXiv · doi:10.48550/arxiv.1611.09726 · Cited by 77
Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices
Lu, Z., Rallapalli, S., Chan, K., & Porta, T. L. (2017) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3123266.3123389 · Cited by 73
Mainstream: dynamic stem-sharing for multi-tenant video processing
Jiang, A. H., Wong, D., Canel, C., Tang, L., Misra, I., Kaminsky, M., Kozuch, M. A., Pillai, P. S., Andersen, D. G., & Ganger, G. R. (2018) · USENIX Annual Technical Conference · Cited by 73
Hill, J. W., & LaValle, S. M. (2004) · Cited by 71
Delivering Deep Learning to Mobile Devices via Offloading
Ran, X., Chen, H., Liu, Z., & Chen, J. (2017) · doi:10.1145/3097895.3097903 · Cited by 70
Self-citationZhang, W., Hwang, J., Rajagopalan, S., Ramakrishnan, K. K., & Wood, T. (2016) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/2999572.2999602 · Cited by 63
Glimpse: A Programmable Early-Discard Camera Architecture for Continuous Mobile Vision
Naderiparizi, S., Zhang, P., Philipose, M., Priyantha, N. B., Liu, J., & Ganesan, D. (2017) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081347 · Cited by 57
Alzantot, M., Wang, Y., Ren, Z., & Srivastava, M. B. (2017) · doi:10.1145/3089801.3089805 · Cited by 51
Predictive View Generation to Enable Mobile 360-degree and VR Experiences
Hou, X., Dey, S., Zhang, J., & Budagavi, M. (2018) · doi:10.1145/3229625.3229629 · Cited by 49
Enabling deep learning at the IoT edge
Lai, L., & Suda, N. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3243473 · Cited by 49
Fast transparent virtual machine migration in distributed edge clouds
Chaufournier, L., Sharma, P., Le, F., Nahum, E., Shenoy, P. J., & Towsley, D. (2017) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3132211.3134445 · Cited by 49
Learning from Differentially Private Neural Activations with Edge Computing
Mao, Y., Yi, S., Li, Q., Feng, J., Xu, F., & Zhong, S. (2018) · IEEE/ACM Symposium on Edge Computing (SEC) · doi:10.1109/sec.2018.00014 · Cited by 48
ACACIA: Context-aware Edge Computing for Continuous Interactive Applications over Mobile Networks
Cho, J., Sundaresan, K., Mahindra, R., der Merwe, J. V., & Rangarajan, S. (2016) · ACM International Conference on emerging Networking EXperiments and Technologies (CoNEXT) · doi:10.1145/2999572.2999604 · Cited by 45
LEoNIDS: A Low-Latency and Energy-Efficient Network-Level Intrusion Detection System
Tsikoudis, N., Papadogiannakis, A., & Markatos, E. P. (2014) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2014.2369958 · Cited by 41
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01215 · Cited by 39
Exploring the Vision Processing Unit as Co-Processor for Inference
Rivas-Gomez, S., Peña, A. J., Moloney, D., Laure, E., & Markidis, S. (2018) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2018.00098 · Cited by 30
(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1
Research works printed but not linked: 31
- Jeans, 2019, Related’s Hudson Yards: Smart City or Surveillance City?
- AT&T Multi-Access Edge Computing
- Blog, Edge Computing at Chick-Fil-A
- Goodfellow, 2016, Deep Learning, 1
- 10.1145/3132211.3134456 · DOI
- 10.1145/3299710.3211336 · DOI
- Tensorflow
- Tensorflowlite
- Caffe2
- Caffe
- Pytorch
- Cuda
- Cudnn
- AWS Deeplens
- Deep Learning for Siri’s Voice: On-Device Deep Mixture Density Networks for Hybrid Unit Selection Synthesis
- Google Duplex: An AI System for Accomplishing Real-World Tasks Over the Phone
- Pagespeed Insights: Improve Server Response Time
- 2017, Hey Siri: An On-Device DNN-Powered Voice Trigger for Apple’s Personal Assistant
- Google’s Pixel Buds are no Match for Professional Interpreters
- Jindal, 2018, Enabling Full Body AR With Mask R-CNN2GO
- 10.1145/3081333.3081360 · DOI · Paper page
- Edge TPU.
- VPU.
- NVIDIA EGX Edge Computing Platform
- Qualcomm Neural Processing SDK for AI
- 10.1109/MNET.2018.1700202 · DOI · Paper page
- Arcore Overview
- Teerapittayanon, 2017, BranchyNet: Fast inference via early exiting from deep neural networks, CoRR, abs/1709.01686, 1 · arXiv
- 10.1145/3195970.3196023 · doi:10.1145/3195970.3196023 · Paper page
- Hsieh, Gaia: Geo-distributed machine learning approaching LAN speeds, 629
- 10.1109/NCA.2017.8171350 · DOI
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
Edge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2023) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 563
“Various methods of fast implementation of DL reasoning in the combination of end devices, edge servers and cloud, and the methods of training DL models in multiple edge devices are also discussed in Reference [14].”
MethodEdge Machine Learning for AI-Enabled IoT Devices: A Review
Merenda, M., Porcaro, C., & Iero, D. (2020) · Sensors · doi:10.3390/s20092533 · Cited by 523
“The target of secure computation [66] is to ensure that the end device receives an inference result without learning anything about the DNN model on the edge server and vice versa.”
BackgroundMachine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2022) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 402
“In the last few years, edge computing is being increasingly used for the deployment of ML based intelligent systems in resource-constrained environments [25, 145, 150, 165, 166], which is the motivation for this survey.”
BackgroundA Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Metadata
- Authors
- Chen, J., & Ran, X.
- Affiliations
- University of California, Riverside (US)
- ORCID
- Chen, Jiasi
- Venue
- Proceedings of the IEEE
- Published
- 2019-08
- Volume
- 107
- Issue
- 8
- Pages
- 1655-1674
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2960833983
- Cited by
- 1,540
- References
- 141
- Citations by year
- 2026: 205 · 2025: 250 · 2024: 270 · 2023: 245 · 2022: 232 · 2021: 218 · 2020: 114 · 2019: 6
- FWCI
- 77.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Proceedings of the IEEE (publishedVersion)
- Funders
- National Science Foundation (CNS-1817216)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- edge computing, deep learning, edge inference, distributed deep learning training, edge servers, cloud-edge collaboration, Internet of Things, low latency, privacy, spectral efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.