The DOI matches its Crossref record; 264 of the 264 references it cites were found in a registry or an index.
Distributed Artificial Intelligence Empowered by End-Edge-Cloud Computing: A Survey
Abstract
As the computing paradigm shifts from cloud computing to end-edge-cloud computing, it also supports artificial intelligence evolving from a centralized manner to a distributed one. In this paper, we provide a comprehensive survey on the distributed artificial intelligence (DAI) empowered by end-edge-cloud computing (EECC), where the heterogeneous capabilities of on-device computing, edge computing, and cloud computing are orchestrated to satisfy the diverse requirements raised by resource-intensive and distributed AI computation. Particularly, we first introduce several mainstream computing paradigms and the benefits of the EECC paradigm in supporting distributed AI, as well as the fundamental technologies for distributed AI. We then derive a holistic taxonomy for the state-of-the-art optimization technologies that are empowered by EECC to boost distributed training and inference, respectively. After that, we point out security and privacy threats in DAI-EECC architecture and review the benefits and shortcomings of each enabling defense technology in accordance with the threats. Finally, we present some promising applications enabled by DAI-EECC and highlight several research challenges and open issues toward immersive performance acquisition.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Xception: Deep Learning with Depthwise Separable Convolutions
Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
Fog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201
GhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222
Membership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“or more hidden layers are ultimately propagated to the output layer, which presents the final outputs of the network to the user [25].”
BackgroundHow to generate and exchange secrets
Yao, A. C.-C. (1986) · 27th Annual Symposium on Foundations of Computer Science (sfcs 1986) · doi:10.1109/sfcs.1986.25 · Cited by 3,733
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · cited 2×
“erences [13], [14] provided overviews of the architectures and several key technologies for DL model computation at the network edge.”
BackgroundBoyd, S., Ghosh, A., Prabhakar, B., & Shah, D. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.874516 · Cited by 2,439
Privacy-preserving deep learning
Shokri, R., & Shmatikov, V. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813687 · Cited by 2,356
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
Nasr, M., Shokri, R., & Houmansadr, A. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00065 · Cited by 1,760
Exploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734
Privacy-Preserving Deep Learning via Additively Homomorphic Encryption
Phong, L. T., Aono, Y., Hayashi, T., Wang, L., & Moriai, S. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2787987 · Cited by 1,662
Deep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540 · cited 2×
“The references [13], [14] provided overviews of the architectures and several key technologies for DL model computation at the network edge.”
BackgroundMethodConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · cited 2×
“Wang et al. [9] reviewed the techniques for the integration of DL and edge computing from networking, communication, and computations perspectives.”
BackgroundHow to backdoor federated learning
Bagdasaryan, E., Veit, A., Hua, Y., Estrin, D., & Shmatikov, V. (2018) · arXiv · doi:10.48550/arxiv.1807.00459 · Cited by 1,495
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., & Han, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_48 · Cited by 1,400
Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134012 · Cited by 1,377
Neural Cleanse: Identifying and Mitigating Backdoor Attacks in Neural Networks
Wang, B., Yao, Y., Shan, S., Li, H., Viswanath, B., Zheng, H., & Zhao, B. Y. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00031 · Cited by 1,368
BranchyNet: Fast inference via early exiting from deep neural networks
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900006 · Cited by 1,326
Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,147
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Yin, D., Chen, Y., Ramchandran, K., & Bartlett, P. (2018) · arXiv · doi:10.48550/arxiv.1803.01498 · Cited by 1,130
Lee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2021) · arXiv · doi:10.48550/arxiv.2110.05352 · Cited by 1,088
Lee, L.-H., Braud, T., Zhou, P. Y., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2024) · Foundations and Trends® in Human-Computer Interaction · doi:10.1561/1100000095 · Cited by 1,082
Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks
Liu, K., Dolan-Gavitt, B., & Garg, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00470-5_13 · Cited by 1,055
Client-Edge-Cloud Hierarchical Federated Learning
Liu, L., Zhang, J., Song, S. H., & Letaief, K. B. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148862 · Cited by 1,033
A Hybrid Approach to Privacy-Preserving Federated Learning
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., & Zhou, Y. (2019) · Proceedings of the 12th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3338501.3357370 · Cited by 1,029
Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996
Data Poisoning Attacks Against Federated Learning Systems
Tolpegin, V., Truex, S., Gursoy, M. E., & Liu, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58951-6_24 · Cited by 927
Blockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2921755 · Cited by 887 · cited 1×
“Moreover, incentive mechanisms can motivate users to participate in collaborative training and upload model parameters [132].”
BackgroundSwarm Learning for decentralized and confidential clinical machine learning
Warnat-Herresthal, S., Schultze, H., Shastry, K. L., Manamohan, S., Mukherjee, S., Garg, V., Sarveswara, R., Händler, K., Pickkers, P., Aziz, N. A., et al. (2021) · Nature · doi:10.1038/s41586-021-03583-3 · Cited by 884
Blockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1808.03949 · Cited by 882
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
Wang, Z., Song, M., Zhang, Z., Song, Y., Wang, Q., & Qi, H. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737416 · Cited by 881
Zhu, C., Han, S., Mao, H., & Dally, W. J. (2016) · arXiv · doi:10.48550/arxiv.1612.01064 · Cited by 865
Learning Differentially Private Recurrent Language Models
McMahan, H. B., Ramage, D., Talwar, K., & Zhang, L. (2017) · arXiv · doi:10.48550/arxiv.1710.06963 · Cited by 849
Local Model Poisoning Attacks to Byzantine-Robust Federated Learning
Fang, M., Cao, X., Jia, J., & Gong, N. Z. (2019) · arXiv · doi:10.48550/arxiv.1911.11815 · Cited by 828
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · ACM SIGARCH Computer Architecture News · doi:10.1145/3093337.3037698 · Cited by 806
Zhang, J., & Tao, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039359 · Cited by 774
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wen, W., Xu, C., Yan, F., Wu, C., Wang, Y., Chen, Y., & Li, H. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07878 · Cited by 622
Ren, J., Zhang, D., He, S., Zhang, Y., & Li, T. (2020) · ACM Computing Surveys · doi:10.1145/3362031 · Cited by 615
Self-citationDeepChain: Auditable and Privacy-Preserving Deep Learning with Blockchain-based Incentive
Weng, J., Weng, J., Zhang, J., Li, M., Zhang, Y., & Luo, W. (2019) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2019.2952332 · Cited by 610 · cited 1×
“To further improve the FL system using blockchain, the authors of [133] designed strategies to allow unsuspecting parties to participate in privacy-preserving learning and sharing gradients.”
MethodSelf-citationArtificial-Intelligence-Enabled Intelligent 6G Networks
Yang, H., Alphones, A., Xiong, Z., Niyato, D., Zhao, J., & Wu, K. (2020) · IEEE Network · doi:10.1109/mnet.011.2000195 · Cited by 589
Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence
Hao, M., Li, H., Luo, X., Xu, G., Yang, H., & Liu, S. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2945367 · Cited by 569
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548
Revisiting Distributed Synchronous SGD
Pan, X., Chen, J., Monga, R., Bengio, S., & Józefowicz, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05800 · Cited by 548
DeepThings: Distributed Adaptive Deep Learning Inference on Resource-Constrained IoT Edge Clusters
Zhao, Z., Barijough, K. M., & Gerstlauer, A. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2858384 · Cited by 502
CMFL: Mitigating Communication Overhead for Federated Learning
WANG, L., WANG, W., & LI, B. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00099 · Cited by 475
Can FPGAs Beat GPUs in Accelerating Next-Generation Deep Neural Networks?
Nurvitadhi, E., Venkatesh, G., Sim, J., Marr, D., Huang, R., Ong Gee Hock, J., Liew, Y. T., Srivatsan, K., Moss, D., Subhaschandra, S., et al. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021740 · Cited by 467
Local Differential Privacy-Based Federated Learning for Internet of Things
Zhao, Y., Zhao, J., Yang, M., Wang, T., Wang, N., Lyu, L., Niyato, D., & Lam, K.-Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3037194 · Cited by 456
Luo, S., Chen, X., Wu, Q., Zhou, Z., & Yu, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3003744 · Cited by 455
DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450
Advanced lightweight encryption algorithms for IoT devices: survey, challenges and solutions
Singh, S., Sharma, P. K., Moon, S. Y., & Park, J. H. (2024) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-017-0494-4 · Cited by 444
Communication-Efficient Federated Learning for Wireless Edge Intelligence in IoT
Mills, J., Hu, J., & Min, G. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2956615 · Cited by 436
LDP-Fed: federated learning with local differential privacy
Truex, S., Liu, L., Chow, K.-H., Gursoy, M. E., & Wei, W. (2020) · Proceedings of the Third ACM International Workshop on Edge Systems, Analytics and Networking · doi:10.1145/3378679.3394533 · Cited by 435
Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks
Savazzi, S., Nicoli, M., & Rampa, V. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2964162 · Cited by 431
An Edge Traffic Flow Detection Scheme Based on Deep Learning in an Intelligent Transportation System
Chen, C., Liu, B., Wan, S., Qiao, P., & Pei, Q. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025687 · Cited by 429
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424
A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Machine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2022) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 402
FedHome: Cloud-Edge Based Personalized Federated Learning for In-Home Health Monitoring
Wu, Q., Chen, X., Zhou, Z., & Zhang, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3045266 · Cited by 392
CNTK: Microsoft's Open-Source Deep-Learning Toolkit
Seide, F., & Agarwal, A. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945397 · Cited by 382
JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Abrishami, M. S., & Pedram, M. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2947893 · Cited by 381
Deep Learning Models for Cyber Security in IoT Networks
Roopak, M., Yun Tian, G., & Chambers, J. (2019) · 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc.2019.8666588 · Cited by 361
Flux: Elegant machine learning with Julia
Innes, M. (2018) · Journal of Open Source Software · doi:10.21105/joss.00602 · Cited by 353
Can You Really Backdoor Federated Learning?
Sun, Z., Kairouz, P., Suresh, A. T., & McMahan, H. B. (2019) · arXiv · doi:10.48550/arxiv.1911.07963 · Cited by 348
Jia, B., Zhang, X., Liu, J., Zhang, Y., Huang, K., & Liang, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3085960 · Cited by 343
Self-citationArthurs, P., Gillam, L., Krause, P., Wang, N., Halder, K., & Mouzakitis, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3084396 · Cited by 339
MoDNN: Local distributed mobile computing system for Deep Neural Network
Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331
Byzantine-Robust Federated Machine Learning through Adaptive Model AveragingPreprint
Muñoz-González, L., Co, K. T., & Lupu, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05125 · Cited by 312
Data Poisoning Attacks on Federated Machine Learning
Sun, G., Cong, Y., Dong, J., Wang, Q., Lyu, L., & Liu, J. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3128646 · Cited by 310
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Split Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges
Matsubara, Y., Levorato, M., & Restuccia, F. (2023) · ACM Computing Surveys · doi:10.1145/3527155 · Cited by 304
A Survey on Edge and Edge-Cloud Computing Assisted Cyber-Physical Systems
Cao, K., Hu, S., Shi, Y., Colombo, A., Karnouskos, S., & Li, X. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3073066 · Cited by 303
PoisonGAN: Generative Poisoning Attacks Against Federated Learning in Edge Computing Systems
Zhang, J., Chen, B., Cheng, X., Binh, H. T. T., & Yu, S. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3023126 · Cited by 291
NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision
Fang, B., Zeng, X., & Zhang, M. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241559 · Cited by 291
One-Shot Federated LearningPreprint
Guha, N., Talwalkar, A., & Smith, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.11175 · Cited by 285
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
Self-citationUnderstanding Distributed Poisoning Attack in Federated Learning
Cao, D., Chang, S., Lin, Z., Liu, G., & Sun, D. (2019) · 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads47876.2019.00042 · Cited by 285
PP-LCNet: A Lightweight CPU Convolutional Neural NetworkPreprint
Cui, C., Gao, T., Wei, S., Du, Y., Guo, R., Dong, S., Lu, B., Zhou, Y., Lv, X., Liu, Q., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.15099 · Cited by 278
Efficient Computing Resource Sharing for Mobile Edge-Cloud Computing Networks
Zhang, Y., Lan, X., Ren, J., & Cai, L. (2020) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2020.2979807 · Cited by 261
Self-citationRole of Artificial Intelligence in the Internet of Things (IoT) cybersecurity
Kuzlu, M., Fair, C., & Guler, O. (2021) · Discover Internet of Things · doi:10.1007/s43926-020-00001-4 · Cited by 259
Qsparse-local-SGD: Distributed SGD with quantization, sparsification, and local computations
Basu, D., Data, D., Karakus, C., & Diggavi, S. N. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2985917 · Cited by 256
PaddlePaddle: An Open-Source Deep Learning Platform from Industrial Practice
Ma, Y., Yu, D., Wu, T., & Wang, H. (2019) · doi:10.11871/jfdc.issn.2096.742x.2019.01.011 · Cited by 255
Tang, X., Cao, C., Wang, Y., Zhang, S., Liu, Y., Li, M., & He, T. (2021) · China Communications · doi:10.23919/jcc.2021.02.011 · Cited by 245
Sparse Binary Compression: Towards Distributed Deep Learning with minimal Communication
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852172 · Cited by 240
LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy
Sun, L., Qian, J., & Chen, X. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/217 · Cited by 239
Cloud-Edge Orchestration for the Internet of Things: Architecture and AI-Powered Data Processing
Wu, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3014845 · Cited by 238
Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks
Lim, W. Y. B., Xiong, Z., Miao, C., Niyato, D., Yang, Q., Leung, C., & Poor, H. V. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2985694 · Cited by 233
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI
Yao, J., Zhang, S., Yao, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178211 · Cited by 227
When Federated Learning Meets Blockchain: A New Distributed Learning Paradigm
Ma, C., Li, J., Ding, M., Shi, L., Wang, T., Han, Z., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2009.09338 · Cited by 225
When Federated Learning Meets Blockchain: A New Distributed Learning Paradigm
Ma, C., Li, J., Shi, L., Ding, M., Wang, T., Han, Z., & Poor, H. V. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2022.3180932 · Cited by 223
AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning
Deng, Y., Lyu, F., Ren, J., Wu, H., Zhou, Y., Zhang, Y., & Shen, X. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3134647 · Cited by 219
Self-citationResource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing
Wang, Z., Xu, H., Liu, J., Huang, H., Qiao, C., & Zhao, Y. (2021) · IEEE INFOCOM 2021 - IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488756 · Cited by 216
The Privacy Blanket of the Shuffle Model
Balle, B., Bell, J., Gascón, A., & Nissim, K. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-26951-7_22 · Cited by 214
Optimal UAV Caching and Trajectory in Aerial-Assisted Vehicular Networks: A Learning-Based Approach
Wu, H., Lyu, F., Zhou, C., Chen, J., Wang, L., & Shen, X. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3005469 · Cited by 213
Self-citationAn Entropy-based Pruning Method for CNN CompressionPreprint
Luo, J.-H., & Wu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05791 · Cited by 211
FAIR: Quality-Aware Federated Learning with Precise User Incentive and Model Aggregation
Deng, Y., Lyu, F., Ren, J., Chen, Y.-C., Yang, P., Zhou, Y., & Zhang, Y. (2021) · IEEE INFOCOM 2021 - IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488743 · Cited by 211
Self-citationYao, S., Li, J., Liu, D., Wang, T., Liu, S., Shao, H., & Abdelzaher, T. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430898 · Cited by 209
A Reconfigurable Streaming Deep Convolutional Neural Network Accelerator for Internet of Things
Du, L., Du, Y., Li, Y., Su, J., Kuan, Y.-C., Liu, C.-C., & Chang, M.-C. F. (2018) · IEEE Transactions on Circuits and Systems I: Regular Papers · doi:10.1109/tcsi.2017.2735490 · Cited by 205
BottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systems
Shao, J., & Zhang, J. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145068 · Cited by 200
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · 2019 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 196
Ma, X., Guo, F.-M., Niu, W., Lin, X., Tang, J., Ma, K., Ren, B., & Wang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5954 · Cited by 193
DeepCache: Principled Cache for Mobile Deep Vision
Xu, M., Zhu, M., Liu, Y., Lin, F. X., & Liu, X. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241563 · Cited by 185
CONTRA: Defending Against Poisoning Attacks in Federated Learning
Awan, S., Luo, B., & Li, F. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-88418-5_22 · Cited by 182
Distilled One-Shot Federated LearningPreprint
Zhou, Y., Pu, G., Ma, X., Li, X., & Wu, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.07999 · Cited by 181
Characterizing Urban Vehicle-to-Vehicle Communications for Reliable Safety Applications
Lyu, F., Zhu, H., Cheng, N., Zhou, H., Xu, W., Li, M., & Shen, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2920813 · Cited by 180
Self-citationMulti-Objective Optimization for Resource Allocation in Vehicular Cloud Computing Networks
Wei, W., Yang, R., Gu, H., Zhao, W., Chen, C., & Wan, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3091321 · Cited by 178
Bringing ai to edge: from deep learning’s perspective
Liu, D., Kong, H., Luo, X., Liu, W., & Subramaniam, R. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.04.141 · Cited by 171 · cited 1×
“There have been some surveys investigating AI-powered cloud-edge orchestration [5], [6], [8], [9], [10], edge intelligence [12], [13], [14], [15], end-edge-cloud orchestration [7], [11], AI/ML for wireless edge network [16], [17], and privacy and security for distributed learning [18].”
BackgroundStaleness-aware Async-SGD for Distributed Deep Learning
Zhang, W., Gupta, S., Lian, X., & Liu, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05950 · Cited by 171
Access Control for Electronic Health Records with Hybrid Blockchain-Edge Architecture
Guo, H., Li, W., Nejad, M., & Shen, C.-C. (2019) · 2019 IEEE International Conference on Blockchain (Blockchain) · doi:10.1109/blockchain.2019.00015 · Cited by 169
Mhaisen, N., Abdellatif, A. A., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3053588 · Cited by 168
AdaComp : Adaptive Residual Gradient Compression for Data-Parallel Distributed Training
Chen, C.-Y., Choi, J., Brand, D., Agrawal, A., Zhang, W., & Gopalakrishnan, K. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11728 · Cited by 166
A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks
Shi, S., Wang, Q., Zhao, K., Tang, Z., Wang, Y., Huang, X., & Chu, X. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00220 · Cited by 161
Enabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
Lim, W. Y. B., Ng, J. S., Xiong, Z., Niyato, D., Miao, C., & Kim, D. I. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118401 · Cited by 160
Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT
Zhang, W., Yang, D., Peng, H., Wu, W. R., Quan, W., Zhang, H., & Shen, X. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3068255 · Cited by 155
Self-citationCachier: Edge-Caching for Recognition Applications
Drolia, U., Guo, K., Tan, J., Gandhi, R., & Narasimhan, P. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.94 · Cited by 148
A Review on Computational Intelligence Techniques in Cloud and Edge Computing
Asim, M., Wang, Y., Wang, K., & Huang, P.-Q. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.3007905 · Cited by 147
Wu, Y., Song, Y., Wang, T., Qian, L., & Quek, T. Q. S. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3153068 · Cited by 146
CloudLeak: Large-Scale Deep Learning Models Stealing Through Adversarial Examples
Yu, H., Yang, K., Zhang, T., Tsai, Y.-Y., Ho, T.-Y., & Jin, Y. (2020) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2020.24178 · Cited by 144
IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M. (2018) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3267809.3267828 · Cited by 143
Adaptive Inference through Early-Exit Networks: Design, Challenges and Directions
Laskaridis, S., Kouris, A., & Lane, N. D. (2021) · International Workshop on Embedded and Mobile Deep Learning (EMDL) · doi:10.1145/3469116.3470012 · Cited by 139
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Chang, S.-E., Li, Y., Sun, M., Shi, R., So, H. K., Qian, X., Wang, Y., & Lin, X. (2021) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00027 · Cited by 136
GAN Enhanced Membership Inference: A Passive Local Attack in Federated Learning
Zhang, J., Zhang, J., Chen, J., & Yu, S. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148790 · Cited by 133 · cited 1×
“Considering the lack of target training data in practice, Zhang et al. [227] used GAN to generate samples that have the same distribution as the original data records to fill the gap in attack data.”
MethodLight-OPU: An FPGA-based Overlay Processor for Lightweight Convolutional Neural Networks
Yu, Y., Zhao, T., Wang, K., & He, L. (2020) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3373087.3375311 · Cited by 129
Efficient Federated Learning With Spike Neural Networks for Traffic Sign Recognition
Xie, K., Zhang, Z., Li, B., Kang, J., Niyato, D., Xie, S., & Wu, Y. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3178808 · Cited by 128
Mathur, A., Lane, N. D., Bhattacharya, S., Boran, A., Forlivesi, C., & Kawsar, F. (2017) · Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3081333.3081359 · Cited by 128
Auto-Split: A General Framework of Collaborative Edge-Cloud AI
Banitalebi-Dehkordi, A., Vedula, N., Pei, J., Xia, F., Wang, L., & Zhang, Y. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467078 · Cited by 116
Self-citationDDPQN: An Efficient DNN Offloading Strategy in Local-Edge-Cloud Collaborative Environments
Xue, M., Wu, H., Peng, G., & Wolter, K. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3116597 · Cited by 113
Self-citationRen, Y., Zhu, F., Qi, J. X., Wang, J., & Sangaiah, A. K. (2019) · Applied Sciences · doi:10.3390/app9102058 · Cited by 106
Kang, J., Li, X., Nie, J., Liu, Y., Xu, M., Xiong, Z., Niyato, D. T., & Qiang, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3178970 · Cited by 105
HHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for ElectroencephalographyPreprint
Gao, D., Ju, C., Wei, X., Liu, Y., Chen, T., & Yang, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.05784 · Cited by 103
Distilled Split Deep Neural Networks for Edge-Assisted Real-Time Systems
Matsubara, Y., Baidya, S., Callegaro, D., Levorato, M., & Singh, S. (2019) · doi:10.1145/3349614.3356022 · Cited by 101
Lightweight Deep Learning Model in Mobile-Edge Computing for Radar-Based Human Activity Recognition
Zhu, J., Lou, X., & Ye, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063504 · Cited by 100
Towards Rear-End Collision Avoidance: Adaptive Beaconing for Connected Vehicles
Lyu, F., Cheng, N., Zhu, H., Zhou, H., Xu, W., Li, M., & Shen, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2966586 · Cited by 99
Self-citationTowards Real-time Cooperative Deep Inference over the Cloud and Edge End Devices
Zhang, S., Li, Y., Liu, X., Guo, S., Wang, W., Wang, J., Ding, B., & Wu, D. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3397315 · Cited by 99
SurveilEdge: Real-time Video Query based on Collaborative Cloud-Edge Deep Learning
Wang, S., Yang, S., & Zhao, C. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155284 · Cited by 98
MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs
Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K. W., Chen, X., Li, H., & Chen, Y. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203852 · Cited by 97
Trusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning
Ma, C., Li, J., Wei, K., Liu, B., Ding, M., Yuan, L., Han, Z., & Vincent Poor, H. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3306773 · Cited by 96
An Intelligent End–Edge–Cloud Architecture for Visual IoT-Assisted Healthcare Systems
Yang, Z., Liang, B., & Ji, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3052778 · Cited by 90
An IoT and Edge Computing Based Framework for Charge Scheduling and EV Selection in V2G Systems
Chamola, V., Sancheti, A., Chakravarty, S., Kumar, N., & Guizani, M. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3013198 · Cited by 89
TODG: Distributed Task Offloading With Delay Guarantees for Edge Computing
Yue, S., Ren, J., Qiao, N., Zhang, Y., Jiang, H., Zhang, Y., & Yang, Y. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3123535 · Cited by 89
Self-citationHow to scale distributed deep learning?
Jin, P. H., Yuan, Q., Iandola, F., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1611.04581 · Cited by 85
Salient Object Detection in the Distributed Cloud-Edge Intelligent Network
Gao, Z., Zhang, H., Dong, S., Sun, S., Wang, X., Yang, G., Wu, W., Li, S., & de Albuquerque, V. H. C. (2020) · IEEE Network · doi:10.1109/mnet.001.1900260 · Cited by 83
A Cloud Edge Collaborative Intelligence Method of Insulator String Defect Detection for Power IIoT
Song, C., Xu, W., Han, G., Zeng, P., Wang, Z., & Yu, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3039226 · Cited by 83
INTERNET OF THINGS AND THE MAN-IN-THE-MIDDLE ATTACKS – SECURITY AND ECONOMIC RISKS
Čekerevac, Z., Dvořák, Z., Prigoda, L., & Čekerevac, P. (2017) · MEST Journal · doi:10.12709/mest.05.05.02.03 · Cited by 82
Zhang, L., Chen, L., & Xu, J. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450051 · Cited by 82
An architecture pattern for trusted orchestration in IoT edge clouds
Pahl, C., Ioini, N. E., Helmer, S., & Lee, B. (2018) · International Conference on Fog and Mobile Edge Computing (FMEC) · doi:10.1109/fmec.2018.8364046 · Cited by 80
Singh, V. K., & Kolekar, M. H. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11158-7 · Cited by 80
FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated LearningPreprint
Jiang, Z., Wang, W., & Liu, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00675 · Cited by 80
Learned Gradient Compression for Distributed Deep Learning
Abrahamyan, L., Chen, Y., Bekoulis, G., & Deligiannis, N. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084806 · Cited by 79
Xue, M., Wu, H., Li, R., Xu, M., & Jiao, P. (2021) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3111731 · Cited by 78
Self-citationGossip training for deep learning
Blot, M., Picard, D., Cord, M., & Thome, N. (2016) · arXiv · doi:10.48550/arxiv.1611.09726 · Cited by 77
Analysis of DDoS-Capable IoT Malwares
Spognardi, A., Donno, M. D., Dragoni, N., et al. (2017) · Annals of Computer Science and Information Systems · doi:10.15439/2017f288 · Cited by 77
Exploiting Transfer Learning for Emotion Recognition Under Cloud-Edge-Client Collaborations
Wu, D., Han, X., Yang, Z., & Wang, R. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3020677 · Cited by 74
AsyMo: scalable and efficient deep-learning inference on asymmetric mobile CPUs
Wang, M., Ding, S., Cao, T., Liu, Y., & Xu, F. (2021) · ACM Annual International Conference on Mobile Computing and Networking (MobiCom) · doi:10.1145/3447993.3448625 · Cited by 73
Cybersecurity Challenges and Opportunities in the New "Edge Computing + IoT" World
Pan, J., & Yang, Z. (2018) · ACM International Workshop on Security in Software Defined Networks & Network Function Virtualization (SDN-NFV Sec) · doi:10.1145/3180465.3180470 · Cited by 72
An Edge Computing Based Public Vehicle System for Smart Transportation
Lin, J., Yu, W., Yang, X., Zhao, P. F., Zhang, H., & Zhao, W. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3028497 · Cited by 72
SHARE: Shaping Data Distribution at Edge for Communication-Efficient Hierarchical Federated Learning
Deng, Y., Lyu, F., Ren, J., Zhang, Y., Zhou, Y., Zhang, Y., & Yang, Y. (2021) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs51616.2021.00012 · Cited by 72
Self-citationNeural Compression and Filtering for Edge-assisted Real-time Object Detection in Challenged Networks
Matsubara, Y., & Levorato, M. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412388 · Cited by 71
Communication-Efficient Distributed Deep Learning with Merged Gradient Sparsification on GPUs
Shi, S., Wang, Q., Chu, X., Li, B., Qin, Y., Liu, R., & Zhao, X. (2020) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom41043.2020.9155269 · Cited by 71
A Hitchhiker’s Guide On Distributed Training Of Deep Neural Networks
Chahal, K., Grover, M. S., Dey, K., & Shah, R. R. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.10.004 · Cited by 70
HierTrain: Fast Hierarchical Edge AI Learning With Hybrid Parallelism in Mobile-Edge-Cloud Computing
Liu, D., Chen, X., Zhou, Z., & Ling, Q. H. (2020) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2020.2994737 · Cited by 70
Efficient Federated Meta-Learning Over Multi-Access Wireless Networks
Yue, S., Ren, J., Xin, J., Zhang, D., Zhang, Y., & Zhuang, W. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3143259 · Cited by 68
Self-citationMetaverse for Wireless Systems: Vision, Enablers, Architecture, and Future Directions
Khan, L. U., Han, Z., Niyato, D. T., Guizani, M., & Hong, C. S. (2024) · IEEE Wireless Communications · doi:10.1109/mwc.013.2300287 · Cited by 68
JointRec: A Deep-Learning-Based Joint Cloud Video Recommendation Framework for Mobile IoT
Duan, S., Zhang, D., Wang, Y., Li, L., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2944889 · Cited by 65
Self-citationPrivacy for Free: Communication-Efficient Learning with Differential Privacy Using SketchesPreprint
Li, T., Liu, Z., Sekar, V., & Smith, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.00972 · Cited by 65
MEGEX: Data-Free Model Extraction Attack Against Gradient-Based Explainable AI
Miura, T., Shibahara, T., & Yanai, N. (2024) · doi:10.1145/3665451.3665533 · Cited by 64
Towards cloud-edge collaborative online video analytics with fine-grained serverless pipelines
Zhang, M., Wang, F., Zhu, Y., Liu, J., & Wang, Z. (2021) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3458305.3463377 · Cited by 60
Branchy-GNN: A Device-Edge Co-Inference Framework for Efficient Point Cloud Processing
Shao, J., Zhang, H., Mao, Y., & Zhang, J. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414831 · Cited by 58
Wang, Y., Yang, S., Ren, X., Zhao, P. F., Zhao, C., & Yang, X. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3104003 · Cited by 58
Lightweight Compression Of Neural Network Feature Tensors For Collaborative Intelligence
Cohen, R. A., Choi, H., & Bajic, I. V. (2020) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme46284.2020.9102797 · Cited by 57
GGS: General Gradient Sparsification for Federated Learning in Edge Computing
Li, S., Qi, Q., Wang, J., Sun, H., Li, Y., & Yu, F. R. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148987 · Cited by 56
An Efficient Statistical-based Gradient Compression Technique for Distributed Training SystemsPreprint
Abdelmoniem, A. M., Elzanaty, A., Alouini, M., & Canini, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.10761 · Cited by 52
Alzantot, M., Wang, Y., Ren, Z., & Srivastava, M. B. (2017) · doi:10.1145/3089801.3089805 · Cited by 51
A cloud edge-based two-level hybrid scheduling learning model in cloud manufacturing
Jian, C., Ping, J., & Zhang, M. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1779371 · Cited by 50
Edge-Network-Assisted Real-Time Object Detection Framework for Autonomous Driving
Kim, S. W., Ko, K., Ko, H., et al. (2021) · IEEE Network · doi:10.1109/mnet.011.2000248 · Cited by 48
Improving utility and security of the shuffler-based differential privacy
Wang, T., Ding, B., Xu, M., Huang, Z., Hong, C., Zhou, J., Li, N., & Jha, S. (2020) · Proceedings of the VLDB Endowment · doi:10.14778/3424573.3424576 · Cited by 47
An End-to-End Encrypted Neural Network for Gradient Updates Transmission in Federated Learning
Li, H., & Han, T. (2019) · DCC · doi:10.1109/dcc.2019.00101 · Cited by 45
MobiPose: real-time multi-person pose estimation on mobile devices
Zhang, J., Zhang, D., Xu, X., Jia, F., Liu, Y., Liu, X., Ren, J., & Zhang, Y. (2020) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/3384419.3430726 · Cited by 45
Self-citationAppealNet: An Efficient and Highly-Accurate Edge/Cloud Collaborative Architecture for DNN Inference
Li, M., Li, Y., Tian, Y., Jiang, L., & Xu, Q. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586176 · Cited by 45
DeSMP: Differential Privacy-exploited Stealthy Model Poisoning Attacks in Federated Learning
Hossain, M. T., Islam, S., Badsha, S., & Shen, H. (2021) · 2021 17th International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn53354.2021.00038 · Cited by 44
DeePar: A Hybrid Device-Edge-Cloud Execution Framework for Mobile Deep Learning Applications
Huang, Y., Wang, F., Wang, F., & Liu, J. (2019) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infcomw.2019.8845240 · Cited by 44
Local Averaging Helps: Hierarchical Federated Learning and Convergence Analysis.Preprint
Wang, J., Wang, S., Chen, R., & Ji, M. (2020) · arXiv (Cornell University) · Cited by 42
Deep Learning Enhanced Driving Behavior Evaluation Based on Vehicle-Edge-Cloud Architecture
Xun, Y., Qin, J., & Liu, J. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3078482 · Cited by 42
RedSync: Reducing synchronization bandwidth for distributed deep learning training system
Fang, J., Fu, H., Yang, G., & Hsieh, C. (2019) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2019.05.016 · Cited by 41
Ding, Y., & Satō, H. (2020) · IEEE International Conference on Cyber Security and Cloud Computing / IEEE International Conference on Edge Computing and Scalable Cloud (CSCloud/EdgeCom) · doi:10.1109/cscloud-edgecom49738.2020.00015 · Cited by 41
Privacy-Preserving Streaming Truth Discovery in Crowdsourcing With Differential Privacy
Wang, D., Ren, J., Wang, Z., Pang, X., Zhang, Y., & Shen, X. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3062775 · Cited by 41
Self-citationAccelerating Mobile Applications at the Network Edge with Software-Programmable FPGAs
Jiang, S., He, D., Yang, C., Xu, C., Luo, G., Chen, Y., Liu, Y., & Jiang, J. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485850 · Cited by 40
Research works printed but not linked: 58
- Vailshery, 2021, IoT and Non-IoT Connections Worldwide 2010–2025
- Badnakhe, 2021, IoT Is Not a Buzzword But Necessity
- 10.1002/9781119042655 · doi:10.1002/9781119042655
- 10.1109/TMC.2021.3119200 · doi:10.1109/tmc.2021.3119200
- Zheng, Asynchronous stochastic gradient descent with delay compensation, 4120
- Sun, Asynchronous coordinate descent under more realistic assumptions, 30, 6182
- Chen, Accelerating Gossip SGD with periodic global averaging, 1791
- Koloskova, Decentralized stochastic optimization and Gossip algorithms with compressed communication, 3478
- Assran, Stochastic gradient push for distributed deep learning, 344
- Abadi, TensorFlow: A system for large-scale machine learning, 265
- Paszke, Pytorch: An imperative style, high-performance deep learning library, 32, 8026
- 2020, MindSpore
- 2020, MegEngine: A Fast, Scalable and Easy-to-Use Deep Learning Framework
- Sergeev, 2018, Horovod: Fast and easy distributed deep learning in TensorFlow, arXiv:1802.05799 · arXiv
- 2018, MACE
- 2019, Deeplearning4j.
- 2022, JAX: Autograd and XLA
- Jiang, A unified architecture for accelerating distributed DNN training in heterogeneous GPU/CPU clusters, 463
- Markham, 2017, Caffe2: Portable High-Performance Deep Learning Framework From Facebook
- Chollet, 2021, Keras.
- 2018, Intel, AI. PlaidML.
- 2021, Introduction to Model Parallelism.
- Dean, Large scale distributed deep networks, 25, 1223
- Sun, Slim-DP: A multi-agent system for communication-efficient distributed deep learning, 721
- Alistarh, QSGD: Communication-efficient SGD via gradient quantization and encoding, 30, 1709
- 10.1109/MM.2019.2935967 · DOI
- Geng, Horizontal or vertical? A hybrid approach to large-scale distributed machine learning, 1
- Kim, SplitNet: Learning to semantically split deep networks for parameter reduction and model parallelization, 1866
- Chen, ScaleCom: Scalable sparsified gradient compression for communication-efficient distributed training, 33, 13551
- Wu, PocketFlow: An automated framework for compressing and accelerating deep neural networks, 1
- Vogels, PowerSGD: Practical low-rank gradient compression for distributed optimization, 32, 14236
- Howard, 2017, MobileNets: Efficient convolutional neural networks for mobile vision applications, arXiv:1704.04861 · arXiv
- Liu, 2021, Hierarchical quantized federated learning: Convergence analysis and system design, arXiv:2103.14272 · arXiv
- Bonawitz, Towards federated learning at scale: System design, 1, 374
- McMahan, Communication-efficient learning of deep networks from decentralized data, 1273
- Park, Few-round learning for federated learning, 34, 28612
- 2018, EdgeTPU.
- 2018, The World’s First Full-Stack All-Scenario AI Chip.
- 10.1109/ISCAS45731.2020.9180843 · doi:10.1109/iscas45731.2020.9180843
- Narayanan, Accelerating deep learning workloads through efficient multi-model execution, 20
- Jiang, MainStream: Dynamic stem-sharing for multi-tenant video processing, 29
- Blanchard, Machine learning with adversaries: Byzantine tolerant gradient descent, 118
- Mhamdi, The hidden vulnerability of distributed learning in Byzantium, 3521
- Geyer, 2017, Differentially private federated learning: A client level perspective, arXiv:1712.07557 · arXiv
- Girgis, Shuffled model of differential privacy in federated learning, 2521
- Orekondy, 2018, Gradient-leaks: Understanding and controlling deanonymization in federated learning, arXiv:1805.05838 · arXiv
- Yan, Cache telepathy: Leveraging shared resource attacks to learn DNN architectures, 2003
- Zhu, Hermes attack: Steal DNN models with lossless inference accuracy, 1
- Xie, Practical distributed learning: Secure machine learning with communication-efficient local updates, 19
- 10.1088/1742-6596/1624/5/052017 · doi:10.1088/1742-6596/1624/5/052017
- 10.1109/TII.2019.2940745 · doi:10.1109/tii.2019.2940745
- 10.1109/TLA.2021.9477277 · doi:10.1109/tla.2021.9477277
- 10.1109/JIOT.2019.2958097 · doi:10.1109/jiot.2019.2958097
- Organization, 2019, Towards Policy for Health and Ageing
- Xiao-Xu, Computing power network framework based on end-edge-supercloud collaboration, J. Comput. Appl.
- Telecom, 2019, Computing Power Network for MEC
- Mattsson, 2021, Machine Learning in Trusted Execution Environments and Quantum Computers
- 2020, Function Offload Coprocessors: A New Era of Decentralized and Distributed Computing
Cited by
A Comprehensive Survey on TinyML
Abadade, Y., Temouden, A., Bamoumen, H., Benamar, N., Chtouki, Y., & Hafid, A. S. (2023) · IEEE Access · doi:10.1109/access.2023.3294111 · Cited by 366
“resource-intensive and distributed AI computation [40].”
A Survey of Beam Management for mmWave and THz Communications Towards 6G
Xue, Q., Ji, C., Ma, S., Guo, J., Xu, Y., Chen, Q., & Zhang, W. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3361991 · Cited by 280
Das, S. K., Mudi, R., Rahman, M. S., Rabie, K. M., & Li, X. (2024) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2024.3466858 · Cited by 27
Metadata
- Authors
- Duan, S., Wang, D., Ren, J., Lyu, F., Zhang, Y., Wu, H., & Shen, X.
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2023
- Volume
- 25
- Issue
- 1
- Pages
- 591-624
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W4312588618
- Cited by
- 408
- References
- 264
- FWCI
- 35.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Key Research and Development Program of China (2022YFF0604502)
- National Natural Science Foundation of China (62122095, 62002389, 62072472, U19A2067)
- Grant from the Guoqiang Institute, Tsinghua University
- Natural Science Foundation of Hunan Province, China (2020JJ2050, 2021JJ20079)
- Young Elite Scientist Sponsorship Program by CAST (YESS20200238)
- Young Talents Plan of Hunan Province of China (2021RC3004)
- Higher Education Discipline Innovation Project (B18059)
- Central South University Innovation-Driven Research Programme (2023CXQD029)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.