Communication-Efficient Edge AI: Algorithms and Systems
Open accessThe DOI matches its Crossref record; 241 of the 242 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Artificial intelligence (AI) has achieved remarkable breakthroughs in a wide range of fields, ranging from speech processing, image classification to drug discovery. This is driven by the explosive growth of data, advances in machine learning (especially deep learning), and the easy access to powerful computing resources. Particularly, the wide scale deployment of edge devices (e.g., IoT devices) generates an unprecedented scale of data, which provides the opportunity to derive accurate models and develop various intelligent applications at the network edge. However, such enormous data cannot all be sent to the cloud for processing, due to the varying channel quality, traffic congestion and/or privacy concerns, and the enormous energy consumption. By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative. AI at the edge requires close cooperation amongedge devices, such as smart phones and smart vehicles, andedge serversat the wireless access points and base stations, which however result in heavy communication overheads. In this paper, we present a comprehensive survey of the recent developments in various techniques for overcoming these communication challenges. Specifically, we first identify key communication challenges in edge AI systems. We then introduce communication-efficient techniques, from both algorithmic and system perspectives for training and inference tasks at the network edge. Potential future research directions are also highlighted.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“With the latest innovations in Artificial Intelligence (AI) efficiency, the proliferation of IoT devices, and the rise of edge computing, the potential of edge AI has now been unlocked [19].”
From Edge AI: A survey (2023) · cites this paper as [19]
In the citing paper
“Edge AI provides a promising solution for connected intelligence by enabling data collection, processing, transmission, and consumption at the network edge [29], [30].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [29]
In the citing paper
“Edge device distributed inference based on wireless MapReduce enjoys the advantages of providing low-latency, high-accurate, scalable, and resilient services for edge devices without accessing the cloud data center [12], [29].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [29]
Citations
Cites
Items 201–242 of 242
Communication Efficient Federated Learning over Multiple Access Channels
Chang, W.-T., & Tandon, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.08737 · Cited by 43
Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques and ToolsPreprint
Mayer, R., & Jacobsen, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11314 · Cited by 42
Deep Joint Source-Channel Coding of Images with Feedback
Kurka, D. B., & Gündüz, D. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054216 · Cited by 42
On Model Coding for Distributed Inference and Transmission in Mobile Edge Computing Systems
Zhang, J., & Simeone, O. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2911496 · Cited by 37
Self-citationCoded Computing for Distributed Graph Analytics
Prakash, S., Reisizadeh, A., Pedarsani, R., & Avestimehr, S. (2018) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2018.8437860 · Cited by 36
Communication-Efficient Distributed Reinforcement LearningPreprint
Chen, T., Zhang, K., Giannakis, G. B., & Başar, T. (2018) · arXiv (Cornell University) · Cited by 35
CodedReduce: A Fast and Robust Framework for Gradient Aggregation in Distributed Learning
Reisizadeh, A., Prakash, S., Pedarsani, R., & Avestimehr, A. S. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2021.3109097 · Cited by 35
Near Optimal Coded Data Shuffling for Distributed Learning
Attia, M. A., & Tandon, R. (2019) · IEEE Transactions on Information Theory · doi:10.1109/tit.2019.2926704 · Cited by 34
Coded Distributed Computing with Node Cooperation Substantially Increases Speedup Factors
Parrinello, E., Lampiris, E., & Elia, P. (2018) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2018.8437333 · Cited by 33
A Node-Selection-Based Sub-Task Assignment Method for Coded Edge Computing
Zhao, S. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2909034 · Cited by 33
Distributed Deep Learning Strategies for Automatic Speech Recognition
Zhang, W., Cui, X., Finkler, U., Kingsbury, B. E. D., Saon, G., Kung, D. S., & Picheny, M. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682888 · Cited by 32
A pliable index coding approach to data shuffling
Song, L., Fragouli, C., & Zhao, T. (2017) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2017.8006991 · Cited by 32
Computation Over Wide-Band Multi-Access Channels: Achievable Rates Through Sub-Function Allocation
Wu, F., Chen, L., Zhao, N., Chen, Y., Yu, F. R., & Wei, G. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2918145 · Cited by 31
Learning Compact Neural Networks with RegularizationPreprint
Oymak, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01223 · Cited by 31
Secure Distributed On-Device Learning Networks with Byzantine Adversaries
Dong, Y., Cheng, J., Hossain, M. J., & Leung, V. C. M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1900025 · Cited by 28
A Distributed Second-Order Algorithm You Can TrustPreprint
Mendler-Dünner, C., Lucchi, A., Gargiani, M., Bian, A., Hofmann, T., & Jaggi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07569 · Cited by 27
Fitting ReLUs via SGD and Quantized SGD
Kalan, S. M. M., Soltanolkotabi, M., & Avestimehr, A. S. (2019) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849667 · Cited by 25
Distributed Stochastic Gradient Descent Using LDGM Codes
Horii, S., Yoshida, T., Kobayashi, M., & Matsushima, T. (2019) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849580 · Cited by 23
Reconfigurable Intelligent Surface for Green Edge InferencePreprint
Hua, S., Zhou, Y., Yang, K., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00820 · Cited by 23
Self-citationCommunication-Efficient Distributed Strongly Convex Stochastic Optimization: Non-Asymptotic RatesPreprint
Sahu, A. K., Jakovetić, D., Bajović, D., & Kar, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02920 · Cited by 18
Exact Convergence of Gradient-Free Distributed Optimization Method in a Multi-Agent System
Pang, Y., & Hu, G. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619028 · Cited by 18
Wireless MapReduce Distributed Computing
Li, F., Chen, J., & Wang, Z. (2018) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2018.8437709 · Cited by 18
Layer-wise Deep Neural Network Pruning via Iteratively Reweighted Optimization
Jiang, T., Yang, X., Shi, Y., & Wang, H. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682464 · Cited by 17
Self-citationStochastic Gradient Coding for Flexible Straggler Mitigation in Distributed Learning
Bitar, R., Wootters, M. K., & Rouayheb, S. E. (2019) · IEEE Information Theory Workshop (ITW) · doi:10.1109/itw44776.2019.8989328 · Cited by 17
MapReduce-based deep learning with handwritten digit recognition case study
Basit, N., Zhang, Y., Wu, H., Liu, H., Bin, J., He, Y., & Hendawi, A. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840783 · Cited by 15
Wireless Map-Reduce Distributed Computing with Full-Duplex Radios and Imperfect CSI
Ha, S., Zhang, J., Simeone, O., & Kang, J. (2019) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2019.8815393 · Cited by 15
Self-citationFundamental Limits of Wireless Distributed Computing Networks
Ji, M., & Chen, R. (2018) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2018.8485811 · Cited by 12
Mobile Edge Computing and Artificial Intelligence: A Mutually-Beneficial RelationshipPreprint
Al-Habob, A. A., & Dobre, O. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.03100 · Cited by 11
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning
Du, Y., Yang, S., & Huang, K. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969082 · Cited by 10
Distributed Sensing With Orthogonal Multiple Access: To Code or not to Code?
Dong, Y. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2971203 · Cited by 9
Distributed Stochastic Gradient Descent Using LDGM CodesPreprint
Horii, S., Yoshida, T., Kobayashi, M., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.04668 · Cited by 8
Communication constrained cloud-based long-term visual localization in real time
Ding, X., Wang, Y., Tang, L., Yin, H., & Xiong, R. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968550 · Cited by 8
Distributed quantized gradient-free algorithm for multi-agent convex optimization
Ding, J., Yuan, D., Jiang, G., & Zhou, Y. (2017) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc.2017.7978329 · Cited by 7
Large-Scale Beamforming for Massive MIMO via Randomized Sketching
Choi, H., Jiang, T., Shi, Y., Liu, X., Zhou, Y., & Letaief, K. B. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3071543 · Cited by 7
Self-citationElastic Gossip: Distributing Neural Network Training Using Gossip-like ProtocolsPreprint
Pramod, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02407 · Cited by 4
Sahu, A. K., Jakovetić, D., Bajović, D., & Kar, S. (2018) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2018.8646406 · Cited by 4
Large-Scale Beamforming for Massive MIMO via Randomized SketchingPreprint
Choi, H., Jiang, T., Shi, Y., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05904 · Cited by 4
Self-citationCommunication constrained cloud-based long-term visual localization in real timePreprint
Ding, X., Wang, Y., Tang, L., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03968 · Cited by 4
Pliable Data Shuffling for On-device Distributed Learning
Jiang, T., Yang, K., & Shi, Y. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682270 · Cited by 4
Self-citationTowards a Theoretical Understanding of Hashing-Based Neural NetsPreprint
Lin, Y., Song, Z., & Yang, L. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.10244 · Cited by 3
Communication Topologies Between Learning Agents in Deep Reinforcement Learning.Preprint
Adjodah, D., Calacci, D., Dubey, A., Goyal, A., Krafft, P. M., Moro, E., & Pentland, A. (2019) · arXiv (Cornell University) · Cited by 3
ELASTIC GOSSIP: DISTRIBUTING NEURAL NETWORK TRAINING USING GOSSIP-LIKE PROTOCOLSPreprint
Pramod, S. (2018) · arXiv (Cornell University) · doi:10.13016/m2cl1x-yatq · Cited by 3
Research works printed but not linked: 10
- 2016, Regulation (EU) 2016/679 of the European parliament and of the council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (general data protection regulation), Official J Eur Union, 119, 1
- bughin, 2018, Assessing the Economic Impact of Artificial Intelligence
- chen, 2019, signSGD via zeroth-order oracle, Proc Int Conf Learn Represent (ICLR), 6
- 2018, Cisco Global Cloud Index Forecast and Methodology 2016–2021 White Paper
- 10.1109/twc.2019.2963654 · doi:10.1109/twc.2019.2963654
- 10.15607/rss.2019.xv.063 · doi:10.15607/rss.2019.xv.063
- 2019, NVIDIA Clara An Application Framework Optimized for Healthcare and Life Sciences Developers
- 2018, Fate An Industrial Grade Federated Learning Framework
- hu, 2015, Mobile edge computing—A key technology towards 5G
- mao, 2018, A privacy-preserving deep learning approach for face recognition with edge computing, Proc USENIX Workshop Hot Topics Edge Comput (HotEdge), 308
Cited by
Federated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“edge devices are essential to reduce the uplink communication overheads, for which various data dimensionality reduction approaches have been proposed by exploiting the specific computation tasks and communication environments [29].”
BackgroundMethodInfluentialSelf-citationAgentic AI: Autonomous intelligence for complex goals–a comprehensive survey
Acharya, D. B., Kuppan, K., & Divya, B. (2025) · IEEE Access · doi:10.1109/access.2025.3532853 · Cited by 717
Siriwardhana, Y., Porambage, P., Liyanage, M., & Ylianttila, M. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3061981 · Cited by 674
Singh, R., & Gill, S. S. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.02.004 · Cited by 572
Metadata
- Authors
- Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B.
- Affiliations
- ShanghaiTech University (CN)
- Chinese Academy of Sciences (CN)
- Hong Kong Polytechnic University (HK)
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2020
- Volume
- 22
- Issue
- 4
- Pages
- 2167-2191
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W3041971333
- Cited by
- 488
- References
- 237
- Citations by year
- 2026: 58 · 2025: 97 · 2024: 93 · 2023: 100 · 2022: 73 · 2021: 53 · 2020: 12
- FWCI
- 27.96
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Communications Surveys & Tutorials (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Nature Science Foundation of China (61601290)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- edge AI, communication efficiency, edge computing, communication overhead, distributed learning, edge inference, IoT devices, privacy, energy consumption, wireless networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.