The DOI matches its Crossref record; 25 of the 27 references it cites were found in a registry or an index.
Communication-Efficient Federated Learning for Wireless Edge Intelligence in IoT
Abstract
The rapidly expanding number of Internet of Things (IoT) devices is generating huge quantities of data, but public concern over data privacy means users are apprehensive to send data to a central server for machine learning (ML) purposes. The easily changed behaviors of edge infrastructure that software-defined networking (SDN) provides makes it possible to collate IoT data at edge servers and gateways, where federated learning (FL) can be performed: building a central model without uploading data to the server. FedAvg is an FL algorithm which has been the subject of much study, however, it suffers from a large number of rounds to convergence with non-independent identically distributed (non-IID) client data sets and high communication costs per round. We propose adapting FedAvg to use a distributed form of Adam optimization, greatly reducing the number of rounds to convergence, along with the novel compression techniques, to produce communication-efficient FedAvg (CE-FedAvg). We perform extensive experiments with the MNIST/CIFAR-10 data sets, IID/non-IID client data, varying numbers of clients, client participation rates, and compression rates. These show that CE-FedAvg can converge to a target accuracy in up to 6× less rounds than similarly compressed FedAvg, while uploading up to 3× less data, and is more robust to aggressive compression. Experiments on an edge-computing-like testbed using Raspberry Pi clients also show that CE-FedAvg is able to reach a target accuracy in up to 1.7× less real time than FedAvg.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Implementation results on an industrial edge computing-like testbed using Raspberry Pi clients show the effectiveness of the proposed scheme with lower communication latency while the training accuracy is preserved.”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [174]
In the citing paper
“Furthermore, to enable intelligent and privacy-enhanced edgebased industrial IoT applications, many efficient FL solutions have been introduced to solve communication issues by using update reconstruction techniques [174], [175] or relevance detection during the model update [177].”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [174]
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
(2010) · Cited by 8,261
Federated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Federated Learning with Non-IID Data
Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., & Chandra, V. (2018) · arXiv · doi:10.48550/arxiv.1806.00582 · Cited by 2,077
Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2944481 · Cited by 1,725
Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing
Li, H., Ota, K., & Dong, M. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700202 · Cited by 1,566
Federated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134
Federated Learning of Deep Networks using Model AveragingPreprint
McMahan, H. B., Moore, E., Ramage, D., & y Arcas, B. A. (2016) · arXiv (Cornell University) · Cited by 1,005
Run-length encodings (Corresp.)
Golomb, S. W. (1966) · IEEE Transactions on Information Theory · doi:10.1109/tit.1966.1053907 · Cited by 990
Chen, Y., Sun, X., & Jin, Y. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2953131 · Cited by 597
Federated Learning: Collaborative Machine Learning without Centralized Training Data
Abhishek, V. A., Binny, S., Johan, T. R., Raj, N., & Thomas, V. (2022) · International Journal of Engineering Technology and Management Sciences · doi:10.46647/ijetms.2022.v06i05.052 · Cited by 489
Liu, C., Cao, Y., Luo, Y., Chen, G., Vokkarane, V., Yunsheng, M., Chen, S., & Hou, P. (2018) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2017.2662008 · Cited by 333
Federated Learning for Keyword Spotting
Leroy, D., Coucke, A., Lavril, T., Gisselbrecht, T., & Dureau, J. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683546 · Cited by 291
Sparse Binary Compression: Towards Distributed Deep Learning with minimal Communication
Sattler, F., Wiedemann, S., Muller, K.-R., & Samek, W. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852172 · Cited by 240
Federated Learning for Emoji Prediction in a Mobile Keyboard
Ramaswamy, S., Mathews, R., Rao, K., & Beaufays, F. (2019) · arXiv · doi:10.48550/arxiv.1906.04329 · Cited by 231
Pathinarupothi, R. K., Durga, P., & Rangan, E. S. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2870068 · Cited by 228
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188
Multi-subpopulation evolutionary algorithms for coverage deployment of UAV-networks
Reina, D. G., Tawfik, H., & Toral, S. L. (2017) · Ad Hoc Networks · doi:10.1016/j.adhoc.2017.09.005 · Cited by 76
Fog-Embedded Deep Learning for the Internet of Things
Lyu, L., Bezdek, J. C., He, X., & Jin, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2912465 · Cited by 61
Edge-Assisted Hierarchical Federated Learning with Non-IID DataPreprint
Liu, L., Zhang, J., Song, S., & Letaief, K. B. (2019) · arXiv (Cornell University) · Cited by 52
A New Learning Automata-Based Pruning Method to Train Deep Neural Networks
Guo, H., Li, S., Li, B., Ma, Y., & Ren, X. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2711426 · Cited by 42
Strategies for Re-Training a Pruned Neural Network in an Edge Computing Paradigm
Chandakkar, P. S., Li, Y., Ding, P. L. K., & Li, B. (2017) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/ieee.edge.2017.45 · Cited by 40
Research works printed but not linked: 3
- lecun, 2010, MNIST Handwritten Digit Database
- abadi, 2015, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
- lueth, 2018, State of the IoT 2018 Number of IoT devices now at 7B—Market accelerating
Cited by
Sorted by citations
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“[174] Communicationefficient FL HFL NN Edge devices Cloud server A communication-efficient FL approach called CE-FedAvg for optimizing communication rounds.”
BackgroundMethodFederated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. (2021) · Deakin Research Online (Deakin University) · Cited by 889
Survey on 6G Frontiers: Trends, Applications, Requirements, Technologies and Future Research
de Alwis, C., Kalla, A., Pham, Q., Kumar, P., Dev, K., Hwang, W., & Liyanage, M. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3071496 · Cited by 809
Federated learning meets blockchain in edge computing: Opportunities and challenges
Nguyen, D. C., Ding, M., Pham, Q.-V., Pathirana, P. N., Le, L. B., Seneviratne, A., Li, J., Niyato, D., & Poor, H. V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3072611 · Cited by 661
Metadata
- Authors
- Mills, J., Hu, J., & Min, G.
- Affiliations
- University of Exeter (GB)
- Venue
- IEEE Internet of Things Journal
- Published
- 2020-07
- Volume
- 7
- Issue
- 7
- Pages
- 5986-5994
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2991236681
- Cited by
- 436
- References
- 27
- Citations by year
- 2026: 28 · 2025: 50 · 2024: 88 · 2023: 89 · 2022: 96 · 2021: 56 · 2020: 29
- FWCI
- 20.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Open Research Exeter (University of Exeter) (acceptedVersion)
- Figshare (submittedVersion)
- Funders
- EPSRC DTP Studentship
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- federated learning, communication efficiency, Internet of Things, FedAvg, data compression, non-IID data, edge computing, data privacy, software-defined networking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
