Cited by 436Privacy-Preserving Technologies in DataIoT and Edge/Fog ComputingStochastic Gradient Optimization Techniques

Communication-Efficient Federated Learning for Wireless Edge Intelligence in IoT

Mills, Jed, Hu, Jia, Min, Geyong·2020·IEEE Internet of Things Journal

Abstract

The rapidly expanding number of Internet of Things (IoT) devices is generating huge quantities of data, but public concern over data privacy means users are apprehensive to send data to a central server for machine learning (ML) purposes. The easily changed behaviors of edge infrastructure that software-defined networking (SDN) provides makes it possible to collate IoT data at edge servers and gateways, where federated learning (FL) can be performed: building a central model without uploading data to the server. FedAvg is an FL algorithm which has been the subject of much study, however, it suffers from a large number of rounds to convergence with non-independent identically distributed (non-IID) client data sets and high communication costs per round. We propose adapting FedAvg to use a distributed form of Adam optimization, greatly reducing the number of rounds to convergence, along with the novel compression techniques, to produce communication-efficient FedAvg (CE-FedAvg). We perform extensive experiments with the MNIST/CIFAR-10 data sets, IID/non-IID client data, varying numbers of clients, client participation rates, and compression rates. These show that CE-FedAvg can converge to a target accuracy in up to 6× less rounds than similarly compressed FedAvg, while uploading up to 3× less data, and is more robust to aggressive compression. Experiments on an edge-computing-like testbed using Raspberry Pi clients also show that CE-FedAvg is able to reach a target accuracy in up to 1.7× less real time than FedAvg.

Integrity signals

Registry

Crossref · 10.1109/jiot.2019.2956615

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Implementation results on an industrial edge computing-like testbed using Raspberry Pi clients show the effectiveness of CE-FedAvg with lower communication latency while training accuracy is preserved.

    “Implementation results on an industrial edge computing-like testbed using Raspberry Pi clients show the effectiveness of the proposed scheme with lower communication latency while the training accuracy is preserved.”
  • To enable intelligent and privacy-enhanced edge-based industrial IoT applications, many efficient FL solutions have been introduced to solve communication issues by using update reconstruction techniques or relevance detection during the model update.

    “Furthermore, to enable intelligent and privacy-enhanced edgebased industrial IoT applications, many efficient FL solutions have been introduced to solve communication issues by using update reconstruction techniques [174], [175] or relevance detection during the model update [177].”

Cites

Flagged first, then by citations

2 of the 27 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Mills, J., Hu, J., & Min, G.
Affiliations
University of Exeter (GB)
Venue
IEEE Internet of Things Journal
Published
2020-07
Volume
7
Issue
7
Pages
5986-5994
ISSN
  • 2327-4662 (ISSN-L)
  • 2372-2541
OpenAlex
W2991236681
Cited by
436
References
27
Citations by year
2026: 28 · 2025: 50 · 2024: 88 · 2023: 89 · 2022: 96 · 2021: 56 · 2020: 29
FWCI
20.88
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Internet of Things Journal (publishedVersion)
  • Open Research Exeter (University of Exeter) (acceptedVersion)
  • Figshare (submittedVersion)
Funders
EPSRC DTP Studentship
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
  • Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Keywords
federated learning, communication efficiency, Internet of Things, FedAvg, data compression, non-IID data, edge computing, data privacy, software-defined networking

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review